Challenge Mechanics

• We ask participants to make use of the meta-train dataset (MedMNIST v2), which is essentially a compilation of various datasets, encompassing a broad spectrum of imaging modalities such as binary, multi-class, or multi-label classification. 
• Teams that participate in the MeDA challenge will utilize this data to train a cross-domain learning algorithm. Its effectiveness will be locally gauged by evaluating its capacity to perform well on a left-out classification task using a limited N number of samples. 
• Potential algorithmic strategies can be inspired by techniques like meta-learning, transfer learning, or self-supervised pre-training.

Testing and ranking

• Teams must submit a trained model (exported in ONNX format), and this model must be trained only on the provided dataset (MedMNIST v2).
• The organizers will test the model using a private, unseen 3 testing datasets targeting different  endoscopic classification tasks. Each dataset has been processed so it contains 6 classes. The application area is not revealed to avoid giving an unfair advantage through information leakage.
• Metrics used to evaluate the performance of the models are the average of accuracy and F1 score across the 3 testing datasets. Teams will be ranked based on these results.

Submission procedure

• A CMT link is provided for the participant teams. The participants should create a team name and do the submission using an anonymous email (i.e, team-name@domain.com) to avoid any bias in the challenge process. The submission should include the paper and link to code/model (ONNX model).

  
Note: please avoid any institutional or country-based references in the name of your team

            
Challenge Timeline

• Submission portal opens: 15 September 2025
• Registration deadline: 15 October 2025 (create a submission in CMT)
• Submission deadline: 25 October 2025 (final submission in CMT)
• Top-performing teams contacted: 2 November 2025
• Results announced at MICAI 2025: 5 November 2025

Conference Participation Dynamics

• Teams must send an 4-page paper abstract in IEEE standard format showing their procedure, explaining their method and showing results. Use the IEEE Format found at the end.
• The best ranking teams will do a short presentation of their work during the MICAI conference on November 5th, 2025
• The mode of participation will be HYBRID (teams can join via zoom if is not possible for them to attend) 

Prizes

Prizes will be announced during the competition in Guanajuato. The top three methods will receive a full registration grant for MICAI 2026 to publish an extended version of their paper.

Rules

• Participating teams may consist of one or more individuals (max 5 individuals). Each individual may only be part of one team. The creation of multiple accounts to circumvent this rule is not permitted.

• All valid results will be announced publicly through the leaderboard. The teams of the three top-performing methods will be invited to publish their work in a special issue.

• We aim to publish an analysis of the challenge results. The three top-performing teams will be invited to contribute to this publication. Moreover, the challenge organizers may invite additional teams with particularly novel/interesting algorithms to contribute.

• Participating teams are free to publish their own algorithms and results separately but may only reference the overall challenge results once the challenge paper is published.

• The participants may use the data we provide, i.e. our meta-dataset for training. Additionally, a set of publicly available and commonly used computer vision datasets, may be used, specifically:

1. 1. 1. ImageNet (ILSVRC 2012), miniImageNet, tieredImageNet
      2. CIFAR 100, CIFAR-FS
      3. MSCOCO
      4. Omniglot

• The use of openly available pre-trained neural networks trained exclusively on the above datasets is also permitted. Any pre-trained networks used, as well as the data used for training must be reported in the post-submission report.

• The test data will contain previously unseen (not contained in the meta-training data) data scarce scenarios that bear resemblance to the meta-training data, but is distinct from them.
• Participating teams are expected to make their methods fully reproducible. This includes the availability of code, any additional data used, as well as instructions on how to replicate the results.

CMT submission site: Track: MeDA Challenge 2025

Contact
For further details and questions please contact the organizers

• Dr. Gilberto Ochoa-Ruiz, gilberto.ochoa@tec.mx
• Msc. Ivan Reyes-Amezcua, ivan.reyes@cinvestav.mx

Acknowledgements
This challenge is organized in the context of the  project 322537 “ML-INSIDE: Novel Machine Learning Methods  for Image aNalysiS & bIomeDical Engineering in Endoscopy” funded by CONAHCYT through  the SEP-CONAHCYT-ANUIES-ECOS NORD Francia program.