KARMA OpenMedEvalKit

Evaluate medical AI models - text, image and audio - on one framework.

An evaluation framework for medical AI. Run any model - Qwen, MedGemma, OpenAI or Bedrock APIs, or your own - against 12+ medical datasets across text, images and audio, with standard metrics and cached results. New models and datasets register themselves.