AIEval

EvalAI: The open-source platform for robust, at-scale evaluation and comparison of machine learning and AI algorithms.

EvalAI is your definitive, open-source solution for evaluating state-of-the-art AI. This platform handles large-scale evaluation, supporting over 450 hosted AI challenges, 51,000+ users, and 500,000+ submissions with custom protocols: You define the evaluation phases, dataset splits, and even integrate remote evaluation clusters. Agents submit code via Docker images for secure, environment-specific testing. We deliver the definitive, public, and private leaderboards you need to drive credible ML/AI progress.

https://eval.ai