Skip to content
RAG Repo

DataComp turns the usual model benchmark on its head. Instead of fixing the data and comparing models, it fixes the model architecture and training budget, then asks which slice of data produces the best results. The dataset you build is the thing under test.

It ships a common candidate pool of image-text pairs at several scales, along with a standard training and evaluation setup. Teams filter or reweight that pool with their own curation ideas and measure the effect on downstream tasks, making results directly comparable across approaches.

image-textbenchmarkdata-curationweb-scalemultimodal

Related sources