Skip to content
#

human-annotation

Star

Here are 8 public repositories matching this topic...

Language: All
Filter by language
All 8 Jupyter Notebook 3 Python 3 HTML 1 JavaScript 1

RaptorMai / CompBench

Star 31

CompBench evaluates the comparative reasoning of multimodal large language models (MLLMs) with 40K image pairs and questions across 8 dimensions of relative comparison: visual attribute, existence, state, emotion, temporality, spatiality, quantity, and quality. CompBench covers diverse visual domains, including animals, fashion, sports, and scenes.

benchmark reasoning vision-and-language multimodal-deep-learning human-annotation foundation-models large-language-models llms vision-language-model multimodal-large-language-models evaluation-llms llms-benchmarking
  • Updated Aug 6, 2024
  • Jupyter Notebook

Improve this page

Add a description, image, and links to the human-annotation topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the human-annotation topic, visit your repo's landing page and select "manage topics."

Learn more