Introducing Community Benchmarks on Kaggle – blog.google

Learn more:
Learn more:
Learn more:
Learn more:
Learn more:
Learn more:
Jan 14, 2026
Today’s AI models require more than static accuracy scores. Community Benchmarks, a new capability on Kaggle, enables the global AI community to design, run and share custom evaluations that better reflect real-world model behavior.

Kaggle launched Community Benchmarks so you can design and share custom benchmarks for evaluating AI models. You can build tasks to test model performance on specific problems. Group those tasks into a benchmark to evaluate leading AI models and track their performance on a leaderboard.

• “Introducing Community Benchmarks on Kaggle” lets the AI community design and share custom AI model evaluations.
• Community Benchmarks offer a transparent way to validate specific use cases for AI model performance.
• Build tasks to test AI models, then group them into benchmarks to compare model performance.
• You’ll get free access to models, reproducible results, complex interaction testing, and rapid prototyping.
• Kaggle’s Community Benchmarks help shape the future of AI by improving how models are evaluated.

Your browser does not support the audio element.
Today, Kaggle is launching Community Benchmarks, which lets the global AI community design, run and share their own custom benchmarks for evaluating AI models. This is the next step after we launched Kaggle Benchmarks last year, to provide trustworthy and transparent access to evaluations from top-tier research groups like Meta’s MultiLoKo and Google’s FACTS suite.
AI capabilities have evolved so rapidly that it’s become difficult to evaluate model performance. Not long ago, a single accuracy score on a static dataset was enough to determine model quality. But today, as LLMs evolve into reasoning agents that collaborate, write code and use tools, those static metrics and simple evaluations are no longer sufficient.
Kaggle Community Benchmarks provide developers with a transparent way to validate their specific use cases and bridge the gap between experimental code and production-ready applications.
These real-world use cases demand a more flexible and transparent evaluation framework. Kaggle’s Community Benchmarks provide a more dynamic, rigorous and continuously evolving approach to AI model evaluation — one shaped by the users building and deploying these systems everyday.
Benchmarks start with building tasks, which can range from evaluating multi-step reasoning and code generation to testing tool use or image recognition. Once you have tasks, you can add them to a benchmark to evaluate and rank selected models by how they perform across the tasks in the benchmark.
Here’s how you can get started:
Once you build your benchmark, here’s what benefits you’ll see:
These powerful capabilities are powered by the new kaggle-benchmarks SDK. Here are a few resources for getting started:
The future of AI progress depends on how models are evaluated. With Kaggle Community Benchmarks, Kagglers are no longer just testing models, they’re helping shape the next generation of intelligence.
Ready to build? Try Community Benchmarks today.
Let’s stay in touch. Get the latest news from Google in your inbox.
Follow Us

source