The founders of the popular generative artificial intelligence benchmarking platform LMArena have said they’re founding an official company called Arena Intelligence Inc. to help them improve the project in future.
LMArena’s founders wrote in a blog post today that the new company will enable it to acquire the resources they need to implement significant improvements to its neutral large language model testing platform. However, they stressed that they’ll continue to ensure LMArea offers a neutral testing ground for AI users that’s not influenced by any corporate entities.
LMArena was founded in 2023 by a group of University of California, Berkeley researchers. It has steadily emerged to become one of the most reputable AI benchmarking platforms in the business. It has partnered with major companies including Google LLC, OpenAI and Anthropic PBC to enable the AI community to evaluate their models and publish the results for all to see.
The project initially received funding in the shape of donations and grants from sources including the venture capital firm Andreessen Horowitz, Google’s Kaggle data science platform and Together Computer Inc.
In their blog post, the LMArena team said that some of its members had recently graduated from UC Berkeley and would like to continue working on the project. They explained they make an “even better service” for the AI community. However, they reiterated that they’ll stay true to LMArena’s original mission, which is to provide a neutral and open platform for testing and evaluating AI Models.
“Our leaderboard will never be biased towards (or against) any provider, and will faithfully reflect our community’s preferences by design. It will be science-driven,” the founders wrote. “Staying neutral and earning community trust will always be essential to the success of our business. But this isn’t just about being strategic; it’s our choice, and part of our personal motivations for starting this company. So we will never deviate from that north star.”
By starting an official company, the founders say they’ll be able to accelerate this mission, and as a first step towards that they’re already rebuilding the core LMArena platform, which is now available in beta for community feedback. As part of that effort, they’ve already set about fixing numerous bugs and enhancing the user experience with new features such as logins, chat histories and personal leaderboards.
In addition, the new company will also support more open research, with a focus on new LLM evaluations such as WebDev Arena, RepoChat Arena and Search Arena.
What the founders didn’t reveal was how they’re aiming to make money. They stressed that they haven’t yet fully ironed out the company’s business model, nor have they secured any financial backing thus far. But they’re confident they’ll be able to start making money soon.
“We know AI companies want access to neutral and reliable evaluation services to speed up model development and improve real-world performance,” the founders wrote. “This applies to first-party model providers and also to other companies for whom AI is a core part of their business.”
Image: LMArena
Your vote of support is important to us and it helps us keep the content FREE.
One click below supports our mission to provide free, deep, and relevant content.
Join our community on YouTube
Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.
THANK YOU
