At H2O.ai, our mission has always been clear: to enable the responsible and scalable adoption of AI. As part of our commitment to providing our customers with the tools they need to build, test, and govern their AI systems effectively, we are announcing our latest collaboration with AI Verify Foundation.

The AI Verify Foundation is a not-for-profit Foundation is a wholly owned subsidiary of the Infocomm Media Development Authority (IMDA). The Foundation aims to harness the collective power and contributions of the global open-source community to develop AI testing tools to enable responsible AI. At H2O.ai, we believe that responsible AI starts with ensuring transparency, accountability, and governance throughout the lifecycle of AI systems, from development to deployment. We have developed robust tools like H2O Eval Studio for customers to systematically assess the performance, security, fairness, and overall effectiveness of LLMs and Retrieval-Augmented Generation systems. Our collaboration with AI Verify Foundation will further strengthen such efforts, ensuring organizations can meet both internal governance standards and external regulatory requirements.

Through this collaboration, H2O.ai is proud to contribute to AI Verify Foundation’s flagship open-source initiative, Project Moonshot, which focuses on the testing and evaluation of large language models. Specifically, H2O.ai will contribute benchmarks and code to Project Moonshot, enhancing the toolkit for evaluating LLM applications across industries. This partnership also allows us to integrate tests recommended by AI Verify Foundation into H2O EvalStudio, empowering our users to leverage industry-leading standards and insights for their AI testing needs.

Shameek Kundu, Executive Director of the AI Verify Foundation, in endorsing this collaboration, commented: ”We believe that having the right tools and approaches to AI testing is crucial to enabling the adoption of AI for the benefit of society, businesses, and citizens alike. We are very pleased to have H2O.ai, an active member of the foundation, as a partner in this journey to drive responsible AI testing at scale.”

H2O.ai is excited about the future of this collaboration and looks forward to working closely with the AI Verify Foundation and the broader community. Together, we will continue to advance the state of responsible AI, ensuring AI systems can be trusted to serve the needs of society.

Stay tuned for more updates on our work with the AI Verify Foundation and how it will contribute to building a safer, more transparent AI ecosystem for all.