Confident AI

About

Confident AI allows companies of all sizes to benchmark, safeguard, and improve LLM applications, with best-in-class metrics and guardrails powered by DeepEval. Built by the creators of DeepEval (12.6k stars, >3m monthly downloads), Confident AI is able to offer battle-tested, open-source evaluation algorithms while providing the infrastructure needed for teams to stay confident their LLM systems.

Founders

• 
  Jeffrey Ip· CEO & Cofounder

  Creator of DeepEval, the open-source LLM evaluation framework. and grew it to over 400k monthly downloads and counting. Previously SWE @ Google, Microsoft.

  LinkedIn ↗Twitter ↗
• 
  Kritin Vongthongsri· Co-Founder

  Building the #1 LLM Evaluation Platform & empowering teams to red-team and safeguard LLM apps. AI Researcher and CHI-published author, previously built NLP pipelines for fintech startup and researched self-driving cars/HCI during @ Princeton (ORFE'24 + CS).

  LinkedIn ↗

Product launches · 1 launch

• Confident AI: The Evals Platform for AI Quality & Observability ↗▲ 374Feb 13, 2025

  An evaluation platform for engineers, QAs, and PMs to pinpoint which iteration of their AI to put in production.

Change history · none recorded