evals
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
About this project
OpenAI Evals You can now configure and run Evals directly in the OpenAI Dashboard. Get started → Evals provide a framework for evaluating large language models (LLMs) or systems built using LLMs. We offer an existing registry of evals to test different dimensions of OpenAI models and the ability to write your own custom evals for use cases you care about. You can also use your data to build private evals which represent the common LLMs patterns in your workflow without exposing any of that data publicly. If you are building with LLMs, creating high quality evals is one of the most impactful things you can do. Without evals, it can be very difficult and time intensive to understand how…
Technologies
Project health
GitHub
Reviews
Built by
Maintain openai/evals? Claiming verifies admin access through your GitHub account and gives you control of this listing.
