smevals - a small eval suite for evaluating models, prompts, and harnesses
Smevals is a new lightweight evaluation framework designed to test models, prompts, and harnesses across various configurations.
Developed by Prime Radiant, smevals provides a streamlined way to run small eval suites and grade model outputs. It is designed to be easily integrated into coding agent workflows, allowing developers to quickly iterate on prompts and model capabilities.