Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
--values-file, -v Values files to validate (comma-separated or multiple flags) Defaults to values.yaml --rules-file, -r Rules files to validate against (comma-separated or multiple flags) Defaults to ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results