Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Why write ten lines of code when one will do? From magic variable swaps to high-speed data counting, these Python snippets will transform your code.
💻 local machines, e.g., macOS (+ Apple Silicon/MPS) and Linux/Windows WSL (+ NVIDIA GPU). 🌐 Remote Linux servers with GPUs, e.g., VMs on cloud providers and IC and RCP HaaS at EPFL. ☁️ Managed ...