Skip to main content

huggingface-community-evals

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

Stars
1,305
Source
openai/plugins
Updated
2026-05-30
Slug
openai--plugins--community-evals
View on GitHubRaw SKILL.md

// install — copy + paste into any project

mkdir -p .claude/skills && curl -fsSL https://raw.githubusercontent.com/openai/plugins/HEAD/plugins/hugging-face/skills/community-evals/SKILL.md -o .claude/skills/community-evals.md

Drops the SKILL.md into .claude/skills/community-evals.md. Works with Claude Code, Cursor, and any agent that loads SKILL.md files from .claude/skills/.