Reposen Monogram
Reposenreposen.se
/llm.txtGitHub Repo
NVIDIA icon

NVIDIA/SkillEvaluator

v0.9.0

Curated ai tools / ai-evals / testing repository (NVIDIA/SkillEvaluator) tracked via conditional GitHub .atom polling.

COMPATIBLE
What is NVIDIA/SkillEvaluator?

SkillEvaluator is a multi-tier evaluation framework and CI/CD quality gate from NVIDIA for testing AI agent skills and plugins before production rollout. It solves the challenge of silent agent regressions by running security scans, semantic overlap detection, synthetic dataset generation, and live agent benchmarks to measure real behavioral impact.

TESTINGpypi:skillevaluatorPythonreleases.atom
3,242+12 stars (24h)
#ai-evals#skillevaluator
AI Executive Summary & Artifact Size Impact
Quick Summary: What Changed · What To Do · Upgrade Effort

Build and review better evaluation datasets. Declare deter. Drop-in upgrade. Migration: None.

Semver: MINOR·Manifest: pyproject.toml
Artifact Size Impactunavailable
Size Unavailable
Telemetry unmeasured for pre-release or source-only registry build
Breaking Changes, Release Highlights & Migration Snippet

Key Release Highlights (v0.9.0)

  • Build and review better evaluation datasets. Declare deterministic checks for script execution, workspace files, and final responses. Generate datasets grounded in skill ins...
  • Track skill improvements over time. Compare retained skill versions with --compare-to and compare-versions, browse run history, and reuse a compatible no-skill baseline ...
  • Control evaluation spending. Set token, judge-call, attempt, and priced-cost budgets. Reports retain partial results when limits stop a run. Token usage is shown per case an...
  • Understand the evidence behind each result. Reports show met, unmet, unchecked, and inapplicable expectations; dataset coverage and sufficiency; skill activation; failed-arm...
Zero Breaking Changes Detected

Verified safe drop-in upgrade for skillevaluator in pyproject.toml.

Copy-Paste Upgrade / Migration Snippet
npm install skillevaluator@0.9.0

Ecosystem Compatibility Matrix & Verified Graph Warnings

TypeScript 5.xcompatible— Ships standard TypeScript declaration files without type regressions.

Zero-Noise Historical Release Timeline (1)

Format: [Core Change] + [Required Action] + [Migration Effort]
v0.9.0COMPATIBLE⚖️ Size Unavailable

Build and review better evaluation datasets. Declare deter. Drop-in upgrade. Migration: None.

Upgrade & Migration Q&A (NVIDIA/SkillEvaluator v0.9.0)

Direct Answers for Engineers & AI Agents

Is NVIDIA/SkillEvaluator v0.9.0 safe to upgrade in production?

NVIDIA/SkillEvaluator v0.9.0 is classified as COMPATIBLE (MINOR release). Build and review better evaluation datasets. Declare deter. Drop-in upgrade. Migration: None.

What breaking changes or compatibility risks exist in NVIDIA/SkillEvaluator v0.9.0?

No breaking API changes or peer dependency conflicts are recorded for NVIDIA/SkillEvaluator v0.9.0 in the Reposen compatibility graph.

What is the bundle size impact of skillevaluator v0.9.0?

Measured bundle size telemetry is currently unavailable for skillevaluator v0.9.0; verify build output locally before deploying.

How do I upgrade skillevaluator to v0.9.0?

Upgrade skillevaluator to v0.9.0 by running "pip install skillevaluator==0.9.0" and applying the migration steps: npm install skillevaluator@0.9.0

Related Engineering Blueprints (1)

All Engineering Articles
10 min read

The Infrastructure Race: How Tech Giants Are Standardizing AI Agent Architecture

Architectural analysis of Alibaba open-code-review, Tencent LoopForge, and NVIDIA SkillEvaluator: hybrid pipelines, human approval gates, and CI/CD skill evals.