[NeMo Gym] v0.5.0 Roadmap

[sephmard]

Release date: August 5, 2026

This is a summary snapshot of the planned work targeted for the NeMo Gym v0.5.0 release. Updates will be managed in the GitHub Project Gym v0.5.0.

Agent Integration

• Simplify workflow when using existing agent harnesses external to NeMo Gym epic: external agent integration #1396
• Expand collection of built-in harnesses such as Codex, Pi, KiloCode, and Goose epic: built-in agent harness evaluations #1042
• Agent harness training compatibility epic: agent harness training compatibility #1824

Rollout Collection

• Token level stats at step-level and full trajectory-level resolution for all rollouts [epic] Token-level stats during rollout and eval #1483
• Standardized trajectories format [epic] standardised trajectories format #1867
• Recompute rewards from existing rollouts Can you recompute reward using existing rollout and a new verifier? #987

Deployment & Sandboxing

• Pluggable built in sandbox providers for portable execution across multiple runtimes epic: built-in sandbox providers #1685
• Enable NeMo Gym deployment on Kubernetes through Red Hat OpenShift epic: Enable Kubernetes for the Gym for OpenShift #1269

Usability

• Search & Discoverability for Environments and Components from the CLI [Epic] Search & Discoverability for Environments and Components from the CLI #1582
• Add orchestration layer for Evaluation Feat: Add Orchestration Layer for Evaluation #1640
• Simplify dataset ingestion with improved data preparation, validation, and conversion workflows epic: dataset preparation #1338

Benchmarks

• Expand collection of available benchmarks Epic: Validated Benchmarks to NeMo Gym for Nemotron #1451