openenv/pr_749/en/environments.md

Environments

The environments listed here may not reflect the latest additions. For the official OpenEnv collection, see the OpenEnv organization on Hugging Face. You may also find additional community environments tagged agent-environment on Hugging Face Spaces. The environments highlighted below are a curated selection.

The OpenEnv community has built a catalog of ready-to-run environments that cover deterministic smoke tests, full developer workflows, and multi-step reasoning challenges. Explore the surface area below and jump directly into the guides for each environment.

  Echo
  Minimal observation/action loop for verifying client integrations, CI pipelines, and onboarding flows in seconds.
  
    📄 Docs
    🤗 HF
  


  Coding
  Secure sandbox with filesystem access and evaluation hooks for executing generated code and building autonomous dev workflows.
  
    📄 Docs
    🤗 HF
  


  Jupyter
  Notebook-style coding environment backed by E2B with setup/verify hooks and a web UI for interactive runs.
  
    📄 Docs
  


  Terminus
  Terminal-first coding environment with high-contrast shell output and session controls for execute/verify/close flows.
  
    📄 Docs
  


  Coding Tools
  SETA-style multi-tool coding environment with shell, file editing, search, todos, and submit verification.
  
    📄 Docs
  


  Chat
  Message-driven loop tailored for conversational agents that need structured turns, safety rails, and message attribution.
  
    📄 Docs
    🤗 HF
  


  Atari
  Classic Arcade Learning Environment tasks packaged for fast benchmarking of reinforcement-learning style agents.
  
    📄 Docs
    🤗 HF
  


  OpenSpiel
  Multi-agent, game-theory workloads powered by DeepMind's OpenSpiel suite, ideal for search and self-play experiments.
  
    📄 Docs
    🤗 HF
  


  SUMO-RL
  Traffic control scenarios with SUMO simulators for agents that reason about continuous control and scheduling.
  
    📄 Docs
  


  FinRL
  Financial market simulations with portfolio APIs, perfect for RLHF strategies and algorithmic trading experiments.
  
    📄 Docs
  


  TextArena
  Multi-task text arena for language-game competitions such as Wordle, reasoning puzzles, and program synthesis.
  
    📄 Docs
    🤗 HF
  


  Git
  Teaches agents to navigate repositories, inspect diffs, and land changes via Git-native operations.
  
    📄 Docs
  


  DIPG Safety
  Safety-critical diagnostics from the DIPG benchmark, highlighting guardrails, adversarial prompts, and risk scoring.
  
    📄 Docs
    🤗 HF
  


  Snake
  Classic snake game environment for RL research with configurable grids, partial observability, and customizable rewards.
  
    📄 Docs
    🤗 HF
  


  Web Search
  Web search environment for RL research with configurable grids, partial observability, and customizable rewards.
  
    📄 Docs
    🤗 HF
  


  BrowserGym
  Browser automation environment for web agents with DOM interaction, navigation, and multi-step task completion.
  
    📄 Docs
    🤗 HF
  


  KernRL
  RL environment for GPU kernel optimization. Train LLM agents to write fast CUDA/Triton kernels that beat baseline implementations.
  
    📄 Docs
  


  Calendar
  Calendar tool-use environment exposing a Calendar Gym through the OpenEnv reset/step/state interface for scheduling agents.
  
    📄 Docs
  


  CARLA
  Embodied evaluation environment for testing LLM decision-making in a full 3D driving simulator with irreversible consequences and ethical trolley scenarios.
  
    📄 Docs
    🤗 HF
  


  Chess
  Chess RL environment powered by the moonfish engine with configurable opponents, position evaluation, and full chess rules.
  
    📄 Docs
  


  Connect4
  Classic Connect Four board game environment for training agents on turn-based strategy with a 6×7 grid.
  
    📄 Docs
  


  DM Control
  Generic OpenEnv wrapper for dm_control.suite, providing access to all MuJoCo-based continuous control tasks like cartpole, walker, and humanoid.
  
    📄 Docs
  


  FinQA
  Financial question-answering environment that evaluates LLMs on complex financial questions using tool calls on SEC 10-K filing data.
  
    📄 Docs
  


  Grid World
  Simple 5×5 grid world RL testbed and step-by-step guide for building new OpenEnv environments from scratch.
  
    📄 Docs
    🤗 HF
  


  Julia
  Julia code execution environment with test result tracking and reward calculation for RL training on Julia programming tasks.
  
    📄 Docs
  


  Maze
  Gridworld maze where agents navigate from start to exit while avoiding walls, with configurable 8×8 layouts.
  
    📄 Docs
  


  OpenApp
  Web application simulation wrapping the OpenApps framework and BrowserGym for training UI agents on calendar, todo, messenger, and maps apps.
  
    📄 Docs
  


  Reasoning Gym
  Integrates the Reasoning Gym library to provide single-step reasoning tasks with configurable datasets and scoring.
  
    📄 Docs
  


  REPL
  Python REPL environment for code execution tasks based on the Recursive Language Models paradigm with sandboxed execution and context loading.
  
    📄 Docs
  


  TB2
  OpenEnv wrapper for Terminal-Bench 2 tasks with local and Docker execution modes for terminal-based agent evaluation.
  
    📄 Docs
  


  Unity
  OpenEnv wrapper for Unity ML-Agents environments, providing access to Unity's RL environments through HTTP/WebSocket interfaces.
  
    📄 Docs
  


  Wildfire
  Autonomous wildfire-control simulation where agents contain spreading fires using water, firebreaks, and timing under dynamic conditions.
  
    📄 Docs
  


  Agent World Model
  AgentWorldModel-1K — 1,000 synthetic MCP tool-use environments with 10,000 tasks for large-scale agentic RL training.
  
    📄 Docs
    🤗 HF
  


  OpenCode
  opencode_env runs the OpenCode coding agent inside an isolated E2B sandbox against any OpenAI-compatible LLM endpoint, optionally capturing per-token logprobs.
  
    📄 Docs
  

Want to publish your own environment? Head over to the Build Your Own Environment guide for a step-by-step walkthrough.

Community Environments

  RLVE Gym
  A suite of 400 environments that procedurally generate reasoning problems for LM training with configurable difficulty.
  
    📄 Docs
    🤗 HF