simulate/v0.0.2/en/tutorials.html

<meta charset="utf-8" /><meta http-equiv="content-security-policy" content=""><meta name="hf:doc:metadata" content="{&quot;local&quot;:&quot;overview&quot;,&quot;sections&quot;:[{&quot;local&quot;:&quot;examples&quot;,&quot;title&quot;:&quot;Examples&quot;},{&quot;local&quot;:&quot;advanced-usage&quot;,&quot;title&quot;:&quot;Advanced Usage&quot;}],&quot;title&quot;:&quot;Overview&quot;}" data-svelte="svelte-1phssyn">
	<link rel="modulepreload" href="/docs/simulate/v0.0.2/en/_app/assets/pages/__layout.svelte-hf-doc-builder.css">
	<link rel="modulepreload" href="/docs/simulate/v0.0.2/en/_app/start-hf-doc-builder.js">
	<link rel="modulepreload" href="/docs/simulate/v0.0.2/en/_app/chunks/vendor-hf-doc-builder.js">
	<link rel="modulepreload" href="/docs/simulate/v0.0.2/en/_app/chunks/paths-hf-doc-builder.js">
	<link rel="modulepreload" href="/docs/simulate/v0.0.2/en/_app/pages/__layout.svelte-hf-doc-builder.js">
	<link rel="modulepreload" href="/docs/simulate/v0.0.2/en/_app/pages/tutorials.mdx-hf-doc-builder.js">
	<link rel="modulepreload" href="/docs/simulate/v0.0.2/en/_app/chunks/Tip-hf-doc-builder.js">
	<link rel="modulepreload" href="/docs/simulate/v0.0.2/en/_app/chunks/IconCopyLink-hf-doc-builder.js"> 






<h1 class="relative group"><a id="overview" class="header-link block pr-1.5 text-lg no-hover:hidden with-hover:absolute with-hover:p-1.5 with-hover:opacity-0 with-hover:group-hover:opacity-100 with-hover:right-full" href="#overview"><span><svg class="" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" aria-hidden="true" role="img" width="1em" height="1em" preserveAspectRatio="xMidYMid meet" viewBox="0 0 256 256"><path d="M167.594 88.393a8.001 8.001 0 0 1 0 11.314l-67.882 67.882a8 8 0 1 1-11.314-11.315l67.882-67.881a8.003 8.003 0 0 1 11.314 0zm-28.287 84.86l-28.284 28.284a40 40 0 0 1-56.567-56.567l28.284-28.284a8 8 0 0 0-11.315-11.315l-28.284 28.284a56 56 0 0 0 79.196 79.197l28.285-28.285a8 8 0 1 0-11.315-11.314zM212.852 43.14a56.002 56.002 0 0 0-79.196 0l-28.284 28.284a8 8 0 1 0 11.314 11.314l28.284-28.284a40 40 0 0 1 56.568 56.567l-28.285 28.285a8 8 0 0 0 11.315 11.314l28.284-28.284a56.065 56.065 0 0 0 0-79.196z" fill="currentColor"></path></svg></span></a>
	<span>Overview
	</span></h1>

<p>Welcome to the 🤗 Simulate tutorials! These beginner-friendly tutorials will guide you through the fundamentals of working with 🤗 Simulate. You’ll load and prepare an environment for training with your Deep RL framework of choice. Along the way, you’ll learn how to define and load different Assets, Sensors and Actuators, watch an RL Agent interact with and see what’s inside your environment and share a dataset to the <a href="https://huggingface.co/Spaces" rel="nofollow">Hub</a>.</p>
<h2 class="relative group"><a id="examples" class="header-link block pr-1.5 text-lg no-hover:hidden with-hover:absolute with-hover:p-1.5 with-hover:opacity-0 with-hover:group-hover:opacity-100 with-hover:right-full" href="#examples"><span><svg class="" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" aria-hidden="true" role="img" width="1em" height="1em" preserveAspectRatio="xMidYMid meet" viewBox="0 0 256 256"><path d="M167.594 88.393a8.001 8.001 0 0 1 0 11.314l-67.882 67.882a8 8 0 1 1-11.314-11.315l67.882-67.881a8.003 8.003 0 0 1 11.314 0zm-28.287 84.86l-28.284 28.284a40 40 0 0 1-56.567-56.567l28.284-28.284a8 8 0 0 0-11.315-11.315l-28.284 28.284a56 56 0 0 0 79.196 79.197l28.285-28.285a8 8 0 1 0-11.315-11.314zM212.852 43.14a56.002 56.002 0 0 0-79.196 0l-28.284 28.284a8 8 0 1 0 11.314 11.314l28.284-28.284a40 40 0 0 1 56.568 56.567l-28.285 28.285a8 8 0 0 0 11.315 11.314l28.284-28.284a56.065 56.065 0 0 0 0-79.196z" fill="currentColor"></path></svg></span></a>
	<span>Examples
	</span></h2>

The examples assume some basic knowledge of Python, Deep Reinforcement Learning and a Deep RL framework like [Stable Baselines 3](https://stable-baselines3.readthedocs.io/en/master/).
If you&#39;re already familiar with these, feel free to check out the [quictour](./quicktour) to see what you can do with 🤗 Simulate. If you want to learn more about Deep Reinforcement Learning, check of the 🤗 [Deep RL course](https://github.com/huggingface/deep-rl-class#the-hugging-face-deep-reinforcement-learning-class-).


<div class="course-tip  bg-gradient-to-br dark:bg-gradient-to-r before:border-green-500 dark:before:border-green-800 from-green-50 dark:from-gray-900 to-white dark:to-gray-950 border border-green-50 text-green-700 dark:text-gray-400">The examples only cover the basic skills you need to use 🤗 Simulate. There are many other useful functionalities and applications that aren&#39;t discussed here, we will expand on these in upcoming releases.
</div>
<p>To make it easy to run the examples, most of them will download an engine build from the hub.
You can change this in many examples by specifying a <code>build_exe</code> at runtime, e.g. if you are adding a new backend feature!
Here are the three cases for <code>build_exe</code> at runtime:</p>
<ol><li>(default) <code>--build_exe=&quot;&quot;</code>: download appropriate executable from the hub and run. This will cache a version for you to re-run!</li>
<li><code>--build_exe=/local/path/</code>: run a local development version of an executable.</li>
<li><code>--build_exe=debug</code>: run the example in the engine editor (requires installation). This can also be triggered when <code>build_exe</code> is set to <code>None</code> in the example.</li></ol>
<p>If you have any questions about 🤗 Simulate, feel free to join and ask the community on our <a href="https://discuss.huggingface.co/c/simulate/10" rel="nofollow">forum</a>.</p>
<h2 class="relative group"><a id="advanced-usage" class="header-link block pr-1.5 text-lg no-hover:hidden with-hover:absolute with-hover:p-1.5 with-hover:opacity-0 with-hover:group-hover:opacity-100 with-hover:right-full" href="#advanced-usage"><span><svg class="" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" aria-hidden="true" role="img" width="1em" height="1em" preserveAspectRatio="xMidYMid meet" viewBox="0 0 256 256"><path d="M167.594 88.393a8.001 8.001 0 0 1 0 11.314l-67.882 67.882a8 8 0 1 1-11.314-11.315l67.882-67.881a8.003 8.003 0 0 1 11.314 0zm-28.287 84.86l-28.284 28.284a40 40 0 0 1-56.567-56.567l28.284-28.284a8 8 0 0 0-11.315-11.315l-28.284 28.284a56 56 0 0 0 79.196 79.197l28.285-28.285a8 8 0 1 0-11.315-11.314zM212.852 43.14a56.002 56.002 0 0 0-79.196 0l-28.284 28.284a8 8 0 1 0 11.314 11.314l28.284-28.284a40 40 0 0 1 56.568 56.567l-28.285 28.285a8 8 0 0 0 11.315 11.314l28.284-28.284a56.065 56.065 0 0 0 0-79.196z" fill="currentColor"></path></svg></span></a>
	<span>Advanced Usage
	</span></h2>

<p>This section is for users looking to gain speed, run more advanced simulations, or use tools that are recently added.</p>
<p>For example, these include how to achieve high throughput training with Map Pools, the <a href="https://alex-petrenko.github.io/sample-factory/" rel="nofollow">sample-factory</a> RL framework and running Simulate on a GCP instance.</p>
<hr>
<p>Let’s get started! 🏁</p>


		<script type="module" data-hydrate="1egnzv5">
		import { start } from "/docs/simulate/v0.0.2/en/_app/start-hf-doc-builder.js";
		start({
			target: document.querySelector('[data-hydrate="1egnzv5"]').parentNode,
			paths: {"base":"/docs/simulate/v0.0.2/en","assets":"/docs/simulate/v0.0.2/en"},
			session: {},
			route: false,
			spa: false,
			trailing_slash: "never",
			hydrate: {
				status: 200,
				error: null,
				nodes: [
					import("/docs/simulate/v0.0.2/en/_app/pages/__layout.svelte-hf-doc-builder.js"),
						import("/docs/simulate/v0.0.2/en/_app/pages/tutorials.mdx-hf-doc-builder.js")
				],
				params: {}
			}
		});
	</script>