hub/main/en/models-libraries.html

<meta charset="utf-8" /><meta name="hf:doc:metadata" content="{&quot;title&quot;:&quot;Libraries&quot;,&quot;local&quot;:&quot;libraries&quot;,&quot;sections&quot;:[{&quot;title&quot;:&quot;How can I add a new library to the Inference API?&quot;,&quot;local&quot;:&quot;how-can-i-add-a-new-library-to-the-inference-api&quot;,&quot;sections&quot;:[],&quot;depth&quot;:3}],&quot;depth&quot;:1}">
		<link href="/docs/hub/main/en/_app/immutable/assets/0.e3b0c442.css" rel="modulepreload">
		<link rel="modulepreload" href="/docs/hub/main/en/_app/immutable/entry/start.d0cd5065.js">
		<link rel="modulepreload" href="/docs/hub/main/en/_app/immutable/chunks/scheduler.d6170356.js">
		<link rel="modulepreload" href="/docs/hub/main/en/_app/immutable/chunks/singletons.d032f1eb.js">
		<link rel="modulepreload" href="/docs/hub/main/en/_app/immutable/chunks/paths.752f1c6b.js">
		<link rel="modulepreload" href="/docs/hub/main/en/_app/immutable/entry/app.b6abe3c1.js">
		<link rel="modulepreload" href="/docs/hub/main/en/_app/immutable/chunks/index.fcd4cc08.js">
		<link rel="modulepreload" href="/docs/hub/main/en/_app/immutable/nodes/0.f045427f.js">
		<link rel="modulepreload" href="/docs/hub/main/en/_app/immutable/nodes/80.0f110f0a.js">
		<link rel="modulepreload" href="/docs/hub/main/en/_app/immutable/chunks/EditOnGithub.da2b595c.js"><!-- HEAD_svelte-u9bgzb_START --><meta name="hf:doc:metadata" content="{&quot;title&quot;:&quot;Libraries&quot;,&quot;local&quot;:&quot;libraries&quot;,&quot;sections&quot;:[{&quot;title&quot;:&quot;How can I add a new library to the Inference API?&quot;,&quot;local&quot;:&quot;how-can-i-add-a-new-library-to-the-inference-api&quot;,&quot;sections&quot;:[],&quot;depth&quot;:3}],&quot;depth&quot;:1}"><!-- HEAD_svelte-u9bgzb_END -->      <p></p>  <h1 class="relative group"><a id="libraries" class="header-link block pr-1.5 text-lg no-hover:hidden with-hover:absolute with-hover:p-1.5 with-hover:opacity-0 with-hover:group-hover:opacity-100 with-hover:right-full" href="#libraries"><span><svg class="" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" aria-hidden="true" role="img" width="1em" height="1em" preserveAspectRatio="xMidYMid meet" viewBox="0 0 256 256"><path d="M167.594 88.393a8.001 8.001 0 0 1 0 11.314l-67.882 67.882a8 8 0 1 1-11.314-11.315l67.882-67.881a8.003 8.003 0 0 1 11.314 0zm-28.287 84.86l-28.284 28.284a40 40 0 0 1-56.567-56.567l28.284-28.284a8 8 0 0 0-11.315-11.315l-28.284 28.284a56 56 0 0 0 79.196 79.197l28.285-28.285a8 8 0 1 0-11.315-11.314zM212.852 43.14a56.002 56.002 0 0 0-79.196 0l-28.284 28.284a8 8 0 1 0 11.314 11.314l28.284-28.284a40 40 0 0 1 56.568 56.567l-28.285 28.285a8 8 0 0 0 11.315 11.314l28.284-28.284a56.065 56.065 0 0 0 0-79.196z" fill="currentColor"></path></svg></span></a> <span>Libraries</span></h1> <p data-svelte-h="svelte-n9iupl">The Hub has support for dozens of libraries in the Open Source ecosystem. Thanks to the <code>huggingface_hub</code> Python library, it’s easy to enable sharing your models on the Hub. The Hub supports many libraries, and we’re working on expanding this support. We’re happy to welcome to the Hub a set of Open Source libraries that are pushing Machine Learning forward.</p> <p data-svelte-h="svelte-mvo9wj">The table below summarizes the supported libraries and their level of integration. Find all our supported libraries in <a href="https://github.com/huggingface/huggingface.js/blob/main/packages/tasks/src/model-libraries.ts" rel="nofollow">the model-libraries.ts file</a>.</p> <table data-svelte-h="svelte-1huednv"><thead><tr><th>Library</th> <th>Description</th> <th>Inference API</th> <th align="right">Widgets</th> <th>Download from Hub</th> <th>Push to Hub</th></tr></thead> <tbody><tr><td><a href="./adapters">Adapters</a></td> <td>A unified Transformers add-on for parameter-efficient and modular fine-tuning.</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./allennlp">AllenNLP</a></td> <td>An open-source NLP research library, built on PyTorch.</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>❌</td></tr> <tr><td><a href="./asteroid">Asteroid</a></td> <td>PyTorch-based audio source separation toolkit</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>❌</td></tr> <tr><td><a href="./bertopic">BERTopic</a></td> <td>BERTopic is a topic modeling library for text and images</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./diffusers">Diffusers</a></td> <td>A modular toolbox for inference and training of diffusion models</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="https://github.com/mindee/doctr" rel="nofollow">docTR</a></td> <td>Models and datasets for OCR-related tasks in PyTorch &amp; TensorFlow</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>❌</td></tr> <tr><td><a href="./espnet">ESPnet</a></td> <td>End-to-end speech processing toolkit (e.g. TTS)</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>❌</td></tr> <tr><td><a href="./fastai">fastai</a></td> <td>Library to train fast and accurate models with state-of-the-art outputs.</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./keras">Keras</a></td> <td>Open-source multi-backend deep learning framework, with support for JAX, TensorFlow, and PyTorch.</td> <td>❌</td> <td align="right">❌</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="https://keras.io/guides/keras_nlp/upload/" rel="nofollow">KerasNLP</a></td> <td>Natural language processing library built on top of Keras that works natively with TensorFlow, JAX, or PyTorch.</td> <td>❌</td> <td align="right">❌</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./tf-keras">TF-Keras</a> (legacy)</td> <td>Legacy library that uses a consistent and simple API to build models leveraging TensorFlow and its ecosystem.</td> <td>❌</td> <td align="right">❌</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./flair">Flair</a></td> <td>Very simple framework for state-of-the-art NLP.</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="https://github.com/facebookresearch/mbrl-lib" rel="nofollow">MBRL-Lib</a></td> <td>PyTorch implementations of MBRL Algorithms.</td> <td>❌</td> <td align="right">❌</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="https://github.com/Natooz/MidiTok" rel="nofollow">MidiTok</a></td> <td>Tokenizers for symbolic music / MIDI files.</td> <td>❌</td> <td align="right">❌</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./ml-agents">ML-Agents</a></td> <td>Enables games and simulations made with Unity to serve as environments for training intelligent agents.</td> <td>❌</td> <td align="right">❌</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./mlx">MLX</a></td> <td>Model training and serving framework on Apple silicon made by Apple.</td> <td>❌</td> <td align="right">❌</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="https://github.com/NVIDIA/NeMo" rel="nofollow">NeMo</a></td> <td>Conversational AI toolkit built for researchers</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>❌</td></tr> <tr><td><a href="./open_clip">OpenCLIP</a></td> <td>Library for open-source implementation of OpenAI’s CLIP</td> <td>❌</td> <td align="right">❌</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./paddlenlp">PaddleNLP</a></td> <td>Easy-to-use and powerful NLP library built on PaddlePaddle</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./peft">PEFT</a></td> <td>Cutting-edge Parameter Efficient Fine-tuning Library</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="https://github.com/pyannote/pyannote-audio" rel="nofollow">Pyannote</a></td> <td>Neural building blocks for speaker diarization.</td> <td>❌</td> <td align="right">❌</td> <td>✅</td> <td>❌</td></tr> <tr><td><a href="https://github.com/kensho-technologies/pyctcdecode" rel="nofollow">PyCTCDecode</a></td> <td>Language model supported CTC decoding for speech recognition</td> <td>❌</td> <td align="right">❌</td> <td>✅</td> <td>❌</td></tr> <tr><td><a href="https://github.com/clementchadebec/benchmark_VAE" rel="nofollow">Pythae</a></td> <td>Unified framework for Generative Autoencoders in Python</td> <td>❌</td> <td align="right">❌</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./rl-baselines3-zoo">RL-Baselines3-Zoo</a></td> <td>Training framework for Reinforcement Learning, using <a href="https://github.com/DLR-RM/stable-baselines3" rel="nofollow">Stable Baselines3</a>.</td> <td>❌</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./sample-factory">Sample Factory</a></td> <td>Codebase for high throughput asynchronous reinforcement learning.</td> <td>❌</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./sentence-transformers">Sentence Transformers</a></td> <td>Compute dense vector representations for sentences, paragraphs, and images.</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./setfit">SetFit</a></td> <td>Efficient few-shot text classification with Sentence Transformers</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./spacy">spaCy</a></td> <td>Advanced Natural Language Processing in Python and Cython.</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./span_marker">SpanMarker</a></td> <td>Familiar, simple and state-of-the-art Named Entity Recognition.</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="https://skops.readthedocs.io/en/stable/" rel="nofollow">Scikit Learn (using skops)</a></td> <td>Machine Learning in Python.</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./speechbrain">Speechbrain</a></td> <td>A PyTorch Powered Speech Toolkit.</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>❌</td></tr> <tr><td><a href="./stable-baselines3">Stable-Baselines3</a></td> <td>Set of reliable implementations of deep reinforcement learning algorithms in PyTorch</td> <td>❌</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="https://github.com/TensorSpeech/TensorFlowTTS" rel="nofollow">TensorFlowTTS</a></td> <td>Real-time state-of-the-art speech synthesis architectures.</td> <td>❌</td> <td align="right">❌</td> <td>✅</td> <td>❌</td></tr> <tr><td><a href="./timm">Timm</a></td> <td>Collection of image models, scripts, pretrained weights, etc.</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./transformers">Transformers</a></td> <td>State-of-the-art Natural Language Processing for PyTorch, TensorFlow, and JAX</td> <td>✅</td> <td align="right">✅</td> <td>✅</td> <td>✅</td></tr> <tr><td><a href="./transformers-js">Transformers.js</a></td> <td>State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!</td> <td>❌</td> <td align="right">❌</td> <td>✅</td> <td>❌</td></tr> <tr><td><a href="./unity-sentis">Unity Sentis</a></td> <td>Inference engine for the Unity 3D game engine</td> <td>❌</td> <td align="right">❌</td> <td>❌</td> <td>❌</td></tr></tbody></table>  <h3 class="relative group"><a id="how-can-i-add-a-new-library-to-the-inference-api" class="header-link block pr-1.5 text-lg no-hover:hidden with-hover:absolute with-hover:p-1.5 with-hover:opacity-0 with-hover:group-hover:opacity-100 with-hover:right-full" href="#how-can-i-add-a-new-library-to-the-inference-api"><span><svg class="" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" aria-hidden="true" role="img" width="1em" height="1em" preserveAspectRatio="xMidYMid meet" viewBox="0 0 256 256"><path d="M167.594 88.393a8.001 8.001 0 0 1 0 11.314l-67.882 67.882a8 8 0 1 1-11.314-11.315l67.882-67.881a8.003 8.003 0 0 1 11.314 0zm-28.287 84.86l-28.284 28.284a40 40 0 0 1-56.567-56.567l28.284-28.284a8 8 0 0 0-11.315-11.315l-28.284 28.284a56 56 0 0 0 79.196 79.197l28.285-28.285a8 8 0 1 0-11.315-11.314zM212.852 43.14a56.002 56.002 0 0 0-79.196 0l-28.284 28.284a8 8 0 1 0 11.314 11.314l28.284-28.284a40 40 0 0 1 56.568 56.567l-28.285 28.285a8 8 0 0 0 11.315 11.314l28.284-28.284a56.065 56.065 0 0 0 0-79.196z" fill="currentColor"></path></svg></span></a> <span>How can I add a new library to the Inference API?</span></h3> <p data-svelte-h="svelte-109ccky">If you’re interested in adding your library, please reach out to us! Read about it in <a href="./models-adding-libraries">Adding a Library Guide</a>.</p> <a class="!text-gray-400 !no-underline text-sm flex items-center not-prose mt-4" href="https://github.com/huggingface/hub-docs/blob/main/docs/hub/models-libraries.md" target="_blank"><span data-svelte-h="svelte-1kd6by1">&lt;</span> <span data-svelte-h="svelte-x0xyl0">&gt;</span> <span data-svelte-h="svelte-1dajgef"><span class="underline ml-1.5">Update</span> on GitHub</span></a>  <p></p> 
			
			<script>
				{
					__sveltekit_1vatp3t = {
						assets: "/docs/hub/main/en",
						base: "/docs/hub/main/en",
						env: {}
					};

					const element = document.currentScript.parentElement;

					const data = [null,null];

					Promise.all([
						import("/docs/hub/main/en/_app/immutable/entry/start.d0cd5065.js"),
						import("/docs/hub/main/en/_app/immutable/entry/app.b6abe3c1.js")
					]).then(([kit, app]) => {
						kit.start(app, element, {
							node_ids: [0, 80],
							data,
							form: null,
							error: null
						});
					});
				}
			</script>