Buckets:

HuggingFaceDocBuilder's picture
|
download
raw
2.08 kB
# ๐Ÿค— Optimum Neuron
๐Ÿค— Optimum Neuron is the interface between the ๐Ÿค— Transformers library and AWS Accelerators including [AWS Trainium](https://aws.amazon.com/machine-learning/trainium/?nc1=h_ls) and [AWS Inferentia](https://aws.amazon.com/machine-learning/inferentia/?nc1=h_ls).
It provides a set of tools enabling easy model loading, training and inference on single- and multi-Accelerator settings for different downstream tasks.
The list of officially validated models and tasks is available [here](https://huggingface.co/docs/optimum-neuron/package_reference/configuration#supported-architectures).
<a
class="!no-underline border dark:border-gray-700 p-5 rounded-lg shadow hover:shadow-lg"
href="./tutorials/fine_tune_bert"
>
Tutorials
Learn the basics and become familiar with training & deploying transformers on AWS Trainium and AWS Inferentia.
Start here if you are using ๐Ÿค— Optimum Neuron for the first time!
How-to guides
Practical guides to help you achieve a specific goal. Take a look at these guides to learn how to use ๐Ÿค— Optimum
Neuron to solve real-world problems.
<a
class="!no-underline border dark:border-gray-700 p-5 rounded-lg shadow hover:shadow-lg"
href="./package_reference/trainer"
>
Reference
Technical descriptions of how the classes and methods of ๐Ÿค— Optimum Neuron work.
<a
class="!no-underline border dark:border-gray-700 p-5 rounded-lg shadow hover:shadow-lg"
onclick="event.preventDefault(); window.open('https://huggingface.co/datasets/sanhitsa/AWS-White-Papers-and-Blogs/resolve/main/Whitepaper-Scale-production-AI-with-Hugging-Face-Optimum-Neuron-and-AWS-Trainium-and-Inferentia.pdf', '_blank');"
>
White Paper
<p
class="text-gray-700">To learn more about how Optimum Neuron and AWS Inferentia and Trainium are being used by companies, read the White Paper.

Xet Storage Details

Size:
2.08 kB
ยท
Xet hash:
dc3c1ca1f770a891c73b53dd7e79abc35b0bf371f00ce72066c2b7d9b5d7d6d5

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.