Buckets:
๐ค Optimum Neuron
๐ค Optimum Neuron is the interface between the ๐ค Transformers library and AWS Accelerators including AWS Trainium and AWS Inferentia. It provides a set of tools enabling easy model loading, training and inference on single- and multi-Accelerator settings for different downstream tasks. The list of officially validated models and tasks is available here.
<a
class="!no-underline border dark:border-gray-700 p-5 rounded-lg shadow hover:shadow-lg"
href="./tutorials/fine_tune_bert"
>
Tutorials
Learn the basics and become familiar with training & deploying transformers on AWS Trainium and AWS Inferentia.
Start here if you are using ๐ค Optimum Neuron for the first time!
How-to guides
Practical guides to help you achieve a specific goal. Take a look at these guides to learn how to use ๐ค Optimum
Neuron to solve real-world problems.
<a
class="!no-underline border dark:border-gray-700 p-5 rounded-lg shadow hover:shadow-lg"
href="./package_reference/trainer"
>
Reference
Technical descriptions of how the classes and methods of ๐ค Optimum Neuron work.
<a
class="!no-underline border dark:border-gray-700 p-5 rounded-lg shadow hover:shadow-lg"
onclick="event.preventDefault(); window.open('https://huggingface.co/datasets/sanhitsa/AWS-White-Papers-and-Blogs/resolve/main/Whitepaper-Scale-production-AI-with-Hugging-Face-Optimum-Neuron-and-AWS-Trainium-and-Inferentia.pdf', '_blank');"
>
White Paper
<p
class="text-gray-700">To learn more about how Optimum Neuron and AWS Inferentia and Trainium are being used by companies, read the White Paper.
Xet Storage Details
- Size:
- 2.08 kB
- Xet hash:
- dc3c1ca1f770a891c73b53dd7e79abc35b0bf371f00ce72066c2b7d9b5d7d6d5
ยท
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.