Buckets:

HuggingFaceDocBuilder's picture
|
download
raw
887 Bytes
# Basic usage completed![[basic-usage-completed]]
<CourseFloatingBanner
chapter={2}
classNames="absolute z-10 right-0 top-0"
/>
Great job following the course up to here! To recap, in this chapter you:
- Learned the basic building blocks of a Transformer model.
- Learned what makes up a tokenization pipeline.
- Saw how to use a Transformer model in practice.
- Learned how to leverage a tokenizer to convert text to tensors that are understandable by the model.
- Set up a tokenizer and a model together to get from text to predictions.
- Learned the limitations of input IDs, and learned about attention masks.
- Played around with versatile and configurable tokenizer methods.
From now on, you should be able to freely navigate the 🤗 Transformers docs: the vocabulary will sound familiar, and you've already seen the methods that you'll use the majority of the time.

Xet Storage Details

Size:
887 Bytes
·
Xet hash:
f2eddd51fd19cdb225f4e0487bcc5c5d32a0e8bfb4a1d9b10158dbc369c4d93b

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.