Buckets:
| # Basic usage completed![[basic-usage-completed]] | |
| <CourseFloatingBanner | |
| chapter={2} | |
| classNames="absolute z-10 right-0 top-0" | |
| /> | |
| Great job following the course up to here! To recap, in this chapter you: | |
| - Learned the basic building blocks of a Transformer model. | |
| - Learned what makes up a tokenization pipeline. | |
| - Saw how to use a Transformer model in practice. | |
| - Learned how to leverage a tokenizer to convert text to tensors that are understandable by the model. | |
| - Set up a tokenizer and a model together to get from text to predictions. | |
| - Learned the limitations of input IDs, and learned about attention masks. | |
| - Played around with versatile and configurable tokenizer methods. | |
| From now on, you should be able to freely navigate the 🤗 Transformers docs: the vocabulary will sound familiar, and you've already seen the methods that you'll use the majority of the time. | |
| <EditOnGithub source="https://github.com/huggingface/course/blob/main/chapters/en/chapter2/7.mdx" /> |
Xet Storage Details
- Size:
- 988 Bytes
- Xet hash:
- fc4ebb8dcf0245f4d164831f1bb507b32b00139cffaf3d90978eac7d1c6b3ce4
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.