Buckets:
| # 🤗 Datasets, check![[datasets-check]] | |
| <CourseFloatingBanner | |
| chapter={5} | |
| classNames="absolute z-10 right-0 top-0" | |
| /> | |
| Well, that was quite a tour through the 🤗 Datasets library -- congratulations on making it this far! With the knowledge that you've gained from this chapter, you should be able to: | |
| - Load datasets from anywhere, be it the Hugging Face Hub, your laptop, or a remote server at your company. | |
| - Wrangle your data using a mix of the `Dataset.map()` and `Dataset.filter()` functions. | |
| - Quickly switch between data formats like Pandas and NumPy using `Dataset.set_format()`. | |
| - Create your very own dataset and push it to the Hugging Face Hub. | |
| - Embed your documents using a Transformer model and build a semantic search engine using FAISS. | |
| In [Chapter 7](/course/chapter7), we'll put all of this to good use as we take a deep dive into the core NLP tasks that Transformer models are great for. Before jumping ahead, though, put your knowledge of 🤗 Datasets to the test with a quick quiz! | |
| <EditOnGithub source="https://github.com/huggingface/course/blob/main/chapters/en/chapter5/7.mdx" /> |
Xet Storage Details
- Size:
- 1.12 kB
- Xet hash:
- 537088dbd2b080c8dc9dea8a9c277437f1ffa4ab87b93472b48732c9c3cc7a06
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.