Torch.utils.data
torch.utils.data — PyTorch 2.1 documentation
torch.utils.data At the heart of PyTorch data loading utility is the torch.utils.data.DataLoader class. It represents a Python iterable over a dataset, with support for These options are configured by the constructor arguments of a DataLoader, which has si
pytorch.org
collate_fn
Huggingface Load
Load
Your data can be stored in various places; they can be on your local machine’s disk, in a Github repository, and in in-memory data structures like Python dictionaries and Pandas DataFrames. Wherever a dataset is stored, 🤗 Datasets can help you load it
huggingface.co
Huggingface Use with PyTorch
Use with PyTorch
This document is a quick introduction to using datasets with PyTorch, with a particular focus on how to get torch.Tensor objects out of our datasets, and how to use a PyTorch DataLoader and a Hugging Face Dataset with the best performance. By default, data
huggingface.co
'Tech > 파이썬' 카테고리의 다른 글
| Lex/Yacc/LISP/Python Tokenizer (0) | 2023.11.05 |
|---|---|
| GPU 하드웨어/CUDA, CUDNN, Pytorch 설치 (0) | 2023.10.24 |
| CUDA Memory/Huggingface Cache Management (0) | 2023.10.21 |
| 파이썬 자연어처리 기초 (0) | 2023.10.20 |