@webdataset
Guthub

webdataset

Twitter logo Share LinkedIn logo Share Facebook logo Share
  • Stars
    star
    2,297
  • Global Org. Rank 8,541 (Top 3 %)
  • Registered over 3 years ago
  • Most used languages
    Python
         25.0 %
    Jupyter Notebook
         25.0 %
    Go
         25.0 %
    Julia
         25.0 %

Top repositories

1

webdataset

A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
Python
2,168
star
2

tarp

Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.
Go
118
star
3

WebDataset.jl

A high performance I/O library for deep learning in Julia, based on the PyTorch WebDataset library
Julia
10
star
4

wdsconversions

conversions of standard pytorch datasets to webdataset format
Jupyter Notebook
1
star