Skip to content
@webdataset

webdataset

High Performance I/O for Large Scale Deep Learning

Popular repositories Loading

  1. webdataset webdataset Public

    A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

    Python 2.3k 189

  2. tarp tarp Public

    Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.

    Go 124 15

  3. WebDataset.jl WebDataset.jl Public

    A high performance I/O library for deep learning in Julia, based on the PyTorch WebDataset library

    Julia 10 1

  4. wdsconversions wdsconversions Public

    conversions of standard pytorch datasets to webdataset format

    Jupyter Notebook 1 1

Repositories

Showing 4 of 4 repositories
  • WebDataset.jl Public

    A high performance I/O library for deep learning in Julia, based on the PyTorch WebDataset library

    webdataset/WebDataset.jl’s past year of commit activity
    Julia 10 MIT 1 0 49 Updated Nov 8, 2024
  • webdataset Public

    A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

    webdataset/webdataset’s past year of commit activity
    Python 2,338 BSD-3-Clause 189 113 7 Updated Oct 9, 2024
  • tarp Public

    Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.

    webdataset/tarp’s past year of commit activity
    Go 124 15 7 3 Updated Dec 10, 2023
  • wdsconversions Public

    conversions of standard pytorch datasets to webdataset format

    webdataset/wdsconversions’s past year of commit activity
    Jupyter Notebook 1 1 0 0 Updated Aug 20, 2022

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…