Optimize your datasets for ML Goodbye, boilerplate code
The fastest dataset optimization and management tool for computer vision.
The open source community
creating the future of data
Trended #1 in Python
3.3kGithub Stars
+3%
60+Contributors
+21%
600+Community members
Meet Tensie. Tensie's lit. She likes
optimizing datasets & fire puns.Your model's gonna love your data.
You will, tooPlus, we're
open-source!Managing computer vision datasets is hard. Therefore, you may try to increase performance by tinkering with your models rather than your data. But optimal models need optimized datasets! With Hub, you can easily improve your datasets because Hub neatly rearranges your computer vision datasets into our Data 2.0 format (NumPy-like, cloud-native arrays). As a result, Hub datasets are very easy to manage and optimize for computer vision applications.
Check out our Repo
Better data for your team, at scale
Features
Load Data from Anywhere
Hub works locally, on Google Cloud, MinIO, AWS, Azure as well as Activeloop storage (no servers needed). Load data (even from Kaggle!) and directly stream datasets from cold storage to ML workflows. It's that fast.
Dataset Version Control
Modify dataset elements across different versions and seamlessly switch between them. Hub's intuitive Python API works with datasets of any size and overcomes the limitations of file-based version control.
Transformations at Scale
Quickly modify, update, or resample your datasets in order to find the optimal dataset for your models. Scale to hundreds of machines with one line of code.
Scalable Model Training
Stream your dataset to PyTorch or TensorFlow with one line of code. Train in a distributed fashion with Ray to efficiently utilize your compute resources.
Team and Access Management
Keep your datasets private, share them with your organization or anyone on the web. Have multiple data scientists working on the same data? We can handle that, too.
Dataset Querying
Easily filter, subset or query terabyte-scale datasets to generate instant insights and uncover opportunities for dataset optimization.
Visualize any computer
vision dataset
Instantly visualize any slice of the dataset you upload to Hub.
- Rapidly visualize different versions of your data
- Understand your data and improve its quality
- Run transforms on the data with in-built compute infrastructure
- Train your models on our compute infrastructure
Open data, one click away
Click to View
the Dataset
- Explore verified datasets
by team Activeloop...
- ... public organizations
(like Google!) ...
- ... and our open-source
community!
Optimizing data is easy(If you use Hub)
1from hub import Dataset
2from PIL import Image
3
4ds = Dataset('hub://activeloop/mnist_train') # Hub Dataset
5
6# Display an image
7Image.fromarray(ds.images[0].numpy())Software 2.0 needs Data 2.0.
The future of Machine Learning is data-centric.
Optimize your data for Machine Learning with Activeloop Hub.> pip install hub
Get started with
Activeloop HubCreate
an accountHub is open source.
Join the communityStay in the loop