Datasets documentation
Command Line Interface (CLI)
Get started
Tutorials
OverviewLoad a dataset from the HubKnow your datasetPreprocessCreate a datasetShare a dataset to the Hub
How-to guides
Overview
General usage
LoadProcessStreamUse with PyTorchUse with TensorFlowUse with NumPyUse with JAXUse with PandasUse with PolarsUse with PyArrowUse with SparkCache managementCloud storageSearch indexCLITroubleshooting
Audio
Vision
Load image dataProcess image dataCreate an image datasetDepth estimationImage classificationSemantic segmentationObject detectionLoad video dataCreate a video datasetLoad document dataCreate a document datasetCreate a medical imaging dataset
Text
Tabular
Dataset repository
Conceptual guides
Reference
You are viewing v4.8.3 version. A newer version v4.8.4 is available.
Command Line Interface (CLI)
🤗 Datasets provides a command line interface (CLI) with useful shell commands to interact with your dataset.
You can check the available commands:
>>> datasets-cli --help
usage: datasets-cli <command> [<args>]
positional arguments:
{env,test,delete_from_hub}
datasets-cli command helpers
env Print relevant system environment info.
test Test dataset loading.
delete_from_hub Delete dataset config from the Hub
optional arguments:
-h, --help show this help message and exitDelete from Hub
Delete a dataset configuration from a supported dataset on the Hub.
>>> datasets-cli delete_from_hub --help
usage: datasets-cli <command> [<args>] delete_from_hub [-h] [--token TOKEN] [--revision REVISION] dataset_id config_name
positional arguments:
dataset_id source dataset ID, e.g. USERNAME/DATASET_NAME or ORGANIZATION/DATASET_NAME
config_name config name to delete
optional arguments:
-h, --help show this help message and exit
--token TOKEN access token to the Hugging Face Hub
--revision REVISION source revisionFor example:
>>> datasets-cli delete_from_hub USERNAME/DATASET_NAME CONFIG_NAME
Update on GitHubDo not forget that you need to log in first to your Hugging Face account:
>>> hf auth login