Downloader usage
The following command downloads the file vocab.json
from the Hugging Face
project lysandre/arxiv-nlp:
llm-download \
huggingface \
-l INFO \
-i lysandre/arxiv-nlp \
-f vocab.json \
-o .
The next command gets the file part_1_200000.parquet
from the dataset
nampdn-ai/tiny-codes
(if you don't specify a filename, the complete dataset will get downloaded):
llm-download \
huggingface \
-l INFO \
-i nampdn-ai/tiny-codes \
-t dataset \
-f part_1_200000.parquet \
-o .
NB: Hugging Face will cache files locally in your home directory before copying it to the location that you specified.