70 Commits

Author	SHA1	Message	Date
oobabooga	875847bf88	Consider tokenizer a type of text	2023-03-10 00:45:28 -03:00
oobabooga	249c268176	Fix the download script for long lists of files on HF	2023-03-10 00:41:10 -03:00
Ber Zoidberg	ec3de0495c	download tokenizer when present	2023-03-09 19:08:09 -08:00
oobabooga	7c70e0e2a6	Fix the download script (sort of)	2023-03-02 14:05:21 -03:00
oobabooga	fe1771157f	Properly scrape huggingface for download links (for #122)	2023-02-24 14:06:42 -03:00
oobabooga	bb1dac2f76	Convert the download option (A-Z) to upper case	2023-02-20 15:50:48 -03:00
oobabooga	fd8070b960	Give some default options in the download script	2023-02-16 23:04:13 -03:00
oobabooga	bf9dd8f8ee	Add --text-only option to the download script	2023-02-12 00:42:56 -03:00
oobabooga	66862203fc	Only download safetensors if both pytorch and safetensors are present	2023-02-12 00:06:22 -03:00
oobabooga	219366342b	Sort imports according to PEP8 (based on #67)	2023-02-10 15:40:03 -03:00
oobabooga	9215e281ba	Add --threads option to the download script	2023-02-03 18:57:12 -03:00
oobabooga	03f084f311	Add safetensors support	2023-02-03 18:36:32 -03:00
oobabooga	1e541d4882	Update download-model.py	2023-01-21 00:43:00 -03:00
oobabooga	18ef72d7c0	Update download-model.py	2023-01-21 00:38:23 -03:00
81300	fffd49e64e	Add --branch option to the model download script	2023-01-20 22:51:56 +02:00
oobabooga	6456777b09	Clean things up	2023-01-16 16:35:45 -03:00
oobabooga	fcda5d7107	Fix the download script on windows (#6)	2023-01-13 09:05:21 -03:00
oobabooga	dd1bed2d8b	Fix the download script	2023-01-07 16:49:21 -03:00
oobabooga	5345685ead	Make paths cross-platform (should work on Windows now)	2023-01-07 16:33:43 -03:00
oobabooga	fed7233ff4	Add script to download models	2023-01-06 19:57:31 -03:00