13 Commits

Author	SHA1	Message	Date
oobabooga	89f6036e98	Bump llama-cpp-python, remove python 3.8/3.9, cuda 11.7 (#5397)	2024-01-30 13:19:20 -03:00
oobabooga	1c90e02243	Update Colab-TextGen-GPU.ipynb	2023-11-30 11:55:18 -08:00
oobabooga	072cfe19e9	Minor Colab fix	2023-11-15 08:18:32 -08:00
oobabooga	3d861a459d	Minor Colab fix	2023-11-15 08:15:43 -08:00
oobabooga	74fee4f312	Update Colab-TextGen-GPU.ipynb	2023-11-10 09:18:25 -08:00
oobabooga	4aabff3728	Remove old API, launch OpenAI API with --api	2023-11-10 06:39:08 -08:00
oobabooga	df90d03e0b	Replace --mul_mat_q with --no_mul_mat_q	2023-10-22 12:23:03 -07:00
oobabooga	63688004dc	Add default cmd flags to colab	2023-10-22 09:56:43 -07:00
oobabooga	613feca23b	Make colab functional for llama.cpp ... - Download only Q4_K_M for GGUF repositories by default - Use maximum n-gpu-layers by default	2023-10-22 09:08:25 -07:00
oobabooga	994502d41b	Colab fixes	2023-10-22 08:57:16 -07:00
oobabooga	05741821a5	Minor colab changes	2023-10-22 08:44:35 -07:00
mongolu	c18504f369	USE_CUDA118 from ENV remains null one_click.py + cuda-toolkit (#4352)	2023-10-22 12:37:24 -03:00
oobabooga	619093483e	Add Colab notebook	2023-10-21 20:27:52 -07:00