Commit Graph

9 Commits

Author SHA1 Message Date
oobabooga
74fee4f312 Update Colab-TextGen-GPU.ipynb 2023-11-10 09:18:25 -08:00
oobabooga
4aabff3728 Remove old API, launch OpenAI API with --api 2023-11-10 06:39:08 -08:00
oobabooga
df90d03e0b Replace --mul_mat_q with --no_mul_mat_q 2023-10-22 12:23:03 -07:00
oobabooga
63688004dc Add default cmd flags to colab 2023-10-22 09:56:43 -07:00
oobabooga
613feca23b Make colab functional for llama.cpp
- Download only Q4_K_M for GGUF repositories by default
- Use maximum n-gpu-layers by default
2023-10-22 09:08:25 -07:00
oobabooga
994502d41b Colab fixes 2023-10-22 08:57:16 -07:00
oobabooga
05741821a5 Minor colab changes 2023-10-22 08:44:35 -07:00
mongolu
c18504f369
USE_CUDA118 from ENV remains null one_click.py + cuda-toolkit (#4352) 2023-10-22 12:37:24 -03:00
oobabooga
619093483e Add Colab notebook 2023-10-21 20:27:52 -07:00