6 Commits

Author	SHA1	Message	Date
oobabooga	cec8db52e5	Add max_tokens_second param (#3533)	2023-08-29 17:44:31 -03:00
oobabooga	0af10ab49b	Add Classifier Free Guidance (CFG) for Transformers/ExLlama (#3325)	2023-08-06 17:22:48 -03:00
oobabooga	e931844fe2	Add auto_max_new_tokens parameter (#3419)	2023-08-02 14:52:20 -03:00
matatonic	90a4ab631c	extensions/openai: Fixes for: embeddings, tokens, better errors. +Docs update, +Images, +logit_bias/logprobs, +more. (#3122)	2023-07-24 11:28:12 -03:00
oobabooga	e202190c4f	lint	2023-07-12 11:33:25 -07:00
matatonic	3e7feb699c	extensions/openai: Major openai extension updates & fixes (#3049) ... * many openai updates * total reorg & cleanup. * fixups * missing import os for images * +moderations, custom_stopping_strings, more fixes * fix bugs in completion streaming * moderation fix (flagged) * updated moderation categories --------- Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>	2023-07-11 18:50:08 -03:00