From 80c798cd74df9e07625abc5da3546db1b0a7a24b Mon Sep 17 00:00:00 2001 From: Brian Date: Mon, 20 May 2024 00:29:27 +1000 Subject: [PATCH] Updated Terminology (markdown) --- Terminology.md | 9 ++++++++- 1 file changed, 8 insertions(+), 1 deletion(-) diff --git a/Terminology.md b/Terminology.md index 5c83103..1752036 100644 --- a/Terminology.md +++ b/Terminology.md @@ -1,3 +1,10 @@ * BOS Token - Beginning of Sentence Token -* EOS Token - End of Sentence Token \ No newline at end of file +* EOS Token - End of Sentence Token + +* Token - short segments of symbols (that could typically make up a word) +* Embeddings - Higher level token vectors representations of tokens + +## Maintainers Specific Acronyms and Terminology + +* FA - Flash Attention \ No newline at end of file