diff --git a/Terminology.md b/Terminology.md index 5c83103..1752036 100644 --- a/Terminology.md +++ b/Terminology.md @@ -1,3 +1,10 @@ * BOS Token - Beginning of Sentence Token -* EOS Token - End of Sentence Token \ No newline at end of file +* EOS Token - End of Sentence Token + +* Token - short segments of symbols (that could typically make up a word) +* Embeddings - Higher level token vectors representations of tokens + +## Maintainers Specific Acronyms and Terminology + +* FA - Flash Attention \ No newline at end of file