4 Terminology

Brian edited this page 2024-05-21 12:08:23 +10:00

Table of Contents

• Maintainers Specific Acronyms and Terminology

• BOS Token - Beginning of Sentence Token

• EOS Token - End of Sentence Token

• Token - short segments of symbols (that could typically make up a word)

• Embeddings - Higher level token vectors representations of tokens

• NIHS - Needle In a Hay Stack

• NINS - Needle In Needle Stack

Maintainers Specific Acronyms and Terminology

These are keywords in code that is not typically of importance to users.

• FA - Flash Attention

Users Guide

Useful information for users that doesn't fit into Readme.

• Home
  • Install
  • ArchLinux
  • Nix
  • NixOS
  • Android Termux
  • Windows Msys2
  • Debian (Ubuntu)
  • Redhat
• Feature Matrix
• GGML Tips & Tricks
• Chat Templating
• Metadata Override
• HuggingFace Model Card Metadata Interoperability Consideration

Technical Details

These are information useful for Maintainers and Developers which does not fit into code comments

• Tensor Encoding Schemes
• Terminology
• PR And Issue Tickets Maintenance
• Dev Notes

Github Actions Main Branch Status

Click on a badge to jump to workflow. This is here as a useful general view of all the actions so that we may notice quicker if main branch automation is broken and where.

• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
•