Skip to content

micycle1/count-tokens

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

count-tokens

Ultra-fast, client-side token counter for large text blobs using OpenAI-style BPEs.

What this is

  • Static site (GitHub Pages) that counts tokens entirely in your browser
  • Built with bpe-openai compiled to WebAssembly
  • Optimised for huge pastes (even repo-level): avoids per-token highlighting that makes other sites hang
  • Zero backend; no data leaves your machine

Supported encodings

  • cl100k_base
  • o200k_base
  • voyage3_base

About

Ultra-fast, client-side token counter for large text blobs

Topics

Resources

Stars

Watchers

Forks