Star

Compare Tamil Tokenizers

Inspect token boundaries, byte fallbacks, and real-time token savings for Partha against OpenAI, Google, Meta, and Indic baselines.

122K Vocab 1,135 Tamil Conjuncts 50% Fewer Tokens vs OpenAI Pure Rust BPE
Presets:
0 chars • 0 bytes • 0 words