← Simulators
✂️ Tokenization
Type text and see how it breaks into tokens and IDs (simulated).
Step 1 — Tokens
Thecatsatonthemat
6 token(s)
Step 2 — Token IDs
The → 2600cat → 2637sat → 2674on → 2711the → 2748mat → 2785
Try examples
Type text and see how it breaks into tokens and IDs (simulated).
6 token(s)
Try examples