← Simulators

✂️ Tokenization

Type text and see how it breaks into tokens and IDs (simulated).

Step 1 — Tokens

Thecatsatonthemat

6 token(s)

Step 2 — Token IDs

The → 2600cat → 2637sat → 2674on → 2711the → 2748mat → 2785

Try examples