Tiktokenizer

Qwen · Published local tokenizer

Qwen3 Token Counter

Count Qwen3-32B base-text tokens locally with its published tokenizer and inspect token IDs. Full requests still need the checkpoint's chat template and provider-specific formatting.

Accuracy note

Exact base-text counting uses the published Qwen3-32B tokenizer locally. Chat templates, role markers, tools, generation prompts and provider wrappers are excluded.

Frequently asked questions

Is Qwen3 counting supported locally?

Yes. The published Qwen3-32B tokenizer is bundled locally, so you can count plain text and inspect its token IDs without an API key. Chat overhead is excluded.

How should I count Qwen3 tokens?

Use the tokenizer and chat template shipped with the exact Qwen3 checkpoint or your inference provider's counting endpoint.