Recent releases and counting methods
Dates below identify the official release milestone, not this guide's publication date. Variants with a shared release and counting workflow share one guide; use that guide's model choices to switch variants.
| Model guide | Provider | Release milestone | Local support | Official source |
|---|---|---|---|---|
| GPT-6.2 | OpenAI | 2026-11-17 | Local estimate | Release announcement |
| MAI Code 2 | Microsoft | 2026-11-17 | Reference encoding | Release announcement |
| Qwen4-Max | Qwen | 2026-11-16 | Reference encoding | Release announcement |
| Gemini 4 Hydrogen | 2026-11-12 | Local estimate | Release announcement | |
| Gemini 4 Carbon | 2026-11-10 broader availability | Local estimate | Release announcement | |
| Claude Fable 5.2 & Mythos 5.2 | Anthropic | 2026-11-09 | Local estimate | Release announcement |
| GPT-6.1 Terra | OpenAI | 2026-10-26 | Local estimate | Release announcement |
| Kimi K3.1 Pro | Moonshot AI | 2026-10-24 official research listing | Exact base text | Release announcement |
| MiniMax M3.1 Flash | MiniMax | 2026-10-19 | Reference encoding | Release announcement |
| DeepSeek V4.1 Flash 1017 | DeepSeek | 2026-10-17 | Exact base text | Release announcement |
| Mistral Large 4 | Mistral | October 2026 preview; subsequent open-weight release | Reference encoding | Release announcement |
Which results are model tokens?
Exact base text uses verified published tokenizer files. It can show real token boundaries and IDs, but excludes the provider's complete chat template and multimodal request processing.
Local estimates for OpenAI, Anthropic and Google use each provider's general text-ratio guidance. They are oriented toward English and do not reconstruct proprietary tokenization. Reference-only models instead display a named encoding for comparison, with no claim of model equivalence.
Do not rank model prices, multilingual compression or usable context capacity using a mixture of exact counts, character estimates and unrelated reference counts. Compare actual model-aware usage for the same complete task.
Release dates versus product updates
Gemini 4 Carbon's November 10 announcement expands an earlier restricted release. Kimi's official research index dates K3.1 Pro to October 24; a promised weight-release date does not establish browser tokenizer support.
DeepSeek V4.1 Flash 1017 is an October 17 checkpoint. DeepSeek's November 13 full-suite application APIs are a separate product update. Mistral Large 4 likewise had a preview milestone followed by an improved open-weight release.
Tiktokenizer Reference Sources
Tokenizer behavior and model limits change. Verify production decisions with current provider documentation:
- GPT-6.2: official announcement
- MAI Code 2: official announcement
- Qwen4-Max: official announcement
- Gemini 4 Hydrogen: official announcement
- Gemini 4 Carbon: official announcement
- Claude Fable 5.2 & Mythos 5.2: official announcement
- GPT-6.1 Terra: official announcement
- Kimi K3.1 Pro: official announcement
- MiniMax M3.1 Flash: official announcement
- DeepSeek V4.1 Flash 1017: official announcement
- Mistral Large 4: official announcement