BitsExplorer finds what people are building with AI, every day. See today's picks →

Thai Tokenizer Retrofit

Cut Thai token cost at fixed vocabulary size: prune unused entries and swap in Thai subwords. Mistral-7B: Thai tokens −61–67%, English unchanged.

Description excerpted from the original listing, which is linked below.

Open it Source code

Facts

Published: 24 Oct 2026 (1h ago)
Medium: web
First seen: 24 Oct 2026, 07:10 UTC

Built with

Claude Code: confirmed
the agent's own trailer in the repository's commit history

What we can see

75 hygiene score

Certificate Get "https://ilfforever.github.io/thai-tokenizer-retrofit/": dial tcp [2606:50c0:8002::153]:443: connect: cannot assign requested address
Cookie attributes Get "https://ilfforever.github.io/thai-tokenizer-retrofit/": dial tcp [2606:50c0:8002::153]:443: connect: cannot assign requested address
Credentials and payment Get "https://ilfforever.github.io/thai-tokenizer-retrofit/": dial tcp [2606:50c0:8002::153]:443: connect: cannot assign requested address
No strict transport security Get "https://ilfforever.github.io/thai-tokenizer-retrofit/": dial tcp [2606:50c0:8002::153]:443: connect: cannot assign requested address
Served over HTTPS
Mail authentication neither published
Loads insecure resources Get "https://ilfforever.github.io/thai-tokenizer-retrofit/": dial tcp [2606:50c0:8002::153]:443: connect: cannot assign requested address
Redirects Get "https://ilfforever.github.io/thai-tokenizer-retrofit/": dial tcp [2606:50c0:8002::153]:443: connect: cannot assign requested address
Security headers Get "https://ilfforever.github.io/thai-tokenizer-retrofit/": dial tcp [2606:50c0:8002::153]:443: connect: cannot assign requested address
Third-party origins Get "https://ilfforever.github.io/thai-tokenizer-retrofit/": dial tcp [2606:50c0:8002::153]:443: connect: cannot assign requested address
Transport security Get "https://ilfforever.github.io/thai-tokenizer-retrofit/": dial tcp [2606:50c0:8002::153]:443: connect: cannot assign requested address

Observed 24 Oct 2026 by fetching the page as a browser would. This describes hygiene and transparency, not safety: a missing header does not make a site dangerous, and a complete set does not make it trustworthy.

Made this?

Show it on your own site or README. It links back to this page.

Get the badge

For a web page

<a href="https://bitsexplorer.com/i/4626007/thai-tokenizer-retrofit"><img src="https://bitsexplorer.com/badge/4626007.svg" alt="Featured on BitsExplorer" height="22"></a>

For a README (Markdown)

[![Featured on BitsExplorer](https://bitsexplorer.com/badge/4626007.svg)](https://bitsexplorer.com/i/4626007/thai-tokenizer-retrofit)

Changes we have seen

24 Oct 2026 first indexed

Thai Tokenizer Retrofit

More built with Claude Code

Today's picks

The week in AI-built software