‘Tokeniser tax’: Why AI is more expensive for non-English users

Nov 16, 2026 - 10:30
‘Tokeniser tax’: Why AI is more expensive for non-English users

Join our WhatsApp Community to receive travel deals, free stays, and special offers!
- Join Now -

Join our WhatsApp Community to receive travel deals, free stays, and special offers!
- Join Now -

This article was originally published in Rest of World, which covers technology’s impact outside the West.

People who use less widely spoken languages could end up paying more to use artificial intelligence than those who speak English or other dominant languages.

A new study published last month by the Coalition for Language Equity in AI Research found AI models require far more tokens for some languages than others. Tokens are the units of text or data that the models process. The researchers have called this a hidden “tokeniser tax,” which can make AI more expensive in languages with smaller online presence. A tokeniser is a tool that breaks down raw text, images, or audio into tokens.

Even within the 20 most popular languages on the internet, there is a gap in token usage, the research found. The most expensive of the languages used between 1.5 and 5 times more tokens than the cheapest. This gap widened when researchers expanded the set to 200 languages, with the token cost gap in one AI model growing by 17 times.

“A startup in [Bengaluru] may pay a surcharge on every prompt and completion while its competitor in Austin does not,” the study said. “The tokeniser tax also has implications beyond cost. Higher...

Read more

What's Your Reaction?

Like Like 0
Dislike Dislike 0
Love Love 0
Funny Funny 0
Angry Angry 0
Sad Sad 0
Wow Wow 0