Tag: tokenization

All the articles with the tag "tokenization".

• The token tax of Norwegian Bokmål in LLMs

  Published: 5 May, 2026

  • 2 min read

  The same government foreword used 37.4% to 67.5% more tokens in Norwegian Bokmål than in English, despite fewer characters.