Title: TIL: Conversion Factors Between Tokens and Words Date: 2025-02-14 Tags: llms Summary: Today I Learned: Small tools and facts I've learned Status: published Helpful [rules of thumb](https://help.openai.com/en/articles/4936856-what-are-tokens-and-how-to-count-them) for understanding tokens: ``` 1 token ~= 4 chars in English 1 token ~= ¾ words 100 tokens ~= 75 words ``` ``` 1-2 sentence ~= 30 tokens 1 paragraph ~= 100 tokens 1,500 words ~= 2048 tokens ```