Skip to main content
要約チューブ
Sign in

Token

The unit LLMs work in. Roughly four English characters or one-to-two Japanese characters per token.

Tokens are the billing and context-limit unit for LLMs. English runs at about four characters per token; Japanese and Chinese compress to roughly one-to-two characters per token, making them slightly more expensive. SumTube accounts for this when deciding how much of a Japanese transcript to send in one request.