SINOON

What is Token (AI)?

A token is the unit of text a language model reads and writes: a piece of a word, a short word or a punctuation mark. It's also the unit used to bill AI model usage through APIs.

Before processing a text, the model splits it into tokens. In English, a token averages about three quarters of a word; other languages, such as Portuguese, usually need more tokens for the same content. Providers bill input tokens (what you send, including instructions and documents) separately from output tokens (what the model answers), so trimming instructions and avoiding resending entire documents lowers the cost of an agent in production.

Put AI to work in your company

Talk to the SINOON team and find out which agent, squad or engagement makes sense for where you are now.

Custom AI agents, automation squads, consulting and team training.