pub const BYTES_PER_TOKEN: u64 = 4;Expand description
Bytes of a file per estimated token. Four is the working figure for English prose and for the YAML and Markdown this layer is made of; the answer says which divisor it used so that a caller measuring differently can convert rather than guess.