You're right. There was also an experiment in Meta which tokenized bytes directl...

		curioussquirrel 76 days ago \| parent \| context \| favorite \| on: LLMs are getting better at character-level text ma... You're right. There was also an experiment in Meta which tokenized bytes directly and it didn't hurt performance much in very small models.