Two Papers That Question the LLM Recipe

For the modern LLM era, the standard recipe has rested on two pillars: a fixed tokenizer, and next-token prediction. Text becomes tokens, and the model learns by guessing the next one. Two lines of work are now challenging that recipe from opposite sides. Meta’s Byte Latent Transformer (BLT) asks whether we need tokens at all. […]