Ai2's Bolmo byte-level model research is published in Nature
Ai2 says the research behind Bolmo, its family of fully open byte-level language models introduced last December, has been published in Nature. The paper describes "byteifying," a process that converts an existing subword model into a byte-level one with a relatively short additional training run. Ai2 applied it to Qwen 3 8B and Llama 3 8B to make Bwen 8B and BlamaLlama-B 8B, which it says come close to the original models. Ai2 says Bwen 8B outperforms Bolmo 7B across its aggregate evaluation suite, and it has released new checkpoints and Stage 1 checkpoints on Hugging Face.