“Llama three makes use of a tokenizer having a vocabulary of 128K tokens that encodes language much more competently, which ends up in considerably improved model overall performance,” the organization said. Code Shield is another addition that gives guardrails built to assistance