Nestmodels for Linnet
Models / llama-3.1-8b-instruct

Llama 3.1 8B Instruct

An 8B-parameter Llama-architecture decoder with grouped-query attention, llama3 rope scaling for a 131072-token context, a 128256-token vocabulary, and an untied output head, instruction-tuned.

8B parametersllamallama3.1text-generationdecoder-onlygrouped-query-attentionchat
Hugging FaceGitHubarXiv Registry entry

Greedy decoding of one chat prompt, through Linnet and through transformers (KV cache, argmax, bf16).

Prompt

Explain in two sentences why the sky is blue.

Linnet

Here is a two-sentence explanation: The sky appears blue because of a phenomenon called Rayleigh scattering, in which shorter (blue) wavelengths of light are scattered more than longer (red) wavelengths by the tiny molecules of gases in the Earth's atmosphere. As a result, the blue light is dispersed in all directions, reaching our eyes from every part of the sky and giving it its blue color.

transformers (KV cache, argmax, bf16)

Here is a two-sentence explanation: The sky appears blue because of a phenomenon called Rayleigh scattering, in which shorter (blue) wavelengths of light are scattered more than longer (red) wavelengths by the tiny molecules of gases in the Earth's atmosphere. As a result, the blue light is dispersed in all directions, reaching our eyes from every part of the sky and giving it its blue color.

All 81 generated tokens agree with the reference.