Models / tinyllama-1.1b-chat

TinyLlama 1.1B Chat v1.0

A 1.1B-parameter Llama 2 architecture trained on 3 trillion tokens, chat-tuned.

1.1B parametersllamaApache-2.0text-generationdecoder-onlygrouped-query-attentionchat

Greedy decoding of one chat prompt, through Linnet and through transformers (KV cache, argmax, bf16).

Prompt

Explain in two sentences why the sky is blue.

Linnet

The sky is blue because the sunlight reflects off the Earth's atmosphere, which contains a variety of colors, including red, orange, yellow, green, blue, and violet. The blue color is produced by the combination of these colors, which are scattered and refracted by the atmosphere. The blue color is also due to the presence of water molecules in the atmosphere, which absorb some of the blue light and reflect it back to the Earth's

transformers (KV cache, argmax, bf16)

The sky is blue because the sunlight reflects off the Earth's atmosphere, which contains a variety of colors, including red, orange, yellow, green, blue, and violet. The blue color is produced by the combination of these colors, which are scattered and refracted by the atmosphere. The blue color is also due to the presence of water molecules in the atmosphere, which absorb some of the blue light and reflect it back to the Earth's

All 96 generated tokens agree with the reference.