Models / phi-3-mini-4k-instruct

Phi-3 Mini 4K Instruct

A 3.8B-parameter decoder with fused QKV and gate/up projections, full (non-grouped) multi-head attention, RMS normalization, SwiGLU, and an untied output head, instruction-tuned for a 4K context.

3.8B parametersphi3MITtext-generationdecoder-onlychat

Greedy decoding of one chat prompt, through Linnet and through transformers (KV cache, argmax, bf16).

Prompt

Explain in two sentences why the sky is blue.

Linnet

The sky appears blue due to a phenomenon called Rayleigh scattering, where molecules and small particles in the Earth's atmosphere scatter sunlight in all directions, and blue light is scattered more than other colors because it travels as shorter, smaller waves. This scattered blue light is what we see when we look up at the sky on a clear day.

transformers (KV cache, argmax, bf16)

The sky appears blue due to a phenomenon called Rayleigh scattering, where molecules and small particles in the Earth's atmosphere scatter sunlight in all directions, and blue light is scattered more than other colors because it travels as shorter, smaller waves. This scattered blue light is what we see when we look up at the sky on a clear day.

All 76 generated tokens agree with the reference.