Mini Llms

Spanish This item is in Spanish.

4M params · step 20,000 · val_loss 2. Un mini-LLM decoder-only (RoPE, RMSNorm, SwiGLU, Grouped Query Attention) entrenado desde cero sobre WikiText-103.

Description read from the page itself, because the listing it was found in gave none.

Open it Listing Open in English

The English version is the original site passed through Google Translate. Nothing is translated or stored here.