# Large language models transition from integrating across position-yoked, exponential windows to structure-yoked, power-law windows.

Article · David Skrill, Sam Norman-Haignere

- Archive id: pmid:38434255
- Published: 2023-12-01
- Venue: PubMed
- PMID: 38434255
- Citations: 2
- Source URL: https://pubmed.ncbi.nlm.nih.gov/38434255
- PDF: https://pmc.ncbi.nlm.nih.gov/articles/PMC10907028/pdf/nihms-1969579.pdf
- Provenance: openalex

_Abstract not reproduced: its license does not permit redistribution. See the source URL._

Topics: [Scaling Laws & Compute-Optimal Training](https://space-kitty.com/topics/scaling-laws)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.
