Large language models transition from integrating across position-yoked, exponential windows to structure-yoked, power-law windows.
David Skrill, Sam Norman-Haignere
The abstract is not reproduced here because its license does not permit redistribution. Read it at the original source.
Record
- Archive ID
- pmid:38434255
- Published
- Dec 1, 2023
- Venue
- PubMed
- PubMed
- 38434255
- Categories
- Topic Modeling
- Provenance
- openalex