RoPE

arxiv.org ↗

and YaRN - rotary position embeddings and context-length extension.

and YaRN - rotary position embeddings and context-length extension.

This entry links to an external website rather than a GitHub repository, so there's no README to display here.