Keys, queries, and values are all vectors during the LLMs. RoPE [sixty six] consists of the rotation on the query and