LongRoPE Strategy: Extending Context Without Losing the Plot

What LongRoPE suggests about scaling context windows while preserving useful long-range attention behavior.