Infini-attention: Memory Architectures for Very Long Conversations

Understanding infinite-context transformer ideas and how to adapt them for practical conversational systems.