Repository:test-time-training/e2e
End-to-End Test-Time Training for Long Context in JAX
This repository provides the official JAX implementation of End-to-End Test-Time Training (TTT) for long contexts. It approaches long-context language modeling as a continual learning challenge, using a standard Transformer with sliding-window attention that compresses input contexts into its weights at test time via next-token prediction.
693starsPython
From Video: Weekly AI Updates: Local Models, GPT-6 Astra, and Agent Architectures