InFeeo
Global
All
New
Language

Channels

Next-Latent Prediction Transformers [R](reddit.com)
Microsoft Research Preprint Next-token prediction is myopic. What if transformers learn to predict their own next latent state? Microsoft Research present Next-Latent Prediction (NextLat): a self-supervised learning method that teaches transformers to form compact world models for reasoning and planning. It also unlocks up to 3.3x faster inference via self-speculative decoding! On top of next-token prediction, NextLat trains the transformer to predict its own next latent state given the current latent state and next token. NextLat has a few key benefits: Representation Learning: NextLat encourages transformers to compress history into compact belief states. Better Data Efficiency: predicting in latent space provides denser supervision than predicting one-hot tokens. Faster Inference: via recursive multi-step lookahead. I'm super excited about this work. Please do check it out below: 💬 Blog: https://jaydenteoh.github.io/blog/2026/nextlat 💻 Code: https://github.com/JaydenTeoh 📝 Paper: https://arxiv.org/abs/2511.05963 submitted by /u/jayden_teoh_ [link] [Kommentare]
ICRA'27(reddit.com)
Hello Everyone, I am preparing my manuscript for upcoming ICRA'27. But They have page limit of 8 pages, including references. As well, They don't accept any supplementary documents. So my question is how can I show more experiments and ablation studies? Because 8 page is not sufficient. Any tips? Much appreciated!! submitted by /u/selim_sarowar [link] [Kommentare]