Bookmarks
SubscribeDev tools, references, and rabbit holes Tiago wants to keep around.
Monday, June 29, 2026
Wednesday, June 24, 2026
Saturday, June 20, 2026
Monday, June 15, 2026
Sunday, June 14, 2026
Tuesday, June 9, 2026
If you liked this piece, you should subscribe to my premium newsletter. It’s $70 a year, or $7 a month, and in return you get a weekly newsletter that’s usually anywhere from 5,000 to 18,000 words, including vast, detailed analyses of NVIDIA, Anthropic and OpenAI’s finances, and the AI bubble writ large (updated to version 3.0 last week). My Hater's Guides To the SaaSpocalypse, Private Credit and Private Equity are essential to understanding our current financial system, and my guide to how Open
Monday, June 8, 2026
Monday, June 1, 2026
Saturday, May 30, 2026
Friday, May 29, 2026
Focused Energy is the leading Laser Fusion company building on NIF’s foundation & pursuing the most promising path to clean, limitless fusion power
Wednesday, May 27, 2026
Transformer-based large language models are increasingly used for long-horizon tasks; however, their attention mechanism scales poorly with context length. To handle this, we study a sleep-like consolidation mechanism in which a model periodically converts recent context into persistent fast weights before clearing its key-value cache. During sleep, the model performs $N$ offline recurrent passes over the accumulated context and updates the fast weights in its state-space model (SSM) blocks through a learned local rule. During inference, this shifts extra computation to sleep while preserving the latency of wake-time prediction. We test our method on controlled synthetic tasks, including cellular automata and multi-hop graph retrieval, as well as a realistic math reasoning task, on which a regular transformer as well as SSM-attention hybrid models fail. We then show that increasing sleep duration $N$ for our models improves performance, with the largest gains on examples that require deeper reasoning.
Tuesday, May 26, 2026
Saturday, May 23, 2026
Friday, May 22, 2026
Thursday, May 21, 2026
Astra plus infinite AI employees for marketing, coding, ops, finance, support, and more.