← Founder Notes
Archive

The next big speedup in ai isn't a bigger model, it's not generating at all. nandhakishorm/laya,…

Yethikrishna ROriginal on Threads

the next big speedup in ai isn't a bigger model, it's not generating at all. nandhakishorm/laya, trending on github september 23, answers typed questions about any text in one 33-millisecond forward pass, and the repo picked up over 6,500 stars this week.

autoregressive tokens are a tax that some workloads no longer need to pay.

Provenance

The note above is reproduced unedited from the original post, first published on Threads on 23 September 2026 at 22:06 IST.

View the original post
Embed this note
<iframe src="https://founder.myndlabs.tech/notes/embed/the-next-big-speedup-in-ai-isn-t-DdowOLXiL0L" width="480" height="420" style="border:0;max-width:100%" loading="lazy" title="The next big speedup in ai isn't a bigger model, it's not generating at all. nandhakishorm/laya,…"></iframe>

More notes