Hacker News

TinyToT

by @vkaku

I recently decided to build and run my own training free inference engine... and it worked. It's called TinyToT: https://github.com/guilt/TinyToT You basically get a LLM without any training/RL here. See: https://x.com/i/status/2076344798525460581

Discover more builders

Builderlust is an endless, joyful scroll of real projects people are shipping right now. Get the app to keep finding your next spark of inspiration.

📱 Coming soon to iOS & AndroidOpen in the app