Estimates for a short prompt on a single device. Measured numbers come from community benchmarks (r/LocalLLaMA, localscore.ai and more); others are derived from similar setups or projected from specs. Open source on GitHub.
Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware
In short
Llmspeed offers users a hands-on experience with the performance of a local Large Language Model, using community benchmarks to estimate short-prompt speeds and providing transparency and community contributions. The project is open-source on GitHub.
Key points
- Llmspeed provides a feel-good factor before making a hardware purchase.: Llmspeed provides a feel-good factor before making a hardware purchase.
- Community benchmarks offer measured estimates for short-prompt speeds.: Community benchmarks offer measured estimates for short-prompt speeds.
- Open-source GitHub allows for transparency and community involvement.: Open-source GitHub allows for transparency and community involvement.