Hacker News · 首页· fsbonetto·· 2026-10-07精选AI 评分49
OpenTPU：用 AI 开发的开源 AI 推理加速器，小模型达 80+ tok/sec
OpenTPU – An open-source AI accelerator, developed by AI
AI 导读
作者 fsbonetto 发布 OpenTPU，一个用 AI 开发的开源 AI 推理引擎，此前其团队已用同样方法开发 RISC-V CPU 核心。该项目可运行 Qwen 3.5、Gemma 4 等多数现代模型，性能起初每秒仅几个 token，经递归自我改进循环后在较小模型上达到 80+ tok/sec。
推荐理由
开源 AI 加速器项目公开了用 AI 递归自我改进提升性能的路径，对关注 AI 辅助硬件开发的读者有参考价值。
正文
 | After using AI to develop risc-v CPU cores, the same technique was used for developing openTPU. An open source AI inference engine. It's able to run most of the modern models like Qwen 3.5, Gemma 4, and many others. The TPU started able to produce only a few tokens per second and trough a recursive self improvement loop got to 80+ tok/sec on the smallers models. |
来源：Hacker News · 首页 · news.ycombinator.com