RunanywhereAI Trnrt

The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

What you get

RunanywhereAI Trnrt is a free, open-source AI tool published on GitHub by RunanywhereAI. The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere. GitHub stars: 804 License: Apache-2.0 (free to use) Language: Python Topics: aws, glm, inference, llm, llm-serving, megakernels, neuron, nki Last updated: 2026-11-09 How to get it: open the repository on GitHub, read the README and follow the setup steps. HEEEXY lists it in the Lab because it is popular, actively maintained and openly licensed.

More for new on github

  • Yetone Magpie: Every agent's model. One place. Codex on DeepSeek, Claude Code on Kimi, from the menu bar.
  • Printfilm: PRINTFILM: AI short-video marketing and AI short-drama creation platform
  • Answer Me With Html: Answer me with HTML — an agent skill that answers hard questions with a one-page HTML you can actually read. 让 AI Agent 用一页 HTML 回答复杂问题。