All news
VIBPS / NEWS • AI INFRASTRUCTURE

Kimi K3.1 Pro weights are available: can makers run the model?

Moonshot has released Kimi K3.1 Pro model files. Its model card and AMD's serving guide show API and self-hosted options, with substantial hardware and license considerations.

The model files for Moonshot AI's Kimi K3.1 Pro are now on its Hugging Face page, following the model's earlier hosted launch. That changes the practical question for app makers: they can inspect and deploy the released weights under Moonshot's license, or use Moonshot's hosted API. The release does not mean a typical laptop can run the full model. AMD's November 4 serving guide describes an eight-accelerator data-center setup.

What exactly did Moonshot release?

Moonshot describes Kimi K3.1 Pro as an open-weight model for text and image input, tool calling and long-context tasks. Its model card lists 2.8 trillion total parameters, about 104 billion activated per token, and a maximum context length of 1,048,576 tokens. Those are architecture and configuration figures, not a promise that every deployment can economically process a million-token prompt or deliver the same quality on every workload.

The Hugging Face repository includes the model files and a specific Kimi K3.1 Pro license. Open weights let operators obtain and serve the model themselves; that term does not by itself establish that every use is unrestricted. Moonshot's license includes conditions for some large commercial model-as-a-service businesses and products. A maker planning a commercial deployment should read the actual license and check their own use case.

How can an app use Kimi K3.1 Pro?

The simplest documented route is Moonshot's API, selecting kimi-k3.1-pro. The model card also points to serving recipes for vLLM, SGLang and TokenSpeed. Self-hosting gives a team more control over where inference runs, but also makes the team responsible for infrastructure, updates and operation. Neither the model card nor a benchmark table proves that a particular app will run faster or cost less with its own deployment.

AMD reports day-one support on its Instinct MI355X hardware through ATOM and vLLM. Its tested setup uses eight MI355X accelerators for one node, and AMD says one million-token request can fit in that configuration. Its performance numbers come from specified hardware, software and workloads, so they should not be generalized to a single workstation or another provider's cluster. A smaller builder can assess the hosted API before considering dedicated serving capacity.

What should makers test before switching models?

For an app with a real audience, a model change is more than a leaderboard comparison. Test the tasks the app actually performs: answer quality, tool-call format, image handling if used, latency, failure cases and total operating cost. Moonshot's published benchmark results are vendor reports with particular settings. They do not establish how Kimi will behave in another product's prompts, data or safety workflow.

If a maker changes the model behind a feature, they should describe the change honestly to users and explain any routing or fallback behavior that affects results. VIBPS is a social network for software; it does not certify which model powers a visitor-owned app. This article is based on the released model card, license and AMD's serving report, without a VIBPS benchmark or hands-on deployment.

Can users verify which AI model an app uses?

More software stories, with sources and context.

More news