Kimi K2.7-Code cuts thinking tokens 30% — but practitioners say the benchmarks don't check out

Moonshot AI가 K2 코딩 모델군의 오픈소스 업데이트인 Kimi K2.7-Code를 공개하며 K2.6 대비 thinking-token 사용량을 30% 줄였다고 밝혔습니다. 이 모델은 기존과 같은 1조 파라미터급 mixture-of-experts 구조를 쓰며 OpenAI-compatible API, vLLM, SGLang 배포를 지원하지만, temperature 조정 없이 thinking mode로만 동작합니다. 성능 향상 수치는 Moonshot AI의 자체 벤치마크에 기반해, 실무자들은 독립 검증 부재를 문제로 제기하고 있습니다.

thinking-token 절감은 agentic workflow 운영 비용에 직접 영향을 주는 만큼, 주장이 사실이라면 대규모 코딩 자동화 환경에서 의미 있는 비용 개선으로 이어질 수 있습니다. 다만 자체 벤치마크 중심의 발표와 DeepSWE 같은 독립 평가 미제출은 모델 성능 경쟁이 ‘점수 마케팅’과 실제 운영 성능 검증 사이의 긴장을 키우고 있음을 보여줍니다.

Moonshot AI released Kimi K2.7-Code this week, an open-source update to its K2 coding model family, claiming leaner reasoning and double-digit performance gains.K2.7-Code is built on the same trillion-parameter mixture-of-experts architecture as its predecessor K2.6, and drops in via an OpenAI-compatible API — which matters for teams already running K2.6 in production gateways.When K2.6 launched in April, it topped OpenRouter's weekly LLM leaderboard — a ranking based on actual API routing decisions by developers, not self-reported benchmark scores.Moonshot AI says K2.7-Code addresses what it calls "overthinking," reducing thinking-token usage by 30% compared to K2.6 — a number that would directly affect inference costs for teams running agentic workflows. Whether that efficiency gain holds on independent benchmarks is a question practitioners have already started raising publicly.What Kimi K2.7-Code isK2.7-Code is released under a Modified MIT license, with weights available on HuggingFace. The model is deployable via vLLM or SGLang. It runs exclusively in thinking mode and does not support temperature adjustment — Moonshot AI has fixed it at 1.0, meaning teams cannot tune output determinism the way they might with other models.The core change from K2.6 is how the model generates low-level code. Where K2.6 produced implementations by wrapping existing libraries and routing through established frameworks, K2.7-Code authors implementations directly. Moonshot AI says this produces more reliable generalization across Rust, Go and Python, and across task types including frontend development, DevOps and performance optimization.On benchmark performance, Moonshot AI claims gains of 21.8% on Kimi Code Bench v2, 11% on Program Bench and 31.5% on MLS Bench Lite. All three are proprietary benchmarks run by Moonshot AI. The model has not been submitted to DeepSWE, an independent coding benchmark that produces a 70-point spread across models — compared to SWE-Bench Pro's 30-point spread — making it a more discriminating signal for teams configuring model routing systems.More honest, weaker for itThe picture from outside Moonshot's own benchmarks is more complicated.Researcher Elliot Arledge ran K2.7-Code against K2.6 and Claude Fable 5 on KernelBench-Hard, a public benchmark focused on GPU kernel optimization, and published his full run logs at kernelbench.com. "K2.7 is more honest but not more capable," Arledge wrote on X. On five of six problems, K2.7-Code produced real authored Triton kernels where K2.6 had used library wrappers. Two of those kernels failed on the model's own bugs. The MoE kernel result regressed from K2.6's score of 0.222 to 0.157. "Fable, for reference, tops every cell it doesn't honestly fail," Arledge wrote.Sugumaran Balasubramaniyan, a developer who built a model-task-router for the Hermes Agent platform using DeepSWE as his reference signal, responded publicly to the K2.7-Code release and challenged Moonshot AI directly on the benchmark choices. "Respectfully, every model 'improves' double digits on its own test suite," Balasubramaniyan wrote on X. He noted that K2.6 scored 24% on DeepSWE, tied with GPT-5.4-mini, and asked whether Moonshot AI would submit K2.7-Code to the same benchmark. Balasubramaniyan said it took 13 review rounds to get the benchmark data right for his router and that he would route coding tasks to K2.7-Code if the independent numbers hold up.What this means for enterprisesThe token efficiency gain is immediately usable. Teams running K2.6 in production can swap in K2.7-Code via the OpenAI-compatible API and expect lower inference costs on agentic workflows without an architecture change. The 30% thinking-token reduction is Moonshot's own number, but the integration path is low-risk enough to test against your own workloads before committing.The practical question is whether those efficiency gains hold on a team's own task distribution. Running K2.7-Code against your own workloads before adjusting gateway weights is the low-risk path to finding out.