eval
Public results and task definitions for FrontierHarness Eval
- 形态
- Plugin 插件
- 安装
- 通过 profile 安装
- 需要密钥
- 是
- 近月下载
- —
- 最近推送
- 1 个月前更新
项目说明
From README
FrontierHarness Eval Explore the live results → · Read the blog → · Evaluate your own harness → Similar pass rate.17.5x cost differences.We ran the same Kimi K3 model through nine coding-agent harnesses—12 configurations in total—on the same 30 software-engineering tasks.
With the model, tasks, and runtime held constant, changing the harness changed pass rate, cost, cache behavior, and speed.Full results Harness (configuration) Pass rate Median cost per pass Cache, median cell Median time --- --- --- --- --- Codex 66.7% $3.47 88.0% 6m 43s DSH Creator 63.3% $3.28 84.
3% 6m 44s Claude Code 63.3% $18.34 67.8% 9m 38s Pi 60.0% $2.43 79.4% 7m 33s DSH PTC 60.0% $4.58 87.2% 7m 44s DSH Standard 60.0% $3.46 86.5% 6m 17s Oh My Pi 56.7% $4.75 82.2% 6m 46s Kimi Code 56.7% $3.65 88.0% 7m 56s DSH Minimal 56.7% $4.72 84.6% 5m 41s Exo Harness 53.3% $1.05 70.
3% 6m 17s OpenCode 50.0% $3.24 78.4% 6m 27s H
安装方式
通过 profile 安装 · 需要额外配置密钥
npx skills add https://runta.com/docs --skill runta-installer runta-clinpx skills add frontier-harness-eval/eval --skill frontierharness-evalnpx skills add https://runta.com/docs --skill runta-installer runta-cli --agent codex -y安装命令包含风险形态
- 全局安装,会改动系统级依赖
全局安装会修改系统级依赖;远程脚本执行等于把执行权交给仓库作者。装前请通读命令。
为什么是这个分数
近 60 天内有提交;README 给出了可直接复制的安装命令;运行前需要准备 API Key 或环境变量。
- 维护活跃
- 70
- 实用度
- 92
- 生态热度
- 56
- 上手便捷
- 68
- 信号质量
- 96
- 数据置信度
- 100%
相关插件
huashu-design
alchaincyf/huashu-design
Huashu Design 3.0 · 在 agent 里打一句话,拿回能交付的设计:网页 / App 原型 / 可编辑 PPTX / 动画 / 信息图 · 六个候选挑三个方向 · 84 种带样张的风格库 · 越用越懂你的外观账本与设计体检 · HTML-native design skill for Claude Code, Codex, Cursor & any agent
dsh-chat-import
Nwflower/dsh-chat-import
把 13 家 coding agent(Claude Code、Codex、ChatGPT、Cursor、Gemini、opencode 等)的完整对话历史导入为可续聊的 DeepSeek Harness 会话,并支持反向导出回 Claude Code。
iPolloWork
Devin-AXIS/iPolloWork
Enterprise-grade, local-first Agent Workbench for people and agent teams. A unified multi-engine workspace for Codex Harness, DeepSeek Harness, and OpenCode, with unified plugins and Skills, multi-agent projects and tasks, and editable code, documents, presentations, design, and video.