跳转至

dsh-llm-verifier

⭐ 11 · ✅ 活跃 · 插件
类型 插件 分类 搜索与研究
星数 ⭐ 11 状态 ✅ 活跃
作者 Aa728848 更新时间 —
子分类 🌐 网页搜索 能力 coding

一句话介绍

Configurable DSH-native LLM verifier with a Web settings page

详细介绍

Generate several coding-agent patches, reject the ones that fail your tests, and let an LLM verifier rank the rest before you decide whether to apply the winner. 简体中文 dsh-llm-verifier is a developer-preview plugin for DeepSeek Harness. It runs 3 or 5 independent coding candidates in detached Git worktrees, validates every candidate against project tests, ranks the passing patches with llm-verifier, and keeps the original checkout unchanged until a separate approval applies the selected patch.

✨ 核心特性

  • Best-of-3 or Best-of-5: use 3 candidates by default, or 5 for higher-value tasks.
  • Validation-first selection: failing candidates never enter model ranking.
  • Efficient ranking: one passing candidate wins by validation; two use one pivot; three to five use two pivots.
  • Two approval gates: one before candidate execution and another before applying the winner.
  • Integrity checks before apply: repository path, base HEAD, clean state, and winner-patch SHA-256 are checked again.
  • Auditable artifacts: reports include rankings, changed files, timings, process status, patch hashes, verifier requests, and token usage.

📦 安装

git clone https://github.com/Web0926/dsh-llm-verifier.git
cd dsh-llm-verifier

pnpm install --frozen-lockfile
uv sync --frozen --project python
pnpm run check

🚀 快速开始

dsh plugin --profile web add "$(pwd)"
dsh plugin --profile web list

📚 更多信息

1. Clone, install, and verify

git clone https://github.com/Web0926/dsh-llm-verifier.git cd dsh-llm-verifier pnpm install --frozen-lockfile uv sync --frozen --project python pnpm run check

Configuration

Default values: Override the plugin entry in the Web profile's cordis.patch.yml: config: defaultCandidateCount: 3 candidateProfile: headless credentialRef: DEEPSEEK_API_KEY verifierModel: deepseek-v4-flash nEvaluations: 2 maxVerifierWorkers: 8 verifierEffort: high verifierMaxTokens: 32768 candidateTimeoutMs: 1200000 validationTimeoutMs: 600000 runTimeoutMs: 2700000 maxVerifierTraceBytes: 524288

🔗 链接