Sources指导来源
Two ideas we're building on.
我们站在的两个肩膀。
GAN (Goodfellow et al., 2014) — a generator and a discriminator train adversarially. The sharper the discriminator, the stronger the generator becomes. Our nine design skills are the generator, design-review is the discriminator.
GAN(Goodfellow et al., 2014) —— generator 和 discriminator 对抗训练。discriminator 越锐利,generator 就越强。我们的 9 个设计 skill 是 generator,design-review 是 discriminator。
Anthropic, Harness design for long-running apps — planner / generator / evaluator three-part split, evaluators must be separate, sprint contracts, 5–15 iteration rounds. The rule we take most seriously: each harness component must correspond to one specific model weakness. Assumptions worth stress-testing, because they may be incorrect or quickly outdated.
Anthropic 的 Harness design for long-running apps —— planner / generator / evaluator 三段式,evaluator 必须独立,sprint contract,5–15 轮迭代。我们最认真对待的一条:每一个 harness 组件都要对应模型的一个具体弱点。这些假设值得压测,因为它们可能不对,或者很快过时。
Agents tend to praise their own work confidently — even when quality is obviously mediocre to a human observer. Separating the agent doing the work from the agent evaluating it is a powerful lever.
Agent 倾向于自信地称赞自己的作品 —— 哪怕在人类观察者看来质量明显平庸。把做事的 agent 和评判的 agent 分开,是一个真正的杠杆。
Anthropic — Harness design postAnthropic —— harness-design 文章