ThatSplash19
Menu

Research notes

Harness engineering: the agent is only one part.

A frozen model still needs an engineered environment: observe, decide, act, verify - with permissions, schemas, and completion checks outside the model. Educational and informational.

Agent execution loop

Source: harness engineering notes and related papers (screenshot-only until verified).

Ten harness pieces

Checker view (governed review)

Educational pattern for careful review. A draft is not a finished release. A reviewer's pass is not the same as a human approval to publish.

Author

Builds the draft. May propose fixes. Does not mark the work as finished for the public.

Checker (separate person or role)

Reviews against a fixed checklist. A clear verdict line is required - not a free-form "looks good."

Target: none
VERDICT: REVISE
Review rounds: limited
Open notes: keep a separate list - do not silently rewrite the same pack
Save as a new revision; do not overwrite the prior review

Human approval

Publishing needs a separate human approval bound to the exact files being released. A reviewer's pass never substitutes for that.

Checked Inferred Unknown

Unknown evidence should not be presented as ready to publish. Do not invent statistics, prices, or revenue figures.

Failure-avoidance tips

  • Sort before hash/compare - unordered rows must not change a checksum.
  • Stamp holdout contamination - selecting after seeing results blocks "out-of-sample pass" language.
  • Name the cost assumption - keep/retire language must show the cost column.
  • Link-check cited paths - docs must not name files that are not available to the reader.
  • No invented figures - if a number is not verified, label it unknown and leave it out of publish chrome.

No screenshot is used as a source on this page.

About this study

Some content on this site is made with the help of AI tools. AI-assisted, human-directed.

Education and information only. No professional advice. Results are not guaranteed.

Back to Research