mfowler
3bf3316572
Capstone summary of the Builder/Adversary prompt + verification-cadence study: - adversary EXISTENCE costs ~4.7x (solo 2.8M vs ~13M); cadence is ~token-neutral - context hygiene is the one clean -22% win; minimal prompts -25% but test less - deferred review saves nothing (the one comprehensive pass is expensive) + late - cost is process not product (tokens~duration 0.83, ~commits 0.79, ~LOC -0.04) All results now in-repo: FINDINGS.md + RESULTS-campaign.md + raw .data + runners. (deferred N=3, finalizing to N=5.)
32 lines
1.9 KiB
Plaintext
32 lines
1.9 KiB
Plaintext
builder-adversary 1 YES 6118255 4999219 11117474 960 14 466
|
|
builder-adversary 2 YES 7058221 6521395 13579616 1680 13 449
|
|
builder-adversary 3 YES 7057033 7903381 14960414 1080 16 458
|
|
builder-adversary 4 YES 6723564 6314119 13037683 1020 13 429
|
|
builder-adversary 5 YES 6177117 5725981 11903098 1020 15 381
|
|
builder-adversary-min 1 YES 4608722 4526996 9135718 780 15 367
|
|
builder-adversary-min 2 YES 5692897 5693518 11386415 720 17 347
|
|
builder-adversary-min 3 YES 5225139 4091537 9316676 1140 16 396
|
|
builder-adversary-min 4 YES 4996985 4976828 9973813 660 14 347
|
|
builder-adversary-min 5 NO 2479575 1213596 3693171 1800 4 128
|
|
builder-adversary-min 1 YES 4508074 5264507 9772581 660 14 387
|
|
builder-adversary-stateless 1 YES 5439341 5018236 10457577 900 15 400
|
|
builder-adversary-stateless 2 YES 4958232 5034602 9992834 840 13 341
|
|
builder-adversary-stateless 3 YES 5035212 5059218 10094430 900 14 463
|
|
builder-adversary-stateless 4 YES 4736715 5385660 10122375 960 13 328
|
|
builder-adversary-stateless 5 YES 7083535 5926257 13009792 1020 17 468
|
|
builder-adversary-lean 1 YES 6605782 6356919 12962701 900 28 390
|
|
builder-adversary-lean 2 YES 7290398 6118951 13409349 1080 28 451
|
|
builder-adversary-lean 3 NO 3476619 3041803 6518422 1800 11 259
|
|
builder-adversary-lean 4 YES 6208552 7607043 13815595 960 24 378
|
|
builder-adversary-lean 5 YES 5959024 6142331 12101355 960 28 431
|
|
builder-adversary-lean 1 YES 8030199 5763715 13793914 1020 25 354
|
|
builder-solo 1 YES 2417528 0 2417528 360 5 401
|
|
builder-solo 2 YES 2747457 0 2747457 420 7 450
|
|
builder-solo 3 YES 2837115 0 2837115 420 6 426
|
|
builder-solo 4 YES 2773634 0 2773634 420 5 398
|
|
builder-solo 5 YES 2948467 0 2948467 420 4 446
|
|
builder-adversary-deferred 1 YES 7375559 5991241 13366800 1020 10 425
|
|
builder-adversary-deferred 2 YES 7803666 5084416 12888082 840 7 381
|
|
builder-adversary-deferred 3 YES 8034336 7299906 15334242 1260 12 444
|
|
builder-adversary-deferred 4 NO 4589433 3947296 8536729 2700 6 146
|