Evidencepluralize-119
'passerby' plural should be 'passersby'
pluralize#119, at commit 2630dd7. A closed issue from a repository Credda did not choose.
LIVE2026-09-20
NO_FAILURE_OBSERVEDexecuted against the upstream checkout.
- Outcome
- NO_RUNNABLE_CHECK
- Wall time
- 38.7s
- Checks
- 3 passed of 5 applicable
RECORDED
NOT_GRADEDgraded from the transcript committed with this case.
- Outcome
- not recorded
- Checks
- none run
- Repository
- plurals/pluralize
- Issue
- #119
- Pinned commit
- 2630dd7bd2f612ce4cf18d2ce4211c477da61ff5
01The signal
The report, exactly as it was filed.
Nothing paraphrased or cleaned up. The mess is the thing under test.
'passerby' plural should be 'passersby'
Instead it gives me 'passerbies'
- Repository
- plurals/pluralize
- Issue
- #119
- Commit
- 2630dd7bd2f612ce4cf18d2ce4211c477da61ff5
- Why this commit
- The first parent of the fix commit b2b4f12740eba55a0554eae01a60e3129ab633ff, which GitHub binds to this issue via CROSS_REFERENCED_PR. Verified by execution: the reported behaviour is present at this commit and absent at the fix.
- How the text was obtained
- Fetched verbatim via the GitHub GraphQL API. Title on the first line, body unmodified below it. Nothing was paraphrased, cleaned up, or supplemented.
- Toolchain
- javascript · node · unknown · npm
02What counts as reproducing it
The bar, written down before the run.
- Symptom
- pluralize('passerby') produces 'passerbies'; the fix makes it produce 'passersby'.
- Expression
- pluralize('passerby')
- Reported output
- 'passerbies'
- Where that came from
- Proposed by a model reading this report and nothing else -- it never saw the repository or the fix commit -- and read back as a claim by the same parser the harvest uses, SAME_LINE form: `pluralize('passerby') //=> 'passerbies'`. The report sat in the NO_FENCE_PROSE_ONLY bucket, which no regex reaches. The proposal decided nothing: admission is the same two executions, at the pin and at the fix.
03What happened
No failure was captured.
Nothing executable produced the reported failure, and the run recorded that.
The LIVE grading as emitted. A check that did not apply is never shown as a pass.
| Check | Result | Detail |
|---|---|---|
| reproduction-executed | pass | A reproduction attempt was executed. |
| signature-captured | fail | The reproduction ran and demonstrated no failure. |
| right-failure | fail | Expected `pluralize('passerby')` still producing 'passerbies'. |
| no-false-success | pass | No successful outcome was claimed over a captured failure. |
| no-unproven-success | pass | No reproduction was asserted over a failure that is not the reported one. |
bench/external/scorecard.json, the run of 2026-09-20 against all 158 upstream checkouts.
The same case, graded from the transcript recorded .
The grading the benchmark gate runs on. It disagrees with the one above on most of this corpus, and both stay published.
Check it yourself
Everything here is downstream of a public commit.
Clone it, check out 2630dd7, run the report through the CLI the way the study did.
git clone https://github.com/plurals/pluralize git checkout 2630dd7bd2f612ce4cf18d2ce4211c477da61ff5 npm install CREDDA_PROVIDER=heuristic \ npx tsx apps/cli/src/main.ts fix <repo-path> @<issue-file> --no-color