Sign in

Evidencemathjs-680

eval inequations with string scope

mathjs#680, at commit 2c1b8f2. A closed issue from a repository Credda did not choose.

LIVE2026-09-20

RIGHT_FAILURE

executed against the upstream checkout.

Outcome
PATCH_REJECTED
Wall time
132.0s
Checks
5 passed of 5 applicable

RECORDED

NOT_GRADED

graded from the transcript committed with this case.

Outcome
not recorded
Checks
none run
Repository
josdejong/mathjs
Issue
#680
Pinned commit
2c1b8f2f057a57bf9c0406c60f6cb99fd63f3179

01The signal

The report, exactly as it was filed.

Nothing paraphrased or cleaned up. The mess is the thing under test.

mathjs#680 · as filedcommit 2c1b8f2

eval inequations with string scope

I'm using eval() in an nodejs project and it works great until i found this:

```
    print(math.eval('W<=5*Z', {W:'50',Z:'300'}));    // false
    print(math.eval('W<=5*Z', {W:50,Z:300}));        // true
```

Shouldn't the string scope eval the same way the number scope does?

PS: I tried the code above also on
http://jsbin.com/devacu/edit
Issue
#680
Commit
2c1b8f2f057a57bf9c0406c60f6cb99fd63f3179
Why this commit
The first parent of the fix commit 326c9fb0de90fd8316df4db70fda643544158292, which GitHub binds to this issue via CLOSED_EVENT_COMMIT. Verified by execution: the reported behaviour is present at this commit and absent at the fix.
How the text was obtained
Fetched verbatim via the GitHub GraphQL API. Title on the first line, body unmodified below it. Nothing was paraphrased, cleaned up, or supplemented.
Toolchain
javascript · node · unknown · npm

02What counts as reproducing it

The bar, written down before the run.

expected.reportedFailurecommitted with the case
Symptom
math.eval('W<=5*Z', {W:'50',Z:'300'}) produces false; the fix makes it produce true.
Expression
math.eval('W<=5*Z', {W:'50',Z:'300'})
Reported output
false
Where that came from
Read mechanically from the report's fenced code, SAME_LINE form: `print(math.eval('W<=5*Z', {W:'50',Z:'300'})); // false`.

03What happened

The live run reproduced the reported failure.

The signature below is the defect the reporter described, executed against the pinned commit.

captured failure signatureLIVE · normalized
`math.eval('W<=5*Z', {W:'50',Z:'300'})` still produces false (read false)
bench external · checks · LIVE5 checks · 2026-09-20

The LIVE grading as emitted. A check that did not apply is never shown as a pass.

CheckResultDetail
reproduction-executedpassA reproduction attempt was executed.
signature-capturedpass`math.eval('W<=5*Z', {W:'50',Z:'300'})` still produces false (read false)
right-failurepassReproduced the reported failure: math.eval('W<=5*Z', {W:'50',Z:'300'}) produces false; the fix makes it produce true.
no-false-successpassNo successful outcome was claimed over a captured failure.
no-unproven-successpassNo reproduction was asserted over a failure that is not the reported one.

bench/external/scorecard.json, the run of 2026-09-20 against all 158 upstream checkouts.

The same case, graded from the transcript recorded .

The grading the benchmark gate runs on. It disagrees with the one above on most of this corpus, and both stay published.

Check it yourself

Everything here is downstream of a public commit.

Clone it, check out 2c1b8f2, run the report through the CLI the way the study did.

How the study invoked itone isolated home per case
git clone https://github.com/josdejong/mathjs
git checkout 2c1b8f2f057a57bf9c0406c60f6cb99fd63f3179
npm install

CREDDA_PROVIDER=heuristic \
  npx tsx apps/cli/src/main.ts fix <repo-path> @<issue-file> --no-color
Read the full studyAll 158 cases