Skip to content

test: [expected failures] EXPR fixtures needing implementation fixes - #164

Draft
leongdl wants to merge 1 commit into
OpenJobDescription:mainlinefrom
leongdl:conformance-expr-lang-expected-failures
Draft

test: [expected failures] EXPR fixtures needing implementation fixes#164
leongdl wants to merge 1 commit into
OpenJobDescription:mainlinefrom
leongdl:conformance-expr-lang-expected-failures

Conversation

@leongdl

@leongdl leongdl commented Aug 2, 2026

Copy link
Copy Markdown
Contributor

Important

Expected-failure fixtures — do not expect these to pass. Spec-correct fixtures that FAIL against at least one current implementation, parked in EXPR/proposed/ (not discovered by the runner) so merging keeps the suite green. Per-fixture output, spec citation, and classification in proposed/README.md. Promote each fixture unchanged when its fix lands.

Contents (5 fixtures, dual-implementation verified)

  • expr2.1.1--int64-overflow-param-default.invalid — INT param default: 2^63 accepted at check by BOTH implementations. The known live acceptance bug on the template-validation axis. Also blocked on restoring RFC 0005's dropped "64-bit Signed Integer Type" section to the published spec.
  • expr2.1.1--int64-max-task-range.test — openjd-rs FALSELY REJECTS a valid task-range endpoint of 2^63−1 ("Integer overflow"); probing shows acceptance ends at 2^62−1. Python accepts and runs. The spec admits any int64. Rust-side bug, the mirror image of the acceptance bug.
  • expr2.1.1--int64-overflow-task-range.invalid — task-range element 2^63: openjd-rs correctly rejects; the Python CLI accepts. Python-side bug.
  • expr2.1.3--membership-element-type-mismatch.invalid"a" in [1, 2] accepted by openjd-rs (evaluates to false at runtime); Python rejects at validation. §2.1.3 defines membership only as (list[T], T). Rust-side bug.
  • 3.6.1--let-identifier-513.invalid — a 513-char let identifier accepted by BOTH implementations; schema §3.6.1 caps <UserIdentifier> at 512. The 512 accept-twin is green in the companion PR.

Companion to the green-fixture PR from branch conformance-expr-lang-gaps.

…in proposed/)

Five parked fixtures with dual-implementation observations: the int64 param-default acceptance (both implementations), the openjd-rs 2^62 false-reject on task-range endpoints (Python accepts, spec admits any int64), the Python-only task-range 2^63 acceptance, the untyped membership acceptance in openjd-rs, and the unenforced 513-char let-identifier cap (both). Per-fixture output, spec citation, and classification in proposed/README.md. Companion to conformance-expr-lang-gaps.

Signed-off-by: David Leong <116610336+leongdl@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant