Skip to content

latest rascal release - #11

Open
jurgenvinju wants to merge 4 commits into
mainfrom
latest-rascal-release
Open

jurgenvinju wants to merge 4 commits into
mainfrom
latest-rascal-release

Conversation

@jurgenvinju

@jurgenvinju jurgenvinju commented Oct 9, 2026 •

Copy link
Copy Markdown
Member
  • bumped versions and replaced JUnit with native rascal testing
  • deleted old test runner
  • fix new failing tests by normalizing casing in logical schemes

@jurgenvinju
jurgenvinju marked this pull request as draft October 9, 2026 10:39
@jurgenvinju jurgenvinju self-assigned this Oct 9, 2026
@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
5 4 1 0 0 0 1ms

Test Results

failed 1 failed
passed 4 passed

Details

tests 5 tests in 1 suites
clock 13.1s
tool Rascal test runner
build Build and Deploy arrow-right builds link #43
pull-request latest rascal release link #11

Failed Tests

junitM3RemainedTheSame

Insights

Average Tests per Run Total Flaky Tests Total Failed Slowest Test (p95)
5 0 1 8.2s

Fail Rate

Fail Rate 20.00%
Test 📝 Results 📊 Passed ✅ Failed ❌ Fail Rate (%) 📈
junitM3RemainedTheSame 1 0 1 100.00    ↑100.00

builds: Run #43

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
5 4 1 0 0 0 0 13.1s

❌ Some tests failed!

Name Failure Message
❌ junitM3RemainedTheSame Test lang::java::tests::BasicM3Tests::junitM3RemainedTheSame failed due to test returned false

Slowest Tests

Test 📝 Results 📊 Duration (avg) ⏱️ Duration (p95) ⏱️
junitASTsRemainedTheSame 1 8.2s 8.2s
junitM3RemainedTheSame 1 3.3s 3.3s
snakesASTsRemainedTheSame 1 1.2s 1.2s
hamcrestJarM3RemainedTheSame 1 223ms 223ms
snakesM3RemainedTheSame 1 87ms 87ms

Files

4 passed, 1 failed, and 0 skipped in 13.1s across 1 files

File Path Passed Failed Flaky Skipped Duration
❌ src/lang/java/tests/BasicM3Tests.rsc
        ✅ snakesASTsRemainedTheSame (1.2s)
        ✅ junitASTsRemainedTheSame (8.2s)
        ✅ hamcrestJarM3RemainedTheSame (223ms)
        ✅ snakesM3RemainedTheSame (87ms)
        ❌ junitM3RemainedTheSame (3.3s)
✅ 4 ❌ 1 13.1s

Github Test Reporter by CTRF 💚

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
5 5    ↑1 0    ↓1 0 0 0 19.0s    ↑5.9s

Test Results

passed 5 passed ↑1

Details

tests 5 tests in 1 suites
clock 19.0s ↑5.9s
tool Rascal test runner
build Build and Deploy arrow-right builds link #44
pull-request latest rascal release link #11

Insights

Average Tests per Run Total Flaky Tests Total Failed Slowest Test (p95)
5 0 1 14.9s

Fail Rate

Fail Rate 10.00%    ↓10.00
Test 📝 Results 📊 Passed ✅ Failed ❌ Fail Rate (%) 📈
junitM3RemainedTheSame 2 1 1 50.00    ↓50.00

builds: Run #44

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
5 5 0 0 0 0 0 19.0s

🎉 All tests passed!

Slowest Tests

Test 📝 Results 📊 Duration (avg) ⏱️ Duration (p95) ⏱️
junitASTsRemainedTheSame 2 11.6s 14.9s
junitM3RemainedTheSame 2 3.2s 3.3s
snakesASTsRemainedTheSame 2 843ms 1.2s
hamcrestJarM3RemainedTheSame 2 298ms 373ms
snakesM3RemainedTheSame 2 115ms 144ms

Files

5 passed, 0 failed, and 0 skipped in 19.0s across 1 files

File Path Passed Failed Flaky Skipped Duration
✅ src/lang/java/tests/BasicM3Tests.rsc
        ✅ junitASTsRemainedTheSame (14.9s)
        ✅ snakesM3RemainedTheSame (144ms)
        ✅ junitM3RemainedTheSame (3.2s)
        ✅ hamcrestJarM3RemainedTheSame (373ms)
        ✅ snakesASTsRemainedTheSame (438ms)
✅ 5 19.0s

± Comparison with run #43 at f50c4b4 | ⏱️ Measured over 2 runs.

Github Test Reporter by CTRF 💚

@jurgenvinju
jurgenvinju marked this pull request as ready for review October 12, 2026 07:47

@jurgenvinju jurgenvinju left a comment

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor changes were necessary to make the tests succeed and to make the documentation representative (no more uppercase characters in logical schemes)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant