latest rascal dep and tests

[jurgenvinju]

• no more annotations
• fixed compilation errors in Java due to new overloads and null parameters
• replaced JUnit tests by native rascal tests in the pom
• fixed broken tests

[jurgenvinju]

The tests currently fail if run manually:

rascal>:test
WARNING: ResourcesPlugin was null, can't get workspace; not overriding include files
Test report for lang::cpp::tests::AST
	all 1/1 tests succeeded
WARNING: ResourcesPlugin was null, can't get workspace; not overriding include files
WARNING: ResourcesPlugin was null, can't get workspace; not overriding include files
error: modelConsistencyAddressBook @ |file:///Users/jurgenv/git/clair/src/lang/cpp/tests/M3.rsc|(113,1529,<8,0>,<47,1>)
Test lang::cpp::tests::M3::modelConsistencyAddressBook failed due to
	test threw unexpected exception


Exception:
/Users/jurgenv/git/clair/src/lang/cpp/tests/M3.rsc:15,4: AssertionFailed()
	at modelConsistencyAddressBook(|file:///Users/jurgenv/git/clair/src/lang/cpp/tests/M3.rsc|(113,1529,<8,0>,<47,1>))
	at $(|main:///_dollar_|)

Test report for lang::cpp::tests::M3
	0/1 tests succeeded
	0/1 tests failed
	1/1 tests threw exceptions

bool: false

[jurgenvinju]

The automatic tests from mvn also fail, but without printing the error:

$ mvn test
...
[INFO] --- rascal:0.32.0-RC7:test (it-test) @ clair ---
[INFO] The Rascal runtime was resolved at /Users/jurgenv/.m2/repository/org/rascalmpl/rascal/0.43.0-RC17/rascal-0.43.0-RC17.jar
WARNING: ResourcesPlugin was null, can't get workspace; not overriding include files
WARNING: ResourcesPlugin was null, can't get workspace; not overriding include files
WARNING: ResourcesPlugin was null, can't get workspace; not overriding include files
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------

[github-actions]

Summary

Tests 📝	Passed ✅	Failed ❌	Skipped ⏭️	Other ❓	Flaky 🍂	Duration ⏱️
2	1	1	0	0	0	1ms

Test Results

1 failed
1 passed

Details

2 tests in 2 suites
1.1s
Rascal test runner
Build and Deploy builds #276
latest rascal dep and tests #98

Failed Tests

modelConsistencyAddressBook

Insights

Average Tests per Run	Total Flaky Tests	Total Failed	Slowest Test (p95)
2	0	1	763ms

Fail Rate

Fail Rate	50.00%

Test 📝	Results 📊	Passed ✅	Failed ❌	Fail Rate (%) 📈
modelConsistencyAddressBook	1	0	1	100.00    ↑100.00

builds: Run #276

Tests 📝	Passed ✅	Failed ❌	Skipped ⏭️	Pending ⏳	Other ❓	Flaky 🍂	Duration ⏱️
2	1	1	0	0	0	0	1.1s

❌ Some tests failed!

Name	Failure Message
❌ modelConsistencyAddressBook	Test lang::cpp::tests::M3::modelConsistencyAddressBook failed due to test threw unexpected exception Exception: /home/runner/work/clair/clair/src/lang/cpp/tests/M3.rsc:15,4: AssertionFailed() at modelConsistencyAddressBook(|file:///home/runner/work/clair/clair/src/lang/cpp/tests/M3.rsc|(113,1529,<8,0>,<47,1>)) at $(|main:///dollar|)

Slowest Tests

Test 📝	Results 📊	Duration (avg) ⏱️	Duration (p95) ⏱️
modelConsistencyAddressBook	1	763ms	763ms
declTypeFeature	1	329ms	329ms

Files

1 passed, 1 failed, and 0 skipped in 1.1s across 2 files

File Path	Passed	Failed	Flaky	Skipped	Duration
❌ src/lang/cpp/tests/M3.rsc         ❌ modelConsistencyAddressBook (763ms)		❌ 1			763ms
✅ src/lang/cpp/tests/AST.rsc         ✅ declTypeFeature (329ms)	✅ 1				329ms

Github Test Reporter by CTRF 💚

[jurgenvinju]

rascal>m.declarations<name> - m.containment<to> - top(m.containment)
set[loc]: {|cpp+translationunit:///src/test/phonebook.cpp|}
rascal>top(m.containment)
set[loc]: {|cpp+translationunit:///|}
rascal>m.containment[|cpp+translationunit:///|]
set[loc]: {
  |cpp+function:///strncpy(char.*,const.char.*,int)|,
  |cpp+class:///Phonebook|,
  |cpp+function:///main(int,char.*.*)|,
  |cpp+function:///strcmp(const.char.*,const.char.*)|,
  |cpp+class:///Contact|
}

There seems to be a mysterious new root in the containment hierarchy: |cpp+translationunit:///|, this should be |cpp+translationunit:///src/test/phonebook.cpp|

[jurgenvinju]

This bug is caused by the new behavior of rascal and vallang to canonicalize schemes and authorities to lowercase.

[github-actions]

Summary

Tests 📝	Passed ✅	Failed ❌	Skipped ⏭️	Other ❓	Flaky 🍂	Duration ⏱️
2	2    ↑1	0    ↓1	0	0	0	878ms    ↓237ms

Test Results

2 passed ↑1

Details

2 tests in 2 suites
878ms ↓237ms
Rascal test runner
Build and Deploy builds #278
latest rascal dep and tests #98

Insights

Average Tests per Run	Total Flaky Tests	Total Failed	Slowest Test (p95)
2	0	1	763ms

Fail Rate

Fail Rate	25.00%    ↓25.00

Test 📝	Results 📊	Passed ✅	Failed ❌	Fail Rate (%) 📈
modelConsistencyAddressBook	2	1	1	50.00    ↓50.00

builds: Run #278

Tests 📝	Passed ✅	Failed ❌	Skipped ⏭️	Pending ⏳	Other ❓	Flaky 🍂	Duration ⏱️
2	2	0	0	0	0	0	878ms

🎉 All tests passed!

Slowest Tests

Test 📝	Results 📊	Duration (avg) ⏱️	Duration (p95) ⏱️
modelConsistencyAddressBook	2	658ms	763ms
declTypeFeature	2	323ms	329ms

Files

2 passed, 0 failed, and 0 skipped in 878ms across 2 files

File Path	Passed	Failed	Flaky	Skipped	Duration
✅ src/lang/cpp/tests/M3.rsc         ✅ modelConsistencyAddressBook (553ms)	✅ 1				553ms
✅ src/lang/cpp/tests/AST.rsc         ✅ declTypeFeature (318ms)	✅ 1				318ms

_{± Comparison with run #276 at a2f9ace | ⏱️ Measured over 2 runs.}

Github Test Reporter by CTRF 💚