Quality Outreach Report introduction

The first Quality Report was published in September 2015 here, our initial intention was to provide a report every six months. We now release

a Feature Release every 6 months so we have decided to publish a Quality Outreach Report every three months.

The previous report was issued in December 2020 here

1.0 FOSS Projects listed on Quality Outreach Wiki

We now have 145 FOSS Projects and their developers listed on the Quality Outreach Wiki page.

There have been 3 new FOSS Projects added since the last report in December 2020. Welcome!

New Projects added :

Note, we have a further 8 Projects that we communicate with that are not listed on the wiki i.e 153 projects in total.

All FOSS Projects receive regular updates when Early Access (EA) builds become available, they are encouraged to

test and report back any issues they find during their testing.

2.0 Bugs logged since December 2020

Developers from 8 of the 153 participating projects filed 14 new issues in the JDK Bug System in the last three months, thank you !


PriorityFixedOpenDuplicateNot an IssueTotal
P100000
P210001
P333006
P405117
Total Unique Issues481114

The table above lists the number of bugs logged in total - 14, of which 1 was P2, 6 were P3 bugs and 7 were P4 bugs.


ComponentP1P2P3P4Total
core-libs
013610
tools00314
Total Unique Issues016714

The table above lists the number of bugs logged by Component. Total 14 Bugs were found in 2 component areas.

2.1 FOSS Projects logging significant bugs

The following Projects have submitted bug reports in the last three months and deserve special mention:

2.2 Overall Summary of bugs filed by FOSS Projects since October 2013


PriorityFixedOpenDuplicateNot an IssueIncompleteWon't fixCan't ReproduceOtherTotal
P113000000013
P2620106004284
P31201427224762204
P4324213114650113
P5201000003
Total Issues229565139813154415


3.0  FOSS activity on JDK 16 Early Access Builds - bugs logged since December 2020 to now


PriorityFixedOpenDuplicateNot an IssueTotal
P100000
P210001
P332005
P402002
Total Unique Issues44008


The following Projects have submitted bug reports against JDK 16 Early Access builds :

Commendable contributions (3 bug fixes & 6 reports) from Christian Stein of Junit5 for JDK 16. Well done!

3.1   Testing Early Access builds of JDK 16 - list of FOSS Projects results and their comments



FOSS ProjectJDK 16 EA+GA    Comments

1

Apache Ant(tick)Ran our Ant project testsuite on a Linux setup against JDK 16 build 16+36-2231. No issues found.
2Apache Commons(tick)I migrated most of the Apache Commons build on github from 16-EA to 16. I don't expect any issues, I hope.
3Apache Derby(tick)For the record, the Derby build/test cycle found no problems with the GA JDK 16.
4

Apache Lucene

(tick)Logged 4 bugs including 1 enhancement on b30, 3 bugs were fixed already.
5Apache Maven(tick)Reported an issue - we fixed our integration tests for Maven components with Groovy and few old plugin updates.
6

Apache Syncope

(tick)I am glad to say we did restore the JDK 16 b29 build with a dedicated Maven profile.
7Apache Tomcat(tick)

Build and tests pass successfully with JDK 16 16+36-2231 on both Linux x86_64 and aarch64!

8Apache Wicket(tick)

Build and tests are green with JDK 16 build 16+36-2231 on both Linux x86_64 and aarch64!

9Apache ZooKeeper(tick)ZooKeeper tests are passing on the latest JDK16-ea build b35.
10

Eclipse Collections

(tick)

All our tests are passing and pipelines are green!

11

eo-yaml

(tick)I can confirm from Travis CI that the build works fine on the latest OpenJDK 16.
12FXGL(tick)

Tests are also green on JDK 16 b21.

13

FXyz

(tick)

Works fine with latest 16-ea build b24.

14GraphHopper(tick)It seems to be fine for us.
15Hibernate ORM(tick)Version 5.4 tested against JDK 16 GA. No problem to report.
16Hibernate Validator(tick)Versions 6.1, 6.2, 7.0 tested against JDK 16 GA. No problem to report.
17Hibernate Search(tick)Version 5.11, 6.0 tested against JDK 16 GA. No problem to report.
18Hibernate Reactive(tick)Version 1.0 tested against JDK 16. No problem to report.
19JaCoCo(tick)Our tests are still green on latest OpenJDK 16 Early Access build.
20Jenkins(tick)We have completed smoke testing of Jenkins wi9th Java 16.
21JobRunr(tick)

JobRunr is still running smoothly on JDK16

22jOOQ(tick)

Tried with JDK 16(b21) as well now. I haven't discovered any issues

23JUnit5(tick)No issues detected by me this time. Using JDK 16 "RC1" (build 35) since its day zero.
24Kotlin(tick)Kotlin 1.5.0+ will work under JDK 16+ in Gradle, in the IntelliJ's build system, and if run manually via CLI. The problem remains for Kotlin+Maven though
25

Micrometer

(tick)

Micrometer 1.5.x build with 16 EA b17 and did not have any problems.

26MyBatis(tick)

All MyBatis tests are passing on CI with JDK 16 GA build.

27PDFsam(tick)

All tests are green in PDFsam with this version (b28).

28RxJava(tick)

Target 15: Compile - OK, Tests - OK Target 16: not supported by Gradle yet.

29Sejda(tick)

All green on Sejda with b28.

30Vaadin(tick)Works perfectly with JDK 16 GA.

3.2 Feedback from FOSS projects on Twitter


FOSS ProjectJDK 16 GA    Tweets
1Apache Maven(tick)Maven plugins and libraries are all green. #allTestsGreenOnJDK16
2Apache Tomcat(tick)#AllTestsGreenOnJDK16
3Apache Wicket(tick)#AllTestsGreenOnJDK16
4ApprovalTests(tick)#AllTestsGreenOnJDK16 for ApprovalTests.
5AsciidoctorJ(tick)AsciidoctorJ 2.4.3 has #AllTestsGreenOnJDK16
6AssertJ
(tick)AssertJ 3.19.0 #AllTestsGreenOnJDK16.
7Byte Buddy(tick)#AllTestsGreenOnJDK16 Byte Buddy 1.10.22.
8

Eclipse Collections

(tick)

Eclipse Collections v10.4.0 has #AllTestsGreenOnJDK16.

9EqualsVerifier(tick)EqualsVerifier 3.5.5 has #AllTestsGreenOnJDK16.
10FXGL(tick)

FXGL 11.14 #AllTestsGreenOnJDK16.

11Gradle(tick)Gradle 7.0-rc-1 has #AllTestsGreenOnJDK16.
12Hibernate ORM(tick)Hibernate ORM v. 5.4.30.Final #AllTestsGreenOnJDK16.
13JaCoCo(tick)

JaCoCo 0.8.6 #AllTestsGreenOnJDK16.

14Java Katas(tick)

Happy to note that the Java Katas are green with Java 16.

15JFreeSVG
(tick)JFreeSVG 4.2 #AllTestsGreenOnJDK16.
16JHipster(tick)jhipster is #AllTestsGreenOnJDK16!
17jOOQ(tick)

jOOQ 3.15 will officially support JDK 16. #AllTestsGreenOnJDK16

18JUnit5(tick)JUnit 5 #AllTestsGreenOnJDK16 and also #JDK17
19Spring Boot(tick)Spring Boot is ready for Java 16. #AllTestsGreenOnJDK16

4.0  FOSS activity on JDK 17 Early Access Builds - bugs logged since December 2020 to now


PriorityFixedOpenDuplicateNot an IssueTotal
P100000
P200000
P311002
P402013
Total Unique Issues13015


The following Projects have submitted bug reports against JDK 17 Early Access builds:

4.1   Testing Early Access builds of JDK 17 - list of  FOSS Projects results and their comments



FOSS ProjectJDK 17 EA    Comments

1

Apache Ant(tick)Ran our Ant project testsuite on a Linux setup against JDK 17 build 17-ea+13-1000. No issues found.
2Apache Commons(tick)Logged one regression (JDK-8262108) against JDK 17 b5.
3Apache Tomcat(tick)Build and tests pass successfully with JDK 17-ea+13-1000 on both Linux x86_64 and aarch64!
4Apache Wicket(tick)Build and tests are green with JDK 17-ea+13-1000 on both Linux x86_64 and aarch64!
5Hibernate ORM(tick)Version 5.4 tested against JDK 17 EA13. No problem to report.
6Hibernate Validator(tick)Versions 6.1, 6.2, 7.0 tested against JDK 17 EA13. No problem to report.
7Hibernate Search(tick)Version 6.0 tested against JDK 17 EA13. No problem to report.
8Hibernate Reactive(tick)Version 1.0 tested against JDK 17 EA13. No problem to report.
9JaCoCo(tick)Our tests are still green on latest OpenJDK 17 Early Access build.
10Java Katas(tick)Java Katas are green with JDK 17ea.
11JUnit5(tick)JUnit5 is green for JDK17.
12RxJava(tick) JDK 17b8 - Target 15: Compile - OK, Tests - OK, Target 16: not supported by Gradle yet, Target 17: not supported by Gradle yet.

5.0 Discussion of the quality-discuss@openjdk.java.net mailing list

6.0 Java 16 is now available!

The next Quality Outreach report is due in June 2021