Quality Outreach Report Introduction
The first Quality Report was published in September 2015. Our initial intention was to provide a report every six months. We now release a Feature Release every 6 months so we have decided to publish a Quality Outreach Report every three months.
The previous report was issued in December 2021, the next report is due in June 2022.
1.0 FOSS Projects participating in the Quality Outreach program
We now have 175 FOSS Projects of which 166 and their developers are listed on the Quality Outreach Wiki page.
All FOSS Projects receive regular updates when Early Access (EA) builds become available, they are encouraged to test and report back any issues they find during their testing.
2.0 Bugs logged since January 2022
Developers from 4 of the 175 participating projects filed 9 new issues in the JDK Bug System in the last three months, thank you !
| Priority | Fixed | Open | Duplicate | Not an Issue | Won't fix | Total |
|---|---|---|---|---|---|---|
| P1 | 0 | 0 | 0 | 0 | 0 | 0 |
| P2 | 0 | 0 | 0 | 0 | 0 | 0 |
| P3 | 0 | 2 | 0 | 0 | 0 | 2 |
| P4 | 6 | 1 | 0 | 0 | 0 | 7 |
| Total Unique Issues | 6 | 3 | 0 | 0 | 0 | 9 |
The table above lists the number of bugs logged in total - 9, of which 2 were P3 and 7 were P4 bugs.
| Component | P1 | P2 | P3 | P4 | Total |
|---|---|---|---|---|---|
| client-libs | 0 | 0 | 1 | 0 | 1 |
| core-libs | 0 | 0 | 0 | 2 | 2 |
| hotspot | 0 | 0 | 1 | 0 | 1 |
| tools | 0 | 0 | 0 | 5 | 5 |
| Total Unique Issues | 0 | 0 | 2 | 7 | 9 |
The table above lists the number of bugs logged by Component. Total 9 Bugs were found in 4 component areas.
2.1 FOSS Projects logging significant bugs
The following Projects have submitted bug reports in the last three months and deserve special mention:
- Apache Ant
- Apache PDFBox
- JaCoCo
- JUnit5
2.2 Overall Summary of bugs filed by FOSS Projects since October 2013
| Priority | Fixed | Open | Duplicate | Not an Issue | Incomplete | Won't fix | Can't Reproduce | Other | Total |
|---|---|---|---|---|---|---|---|---|---|
| P1 | 13 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 13 |
| P2 | 67 | 0 | 10 | 7 | 0 | 0 | 4 | 2 | 90 |
| P3 | 136 | 16 | 28 | 22 | 3 | 7 | 6 | 3 | 222 |
| P4 | 61 | 46 | 15 | 14 | 4 | 7 | 5 | 5 | 157 |
| P5 | 3 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 4 |
| Total Issues | 280 | 62 | 54 | 43 | 7 | 14 | 15 | 10 | 486 |
3.0 FOSS activity on JDK 18 Early Access Builds - Bugs logged from January 2022 to General Availability
| Priority | Fixed | Open | Duplicate | Not an Issue | Total |
|---|---|---|---|---|---|
| P1 | 0 | 0 | 0 | 0 | 0 |
| P2 | 0 | 0 | 0 | 0 | 0 |
| P3 | 0 | 0 | 0 | 0 | 0 |
| P4 | 0 | 1 | 0 | 0 | 1 |
| Total Unique Issues | 0 | 1 | 0 | 0 | 1 |
3.1 Testing Early Access builds of JDK 18 - list of FOSS Projects and their feedback
| Project | Comments | |
|---|---|---|
1 | Apache Ant | Ant passes with 18-ea+34-2083. |
| 2 | Apache Derby | Derby builds on 18-ea+33-2077. |
| 3 | Apache Johnzon | Passes on JDK EA 18 b23. |
| 4 | Apache Lucene | Will update the JDK 18 candidate soon. Up to now we have not found serious issues. |
| 5 | Apache MyBatis | Pass on JDK 18 GA. |
| 6 | Apache PDFBox | PDFBox reported JDK-8277574. |
| 7 | Apache Tomcat | Builds and tests on JDK 18+36-2087 / Linux x86_64 and aarch64! |
| 8 | Apache Wicket | Builds and tests on JDK 18+36-2087 / Linux x86_64 and aarch64! |
| 9 | Apache Zookeeper | Tests pass on 18+36-2087. |
| 10 | BNYM Code Katas | No issue to report on 18+36-2087. |
| 11 | Burningwave | For Burningwave Core all tests are green with build 20. |
| 12 | Byte Buddy | Reported JDK-8277510, fixed in 18EA b26. |
| 13 | Debezium | CI jobs verifying that all looks good on JDK 18. |
| 14 | Eclipse Collections | Eclipse Collections now build with JDK 18 EA. |
| 15 | Elasticsearch | Elasticsearch passes on JDK 18 EA build 27. |
| 16 | FXGL | FXGL passes on JDK 18 EA build 27. |
| 17 | Hibernate ORM | Version 5.6 & Version 6.0 tested against JDK 18 GA (RC!), OK! |
| 18 | Hibernate Validator | Versions 7.0 & Versions 8.0 tested against JDK 18 GA (RC!), OK! |
| 19 | Hibernate Search | Version 6.1 & Version 6.2 tested against JDK 18 GA (RC!), OK! |
| 20 | Hibernate Reactive | Version 1.1 tested against JDK 18 GA (RC!), OK! |
| 21 | JUnit | JUnit 5.9-SNAPSHOT builds fine on JDK 18 EA b25. |
| 22 | Karate | Green for all versions, including JDK 18 EA. |
| 23 | Micrometer | Pass on 18 EA b26. |
| 24 | Renaissance | Renaissance passes with 18-ea. |
| 25 | RxJava | RxJava 3.1.3: JDK 18-b36, OK! |
| 26 | Vaadin | We have been actively testing with the newly released JDKs, now JDK 18 EA 15 is good to go with the Vaadin products. |
| 27 | Yupiik Batch | Yupiik Batch (baseline on 17) passes on JDK 18 EA. |
| 28 | Yupiik uShip | Yupiik uShip (baseline on 11) passes on JDK 18 EA. |
4.0 FOSS activity on JDK 19 Early Access Builds - bugs logged from January 2022 to till date
| Priority | Fixed | Open | Duplicate | Not an Issue | Total |
|---|---|---|---|---|---|
| P1 | 0 | 0 | 0 | 0 | 0 |
| P2 | 0 | 0 | 0 | 0 | 0 |
| P3 | 0 | 1 | 0 | 0 | 1 |
| P4 | 3 | 0 | 0 | 0 | 3 |
| Total Unique Issues | 3 | 1 | 0 | 0 | 4 |
The following Projects have submitted bug reports against JDK 19 Early Access builds :
- Apache Ant
- JaCoCo
- JUnit
4.1 Testing Early Access builds of JDK 19 - list of FOSS Projects and their feedback
| Project | Comments | |
|---|---|---|
| 1 | Apache Ant | Ant passes with Java 19 build 19-ea+8-441. |
2 | Apache Derby | Derby builds and tests cleanly against build 19-ea+11-661. |
| 3 | Apache Johnzon | No issue to report on 19-ea+15-942. |
| 4 | Apache Tomcat | Build and tests pass successfully with JDK 19-ea+18-1211 on both Linux x86_64 and aarch64! |
| 5 | Apache Wicket | Build and tests pass successfully with JDK 19-ea+18-1211 on both Linux x86_64 and aarch64! |
| 6 | Apache Zookeeper | Tests pass on 19-ea+11-661. |
| 7 | BNYM Code Katas | No issue to report on 19-ea+15-942. |
| 8 | Hibernate ORM | Version 6.0 tested against JDK 19 EA15. |
| 9 | Hibernate Validator | Versions 7.0 and 8.0 tested against JDK 19 EA15. |
| 10 | Hibernate Search | Version 6.2 tested against JDK 19 EA15. |
| 11 | Hibernate Reactive | Version 1.1 tested against JDK 19 EA15. |
| 12 | Renaissance | Renaissance passes with 19-ea. |
| 13 | RxJava | RxJava 3.1.3: JDK 19-b11, lot of false failure due to Gradle. |
5.0 Java 18 is now available!
See The Arrival of Java 18 post.