Quality Outreach Report introduction
The first Quality Report was published in September 2015 here, our initial intention was to provide a report every six months.
We now release a Feature Release every 6 months so we have decided to publish a Quality Outreach Report every three months.
The previous report was issued in September 2021 here
- Section one looks at the number of FOSS Project participating in the Quality Outreach.
- Section two lists the bug logging activities over the past three months (October 2021 - December 2021).
- Section three lists the FOSS project activities on JDK 18 Early Access builds.
1.0 FOSS Projects listed on Quality Outreach Wiki
We now have 175 FOSS Projects of which 166 and their developers are listed on the Quality Outreach Wiki page.
There have been 6 new FOSS Projects added since the last report in September 2021. Welcome All!
New Projects added :
- BNY Mellon Code Katas
- BNY Mellon Spring Training
- Eclipse Jifa
Renaissance Suite
- Yupiik Batch
- Yupiik uShip
All FOSS Projects receive regular updates when Early Access (EA) builds become available, they are encouraged to test and report back any issues they find during their testing.
2.0 Bugs logged since October 2021
Developers from 9 of the 175 participating projects filed 10 new issues in the JDK Bug System in the last three months, thank you !
Priority | Fixed | Open | Duplicate | Not an Issue | Won't fix | Total |
|---|---|---|---|---|---|---|
| P1 | 0 | 0 | 0 | 0 | 0 | 0 |
| P2 | 1 | 0 | 0 | 0 | 0 | 1 |
| P3 | 1 | 2 | 0 | 0 | 0 | 3 |
| P4 | 4 | 1 | 1 | 0 | 0 | 6 |
| Total Unique Issues | 6 | 3 | 1 | 0 | 0 | 10 |
The table above lists the number of bugs logged in total - 10, of which 1 was P2, 3 were P3 and 6 were P4 bugs.
Component | P1 | P2 | P3 | P4 | Total |
|---|---|---|---|---|---|
| client-libs | 0 | 0 | 2 | 0 | 2 |
| core-libs | 0 | 1 | 0 | 4 | 5 |
| hotspot | 0 | 0 | 1 | 0 | 1 |
| tools | 0 | 0 | 0 | 2 | 2 |
| Total Unique Issues | 0 | 1 | 3 | 6 | 10 |
The table above lists the number of bugs logged by Component. Total 10 Bugs were found in 4 component areas.
2.1 FOSS Projects logging significant bugs
The following Projects have submitted bug reports in the last three months and deserve special mention:
- Apache Ant
- Apache PDFBox
- Apache POI
- Byte Buddy
- Hibernate
- JOOQ
- PDFBox
2.2 Overall Summary of bugs filed by FOSS Projects since October 2013
Priority | Fixed | Open | Duplicate | Not an Issue | Incomplete | Won't fix | Can't Reproduce | Other | Total |
|---|---|---|---|---|---|---|---|---|---|
| P1 | 13 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 13 |
| P2 | 67 | 0 | 10 | 7 | 0 | 0 | 4 | 2 | 90 |
| P3 | 134 | 17 | 28 | 22 | 3 | 7 | 6 | 3 | 220 |
| P4 | 52 | 46 | 15 | 13 | 4 | 7 | 5 | 5 | 147 |
| P5 | 3 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 4 |
| Total Issues | 269 | 63 | 54 | 42 | 7 | 14 | 15 | 10 | 474 |
3.0 FOSS activity on JDK 18 Early Access Builds - bugs logged since October 2021 to now
Priority | Fixed | Open | Duplicate | Not an Issue | Total |
|---|---|---|---|---|---|
| P1 | 0 | 0 | 0 | 0 | 0 |
| P2 | 1 | 0 | 0 | 0 | 1 |
| P3 | 0 | 1 | 0 | 0 | 1 |
| P4 | 4 | 0 | 1 | 0 | 5 |
| Total Unique Issues | 5 | 1 | 1 | 0 | 7 |
The following Projects have submitted bug reports against JDK 18 Early Access builds :
- Apache Ant
- Apache PDFBox
- Byte Buddy
- Hibernate
3.1 Testing Early Access builds of JDK 18 - List of FOSS Projects results and their comments
FOSS Project | JDK 18 | Comments | |
|---|---|---|---|
FOSS Project | JDK 18 | Comments | |
1 | Apache Ant | b20 | Ant currently fails due to JEP 411, should be tackled in the coming weeks. |
| 2 | Apache Derby | b23 | Apache Derby now passes on JDK 18 EA b23 |
| 3 | Apache Johnzon | b23 | Passes on JDK EA 18 b23 |
| 4 | Apache MyBatis | b23 | Apache MyBatis passes (Linux x86_64 and aarch64) |
| 5 | Apache PDFBox | b23 | Apache PDFBox reported JDK-8277574. |
| 6 | Apache Tomcat | b27 | Build and tests pass successfully with JDK 18 EA b27 (Linux x86_64 and aarch64) |
| 7 | Apache Wicket | b27 | Build and tests pass successfully with JDK 18 EA b27 (Linux x86_64 and aarch64) |
| 8 | Apache Zookeeper | b6 | Zookeeper passes with JDK 18 EA |
| 9 | BNYM Code Katas | b23 | BNYM Code Katas passes |
| 10 | Burningwave | b20 | For Burningwave Core all tests are green. |
| 11 | Byte Buddy | b23 | Byte Buddy reported JDK-8277510, fixed in 18EA b26. |
| 12 | Debezium | b20 | CI jobs verifying that all looks good on JDK 18 EA |
| 13 | Eclipse Collections | b14 | Eclipse Collections now build with JDK 18 EA |
| 14 | Elasticsearch | b27 | Elasticsearch passes on JDK 18 EA |
| 14 | FXGL | b27 | FXGL passes |
| 15 | Hibernate ORM | b27 | Version 5.6 tested against JDK 18 EA27: confirm JDK-8277451 fix, no problems to report! |
| 16 | Hibernate Validator | b27 | Version 7.0 passes on JDK 18 EA |
| 17 | Hibernate Search | b27 | Version 6.1 passes on JDK 18 EA |
| 18 | Hibernate Reactive | b27 | Version 1.1 passes on JDK 18 EA |
| 19 | JUnit | b25 | JUnit 5.9-SNAPSHOT builds fine on JDK 18 EA b25 |
| 20 | Karate | b14 | Green for all versions, including JDK 18 EA |
| 21 | Micrometer | b26 | Pass on 18 EA b26 |
| 22 | RxJava | b27 | RxJava 3.1.3 fails on 18 b27. Probably a Graddle issue, will test again once issue is solved on Graddle side. |
| 23 | Vaadin | b15 | We have been actively testing with the newly released JDKs, now JDK 18 EA 15 is good to go with the Vaadin products. |
| 24 | Yupiik Batch | b23 | Yupiik Batch (baseline on 17) passes on JDK 18 EA |
| 25 | Yupiik uShip | b23 | Yupiik uShip (baseline on 11) passes on JDK 18 EA |
The next Quality Outreach report is due in March 2022
Overview
Content Tools
ThemeBuilder