Quality Outreach Report introduction
The first Quality Report was published in September 2015 here, our initial intention was to provide a report every six months. We now release
a Feature Release every 6 months so we have decided to publish a Quality Outreach Report every three months.
The previous report was issued in September 2020 here
- Section one looks at the number of FOSS Project participating in the Quality Outreach .
- Section two lists Bug logging activities over the past three months (end of September 2020 - December 2020).
- Section three lists FOSS project activity on JDK 16 Early Access builds.
- Section four gives a summary of the Outreach Feedback Survey.
- Section five lists traffic on quality-discuss@openjdk.java.net.
1.0 FOSS Projects listed on Quality Outreach Wiki
We now have 139 FOSS Projects and their developers listed on the Quality Outreach Wiki page.
There have been 6 new FOSS Projects added since the last report in September 2020. Welcome!
New Projects added :
- Hibernate Reactive
- Hibernate Search
- Hibernate Validator
- JaColine
- JFreePDF
- VMOptionsExplorer
Note, we have a further 15 Projects that we communicate with that are not listed on the wiki i.e 154 projects in total.
All FOSS Projects receive regular updates when Early Access (EA) builds become available, they are encouraged to
test and report back any issues they find during their testing.
2.0 Bugs logged since September 2020
Developers from 10 of the 154 participating projects filed 15 new issues in the JDK Bug System in the last three months, thank you !
Priority | Fixed | Open | Duplicate | Not an Issue | Total |
---|---|---|---|---|---|
P1 | 0 | 0 | 0 | 0 | 0 |
P2 | 0 | 2 | 0 | 0 | 2 |
P3 | 2 | 2 | 0 | 1 | 5 |
P4 | 2 | 5 | 0 | 1 | 8 |
Total Unique Issues | 4 | 9 | 0 | 2 | 15 |
The table above lists the number of bugs logged in total - 15, of which 2 were P2, 5 were P3 bugs and 8 were P4 bugs.
Component | P1 | P2 | P3 | P4 | Total |
---|---|---|---|---|---|
core-libs | 0 | 1 | 1 | 4 | 6 |
core-svc | 0 | 0 | 0 | 1 | 1 |
hotspot | 0 | 0 | 1 | 1 | 2 |
tools | 0 | 1 | 3 | 2 | 6 |
Total Unique Issues | 0 | 2 | 5 | 8 | 15 |
The table above lists the number of bugs logged by Component. The 15 Bugs were found in 4 component areas.
2.1 FOSS Projects logging significant bugs
The following Projects have submitted bug reports in the last three months and deserve special mention:
- Apache Ant
- Apache Lucene
- Apache Tomcat
- Apache Zookeeper
- Byte Buddy
- Graph Hopper
- JaCoCo
- JOSM
- JUnit5
- JDK-8253761 - Bug logged & fix provided by Christian
- JDK-8255576 - Bug logged & fix provided by Christian
- RxJava
2.2 Overall Summary of bugs filed by FOSS Projects since October 2013
Priority | Fixed | Open | Duplicate | Not an Issue | Incomplete | Won't fix | Can't Reproduce | Other | Total |
---|---|---|---|---|---|---|---|---|---|
P1 | 13 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 13 |
P2 | 58 | 2 | 10 | 6 | 0 | 0 | 4 | 2 | 82 |
P3 | 107 | 16 | 27 | 22 | 3 | 7 | 6 | 0 | 188 |
P4 | 31 | 38 | 12 | 10 | 4 | 6 | 5 | 0 | 106 |
P5 | 2 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 3 |
Total Unique Issues | 211 | 56 | 50 | 38 | 7 | 13 | 15 | 2 | 392 |
3.0 FOSS activity on JDK 16 Early Access Builds - bugs logged since September 2020
Priority | Fixed | Open | Duplicate | Not an Issue | Total |
---|---|---|---|---|---|
P1 | 0 | 0 | 0 | 0 | 0 |
P2 | 0 | 2 | 0 | 0 | 2 |
P3 | 2 | 2 | 0 | 1 | 5 |
P4 | 2 | 2 | 0 | 0 | 4 |
Total Unique Issues | 4 | 6 | 0 | 1 | 11 |
The following Projects have submitted bug reports against JDK 16 Early Access builds :
- Apache Ant
- Apache Tomcat
- Apache Zookeeper
- Byte Buddy
- Graph Hopper
- JaCoCo
- JOSM
- JUnit5
- RxJava
3.1 Testing Early Access builds of JDK 16 - list of FOSS Projects results and their comments
FOSS Project | JDK 16 EA | Comments | |
---|---|---|---|
1 | Apache Ant | Logged a regression issue with build 28 - JDK-8258246 | |
2 | Apache Derby | Derby builds and tests cleanly against JDK 16 build 28. | |
3 | Apache Lucene | Confirm that the bug(JDK-8252739) is fixed in JDK 16 build 18. | |
4 | Apache Synscope | Reported issues due to newly introduced JEP 396 from their dependencies. | |
5 | Apache Tomcat | Apache Tomcat's build and tests pass with JDK 16 b28 on both x86_64 and aarch64, Ubuntu 20.04! | |
6 | Apache Wicket | Apache Wicket build and tests are OK with JDK 16 b28 for both aarch64 and x86_64 (Ubuntu 20.10)! | |
7 | Apache Zookeeper | Not able to run ZooKeeper tests due to an open issue(byte-buddy/issues/983) with ByteBuddy. | |
8 | Eclipse Collections | Updated Eclipse Collections to use latest build JDK 16 EA b21. | |
9 | Eo-yaml | eo-yaml builds successfully with OpenJDK 16 EA b6. | |
10 | FXGL | FXGL tests are also green on JDK 16. | |
11 | FXyz | FXyz works fine with latest 16-ea+24. | |
12 | GraphHopper | Logged regression on JDK 16 b25 - JDK-8256837 | |
13 | Hibernate ORM | Tested with version 5.5.0-SNAPSHOT. Everything works fine with JDK 16 EA build 28. | |
14 | Hibernate Validator | Tested with versions 6.1, 6.2 and 7.0. Everything works fine with JDK 16 EA build 28. | |
15 | Hibernate Search | Tested with versions 5.11 and 6.0. Everything works fine with JDK 16 EA build 28. | |
16 | Hibernate Reactive | Tested with version 1.0. Everything works fine with JDK 16 EA build 28. | |
17 | JaCoCo | JaCoCo tests are green on JDK 16 and we already started testing JDK 17. | |
18 | Java Katas | Happy to report build passed for JDK 16 build 26. I specifically was looking for the datetime kata to pass. | |
19 | JobRunr | JobRunr works with records out-of-the-box. | |
20 | jOOQ | Tried with JDK 16(b21) as well now. I haven't discovered any issues. | |
21 | JOSM | Logged bug on JDK 16 EA build and same got fixed in b25. | |
22 | JUnit5 | Logged and fixed bugs in JDK 16 EA. | |
23 | Micrometer | Tested the Micrometer 1.5.x build with 16 EA build 17 and did not have any problems. | |
24 | PDFsam | All tests are green in PDFsam with this version - JDK 16 b28. | |
25 | RxJava | RxJava 3.0.9 snapshot fails on JDK 16 b28 due to the type extraction bug from last time:byte-buddy/issues/983 | |
26 | Sejda | All green on Sejda. |
4.0 Outreach Feedback Survey
We received feedback from 65 FOSS Projects - Thank you for taking the time to respond!
- Does your project support JDK 15 - Yes (51) , No - but have plans to (4) , No Plans (10)
- Have you tested JDK 16 EA builds - Yes (41) , No - but have plans to (14) , No Plans (10)
- Do you find availability emails useful - Yes (63) , No - 1
Any libraries/tools that should be added to the Quality Outreach program: We received pointers to 7 FOSS Projects that we are not currently engaged with.
Please provide any feedback on the Quality Outreach program:
- Add more content to the emails - blogs etc.
- Allow project to update the external Quality page
- Add a CI
Again , thank you for responding and providing excellent feedback.
5.0 Discussion of the quality-discuss@openjdk.java.net mailing list
- Total 1 member participated in various discussions on the mailing list.
- Discussion threads
- OpenJDK 17 EA build test results - 1
- OpenJDK 16 EA build test results - 10
- OpenJDK 16 EA builds availability - 4
- Announcement of JDK 16 Rampdown Phase One - 1