Quality Outreach Report introduction.
The first Quality Report was published in September 2015 here. We now release a Feature Release every 6 months so we have decided
to publish a Quality Outreach Report every three months.
The previous report was issued in September 2019 here
- Section one looks at new additions to the list of FOSS Project participating in the Quality Outreach .
- Section two lists Bug logging activities over the past three months (end of September 2019 - December 2019).
- Section three lists FOSS Project's experience testing JDK 14 Early Access builds.
- Section four lists traffic on quality-discuss@openjdk.java.net
1.0 FOSS Projects listed on Quality Outreach Wiki.
There are 123 FOSS Projects listed on the Quality Outreach Wiki page.
We have added 4 new FOSS Projects since the last report in September 2019. Welcome!
New Projects added :
- Apache Syncope
- Apereo CAS
- Micronaut
- Angel-ML
Note, we have a further 15 Projects that we communicate with that are not listed on the wiki i.e 138 projects in total.
All FOSS Projects receive regular updates when Early Access (EA) builds become available, they are encouraged to
test and report back any issues they find during their testing.
2.0 Bugs logged since September 2019
Developers from 7 of the 138 participating projects filed 20 new issues in the JDK Bug System in the last three months, thank you !
| Priority | Fixed | Open | Duplicate | Not an Issue | Open |
|---|---|---|---|---|---|
| P1 | 0 | 0 | 0 | 0 | 0 |
| P2 | 1 | 2 | 1 | 0 | 4 |
| P3 | 3 | 3 | 2 | 0 | 8 |
| P4 | 2 | 5 | 1 | 0 | 8 |
| Total Unique Issues | 6 | 10 | 4 | 0 | 20 |
The Table above lists the number of bugs logged in total - 20, of which 4 were P2 bugs, with 8 P3 bugs & 8 P4 bugs etc.
| Component | P1 | P2 | P3 | p4 | Total |
|---|---|---|---|---|---|
| core-libs | 0 | 1 | 2 | 5 | 8 |
| core-svc | 0 | 0 | 1 | 0 | 1 |
| hotspot | 0 | 2 | 3 | 0 | 5 |
| security-libs | 0 | 0 | 1 | 1 | 2 |
| tools | 0 | 1 | 1 | 2 | 4 |
| Total Unique Issues | 0 | 4 | 8 | 8 | 20 |
The Table above lists the number of bugs logged by Component. Bugs have been found from core-libs, core-svc, hotspot, security-libs and tools components.
2.1 FOSS Projects logging significant bugs
The following Projects have submitted bug reports in the last three months and deserve special mention:
- Apache Ant
- Apace Tomcat
- JUnit5
- JaCoCo
- Eclipse Jetty
- Apache Maven
- Apache Lucene
2.2 Overall Summary of bugs filed by FOSS Projects from the start of the Quality Outreach Program to date.
| Priority | Fixed | Open | Duplicate | Not and Issue | Incomplete | Won't Fix | Cannot Reproduce | Other | Total |
|---|---|---|---|---|---|---|---|---|---|
| P1 | 12 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 12 |
| P2 | 50 | 3 | 9 | 5 | 0 | 0 | 4 | 2 | 73 |
| P3 | 85 | 15 | 25 | 20 | 3 | 7 | 6 | 0 | 161 |
| P4 | 19 | 35 | 10 | 7 | 4 | 4 | 5 | 0 | 84 |
| P5 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 2 |
| Total Unique Issues | 167 | 54 | 44 | 32 | 7 | 11 | 15 | 2 | 332 |
2.3 FOSS Projects logging bugs against JDK 14 Early Access Builds - from September 2019 to date
| Priority | Fixed | Open | Duplicate | Not an Issue | Total |
|---|---|---|---|---|---|
| P1 | 0 | 0 | 0 | 0 | 0 |
| P2 | 2 | 2 | 1 | 0 | 5 |
| P3 | 2 | 2 | 1 | 0 | 5 |
| P4 | 2 | 1 | 0 | 0 | 3 |
| Total Unique Issues | 6 | 5 | 2 | 0 | 13 |
The following Projects have submitted significant bug reports against JDK 14 Early Access builds and deserve special mention:
- Apache Ant
- Apache Lucene
- Apache Tomcat
- JaCoCo
- jOOQ
- JUnit5
A special mention for Apache Ant contact Jaikiran Pai
Three bugs were logged by our Apache Ant contact Jaikiran Pai. Not only did he log three bugs, he provided fixes for two of the Bugs!
Many thanks Jaikiran.
3.0 Testing Early Access builds of JDK 14 - list of FOSS Projects results and their comments
| FOSS Project | JDK 14 EA | Comments | |
|---|---|---|---|
1 | Apache Ant |
| Our tests on a Linux system against this version (JDK 14 build 14-ea+27-1339) have passed without any unexpected failures |
| 2 | Apache Lucene |  | Reported issues with JDK 14 b27 - duplicate of JDK-8235870 |
| 3 | Apache Tomcat | | No other test failures were observed when building an running the full test suite with EA27. |
| 4 | Apache Wicket | | All is good in Wicket with the new build(JDK 14 b27)! |
| 5 | Eclipse Collections | | Builds(JDK 14 b22) Updated for Eclipse Collections. |
| 6 | JaCoCo | | Reported one issue on JDK 14 b28 - arm32 build issue |
| 7 | RxJava | | RxJava 3.0.0-RC7 snapshot and JDK 14b27 - Windows 10 x64, Target 13: Compile OK, Tests: OK. |
| 8 | jUnit5 | | jUnit5 - Local tests look good |
4.0 Discussion of the quality-discuss@openjdk.java.net mailing list
- Total 1 member participated in various discussions on the mailing list.
- Discussion threads
- Release Announcement: General Availability of Java 13 / JDK 13 - 1
- JDK 14 Early Access build availability - 4
JDK 14 Early Access build test results availability - 9
The next Quality Outreach report is due in March 2020
Overview
Content Tools
ThemeBuilder