Quality Outreach report March 2020

The first Quality Report was published in September 2015 here, our initial intention was to provide a report every six months. We now release

a Feature Release every 6 months so we have decided to publish a Quality Outreach Report every three months.

The previous report was issued in December 2019 here

Section one looks at the number of FOSS Project participating in the Quality Outreach .
Section two lists Bug logging activities over the past three months (end of December 2019 - March 2020).
Section three lists FOSS project activity on JDK 14 Early Access builds.
Section four lists FOSS project activity on JDK 15 Early Access builds.
Section five lists traffic on quality-discuss@openjdk.java.net.

1.0 FOSS Projects listed on Quality Outreach Wiki.

We now have 123 FOSS Projects and their developers listed on the Quality Outreach Wiki page.

There have been no new FOSS Projects added since the last report in December 2019.

Note, we have a further 15 Projects that we communicate with that are not listed on the wiki i.e 138 projects in total.

All FOSS Projects receive regular updates when Early Access (EA) builds become available, they are encouraged to

test and report back any issues they find during their testing.

2.0 Bugs logged since December 2019

Developers from 7 of the 138 participating projects filed 17 new issues in the JDK Bug System in the last three months, thank you !

Priority	Fixed	Open	Duplicate	Not an Issue	Total
P1	1	0	0	0	1
P2	0	1	1	1	3
P3	0	6	0	0	6
P4	2	5	0	0	7
Total Unique Issues	3	12	1	1	17

The Table above lists the number of bugs logged in total - 17, of which 1 was a P1 showstopper bug , 3 were P2 bugs, with 6 P3 bugs & finally 7 P4 bugs etc.

Components	P1	P2	P3	P4	Total
core-libs	0	0	0	2	2
client-libs	0	0	1	3	4
hotspot	1	3	1	0	5
security-libs	0	0	2	0	2
tools	0	0	2	2	4
Total Unique Issues	1	3	6	7	17

The Table above lists the number of bugs logged by Component. The 17 Bugs were found in 5 component areas .

2.1 FOSS Projects logging significant bugs

The following Projects have submitted bug reports in the last three months and deserve special mention:

Apache Ant
Apache Lucene
Apache Tomcat
JaCoCo
JOSM
JUnit5
PDFBox

2.2 Overall Summary of bugs filed by FOSS Projects from the start of the Quality Outreach Program to date.

Priority	Fixed	Open	Duplicate	Not an Issue	Incomplete	Won't Fix	Cannot Reproduce	Other	Total
P1	13	0	0	0	0	0	0	0	13
P2	53	2	10	6	0	0	4	2	77
P3	90	19	25	20	3	7	6	0	170
P4	23	32	10	8	5	5	5	0	88
P5	1	0	1	0	0	0	0	0	2
Total Unique Issues	180	53	46	34	8	12	15	2	350

3.0 FOSS activity on JDK 14 Early Access Builds - bug logged from December 2019 to date

Priority	Fixed	Open	Duplicate	Total
P1	1	0	0	1
P2	0	1	1	2
P3	0	0	0	0
P4	1	1	0	2
Total Unique Issues	2	2	1	5

The following Projects have submitted significant bug reports ,18 bugs in total, during the six months release cycle of JDK 14

Thank you for your contribution to the Quality of the Release!

Apache Ant
Apache CXF
Apache Lucene
Apache Tomcat
Apache Wicket
Eclipse Collections
Hibernate
JaCoCo
RxJava

3.1 Testing Early Access builds of JDK 14 - list of FOSS Projects results and their comments

Regular feedback was received from the following FOSS Projects,much appreciated !

See Mark Reinhold's tweet - If your tests are green on JDK 14 please respond to Mark

	FOSS Project	Comments
1	Apache Ant	No unexpected failures observed with JDK 14 build 14+36-1461 for our Ant testsuite on a Linux setup.
2	Apache Lucene	I switched the Jenkins builds yesterday to enable it. But in fact it was only a rename: “jdk-14-rc” -> “jdk-14”, and first build succeeded.
3	Apache Tomcat	Logged JDK-8233619. No additional issues found testing either version. Build, smoke test and full unit test on Linux all OK.
4	Apache Wicket	I've just tested both Java 14 b36 and Java 15 b9 - both fine for Apache Wicket!
5	Apereo CAS	After the upgrade to Gradle 6.3 which brings forward support for JDK 14, Apereo CAS can successfully build and run against JDK 14.
6	Eclipse Collections	JDK 14 EA builds, updated for Eclipse Collections.
7	GraphHopper	Currently we do not have any problems with JDK 14.
8	JaCoCo	Reported one issue JDK-8237528 which is fixed in JDK 15. Everything else is fine on JDK 14 EA b32.
9	JUnit5	Local tests look good.
10	RxJava	RxJava 3.0.0 with JDK 14b36 Compile: OK, Tests: OK -Target 14 now works via IntelliJ 2020 preview.
11	Spring	Spring Framework 5.2.5 release adds support for the recently released Java 14.

4.0 FOSS activity on JDK 15 Early Access Builds - bugs logged from December 2019 to date

FOSS Projects have started testing JDK 15 Early Access builds and below is the number of bugs found so far.

Priority	Open	Total
P1	0	0
P2	0	0
P3	4	4
P4	1	1
Total Unique Issues	5	5

The following Projects have submitted bug reports against JDK 15 Early Access builds :

Apache Lucene
Apache Tomcat
JOSM
Junit

4.1 Testing Early Access builds of JDK 15 - list of FOSS Projects results and their comments

	FOSS Project	Comments
1	Apache Ant	No unexpected failures observed with JDK 15 build 15-ea+9-264 for our Ant testsuite on a Linux setup.
2	Apache Lucene	JDK15 build 14 was installed, and first build succeeded.
4	Apache Wicket	I've just tested Java 15 b9 - fine for Apache Wicket!
6	JaCoCo	Reported one issue JDK-8237528 which is already fixed in JDK 15. Everything else is fine on JDK 15 EA b6.
7	RxJava	Upgraded to Gradle 6.3-RC2 and rerun tests on CI with all available targets, including Target 15 too - all green for JDK 15 b14.

5.0 Discussion of the quality-discuss@openjdk.java.net mailing list

Total 1 member participated in various discussions on the mailing list.
Discussion threads
- OpenJDK 14 EA build test results - 6
- OpenJDK 15 EA build test results - 8
- OpenJDK 14 EA & OpenJDK 15 EA builds availability - 1
- Release announcement of JDK 14 Rampdown Phase Two - 1
- Release announcement of JDK 14 Release Candidate Phase - 1
- Release Announcement: General Availability of JDK 14 - 1