Quality Outreach Report introduction.

The first Quality Report was published in September 2015 here, our initial intention was to provide a report every six months. We now release

a Feature Release every 6 months so we have decided to publish a Quality Outreach Report every three months.

The previous report was issued in June 2019 here

Section one looks at new additions to the list of FOSS Project participating in the Quality Outreach .
Section two lists Bug logging activities over the past three months (end of June 2019 - September 2019).
Section three lists FOSS Project's experience testing JDK 13 Early Access builds.
Section four lists FOSS Project's experience testing JDK 14 Early Access builds.
Section five lists traffic on quality-discuss@openjdk.java.net

1.0 FOSS Projects listed on Quality Outreach Wiki.

We now have 119 FOSS Projects and their developers listed on the Quality Outreach Wiki page, two projects are no longer active and have been removed.

We have added 1 new FOSS Project since the last report in June 2019. New Project added :

RabbitMQ
- RabbitMQ AMQP Client
- RabbitMQ JMS Client
- RabbitMQ Performance Testing Tool
- RabbitMQ Hop, Java Client for the RabbitMQ HTTP API
- Reactor RabbitMQ

Note, we have a further 14 Projects that we communicate with that are not listed on the wiki i.e 133 projects in total.

All FOSS Projects receive regular updates when Early Access (EA) builds become available, they are encouraged to

test and report back any issues they find during their testing.

2.0 Bugs logged since June 2019

Developers from 5 of the 133 participating projects filed 8 new issues in the JDK Bug System in the last three months, thank you !

Priority	Fixed	Open	Duplicate	Total
P1	0	0	0	0
P2	1	0	0	1
P3	2	0	0	2
P4	3	1	1	5
Total Unique Issues	6	1	1	8

The Table above lists the number of bugs logged in total - 8, of which 1 was P2 bugs, with 2 P3 & 5 P4 bugs etc.

Priority	Open	Duplicate	Not an Issue	Total
core-libs	0	1	2	3
hotspot	1	1	0	2
core-svc	0	0	1	1
infrastructure	0	0	1	1
security-libs	0	0	1	1
Total Unique Issues	1	2	5	8

The Table above lists the number of bugs logged by Component. Bugs have been found from core-libs, hotspot, core-svc, infrastructure and security-libs components.

2.1 FOSS Projects logging significant bugs

The following Projects have submitted bug reports in the last three months and deserve special mention:

Apache Ant
Byte Buddy
Apache Tomcat
Eclipse Jetty
JaCoCo

2.2 Overall Summary of bugs filed by FOSS Projects from the start of the Quality Outreach Program to date.

Priority	Fixed	Open	Duplicate	Not an Issue	Incomplete	Won't Fix	Cannot Reproduce	Other	Total
P1	12	0	0	0	0	0	0	0	12
P2	48	1	8	5	0	0	4	2	68
P3	81	12	23	20	3	6	6	0	151
P4	16	31	9	7	4	4	5	0	76
P5	1	1	0	0	0	0	0	0	2
Total Unique Issues	158	45	40	32	7	10	15	2	309

2.3 FOSS Projects logging bugs against JDK 13 Early Access Builds - from January 2019 to date.

Priority	Fixed	Duplicate	Not an Issue	Total
P1	0	0	0	0
P2	2	0	3	5
P3	1	0	1	2
P4	0	2	0	2
Total Unique Issues	3	2	4	9

The following Projects have submitted significant bug reports against JDK 13 Early Access builds and deserve special mention:

Apache Ant
Apache JMeter
Apache Tomcat
Apache Wicket
Equals Verifier
JOSM

3.0 Testing Early Access builds of JDK 13 - list of FOSS Projects results and their comments

	FOSS Project	Comments
1	Apache Ant	No issues observed on our Linux setups running Ant against this JDK 13 build 13+33.
2	Apache CXF	The builds against latest JDK 13 bits are looking not bad.
3	Apache HttpClient	Apache HttpClient 5.0 and 4.5, all tests passed with JDK 13 OpenJDK Runtime Environment (build 13-ea+26)
4	Apache Lucene	No problems with JDK 13 RC up to now. Several runs completed, we just had the usual random test failures.
5	Apache Maven	As far as I know there are no issues discovered.
6	Apache POI	We are running all tests on JDK 13 b25 successfully, so no issues to report from us for now, JDK 13-ea+31 works fine as well.
7	Apache Tomcat	Latest Tomcat 9.0.x builds and completes unit tests without any issues.
8	Apache Wicket	Everything is green in Wicket tests with latest 13 build!
9	Hibernate	Glad to report that all our projects seem to be able to complete their respective testsuite on OpenJDK 13 build 33: no regressions found so far!
10	JaCoCo	Everything on our side works fine with JDK 13 EA up to latest available as of today build 23.
11	Netty	All works as expected it seems.
12	RabbitMQ	Java libraries test suites passed on 13-ea+30.
13	RxJava	RxJava 3.0.0-RC2 snapshot running on Windows 10 x64. JDK 13 b33 - Compile: OK, Test: OK.
14	Wildfly	WildFly community application server works like a charm on JDK 13 EA 23.

4.0 Testing Early Access builds of JDK 14 - list of FOSS Projects results and their comments

	FOSS Project	Comments
1	Apache Ant	No issues observed on our Linux setups running Ant against this JDK 14 build 14-ea+11-371.
2	Apache Lucene	No problems with JDK 14 EA up to now.
3	Apache Tomcat	Latest Tomcat 9.0.x builds and completes unit tests without any issues.
4	Apache Wicket	Everything is green in Wicket tests with latest 14 build!
5	JaCoCo	Reported JVM crash, which is reproducible on all versions up to 14 EA b6. Issue has been fixed in JDK 14 b8.
6	RabbitMQ	Java libraries test suites passed on 14-ea+6-171.
7	RxJava	Tested JDK 14 b8 - Compile: OK, Tests: OK

5.0 Discussion of the quality-discuss@openjdk.java.net mailing list

Total 4 members participated in various discussions on the mailing list.
Discussion threads
- JDK 13 & JDK 14 EA build Test Results - 11
- JDK 13 & JDK 14 EA availability - 2
- Addition of new FOSS project RabbitMQ - 2
- Notification on JDK 13 Rampdown Phase Two - 1
- Notification on JDK 13 Release Candidate Phase - 1

Quality Outreach report September 2019