Quality Outreach report March 2020

The first Quality Report was published in September 2015 here, our initial intention was to provide a report every six months. We now release

a Feature Release every 6 months so we have decided to publish a Quality Outreach Report every three months.

The previous report was issued in December 2019 here

• Section one looks at the number of FOSS Project participating in the Quality Outreach .
• Section two lists Bug logging activities over the past three months (end of December 2019 - March 2020).
• Section three lists FOSS project activity on JDK 14 Early Access builds.
• Section four lists FOSS project activity on JDK 15 Early Access builds.
• Section five lists traffic on quality-discuss@openjdk.java.net.

1.0 FOSS Projects listed on Quality Outreach Wiki.

We now have 123 FOSS Projects and their developers listed on the Quality Outreach Wiki page.

There have been no new FOSS Projects added since the last report in December 2019.

Note, we have a further 15 Projects that we communicate with that are not listed on the wiki i.e 138 projects in total.

All FOSS Projects receive regular updates when Early Access (EA) builds become available, they are encouraged to

test and report back any issues they find during their testing.

2.0 Bugs logged since December 2019

Developers from 7 of the 138 participating projects filed 17 new issues in the JDK Bug System in the last three months, thank you !

The Table above lists the number of bugs logged in total - 17, of which 1 was a P1 showstopper bug , 3 were P2 bugs, with 6 P3 bugs & finally 7 P4 bugs etc.

The Table above lists the number of bugs logged by Component. The 17 Bugs were found in 5 component areas .

2.1 FOSS Projects logging significant bugs

The following Projects have submitted bug reports in the last three months and deserve special mention:

• Apache Ant
• Apache Lucene
• Apache Tomcat
• JaCoCo
• JOSM
• JUnit5
• PDFBox

2.2 Overall Summary of bugs filed by FOSS Projects from the start of the Quality Outreach Program to date.

3.0  FOSS activity on JDK 14 Early Access Builds - bug logged from December 2019 to date

The following Projects have submitted significant bug reports ,18 bugs in total,  during the six months release cycle of JDK 14

Thank you for your contribution to the Quality of the Release!

• Apache Ant
• Apache CXF
  
• Apache Lucene
  
• Apache Tomcat
• Apache Wicket
• Eclipse Collections
• Hibernate
• JaCoCo
  
• RxJava
  
  

3.1   Testing Early Access builds of JDK 14 - list of  FOSS Projects results and their comments

Regular feedback was received from the following FOSS Projects,much appreciated !

See Mark Reinhold's tweet - If your tests are green on JDK 14 please respond to Mark

	FOSS Project	JDK 14 EA	Comments
1	Apache Ant		No unexpected failures observed with JDK 14 build 14+36-1461 for our Ant testsuite on a Linux setup.
2	Apache Lucene		I switched the Jenkins builds yesterday to enable it. But in fact it was only a rename: “jdk-14-rc” -> “jdk-14”, and first build succeeded.
3	Apache Tomcat		Logged JDK-8233619. No additional issues found testing either version. Build, smoke test and full unit test on Linux all OK.
4	Apache Wicket		I've just tested both Java 14 b36 and Java 15 b9 - both fine for Apache Wicket!
5	Apereo CAS		After the upgrade to Gradle 6.3 which brings forward support for JDK 14, Apereo CAS can successfully build and run against JDK 14.
6	Eclipse Collections		JDK 14 EA builds, updated for Eclipse Collections, is now building on JDK14 GA.
7	GraphHopper		Currently we do not have any problems with JDK 14.
8	JaCoCo		Reported one issue JDK-8237528 which is fixed in JDK 15. Everything else is fine on JDK 14 EA b32.
9	JUnit5		Local tests look good.
10	RxJava		RxJava 3.0.0 with JDK 14b36 Compile: OK, Tests: OK -Target 14 now works via IntelliJ 2020 preview.
11	Spring		Spring Framework 5.2.5 release adds support for the recently released Java 14.

4.0  FOSS activity on JDK 15 Early Access Builds - bugs logged from December 2019 to date

FOSS Projects have started testing JDK 15 Early Access builds and below is the number of bugs found so far.

The following Projects have submitted bug reports against JDK 15 Early Access builds :

• Apache Lucene
• Apache Tomcat
• JOSM
• Junit
  

4.1   Testing Early Access builds of JDK 15 - list of  FOSS Projects results and their comments

	FOSS Project	JDK 15 EA	Comments
1	Apache Ant		No unexpected failures observed with JDK 15 build 15-ea+9-264 for our Ant testsuite on a Linux setup.
2	Apache Lucene		JDK15 build 14 was installed, and first build succeeded.
3	Apache Maven		Testing with Java 15-ea for a couple of weeks now, no issues found apart from some third party dependencies.
4	Apache Wicket		I've just tested Java 15 b9 - fine for Apache Wicket!
5	Eclipse Collections		is now building on JDK15 EA-Build-18. No problems found so far.
5	JaCoCo		Reported one issue JDK-8237528 which is already fixed in JDK 15. Everything else is fine on JDK 15 EA b6.
6	RxJava		Upgraded to Gradle 6.3-RC2 and rerun tests on CI with all available targets, including Target 15 too - all green for JDK 15 b14.

5.0 Discussion of the quality-discuss@openjdk.java.net mailing list

• Total 1 member participated in various discussions on the mailing list.
• Discussion threads
  
  • OpenJDK 14 EA build test results - 6
  • OpenJDK 15 EA build test results - 8
  • OpenJDK 14 EA & OpenJDK 15 EA builds availability - 1
  • Release announcement of JDK 14 Rampdown Phase Two - 1
  • Release announcement of JDK 14 Release Candidate Phase - 1
  • Release Announcement: General Availability of JDK 14 - 1

The next Quality Outreach report is due in June 2020