Quality Outreach Report introduction

The first Quality Report was published in September 2015 here, our initial intention was to provide a report every six months. We now release

a Feature Release every 6 months so we have decided to publish a Quality Outreach Report every three months.

The previous report was issued in September 2020 here

• Section one looks at the number of FOSS Project participating in the Quality Outreach .
• Section two lists Bug logging activities over the past three months (end of September 2020 - December 2020).
• Section three lists FOSS project activity on JDK 16 Early Access builds.
• Section four gives glimpse of Outreach Feedback Survey results.
• Section five lists traffic on quality-discuss@openjdk.java.net.

1.0 FOSS Projects listed on Quality Outreach Wiki

We now have 139 FOSS Projects and their developers listed on the Quality Outreach Wiki page.

There have been 6 new FOSS Projects added since the last report in September 2020. Welcome!

New Projects added :

• Hibernate Reactive
• Hibernate Search
• Hibernate Validator
• JaColine
• JFreePDF
• VMOptionsExplorer

Note, we have a further 15 Projects that we communicate with that are not listed on the wiki i.e 154 projects in total.

All FOSS Projects receive regular updates when Early Access (EA) builds become available, they are encouraged to

test and report back any issues they find during their testing.

2.0 Bugs logged since September 2020

Developers from 10 of the 154 participating projects filed 15 new issues in the JDK Bug System in the last three months, thank you !

The table above lists the number of bugs logged in total - 15, of which 2 were P2, 5 were P3 bugs and 8 were P4 bugs.

The table above lists the number of bugs logged by Component. The 15 Bugs were found in 4 component areas.

2.1 FOSS Projects logging significant bugs

The following Projects have submitted bug reports in the last three months and deserve special mention:

• Apache Ant
• Apache Lucene
• Apache Tomcat
• Apache Zookeeper
• Byte Buddy
• Graph Hopper
• JaCoCo
• JOSM
• JUnit5
  • JDK-8253761 - Bug logged & fix provided by Christian
  • JDK-8255576 - Bug logged & fix provided by Christian
• RxJava

2.2 Overall Summary of bugs filed by FOSS Projects since October 2013

3.0  FOSS activity on JDK 16 Early Access Builds - bugs logged since September 2020 to now

The following Projects have submitted bug reports against JDK 16 Early Access builds :

• Apache Ant
• Apache Tomcat
• Apache Zookeeper
• Byte Buddy
• Graph Hopper
• JaCoCo
• JOSM
• JUnit5
• RxJava

3.1   Testing Early Access builds of JDK 16 - list of  FOSS Projects results and their comments

	FOSS Project	JDK 16 EA	Comments
1	Apache Ant		Logged a regression issue with build 28 - JDK-8258246
2	Apache Derby		Derby builds and tests cleanly against JDK 16 build 28.
3	Apache Lucene		Confirm that the bug(JDK-8252739) is fixed in JDK 16 build 18.
4	Apache Synscope		Reported issues due to newly introduced JEP 396 from their dependencies.
5	Apache Tomcat		Apache Tomcat's build and tests pass with JDK 16 b28 on both x86_64 and aarch64, Ubuntu 20.04!
6	Apache Wicket		Apache Wicket build and tests are OK with JDK 16 b28 for both aarch64 and x86_64 (Ubuntu 20.10)!
7	Apache Zookeeper		No more able to run ZooKeeper tests due to an open issue(byte-buddy/issues/983) with ByteBuddy.
8	Eclipse Collections		Updated Eclipse Collections to use latest build JDK 16 EA b21.
9	Eo-yaml		eo-yaml builds successfully with OpenJDK 16 EA b6.
10	FXGL		FXGL tests are also green on JDK 16.
11	FXyz		FXyz works fine with latest 16-ea+24.
12	GraphHopper		Logged regression on JDK 16 b25 - JDK-8256837
13	Hibernate ORM		Tested with version 5.5.0-SNAPSHOT. Everything works fine with JDK 16 EA build 28.
14	Hibernate Validator		Tested with versions 6.1, 6.2 and 7.0. Everything works fine with JDK 16 EA build 28.
15	Hibernate Search		Tested with versions 5.11 and 6.0. Everything works fine with JDK 16 EA build 28.
16	Hibernate Reactive		Tested with version 1.0. Everything works fine with JDK 16 EA build 28.
17	JaCoCo		JaCoCo tests are green on JDK 16 and we already started testing JDK 17.
18	Java Katas		Happy to report build passed for JDK 16 build 26. I specifically was looking for the datetime kata to pass.
19	JobRunr		JobRunr works with records out-of-the-box.
20	jOOQ		Tried with JDK 16(b21) as well now. I haven't discovered any issues.
21	JOSM		Logged bug on JDK 16 EA build and same got fixed in b25.
22	JUnit5		Logged and fixed bugs in JDK 16 EA.
23	Micrometer		Tested the Micrometer 1.5.x build with 16 EA build 17 and did not have any problems.
24	PDFsam		All tests are green in PDFsam with this version - JDK 16 b28.
25	RxJava		RxJava 3.0.9 snapshot fails on JDK 16 b28 due to the type extraction bug from last time:byte-buddy/issues/983
26	Sejda		All green on Sejda.

4.0 Outreach Feedback Survey 

We received feedback from 65 FOSS Projects - Thank you for taking the time to respond!

1. Does your project support JDK 15 - Yes (51) , No - but have plans to (4) , No Plans (10)
2. Have you tested JDK 16 EA builds - Yes (41) , No - but have plans to (14) , No Plans (10)
3. Do you find availability emails useful - Yes (63) , No - 1

4. Any libraries/tools that should be added to the Quality Outreach program: We received pointers to 7 FOSS Projects that we are not currently engaged with.

5. Please provide any feedback on the Quality Outreach program:

   • Add more content to the emails - blogs etc.
   • Allow project to update the external Quality page
   • Add a CI 

Again , thank you for responding and providing excellent feedback.

5.0 Discussion of the quality-discuss@openjdk.java.net mailing list

• Total 1 member participated in various discussions on the mailing list.
• Discussion threads
  
  • OpenJDK 17 EA build test results - 1
  • OpenJDK 16 EA build test results - 10
  • OpenJDK 16 EA builds availability - 4
  • Announcement of JDK 16 Rampdown Phase One - 1

The next Quality Outreach report is due in March 2021