Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This is SPECjvm2008 modified to run with JDK24. Scores are ops/min, more is better. All benchmarks have been run on a AWS c5.9xlarge instance.

JVM flags: -Xms8g -Xms8g Xmx8g -XX:+AlwaysPreTouch

Notes: The CryptoRsa benchmark shows a legit regression of ~2%. I confirmed this by running 50 times (most benchmarks are run 3 times). The regression disappears when improving oopDesc::klass().

...

This is renaissance-jmh-0.15.0, excluding Als, ChiSquare, DecTree, GaussMix, LogRegression, MovieLens, NaiveBayes, PageRank and DbShootout, which are not compatible with JDK24 due to SecurityManager restriction. Scores are ms/op, less is better. All benchmarks have been run on a AWS c5.9xlarge instance.

JVM flags: -Xms8g -Xms8g Xmx8g -XX:+AlwaysPreTouch

Benchmark

Baseline

-UCOH

%

+UCOH

%

AkkaUct

799.526

796.987

-0.32%

792.829

-0.84%

Reactors

15192.454

15070.100

-0.81%

14533.405

-4.34%

FjKmeans

1048.697

1049.511

0.07%

953.387

-9.09%

FutureGenetic

2011.925

1991.429

-1.02%

2072.172

2.99%

Mnemonics

2760.609

2739.520

-0.77%

2824.556

2.31%

ParMnemonics

2270.166

2286.626

0.72%

2304.885

1.52%

Scrabble

53.150

53.525

0.70%

55.052

3.57%

Neo4jAnalytics

1482.061

1479.183

-0.20%

1511.736

2.00%

RxScrabble

104.344

103.626

-0.69%

105.156

0.77%

Dotty

697.111

700.798

0.52%

700.191

0.44%

ScalaKmeans

175.545

177.320

1.01%

188.345

7.29%

Philosophers

5598.596

5645.268

0.83%

6379.457

13.94%

ScalaStmBench7

1010.489

1018.077

0.75%

999.638

-1.08%

FinagleChirper

3643.971

3629.694

-0.40%

3681.006

1.01%

FinagleHttp

3392.307

3338.891

-1.58%

3269.203

-3.63%

SPECjbb2015

SPECjbb2015 in composite mode, run on a AWS c5.9xlarge instance, 10 times in a row, scores averaged over all runs. More is better.

JVM flags: -Xms20g -Xms20g Xmx20g -XX:+AlwaysPreTouch

Score

Baseline

-UCOH

%

+UCOH

%

max-jops

49818

49700

-0.24%

51652

3.68%

critial-jops

39139

38726

-1.06%

41219

5.31%


GC Pause times

Young GC time, measured over 10 runs of SPECjbb2015 each, the total number of cycles is given, too.

Young GC time, baseline: avg: 71.4059 ms, #cycles: 22909
Young GC time, -UCOH:    avg: 73.2457 ms, #cycles: 23032
Young GC time, +UCOH:    avg: 69.8878 ms, #cycles: 20619


Concurrent marking time, measured over a run of SPECjvm compiler.compiler benchmark.

Concurrent marking time, baseline: avg: 1757.43 ms, #cycles: 69
Concurrent marking time, -UCOH:    avg: 1724.96 ms, #cycles: 78
Concurrent marking time, +UCOH:    avg: 1664.67 ms, #cycles: 62

SPECjbb2015 (run at Red Hat)

The following tests were run at Red Hat on a bare metal RHEL9 x64 i7-4770 8core machine, with the benchmark process isolated on 6 cores, 10 consecutive runs, all scores averaged. Perf statistics were done for the full benchmark process run, therefore include warmup and report generation.

JVM flags: -Xshare:off -Xlog:gc* -XX:+UseG1GC -Xms4g -Xms4gXmx4g


-COH+COH%
maxjops10136.610823.6+6.78%
critjops37423995.6+6.78%
Number of GCs4971.83469.8-30.21%
GC Real Times, Sum, seconds350.34273-22.08%
GC User Times, Sum, seconds2031.831588.63-21.81%
GC Sys Times, Sum, seconds3.072.2-28.34%
L1 Misses1294363538563.41109038645193.3-14.32%
L1 Loads25511385965443.621610503370719.1-15.29%
LLC Misses273833668865.4212658994859.6-22.34%
LLC Loads655211047461.7555606059480-15.20%
TLB Misses37718612782.932378833894.3-14.16%
TLB Loads25308734883537.921437105901958.6-15.30%
Instructions83966573365463.872477839817765.8-13.68%
Branches15749934748078.213181107354563.9-16.31%

...