In the previous series of SPEC benchmarks, I explained what SPEC is, the structure of SPEC and some technicalities that users need to understand while evaluating performance with SPEC benchmarks along with running SPEC intrate ( a series of integer computation benchmarks) on RISC-V, Arm, and x86 compute instances. 

On this page, readers will get to know the results of SPEC fprate benchmarks (a series of floating point computation benchmarks). Before continuing with this, if you have any ambiguities while running the SPEC benchmarks, refer to this page where I have explained some technicalities and the structure of SPEC benchmark.

Execution of test

Errors encountered

One thing to note is that, at the time of running this benchmark, I got some errors while running the benchmark on RISC-V compute instances indicating that it is not ported to RISC-V architecture yet. 

• fprate peak is not run in this benchmark. The reason is that, I encountered a segmentation fault while running the benchmark on RISC-V compute instances. So I skipped it.
• The test ran successfully on Visionfive2, raspberry pi, and intel i7-6500U. But when running it on VisionFive 1, I was getting the following error:

*** Miscompare of spec_test.out; for details see
      $SPEC_DIR/benchspec/CPU/507.cactuBSSN_r/run/run_base_test_visionfiveV1speccpu.0000/spec_test.out.mis
  0092:  INFO (PUGH):   Size: 42 42 42
         INFO (PUGH):  42
                    ^

To solve this error, I had to edit two files. $SPEC_DIR/benchspec/CPU/507.cactuBSSN_r/data/refrate/output/spec_ref.out and $SPEC_DIR/benchspec/CPU/507.cactuBSSN_r/data/test/output/spec_test.out. I changed line 92 of both of these files to match the output result file. After modifying them, the result was successful.

Execution Command

The command used for the execution of the test is given below:

./bin/runcpu --config="$PATH_OF_CONFIG_FILE" SPECrate_fp_base --reportable

Results

Individual Test Results

StarFive VisionFive v1

The individual test results of StarFive VisionFive v1 are as follows:

StarFive VisionFive v2

The individual test results of StarFive VisionFive v2 are as follows:

Raspberry 4 Model B

The individual test results of Raspberry 4 Model B are as follows:

Intel i7-6500U

The individual test results of Intel i7-6500U are as follows:

Final Score

The results of the compute instances of specrate for base rules are as follows:

StarFive Visionfive v1: 0.341559
StarFive VisionFive v2: 0.810579
Raspberry Pi 4 Model B: 1.815875
Intel i7-6500U: 9.537077​