[Shootout-list] fannkuch (timer resolution; HZ=1000?)

[Jon Harrop]

On Friday 20 May 2005 19:31, Isaac Gouy wrote:
> --- Jon Harrop <jon@ffconsultancy.com> wrote:
> > I've heard (from Microsoft) that C# does poorly in the shootout
> > because it has a big startup time.
>
> Microsoft! Would that be Mr Gates, or An Other employee?

A friend at MSR Cambridge.

> > I thought it would be nice to do those Skaller plots using only tests
> > which ran for >0.1s or even >1s but there is virtually no such data
>
> on
>
> > the shootout (i.e. the plots are all blank).
>
> Guess that depends what you mean. I gave up looking after the first 5
> benchmarks with top run times >0.1s (and 3 >1s)

You should have been looking at the lowest running times. Here are the 
smallest positive times for each benchmark for the biggest n:

{0.01, 0.01, 0.01, 0.01, 0.01, 0.02, 0.02, 0.02, 0.02, 0.02, 0.04, 0.05, 0.05, 
0.06, 0.07, 0.07, 0.07, 0.07, 0.07, 0.08, 0.1, 0.12, 0.13, 0.18, 0.19, 0.19, 
0.2, 0.2, 0.22, 0.28, 0.39, 0.49, 0.59, 0.67, 0.69, 0.83, 0.92, 1.19, 1.41, 
2.31, 2.45, 3.09, 4.15, 9.88, 15.08}

As you can see, half of them are <0.1s and 82% are <1s. So half of the current 
benchmarks are actually just measuring startup time for some languages (most 
notably Java).

-- 
Dr Jon D Harrop, Flying Frog Consultancy Ltd.
Objective CAML for Scientists
http://www.ffconsultancy.com/products/ocaml_for_scientists