[cairo] ANN: "Caskbench" performance benchmark

[Petr Kobalíček]

Hi Bryce,

I have found this suite a bit earlier than you announced it and I think
that you have done a great job! Some improvements are needed, like Chris
said, the random number generator should be improved, but I like the tool
and especially the fact it compares with Skia.

I'm currently developing a 2d vector graphics engine that is using a JIT
compiler to generate inner loops and I'm also preparing a microbenchmark
tool that will check performance of various combinations of the pipeline -
source style, blend, rasterizer, etc... I'm gonna release the library and
tooling soon, but from my early observations I can conclude that cairo
image backend is really slow compared to others, the only exception are
aligned fills, but these are fast in all the libraries available.

Cheers,
Petr

On Fri, Sep 26, 2014 at 2:54 AM, Bryce Harrington <bryce at osg.samsung.com>
wrote:

> At Samsung one of the projects I've been working on is a benchmark test
> for comparing the performance of Cairo and Skia with EGL + MSAA, called
> Caskbench.  I presented about this testing at LinuxConf US in Chicago
> last month.
>
> This is no where near as comprehensive or meticulous as Cairo's
> performance test suite, but it runs quickly, and includes Skia ports of
> each of the tests.  The idea here being to do fair apples-to-apples
> comparisons of the two codebases, or for comparing performance of
> Cairo's image backend with the egl backend.
>
>
> The codebase has been open sourced and is available on github:
>
>   https://github.com/Samsung/caskbench
>
> Caskbench was designed to be installed and used on Tizen, but was
> developed and has been tested on Linux.  Building it should be
> straightforward; the main problem is getting skia built and installed.
>
> Fortunately, you can skip Skia entirely, by configuring Caskbench
> without it:
>
>   $ cmake . -DENABLE_SKIA=OFF
>
> Or, if you're on Ubuntu, you can install Skia from my PPA:
>
>   https://launchpad.net/~bryce/+archive/ubuntu/skia/
>
> (If you're on Debian, you may be able to install the .deb files from
> this PPA; click "View package details" then click the arrow next to the
> skia package and grab the appropriate .debs.)
>
> Alternatively, you can build and install Skia yourself, but this is
> easier said than done!  Skia does not maintain a stable API and neither
> do they do releases, so we've developed and tested caskbench against a
> snapshot of the tree.  Skia's API has wandered off a ways since then,
> and so unfortunately caskbench doesn't currently build with the trunk.
> The snapshot I've used is the 'dev/m36_1985' branch
>
>
> Once it's built, you can run the tests using the image backend:
>
>   $ ./src/caskbench -t image --iterations 100 --size 10
>
>   cairo-bubbles        64     PASS  10  115.60
>   skia-bubbles         64     PASS  10  311.93  62.94%
>   ...
>
> If you've built Cairo with EGL (--enable-glesv2 --enable-egl), you can
> run the tests against it:
>
>   $ ./src/caskbench -t egl
>
> The --help gives a rundown of all the command line options it supports.
> See the README for more information.
>
>
> Bryce
> --
> cairo mailing list
> cairo at cairographics.org
> http://lists.cairographics.org/mailman/listinfo/cairo
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.cairographics.org/archives/cairo/attachments/20141001/63a465bd/attachment.html>