Collection of test scripts for evaluating pluto's performance compared to Dovecot.
First, run
$ make folders
and place involved certificates under private/.
Next, copy test-config.toml.example to test-config.toml and adjust it to your setup. This includes specifying IPs, ports, certificates and authentication information in order for your tests to run successfully. Afterwards, execute
$ make build
which will re-run folders target, compile all test scripts and the executable to plot the results.
Now you can start testing. For this, choose a test to start with from the available executables and run it, e.g.
$ ./test-append -runs 1000
which will execute 1000 APPEND operations against first pluto and then Dovecot. Result logs will be placed in results/, containing meta-information and comma-separated pairs of msgID and completion time of that command in nanoseconds. A beginning of such a file might look like:
Subject: APPEND
Platform: pluto
Date: 2017-01-01-10-00-00
-----
1, 110422612
2, 98924309
3, 107112562
...
Finally, you can plot two corresponding test results against each other with every run of plot-results. For this, execute
$ ./plot-results -fileOne results/pluto-append-2017-01-01-10-00-00.log -fileTwo results/dovecot-append-2017-01-01-10-00-00.log
and have a look at the output .svg file in results/.
That's it!
This project is GPLv3 licensed.