Hello,It looks like mybinder is having some issues today, so the usual link (below) which displays all of the results may not load an interactive notebook. However, from looking at the weekly notebook (attached), its clear that bschubert/cython [0] has provided us with some significant gains, this is also clear in the tables below.
-----As before, a notebook containing *all* of the results should be available via following link:
https://mybinder.org/v2/gh/james-ennis/bst-benchmarks-notebooks/master?filepath=all_results.ipynbIf the link has expired, you'll need to go to https://mybinder.org/ and the copy and paste: https://github.com/james-ennis/bst-benchmarks-notebooks into the url field, with branch "master" and file "all_results.ipynb". Then "launch".
When the notebook has loaded please click on "Kernel" -> "Restart and Run all".
This will show the four interactive graphs and some instructions regarding how the toolbar can be used to interact with each graph.
-----All results were obtained on the same hardware (a Codethink dev machine configured as a GitLab runner - not being used for anything else), and the results files are being appended to by a CI job. Specs as follows:
* Linux (Debian stable) * x86_64 * 16G RAM * 500Gb SSD * Intel i7-3770 * 8 cores @ 3.40 GHz -----Here are the times and max-rss (peak memory usage) results for a `bst show` of base-files/base-files.bst in the Debian-like project [1] (jennis/use_remote_file branch [2]) for the last 5 weeks:
┌─────┬─────────────────┬─────────────────┐ │ │ Show │ Show once built │ ├─────┼───────┬─────────┼───────┬─────────┤ │Dates│Time │Memory │Time │Memory │ │ │(s) │(M) │(s) │(M) │ ├─────┼───────┼─────────┼───────┼─────────┤ │04/29│11.78 │186 │13.28 │194 │ │05/05│ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┤ │05/06│11.91 │185 │13.94 │193 │ │05/12│ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┤ │05/13│11.65 │186 │12.88 │200 │ │05/19│ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┤ │05/20│11.20 │187 │10.40 │211 │ │05/26│ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┤ │05/27│8.86 │180 │8.29 │203 │ │06/02│ │ │ │ │ └─────┴───────┴─────────┴───────┴─────────┘ -----Here are the times and max-rss results for a `bst build` (4, 8 and 12 builders) of base-files/base-files.bst in the Debian-like project [2].
┌─────┬─────────────────┬─────────────────┬──────────────────┐ │ │ 4 Builders │ 8 Builders │ 12 Builders │ ├─────┼───────┬─────────┼───────┬─────────┼───────┬──────────┤ │Date │Time │Memory │Time │Memory │Time │Memory │ │ │(s) │(M) │(s) │(M) │(s) │(M) │ ├─────┼───────┼─────────┼───────┼─────────┼───────┼──────────┤ │04/29│165.02 │190 │182.59 │190 │207.50 │190 │ │05/05│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼───────┼──────────│ │05/06│176.05 │190 │196.46 │190 │219.28 │190 │ │05/12│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼───────┼──────────┤ │05/13│168.47 │197 │189.70 │198 │213.01 │197 │ │05/19│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼───────┼──────────┤ │05/20│133.44 │210 │153.84 │210 │175.90 │210 │ │05/26│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼───────┼──────────┤ │05/27│129.73 │202 │152.97 │202 │174.24 │202 │ │06/02│ │ │ │ │ │ │ └─────┴───────┴─────────┴───────┴─────────┴───────┴──────────┘ Please see [3] if you're unable to open the weekly notebook. Thanks, James [0] https://gitlab.com/BuildStream/buildstream/merge_requests/1350 [1] https://gitlab.com/jennis/debian-stretch-bst[2] https://gitlab.com/jennis/debian-stretch-bst/tree/jennis/use_remote_file [3] https://mail.gnome.org/archives/buildstream-list/2019-February/msg00046.html
Attachment:
weekly_results.ipynb
Description: Text document