Hello, Apologies that this email has come a day late.The notebook containing *all* of the results should be available via following link:
https://mybinder.org/v2/gh/james-ennis/bst-benchmarks-notebooks/master?filepath=all_results.ipynbIf the link has expired, you'll need to go to https://mybinder.org/ and the copy and paste: https://github.com/james-ennis/bst-benchmarks-notebooks into the url field, with branch "master" and file "all_results.ipynb". Then "launch".
When the notebook has loaded please click on "Kernel" -> "Restart and Run all".
This will show the four interactive graphs and I've provided some instructions regarding how the toolbar can be used to interact with each graph.
-----All results were obtained on the same hardware (a Codethink dev machine configured to be a gitlab runner - not being used for anything else), and the results files are being appended to by a CI job. Specs as follows:
* Linux (Debian stable) * x86_64 * 16G RAM * 500Gb SSD * Intel i7-3770 * 8 cores @ 3.40 GHz -----Here are the times and max-rss (peak memory usage) results for a `bst show` of base-files/base-files.bst in the Debian-like project [0] (jennis/use_remote_file branch) [1] (Note that I've set the column width of the table to 72 in the hope that this will wrap nicely for everyone):
┌─────┬─────────────────┬─────────────────┬───────────────────────────┐ │ │ Show │ YAML cache show │ Show once built │ ├─────┼───────┬─────────┼───────┬─────────┼─────────────────┬─────────┤ │Dates│Time │Memory │Time │Memory │Show once built │Memory │ │ │(s) │(M) │(s) │(M) │(s) │(M) │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │01/14│49.23 │1089 │27.17 │1115 │32.82 │1117 │ │01/20│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │01/21│48.85 │1089 │27.35 │1115 │32.84 │1117 │ │01/27│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │01/28│49.50 │1088 │27.17 │1115 │32.76 │1117 │ │02/03│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/04│48.08 │561 │26.68 │588 │31.90 │589 │ │02/10│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/11│45.46 │408 │23.75 │435 │29.50 │437 │ │02/17│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/18│43.17 │417 │21.65 │443 │27.28 │445 │ │02/24│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/25│41.75 │493 │19.43 │519 │25.69 │625 │ │03/03│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/04│40.96 │517 │18.81 │543 │25.20 │696 │ │03/10│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/11│40.44 │519 │18.06 │545 │24.50 │698 │ │03/17│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/18│38.87 │521 │16.74 │547 │23.19 │696 │ │03/24│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/25│22.63 │422 │13.40 │433 │17.36 │563 │ │03/31│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │04/01│11.32 │352 │11.17 │352 │12.96 │470 │ │04/07│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │04/08│11.27 │352 │11.13 │352 │13.08 │470 │ │04/14│ │ │ │ │ │ │ └─────┴───────┴─────────┴───────┴─────────┴─────────────────┴─────────┘ -----Here are the times and max-rss results for a `bst build` (4, 8 and 12 builders) of base-files/base-files.bst in the Debian-like project [1].
┌─────┬─────────────────┬─────────────────┬───────────────────────────┐ │ │ 4 Builders │ 8 Builders │ 12 Builders │ ├─────┼───────┬─────────┼───────┬─────────┼─────────────────┬─────────┤ │Date │Time │Memory │Time │Memory │Show once built │Memory │ │ │(s) │(M) │(s) │(M) │(s) │(M) │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │01/14│1383.67│1119 │1078.76│1119 │735.41 │1119 │ │01/20│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │01/21│561.12 │1117 │602.20 │1117 │680.10 │1117 │ │01/27│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │01/28│560.7 │1117 │601.57 │1117 │678.03 │1117 │ │02/03│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/04│373.29 │590 │425.09 │589 │500.71 │590 │ │02/10│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/11│308.75 │436 │357.69 │436 │412.90 │436 │ │02/17│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/18│292.78 │445 │350.70 │445 │398.30 │445 │ │02/24│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/25│342.28 │521 │387.28 │521 │436.51 │521 │ │03/03│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/04│354.64 │544 │400.00 │544 │441.61 │544 │ │03/10│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/11│352.95 │546 │395.50 │546 │442.52 │546 │ │03/17│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/18│348.53 │549 │383.93 │549 │431.18 │549 │ │03/24│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/25│286.67 │435 │302.77 │435 │332.87 │435 │ │03/31│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │04/01│249.50 │355 │255.38 │355 │284.80 │355 │ │04/07│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │04/08│233.83 │354 │249.45 │354 │267.39 │354 │ │04/14│ │ │ │ │ │ │ └─────┴───────┴─────────┴───────┴─────────┴─────────────────┴─────────┘Please see my previous email [2] if you're unable to open the weekly notebook.
Thanks, James [0] https://gitlab.com/jennis/debian-stretch-bst[1] https://gitlab.com/jennis/debian-stretch-bst/tree/jennis/use_remote_file [2] https://mail.gnome.org/archives/buildstream-list/2019-February/msg00046.html
Attachment:
weekly_results.ipynb
Description: Text document