[BuildStream] Weekly Performance Update

[Tom Pollard <tom pollard codethink co uk>]

Here are the benchmark results for the week beginning 14/10/19 (also
includes the previous week starting 07/10/19, last week's email was
unfortunately missed):

Ipython notebook with the results:
https://mybinder.org/v2/gl/BuildStream%2Fbenchmarking%2Fbst-benchmarks-notebooks/master?filepath=all_results.ipynb

the results are hosted at:
https://hub.gke.mybinder.org/user/buildstream-ben-marks-notebooks-gexu1j5p/notebooks/all_results.ipynb

Don't forget to run "Kernel" -> "Restart and Run all" to actually
generate the graphs.

Note: If the link has expired, you'll need to go to
https://mybinder.org/ and enter:
https://gitlab.com/BuildStream/benchmarking/bst-benchmarks-notebooks
into the url
field, with branch "master" and file "all_results.ipynb". Then "launch".

---

All results were obtained on the same hardware (a Codethink dev
machine configured as a GitLab runner - not being used for anything
else), and the results files are being appended to by a CI job. Specs
as follows:

* Linux (Debian stretch)
* x86_64
* 16G RAM
* 500Gb SSD
* Intel i7-3770
* 8 cores @ 3.40 GHz

---

Here are the times and max-rss (peak memory usage) results for a `bst
show` of base-files/base-files.bst in the Debian-like project (branch:
jennis/add_all_files [1]) for the last 5 weeks:


┌────────────────┬─────────────────────────────────┬─────────────────────────────────┐
│                │              Show               │         Show once 
built         │
├────────────────┼────────────────┬────────────────┼────────────────┬────────────────┤
│     Dates      │    Time (s)    │  Memory (MiB)  │    Time (s)    │  
Memory (MiB)  │
├────────────────┼────────────────┼────────────────┼────────────────┼────────────────┤
│ 16/09 -> 22/09 │ 6.4            │ 202.0          │ 6.79           │ 
230.0          │
├────────────────┼────────────────┼────────────────┼────────────────┼────────────────┤
│ 23/09 -> 29/09 │ 6.61           │ 202.0          │ 7.46           │ 
231.0          │
├────────────────┼────────────────┼────────────────┼────────────────┼────────────────┤
│ 30/09 -> 06/10 │ 6.44           │ 201.0          │ 6.77           │ 
230.0          │
├────────────────┼────────────────┼────────────────┼────────────────┼────────────────┤
│ 07/10 -> 13/10 │ 6.48           │ 201.0          │ 6.81           │ 
230.0          │
├────────────────┼────────────────┼────────────────┼────────────────┼────────────────┤
│ 14/10 -> 20/10 │ 6.43           │ 201.0          │ 6.74           │ 
230.0          │
└────────────────┴────────────────┴────────────────┴────────────────┴────────────────┘


---

Here are the times and max-rss results for a `bst build` (4, 8 and 12
builders) of base-files/base-files.bst in the Debian-like project
(branch: jennis/add_all_files [1]):

┌────────────────┬─────────────────────────────────┬─────────────────────────────────┬─────────────────────────────────┐
│                │           4 Builders            │           8 
Builders            │           12 Builders           │
├────────────────┼────────────────┬────────────────┼────────────────┬────────────────┼────────────────┬────────────────┤
│     Dates      │    Time (s)    │  Memory (MiB)  │    Time (s)    │  
Memory (MiB)  │    Time (s)    │  Memory (MiB)  │
├────────────────┼────────────────┼────────────────┼────────────────┼────────────────┼────────────────┼────────────────┤
│ 16/09 -> 22/09 │ 127.8          │ 228.0          │ 132.13         │ 
228.0          │ 128.89         │ 228.0          │
├────────────────┼────────────────┼────────────────┼────────────────┼────────────────┼────────────────┼────────────────┤
│ 23/09 -> 29/09 │ 132.4          │ 228.0          │ 135.45         │ 
228.0          │ 131.24         │ 228.0          │
├────────────────┼────────────────┼────────────────┼────────────────┼────────────────┼────────────────┼────────────────┤
│ 30/09 -> 06/10 │ 132.7          │ 228.0          │ 136.81         │ 
228.0          │ 132.0          │ 228.0          │
├────────────────┼────────────────┼────────────────┼────────────────┼────────────────┼────────────────┼────────────────┤
│ 07/10 -> 13/10 │ 132.75         │ 228.0          │ 134.59         │ 
228.0          │ 133.11         │ 228.0          │
├────────────────┼────────────────┼────────────────┼────────────────┼────────────────┼────────────────┼────────────────┤
│ 14/10 -> 20/10 │ 133.42         │ 228.0          │ 136.9          │ 
228.0          │ 134.72         │ 228.0          │
└────────────────┴────────────────┴────────────────┴────────────────┴────────────────┴────────────────┴────────────────┘


---

Please see [2] if you're unable to open the weekly notebook locally.

[1]
https://gitlab.com/BuildStream/benchmarking/debian-stretch-bst/tree/jennis/add_all_files
[2]
https://mail.gnome.org/archives/buildstream-list/2019-February/msg00046.html