[OE-core] [PATCH 0/6] oe-build-perf-test: re-organize buildstats archiving

[Markus Lehtonen]

This patchset optimizes the way buildstats are stored in oe-build-perf-test
result data. After this change buildstats are stored under
refs/notes/buildstats/* in Git, and thus, they're not cloned/fetched by
default. The motivation is to reduce the data footprint as buildstats are
rarely used but they take a lot of space. With thousands of test runs, the
amount of data transfer required by git clone drops from the order of gigabytes
to megabytes. If needed for deeper analysis, buildstats can always be fetched
separately.

The first patch in this changeset packs all buildstats into one JSON-formatted
file so that they're easier to work with under git-notes.

The second patch optimizes buildstats data footprint by combining rusage
values.

Patches #3, #4 and #5 add oe-git-archive script the ability to store data under
git-notes, also fixing one bug in the git push functionality.

The last patch changes the build perf test worker script to store buildstats
under git-notes.


The following changes since commit 3b5ac72bdf76ac8ff98dc3c882a4edc77c6e2c33:

  rpm: add a "rpm-build" PROVIDES (2017-03-22 15:09:26 +0000)

are available in the git repository at:

  git://git.openembedded.org/openembedded-core-contrib marquiz/buildperf/buildstats
  http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/buildperf/buildstats


Markus Lehtonen (6):
  oe-build-perf-test: pack all buildstat in one file
  oe-build-perf-test: sum rusage in buildstats
  scripts/oe-git-archive: fix pushing
  scripts/oe-git-archive: implement --exclude
  scripts/oe-git-archive: implement --notes
  build-perf-test-wrapper.sh: store buildstats under git-notes

 meta/lib/oeqa/buildperf/base.py            | 66 ++++++++++++++++--------------
 meta/lib/oeqa/buildperf/test_basic.py      | 24 +++++------
 scripts/contrib/build-perf-test-wrapper.sh |  2 +
 scripts/oe-build-perf-test                 |  1 +
 scripts/oe-git-archive                     | 32 +++++++++++++--
 5 files changed, 78 insertions(+), 47 deletions(-)

-- 
2.6.6