[OE-core] [PATCH 0/9] oe-build-perf-test: use Python unittest framework

[Markus Lehtonen]

This patchset converts the lately added oe-build-perf-test (and oeqa.buildperf)
to utilize the Python's unittest framework. Unittest (framework) provides a lot
of functionality and it should make future development of build perf tests
easier. As of now, the most visible change is different console output from the
oe-build-perf-test script.

The first patch renames the .py file containing the actual tests. It is
cosmetic but would make oeqa.buildperf module more consistent by requiring all
(possible) future test files to start with a 'test' prefix, too.

The next five patches actually convert the buildperf tests to use Python
unittest framework. This conversion is one bigger change that is split into
multiple smaller patches in order to make it more comprehensible. The patches
are dependent on each other and all of them should be applied as a unit.

The seventh patch aligns test status better with how they are expected to be
used (test failure vs. test error).

The last two patches improve the console output of the script.


The following changes since commit 5ed0d5a7d9b051a551a6de644bf6a42b87c12471:

  dbus: backport stdint.h build fix (2016-08-10 10:45:33 +0100)

are available in the git repository at:

  git://git.openembedded.org/openembedded-core-contrib marquiz/buildperf/unittest
  http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/buildperf/unittest


Markus Lehtonen (9):
  oeqa.buildperf: rename module containing basic tests
  oeqa.buildperf: derive BuildPerfTestCase class from unitest.TestCase
  oeqa.buildperf: add BuildPerfTestLoader class
  oeqa.buildperf: add BuildPerfTestResult class
  oeqa.buildperf: convert test cases to unittest
  oe-build-perf-test: use new unittest based framework
  oeqa.buildperf: introduce runCmd2()
  oe-build-perf-test: write logger output into file only
  oeqa.buildperf: be more verbose about failed commands

 meta/lib/oeqa/buildperf/__init__.py    |  10 +-
 meta/lib/oeqa/buildperf/base.py        | 245 +++++++++++++++++----------------
 meta/lib/oeqa/buildperf/basic_tests.py | 133 ------------------
 meta/lib/oeqa/buildperf/test_basic.py  | 121 ++++++++++++++++
 scripts/oe-build-perf-test             |  54 +++++---
 5 files changed, 294 insertions(+), 269 deletions(-)
 delete mode 100644 meta/lib/oeqa/buildperf/basic_tests.py
 create mode 100644 meta/lib/oeqa/buildperf/test_basic.py

-- 
2.6.6