[OE-core] [PATCH 0/2] Multi-threaded RPM support
Leonardo Sandoval
leonardo.sandoval.gonzalez at linux.intel.com
Thu Jun 1 16:52:00 UTC 2017
On Thu, 2017-06-01 at 18:15 +0300, Alexander Kanavin wrote:
> These two patches add multi-threaded features to RPM to speed up the do_package_write_rpm task.
>
> Specifically:
>
> 1) Multi-threaded xz compressor is used instead of default single-threaded gz. This has the most
> dramatic effect when a recipe produces a smaller number of large-sized packages.
>
> 2) Packages creation is run in multiple threads via thread pools. This is most beneficial when
> a recipe produces a large amount of small packages.
>
> Some not very scientific benchmarks for time and .rpm sizes
> (time is measured for do_package_write_rpm tasks only):
>
> webkitgtk
> before: 9m22s 1550M
> after: 1m50s 858M
>
> glibc-locale
> before: 3m2s 125M
> after: 40s 56M
>
> glibc
> before: 56s 54M
> after: 23s 38M
>
> perl
> before: 1m19s 63M
> after: 55s 42M
>
> python3
> before: 40s 38M
> after: 28s 24M
it is interesting to see that perl and python does not benefit 'much'.
buildstats should give us a better picture per recipe.
Leo
>
> The following changes since commit bd063fa288b49b6e3ea77982d0ccc46610feb1ad:
>
> tune-mips32*.inc: use consistent comments across all three .inc files (2017-05-30 10:15:20 +0100)
>
> are available in the git repository at:
>
> git://git.yoctoproject.org/poky-contrib akanavin/parallel-rpm
> http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=akanavin/parallel-rpm
>
> Alexander Kanavin (2):
> package_rpm.bbclass: use multithreaded xz compression
> rpm: run binary package generation via thread pools
>
> meta/classes/package_rpm.bbclass | 2 +
> ...y-package-building-into-a-separate-functi.patch | 83 ++++++++
> ...-binary-package-creation-via-thread-pools.patch | 137 +++++++++++++
> ...c-make-operations-over-string-pools-threa.patch | 209 +++++++++++++++++++
> ...c-remove-static-local-variables-from-buil.patch | 227 +++++++++++++++++++++
> meta/recipes-devtools/rpm/rpm_git.bb | 4 +
> 6 files changed, 662 insertions(+)
> create mode 100644 meta/recipes-devtools/rpm/files/0001-Split-binary-package-building-into-a-separate-functi.patch
> create mode 100644 meta/recipes-devtools/rpm/files/0002-Run-binary-package-creation-via-thread-pools.patch
> create mode 100644 meta/recipes-devtools/rpm/files/0003-rpmstrpool.c-make-operations-over-string-pools-threa.patch
> create mode 100644 meta/recipes-devtools/rpm/files/0004-build-pack.c-remove-static-local-variables-from-buil.patch
>
> --
> 2.11.0
>
More information about the Openembedded-core
mailing list