[bitbake-devel] [PATCH 2/2] runqueue: Introduce load balanced task spawning

[Alexander Kanavin]

2018-08-14 11:43 GMT+02:00 Richard Purdie <richard.purdie at linuxfoundation.org>:
> If people want to play, I did experiment with "proper" thread pooling:
>
> http://git.yoctoproject.org/cgit.cgi/poky-contrib/commit/?h=rpurdie/wipqueue4&id=d66a327fb6189db5de8bc489859235dcba306237
>
> This implements a make job server within bitbake, then connects make to
> it. The net result is that you can then put a limit on the number of
> processes across all tasks.
>
> I seem to remember there were some bugs with it and not all are listed
> in the commit message, I don't remember what the other issues were...

Both make and ninja have -l option:

      -l [load], --load-average[=load]
            Specifies  that  no  new  jobs (commands) should be
started if there are others jobs running and the load average is at
least load (a floating-point number).  With no argument, removes a
            previous load limit.

       -l N   do not start new jobs if the load average is greater than N

Maybe that could be appended to PARALLEL_MAKE, which is far less
invasive than any other approach?

Alex