<div dir="ltr">Martin, Randy <a href="http://et.al">et.al</a>.:<div><br></div><div>I'm moving around things such that I can give Martin a full builder:</div><div><br></div><div>24Cores, 256GB RAM, up to 3TB storage from the donation that HP made to WebOS-Ports (as I consider it essential to webOS-Ports that OE has a strong foundation)</div><div><br></div><div>Tom</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Sep 18, 2015 at 10:30 AM, Martin Jansa <span dir="ltr"><<a href="mailto:martin.jansa@gmail.com" target="_blank">martin.jansa@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On Fri, Sep 18, 2015 at 12:24:00PM -0400, Randy MacLeod wrote:<br>
> On 2015-09-07 11:14 AM, Martin Jansa wrote:<br>
> > Full jenkins build test takes over 3 days (depending on sstate reuse,<br>
> > one MACHINE can take more than 24 hours), so if I add them to<br>
> > master-next after it's merged to oe-core it will take 3-6 days to<br>
> > build-test them (6 days if they are sent just after current queue is<br>
> > sent for build).<br>
><br>
> Hi Martin,<br>
<br>
Hi Randy,<br>
<br>
> Replying privately but you can add the list back in your<br>
> reply if you like.<br>
<br>
OK, adding both MLs<br>
<br>
> I never build all of meta-oe but a day seems like a long time.<br>
> On a 3-4 year old 24 core system, with 64 GB RAM and<br>
> 2 large disks, I build oe-core + a whitelist of meta-oe + misc layers in<br>
> 5 hours using 18.3 of the 24 cores on average.<br>
> What are the specs of your build machine?<br>
<br>
It's one of VMs running on box donated by HP to webos-ports project. It<br>
has access to 8 E5-2630L 0 @ 2.00GHz cores (from IIRC 24) and slow IO<br>
which we try to compensate a bit by using tmpfs for TMPDIR, VM has 80G<br>
RAM, so I'm using 72G for tmpfs.<br>
<br>
Tom: please fill-in the gaps, I don't know any details about the real HW<br>
it's running on.<br>
<br>
The same machine is also running some webos-ports builds sometimes.<br>
<br>
BUT be aware that my world build is much bigger than what you're<br>
probably building and changes in oe-core almost always ensure very low<br>
sstate reuse.<br>
<br>
e.g. last build with only small oe-core upgrade since previous build:<br>
NOTE: Tasks Summary: Attempted 33283 tasks of which 5252 didn't need to be rerun and 33 failed.<br>
NOTE: Build completion summary:<br>
NOTE: do_populate_sysroot: 21% sstate reuse (485 setscene, 1750 scratch)<br>
NOTE: do_package_qa: 12% sstate reuse (262 setscene, 1760 scratch)<br>
NOTE: do_package: 4% sstate reuse (76 setscene, 1750 scratch)<br>
NOTE: do_packagedata: 13% sstate reuse (281 setscene, 1750 scratch)<br>
NOTE: do_package_write_ipk: 12% sstate reuse (262 setscene, 1756 scratch)<br>
NOTE: do_populate_lic: 22% sstate reuse (521 setscene, 1806 scratch)<br>
<br>
real 1485m40.070s<br>
user 4166m49.125s<br>
sys 2825m50.068s<br>
<br>
BTW: you can see all this information in the world logs I'm sending to MLs<br>
(but not all the builds make it to ML report).<br>
<br>
> A decent build box these days has 32+ cores, 64+ GB RAM and<br>
> and SSD or RAID disk filesystem. The costs of such a system<br>
> are significant but worth it given the number of people's time<br>
> involved in meta-oe.<br>
<br>
That's true, but I have to do with what I have available :).<br>
<br>
> Also, it would be nice if OE had a few such machines each<br>
> working on builds for a MACHINE to reduce your turn-around<br>
> to more like a day or so. :)<br>
<br>
Yes, it would be nice, I'm trying to get Tom King to set another VM like<br>
this in another location (another HP donated server), hopefully he will<br>
finish it soon.<br>
<br>
It's all hosted together with OE infrastructure, bandwidth is limited, but<br>
all I need for these builds is to fetch sources and upload the logs, there<br>
are no package feeds or sstate from these builds usable outside, but now it<br>
rsync the downloaded sources to <a href="http://sources.openembedded.org" rel="noreferrer" target="_blank">sources.openembedded.org</a><br>
<br>
If you know about some idling build servers, I would like to give them<br>
something to do :).<br>
<br>
Regards,<br>
<span class="HOEnZb"><font color="#888888"><br>
--<br>
Martin 'JaMa' Jansa jabber: <a href="mailto:Martin.Jansa@gmail.com">Martin.Jansa@gmail.com</a><br>
</font></span></blockquote></div><br></div>