<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#943634;
font-weight:normal;
font-style:normal;
text-decoration:none none;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="SV" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US">I’m seeing similar results with our builds (Poky + some layers from OpenEmbedded + our own layers; no hash equivalency). Here are some examples of builds from today (with
approximate timings added manually by me):<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US">Initialising tasks: 100% |#######################################| Time: 0:00:08<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US"><1 minute without any output><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US">Checking sstate mirror object availability: 100% |###############| Time: 0:00:23<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US">Sstate summary: Wanted 4151 Found 0 Missed 4151 Current 943 (0% match, 18% complete)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US">NOTE: Executing Tasks<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US"><3 minutes without any output><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US">NOTE: Setscene tasks completed<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US"><9 minutes without any output><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US">No currently running tasks (512 of 12540) 4% |# |<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US">After that I aborted the build and removed the tmp directory. The next build started without any of the above delays. However, the display of the then executed setscene
tasks by knotty is anything but useful now after the latest changes to bitbake (mostly showing nothing, and occasionally showing a few lines saying that it is running task 0 of 0 which are immediately removed again). Anyway, after that build had run for a
couple of thousand tasks it failed with a build error. When I had fixed that and started the build again, I got these timings:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US">Initialising tasks: 100% |#######################################| Time: 0:00:08<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US">Checking sstate mirror object availability: 100% |###############| Time: 0:00:18<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US"><1.5 minutes without any output><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US">Sstate summary: Wanted 3870 Found 1 Missed 3869 Current 1224 (0% match, 24% complete)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US">NOTE: Executing Tasks<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US"><2 minutes without any output><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US">NOTE: Setscene tasks completed<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US">That build eventually completed normally. Finally, when I started the build again to basically do nothing, I got this:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US">Initialising tasks: 100% |#######################################| Time: 0:00:08<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US"><3 minutes without any output><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US">NOTE: Executing Tasks<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:Consolas;color:#943634;mso-fareast-language:EN-US">NOTE: Setscene tasks completed<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US">Comparing that build to a corresponding do-nothing build with Thud, the time difference matches those three minutes where I have no idea what bitbake is doing now that
it didn’t need to do before…<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US">Hopefully these time degradations can be solved, because the current state of bitbake is barely usable. We also need to look into possible ways to improve the cooker output
when it is running the setscene tasks so it makes some kind of sense again.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US">//Peter<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#943634;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US">From:</span></b><span lang="EN-US"> openembedded-core-bounces@lists.openembedded.org <openembedded-core-bounces@lists.openembedded.org>
<b>On Behalf Of </b>Alexander Kanavin<br>
<b>Sent:</b> den 12 augusti 2019 21:50<br>
<b>To:</b> Khem Raj <raj.khem@gmail.com><br>
<b>Cc:</b> OE-core <openembedded-core@lists.openembedded.org><br>
<b>Subject:</b> Re: [OE-core] [PATCH 1/7] insane.bbclass: in file-rdeps do not look into RDEPENDS recursively<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Mon, 12 Aug 2019 at 21:01, Khem Raj <<a href="mailto:raj.khem@gmail.com">raj.khem@gmail.com</a>> wrote:<o:p></o:p></p>
</div>
<div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<p class="MsoNormal"><br>
Richard, another issue I saw was slowness in world builds when I had<br>
this enabled<br>
I was on master-next for both core and bitbake. It was spending a lot<br>
of time in ensuring<br>
the build is not needed so much that the build took almost same time<br>
than the build with<br>
out it where the build without it will build everything.<o:p></o:p></p>
</blockquote>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">world builds seem to have regressed (preparation time wise) even without having hash equivalency. Just oe-core is bearable, but adding meta-oe layers makes it spent many minutes after initializing tasks but before any tasks actually begin.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Alex<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</body>
</html>