<div dir="ltr">Right; I got enough context from your copied/pasted failure report to duplicate it. I'm just wondering if there are other test batteries besides bitbake-selftest and oe-selftest that are gates to clear?<div><br></div><div>-Matt<br><div class="gmail_extra"><br><div class="gmail_quote">On Thu, May 17, 2018 at 11:28 AM, Burton, Ross <span dir="ltr"><<a href="mailto:ross.burton@intel.com" target="_blank">ross.burton@intel.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Matt,<br>
<br>
If you run oe-selftest -r devtool then it will run the tests which are failing.<br>
<span class="HOEnZb"><font color="#888888"><br>
Ross<br>
</font></span><div class="HOEnZb"><div class="h5"><br>
On 14 May 2018 at 22:59, Matt Hoosier <<a href="mailto:matt.hoosier@gmail.com">matt.hoosier@gmail.com</a>> wrote:<br>
> On Mon, May 14, 2018, 15:06 Burton, Ross <<a href="mailto:ross.burton@intel.com">ross.burton@intel.com</a>> wrote:<br>
>><br>
>> Sorry, but:<br>
>><br>
>> 2018-05-14 18:57:44,968 - oe-selftest - INFO - FAIL:<br>
>> test_devtool_add_fetch_git (devtool.DevtoolTests)<br>
>> 2018-05-14 18:57:44,968 - oe-selftest - INFO -<br>
>> ------------------------------<wbr>------------------------------<wbr>----------<br>
>> 2018-05-14 18:57:44,968 - oe-selftest - INFO - Traceback (most recent<br>
>> call last):<br>
>> File<br>
>> "/home/pokybuild/yocto-<wbr>autobuilder/yocto-worker/<wbr>nightly-oe-selftest/build/<wbr>meta/lib/oeqa/core/decorator/_<wbr>_init__.py",<br>
>> line 32, in wrapped_f<br>
>> return func(*args, **kwargs)<br>
>> File<br>
>> "/home/pokybuild/yocto-<wbr>autobuilder/yocto-worker/<wbr>nightly-oe-selftest/build/<wbr>meta/lib/oeqa/selftest/cases/<wbr>devtool.py",<br>
>> line 403, in test_devtool_add_fetch_git<br>
>> result = runCmd('devtool add %s %s -f "%s" -V 1.5' % (testrecipe,<br>
>> srcdir, url_rev))<br>
>> File<br>
>> "/home/pokybuild/yocto-<wbr>autobuilder/yocto-worker/<wbr>nightly-oe-selftest/build/<wbr>meta/lib/oeqa/utils/commands.<wbr>py",<br>
>> line 191, in runCmd<br>
>> raise AssertionError("Command '%s' returned non-zero exit status<br>
>> %d:\n%s" % (command, result.status, exc_output))<br>
>> AssertionError: Command 'devtool add mraa /tmp/devtoolqa0aghorcw/mraa<br>
>> -f<br>
>> "gitsm://<a href="http://git.yoctoproject.org/mraa;rev=ae127b19a50aa54255e4330ccfdd9a5d058e581d" rel="noreferrer" target="_blank">git.yoctoproject.org/<wbr>mraa;rev=<wbr>ae127b19a50aa54255e4330ccfdd9a<wbr>5d058e581d</a>"<br>
>> -V 1.5' returned non-zero exit status 1:<br>
>> ...<br>
>><br>
>> ERROR: Fetcher failure: Fetch command export PSEUDO_DISABLED=1; export<br>
>><br>
>> PATH="/home/pokybuild/yocto-<wbr>autobuilder/yocto-worker/<wbr>nightly-oe-selftest/build/<wbr>build/tmp/sysroots-uninative/<wbr>x86_64-linux/usr/bin:/home/<wbr>pokybuild/yocto-autobuilder/<wbr>yocto-worker/nightly-oe-<wbr>selftest/build/scripts:/home/<wbr>pokybuild/yocto-autobuilder/<wbr>yocto-worker/nightly-oe-<wbr>selftest/build/build/tmp/work/<wbr>recipetool-utucnynk/work/<wbr>recipe-sysroot-native/usr/bin/<wbr>x86_64-poky-linux:/home/<wbr>pokybuild/yocto-autobuilder/<wbr>yocto-worker/nightly-oe-<wbr>selftest/build/build/tmp/work/<wbr>recipetool-utucnynk/work/<wbr>recipe-sysroot/usr/bin/<wbr>crossscripts:/home/pokybuild/<wbr>yocto-autobuilder/yocto-<wbr>worker/nightly-oe-selftest/<wbr>build/build/tmp/work/<wbr>recipetool-utucnynk/work/<wbr>recipe-sysroot-native/usr/<wbr>sbin:/home/pokybuild/yocto-<wbr>autobuilder/yocto-worker/<wbr>nightly-oe-selftest/build/<wbr>build/tmp/work/recipetool-<wbr>utucnynk/work/recipe-sysroot-<wbr>native/usr/bin:/home/<wbr>pokybuild/yocto-autobuilder/<wbr>yocto-worker/nightly-oe-<wbr>selftest/build/build/tmp/work/<wbr>recipetool-utucnynk/work/<wbr>recipe-sysroot-native/sbin:/<wbr>home/pokybuild/yocto-<wbr>autobuilder/yocto-worker/<wbr>nightly-oe-selftest/build/<wbr>build/tmp/work/recipetool-<wbr>utucnynk/work/recipe-sysroot-<wbr>native/bin:/home/pokybuild/<wbr>yocto-autobuilder/yocto-<wbr>worker/nightly-oe-selftest/<wbr>build/bitbake/bin:/home/<wbr>pokybuild/yocto-autobuilder/<wbr>yocto-worker/nightly-oe-<wbr>selftest/build/build/tmp/<wbr>hosttools";<br>
>> export HOME="/home/pokybuild"; git -c core.fsyncobjectfiles=0<br>
>> submodule update --init --recursive --no-fetch failed with exit code<br>
>> 1, output:<br>
>> Submodule 'doxygen2jsdoc'<br>
>> (<a href="https://github.com/arfoll/doxygen2jsdoc.git" rel="noreferrer" target="_blank">https://github.com/arfoll/<wbr>doxygen2jsdoc.git</a>) registered for path<br>
>> 'doxygen2jsdoc'<br>
>> fatal: reference is not a tree: 9cc90b7976252b2d14b7956230c587<wbr>0097e1f008<br>
>> Unable to checkout '<wbr>9cc90b7976252b2d14b7956230c587<wbr>0097e1f008' in<br>
>> submodule path 'doxygen2jsdoc'<br>
>><br>
>> Ross<br>
>><br>
>> On 14 May 2018 at 19:50, Matt Hoosier <<a href="mailto:matt.hoosier@gmail.com">matt.hoosier@gmail.com</a>> wrote:<br>
>> > Although the submodules' histories have been fetched during the<br>
>> > do_fetch() phase, the mechanics used to clone the workdir copy<br>
>> > of the repo haven't been transferring the actual .git/modules<br>
>> > directory from the repo fetched into downloads/ during the<br>
>> > fetch task.<br>
>> ><br>
>> > Fix that, and for good measure also explicitly tell Git to avoid<br>
>> > hitting the network during do_unpack() of the submodules.<br>
>> ><br>
>> > [YOCTO #12739]<br>
>> ><br>
>> > Signed-off-by: Matt Hoosier <<a href="mailto:matt.hoosier@gmail.com">matt.hoosier@gmail.com</a>><br>
>> > ---<br>
>> > lib/bb/fetch2/gitsm.py | 28 +++++++++++++++++++++++++++-<br>
>> > 1 file changed, 27 insertions(+), 1 deletion(-)<br>
>> ><br>
>> > diff --git a/lib/bb/fetch2/gitsm.py b/lib/bb/fetch2/gitsm.py<br>
>> > index 0aff1008..c5019e98 100644<br>
>> > --- a/lib/bb/fetch2/gitsm.py<br>
>> > +++ b/lib/bb/fetch2/gitsm.py<br>
>> > @@ -132,4 +132,30 @@ class GitSM(Git):<br>
>> ><br>
>> > if self.uses_submodules(ud, d, ud.destdir):<br>
>> > runfetchcmd(ud.basecmd + " checkout " +<br>
>> > ud.revisions[ud.names[0]], d, workdir=ud.destdir)<br>
>> > - runfetchcmd(ud.basecmd + " submodule update --init<br>
>> > --recursive", d, workdir=ud.destdir)<br>
>> > +<br>
>> > + updateflags = ""<br>
>> > +<br>
>> > + # Copy over the submodules' fetched histories too.<br>
>> > + if ud.bareclone:<br>
>> > + repo_conf = ud.destdir<br>
>> > + else:<br>
>> > + repo_conf = os.path.join(ud.destdir, '.git')<br>
>> > +<br>
>> > + if os.path.exists(ud.clonedir):<br>
>> > + # This is not a copy unpacked from a shallow mirror<br>
>> > clone. So<br>
>> > + # the manual intervention to populate the .git/modules<br>
>> > done<br>
>> > + # in clone_shallow_local() won't have been done yet.<br>
>> > + runfetchcmd("cp -fpPRH %s %s" %<br>
>> > (os.path.join(ud.clonedir, 'modules'), repo_conf), d)<br>
>> > + updateflags += " --no-fetch"<br>
>> > + elif os.path.exists(os.path.join(<wbr>repo_conf, 'modules')):<br>
>> > + # Unpacked from a shallow mirror clone. Manual<br>
>> > population of<br>
>> > + # .git/modules is already done.<br>
>> > + updateflags += " --no-fetch"<br>
>> > + else:<br>
>> > + # This isn't fatal; git-submodule will just fetch it<br>
>> > + # during do_unpack().<br>
>> > + bb.error("submodule history not retrieved during<br>
>> > do_fetch()")<br>
>> > +<br>
>> > + # Careful not to hit the network during unpacking; all<br>
>> > history should already<br>
>> > + # be fetched.<br>
>> > + runfetchcmd(ud.basecmd + " submodule update --init<br>
>> > --recursive %s" % updateflags, d, workdir=ud.destdir)<br>
>> > --<br>
>> > 2.13.6<br>
>> ><br>
>> > --<br>
>> > ______________________________<wbr>_________________<br>
>> > bitbake-devel mailing list<br>
>> > <a href="mailto:bitbake-devel@lists.openembedded.org">bitbake-devel@lists.<wbr>openembedded.org</a><br>
>> > <a href="http://lists.openembedded.org/mailman/listinfo/bitbake-devel" rel="noreferrer" target="_blank">http://lists.openembedded.org/<wbr>mailman/listinfo/bitbake-devel</a><br>
><br>
><br>
> Okay, I'll have a look at that. Are there any other test suites I should<br>
> know about?<br>
>><br>
>><br>
><br>
</div></div></blockquote></div><br></div></div></div>