[OE-core] [PATCH 00/36] OEQA threading support and selftest migration

[Aníbal Limón]

On 05/29/2017 09:08 AM, Leonardo Sandoval wrote:
> On Mon, 2017-05-29 at 14:19 +0100, Richard Purdie wrote:
>> On Mon, 2017-05-29 at 08:15 -0500, Leonardo Sandoval wrote:
>>> On Sat, 2017-05-27 at 00:32 +0100, Richard Purdie wrote:
>>>>
>>>> On Fri, 2017-05-26 at 15:37 -0500, Aníbal Limón wrote:
>>>>>
>>>>> This series is the integration of tree main changes into the OEQA
>>>>> module,
>>>>>
>>>>> * Implement threading support into OEQA core module
>>>>> * Enables OEQA threaded mode into {,e}SDK test component
>>>>> * Migrate current oe-selftest to use the same framework
>>>> I tried this on the autobuilder:
>>>>
>>>> https://autobuilder.yoctoproject.org/main/builders/nightly-oe-selft
>>>> est/
>>>> builds/901/steps/Running%20oe-selftest/logs/stdio
>>>>
>>>> It was fast, the oe-selftest run which usually takes several hours
>>>> took
>>>> 30 mins. The above logs suggest we might have a coverage issue
>>>> though.
>>> BTW, the new OE/QA threading support does not support (yet, Anibal is
>>> planning to work on it) the selftest test cases (because only one
>>> bitbake instance can be running at a time) so we should see similar
>>> times as before with this migration. So, those 30 minutes just comes
>>> from executing a subset, so something may be wrong in the series.
>>
>> The above was British understatement ;-).
>>
>> If you look at the log it went from 200+ tests to executing just one.
>> There is something *very* wrong with the series.

I executed the branch into the local AB and everything goes well, see
attached log.

May be was an integration issue because we have two patches for migrate
test cases, one for oe-core and other for meta-yocto-bsp. [1]. I
re-launched the build into the local AB to test again and see what happens.

[1]
http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/log/?h=alimon/oeqa_integration

Cheers,
	Anibal

> 
> I rebased Anibal's series on top of current master and executed
> oe-selftest -a at my host, and tests are added correctly and start
> executing as expected, so there may be something going on on the AB.
> Also several local AB builds were launched prior sending the series into
> the mailing list and no errors were seen. Will work on this to figure
> out the root cause.
> 
> Leo
> 
> 
>>
>> I have Anibal's piece of the series queued in -next and may merge that
>> ahead of the selftest pieces whilst you figure out the issue there.
>>
>> Cheers,
>>
>> Richard
> 
> 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: oeqa_integration_ab.log
Type: text/x-log
Size: 163970 bytes
Desc: not available
URL: <http://lists.openembedded.org/pipermail/openembedded-core/attachments/20170529/1e64466a/attachment-0002.bin>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 819 bytes
Desc: OpenPGP digital signature
URL: <http://lists.openembedded.org/pipermail/openembedded-core/attachments/20170529/1e64466a/attachment-0002.sig>