[oe] [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org

akuster808 akuster808 at gmail.com
Wed Nov 14 16:18:54 UTC 2018 

On 11/14/18 7:17 AM, Martin Jansa wrote:
> On Tue, Nov 13, 2018 at 03:27:39PM -0800, akuster808 wrote:
>> On 11/13/18 2:55 PM, Martin Jansa wrote:
>>> Is this the right URL? http://sources.openembedded.org/mirror/sources/
>>> returns 404
>> I thought it was.
>>
>> I get 404 with http://sources.openembedded.org/
>> <http://sources.openembedded.org/mirror/sources/>
> This link is http://sources.openembedded.org/mirror/sources/, that's why
> it's 404, with http://sources.openembedded.org/ you get 403, which is
> fine.
>>> meta/classes/mirrors.bbclass also uses:
>>> cvs://.*/.*     http://sources.openembedded.org/ \n \
>>> svn://.*/.*     http://sources.openembedded.org/ \n \
>>> git://.*/.*     http://sources.openembedded.org/ \n \
>>> hg://.*/.*      http://sources.openembedded.org/ \n \
>>> bzr://.*/.*     http://sources.openembedded.org/ \n \
>>> p4://.*/.*      http://sources.openembedded.org/ \n \
>>> osc://.*/.*     http://sources.openembedded.org/ \n \
>>> https?$://.*/.* http://sources.openembedded.org/ \n \
>>> ftp://.*/.*     http://sources.openembedded.org/ \n \
>>> npm://.*/?.*    http://sources.openembedded.org/ \n \
>>>
>> I will change the URL's. thanks.
>>> without the /mirror/sources suffix, maybe it's copy & paste issue from
>>> downloads.yoctoproject.org <http://downloads.yoctoproject.org> which
>>> uses /mirror/sources?
>>> git://.*/.*     http://downloads.yoctoproject.org/mirror/sources/ \n \
>>>
>>> But if the test works for you, then something even worse is going on :).
>>
>> it found:
>>
>> Summary: 5 tasks failed:
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch
>>
>> with url changes i see:
>>
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/elfutils/elfutils_0.174.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-extended/libarchive/libarchive_3.3.3.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-support/mpfr/mpfr_4.0.1.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch
>>
>> maybe the OE system needs to be checked out.
> I've checked it yesterday and it's broken since Aug 6.
>
> See IRC log from earlier today:
> 00:14 < armpit> sources.openembedded.org needs updating ; )
> 00:17 < JaMa> armpit: khem: the builder lost access to the fileserver as shown in
> http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/475/console
> 00:18 < JaMa> something changed between Aug 6th and 9th
>

/I think Khem is looking into it./

/Looks like the selftest has a use./

/- armin/

>>
>> - armin
>>
>>> On Tue, Nov 13, 2018 at 11:40 PM Armin Kuster <akuster808 at gmail.com
>>> <mailto:akuster808 at gmail.com>> wrote:
>>>
>>>     Signed-off-by: Armin Kuster <akuster808 at gmail.com
>>>     <mailto:akuster808 at gmail.com>>
>>>     ---
>>>      meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py | 30
>>>     ++++++++++++++++++++++
>>>      1 file changed, 30 insertions(+)
>>>      create mode 100644 meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>>>
>>>     diff --git a/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>>>     b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>>>     new file mode 100644
>>>     index 0000000..79bebf5
>>>     --- /dev/null
>>>     +++ b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>>>     @@ -0,0 +1,30 @@
>>>     +import os
>>>     +import re
>>>     +import glob as g
>>>     +import shutil
>>>     +import tempfile
>>>     +from oeqa.selftest.case import OESelftestTestCase
>>>     +from oeqa.utils.commands import runCmd, bitbake, get_bb_var,
>>>     get_bb_vars
>>>     +
>>>     +class MetaOESourceMirroring(OESelftestTestCase):
>>>     +    # Can we download everything from the OpenEmbedded Sources
>>>     Mirror over http only
>>>     +    def test_oe_source_mirror(self):
>>>     +        self.write_config("""
>>>     +BB_ALLOWED_NETWORKS = " sources.openembedded.org
>>>     <http://sources.openembedded.org>"
>>>     +MIRRORS = ""
>>>     +DL_DIR = "${TMPDIR}/test_oe_downloads"
>>>     +PREMIRRORS = "\\
>>>     +    bzr://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    cvs://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    git://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    gitsm://.*/.* http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    hg://.*/.*    http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    osc://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    p4://.*/.*    http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    svn://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    ftp://.*/.*     
>>>     http://sources.openembedded.org/mirror/sources/ \\n \\
>>>     +    http://.*/.*   
>>>      http://sources.openembedded.org/mirror/sources/ \\n \\
>>>     +    https://.*/.*   
>>>     http://sources.openembedded.org/mirror/sources/ \\n"
>>>     +    """)
>>>     +
>>>     +        bitbake("world --runall fetch")
>>>     -- 
>>>     2.7.4
>>>
>>>     -- 
>>>     _______________________________________________
>>>     Openembedded-devel mailing list
>>>     Openembedded-devel at lists.openembedded.org
>>>     <mailto:Openembedded-devel at lists.openembedded.org>
>>>     http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>>>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 819 bytes
Desc: OpenPGP digital signature
URL: <http://lists.openembedded.org/pipermail/openembedded-devel/attachments/20181114/971d7900/attachment.sig>

More information about the Openembedded-devel mailing list