[oe] [meta-networking][PATCH] geoip: add downloadfilename for geoip database files
Martin Jansa
martin.jansa at gmail.com
Fri Nov 30 08:22:17 UTC 2018
I think Khem meant http://sources.openembedded.org/ it returns 403, because
listing is disabled, but the files are there.
On Fri, Nov 30, 2018 at 3:18 AM Changqing Li <changqing.li at windriver.com>
wrote:
>
> On 11/29/18 9:55 AM, Khem Raj wrote:
>
> We have two options
>
> Download and rename may be add a date component and save it on
> sources.oe.org
>
> Hi, I cannot open this website
>
>
> Second option is to download the databases during build as temporary
> artifacts but this might cause reproducibility problems
>
> Either way it is going to have some issues
> May be option 1 even though tedious can be better of two
>
> On Wed, Nov 28, 2018 at 5:31 PM Changqing Li <changqing.li at windriver.com>
> wrote:
>
>> Khem and Marthin,
>>
>> The failure still caused by frequently changed checksum of the database.
>> I send the patch on 11.20.
>>
>> but the checksum changed on 1121, and it also changed on 1128, seems like
>> weekly change.
>>
>> but it should not failed if there is a premirror saved the
>>
>> Here is a result I get:
>>
>> $ md5sum 1128/*v6*
>> d98a04eded0b08b945b5629106d58760 1128/GeoIPv6 (1).dat.gz
>> 4d48c102ec68298b3fc7f57763455cb5 1128/GeoLiteCityv6.dat.gz
>> $ md5sum 1121/*v6*
>> b0f82334f94ca89872e7722db3511bb9 1121/GeoIPv6.dat.gz
>> 50ad18a8a3ea4bba7c929bea6e22db75 1121/GeoLiteCityv6.dat.gz
>> $ md5sum 1120/*v6*
>> a908d7a51c3883eb8f693ca197c7a142 1120/GeoIPv6.dat.gz
>> 8ac3506ccabaae7e9f7d6301c2654313 1120/GeoLiteCityv6.dat.gz
>>
>>
>> On 11/28/18 3:14 AM, Martin Jansa wrote:
>>
>> I'm seeing different checksum than both your builder and the recipe.
>>
>> $ wget http://geolite.maxmind.com/download/geoip/database/GeoIPv6.dat.gz
>> --2018-11-27 20:06:32--
>> http://geolite.maxmind.com/download/geoip/database/GeoIPv6.dat.gz
>> Resolving geolite.maxmind.com... 104.16.37.47, 104.16.38.47,
>> 2606:4700::6810:252f, ...
>> Connecting to geolite.maxmind.com|104.16.37.47|:80... connected.
>> HTTP request sent, awaiting response... 200 OK
>> Length: 1209046 (1.2M) [application/octet-stream]
>> Saving to: ‘GeoIPv6.dat.gz’
>>
>> 2018-11-27 20:06:32 (10.3 MB/s) - ‘GeoIPv6.dat.gz’ saved [1209046/1209046]
>>
>> $ md5sum GeoIPv6.dat.gz
>> d98a04eded0b08b945b5629106d58760 GeoIPv6.dat.gz
>>
>> Is this the legacy archive? Because
>> https://dev.maxmind.com/geoip/legacy/geolite/ now shows following:
>>
>> Yes, I have pointed out this problem the first time I changed the
>> checksum. maybe we should upgrade
>>
>> to geoip2, and drop current geoip1.6. but I think even with geoip2,
>> since it's database still not version,
>>
>> maybe also will met similar problem.
>>
>>
>> //changqing
>>
>>
>> Updated versions of the GeoLite Legacy databases are now only available
>> to redistribution license customers, although anyone can continue to
>> download the March 2018 GeoLite Legacy builds. Starting January 2, 2019,
>> the last build will be removed from our website. GeoLite Legacy database
>> users will need to switch to the GeoLite2 or commercial GeoIP databases and
>> update their integrations by January 2, 2019.
>>
>> For more information, please visit our Support Center.
>>
>> Note: After careful consideration, taking into account customer feedback,
>> we have decided against removing latitude and longitude coordinates from
>> the GeoLite2 databases. We are in the process of reviewing coordinates used
>> in all of our GeoLite2 and GeoIP databases to ensure there is no risk of
>> misuse.
>>
>> * GeoLite2 databases are free IP geolocation databases comparable to, but
>> less accurate than, MaxMind’s GeoIP2 databases. Please remember to use the
>> accuracy radius if displaying coordinates on a map.
>>
>> New Database Format Available: This page is for our GeoLite Legacy
>> databases. For our latest database format, please visit our GeoLite2
>> Databases page. We offer redistribution licenses for our newer GeoLite2
>> databases that will allow you to package the databases with your commercial
>> products. For more information, please visit the GeoLite2 Commercial
>> Redistribution page.
>>
>>
>> On Tue, Nov 27, 2018 at 8:04 PM Khem Raj <raj.khem at gmail.com> wrote:
>>
>>> I am seeing errors on some builders
>>>
>>> http://errors.yoctoproject.org/Errors/Details/202341/
>>> On Mon, Nov 19, 2018 at 11:29 PM Martin Jansa <martin.jansa at gmail.com>
>>> wrote:
>>> >
>>> > Looks, good.
>>> >
>>> > Adding variable for 20181120 might help with maintenance (if we need to
>>> > change just checksums in future). And with good variable name (or a
>>> > comment) it would also document in the recipe why we're using this in
>>> > downloadfilename.
>>> >
>>> > On Tue, Nov 20, 2018 at 7:48 AM <changqing.li at windriver.com> wrote:
>>> >
>>> > > From: Changqing Li <changqing.li at windriver.com>
>>> > >
>>> > > previous change of checksum don't trigger archive to re-downloaded,
>>> > > , which will cause checksum mismatch. add downloadfilename to
>>> > > trigger re-download.
>>> > >
>>> > > 1. for user with PREMIRROR, another benefit is it can still compile
>>> > > success event upstream checksum change frequently.
>>> > > 2. but for user don't use PREMIRROR, if upstream checksum changed,
>>> > > still might have checksum mismatch problem.
>>> > >
>>> > > Signed-off-by: Changqing Li <changqing.li at windriver.com>
>>> > > ---
>>> > > .../recipes-support/geoip/geoip_1.6.12.bb | 24
>>> > > +++++++++++-----------
>>> > > 1 file changed, 12 insertions(+), 12 deletions(-)
>>> > >
>>> > > diff --git a/meta-networking/recipes-support/geoip/geoip_1.6.12.bb
>>> > > b/meta-networking/recipes-support/geoip/geoip_1.6.12.bb
>>> > > index 1e1a7ff..57f0b67 100644
>>> > > --- a/meta-networking/recipes-support/geoip/geoip_1.6.12.bb
>>> > > +++ b/meta-networking/recipes-support/geoip/geoip_1.6.12.bb
>>> > > @@ -9,10 +9,10 @@ HOMEPAGE = "http://dev.maxmind.com/geoip/"
>>> > > SECTION = "libdevel"
>>> > >
>>> > > SRC_URI = "git://github.com/maxmind/geoip-api-c.git \
>>> > > -
>>> > >
>>> http://geolite.maxmind.com/download/geoip/database/GeoLiteCountry/GeoIP.dat.gz;apply=no;name=GeoIP-dat
>>> > > \
>>> > > -
>>> > >
>>> http://geolite.maxmind.com/download/geoip/database/GeoIPv6.dat.gz;apply=no;name=GeoIPv6-dat
>>> > > \
>>> > > -
>>> > >
>>> http://geolite.maxmind.com/download/geoip/database/GeoLiteCity.dat.gz;apply=no;name=GeoLiteCity-dat
>>> > > \
>>> > > -
>>> > >
>>> http://geolite.maxmind.com/download/geoip/database/GeoLiteCityv6-beta/GeoLiteCityv6.dat.gz;apply=no;name=GeoLiteCityv6-dat
>>> > > \
>>> > > +
>>> > >
>>> http://geolite.maxmind.com/download/geoip/database/GeoLiteCountry/GeoIP.dat.gz;apply=no;name=GeoIP-dat;downloadfilename=GeoIP.dat.20181120.gz
>>> > > \
>>> > > +
>>> > >
>>> http://geolite.maxmind.com/download/geoip/database/GeoIPv6.dat.gz;apply=no;name=GeoIPv6-dat;downloadfilename=GeoIPv6.dat.20181120.gz
>>> > > \
>>> > > +
>>> > >
>>> http://geolite.maxmind.com/download/geoip/database/GeoLiteCity.dat.gz;apply=no;name=GeoLiteCity-dat;downloadfilename=GeoLiteCity.dat.20181120.gz
>>> > > \
>>> > > +
>>> > >
>>> http://geolite.maxmind.com/download/geoip/database/GeoLiteCityv6-beta/GeoLiteCityv6.dat.gz;apply=no;name=GeoLiteCityv6-dat;downloadfilename=GeoLiteCityv6.dat.20181120.gz
>>> > > \
>>> > > file://run-ptest \
>>> > > "
>>> > > SRCREV = "4b526e7331ca1d692b74a0509ddcc725622ed31a"
>>> > > @@ -20,14 +20,14 @@ SRCREV =
>>> "4b526e7331ca1d692b74a0509ddcc725622ed31a"
>>> > > SRC_URI[GeoIP-dat.md5sum] = "d538e57ad9268fdc7955c6cf9a37c4a9"
>>> > > SRC_URI[GeoIP-dat.sha256sum] =
>>> > > "b9c05eb8bfcf90a6ddfdc6815caf40a8db2710f0ce3dd48fbd6c24d485ae0449"
>>> > >
>>> > > -SRC_URI[GeoIPv6-dat.md5sum] = "00dc3b3f53eb5f7bf6915f939998f12c"
>>> > > -SRC_URI[GeoIPv6-dat.sha256sum] =
>>> > > "e72221fc630094d7256521b307e9142fb77d2167a27de2c11da536a2ba1d1480"
>>> > > +SRC_URI[GeoIPv6-dat.md5sum] = "a908d7a51c3883eb8f693ca197c7a142"
>>> > > +SRC_URI[GeoIPv6-dat.sha256sum] =
>>> > > "1b06e34eed2c539606a9ab4d97b2140ac80bf9f528d16ad2e3831c75014c2710"
>>> > >
>>> > > SRC_URI[GeoLiteCity-dat.md5sum] = "d700c137232f8e077ac8db8577f699d9"
>>> > > SRC_URI[GeoLiteCity-dat.sha256sum] =
>>> > > "90db2e52195e3d1bcdb2c2789209006d09de5c742812dbd9a1b36c12675ec4cd"
>>> > >
>>> > > -SRC_URI[GeoLiteCityv6-dat.md5sum] =
>>> "7f6333d433d8127181ea3c5828287c98"
>>> > > -SRC_URI[GeoLiteCityv6-dat.sha256sum] =
>>> > > "c339e20cdf326c18aa3571bcd27845e6daf41ca5bfe9401bc472908aaeb42ac7"
>>> > > +SRC_URI[GeoLiteCityv6-dat.md5sum] =
>>> "8ac3506ccabaae7e9f7d6301c2654313"
>>> > > +SRC_URI[GeoLiteCityv6-dat.sha256sum] =
>>> > > "1c5fced1657d09448b3ecc14b65c9536228a627d93ed4159d3438b2c6faa8506"
>>> > >
>>> > > LICENSE = "LGPL-2.1"
>>> > >
>>> > > @@ -44,10 +44,10 @@ EXTRA_OECONF = "--disable-static \
>>> > > do_install() {
>>> > > make DESTDIR=${D} install
>>> > > install -d ${D}/${datadir}/GeoIP
>>> > > - install ${WORKDIR}/GeoIP.dat ${D}/${datadir}/GeoIP/
>>> > > - install ${WORKDIR}/GeoIPv6.dat ${D}/${datadir}/GeoIP/
>>> > > - install ${WORKDIR}/GeoLiteCity.dat ${D}/${datadir}/GeoIP/
>>> > > - install ${WORKDIR}/GeoLiteCityv6.dat ${D}/${datadir}/GeoIP/
>>> > > + install ${WORKDIR}/GeoIP.dat.20181120
>>> ${D}/${datadir}/GeoIP/GeoIP.dat
>>> > > + install ${WORKDIR}/GeoIPv6.dat.20181120
>>> > > ${D}/${datadir}/GeoIP/GeoIPv6.dat
>>> > > + install ${WORKDIR}/GeoLiteCity.dat.20181120
>>> > > ${D}/${datadir}/GeoIP/GeoLiteCity.dat
>>> > > + install ${WORKDIR}/GeoLiteCityv6.dat.20181120
>>> > > ${D}/${datadir}/GeoIP/GeoLiteCityv6.dat
>>> > > ln -s GeoLiteCity.dat ${D}${datadir}/GeoIP/GeoIPCity.dat
>>> > > }
>>> > >
>>> > > --
>>> > > 2.7.4
>>> > >
>>> > > --
>>> > > _______________________________________________
>>> > > Openembedded-devel mailing list
>>> > > Openembedded-devel at lists.openembedded.org
>>> > > http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>>> > >
>>> > --
>>> > _______________________________________________
>>> > Openembedded-devel mailing list
>>> > Openembedded-devel at lists.openembedded.org
>>> > http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>>>
>> --
>> BRs
>>
>> Sandy(Li Changqing)
>>
>> --
> BRs
>
> Sandy(Li Changqing)
>
>
More information about the Openembedded-devel
mailing list