[OE-core] [oe-commits] Bruce Ashfield : kern-tools: improve patch application performance

Martin Jansa martin.jansa at gmail.com
Wed Mar 4 08:45:16 UTC 2015 

On Tue, Mar 03, 2015 at 10:40:45PM -0500, Bruce Ashfield wrote:
> On 2015-03-03 9:23 PM, Martin Jansa wrote:
> > On Mon, Mar 02, 2015 at 10:05:50PM +0000, git at git.openembedded.org wrote:
> >> Module: openembedded-core.git
> >> Branch: master
> >> Commit: 148c78e0f5de2689de3ad9beaa9f6de618d87758
> >> URL:    http://git.openembedded.org/?p=openembedded-core.git&a=commit;h=148c78e0f5de2689de3ad9beaa9f6de618d87758
> >>
> >> Author: Bruce Ashfield <bruce.ashfield at windriver.com>
> >> Date:   Mon Mar  2 16:36:41 2015 -0500
> >>
> >> kern-tools: improve patch application performance
> >>
> >> Update the SRCREV for the following incremental improvement in patch
> >> processing time:
> >>
> >>      kgit-meta: skip patches on non-leaf nodes
> >>
> >>      In a similar way as commit 0768d697 [kgit-meta: dont run kgit-s2q
> >>      for
> >>      non-leaf nodes], we can save even more processing time by not even
> >>      analysing and linking patches if we aren't on the leaf node of the
> >>      tree.
> >>
> >>      This early exit can save nearly 95% of the time required to "patch"
> >>      a tree when no changes are actually applied.
> >>
> >> Signed-off-by: Bruce Ashfield <bruce.ashfield at windriver.com>
> >> Signed-off-by: Richard Purdie <richard.purdie at linuxfoundation.org>
> >
> > Not sure if it's related to this, but today's world build is failing
> > with:
> >
> 
> No luck here. I was able to do a clean build of qemux86 against the 3.19
> kernel.
> 
> I'll keep trying, but am looking for a reproducer at this point.

with qemux86-64 it failed a bit later:
|   CC      drivers/gpu/drm/i915/i915_suspend.o
|   LD      drivers/gpu/drm/panel/built-in.o
|   CC      lib/earlycpio.o
| In file included from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/uapi/linux/ethtool.h:17:0,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/ethtool.h:16,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/netdevice.h:43,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/net/inet_sock.h:24,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/net/inet_connection_sock.h:23,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/net/ipv4/inet_connection_sock.c:19:
| /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/if_ether.h:24:33: fatal error: uapi/linux/if_ether.h: No such file or directory
|  #include <uapi/linux/if_ether.h>
|                                  ^
| In file included from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/arch/x86/include/uapi/asm/bootparam.h:32:0,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/arch/x86/include/asm/x86_init.h:5,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/arch/x86/include/asm/mpspec.h:6,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/arch/x86/include/asm/smp.h:11,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/smp.h:59,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/topology.h:33,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/gfp.h:8,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/slab.h:14,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/net/ipv6/addrlabel.c:16:
| /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/screen_info.h:4:36: fatal error: uapi/linux/screen_info.h: No such file or directory
|  #include <uapi/linux/screen_info.h>
|                                     ^
| compilation terminated.
| In file included from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/spinlock.h:287:0,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/rcupdate.h:38,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/idr.h:18,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/kernfs.h:14,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/sysfs.h:15,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/kobject.h:21,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/cdev.h:4,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/drm/drmP.h:36,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/drivers/gpu/drm/i915/i915_suspend.c:27:
| /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/spinlock_api_smp.h:190:34: fatal error: linux/rwlock_api_smp.h: No such file or directory
| compilation terminated.
| In file included from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/lib/earlycpio.c:28:0:
| /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/earlycpio.h:4:25: fatal error: linux/types.h: No such file or directory
|  #include <linux/types.h>
|                          ^
| compilation terminated.
| In file included from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/uapi/linux/timex.h:56:0,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/timex.h:56,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/sched.h:19,
|                  from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/lib/dump_stack.c:8:
| /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/time.h:7:27: fatal error: linux/time64.h: No such file or directory
| compilation terminated.
| compilation terminated.
| In file included from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/fs/nfs/super.c:33:0:
| /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/sunrpc/clnt.h:23:32: fatal error: linux/sunrpc/timer.h: No such file or directory
| compilation terminated.
| make[3]: *** [lib/earlycpio.o] Error 1
| make[3]: *** Waiting for unfinished jobs....
| make[6]: *** [drivers/gpu/drm/i915/i915_suspend.o] Error 1
| make[5]: *** [drivers/gpu/drm/i915] Error 2
| make[4]: *** No rule to make target `net/ipv6/ip6_fib.o', needed by `net/ipv6/ipv6.o'.  Stop.
| make[4]: *** Waiting for unfinished jobs....
|   CC      net/ipv6/route.o
| make[4]: *** [drivers/gpu/drm] Error 2
| make[3]: *** [lib/dump_stack.o] Error 1
| make[3]: *** [drivers/gpu] Error 2
| make[3]: *** Waiting for unfinished jobs....
| make[4]: *** [net/ipv4/inet_connection_sock.o] Error 1
| make[2]: *** [lib] Error 2
| make[2]: *** Waiting for unfinished jobs....
| make[4]: *** [net/ipv6/addrlabel.o] Error 1
| make[4]: *** [fs/nfs/super.o] Error 1
| make[3]: *** [net/ipv4] Error 2
| make[3]: *** Waiting for unfinished jobs....
| make[4]: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build: No such file or directory
| make[4]: *** No rule to make target `/home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build'.  Stop.
| make[5]: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build: No such file or directory
| make[5]: *** No rule to make target `/home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build'.  Stop.
| x86_64-oe-linux-gcc: error: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/net/ipv6/route.c: No such file or directory
| make[3]: *** [fs/nfs] Error 2
| make[3]: *** Waiting for unfinished jobs....
| make[3]: *** [net/mac80211] Error 2
| make[4]: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build: No such file or directory
| make[4]: *** No rule to make target `/home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build'.  Stop.
| x86_64-oe-linux-gcc: fatal error: no input files
| compilation terminated.
| make[5]: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build: No such file or directory
| make[5]: *** No rule to make target `/home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build'.  Stop.
| make[3]: *** [fs/notify] Error 2
| make[5]: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build: No such file or directory
| make[5]: *** No rule to make target `/home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build'.  Stop.
| make[4]: *** [drivers/i2c/algos] Error 2
| make[4]: *** Waiting for unfinished jobs....
| make[4]: *** [drivers/i2c/busses] Error 2
| make[4]: *** [net/ipv6/route.o] Error 1
| make[3]: *** [net/ipv6] Error 2
| make[4]: *** [drivers/i2c/muxes] Error 2
| make[2]: *** [net] Error 2
| fixdep: error opening config file: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/fs/nls/nls_iso8859-1.c: No such file or directory
| make[4]: *** [fs/nls/nls_iso8859-1.o] Error 2
| make[3]: *** [fs/nls] Error 2
| make[2]: *** [fs] Error 2
| fixdep: error opening config file: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/drivers/i2c/i2c-core.c: No such file or directory
| make[4]: *** [drivers/i2c/i2c-core.o] Error 2
| make[3]: *** [drivers/i2c] Error 2
| make[2]: *** [drivers] Error 2
| make[1]: *** [sub-make] Error 2
| make: *** [__sub-make] Error 2
| ERROR: oe_runmake failed
| WARNING: exit code 1 from a shell command.
| ERROR: Function failed: do_compile (log file is located at /home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86_64-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/temp/log.do_compile.30660)
NOTE: recipe linux-yocto-3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0: task do_compile: Failed

> > ERROR: Function failed: do_kernel_configme (log file is located at /home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/temp/log.do_kernel_configme.29401)
> > ERROR: Logfile of failure stored in: /home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/temp/log.do_kernel_configme.29401
> > Log data follows:
> > | DEBUG: Executing shell function do_kernel_configme
> > | NOTE: kernel configme
> > | [INFO] Configuring target/machine combo: "standard/qemux86"
> > | [INFO] collecting configs in .meta/meta-series
> > | mv: cannot move `/home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/linux-qemux86-standard-build/.tmp.config.PKIfLNkSVj' to `.meta/cfg/standard/common-pc/qemux86-standard-config-3.19': No such file or directory
> > | creation of pre-processed config data failed
> > | config of "standard/qemux86" failed
> > | WARNING: exit code 1 from a shell command.
> > | ERROR: Function failed: do_kernel_configme (log file is located at /home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/temp/log.do_kernel_configme.29401)
> > NOTE: recipe linux-yocto-3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0: task do_kernel_configme: Failed
> > ERROR: Task 30091 (/home/jenkins/oe/world/shr-core/openembedded-core/meta/recipes-kernel/linux/linux-yocto_3.19.bb, do_kernel_configme) failed with exit code '1'
> >
> >>
> >> ---
> >>
> >>   meta/recipes-kernel/kern-tools/kern-tools-native_git.bb | 2 +-
> >>   1 file changed, 1 insertion(+), 1 deletion(-)
> >>
> >> diff --git a/meta/recipes-kernel/kern-tools/kern-tools-native_git.bb b/meta/recipes-kernel/kern-tools/kern-tools-native_git.bb
> >> index 80d26f9..131c5e9 100644
> >> --- a/meta/recipes-kernel/kern-tools/kern-tools-native_git.bb
> >> +++ b/meta/recipes-kernel/kern-tools/kern-tools-native_git.bb
> >> @@ -4,7 +4,7 @@ LIC_FILES_CHKSUM = "file://git/tools/kgit;beginline=5;endline=9;md5=d8d1d729a70c
> >>
> >>   DEPENDS = "git-native"
> >>
> >> -SRCREV = "cab17f884998b43692244a863dea6f505c7f67af"
> >> +SRCREV = "0c51a3d02fa54726141f32824b11d0676960e0a5"
> >>   PR = "r12"
> >>   PV = "0.2+git${SRCPV}"
> >>
> >>
> >> --
> >> _______________________________________________
> >> Openembedded-commits mailing list
> >> Openembedded-commits at lists.openembedded.org
> >> http://lists.openembedded.org/mailman/listinfo/openembedded-commits
> >
> 

-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa at gmail.com
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 181 bytes
Desc: Digital signature
URL: <http://lists.openembedded.org/pipermail/openembedded-core/attachments/20150304/efe1cc87/attachment-0002.sig>

More information about the Openembedded-core mailing list