[OE-core] Oddness regarding file locks in package.bbclass

Peter Kjellerstedt peter.kjellerstedt at axis.com
Tue Oct 3 18:17:20 UTC 2017


I just stumbled upon something odd in package.bbclass. In commit 
ede381d5 from January 2011 (the code hasn't changed since), the 
use of the ${PACKAGELOCK} lock file was changed to shared to 
improve parallelism. However, when looking at the actual change 
it becomes confusing. I have included it below for reference.

> commit ede381d56b180b384fdad98d445e5430819cfade
> Author: Richard Purdie <richard.purdie at linuxfoundation.org>
> Date:   Wed Jan 19 11:04:15 2011 +0000
> 
>     package.bbclass: Take a shared lock when reading to improve do_package parallelism
>     
>     Signed-off-by: Richard Purdie <richard.purdie at linuxfoundation.org>
> 
> diff --git a/meta/classes/package.bbclass b/meta/classes/package.bbclass
> index d39c694de5..8e7fa26f72 100644
> --- a/meta/classes/package.bbclass
> +++ b/meta/classes/package.bbclass
> @@ -497,7 +497,8 @@ python emit_pkgdata() {
>  	pkgdest = bb.data.getVar('PKGDEST', d, 1)
>  	pkgdatadir = bb.data.getVar('PKGDESTWORK', d, True)
>  
> -	lf = bb.utils.lockfile(bb.data.expand("${PACKAGELOCK}", d))
> +	# Take shared lock since we're only reading, not writing
> +	lf = bb.utils.lockfile(bb.data.expand("${PACKAGELOCK}", d), True)

Here the lock is changed to shared as per the commit message.

>  
>  	data_file = pkgdatadir + bb.data.expand("/${PN}" , d)
>  	f = open(data_file, 'w')
> @@ -649,6 +650,7 @@ python package_do_shlibs() {
>  	shlibs_dir = bb.data.getVar('SHLIBSDIR', d, True)
>  	shlibswork_dir = bb.data.getVar('SHLIBSWORKDIR', d, True)
>  
> +	# Take shared lock since we're only reading, not writing
>  	lf = bb.utils.lockfile(bb.data.expand("${PACKAGELOCK}", d))

Here, however, it is not changed, even though a comment is added to 
say that it is. Was this intentional, or just an oversight?

>  
>  	def linux_so(root, path, file):
> @@ -878,6 +880,7 @@ python package_do_pkgconfig () {
>  							if hdr == 'Requires':
>  								pkgconfig_needed[pkg] += exp.replace(',', ' ').split()
>  
> +	# Take shared lock since we're only reading, not writing
>  	lf = bb.utils.lockfile(bb.data.expand("${PACKAGELOCK}", d))

Here again a comment is added, but the code is not changed to match.

>  
>  	for pkg in packages.split():

Also, what is the ${PACKAGELOCK} lock file actually protecting? With 
the exception of the two questionable cases above, I cannot see that 
the lock is taken privately anywhere else. And since it looks as the 
code in package_do_shlibs() and package_do_pkgconfig() is not what 
needs protection (based on the added comments above), what is?

//Peter




More information about the Openembedded-core mailing list