[oe] [RFC] Bitbake 1.8 parser rework

[Stefan Schmidt]

Hello.

On Sun, 2009-07-19 at 05:00, Holger Hans Peter Freyther wrote:
> 
> I posted this patchset a bit earlier and still would be interested in 
> feedback.I have put the version of Bitbake into a git repository so it might 
> be easier to try than to apply the ~20 patches to it.

I did some parsing tests for different distros. No error occurred and the new
parser saved between 11 to 16 seconds. See below for the details:


DISTRO=openmoko, branch milestone5.5
------------------------------------
Old parser:
(oe-openmoko)sschmidt at shell:~/oe/build/openmoko$ time bitbake -p fso-zhone-image
NOTE: Handling BitBake files: | (6485/6485) [100 %]
NOTE: Parsing finished. 0 cached, 6201 parsed, 284 skipped, 0 masked.
NOTE: Requested parsing .bb files only.  Exiting.

real    2m8.318s
user    2m4.740s
sys     0m2.844s

New parser:
(oe-openmoko)sschmidt at shell:~/oe/build/openmoko$ time bitbake -p fso-zhone-image
NOTE: Handling BitBake files: | (6485/6485) [100 %]
NOTE: Parsing finished. 0 cached, 6201 parsed, 284 skipped, 0 masked.
NOTE: Requested parsing .bb files only.  Exiting.

real    1m57.101s
user    1m53.723s
sys     0m2.480s


DISTRO=openmoko, branch org.openembedded.dev
---------------------------------------------
Old parser:
(oe-openmoko)sschmidt at shell:~/oe/build/openmoko$ time bitbake -p fso-zhone-image
NOTE: Handling BitBake files: \ (6978/6978) [100 %]
NOTE: Parsing finished. 0 cached, 6694 parsed, 284 skipped, 0 masked.
NOTE: Requested parsing .bb files only.  Exiting.

real    2m27.989s
user    2m23.577s
sys     0m3.104s

New parser:
(oe-openmoko)sschmidt at shell:~/oe/build/openmoko$ time bitbake -p fso-zhone-image
NOTE: Handling BitBake files: \ (6978/6978) [100 %]
NOTE: Parsing finished. 0 cached, 6694 parsed, 284 skipped, 0 masked.
NOTE: Requested parsing .bb files only.  Exiting.

real    2m12.436s
user    2m9.580s
sys     0m2.296s


DISTRO=angstrom-2008.1, branch org.openembedded.dev
---------------------------------------------
Old parser:
(oe-openmoko)sschmidt at shell:~/oe/build/openmoko$ time bitbake -p fso-zhone-image
NOTE: Handling BitBake files: \ (6832/6978) [97 %]NOTE: Angstrom DOES NOT
support bluez-libs because bluez3 has been replace by bluez4
NOTE: Handling BitBake files: | (6834/6978) [97 %]NOTE: Angstrom DOES NOT
support bluez-utils because bluez3 has been replace by bluez4
NOTE: Handling BitBake files: - (6842/6978) [98 %]NOTE: Angstrom DOES NOT
support bluez-libs because bluez3 has been replace by bluez4
NOTE: Handling BitBake files: / (6847/6978) [98 %]NOTE: Angstrom DOES NOT
support bluez-utils because bluez3 has been replace by bluez4
NOTE: Handling BitBake files: \ (6850/6978) [98 %]NOTE: Angstrom DOES NOT
support bluez-libs because bluez3 has been replace by bluez4
NOTE: Handling BitBake files: \ (6978/6978) [100 %]
NOTE: Parsing finished. 0 cached, 6689 parsed, 289 skipped, 0 masked.
NOTE: Requested parsing .bb files only.  Exiting.

real    2m19.683s
user    2m16.357s
sys     0m3.040s

New parser:
(oe-openmoko)sschmidt at shell:~/oe/build/openmoko$ time bitbake -p fso-zhone-image
NOTE: Handling BitBake files: \ (6832/6978) [97 %]NOTE: Angstrom DOES NOT
support bluez-libs because bluez3 has been replace by bluez4
NOTE: Handling BitBake files: | (6834/6978) [97 %]NOTE: Angstrom DOES NOT
support bluez-utils because bluez3 has been replace by bluez4
NOTE: Handling BitBake files: - (6842/6978) [98 %]NOTE: Angstrom DOES NOT
support bluez-libs because bluez3 has been replace by bluez4
NOTE: Handling BitBake files: / (6847/6978) [98 %]NOTE: Angstrom DOES NOT
support bluez-utils because bluez3 has been replace by bluez4
NOTE: Handling BitBake files: \ (6850/6978) [98 %]NOTE: Angstrom DOES NOT
support bluez-libs because bluez3 has been replace by bluez4
NOTE: Handling BitBake files: \ (6978/6978) [100 %]
NOTE: Parsing finished. 0 cached, 6689 parsed, 289 skipped, 0 masked.
NOTE: Requested parsing .bb files only.  Exiting.

real    2m6.955s
user    2m2.876s
sys     0m2.984s


DISTRO=micro, branch org.openembedded.dev
---------------------------------------------
Old parser:
(oe-openmoko)sschmidt at shell:~/oe/build/openmoko$ time bitbake -p fso-zhone-image
NOTE: Handling BitBake files: \ (6978/6978) [100 %]
NOTE: Parsing finished. 0 cached, 6694 parsed, 284 skipped, 0 masked.
NOTE: Requested parsing .bb files only.  Exiting.

real    1m59.425s
user    1m56.187s
sys     0m2.960s

New parser:
(oe-openmoko)sschmidt at shell:~/oe/build/openmoko$ time bitbake -p fso-zhone-image
NOTE: Handling BitBake files: \ (6978/6978) [100 %]
NOTE: Parsing finished. 0 cached, 6694 parsed, 284 skipped, 0 masked.
NOTE: Requested parsing .bb files only.  Exiting.

real    1m46.620s
user    1m44.471s
sys     0m1.948s


DISTRO=minimal, branch org.openembedded.dev
---------------------------------------------
Old parser:
(oe-openmoko)sschmidt at shell:~/oe/build/openmoko$ time bitbake -p fso-zhone-image
NOTE: Handling BitBake files: \ (6978/6978) [100 %]
NOTE: Parsing finished. 0 cached, 6694 parsed, 284 skipped, 0 masked.
NOTE: Requested parsing .bb files only.  Exiting.

real    2m12.521s
user    2m8.052s
sys     0m3.596s

New parser:
(oe-openmoko)sschmidt at shell:~/oe/build/openmoko$ time bitbake -p fso-zhone-image
NOTE: Handling BitBake files: \ (6978/6978) [100 %]
NOTE: Parsing finished. 0 cached, 6694 parsed, 284 skipped, 0 masked.
NOTE: Requested parsing .bb files only.  Exiting.

real    1m56.785s
user    1m54.711s
sys     0m1.692s

regards
Stefan Schmidt