[bitbake-devel] [PATCH] prserv: don't wait until exit to sync

[Richard Purdie]

On Tue, 2014-11-04 at 08:42 +0000, Richard Purdie wrote:
> We're still figuring out what is going on but it is roughly that:
> 
> a) The build generates a ton of IO
> b) That IO builds up into a queue
> c) The PR service decides it needs to sync to disk
> d) The PR service hits an fsync() of some kind in sqlite whilst writing 
> e) The PR service is blocked for its clients until the sync() finishes
> f) Connections to the PR service timeout.
> 
> It would be nice if we could write the sqlite data in a separate thread
> whilst the readers continue. There is an asynchronous module but its
> deprecated:
> 
> http://www.sqlite.org/asyncvfs.html
> 
> WAL is recommended instead:
> 
> http://www.sqlite.org/wal.html
> 
> so we probably need to look at that.

FWIW,

http://git.yoctoproject.org/cgit.cgi/poky-contrib/commit/?h=rpurdie/t222&id=df0dabbf90f3da7153295adb83e51c41ae4d9375

is a patch Ross is kindly testing for me...

Cheers,

Richard