[oe] LayerIndex timeouts, downtime, and mitigation Sept. 11th 12:04-15:12UTC

[Michael Halstead]

I recently updated https://layers.openembedded.org/ to expose additional
data via the API. Following the update we experienced downtime due to
resource exhaustion. The time line follows:

September 11th, 12:04 UTC - heavy usage of the application lead to
resource exhaustion and intermittent timeouts
September 11th, 13:16 UTC - effectively offline
September 11th, 15:12 UTC - migrated to a more powerful VM restoring
normal operation

I am continuing to monitor the application and I'm working on rate
limiting rules to prevent this in the future. If you have experience
optimizing Django apps and have time to help please reach out to me and
Paul Eggleton.

-- 
Michael Halstead
Linux Foundation / Yocto Project
Systems Operations Engineer
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pEpkey.asc
Type: application/pgp-keys
Size: 1782 bytes
Desc: not available
URL: <http://lists.openembedded.org/pipermail/openembedded-devel/attachments/20190911/1f08f0fc/attachment.bin>