[OE-core] [RFC PATCH 0/8] Proposed implementation of a new runtime tests framework

[Otavio Salvador]

On Fri, Jun 28, 2013 at 7:04 AM, Stefan Stanacar
<stefanx.stanacar at intel.com> wrote:
...
> There are some areas for improvement/limitations right now:
>  - a better way of getting the list of installed packages in a image
>  - qemu is started with the -snapshot option, we should create a copy of the original rootfs instead.
>  - when using TEST_SUITES = "auto" there is no dependency at all between tests (rpm would run before ssh test), so better use TEST_SUITES = "ping ssh auto"
>  - better logging and error reporting for qemu problems (runqemu erros, qemu doesn't start, etc)
>  - more helper methods for tests
>  - others I can't think of right now :)

Did you think about adding something like an overidable set of hooks
which starts, setup image and shutdown the machine? This would allow
same framework to be used for real hardware test.

Regards,

--
Otavio Salvador                             O.S. Systems
http://www.ossystems.com.br        http://projetos.ossystems.com.br
Mobile: +55 (53) 9981-7854            Mobile: +1 (347) 903-9750