@cmaureir Sounds like a complex test matrix. I'd expect to have to run the whole test suite „in the cloud“ (= on an integration server running Jenkins, or via TravisCI or similar) and have a small subset running locally. Then, when a push is received on gerrit, the test matrix kicks off and reports back to the issue.