Hi Sebastian, ---- On Fri, 11 Apr 2025 16:44:32 -0300 Sebastian Andrzej Siewior wrote --- > On 2025-02-13 09:52:56 [+0100], To Gustavo Padovan wrote: > > On 2025-02-11 12:50:47 [-0300], Gustavo Padovan wrote: > > > Hi Sebastian, > Hi Gustavo, > > > > That is one the current limitations in the dashboard. The CI systems are not sending > > > a clear signal yet that they completed all tests they wanted to run. They just submit > > > test result individually as they get finished. > > > > > > Imo, it is a priority to fix this as it is second time this week I get this feedback. > > > > Ah okay. No need to rush. If you have something to look at, let me know > > and I will. Other than that I will lean back and wait for the bot to > > complain ;) > > > > Thank you. > > any updates on this? We had some progress, but not enough yet. KCIDB gained support for CI systems to send when they completed all test execution for a given branch checkout, but we have to plumb this across this pipeline yet. Regardless of that, the data is all available in the dashboard and you look up for the rt-tests results there. kci-dev cli - http://kci.dev/ - can also be used. For example: kci-dev results tests --giturl 'https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git' --branch master --latest --filter=filter.yaml Where filter can contain: ---- test: - rt-tests.cyclictest - rt-tests.cyclicdeadline ... ---- I recommend using latest git kci-dev for the time being as we keep fixing and evolving. Eg, I just sent a PR to fix a crash that happens when we use the filter file with no hw filter in it. I also just created an issue for being able to use wildcards in filters. eg `rt-tests.*` https://github.com/kernelci/kci-dev/issues/163 Both dashboard and kci-dev are pretty young, so features to help the community more and more are growing month by month. We appreciate the patience and understanding of the community. On the the above, I am working on our notifications system in the dashboard. You usecase to be cc'ed on notification for certains tests is not yet support, but we can look at it if we tell me exactly what will help you. In my understanding you want to know when results for any rt-tests change status (eg PASS -> FAIL or vice versa) for a selection of trees (eg mainline, next, etc). Can you confirm? Best, - Gus
