| opendevreview | Joan Gilabert proposed openstack/watcher master: Add Inventory wrapper class for placement data https://review.opendev.org/c/openstack/watcher/+/991147 | 06:50 |
|---|---|---|
| opendevreview | Joan Gilabert proposed openstack/watcher master: Switch PlacementHelper to OpenStackSDK https://review.opendev.org/c/openstack/watcher/+/991148 | 06:50 |
| opendevreview | Joan Gilabert proposed openstack/watcher master: Remove unused placement from OpenStackClients https://review.opendev.org/c/openstack/watcher/+/991149 | 06:50 |
| opendevreview | Joan Gilabert proposed openstack/watcher master: Switch PlacementHelper to OpenStackSDK https://review.opendev.org/c/openstack/watcher/+/991148 | 07:46 |
| opendevreview | Joan Gilabert proposed openstack/watcher master: Remove unused placement from OpenStackClients https://review.opendev.org/c/openstack/watcher/+/991149 | 07:46 |
| sean-k-mooney | dviroel: amoralej teim-ci is mostly fixed. rebooting the vm didnt help but rebooting and updated all my ubiqi networking gear did | 09:29 |
| amoralej | i saw in last reviews that it was running but not reporting comments ? | 09:30 |
| sean-k-mooney | however the new version fo gerrit removed the api that zuul uses for inlien comments. i updated to the latest released zuul but the fix for that is not aviable yet | 09:30 |
| amoralej | ah, that | 09:30 |
| sean-k-mooney | ya so you can view the html report if you click in to the review comment at the top level | 09:31 |
| sean-k-mooney | but i will either have to swap to zuul master if they fix has been commited or wait a bit until that gets done | 09:31 |
| amoralej | i see https://minio-api.teim.app/zuul-logs/ab1/main/ab1ecd754d7547eeb7e1db7e745fe18e/code-review/review-report.html | 09:31 |
| amoralej | thanks! | 09:32 |
| amoralej | is there any magic comment to trigger teim-ci job only? other than recheck ? | 09:32 |
| sean-k-mooney | teim-ci: manual | 09:33 |
| amoralej | ack | 09:33 |
| sean-k-mooney | well or teim-ci: auto | 09:33 |
| sean-k-mooney | https://github.com/SeanMooney/ci-sean-mooney/blob/main/zuul.d/pipelines.yaml#L2-L67 | 09:34 |
| sean-k-mooney | for watcher the 2 pipelines are basiclly the same https://github.com/SeanMooney/ci-sean-mooney/blob/main/zuul.d/projects.yaml#L27-L34 | 09:34 |
| sean-k-mooney | i might change that in the future so the auto pipleine is basiclly what trigers when you push a review i.e. check , the manual one my version of experimental | 09:35 |
| sean-k-mooney | i have consicerd addign other thing to my zuul instnace in the furue but i didnt really have anything concreate | 09:36 |
| sean-k-mooney | for example i do have nightly and weekly pipelines | 09:37 |
| amoralej | teim-ci: experimental would be more clear for experimental version | 09:37 |
| amoralej | thanks for maintaining that | 09:38 |
| sean-k-mooney | well i guess i choos manual as i planned ot use it not for experminal jobs in the normal sence but rather extra jobs that we dont need all the time | 09:38 |
| sean-k-mooney | so basiclly if i had perodic stuff and we wanted a 1 off trigger then it would go in manual | 09:38 |
| sean-k-mooney | i had planned orginally to make teim aviable to all project via the manual tigger | 09:38 |
| sean-k-mooney | but i turned that off | 09:38 |
| sean-k-mooney | amoralej: if you have ideas for useful jobs just let me know or any changes you would like to see | 09:40 |
| amoralej | thaks, i'll let you know if i figure out something | 09:51 |
| opendevreview | Joan Gilabert proposed openstack/watcher master: Switch PlacementHelper to OpenStackSDK https://review.opendev.org/c/openstack/watcher/+/991148 | 10:24 |
| opendevreview | Joan Gilabert proposed openstack/watcher master: Remove unused placement from OpenStackClients https://review.opendev.org/c/openstack/watcher/+/991149 | 10:24 |
| opendevreview | Joan Gilabert proposed openstack/watcher master: Switch PlacementHelper to OpenStackSDK https://review.opendev.org/c/openstack/watcher/+/991148 | 11:00 |
| opendevreview | Joan Gilabert proposed openstack/watcher master: Remove unused placement from OpenStackClients https://review.opendev.org/c/openstack/watcher/+/991149 | 11:00 |
| jgilaber | dviroel amoralej sean-k-mooney Hi! After all the 2025.2 backports for zone migration merged I enabled the volume migration tests there https://review.opendev.org/c/openstack/watcher/+/993976 | 11:49 |
| jgilaber | please take a look when free | 11:50 |
| dviroel | ack , thanks jgilaber | 11:50 |
| amoralej | checking | 11:51 |
| jgilaber | thanks, that was quick! | 11:54 |
| jgilaber | second thing I wanted to raise is TIMED_OUT jobs | 11:54 |
| sean-k-mooney | i mean the ci was passing and your enableing more tests :) | 11:54 |
| jgilaber | it seems that lately we're seeing it more often | 11:55 |
| jgilaber | https://zuul.opendev.org/t/openstack/builds?project=openstack%2Fwatcher&result=TIMED_OUT&skip=0 | 11:55 |
| jgilaber | I looked at a few of them at they seem to be fine, just running a bit slower than usual | 11:55 |
| sean-k-mooney | we have our limits set to about 2 hours | 11:55 |
| jgilaber | it looks to me that they are about to finish with a couple of tests to run | 11:55 |
| sean-k-mooney | honestly we are not runign enouch test in our jobs to be hittign those limits | 11:55 |
| sean-k-mooney | so im not sure we should increase them without investigating why these have got so slow | 11:56 |
| sean-k-mooney | so devstack took ~30mins in the job im checkign | 11:58 |
| sean-k-mooney | which is not excessive | 11:58 |
| jgilaber | last time I checked this the cluster was slow in general | 11:59 |
| sean-k-mooney | 2026-06-19 11:26:00.087436 | controller | {0} watcher_tempest_plugin.tests.scenario.test_execute_zone_migration.TestExecuteZoneMigrationStrategy.test_execute_zone_migration_with_destination_host [108.219466s] ... ok | 11:59 |
| sean-k-mooney | 2026-06-19 11:27:45.803972 | controller | {0} watcher_tempest_plugin.tests.scenario.test_execute_zone_migration.TestExecuteZoneMigrationStrategy.test_execute_zone_migration_without_destination_host [105.683355s] ... ok | 11:59 |
| sean-k-mooney | 2026-06-19 11:31:46.199408 | controller | {0} watcher_tempest_plugin.tests.scenario.test_execute_zone_migration.TestExecuteZoneMigrationStrategyVolume.test_execute_zone_migration_volume_migrate [192.233187s] ... ok | 11:59 |
| sean-k-mooney | 2026-06-19 11:33:50.807120 | controller | {0} watcher_tempest_plugin.tests.scenario.test_execute_zone_migration.TestExecuteZoneMigrationStrategyVolume.test_execute_zone_migration_volume_retype [124.578776s] ... ok | 11:59 |
| jgilaber | I'm about to have lunch but I'll try giving claude the logs and see if it spots anything | 12:00 |
| sean-k-mooney | some of the watchewr tests are taking quite long | 12:00 |
| sean-k-mooney | also the job is running serially | 12:00 |
| amoralej | it'd be interesting to see what's the deploy time for those jobs compared to the passing ones? | 12:00 |
| sean-k-mooney | this is on ovh https://zuul.opendev.org/t/openstack/build/fa5d1415b54543179e9a63ec47a2a4e2/log/job-output.txt | 12:00 |
| sean-k-mooney | so that is not a case of a slow host | 12:01 |
| sean-k-mooney | start of the job to tempest starting was 45 mins | 12:02 |
| sean-k-mooney | but we have selver test that are indivugally taking 2-3 minutes each | 12:04 |
| sean-k-mooney | 30-90 seconds is the accpabel range for a senario test wihtout it being condier exessivly slow and we ahve severa at doubel that | 12:05 |
| sean-k-mooney | 2026-06-19 10:34:42.897426 | controller | {0} watcher_tempest_plugin.tests.scenario.test_execute_actuator.TestExecuteActionsViaActuator.test_execute_scenarios [254.536037s] ... ok | 12:05 |
| dviroel | yeah, i noticed that. Sometimes job passes with 1 hr 9 mins 49 secs, while others timed out after 2h | 12:24 |
| dviroel | if we check a job build history https://zuul.opendev.org/t/openstack/builds?job_name=watcher-tempest-prometheus&project=openstack%2Fwatcher&branch=master&skip=0 | 12:25 |
| sean-k-mooney | im goign to tell an agent to dig into that job but i woudl assume we are misisng notifciotn or takign a very long time to execute | 12:50 |
| jgilaber | here are the findings from opus https://etherpad.opendev.org/p/watcher_tempest_slowness | 12:52 |
| jgilaber | I'm still going through the logs to verify the claims | 12:52 |
| sean-k-mooney | that form a diffent testn tehn i was looking at i think | 12:55 |
| sean-k-mooney | but its interting that the action poooling and data model syscn are the too most expensive | 12:56 |
| jgilaber | I'm looking at https://zuul.opendev.org/t/openstack/build/fa5d1415b54543179e9a63ec47a2a4e2 for reference | 12:56 |
| sean-k-mooney | oh it is the same | 12:56 |
| opendevreview | Merged openstack/watcher stable/2025.2: Enable extra zone migration tests on master branch https://review.opendev.org/c/openstack/watcher/+/993976 | 13:25 |
| opendevreview | chandan kumar proposed openstack/watcher-dashboard master: Add Playwright-based E2E testing framework https://review.opendev.org/c/openstack/watcher-dashboard/+/970353 | 14:58 |
| opendevreview | Douglas Viroel proposed openstack/watcher stable/2026.1: Add regression test for notification lost during synchronization https://review.opendev.org/c/openstack/watcher/+/994161 | 20:10 |
| opendevreview | Douglas Viroel proposed openstack/watcher stable/2026.1: Fix notification updates lost during cluster data model synchronization https://review.opendev.org/c/openstack/watcher/+/994162 | 20:10 |
| opendevreview | Douglas Viroel proposed openstack/watcher stable/2026.1: Fix LP bug link in releasenote for bug 2152645 https://review.opendev.org/c/openstack/watcher/+/994163 | 20:10 |
| opendevreview | Merged openstack/watcher master: Add Inventory wrapper class for placement data https://review.opendev.org/c/openstack/watcher/+/991147 | 21:10 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!