| *** amoralej|off is now known as amoralej | 06:23 | |
| ysandeep | chkumar|ruck, fyi.. triggering wallaby tripleo lines jobs so that https://review.opendev.org/c/openstack/tripleo-ansible/+/844478 reaches downstream early | 07:29 |
|---|---|---|
| ysandeep | chkumar|ruck, fyi.. https://review.rdoproject.org/r/c/testproject/+/31954 | 07:34 |
| ysandeep | ysandeep|lunch | 07:36 |
| *** ysandeep is now known as ysandeep|lunch | 07:36 | |
| chkumar|ruck | ysandeep|lunch: ack | 07:49 |
| *** ysandeep|lunch is now known as ysandeep | 09:15 | |
| chkumar|ruck | ysandeep: the testproject job failed, validation jobs during set facts, fs01 during node provision and few tempest failure | 09:24 |
| ysandeep | chkumar|ruck, this is failing consistently https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-containers-multinode-tripleo-wallaby-validation | 09:25 |
| ysandeep | set facts issue | 09:26 |
| ysandeep | I have reran other jobs to see if issue is consistent | 09:26 |
| chkumar|ruck | ysandeep: opening a new bug | 09:27 |
| ysandeep | ack | 09:28 |
| chkumar|ruck | jpodivin: hello | 09:35 |
| chkumar|ruck | jpodivin: please have a look at this bug https://bugs.launchpad.net/tripleo/+bug/1977716 thanks! | 09:36 |
| chkumar|ruck | ysandeep: https://bugs.launchpad.net/tripleo/+bug/1977716 thanks! | 09:36 |
| ysandeep | thanks! | 09:36 |
| *** jpena|off is now known as jpena | 09:37 | |
| chkumar|ruck | ysandeep: can we skip the validation job and promote it? | 09:40 |
| chkumar|ruck | it will unblock the downstream rhos17 rhel9 line | 09:40 |
| ysandeep | chkumar|ruck, yeah we can , let's wait for other 3 jobs results which failed in last run. | 09:41 |
| ysandeep | if they passes we can promote | 09:41 |
| chkumar|ruck | ok | 09:42 |
| jpodivin | chkumar|ruck: ok, looking | 09:51 |
| jpodivin | chkumar|ruck: hm, well it's definitely odd. The error should have shown up much earlier, the args were missing for months ... | 10:00 |
| jpodivin | fixing it shouldn't be hard, but I'll have to look into why it didn't happen before. | 10:01 |
| jpodivin | ... ah, mystery solved :D https://opendev.org/openstack/validations-common/commit/4e6c1e6add59f45962cee68a76b5f4b759f44041 | 10:03 |
| jpodivin | chkumar|ruck, ysandeep: can I put the patch as a dependency in https://review.rdoproject.org/r/c/testproject/+/31954 ? | 10:07 |
| jpodivin | so we can test it? | 10:07 |
| chkumar|ruck | jpodivin: the test is in mid way, ysandeep what you say? | 10:09 |
| jpodivin | well it can wait. Not like we are pressed for time | 10:09 |
| jpodivin | In any case, proposed fix is here https://review.opendev.org/c/openstack/validations-common/+/844823 we can test it when it's convenient. | 10:09 |
| ysandeep | we can send a separate testproject, /me proposing now | 10:11 |
| ysandeep | jpodivin, this is against master - https://review.opendev.org/c/openstack/validations-common/+/844823 , do we use validation-common master branch in tripleo wallaby jobs? | 10:12 |
| jpodivin | ysandeep: afaik yes. | 10:14 |
| ysandeep | ack | 10:14 |
| jpodivin | the wallaby is using code from VF master branches, except for Tripleo-validations repo. That one is following the Openstack release model | 10:15 |
| chkumar|ruck | ysandeep: please merge this https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/413316 when free, thansk! | 10:19 |
| ysandeep | chkumar|ruck, +wed | 10:23 |
| chkumar|ruck | ysandeep: thanks! | 10:23 |
| ysandeep | chkumar|ruck, jpodivin fyi.. https://review.rdoproject.org/r/c/testproject/+/43466 | 10:26 |
| chkumar|ruck | thanks! | 10:26 |
| jpodivin | ysandeep++ | 10:29 |
| *** pojadhav is now known as pojadhav|afk | 11:14 | |
| *** ysandeep is now known as ysandeep|break | 11:39 | |
| *** dviroel|out is now known as dviroel | 11:51 | |
| chkumar|ruck | marios: ysandeep|break hello | 11:58 |
| chkumar|ruck | fs01 seems to be unstable once again | 11:58 |
| chkumar|ruck | https://logserver.rdoproject.org/05/43405/2/check/distgit-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-wallaby/e8b7c91/logs/undercloud/var/log/extra/dstat.html.gz | 11:58 |
| chkumar|ruck | on dstat logs what we looks specifically? | 11:58 |
| marios | chkumar|ruck: https://logserver.rdoproject.org/05/43405/2/check/distgit-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-wallaby/e8b7c91/logs/undercloud/var/log/tempest/stestr_results.html.gz :/ | 12:00 |
| marios | chkumar|ruck: i was looking at memory for example... but do we have the overcloud nodes dstat there too? | 12:00 |
| chkumar|ruck | I was working on skipping wait until ssh pingable tests | 12:00 |
| chkumar|ruck | let me check | 12:00 |
| marios | chkumar|ruck: no looks like we don't https://logserver.rdoproject.org/05/43405/2/check/distgit-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-wallaby/e8b7c91/logs/overcloud-controller-0/var/log/extra/ | 12:01 |
| chkumar|ruck | it is not there | 12:01 |
| marios | its what ysandeep|break added for the sprint tasks to add this for ovb missing ^^ | 12:01 |
| chkumar|ruck | marios: yes correct | 12:01 |
| chkumar|ruck | the test which passed on yesterday not again started failing | 12:01 |
| chkumar|ruck | s/yesterday/friday | 12:01 |
| marios | all the tempest stuff is merged and promoted through tempest component? | 12:03 |
| marios | chkumar|ruck: ^ ? sanity check | 12:03 |
| chkumar|ruck | marios: nothing is merged | 12:03 |
| marios | we were waiting on 4/5 patches | 12:03 |
| marios | right? the topic branch chkumar|ruck ? ^^^ | 12:03 |
| marios | chkumar|ruck: https://review.opendev.org/q/topic:wait_until_sshable_pingable | 12:04 |
| marios | that one | 12:04 |
| chkumar|ruck | marios: all patches are still in review, I am testing it via rdoinfo for wallaby https://review.rdoproject.org/r/q/topic:wait_until_sshable_pingable | 12:04 |
| marios | ah i see the logs you posted are check not periodic | 12:04 |
| chkumar|ruck | let me put a patch to enable dstat on overcloud | 12:06 |
| *** ysandeep|break is now known as ysandeep | 12:46 | |
| *** amoralej is now known as amoralej|lunch | 12:48 | |
| *** amoralej|lunch is now known as amoralej | 13:18 | |
| *** pojadhav|afk is now known as pojadhav | 13:18 | |
| *** dasm|off is now known as dasm | 13:47 | |
| dasm | o/ | 13:47 |
| chkumar|ruck | dasm: \o | 13:47 |
| chkumar|ruck | dasm: just on time, | 13:47 |
| *** dasm is now known as dasm|rover | 13:47 | |
| chkumar|ruck | we finished the CIX | 13:47 |
| chkumar|ruck | dasm|rover: master got promoted few mins back | 13:48 |
| dasm|rover | nice | 13:48 |
| *** dasm|rover is now known as dasm|ruck | 13:48 | |
| chkumar|ruck | dasm|rover: here is the current state of the world https://hackmd.io/HMjD8MouQXmGWMJP5o76JQ?view#Active-Bugs | 13:48 |
| dasm|ruck | ack | 13:48 |
| chkumar|ruck | dasm|ruck: you can take a look at component lines | 13:49 |
| chkumar|ruck | dasm|ruck: rest is fine :-) | 13:49 |
| dasm|ruck | good :) | 13:50 |
| dasm|ruck | thanks chkumar|ruck++ | 13:50 |
| chkumar|ruck | dasm|ruck: ysandeep added this patch to run dstat on overcloud https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/844837 feel free to update it, if it does not work. | 13:51 |
| dasm|ruck | ack | 13:51 |
| chkumar|ruck | dasm|ruck: I am bumping tempest https://review.rdoproject.org/r/c/rdoinfo/+/43475 to 31.0.0. will cherry-pick patches for wallaby | 13:54 |
| chkumar|ruck | and downstream tomorrow | 13:54 |
| chkumar|ruck | please leave notes | 13:55 |
| chkumar|ruck | I am stepping out for 2 hours, will check later | 13:55 |
| dasm|ruck | k | 13:55 |
| dviroel | marios: o/ - wrt https://review.rdoproject.org/r/c/rdo-jobs/+/43409/2#message-64e23822c9c14917478f576cd70c617bd6377c0e - what am I missing here? that was removed from config already | 13:59 |
| marios | dviroel: will check in sec.. joining scrum | 14:00 |
| bhagyashris | Tripleo Ci team | 14:00 |
| bhagyashris | scrum time | 14:00 |
| bhagyashris | akahat, chkumar|ruck | 14:01 |
| bhagyashris | jm1[m], ^ | 14:01 |
| marios | rcastillo: o/ comments #4 #5 @ https://bugs.launchpad.net/tripleo/+bug/1975917/ | 14:13 |
| pojadhav | https://review.opendev.org/c/openstack/tripleo-quickstart/+/839591 | 14:13 |
| dasm|ruck | marios: i think i had a wrong mic enabled to pick up my voice | 14:23 |
| *** ysandeep is now known as ysandeep|brb | 14:25 | |
| marios | dasm|ruck: yeah sounded like it | 14:28 |
| marios | dasm|ruck: like you had the laptop one for ex. | 14:28 |
| dasm|ruck | yup | 14:28 |
| rcastillo | marios: thx | 14:33 |
| *** ysandeep|brb is now known as ysandeep | 14:33 | |
| marios | rcastillo: np | 14:36 |
| *** dviroel is now known as dviroel|lunch | 15:12 | |
| *** marios is now known as marios|out | 15:45 | |
| *** ysandeep is now known as ysandeep|out | 15:53 | |
| chkumar|ruck | dasm|ruck: anything I can help? | 16:21 |
| *** dviroel|lunch is now known as dviroel | 16:22 | |
| dasm|ruck | chkumar|ruck: i think i'm good. i noticed we might have some issues with network component. running testproject to check that | 16:27 |
| dasm|ruck | chkumar|ruck: https://logserver.rdoproject.org/openstack-component-network/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-network-master/1875702/logs/undercloud/var/log/tempest/stestr_results.html.gz | 16:27 |
| dasm|ruck | > Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance | 16:28 |
| chkumar|ruck | cool! | 16:30 |
| chkumar|ruck | fs01 master is not in good state | 16:30 |
| chkumar|ruck | need to get the dstat logs on overcloud node to find what is going on there | 16:30 |
| chkumar|ruck | dasm|ruck: please leave notes | 16:50 |
| chkumar|ruck | dasm|ruck: see ya tomorrow! | 16:51 |
| dasm|ruck | chkumar|ruck: ofc, see you! | 16:54 |
| *** jpena is now known as jpena|off | 17:15 | |
| *** dviroel is now known as dviroel|afk | 19:57 | |
| dasm|ruck | chkumar|ruck: we're looking good. Seems like my concerns wrt network issues are not the problem. We have cs8 & cs9 wallaby runnung. Fingers crossed for a good run. | 22:15 |
| dasm|ruck | chkumar|ruck: here is cs8 wallaby promo: https://review.rdoproject.org/r/c/testproject/+/42374 | 22:15 |
| dasm|ruck | chkumar|ruck: nothing unusual happened. i'm hoping for a good results tomorrow. | 22:15 |
| * dasm|ruck over and out | 22:16 | |
| dasm|ruck | o/ | 22:16 |
| dasm|ruck | have a good one! | 22:16 |
| *** dasm|ruck is now known as dasm|ruck|off | 22:16 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!