*** jmasud has quit IRC | 00:30 | |
*** jmasud has joined #oooq | 00:34 | |
*** Goneri has quit IRC | 00:47 | |
*** jmasud has quit IRC | 01:00 | |
*** rlandy has quit IRC | 01:17 | |
*** sanjayu__ has joined #oooq | 01:18 | |
*** sanjayu_ has quit IRC | 01:20 | |
*** ysandeep|away is now known as ysandeep | 01:36 | |
*** apetrich has quit IRC | 02:10 | |
*** jmasud has joined #oooq | 03:58 | |
*** ratailor has joined #oooq | 04:06 | |
*** holser has joined #oooq | 04:35 | |
*** jmasud has quit IRC | 04:36 | |
*** ykarel|away is now known as ykarel | 04:41 | |
*** skramaja has joined #oooq | 04:43 | |
*** marios has joined #oooq | 05:15 | |
*** udesale has joined #oooq | 05:35 | |
*** jfrancoa has joined #oooq | 05:36 | |
*** bogdando has joined #oooq | 05:44 | |
*** dpawlik has joined #oooq | 06:05 | |
*** jmasud has joined #oooq | 06:11 | |
*** jmasud has quit IRC | 06:17 | |
*** jmasud has joined #oooq | 06:18 | |
*** ccamacho has joined #oooq | 06:56 | |
*** ccamacho has quit IRC | 06:56 | |
*** jbadiapa has joined #oooq | 07:05 | |
bhagyashris|ruck | chandankumar, hi good noon ! have you submitted any patch to avoid the failure of "periodic-tripleo-ci-centos-8-scenario010-ovn-provider-standalone-master" | 07:06 |
---|---|---|
*** ccamacho has joined #oooq | 07:13 | |
*** sanjayu__ has quit IRC | 07:16 | |
*** jmasud has quit IRC | 07:17 | |
ysandeep | bhagyashris|ruck, may be this is what you are looking for - https://review.opendev.org/#/c/722677/ | 07:17 |
*** saneax has joined #oooq | 07:20 | |
*** apetrich has joined #oooq | 07:23 | |
*** tosky has joined #oooq | 07:35 | |
bhagyashris|ruck | ysandeep, yes thank you :) | 07:44 |
*** dtantsur|afk is now known as dtantsur | 07:54 | |
*** jpena|off is now known as jpena | 07:56 | |
*** holser has quit IRC | 07:59 | |
*** holser has joined #oooq | 07:59 | |
chandankumar | dpawlik, Hello | 08:06 |
chandankumar | dpawlik, somehow rsycn mkdir is not working for creating dir on image server | 08:07 |
chandankumar | dpawlik, https://logserver.rdoproject.org/20/26920/21/check/periodic-tripleo-centos-8-buildimage-overcloud-full-train/b550d93/job-output.txt | 08:07 |
chandankumar | dpawlik, rsync: mkdir "/var/www/html/images/centos8/train/rdo_trunk" failed: No such file or directory (2) | 08:07 |
chandankumar | dpawlik, we need train dir here https://images.rdoproject.org/centos8/ | 08:08 |
chandankumar | dpawlik, please have a look thanks, it is blocking c8 train pipeline | 08:09 |
dpawlik | chandankumar, hi | 08:09 |
dpawlik | chandankumar, /me checking | 08:09 |
chandankumar | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/ci-scripts/tripleo-upstream/upload-cloud-images.sh is used for uploading images | 08:10 |
dpawlik | chandankumar, [uploader@images centos8]$ mkdir -p /var/www/html/images/centos8/train/rdo_trunk | 08:11 |
dpawlik | without any problem | 08:11 |
dpawlik | its beacause train dir was not there. Could you add please "-p" param to the mkdir? | 08:11 |
chandankumar | dpawlik, yup | 08:12 |
dpawlik | chandankumar, strange, that rsync doesn't want to create the dir... but the same user is able to create directory via command | 08:13 |
dpawlik | chandankumar, maybe something is missing in rsync command when I was working on patching the permission problem | 08:13 |
chandankumar | marios, dpawlik quick fix https://review.rdoproject.org/r/27427 for above issue ^^ | 08:15 |
dpawlik | chandankumar, there was also another script that can have same issue, or? | 08:16 |
dpawlik | afair | 08:16 |
*** ykarel is now known as ykarel|lunch | 08:22 | |
marios | chandankumar: ack | 08:24 |
bhagyashris|ruck | chandankumar, can vote for this https://review.opendev.org/#/c/726993/ | 08:27 |
bhagyashris|ruck | +w | 08:27 |
chandankumar | dpawlik, need to check | 08:28 |
chandankumar | dpawlik, first let me update the c8 patch and see whether it is working or not | 08:28 |
dpawlik | okey | 08:28 |
*** ysandeep is now known as ysandeep|lunch | 08:31 | |
panda | marios: Ψ time | 08:32 |
panda | bhagyashris|ruck: I had to fix https://review.opendev.org/#/c/722677/, apparently the configuration option needs a description (why can't they get it from the driver itself, I don't know) | 08:34 |
bhagyashris|ruck | panda, ok | 08:36 |
panda | marios: :( | 08:38 |
marios | panda: sorry ! | 08:38 |
marios | panda: i was staring at get_hash | 08:38 |
marios | coming | 08:38 |
kopecmartin | chandankumar: hi where in the logs of featureset20 can i find, what tempest version was used to run tests? because all tests passed, just 1 neutron plugin tests failed, which is unrelated | 08:41 |
chandankumar | kopecmartin, review link? | 08:41 |
kopecmartin | chandankumar: so if the new tempest version was tested, we can bump as the tests passed https://review.rdoproject.org/r/#/c/26769/ | 08:41 |
chandankumar | kopecmartin, https://logserver.rdoproject.org/69/26769/4/check/distgit-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset020-stein/63b1232/logs/undercloud/var/log/extra/rpm-list.txt.gz | 08:42 |
kopecmartin | chandankumar: there's no tempest, that was the first place i looked | 08:43 |
*** derekh has joined #oooq | 08:43 | |
bhagyashris|ruck | panda, can you point me where exactly you are facing issue about description | 08:44 |
chandankumar | kopecmartin, https://logserver.rdoproject.org/69/26769/4/check/distgit-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset020-stein/63b1232/logs/undercloud/home/zuul/tempest.log.txt.gz | 08:44 |
chandankumar | python2-tempest-23.0.0-0.20200511122550.d432237.el7.noarch | 08:45 |
chandankumar | 2020-05-11 16:00:52 | python2-neutron-tests-tempest-0.9.0-0.20200330151622.15c85f6.el7.noarch | 08:45 |
chandankumar | kopecmartin, tempest is running from container so the info is available in tempest.log | 08:45 |
tosky | chandankumar: out of curiosity, is it running in a centos8/rhel8 container? | 08:46 |
chandankumar | bhagyashris|ruck, do you have link to tempest failure bug on stein ? | 08:46 |
chandankumar | tosky, nope, it is on stein, so it is running c7 container | 08:46 |
tosky | oh, oki | 08:46 |
tosky | chandankumar: but | 08:46 |
chandankumar | tosky, from train, we are using packages installed via os_tempest | 08:46 |
tosky | ok, right, that's the last version which supports python 2 | 08:48 |
bhagyashris|ruck | chandankumar, https://bugs.launchpad.net/tripleo/+bug/1876087 | 08:48 |
openstack | Launchpad bug 1876087 in tripleo "Queens, Rocky, Stein, tempest.scenario.test_network_basic_ops.TestNetworkBasicOps failing. Timeout" [Critical,Fix released] - Assigned to amolkahat (amolkahat) | 08:48 |
panda | bhagyashris|ruck: I can, but I won't, because I'm evil | 08:48 |
chandankumar | kopecmartin, https://bugs.launchpad.net/tripleo/+bug/1876087 is failing only | 08:48 |
chandankumar | if it is passing there, we can go ahead and update the bump | 08:48 |
panda | bhagyashris|ruck: https://64d1a84195be846e8a85-cb762a113d4d5e3960c90c07c5780a8b.ssl.cf2.rackcdn.com/722677/2/check/tripleo-ci-centos-8-scenario010-ovn-provider-standalone/b3f2294/logs/undercloud/home/zuul/tempest.log | 08:48 |
panda | bhagyashris|ruck: oslo_config.cfg.ConfigFileValueError: Value for option enabled_provider_drivers from LocationInfo(location=<Locations.user: (4, True)>, detail='/home/zuul/tempest/etc/tempest.conf') is not valid: Value should be NAME:VALUE pairs separated by "," | 08:49 |
panda | bhagyashris|ruck: https://docs.openstack.org/octavia/latest/configuration/configref.html in section enabled_provider_drivers | 08:49 |
kopecmartin | chandankumar: i see, thanks, so i confirm that the tempest 23 has been tested | 08:50 |
panda | bhagyashris|ruck: it tells it needs a list of dictionaries. | 08:50 |
kopecmartin | chandankumar: the test mentioned in https://bugs.launchpad.net/tripleo/+bug/1876087 is passing | 08:50 |
openstack | Launchpad bug 1876087 in tripleo "Queens, Rocky, Stein, tempest.scenario.test_network_basic_ops.TestNetworkBasicOps failing. Timeout" [Critical,Fix released] - Assigned to amolkahat (amolkahat) | 08:50 |
panda | never heard of a configuration that embeds description for a driver that is part of the code | 08:50 |
kopecmartin | chandankumar: only failing test is from neutron plugin - neutron_tempest_plugin.scenario.test_security_groups.NetworkSecGroupTest.test_multiple_ports_portrange_remote | 08:50 |
*** ykarel|lunch is now known as ykarel | 08:51 | |
chandankumar | kopecmartin, does it was passing earlier? | 08:52 |
*** sshnaidm|afk is now known as sshnaidm | 08:52 | |
kopecmartin | chandankumar: yes, when you check older gate runs the tests passed there .. it's a timeout issue so it doesn't have to occur all the time? | 08:53 |
chandankumar | kopecmartin, ok, let's just open a bug and go with bump | 08:54 |
kopecmartin | chandankumar: ok, these two reviews are needed for the bump https://review.rdoproject.org/r/#/c/26777/ https://review.rdoproject.org/r/#/c/26769/ | 08:54 |
chandankumar | marios, Hello | 09:12 |
chandankumar | marios, do we have a patch up for fs039 with to_build flag? | 09:12 |
marios | chandankumar: o/ no i didn't post something there | 09:14 |
panda | marios: do you know what's the public net to use to assign floating IPs in Ψ ? | 09:14 |
chandankumar | marios, let me put a patch up and see how it goes | 09:14 |
chandankumar | panda, what is Ψ ? | 09:14 |
chandankumar | it appears to shiva's trident | 09:15 |
panda | chandankumar: https://en.wikipedia.org/wiki/Psi_(Greek) | 09:15 |
marios | panda: yeah let me check my instance sec | 09:16 |
marios | panda: pvt | 09:16 |
chandankumar | panda, ah great, thanks :-) | 09:17 |
chandankumar | dpawlik, image issue fixed now thanks! | 09:19 |
*** ysandeep|lunch is now known as ysandeep | 09:25 | |
*** skramaja has quit IRC | 09:37 | |
*** skramaja_ has joined #oooq | 09:37 | |
chandankumar | marios, panda zbr sshnaidm weshay|ruck rdo-cloud will be staying till may end, may 6 date got postponed, we will get new dates in June | 09:49 |
marios | chandankumar: ack | 09:49 |
panda | chandankumar: yey! | 09:49 |
sshnaidm | chandankumar, cool | 09:50 |
sshnaidm | we have 2 clouds in parallel | 09:50 |
sshnaidm | let's go nuts | 09:50 |
chandankumar | sshnaidm, yes | 09:51 |
chandankumar | sshnaidm, regarding this task https://tree.taiga.io/project/tripleo-ci-board/task/1716 jpena will create a user story on this board to track and mhu has some plans on that | 09:53 |
chandankumar | *their | 09:53 |
sshnaidm | chandankumar, great, hope they will find out somehting | 09:54 |
bhagyashris|ruck | panda, i see in one place they have mentioned enabled_providerd_driver like this https://opendev.org/openstack/ovn-octavia-provider/src/branch/master/zuul.d/base.yaml | 10:06 |
bhagyashris|ruck | panda, i think whatever you defined seems correct to me | 10:07 |
bhagyashris|ruck | panda, not sure is this causing failure or not | 10:08 |
*** ysandeep is now known as ysandeep|brb | 10:09 | |
*** udesale_ has joined #oooq | 10:18 | |
*** dpawlik has quit IRC | 10:21 | |
*** udesale has quit IRC | 10:21 | |
*** dpawlik has joined #oooq | 10:21 | |
chandankumar | marios, running fs039 here https://review.rdoproject.org/r/#/c/27431/ | 10:22 |
marios | chandankumar: ack | 10:27 |
*** bogdando has left #oooq | 11:00 | |
*** ysandeep|brb is now known as ysandeep | 11:11 | |
*** rfolco has joined #oooq | 11:16 | |
*** jpena is now known as jpena|lunch | 11:33 | |
*** chem has quit IRC | 11:48 | |
*** chem has joined #oooq | 11:53 | |
*** amoralej is now known as amoralej|lunch | 11:58 | |
*** skramaja_ is now known as skramaja | 12:06 | |
chandankumar | bhagyashris|ruck, does on c7 train promotion, sc4 and sc7 passing? | 12:06 |
*** ratailor has quit IRC | 12:07 | |
bhagyashris|ruck | chandankumar, c7 sc7 is non voting but it's passing https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-latest-released&job_name=periodic-tripleo-ci-centos-7-scenario007-standalone-train | 12:08 |
bhagyashris|ruck | chandankumar, sc4 is also passing https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-latest-released&job_name=periodic-tripleo-ci-centos-7-scenario004-standalone-train | 12:09 |
chandankumar | bhagyashris|ruck, ok thanks it is failing on c8 looking into it | 12:09 |
bhagyashris|ruck | chandankumar, ok | 12:09 |
panda | marios: are you still using your instance mariossprint24task1597 ? | 12:13 |
marios | panda: not right now am not ... do you need it? | 12:13 |
chandankumar | weshay|ruck, Hola around? | 12:13 |
panda | marios: just as a gateway to access the internal promoter, I can't allocate more fips | 12:14 |
marios | panda: sure np go ahead i think you should be able to get onto it | 12:14 |
panda | marios: I would maybe need to install ansible a copy a few files | 12:14 |
marios | panda: do whatever you want | 12:14 |
panda | marios: ok, rm -rf / | 12:14 |
marios | panda: yes, would it help if i deleted it? do we have a quota issue i mean? | 12:14 |
marios | panda: would you be able to create a new one? | 12:15 |
panda | marios: no, we have 5 IP and a quota of 100 | 12:15 |
panda | marios: I opened a ticket. | 12:15 |
weshay|ruck | chandankumar, 0/ | 12:15 |
marios | panda: k | 12:15 |
chandankumar | weshay|ruck, on train c8, on standalone side sc7 and sc4 is failing | 12:15 |
chandankumar | fs01 is running | 12:15 |
weshay|ruck | k.. ya.. I was wondering if we needed to change ceph at all for sc4 | 12:16 |
panda | marios: I'm in, thanks | 12:16 |
chandankumar | https://logserver.rdoproject.org/20/26920/22/check/periodic-tripleo-ci-centos-8-scenario004-standalone-train/344fbcf/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 12:16 |
marios | panda: ack | 12:16 |
weshay|ruck | chandankumar, "<13>May 12 10:40:54 puppet-user: Error: Facter: error while resolving custom fact \"rabbitmq_nodename\": undefined method `[]' for nil:NilClass", | 12:17 |
*** rlandy has joined #oooq | 12:18 | |
*** ratailor has joined #oooq | 12:20 | |
chandankumar | weshay|ruck, yes it is for sc4 and sc7 router is not able to pingable | 12:21 |
rlandy | marios: hey | 12:22 |
rlandy | marios: see we got a fix: https://review.opendev.org/#/c/727087/ | 12:22 |
rlandy | marios: I merged the pipeline and it ran | 12:23 |
chandankumar | weshay|ruck, once the job finishes, I will add those c8 train jobs to pipeline | 12:24 |
marios | rlandy: o/ hey | 12:26 |
*** rfolco is now known as rfolco|rover | 12:27 | |
marios | rlandy: yeah so the job ran in the pipeline but was faining on reposetup get hash ... so i spent time debugging that (long story short wasted time) cos i posted https://review.opendev.org/727146 but then found your abandoned one https://review.opendev.org/725974 and finally the proper one at https://review.opendev.org/#/c/720776 :/ | 12:27 |
marios | rlandy: running in test now at https://code.engineering.redhat.com/gerrit/#/c/200050/ (with https://review.opendev.org/725974 which ill re-abandon after the run finishes) | 12:27 |
marios | rlandy: once it hits the bug we can request a hold cos damien wanted to check something on there for the mysql fix | 12:27 |
marios | rlandy: want to get on phone in half hour? | 12:28 |
*** TrevorV has joined #oooq | 12:28 | |
*** Goneri has joined #oooq | 12:29 | |
weshay|ruck | zbr, https://meet.google.com/kdr-uzwf-yss?authuser=1 | 12:31 |
bhagyashris|ruck | panda, can you rebase this https://review.rdoproject.org/r/#/c/26694/ as it's in merge conflict | 12:33 |
*** ratailor has quit IRC | 12:33 | |
*** zbr_ has joined #oooq | 12:35 | |
*** zbr_ has quit IRC | 12:36 | |
rlandy | marios: sure - thanks | 12:38 |
rlandy | pojadhav: weshay|ruck; the final tls patch merged last night :) | 12:38 |
*** jpena|lunch is now known as jpena | 12:40 | |
rlandy | marios: mind w+'ing https://review.opendev.org/#/c/725253? | 12:41 |
*** Goneri has quit IRC | 12:41 | |
marios | rlandy: ack | 12:42 |
rlandy | thank you | 12:42 |
rlandy | pojadhav: ^^ both your trigger patches are w+'ed | 12:44 |
*** Goneri has joined #oooq | 12:47 | |
rlandy | marios; it looks like the deploy past the bug | 12:47 |
rlandy | ugh | 12:47 |
rlandy | it didn't | 12:48 |
marios | rlandy: yeah just failed the deploy waiting for log (but i also need to change the depends-on to use the 'proper fix' | 12:48 |
marios | rlandy: i mean for the get hash | 12:48 |
rlandy | marios: ok - when you start the job, I'll get that node held | 12:49 |
marios | rlandy: i'll also add damien fix there | 12:49 |
rlandy | cool | 12:49 |
marios | brb | 12:49 |
marios | rlandy: oh wait... i think we need it to fail for the hold? i.e. if we add the fix there it wont fail and we can't hold it? i think that's the case | 12:52 |
pojadhav | rlandy, awsome :) | 12:53 |
chandankumar | rlandy, marios https://review.rdoproject.org/r/#/c/26909/ and then this https://review.rdoproject.org/r/26908 | 12:54 |
rlandy | marios: no need for it to fail | 12:54 |
rlandy | we can hold it as soon as the job starts | 12:54 |
chandankumar | please have a look | 12:54 |
marios | rlandy: ok cool then i'll add the change (i recall this from rdo zuul but maybe am confusing different things) | 12:55 |
rlandy | chandankumar: need to change the name of your image jobs from master -> rhos-17 | 12:55 |
rlandy | also, where are we with the image server? | 12:55 |
rlandy | chandankumar: worth it to ping apevec again? | 12:55 |
marios | rlandy: not sure if fbo is in btw going to rhos-ops | 12:56 |
chandankumar | rlandy, sure pinging him | 12:56 |
rlandy | marios: nhicher can do that for us | 12:56 |
rlandy | chandankumar: thanks - I'll change the job names later | 12:57 |
marios | rlandy: k asked him | 12:58 |
rlandy | great | 12:58 |
marios | chandankumar: ack noting for check later | 12:58 |
sshnaidm | weshay|ruck, mtg? | 13:02 |
*** TrevorV has quit IRC | 13:02 | |
*** amoralej|lunch is now known as amoralej | 13:02 | |
*** TrevorV has joined #oooq | 13:03 | |
*** TrevorV has quit IRC | 13:05 | |
rlandy | chandankumar: marios: hey - could you check the current-tripleo release file? - I merged it to try a component job - but can fix in a follow up patch ... http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/config/release/rhos-17.yml | 13:05 |
ykarel | i noticed rhel8 build containers still running, shouldn't these be cleaned considering it's broken and centos8 train is being prepared | 13:06 |
ykarel | weshay|ruck, bhagyashris|ruck ^^ | 13:06 |
ykarel | https://review.rdoproject.org/zuul/builds?job_name=tripleo-build-containers-rhel-8-train&job_name=tripleo-build-containers-rhel-8-train-branch# | 13:06 |
*** TrevorV has joined #oooq | 13:06 | |
*** sanjayu_ has joined #oooq | 13:10 | |
*** saneax has quit IRC | 13:12 | |
chandankumar | rlandy, rhos-17 release file looks good, tempest_container_namespace: openstack-tempest | 13:14 |
chandankumar | tempest_container_tag: "{{ container_build_id }}" not needed, as tempest container not used for running tempest | 13:14 |
rlandy | chandankumar: thanks | 13:14 |
*** chem has quit IRC | 13:15 | |
*** chem has joined #oooq | 13:17 | |
rlandy | marsio; I wonder of that needs to be on the skip list | 13:19 |
rlandy | marios: ^^ | 13:20 |
rlandy | chandankumar: build-test-packages ... failing on a depends-on change from puppet-tripleo | 13:20 |
rlandy | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/build-test-packages/defaults/main.yml#L62 | 13:20 |
rlandy | should that repo be included in ^^? | 13:20 |
bhagyashris|ruck | ykarel, periodic version of those jobs ^ are not present thats why may be those are not notice but i think we can remove that | 13:21 |
chandankumar | rlandy, I think yes | 13:21 |
rlandy | chandankumar: stupid question ... | 13:21 |
chandankumar | or rdo-jobs should take care of that | 13:21 |
rlandy | how do we get the depends-on change then? | 13:21 |
chandankumar | sorry build test packages will take care of that via rdopkg | 13:21 |
ykarel | bhagyashris|ruck, yes please remove, periodic ones were removed earlier, so these are likely missed | 13:22 |
bhagyashris|ruck | ykarel, ack | 13:22 |
rlandy | chandankumar: ok - we get http://pastebin.test.redhat.com/864083 | 13:22 |
rlandy | marios: ok - we need another patch for that job | 13:22 |
rlandy | marios: to add puppet-tripleo to skip list | 13:23 |
rlandy | let's run once to see if it works | 13:23 |
rlandy | then we can run again and ask to hold node | 13:23 |
chandankumar | -info-repo needs to be changed to ospinfo | 13:23 |
chandankumar | not rdoinfo | 13:23 |
weshay|ruck | ysandeep, sshnaidm is going to contact you for a usability review of the reproducer | 13:24 |
rfolco|rover | panda, did you run a testproject for ovn job fix ? | 13:24 |
rfolco|rover | https://review.rdoproject.org/r/#/c/26694/ | 13:24 |
rfolco|rover | panda, ^ | 13:24 |
marios | rlandy: ack are you posting it? | 13:24 |
weshay|ruck | ysandeep, ping sshnaidm w/ questions or concerns | 13:24 |
rlandy | oh gee | 13:24 |
panda | rfolco|rover: no | 13:24 |
rlandy | marios: we're testing an upstream change with a downstream job | 13:24 |
rlandy | how can that work? | 13:25 |
ysandeep | weshay|ruck, sure o/ | 13:25 |
rfolco|rover | panda, ok, thanks | 13:25 |
panda | rfolco|rover: this was supposet to be aquick fix :( | 13:25 |
chandankumar | rlandy, https://code.engineering.redhat.com/gerrit/gitweb?p=ospinfo.git;a=tree;h=refs/heads/master;hb=refs/heads/master | 13:25 |
panda | rfolco|rover: and it has become a nightmare. | 13:25 |
rfolco|rover | panda, why | 13:25 |
rfolco|rover | don't see any objections or concerns in the patch | 13:25 |
marios | rlandy: ah... i mean if it was a case of applying it it *could* work i.e. they should be pretty up to date but might not be if there are rebase issues | 13:26 |
rfolco|rover | it just didn't get merged, isn't it ? | 13:26 |
rfolco|rover | panda, ^ | 13:26 |
panda | rfolco|rover: because an obscure conf option was missing in the config option itself | 13:26 |
panda | and now it's taking a lot for the jobs | 13:26 |
rlandy | marios: let's rethink this ... | 13:27 |
rlandy | marios: pupper-tripleo - is there a downstream equivalent? | 13:27 |
marios | rlandy: dlrn urls will be different too for buid-test-packages ? | 13:27 |
marios | rlandy: i think there must be | 13:27 |
marios | rlandy: checking | 13:27 |
rlandy | then we need to apply that fix to the downstream repo | 13:28 |
chandankumar | rlandy, puppet-tripleo https://code.engineering.redhat.com/gerrit/gitweb?p=ospinfo.git;a=blob;f=packages.yml;h=be9ab79f75f11b31bf85689b686bfa988b575ea2;hb=refs/heads/master#l5805 | 13:29 |
marios | rlandy: yeah there is | 13:29 |
rfolco|rover | arxcruz, rfolco, zbr, panda, sshnaidm, rlandy, marios, ysandeep, bhagyashris, soniya29, pojadhav, akahat, weshay, chandankumar | 13:30 |
rfolco|rover | community mtg | 13:30 |
marios | rlandy: lets carry on after calls | 13:30 |
rfolco|rover | ping arxcruz, rfolco, zbr, panda, sshnaidm, rlandy, marios, ysandeep, bhagyashris, soniya29, pojadhav, akahat, weshay, chandankumar | 13:30 |
rfolco|rover | community mtg | 13:30 |
chandankumar | weshay|ruck, periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-train https://review.rdoproject.org/zuul/build/2b2f7ccd17e54eeb9c208197a18d84fb : SUCCESS in 3h 14m 04s | 13:37 |
weshay|ruck | oh fuck ya! | 13:38 |
zbr | am i wrong or google is forcing me to user chrome in order to use meet? | 13:41 |
panda | zbr: I am connected from firefox | 13:42 |
zbr | but i wanted a standalone app, not a browser. | 13:42 |
chandankumar | weshay|ruck, https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/build-test-packages/defaults/main.yml#L6 | 13:43 |
zbr | so I can easily kill it, not having a hidden tab somewhere streaming how I sleep during the day | 13:43 |
zbr | and fun, apparently there is no option to signout from a single account, only from all. | 13:45 |
*** openstackstatus has quit IRC | 13:53 | |
*** openstackstatus has joined #oooq | 13:53 | |
*** ChanServ sets mode: +v openstackstatus | 13:53 | |
panda | marios: what's the starting data of your script? just repos ? | 14:00 |
marios | panda: yeah it checks out the repos and uses grep basically | 14:02 |
sshnaidm | rlandy, can you take a look please in your time: https://review.opendev.org/#/c/726847/ | 14:02 |
sshnaidm | rlandy, if possible, would be nice to have dw job on htat | 14:02 |
sshnaidm | I mean bm | 14:02 |
rlandy | sshnaidm: ok - will do a run on that this afternoon | 14:06 |
marios | rlandy: ykarel: re-added your keys now to the new node @ zuul@10.0.109.125 | 14:06 |
weshay|ruck | chandankumar, when's a good time to sync about rdopkg/train.. don't want to overload you w/ stupid mtgs | 14:19 |
ykarel | marios, ack i can access | 14:24 |
*** ysandeep is now known as ysandeep|afk | 14:26 | |
chandankumar | weshay|ruck, we can sync right now | 14:36 |
weshay|ruck | chandankumar, k.. https://meet.google.com/xda-grzq-izz | 14:36 |
chandankumar | weshay|ruck, https://review.opendev.org/#/q/topic:buildtestpackages+(status:open+OR+status:merged) | 14:37 |
chandankumar | weshay|ruck, https://hackmd.io/LuRWE2oESKiAUQQw6OYh6w | 14:39 |
*** dtantsur is now known as dtantsur|afk | 15:08 | |
*** ysandeep|afk is now known as ysandeep | 15:11 | |
weshay|ruck | sshnaidm, https://review.opendev.org/#/c/727227/ | 15:23 |
sshnaidm | weshay|ruck, broken? | 15:24 |
weshay|ruck | sshnaidm, https://bugs.launchpad.net/tripleo/+bug/1878101 | 15:24 |
openstack | Launchpad bug 1878101 in tripleo "ping br-ctlplane is failing too often, "Trying to ping default gateway"" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 15:24 |
arxcruz | rlandy around? | 15:28 |
arxcruz | rlandy: I'm getting Unknown project opendev.org/openstack/openstack-tempest-skiplist | 15:28 |
arxcruz | rlandy: in https://review.opendev.org/#/c/726843/ | 15:28 |
rlandy | arxcruz: where are you getting that error? | 15:28 |
rlandy | looking | 15:28 |
arxcruz | rlandy: on rdo side | 15:28 |
rlandy | arxcruz: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul/rdo.yaml#L1082 | 15:30 |
rlandy | needs to be added to projects that can be included | 15:30 |
arxcruz | rlandy: ok, thanks | 15:30 |
*** jmasud has joined #oooq | 15:35 | |
*** skramaja has quit IRC | 15:52 | |
*** marios is now known as marios|out | 16:07 | |
weshay|ruck | rfolco|rover, only thing a bit whacky atm.. is the upstream gate.. | 16:26 |
rfolco|rover | yup | 16:26 |
weshay|ruck | rfolco|rover, going to look at the criteria for releases and make sure they are right.. | 16:26 |
weshay|ruck | rfolco|rover, hot issues to track https://trello.com/c/E7gL6d4b/1490-cixlp1878101tripleociproa-ping-br-ctlplane-is-failing-too-often-trying-to-ping-default-gateway | 16:27 |
rfolco|rover | weshay|ruck, besides the jobs we moved to nv, is there anything else we can do to make gate great again? | 16:27 |
weshay|ruck | https://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-undercloud-upgrades | 16:28 |
weshay|ruck | rfolco|rover, ya.. try and drive a fix via cix | 16:28 |
weshay|ruck | the gate is mostly random atm.. very unstable compared to early last week and several weeks prior | 16:29 |
*** marios|out has quit IRC | 16:29 | |
*** ccamacho has quit IRC | 16:31 | |
*** holser has quit IRC | 16:31 | |
*** holser has joined #oooq | 16:33 | |
weshay|ruck | zbr++ thanks for https://review.opendev.org/#/c/727113/ | 16:38 |
*** dpawlik has quit IRC | 16:40 | |
*** udesale_ has quit IRC | 16:41 | |
*** amoralej is now known as amoralej|off | 16:42 | |
zbr | weshay|ruck: funny part that the correct fix was removal in that case. | 16:46 |
zbr | mainly it failed, but it was not linting anything there. | 16:46 |
zbr | ping me if there are other places where we see failures. | 16:46 |
weshay|ruck | k.. thanks | 16:47 |
*** ykarel is now known as ykarel|away | 16:55 | |
weshay|ruck | sshnaidm, just confirming what I see | 16:58 |
weshay|ruck | https://review.rdoproject.org/r/#/q/owner:%22Sagi+Shnaidman+%253Csshnaidm%2540redhat.com%253E%22 | 16:58 |
weshay|ruck | eveyrthing is on vexx now? | 16:58 |
sshnaidm | weshay|ruck, promotion? | 17:00 |
sshnaidm | weshay|ruck, all promotion jobs are there, yes | 17:00 |
weshay|ruck | cool | 17:00 |
weshay|ruck | looks like component as well? | 17:00 |
sshnaidm | weshay|ruck, yep | 17:00 |
weshay|ruck | sshnaidm++ | 17:01 |
sshnaidm | weshay|ruck, didn't move yet github jobs, reproducer jobs, etc | 17:01 |
weshay|ruck | rfolco|rover, fyi.. NetworkSecGroupTest is failing across stein and train e.g. https://logserver.rdoproject.org/openstack-periodic-24hr/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-stein/68f40d9/logs/tempest.html.gz | 17:01 |
weshay|ruck | worth lp, skip, cix | 17:01 |
weshay|ruck | sshnaidm, aye | 17:01 |
weshay|ruck | sshnaidm, how about the other 3rd party ci.. 35, 39 | 17:01 |
sshnaidm | weshay|ruck, 4th party ci? :)\ | 17:02 |
weshay|ruck | lol | 17:02 |
rfolco|rover | weshay|ruck, ack, adding to skip list | 17:03 |
weshay|ruck | rfolco|rover, need a lp first :) | 17:03 |
*** derekh has quit IRC | 17:03 | |
rfolco|rover | weshay|ruck, I am just checking if fs020 is the same as reported by bhagyashris|ruck | 17:03 |
rfolco|rover | TestNetworkAdvancedServerOps | 17:05 |
rfolco|rover | looks diff | 17:05 |
rfolco|rover | ok | 17:05 |
bhagyashris|ruck | rfolco|rover, this is diff | 17:05 |
*** jpena is now known as jpena|off | 17:14 | |
bhagyashris|ruck | rfolco|rover, this job is consistently failing on stein only | 17:15 |
rfolco|rover | sometimes on train | 17:15 |
bhagyashris|ruck | rfolco|rover, but very few times and error is also diff | 17:18 |
bhagyashris|ruck | on train | 17:18 |
*** ysandeep is now known as ysandeep|away | 17:19 | |
*** apetrich has quit IRC | 17:20 | |
bhagyashris|ruck | rfolco|rover, ahh i see in more detail both are same | 17:21 |
bhagyashris|ruck | my bad | 17:21 |
*** yolanda has quit IRC | 17:35 | |
rfolco|rover | weshay|ruck, bhagyashris|ruck https://review.opendev.org/727287 [skiplist] NetworkSecGroupTest timeout | 17:47 |
rlandy | weshay|ruck: so I read through the new container generation tools spec - after today's meeting - with interest in the component pipeline testing piece | 17:58 |
rlandy | pls ping me if/when you have a moment to discuss | 17:58 |
rlandy | ie: if we should start with this approach downstream | 17:59 |
rlandy | irrespective of when reldel picks it up | 17:59 |
*** jmasud has quit IRC | 18:16 | |
chandankumar | rlandy, I am back now, Anything I can help to update this piece https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/build-test-packages/tasks/main.yml#L206-L211 for downstream bits | 18:18 |
*** jmasud has joined #oooq | 18:18 | |
rlandy | chandankumar: hey | 18:19 |
rlandy | so a couple of thins | 18:19 |
rlandy | things | 18:19 |
rlandy | 1, I think that project is not added to projects that can be included in zuul | 18:20 |
rlandy | checking that | 18:20 |
rlandy | chandankumar: also, only changes to branch master are picked up | 18:21 |
rlandy | chandankumar: build-test-packages would have to be able to pick up changes on diff branches | 18:21 |
rlandy | chandankumar: <jpena> rlandy: I'd try to use the zuul dict, instead of the legacy env vars | 18:22 |
rlandy | chandankumar: this will require some work to build-test-packages | 18:22 |
rlandy | which we may or may not want to put in | 18:22 |
rlandy | I don't see how else we check downstream changes | 18:22 |
rlandy | - puppet-tripleo: | 18:23 |
rlandy | zuul/include: [] | 18:23 |
rlandy | repoxplorer/skip: true | 18:23 |
rlandy | actually it is there | 18:23 |
rlandy | so then we need the branch thing | 18:24 |
rlandy | chandankumar: ^^ | 18:24 |
chandankumar | rlandy, I am checking this https://sf.hosted.upshift.rdu2.redhat.com/logs/84/200084/3/check/periodic-tripleo-ci-rhel-8-standalone-rhos-17/3322e5b/logs/zuul-variables.yaml | 18:25 |
chandankumar | rlandy, branch: rhos-17.0-trunk-patches | 18:25 |
rlandy | chandankumar: correct - zuul knows about the right branch | 18:25 |
rlandy | but build-test-packages only picks up master changes | 18:26 |
rlandy | 2020-05-12 10:55:23.475381 | primary | ZUUL_CHANGES=openstack/tripleo-quickstart:master:refs/changes/76/720776/18^openstack/tripleo-quickstart-extras:master:refs/changes/00/727200/2^openstack/tripleo-ci:master:refs/changes/96/727196/1^openstack/tripleo-ci-internal-jobs:master:refs/changes/84/200084/1 | 18:26 |
rlandy | chandankumar: ^^ that is the missing piece | 18:26 |
rlandy | chandankumar: hence jpena's suggestion ... | 18:27 |
rlandy | <jpena> and it looks like it is trying to use that env var to build the list of changes | 18:27 |
rlandy | <rlandy> jpena: zuul/dlrn is doing fine - our role needs work | 18:27 |
rlandy | <jpena> rlandy: I'd try to use the zuul dict, instead of the legacy env vars | 18:27 |
chandankumar | rlandy, let me check how to use zuul dict | 18:33 |
rlandy | chandankumar: see zuul.items | 18:34 |
rlandy | branch change etc. | 18:35 |
*** jmasud has quit IRC | 18:42 | |
chandankumar | rlandy, how to get this one refs/changes/84/200084/1 ? | 18:47 |
rlandy | looking | 18:48 |
*** jmasud has joined #oooq | 18:50 | |
rlandy | chandankumar: refs/changes/zuul.items[i].change{last two digits}/zuul.items[i].change/zuul.items[i].patchset | 18:51 |
rlandy | ref: refs/changes/84/200084/3 | 18:52 |
rlandy | chandankumar: ^^ the patch itself is actually there | 18:52 |
chandankumar | rlandy, not sure it will work https://review.opendev.org/#/c/727200/3/roles/build-test-packages/tasks/main.yml | 18:57 |
rlandy | chandankumar: let's try it | 18:57 |
chandankumar | rlandy, rebased the downstream patch | 18:57 |
rlandy | chandankumar++ | 18:58 |
chandankumar | not sure about loop dict part | 18:58 |
rlandy | we'll see | 18:58 |
rlandy | we can fix it of need be | 18:58 |
rlandy | chandankumar: it's late for you - I can pick this up | 19:15 |
rlandy | or we can continue tomorrow | 19:15 |
* rlandy just merges pipeline changes | 19:16 | |
*** apetrich has joined #oooq | 19:17 | |
weshay|ruck | ugh.. 1.5 hour debug on undercloud install | 19:17 |
weshay|ruck | rlandy, os-net-config ugh | 19:18 |
rlandy | charming | 19:18 |
rlandy | weshay|ruck: no rush - we can chat at 1-on-1 tomorrow | 19:18 |
*** apetrich has quit IRC | 19:18 | |
weshay|ruck | rfolco|rover, fyi.. that undercloud-containers bug sucks | 19:19 |
rfolco|rover | weshay|ruck, why | 19:19 |
*** apetrich has joined #oooq | 19:19 | |
chandankumar | rlandy, I got an idea | 19:19 |
chandankumar | rlandy, we donot need this script at all https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/build-test-packages/library/zuul_deps.py#L60 | 19:20 |
chandankumar | rlandy, we just need a list | 19:20 |
chandankumar | rlandy, we can construct that using anible | 19:20 |
rlandy | chandankumar: ok | 19:20 |
rfolco|rover | weshay|ruck, all I could find is that ctlplane is weird https://trello.com/c/E7gL6d4b/1490-cixlp1878101tripleociproa-ping-br-ctlplane-is-failing-too-often-trying-to-ping-default-gateway | 19:22 |
weshay|ruck | rfolco|rover, comments https://1ee15b38e5321bd48ce9-8aefe49572c9ad91eb217e6fb5236bb6.ssl.cf2.rackcdn.com/712464/20/gate/tripleo-ci-centos-8-undercloud-containers/0639b3e/logs/undercloud/var/lib/tripleo-config/scripts/ | 19:22 |
*** dsneddon has joined #oooq | 19:32 | |
chandankumar | rlandy, now see https://review.opendev.org/#/c/727200/4/roles/build-test-packages/tasks/main.yml feel free to update it | 19:36 |
*** jmasud has quit IRC | 19:50 | |
weshay|ruck | rfolco|rover, put comments on the skip list review | 19:54 |
*** TrevorV has quit IRC | 19:54 | |
rfolco|rover | weshay|ruck, thx, will remove train | 19:56 |
rfolco|rover | weshay|ruck, help on prog call report, can we say we are green in the middle of the storm ? | 19:58 |
rlandy | chandankumar: thanks | 19:59 |
weshay|ruck | rfolco|rover, status is for train / osp-16 | 19:59 |
weshay|ruck | rfolco|rover, the status you report are the dates for tripleo and rdo promotion based on http://rhos-release.virt.bos.redhat.com:3030/rhosp | 20:00 |
rfolco|rover | weshay|ruck, green. period. | 20:00 |
weshay|ruck | rfolco|rover, you can add a note about upstream gate issues, but they won't care about that | 20:00 |
rfolco|rover | no thanks :) | 20:00 |
weshay|ruck | rfolco|rover, re: the undercloud-containers bug.. | 20:02 |
weshay|ruck | the code is what's so nuts.. old old tripleo bits | 20:02 |
weshay|ruck | follow https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/net-config-undercloud.j2.yaml -> https://opendev.org/openstack/tripleo-heat-templates/blame/branch/master/network/scripts/run-os-net-config.sh -> https://github.com/openstack/os-net-config | 20:03 |
weshay|ruck | rlandy, stamp https://review.opendev.org/#/c/727287/ | 20:04 |
rlandy | weshay|ruck: stamped | 20:04 |
weshay|ruck | thanks | 20:05 |
rfolco|rover | weshay|ruck, for some reason ctlplane is misconfigured with physical dev ip while it should be the bridge one | 20:08 |
rfolco|rover | weshay|ruck, looking at the code | 20:08 |
weshay|ruck | ya.. you get a dupe ip | 20:09 |
weshay|ruck | but some nodes have two network devices and some have just one | 20:09 |
rfolco|rover | this is not the problem. I compared good runs and bad ones w/ single nic | 20:11 |
*** dpawlik has joined #oooq | 20:17 | |
*** sshnaidm is now known as sshnaidm|afk | 20:18 | |
weshay|ruck | rfolco|rover, have you seen any undercloud-containers centos-8 job fail that had two nics? | 20:18 |
weshay|ruck | just checking because I have not | 20:19 |
weshay|ruck | rfolco|rover, good news.. is the gate seems to be stablizing | 20:28 |
rfolco|rover | weshay|ruck, I think I saw one job w/ 2 nics that failed... let me find it | 20:33 |
rfolco|rover | weshay|ruck, 2 nic failure https://6c0545a7fde0c843fe58-c94b7832c8857c8bbfdc284b48fd4077.ssl.cf2.rackcdn.com/722275/3/check/tripleo-ci-centos-8-undercloud-containers/3665c4e/logs/undercloud/var/log/extra/network.txt | 20:41 |
weshay|ruck | ah.. look at that | 20:42 |
*** jmasud has joined #oooq | 20:42 | |
weshay|ruck | thanks | 20:42 |
* weshay|ruck adds to bug.. | 20:42 | |
weshay|ruck | rfolco|rover, keep the technical bits in the bug.. generally.. use the trello board for nags, handoff, team communication etc. | 20:43 |
*** sanjayu_ has quit IRC | 20:43 | |
rfolco|rover | weshay|ruck, ok | 20:43 |
weshay|ruck | rfolco|rover, add your find to https://bugs.launchpad.net/tripleo/+bug/1878101 | 20:44 |
openstack | Launchpad bug 1878101 in tripleo "ping br-ctlplane is failing too often, "Trying to ping default gateway"" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 20:44 |
weshay|ruck | rfolco|rover, tomorrow can we build a test project job that launches like 5 undercloud-containers deployments w/ kevin's patch? | 20:44 |
rfolco|rover | weshay|ruck, I can prepare one now if you link me to it | 20:51 |
weshay|ruck | rfolco|rover, in the bug | 20:51 |
rfolco|rover | ah of course | 20:51 |
weshay|ruck | rfolco|rover, k.. just don't want to keep you too late.. so just looking for 5 dupe jobs slightly diff name I guess.. but just to blast away w/ that patch | 20:52 |
weshay|ruck | since we're hitting something that is inconsistent | 20:52 |
rfolco|rover | why 5 diff ? | 20:53 |
rfolco|rover | weshay|ruck, rationale ? | 20:53 |
weshay|ruck | rfolco|rover, will zuul run w/ dupe names? if so fine | 20:53 |
weshay|ruck | just wasn't sure | 20:53 |
rfolco|rover | ah you want 5 runs of same | 20:54 |
weshay|ruck | aye | 20:54 |
rfolco|rover | k | 20:54 |
weshay|ruck | centos-8-undercloud-containers.. blasted.. at least 5 | 20:54 |
weshay|ruck | rlandy, https://review.opendev.org/#/c/727438/ | 20:58 |
rlandy | replacement change? | 20:58 |
weshay|ruck | https://trello.com/c/dxk6rZ61/1489-cixbz1834348componentstandalonepuppet-tripleoosp17rhel8rhel8-osp17-standalone-job-failing-downstream-unknown-function-mysqlpassw | 20:58 |
rlandy | weshay|ruck: ok - let's see if we can test that downstream | 20:59 |
rfolco|rover | weshay|ruck, https://review.rdoproject.org/r/#/c/27453/ | 21:05 |
rfolco|rover | ttyl | 21:06 |
*** rfolco|rover is now known as rfolco|rover|off | 21:06 | |
weshay|ruck | rfolco|rover|off, perfect :) | 21:06 |
weshay|ruck | thanks | 21:06 |
*** jfrancoa has left #oooq | 21:08 | |
*** jfrancoa has quit IRC | 21:08 | |
*** jmasud has quit IRC | 21:09 | |
*** jbadiapa has quit IRC | 21:17 | |
*** jmasud has joined #oooq | 21:23 | |
rlandy | weshay|ruck: fyi - waiting on a passing standalone to merge: https://code.engineering.redhat.com/gerrit/#/q/topic:component-pipeline-templates+(status:open+OR+status:merged) | 21:24 |
rlandy | pipelines ready to go | 21:25 |
weshay|ruck | rlandy, why wait? | 21:41 |
*** panda has quit IRC | 21:51 | |
*** panda has joined #oooq | 21:53 | |
rlandy | we'll get tons of failures | 22:09 |
*** holser has quit IRC | 22:11 | |
*** jmasud has quit IRC | 22:17 | |
*** jmasud has joined #oooq | 22:19 | |
*** sanjayu_ has joined #oooq | 23:02 | |
rlandy | weshay|ruck: rethinking where we should put the internal criteria file | 23:13 |
rlandy | weshay|ruck: originally we said in tripleo-environments | 23:14 |
rlandy | a lot of switching code around | 23:14 |
*** tosky has quit IRC | 23:14 | |
*** sanjayu_ has quit IRC | 23:19 | |
*** jmasud has quit IRC | 23:19 | |
*** jmasud has joined #oooq | 23:21 | |
weshay|ruck | rlandy, I still think it should be tripleo-environments | 23:41 |
rlandy | weshay|ruck: ok - mering all pipeline other than the promote one | 23:41 |
rlandy | we have work to do to get that code working for downstream | 23:41 |
rlandy | weshay|ruck: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/promote-hash/tasks/check-promotion-criteria.yaml#L18 | 23:42 |
weshay|ruck | rlandy, k.. was working w/ panda on that as well.. | 23:42 |
weshay|ruck | so.. tripleo-environments/ci-scripts/dlrnapi_promoter/config | 23:43 |
rlandy | weshay|ruck: alright will see what damage the component pipelines do | 23:43 |
rlandy | weshay|ruck: ack | 23:43 |
rlandy | release ... will have to be osp_release | 23:43 |
rlandy | but that;s a minor change in config | 23:43 |
rlandy | will have that change up for review | 23:43 |
weshay|ruck | https://code.engineering.redhat.com/gerrit/200194 | 23:44 |
weshay|ruck | aye | 23:44 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!