| *** sanjayu_ has quit IRC | 00:42 | |
| *** jmasud has quit IRC | 00:54 | |
| *** jmasud has joined #oooq | 00:55 | |
| *** ysandeep|away is now known as ysandeep|rover | 01:52 | |
| ysandeep|rover | weshay|ruck, o/ anything for me in handover? | 01:56 |
|---|---|---|
| *** Goneri has quit IRC | 01:59 | |
| weshay|ruck | ysandeep|rover, so we're good on promotions http://rhos-release.virt.bos.redhat.com:3030/rhosp | 02:33 |
| * weshay|ruck gets two small things | 02:33 | |
| ysandeep|rover | weshay|ruck, that's good news :) | 02:34 |
| weshay|ruck | ysandeep|rover, I think we're hoping this fixes ovb jobs https://review.opendev.org/#/c/717865/ | 02:35 |
| weshay|ruck | so anything we can do to push forward in getting fs001 / fs035 back and working is a ++ | 02:35 |
| weshay|ruck | ysandeep|rover, and lastly.. I asked chandankumar and ykarel|away to assit ade_lee w/ some packaging for tripleo-ansible-ipa.. that may be a good thing to have one of them explain the packaging process | 02:36 |
| ysandeep|rover | ack for ovb jobs, but that patch still seems wip.yesterday cloudnull was debugging further with https://review.opendev.org/#/c/717750/ | 02:38 |
| *** ysandeep|rover is now known as ysandeep|afk | 03:09 | |
| *** skramaja has joined #oooq | 03:58 | |
| *** ysandeep|afk is now known as ysandeep | 04:00 | |
| *** udesale has joined #oooq | 04:40 | |
| *** ykarel|away is now known as ykarel | 04:47 | |
| ykarel | ysandeep, is there some known mirror/network related issue in upstream jobs? | 04:54 |
| ykarel | was looking into failures in https://review.opendev.org/#/c/718477/, and most of them were mirror related | 04:54 |
| ykarel | weshay|ruck, ack /me looks into tripleo-ansible-ipa | 04:55 |
| ysandeep | ykarel, not that i am aware of.. looking at patch results | 04:56 |
| *** ysandeep is now known as ysandeep|rover | 04:56 | |
| ykarel | ysandeep|rover, ack, check if it's failing in other patches to see how wide is it | 04:57 |
| ysandeep|rover | ykarel, ack | 04:57 |
| ykarel | don't want to recheck if issue is still there | 04:57 |
| ysandeep|rover | checked job tripleo-ci-centos-8-containers-multinode its failed during puppet run https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_7bb/718477/1/check/tripleo-ci-centos-8-containers-multinode/7bbbd96/logs/undercloud/home/zuul/undercloud_install.log .. build history not bad.. checking others.. | 05:03 |
| ysandeep|rover | hmm got it in other job- [MIRROR] epel-release-8-8.el8.noarch.rpm: Curl error (6): Couldn't resolve host name for http://mirror.dfw.rax.opendev.org/centos/8/extras/x86_64/os/Packages/epel-release-8-8.el8.noarch.rpm [Could not resolve host: mirror.dfw.rax.opendev.org] | 05:05 |
| *** ratailor has joined #oooq | 05:10 | |
| ysandeep|rover | ykarel, more than mirror issue.. i see job failing during puppet run, found another job failed here https://219e7fca43e7eeaa2176-19d327c34d133e2dbd296ad72151667c.ssl.cf2.rackcdn.com/718477/1/check/tripleo-ci-centos-8-scenario002-standalone/bf577c6/logs/undercloud/home/zuul/standalone_deploy.log .. | 05:10 |
| *** marios_ has joined #oooq | 05:11 | |
| ysandeep|rover | <13>Apr 8 20:32:03 puppet-user: Error: Execution of '/bin/dnf -d 0 -e 1 -y install net-snmp' returned 1: Error: Failed to download metadata for repo 'delorean-component-baremeta | 05:11 |
| ykarel | ysandeep|rover, ^^ can also happen due to mirrors | 05:15 |
| ysandeep|rover | ykarel, ack thanks!.. looking if i can narrow it down(checking if all failed jobs used a particular mirror only).. build history looks good now for earlier failed jobs https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-scenario002-standalone&job_name=tripleo-ci-centos-8-containers-multinode&job_name=tripleo-ci-centos-8-containers-multinode | 05:18 |
| *** jbadiapa has quit IRC | 05:20 | |
| ysandeep|rover | all jobs failed were using mirror.dfw.rax.opendev.org | 05:35 |
| chandankumar | may be issue on particular cloud mirror issue | 05:36 |
| ysandeep|rover | Anaylzed passing vs failed jobs for rax dfw - for today out of 47 jobs - 45 success, 1 failed, 1 timedout http://tripleo-cockpit.usersys.redhat.com/d/VTiDErfWk/jobs-exploration?orgId=1&from=1586390400000&to=1586476799999&panelId=17&fullscreen , http://tripleo-cockpit.usersys.redhat.com/d/VTiDErfWk/jobs-exploration?orgId=1&from=1586390400000&to=1586476799999&panelId=19&fullscreen | 05:42 |
| ykarel | ysandeep|rover, ack let's see if we see it again | 05:44 |
| ysandeep|rover | ykarel, ack o/ | 05:44 |
| ykarel | ysandeep|rover, me also promotes baremetal component to promoted-components for the issue discussed on #tripleo | 05:47 |
| ykarel | and then trigger master promotion and hopefully that ironic fix works | 05:47 |
| ysandeep|rover | ykarel, okay | 05:48 |
| *** sanjayu_ has joined #oooq | 06:06 | |
| *** dpawlik has joined #oooq | 06:07 | |
| *** sanjayu__ has joined #oooq | 06:09 | |
| *** sanjayu_ has quit IRC | 06:12 | |
| *** dpawlik has quit IRC | 06:37 | |
| *** bogdando has joined #oooq | 06:39 | |
| *** dpawlik has joined #oooq | 06:39 | |
| ykarel | ysandeep|rover, is random tempest failure in train full tempest job known? | 06:51 |
| ykarel | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-train | 06:51 |
| ykarel | i see test_trunk_subport_lifecycle failed multiple times in last couple of failed runs | 06:51 |
| ysandeep|rover | ykarel, not known | 06:52 |
| ykarel | ysandeep|rover, ack please check | 06:53 |
| *** bogdando has quit IRC | 06:53 | |
| ysandeep|rover | ykarel, tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020 for this scenario or faced in multiple scenarios? | 06:53 |
| ykarel | ysandeep|rover, periodic ^^, that's only full tempest | 06:55 |
| *** bogdando has joined #oooq | 06:55 | |
| ykarel | there is also standalone full tempest, but /me didn't checked that | 06:55 |
| chandankumar | ysandeep|rover, we are still running fill tempest in train? | 06:55 |
| ykarel | me was checking https://trunk-primary.rdoproject.org/api-centos-train/api/civotes_detail.html?commit_hash=9a07da081ab55116e871add699d18371aeaed356&distro_hash=c0bb2d1483f1e35aca4f929b98f0ef60b8a163ff | 06:55 |
| chandankumar | *full | 06:55 |
| *** sshnaidm|afk is now known as sshnaidm | 06:55 | |
| ykarel | wrt tripleo-ansible-ipa and reached those failures | 06:56 |
| *** jtomasek has joined #oooq | 06:57 | |
| ysandeep|rover | chandankumar, afaik.. not for train | 06:57 |
| chandankumar | ysandeep|rover, ah it is about fs020 | 06:57 |
| *** jtomasek has quit IRC | 06:59 | |
| *** jtomasek has joined #oooq | 07:00 | |
| chandankumar | ysandeep|rover, what is tripleo-ansible-ipa issue? | 07:05 |
| chandankumar | sorry ykarel ^^ | 07:05 |
| *** dtantsur|afk is now known as dtantsur | 07:06 | |
| ykarel | chandankumar, see comment https://review.rdoproject.org/r/#/c/26341/ | 07:06 |
| ykarel | needed train promotion for centos7 and rhel8 | 07:09 |
| ykarel | and that tempest failure in train jobs | 07:09 |
| *** rfolco has quit IRC | 07:11 | |
| chandankumar | ykarel, is tempest failure consistent? | 07:12 |
| ykarel | chandankumar, random, i see some success also | 07:12 |
| ysandeep|rover | In logs couple of failure trying to reach instance and this looks bad - "NeutronError": {"message": "Router a8373112-4b28-4714-a646-93ca38d1447b could not be found", "type": "RouterNotFound", "detail" | 07:17 |
| ysandeep|rover | http://paste.openstack.org/show/791841/ | 07:25 |
| *** tosky has joined #oooq | 07:42 | |
| marios_ | sshnaidm: do you know? https://review.opendev.org/#/c/716639/14/roles/tripleo_overcloud_roles_generate/tests/test.yml cc panda | 07:43 |
| *** marios_ is now known as marios | 07:43 | |
| ysandeep|rover | chandankumar, ykarel http://paste.openstack.org/show/791844/ , i am suspecting issue with ovn - our issue seems similiar to https://bugzilla.redhat.com/show_bug.cgi?id=1765024 | 07:44 |
| openstack | bugzilla.redhat.com bug 1765024 in python-networking-ovn "Traffic not flowing between controller and compute" [Unspecified,Closed: currentrelease] - Assigned to amuller | 07:44 |
| sshnaidm | marios, I suppose for future test running | 07:44 |
| chandankumar | sshnaidm, marios, good morning | 07:45 |
| sshnaidm | marios, anyway we can remove it all roles at once if not used | 07:45 |
| marios | sshnaidm: k that's what i wrote too but didn't have any more context | 07:45 |
| marios | sshnaidm: thanks | 07:45 |
| chandankumar | sshnaidm, marios I am refactored image build based on yesterday discussion https://review.opendev.org/717043 | 07:45 |
| marios | chandankumar: ack will check | 07:46 |
| *** zbr has quit IRC | 07:46 | |
| *** zbr has joined #oooq | 07:47 | |
| *** jschlueter has quit IRC | 07:49 | |
| *** ratailor has quit IRC | 07:51 | |
| *** jschlueter has joined #oooq | 07:51 | |
| *** ratailor has joined #oooq | 07:58 | |
| ykarel | chandankumar, are rhel8 train deployment jobs still running in train? | 08:00 |
| chandankumar | ykarel, yes | 08:00 |
| ykarel | chandankumar, then if we merge https://review.rdoproject.org/r/#/c/26349/ before rhel8 promotion those jobs will start failing | 08:01 |
| chandankumar | ykarel, ok, let's signal when rhel8 promotion happens then we can merge it | 08:01 |
| ykarel | i see last promotion for rhel8 train was 2020-02-14 | 08:01 |
| ykarel | don't know if promotions are being looked after as per ^^ | 08:02 |
| chandankumar | ysandeep|rover, ^^ | 08:02 |
| *** ysandeep|rover is now known as ysandeep|lunch | 08:10 | |
| panda | are we still promoting rhel8 ? | 08:24 |
| *** derekh has joined #oooq | 08:56 | |
| *** surpatil has joined #oooq | 09:01 | |
| chandankumar | panda, we have not yet got c8 for train, so i think we need to promote rhel8 | 09:09 |
| *** ykarel is now known as ykarel|lunch | 09:09 | |
| *** dpawlik has quit IRC | 09:10 | |
| chandankumar | panda, is it possible to promote rhel8 ? | 09:10 |
| chandankumar | panda, https://review.rdoproject.org/r/#/c/26349/ is getting blocked | 09:11 |
| *** holser has joined #oooq | 09:11 | |
| *** holser has quit IRC | 09:12 | |
| *** holser has joined #oooq | 09:12 | |
| panda | chandankumar: force promote ? | 09:13 |
| *** sanjayu__ is now known as saneax_lunch | 09:14 | |
| *** ysandeep|lunch is now known as ysandeep|rover | 09:18 | |
| chandankumar | panda, let me check the status | 09:22 |
| chandankumar | panda, rhel8 job is broken from long time https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-latest-released&job_name=periodic-tripleo-ci-rhel-8-standalone-train | 09:26 |
| chandankumar | from 24 onwards | 09:26 |
| chandankumar | panda, let's leave it as it is | 09:26 |
| panda | chandankumar: so what's the plan to unblock ? | 09:27 |
| chandankumar | ykarel|lunch, let's merge it https://review.rdoproject.org/r/#/c/26349/ | 09:28 |
| chandankumar | panda, need to fix rhel 8 part | 09:28 |
| chandankumar | ysandeep|rover, do we have a bug for rhel-8 train job failure https://logserver.rdoproject.org/openstack-periodic-latest-released/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-train/aafb84f/job-output.txt | 09:29 |
| chandankumar | ? | 09:29 |
| chandankumar | ysandeep|rover, echo 'Failed to parse dlrn hash' | 09:29 |
| *** surpatil has quit IRC | 09:30 | |
| ysandeep|rover | chandankumar, i have not open/seen any bug for this issue, that job is failing from long back https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-rhel-8-standalone-train .. checking previous RR notes if that have any history about this issue. | 09:31 |
| akahat | any guess where exactly it is failing: https://review.opendev.org/#/c/718091 | 09:33 |
| ysandeep|rover | chandankumar, didn't find any existing bug for this issue. I am filing a new one | 09:33 |
| akahat | I mean it is failing in Centos-8-ovb-3ctlr_1cmop_featrset001. But what exactly failing? | 09:34 |
| *** udesale_ has joined #oooq | 09:34 | |
| chandankumar | ysandeep|rover, cool, thanks | 09:35 |
| chandankumar | akahat, https://logserver.rdoproject.org/91/718091/4/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/d540bcf/logs/undercloud/home/zuul/overcloud_prep_images.log.txt.gz | 09:36 |
| marios | chandankumar: o/ any idea about the NODE_FAILURE for code.eng internal sf zuul? i see you have same at https://code.engineering.redhat.com/gerrit/#/c/196373/ | 09:36 |
| chandankumar | akahat, 'Client' object has no attribute 'find_image' is a known issue, ysandeep|rover can help on that | 09:36 |
| akahat | chandankumar, cool. Thanks :) | 09:37 |
| *** udesale has quit IRC | 09:38 | |
| chandankumar | marios, it got fixed few mins back , happened due to switch to tripleo-ci nodepool provider to use provider_net_shared_3 | 09:38 |
| chandankumar | marios, you can recheck now | 09:38 |
| marios | chandankumar: k trying thx | 09:38 |
| ysandeep|rover | chandankumar, fyi.. https://bugs.launchpad.net/tripleo/+bug/1871809 | 09:42 |
| openstack | Launchpad bug 1871809 in tripleo "periodic-tripleo-ci-rhel-8-standalone-train job failing with "Failed to parse dlrn hash"" [High,Triaged] | 09:42 |
| marios | chandankumar: nop still happening any pointer/who did you talk to about that/? | 09:42 |
| chandankumar | marios, check with fbo on #rhos-ops | 09:42 |
| marios | chandankumar: thx | 09:42 |
| ysandeep|rover | akahat, that was a known issue which should have been fixed by promotion, https://logserver.rdoproject.org/91/718091/4/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/d540bcf/logs/undercloud/home/zuul/overcloud_prep_images.log.txt.gz was yesterday run.. fs001 is hitting another issue currently.. https://logserver.rdoproject.org/45/717145/4/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/dce4a54/logs/undercloud/home | 09:48 |
| ysandeep|rover | /zuul/overcloud_prep_images.log.txt.gz .. will be fixed in next promotion. | 09:48 |
| *** dpawlik has joined #oooq | 09:49 | |
| ysandeep|rover | akahat, your patch already got +1 from zuul, you can ignore -1 from rdo third party here.. | 09:49 |
| akahat | ysandeep|rover, cool. | 09:50 |
| akahat | ysandeep|rover, Thank you!! :) | 09:50 |
| ysandeep|rover | akahat, :) my pleasure | 09:50 |
| *** surpatil has joined #oooq | 09:51 | |
| *** ykarel|lunch is now known as ykarel | 09:51 | |
| ykarel | chandankumar, ok for me | 09:51 |
| chandankumar | ykarel, https://review.rdoproject.org/r/#/c/26272/ master one +w | 09:53 |
| chandankumar | ykarel, https://review.rdoproject.org/r/#/c/26349/1 +w it | 09:53 |
| ykarel | chandankumar, did already | 09:54 |
| chandankumar | cool | 09:56 |
| ykarel | chandankumar, can u get console log for upstream-centos-8-rdo-cloud-tripleo-0000032895 | 09:57 |
| ykarel | this is stuck and looks like kernel panic https://review.rdoproject.org/zuul/stream/b88a519ac5e1456184219ef0cf530e06?logfile=console.log | 09:57 |
| chandankumar | ykarel, you mean from toci tenant rdo cloud? | 09:58 |
| ykarel | chandankumar, yes | 09:58 |
| akahat | chandankumar, I think something is not right here: https://review.opendev.org/#/c/718091/, in this review tripleo-ci-centos8-scenario012-standalone is failing.(it's okay it's non-voting) | 10:00 |
| akahat | but i didn't see the changes in the tempest.conf file which we override using 'tempest_tempest_conf_override' | 10:00 |
| akahat | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c6f/718091/4/check/tripleo-ci-centos-8-scenario012-standalone/c6f8a19/logs/undercloud/home/zuul/tempest/etc/tempest.conf | 10:00 |
| akahat | is it a bug? | 10:01 |
| chandankumar | ykarel, check pm | 10:03 |
| ykarel | chandankumar, ack | 10:03 |
| ykarel | it's kernel panic | 10:03 |
| ykarel | ok can ignore the failure and promote | 10:03 |
| chandankumar | ok | 10:04 |
| ykarel | panda, hi | 10:06 |
| ykarel | panda, want to promote centos8 master https://trunk.rdoproject.org/api-centos8-master-uc/api/civotes_agg_detail.html?ref_hash=e979cbb265693180fcde894768701cda | 10:06 |
| ykarel | there was again a false promotion(promotion ignoring ovb failure), ^^ promotion should clear that | 10:07 |
| panda | ykarel: you know what to do :) | 10:09 |
| ykarel | panda, yeap, i am on tmux | 10:09 |
| panda | ykarel: I'll watch | 10:09 |
| ykarel | ok | 10:09 |
| chandankumar | akahat, https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c6f/718091/4/check/tripleo-ci-centos-8-scenario012-standalone/c6f8a19/logs/undercloud/var/log/extra/dump_variables_vars.json | 10:11 |
| chandankumar | akahat, let me fix that | 10:11 |
| panda | ykarel: in 3 minutes. | 10:12 |
| ykarel | panda, okk let' see | 10:12 |
| panda | ykarel: it's every 10 minutes | 10:12 |
| ykarel | panda, ack | 10:12 |
| chandankumar | akahat, or better switch to this var https://opendev.org/openstack/openstack-ansible-os_tempest/src/branch/master/defaults/main.yml#L328 | 10:12 |
| chandankumar | tempest_tempestconf_profile_overrides | 10:13 |
| *** apetrich has quit IRC | 10:15 | |
| ykarel | panda, it started | 10:15 |
| ykarel | Thanks | 10:15 |
| akahat | chandankumar, okay. | 10:15 |
| akahat | chandankumar, are you fixing it? | 10:17 |
| panda | ykarel: you can look at the push log in /home/centos/promoter_logs/container-push/20200409-101436.log | 10:17 |
| chandankumar | akahat, just change the var in fs060 | 10:17 |
| chandankumar | it will get it fixed | 10:17 |
| ykarel | panda, ack | 10:17 |
| akahat | chandankumar, okay | 10:17 |
| panda | ykarel: it's a legacy log, I'm proposing https://review.rdoproject.org/r/26352 to use a single file. | 10:18 |
| ykarel | panda, ack | 10:18 |
| *** saneax_lunch is now known as saneax_ | 10:34 | |
| *** surpatil has quit IRC | 10:44 | |
| *** apetrich has joined #oooq | 11:00 | |
| *** rfolco has joined #oooq | 11:34 | |
| *** ratailor has quit IRC | 11:36 | |
| *** ysandeep|rover is now known as ysandeep|coffee | 11:47 | |
| ykarel | panda, it's promoted https://trunk.rdoproject.org/centos8-master/current-tripleo/delorean.repo.md5, /me reverting master.ini to original | 11:47 |
| *** dpawlik has quit IRC | 11:56 | |
| panda | ykarel: ack | 11:56 |
| *** ysandeep|coffee is now known as ysandeep|rover | 12:00 | |
| ysandeep|rover | akahat, session | 12:01 |
| weshay|ruck | https://hackmd.io/UZPFdivCSAm18jTLDBSdfg | 12:04 |
| weshay|ruck | https://tmate.io/t/vQ8T8GxcntAJDTvBG7UJALVhk | 12:04 |
| weshay|ruck | ssh ro-8MJ95SqNFpdwwvVq2Z63rAu9U@sfo2.tmate.io | 12:04 |
| *** dpawlik has joined #oooq | 12:08 | |
| chandankumar | weshay|ruck, sshnaidm marios https://review.opendev.org/#/c/717043/ please have a look when free | 12:27 |
| sshnaidm | chandankumar, why is it images-vexxhost ? | 12:28 |
| chandankumar | sshnaidm, ah I will change it vexxhost | 12:29 |
| sshnaidm | chandankumar, commented | 12:36 |
| marios | chandankumar: ack will do | 12:37 |
| chandankumar | rfolco, weshay|ruck scrum meeting | 13:01 |
| marios | https://hackmd.io/v-xgVxgHRciqv9UZ1hDK0g | 13:03 |
| marios | rfolco: ^ | 13:03 |
| *** ykarel is now known as ykarel|afk | 13:11 | |
| chandankumar | marios, https://code.engineering.redhat.com/gerrit/#/c/196373 | 13:15 |
| chandankumar | marios, done | 13:38 |
| marios | chandankumar: thanks | 13:40 |
| sshnaidm | rfolco, can you put a new link to training schedule here? https://hackmd.io/v-xgVxgHRciqv9UZ1hDK0g | 13:47 |
| rfolco | sshnaidm, done --> https://hackmd.io/OXNWWIShSBaPXPC8d7kFgQ | 13:48 |
| sshnaidm | rfolco, cool, thanks | 13:48 |
| rfolco | sshnaidm, from now on, all pages should be here https://hackmd.io/team/rh-openstack-ci?nav=overview | 13:49 |
| rfolco | no more personal pages | 13:49 |
| sshnaidm | rfolco, why is it called ":computer: ... " ? | 13:50 |
| sshnaidm | rfolco, missed it in toc | 13:50 |
| marios | bhagyashris: have you seen that https://docs.openstack.org/tripleo-docs/latest/ci/ci_primer.html might address your question a bit | 13:52 |
| marios | https://docs.openstack.org/tripleo-docs/latest/ci/chasing_promotions.html | 13:55 |
| chandankumar | weshay|ruck, marios sshnaidm overcloud image build also passed https://sf.hosted.upshift.rdu2.redhat.com/logs/73/196373/28/check/periodic-tripleo-rhel-8-buildimage-overcloud-full-master/58ce97f/ | 13:55 |
| chandankumar | I am done with image build | 13:55 |
| pojadhav | marios, questions asked by me.. pooja :) | 13:57 |
| marios | oh sorry pojadhav and bhagyashris | 13:57 |
| marios | you should have corrected me :D | 13:57 |
| marios | apologies | 13:57 |
| pojadhav | marios, thats fine :) | 13:57 |
| bhagyashris | marios, pojadhav had some queries regarding jobs | 13:57 |
| bhagyashris | marios, yeah | 13:57 |
| marios | ack thanks sorry for noise bhagyashris | 13:57 |
| bhagyashris | marios, it's ok np | 13:58 |
| chandankumar | weshay|ruck, https://review.rdoproject.org/r/#/c/26351/ +w it | 13:58 |
| bhagyashris | chandankumar, thank you :) yes weshay|ruck please +w it ^ | 13:59 |
| *** TrevorV has joined #oooq | 14:01 | |
| *** ykarel|afk is now known as ykarel | 14:02 | |
| sshnaidm | marios, can you revote please? Now it's fine: https://review.opendev.org/#/c/717961/ | 14:03 |
| marios | sshnaidm: ack checking | 14:04 |
| marios | sshnaidm: you posted some other fix? | 14:05 |
| marios | sshnaidm: i don't see upadte there | 14:05 |
| marios | sshnaidm: i.e. you fixed the link for vex? | 14:05 |
| sshnaidm | marios, enabled gzip for it | 14:08 |
| sshnaidm | marios, https://review.opendev.org/711500 | 14:08 |
| marios | sshnaidm: ack | 14:09 |
| chandankumar | panda, weshay|ruck, marios sshnaidm rfolco tomorrow is public holiday in india, I will be not around. | 14:09 |
| sshnaidm | chandankumar, have fun | 14:10 |
| marios | chandankumar: enjoy | 14:10 |
| *** Goneri has joined #oooq | 14:14 | |
| *** pojadhav is now known as pojadhav|away | 14:15 | |
| ysandeep|rover | weshay|ruck, ^^ me too will not be around tomorrow, Public holiday in india | 14:20 |
| panda | chandankumar: you have too many holidays | 14:20 |
| panda | chandankumar: I'm on the phone with the indian minister, this has to stop. | 14:20 |
| chandankumar | panda, name please | 14:21 |
| chandankumar | panda, please pass me the contact number also i disparately need it | 14:21 |
| panda | chandankumar: Ramesh Pokhriyal | 14:23 |
| panda | oh wait a minute .... | 14:24 |
| panda | I'm on holiday tomorrow too | 14:24 |
| panda | and Monday | 14:24 |
| panda | oopps | 14:24 |
| panda | chandankumar: nevermind | 14:24 |
| chandankumar | panda, hearing it for first time also | 14:24 |
| chandankumar | in india there are so many ministers hard to remember all names | 14:24 |
| chandankumar | panda, enjoy & have fun :-) | 14:25 |
| marios | reviews please https://review.opendev.org/#/c/716896/ | 14:33 |
| marios | chandankumar: weshay|ruck: rfolco: panda: sshnaidm: zbr: arxcruz: when you have time thanks ^ | 14:33 |
| marios | ysandeep|rover: o/ carry on here | 14:35 |
| marios | ysandeep|rover: so i am not covering zuul in my presentation, its about gerrit/git | 14:35 |
| marios | ysandeep|rover: looking at the slides, there is a zuul presentation but looks like sshnaidm rlandy and chandankumar prepared that material | 14:36 |
| marios | weshay|ruck: ^^ | 14:36 |
| weshay|ruck | chandankumar, we have a bug w/ overcloud-full image builds | 14:36 |
| weshay|ruck | 2020-04-09 06:38:57.088540 | primary | + DISTRO=centos8 | 14:36 |
| weshay|ruck | 2020-04-09 06:38:57.088546 | primary | + '[' centos8 = fedora28 ']' | 14:36 |
| weshay|ruck | 2020-04-09 06:38:57.088555 | primary | + export REPO_CONFIG=/home/zuul/workspace/.quickstart/config/release/tripleo-ci/CentOS-7/promotion-testing-hash-master.yml | 14:36 |
| weshay|ruck | 2020-04-09 06:38:57.088567 | primary | + REPO_CONFIG=/home/zuul/workspace/.quickstart/config/release/tripleo-ci/CentOS-7/promotion-testing-hash-master.yml | 14:36 |
| weshay|ruck | 2020-04-09 06:38:57.088576 | primary | + . /home/zuul/workspace/.quickstart/bin/activate | 14:36 |
| weshay|ruck | 2020-04-09 06:38:57.088661 | primary | /home/zuul/src/review.rdoproject.org/config/ci-scripts/tripleo-upstream/convert-upload-undercloud.sh: line 67: /home/zuul/workspace/.quickstart/bin/activate: No such file or directory | 14:37 |
| weshay|ruck | 2 | 14:37 |
| weshay|ruck | https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-buildimage-overcloud-full-master/452bdcf/job-output.txt | 14:37 |
| marios | brb | 14:37 |
| *** rascasoft has joined #oooq | 14:38 | |
| weshay|ruck | chandankumar, 0/ | 14:39 |
| *** bogdando has quit IRC | 14:49 | |
| ysandeep|rover | marios, thank you o/ weshay|ruck ^^ i can cover zuul basic 101 trng after marios session or separately then, I am fine with anything. | 14:50 |
| *** ysandeep|rover is now known as ysandeep|afk | 14:51 | |
| weshay|ruck | meh | 14:54 |
| sshnaidm | chandankumar, bhagyashris do we need it for 3party jobs? https://review.rdoproject.org/r/#/c/26351/ | 15:00 |
| akahat | chandankumar, sshnaidm, marios can we merge it: https://review.opendev.org/#/c/718091 | 15:10 |
| sshnaidm | akahat, is it log from tempest role? https://22e68f0802e3500cdb3f-ade91ca27312268e5fafbe848cc22b67.ssl.cf5.rackcdn.com/718091/5/check/tripleo-ci-centos-8-scenario012-standalone/f417dc2/logs/undercloud/home/zuul/tempest/tempest.log | 15:12 |
| sshnaidm | akahat, is it expected job still fails? | 15:13 |
| sshnaidm | akahat, oh, found it https://22e68f0802e3500cdb3f-ade91ca27312268e5fafbe848cc22b67.ssl.cf5.rackcdn.com/718091/5/check/tripleo-ci-centos-8-scenario012-standalone/f417dc2/logs/undercloud/var/log/tempest/tempest_run.log | 15:15 |
| akahat | sshnaidm, actually it's in the non-voting.. so i didn't bother much about it.. But i ran quick sanity that the variables and etc should be present in tempest.conf | 15:15 |
| sshnaidm | akahat, well, it was failing before as well, I wonder if this patch should have fixed it or just move it to os_tempest | 15:15 |
| akahat | sshnaidm, no.. this patch is not about to fix it. Just to change the run strategy. | 15:16 |
| chandankumar | sshnaidm, regarding ansible zuul patch, we will be consuming in third party job but not gating ansible | 15:19 |
| chandankumar | weshay|ruck, \o/ | 15:20 |
| chandankumar | akahat, looking | 15:21 |
| chandankumar | akahat, can you put the passing tests in tempest whitelist and file a bug for failing tests, let's work on fixing that | 15:23 |
| marios | akahat: i will check again in my next reviews run | 15:27 |
| ykarel | weshay|ruck, i looked at the ci.centos SSH issue today, and able to get green runs https://ci.centos.org/job/tripleo-quickstart-gate-master-delorean-quick-basic/ | 15:29 |
| ykarel | weshay|ruck, issue was on one of the slave there was wrong id_rsa.pub, i removed that | 15:30 |
| chandankumar | akahat, check the comment there | 15:31 |
| akahat | marios, okay. | 15:31 |
| akahat | chandankumar, looking | 15:31 |
| weshay|ruck | ykarel, thank you! where did you remove it? | 15:32 |
| weshay|ruck | chandankumar, need to chat | 15:32 |
| chandankumar | weshay|ruck, yes | 15:32 |
| ykarel | weshay|ruck, in cloudslave01 | 15:32 |
| weshay|ruck | k | 15:33 |
| ykarel | where that job was running | 15:33 |
| weshay|ruck | chandankumar, https://meet.google.com/xbz-prgq-xee?authuser=1 | 15:33 |
| *** ykarel is now known as ykarel|away | 15:33 | |
| weshay|ruck | chandankumar, join #tls_help on internal | 15:33 |
| akahat | chandankumar, you want me to add all the passing tests under the 'tempest_test_whitelist' ? | 15:35 |
| chandankumar | akahat, yes | 15:35 |
| weshay|ruck | chandankumar, internal #tls_help | 15:36 |
| akahat | chandankumar, why? to pass the job? | 15:37 |
| bhagyashris | chandankumar, ykarel|away weshay|ruck thank you for merging this https://review.rdoproject.org/r/#/c/26351/ | 15:59 |
| *** marios is now known as marios|out | 16:05 | |
| *** dpawlik has quit IRC | 16:06 | |
| chandankumar | akahat, it will help to test ironic pieces, then we can work on adding missing necessary resources on os_tempest side so that we can re-enable that test | 16:11 |
| chandankumar | right now we have nothing, having something will help | 16:11 |
| akahat | chandankumar, okay. Were to file bug for the failing test cases? | 16:12 |
| chandankumar | akahat, for tracking yes | 16:12 |
| *** Trevor_V has joined #oooq | 16:16 | |
| akahat | chandankumar, were to report bug? | 16:18 |
| *** marios|out has quit IRC | 16:18 | |
| chandankumar | akahat, bugs.launchpad.net/tripleo | 16:18 |
| akahat | chandankumar, that's what I want :) | 16:19 |
| *** TrevorV has quit IRC | 16:19 | |
| akahat | chandankumar, https://bugs.launchpad.net/tripleo/+bug/1871876 | 16:35 |
| openstack | Launchpad bug 1871876 in tripleo "ironic tests are failing on the CentOS8" [Undecided,New] | 16:35 |
| *** udesale_ has quit IRC | 16:35 | |
| akahat | first bug reported in tripleo :P | 16:35 |
| chandankumar | akahat, please paste the whole traceback with failing tests | 16:36 |
| chandankumar | logs gets deleted in 30 days | 16:36 |
| akahat | chandankumar, okay. | 16:36 |
| *** ysandeep|afk is now known as ysandeep|out | 16:46 | |
| *** dtantsur is now known as dtantsur|afk | 16:46 | |
| weshay|ruck | rfolco, when working w/ get_hash from ci-scripts/roles/get_hash/tasks/get_hash.yml and a periodic test project job.. the change has to merge because protected repos are in play? | 16:53 |
| weshay|ruck | rfolco, maybe I can borrow you for a few min on this? | 16:53 |
| rfolco | weshay|ruck, sure | 16:54 |
| rfolco | weshay|ruck, oiv geho mai | 16:54 |
| rfolco | weshay|ruck, https://meet.google.com/oiv-geho-mai?authuser=1 | 16:54 |
| weshay|ruck | rfolco, https://review.rdoproject.org/r/#/c/26172/ | 16:56 |
| *** pojadhav|away is now known as pojadhav | 16:56 | |
| *** derekh has quit IRC | 17:01 | |
| *** sshnaidm is now known as sshnaidm|afk | 17:12 | |
| weshay|ruck | rfolco, https://review.rdoproject.org/r/#/c/26346/1/ci-scripts/infra-setup/roles/get_hash/tasks/get_hash.yaml | 17:15 |
| *** panda is now known as panda|off | 17:27 | |
| *** rascasoft has quit IRC | 17:33 | |
| *** sshnaidm|afk is now known as sshnaidm|off | 18:02 | |
| rfolco | weshay|ruck, testing here https://review.rdoproject.org/r/#/c/26367/ | 18:22 |
| rfolco | will be away for a few | 18:22 |
| *** rfolco is now known as rfolco|bbl | 18:22 | |
| *** pojadhav is now known as pojadhav|off | 18:45 | |
| weshay|ruck | rfolco|bbl, it failed | 19:19 |
| *** rfolco|bbl is now known as rfolco | 20:15 | |
| weshay|ruck | rfolco, any thoughts? | 20:20 |
| rfolco | weshay|ruck, still don't know why testproject applies the patch but it does not use it | 20:22 |
| weshay|ruck | rfolco, ya.. and what about merging it | 20:22 |
| rfolco | weshay|ruck, rhel component jobs... my concern | 20:23 |
| rfolco | look at my comment | 20:23 |
| weshay|ruck | rfolco, no such thing | 20:23 |
| rfolco | weshay|ruck, ok so maybe i am not aware of how it works | 20:23 |
| weshay|ruck | rfolco, show me the rhel component jobs | 20:24 |
| rfolco | weshay|ruck, all rhel jobs will use legacy urls, is that what you want ? | 20:25 |
| rfolco | weshay|ruck, when you do this | 20:26 |
| rfolco | when: | 20:26 |
| rfolco | - ansible_distribution == 'RedHat' or release is search("queens|rocky|stein|train") | 20:26 |
| weshay|ruck | aye.. I know.. | 20:26 |
| rfolco | I am really asking because I have no idea on how rhel jobs are operating now | 20:27 |
| weshay|ruck | fixing | 20:28 |
| weshay|ruck | rfolco, where is the -uc added again? | 20:31 |
| rfolco | L23 | 20:32 |
| rfolco | https://review.rdoproject.org/r/#/c/26346/1/ci-scripts/infra-setup/roles/get_hash/tasks/get_hash.yaml | 20:32 |
| rfolco | weshay|ruck, ^ | 20:32 |
| rfolco | - name: use the upper constraint url (for master) | 20:33 |
| weshay|ruck | ah.. looked right over that .. thanks | 20:34 |
| weshay|ruck | rfolco, so.. re: rhel | 20:34 |
| weshay|ruck | the only rhel at this point will be internal | 20:34 |
| weshay|ruck | and it won't match the release | 20:34 |
| rfolco | so let's get rid of rhel conditions there | 20:36 |
| rfolco | its does not make any sense | 20:36 |
| rfolco | for internal maybe it would | 20:36 |
| rfolco | for skipping some tasks | 20:36 |
| rfolco | ok I shut up coz not helping much | 20:37 |
| *** jtomasek has quit IRC | 20:41 | |
| weshay|ruck | so boiling this down | 20:43 |
| weshay|ruck | api-centos-master-uc | 20:43 |
| weshay|ruck | api-centos-master-uc | 20:43 |
| weshay|ruck | api-centos-queens | 20:43 |
| weshay|ruck | api-centos-train | 20:43 |
| weshay|ruck | api-centos-stein | 20:43 |
| weshay|ruck | api-centos-rocky | 20:43 |
| weshay|ruck | api-centos8-master-uc | 20:43 |
| weshay|ruck | api-centos8-master-uc | 20:43 |
| weshay|ruck | and we can drop the top two | 20:43 |
| weshay|ruck | so you end up w/ | 20:43 |
| weshay|ruck | api-centos-queens | 20:43 |
| weshay|ruck | api-centos-train | 20:43 |
| weshay|ruck | api-centos-stein | 20:43 |
| weshay|ruck | api-centos-rocky | 20:43 |
| weshay|ruck | api-centos8-master-uc | 20:43 |
| weshay|ruck | api-centos8-master-uc | 20:43 |
| *** owalsh is now known as owalsh_afk | 20:43 | |
| weshay|ruck | rfolco, k.. updated.. removing support for rhel8 | 20:50 |
| weshay|ruck | upstream | 20:50 |
| weshay|ruck | er.. third party | 20:50 |
| rfolco | weshay|ruck, reviewing | 20:51 |
| rfolco | weshay|ruck, one comment about commenting a comment :) | 20:56 |
| rfolco | +2 | 20:56 |
| weshay|ruck | rfolco, k.. I'm going to merge and revert if it doesn't pass the test project job | 20:57 |
| weshay|ruck | should know in like 10-20 min | 20:57 |
| rfolco | k | 20:58 |
| weshay|ruck | jinxed | 21:04 |
| weshay|ruck | lolz | 21:04 |
| *** Trevor_V has quit IRC | 21:05 | |
| weshay|ruck | rfolco, fyi https://review.rdoproject.org/r/#/c/26369/ | 21:10 |
| weshay|ruck | rfolco, molecule is failing | 21:14 |
| weshay|ruck | :( | 21:14 |
| rfolco | but they are dissabled | 21:15 |
| weshay|ruck | where is the data for those tests | 21:15 |
| weshay|ruck | we should switch it to train | 21:15 |
| weshay|ruck | rfolco, where is the test configured.. or the data? | 21:22 |
| weshay|ruck | https://logserver.rdoproject.org/69/26369/1/check/molecule-tripleo-common-delegated-centos-7/e6bf0a3/job-output.txt | 21:22 |
| rfolco | weshay|ruck, in ci-config... zuul.d/layout.yml | 21:24 |
| *** jmasud has quit IRC | 22:40 | |
| *** jmasud has joined #oooq | 22:43 | |
| *** tosky has quit IRC | 23:08 | |
| *** rfolco has quit IRC | 23:37 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!