Monday, 2020-09-28

*** sshnaidm is now known as sshnaidm|off00:41
*** dsneddon has quit IRC02:47
*** dsneddon has joined #oooq02:49
*** udesale has joined #oooq03:12
*** dsneddon has quit IRC04:22
*** dsneddon has joined #oooq04:23
*** ratailor has joined #oooq04:24
*** ratailor_ has joined #oooq04:27
*** ratailor has quit IRC04:29
*** ratailor__ has joined #oooq04:31
*** ratailor_ has quit IRC04:33
*** ykarel has joined #oooq04:40
*** marios has joined #oooq05:04
*** jfrancoa has joined #oooq05:15
*** ysandeep|away is now known as ysandeep05:17
*** akahat|PTO is now known as akahat05:24
*** jfrancoa has quit IRC06:08
*** jfrancoa has joined #oooq06:18
*** apetrich has joined #oooq06:19
*** amoralej|off is now known as amoralej06:25
*** ratailor__ has quit IRC06:31
*** saneax has joined #oooq06:37
*** ysandeep is now known as ysandeep|lunch07:14
mariosbiab07:18
*** marios has quit IRC07:18
*** tosky has joined #oooq07:23
*** marios has joined #oooq07:28
*** jpena|off is now known as jpena07:29
*** ysandeep|lunch is now known as ysandeep07:36
*** jtomasek has joined #oooq07:41
*** marios has quit IRC07:48
*** arxcruz has joined #oooq07:48
*** saneax has quit IRC07:54
*** saneax has joined #oooq07:55
*** jfrancoa has quit IRC08:01
*** jfrancoa has joined #oooq08:01
*** yolanda has joined #oooq08:07
*** saneax has quit IRC08:10
*** chem has quit IRC08:11
*** chem has joined #oooq08:13
*** marios has joined #oooq08:21
*** derekh has joined #oooq08:32
*** holser has joined #oooq08:41
*** saneax has joined #oooq08:49
bhagyashri|roversshnaidm|off, Hi around ?08:55
*** dtantsur has joined #oooq08:56
*** zbr has joined #oooq09:09
zbro/09:09
akahatzbr, o/09:23
akahatzbr, i'm not sure how to fix it: 401: Git checkouts must contain explicit version.09:25
akahatdo you have any idea?09:26
akahatreview link: https://review.rdoproject.org/r/#/c/29518/09:26
zbrakahat: add # noqa 40109:29
holsermorning folks09:30
holserykarel I am going to test https://review.opendev.org/#/c/754363/109:31
akahatzbr, in ansible playbook?09:39
akahathttps://logserver.rdoproject.org/18/29518/17/check/tox-linters/f7a7f94/job-output.txt09:40
zbryep, on the exact line number it was reported on.09:40
akahatokay.. let me try.09:41
zbrrun "tox -e linters" locally and if you did it right it will work.09:41
zbrread https://ansible-lint.readthedocs.io/en/latest/rules.html#excluding-rules09:41
zbrthere is an example with 401 also :D09:42
akahatyup.. it worked..09:44
akahati didn't noticed it in docs. :(09:44
ykarelholser, ack, but how? manually changing launcher-playbook?09:45
*** Tengu has joined #oooq10:10
sshnaidm|offbhagyashri|rover, I'm off today10:20
bhagyashri|roverok10:21
* pojadhav brb10:33
*** udesale_ has joined #oooq11:01
*** udesale has quit IRC11:04
*** ysandeep is now known as ysandeep|brb11:13
*** soniya29 is now known as soniya29|afk11:14
*** saneax has quit IRC11:16
*** jpena is now known as jpena|lunch11:25
*** saneax has joined #oooq11:25
*** ysandeep|brb is now known as ysandeep11:38
weshay|ruckbhagyashri|rover++ https://review.rdoproject.org/r/#/c/29351/11:45
bhagyashri|rover:)11:45
bhagyashri|roverwaiting for result11:45
chandankumarweshay|ruck: https://review.opendev.org/749645 please +w it11:47
chandankumarand https://review.opendev.org/#/c/752643/11:48
*** rfolco has joined #oooq11:52
*** rfolco is now known as rfolco|ruck11:52
*** amoralej is now known as amoralej|lunch11:57
*** jpena|lunch is now known as jpena12:29
chandankumarweshay|ruck: and this one also https://review.opendev.org/753265 these are good to go ahead to clear12:30
mariosakahat: rfolco|ruck: have time to join us on promoter sync ?12:31
rfolco|ruckmarios, on cix, will do my best12:31
akahatmarios, yes.. joining.12:33
*** dsneddon has quit IRC12:33
chandankumarweshay|ruck: please +w https://review.opendev.org/#/c/752643/ to clear this https://review.opendev.org/75268512:48
arxcruzrfolco|ruck: weshay|ruck hey, i have a doctor appointment in a few minutes, i won’t be able to participate in the meeting today12:53
weshay|ruckk12:53
rfolco|ruckarxcruz, take care12:53
weshay|ruckrfolco|ruck, https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-ovn-provider-standalone-ussuri/f800fe3/logs/undercloud/var/log/tempest/stestr_results.html.gz13:01
weshay|ruckzbr, you pto or online today?13:02
weshay|ruckpojadhav, scrum13:02
*** amoralej|lunch is now known as amoralej13:04
pojadhavweshay|ruck, sorry for late joining13:11
weshay|rucknp13:11
*** saneax has quit IRC13:23
weshay|ruckarxcruz, reminder https://projects.engineering.redhat.com/browse/TRIPLEOCI-6013:23
weshay|ruckhelp verify13:23
*** saneax has joined #oooq13:24
weshay|ruckbhagyashri|rover, rfolco|ruck https://review.rdoproject.org/r/#/c/29167/13:30
weshay|ruckplease help move this along13:30
weshay|ruckbhagyashri|rover, https://review.rdoproject.org/r/#/c/29167/13:31
zbri think i may have found the ssh key issue, apparently paramiko fails to load openssh format but loads old rsa ones.13:35
rfolco|ruckweshay|ruck, c7 image builds look good: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-train-upload#13:37
rfolco|ruckhttps://zuul.openstack.org/builds?job_name=tripleo-buildimage-overcloud-full-centos-7-train&job_name=tripleo-buildimage-overcloud-full-centos-8-train13:37
*** saneax has quit IRC13:41
ysandeepweshay|ruck, ping pm13:45
weshay|ruckrfolco|ruck, 2020-09-28 03:43:04.340 | DEBUG diskimage_builder.block_device.blockdevice [-] Creating BlockDevice object __init__ /home/zuul/workspace/venv/lib64/python3.6/site-packages/diskimage_builder/block_device/blockdevice.py:22913:46
weshay|ruckhttps://api.us-east.open-edge.io:8080/swift/v1/AUTH_e02c11e4e2c24efc98022353c88ab506/zuul_opendev_logs_ad1/752421/22/check/tripleo-buildimage-overcloud-full-centos-7-train/ad1b89d/overcloud-full.log13:46
weshay|ruckyup.. see py3 there13:46
rfolco|ruckweshay|ruck, marios I did a recheck on https://review.opendev.org/#/c/739457, cause the fix https://review.opendev.org/#/c/753817/ merged sept 25, and last run was sept 2413:48
rfolco|ruckadded a comment to https://bugs.launchpad.net/tripleo/+bug/189582213:48
openstackLaunchpad bug 1895822 in tripleo "centos8 standalone-upgrade-ussuri fails tempest ping router IP" [Critical,Fix released] - Assigned to Alex Schultz (alex-schultz)13:48
weshay|ruckrfolco|ruck, can you see where the patch is in the component/integration line please13:49
mariosrfolco|ruck: ack it's in depends-on though but sure thanks13:49
rfolco|ruckweshay|ruck, ok, latest runs all failed https://zuul.openstack.org/builds?job_name=tripleo-ci-centos-8-standalone-upgrade-ussuri, will check if the patch is in13:49
rfolco|ruckweshay|ruck, its a fix in tq13:50
rfolco|ruckhttps://review.opendev.org/#/c/753817/3/config/general_config/featureset056.yml13:50
bhagyashri|roverrfolco|ruck, weshay|ruck fyi regarding https://bugs.launchpad.net/tripleo/+bug/1897505 on testproject patch out out of 4 only one job passed which is on top https://review.rdoproject.org/r/#/c/29351/ :(13:51
openstackLaunchpad bug 1897505 in tripleo "overcloud-prep-images failes at Introspect overcloud images (fs001, fs002, fs020and fs039 is failing)" [High,Triaged]13:51
rfolco|ruckweshay|ruck, docker-ha is there ... -e /usr/share/openstack-tripleo-heat-templates/environments/docker-ha.yam13:52
*** TrevorV has joined #oooq13:52
*** jbadiapa has joined #oooq14:26
weshay|ruckrfolco|ruck, fyi.. selinux is permissive in any centos job14:26
rfolco|ruckweshay|ruck, I misunderstood comments about selinux in that bug14:26
ysandeepweshay|ruck, could you please review https://review.rdoproject.org/r/29697 to correct fs039 in train14:29
ysandeepsecurity component*14:29
ysandeepTest run is green with these changes - periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-security-train https://review.rdoproject.org/zuul/build/af3fa5ce91c4431bb2034b5ffbafe1a1 : SUCCESS in 3h 40m 06s14:30
ysandeepchandankumar, thanks!14:31
weshay|ruckchandankumar, ysandeep see my comments https://review.rdoproject.org/r/#/c/29697/14:34
weshay|ruckysandeep, chandankumar I think that's wrong..14:34
chandankumarweshay|ruck: yes you are correct14:35
chandankumarfor ovb we need cloud name14:35
weshay|ruckand the node name? unless there are multiple alias14:35
*** marios has quit IRC14:35
weshay|ruckbut we should be consistent.. because it's confusing enough14:35
weshay|ruckreviews please https://review.opendev.org/#/c/754221/14:37
weshay|ruckhttps://review.opendev.org/#/c/754715/14:37
ysandeepweshay|ruck, thanks! I followed integration job example: https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/integration-jobs-c8-train.yaml#L61 .. i guess that's need update too then..14:41
chandankumarysandeep: weshay|ruck commented14:41
weshay|ruckchandankumar, should we not have some consistentcy?14:42
weshay|ruckwe should have linters enforce this stuff14:42
*** jtomasek has quit IRC14:42
chandankumaryes,14:43
chandankumarlet me compare with rdo-cloud and what is there with vexxhost then make chanegs14:43
ysandeepweshay|ruck chandankumar we are already getting cloud_name: vexxhost from parenting , https://logserver.rdoproject.org/58/28458/10/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-security-train/af3fa5c/zuul-info/inventory.yaml14:43
weshay|ruckk.. thanks14:44
weshay|ruckI will just say.. this is a little confusing :)14:44
ysandeepagree14:45
*** ykarel is now known as ykarel|away14:48
*** ykarel|away has quit IRC14:53
*** ysandeep is now known as ysandeep|away14:53
weshay|ruckbhagyashri|rover, /me comparing https://logserver.rdoproject.org/51/29351/13/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/ff00b59/logs/bmc_13_20749-console.log ---> https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/6242ac0/logs/bmc-console.log15:02
weshay|ruckalso the boot console logs are all empty baremetal_13_20749_0-console.log in the failing jobs15:03
weshay|ruckbhagyashri|rover, https://logserver.rdoproject.org/51/29351/13/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/ff00b59/logs/undercloud/var/log/extra/errors.txt.txt.gz15:05
weshay|ruck: Failed to set boot device to PXE: Failed to set boot device for node 08d9fbed-902a-4273-9758-2a342e12c3e8: Client Error for url: http://192.168.24.3:6385/v1/nodes/08d9fbed-902a-4273-9758-2a342e12c3e8/management/boot_device, Node 08d9fbed-902a-4273-9758-2a342e12c3e8 is locked by host undercloud.localdomain, please retry after the current operation is completed.15:05
weshay|ruckalso see.. 2020-09-28 12:10:45.172 ERROR /var/log/containers/neutron/dhcp-agent.log: 99728 ERROR neutron.agent.linux.ip_lib [req-2c45034c-3e70-4192-a815-81f0c24efb77 - - - - -] Device tap19e4cd8b-ad cannot be used as it has no MAC address15:06
*** jfrancoa has quit IRC15:36
*** amoralej is now known as amoralej|off15:42
weshay|ruckbhagyashri|rover, rfolco|ruck centos-8 train and ussuri should be promoting today.. I'm watching errors in the promotion logs15:43
rfolco|ruckweshay|ruck, cool, thanks15:43
weshay|ruckissues w/ master introspection are still not clear.. bhagyashri|rover is testing it15:43
rfolco|ruckfixing parent for ovn jobs... ussuri is failing https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-scenario010-ovn-provider-standalone-ussuri15:43
rfolco|ruckk15:43
weshay|ruckk.. thanks15:43
arxcruzweshay|ruck: ack, i'll review15:45
*** ykarel|away has joined #oooq15:55
bhagyashri|roverweshay|ruck,  seems post https://review.opendev.org/#/c/749845/ introspection failure issue in happening in master nor sure will check it15:55
weshay|ruckbhagyashri|rover, we can put up a test revert and depends on in your sf test15:56
weshay|ruckrdo sf15:56
weshay|ruckbhagyashri|rover, heh.. introspection fail on that change https://logserver.rdoproject.org/45/749845/3/openstack-check/tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset001/673039b/logs/15:57
weshay|ruckbhagyashri|rover, https://review.opendev.org/#/c/754783/15:57
bhagyashri|roverweshay|ruck, ok15:58
weshay|ruckhttps://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset001&change=74984515:58
weshay|ruckbhagyashri|rover, nice find15:59
bhagyashri|roverweshay|ruck, ykarel|away, pointed on my patch. thanks ykarel|away16:03
ykarel|awayweshay|ruck, bhagyashri|rover you need to ensure that it do not false promote with revert16:03
ykarel|awayif test job pass and promotion criteria get's met there will be false promotion16:03
weshay|ruckykarel|away, good point.. I'll hold master16:04
ykarel|awayor u can remove some jobs from test patch so criteria do not match16:05
weshay|ruckbhagyashri|rover, ykarel|away http://promoter.rdoproject.org/config/CentOS-8/master.ini16:05
weshay|ruckwe're good.. see "must_pass_weshay"16:06
ykarel|awayack16:07
*** marios has joined #oooq16:11
*** tosky has quit IRC16:12
*** jpena is now known as jpena|off16:43
*** marios has quit IRC16:45
weshay|ruckrfolco|ruck, fyi https://review.rdoproject.org/r/#/c/29708/16:51
rfolco|ruckweshay|ruck, good16:52
*** dtantsur is now known as dtantsur|afk16:59
*** derekh has quit IRC17:01
rfolco|ruckweshay|ruck, https://review.rdoproject.org/r/29709 Add standalone-upgrade [master|ussuri] jobs17:02
*** udesale_ has quit IRC17:03
*** ykarel|away has quit IRC17:21
rfolco|ruckweshay|ruck, re: ussuri ovn scen10 >> diff issue from master = https://bugs.launchpad.net/tripleo/+bug/189570517:35
openstackLaunchpad bug 1895705 in tripleo "[train|ussuri] scen10-ovn-provider-standalone: insert-headers is not a valid option for a TCP protocol listener" [Critical,Triaged]17:35
rfolco|ruckweshay|ruck, skip list >> https://review.opendev.org/#/c/754198/17:35
rfolco|ruckneed to merge17:35
rfolco|rucklog example >> https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-ovn-provider-standalone-ussuri/f800fe3/logs/undercloud/var/log/tempest/stestr_results.html.gz17:35
weshay|ruckwf17:37
*** dsneddon has joined #oooq17:44
*** marios has joined #oooq19:06
*** Goneri has joined #oooq19:16
*** tosky has joined #oooq19:27
*** owalsh has quit IRC19:47
weshay|ruckrfolco|ruck, sahara containers keep getting added back into the container config in tripleo19:47
weshay|ruckhttps://review.opendev.org/#/c/754843/19:47
weshay|rucknot sure if that's right19:47
rfolco|ruckweshay|ruck, are you seeing build errors on those ?19:48
rfolco|ruckweshay|ruck, jeez we need to fix this19:50
rfolco|ruck2020-09-28 08:53:34 | Expected................... 8919:50
rfolco|ruck2020-09-28 08:53:34 | Built...................... 10719:50
rfolco|ruck2020-09-28 08:53:34 | SUCCESS: Congratulations! All containers have been built :)19:50
weshay|ruckya19:50
*** owalsh has joined #oooq19:51
weshay|ruckrfolco|ruck, need votes https://review.opendev.org/#/c/754843/219:56
*** apetrich has quit IRC20:00
rfolco|ruckweshay|ruck, left a comment20:00
rfolco|ruckweshay|ruck, I'll fix expected vs built count20:03
weshay|ruckrfolco|ruck, you're LOOKING AT MASTER :)20:03
weshay|rucklook at train20:04
rfolco|ruckweshay|ruck,   master: &exclude_containers20:06
* rfolco|ruck confused20:06
weshay|rucksee the bug20:06
rfolco|ruckok, got it20:07
rfolco|ruckbut for master it does not have any effect20:07
rfolco|ruckthats what I meant20:07
weshay|ruckthat is correct.. I just want to burn these two containers to the ground20:07
*** holser has quit IRC20:07
weshay|ruckthis is like the the third time it's fucked up promotions20:08
*** holser has joined #oooq20:08
rfolco|ruckhmm weshay|ruck the difference from expected to built list are the -base containers20:34
rfolco|ruckhttps://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-ubi-8-push/2f6073c/logs/containers-successfully-built.log20:34
weshay|ruckrfolco|ruck, tomorrow can you start the work to ensure the three containers listed in https://bugs.launchpad.net/tripleo/+bug/1897626 are built for centos-820:38
openstackLaunchpad bug 1897626 in tripleo "sahara containers are not built for centos-8 train and ussuri" [High,Triaged]20:38
weshay|ruckcentos-8 train20:38
weshay|ruckrfolco|ruck, none of those containers are used20:38
weshay|ruckafaict20:38
rfolco|ruckweshay|ruck, not build for train c8 https://logserver.rdoproject.org/openstack-periodic-integration-stable2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-ubi-8-push-train/cae7b38/logs/containers-successfully-built.log20:40
weshay|ruckrfolco|ruck, should we chat about this.. /me is not so sure of anything w/ these stupid sahara containrs20:41
rfolco|ruckyeah lets chat, I am missing context.... these are not built20:41
weshay|ruckhttps://meet.google.com/sdj-zjds-srq20:42
rfolco|ruckweshay|ruck, https://logserver.rdoproject.org/openstack-periodic-integration-stable2-centos7/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-train-containers-build-push/dfd0e77/logs/containers-successfully-built.log20:58
rfolco|ruckweshay|ruck, it builds for c7 train20:58
rfolco|ruckweshay|ruck, in both c8 ussuri and train, use_kolla=false, so it just runs tcib and ignores sahara.21:01
rfolco|ruckweshay|ruck, but for c7 train, it builds w/ kolla, then sahara is built21:02
rfolco|ruckweshay|ruck, I can look at this tomorrow morning. Wife's birthday today. ttyl21:03
weshay|ruckrfolco|ruck, I'm back21:07
weshay|ruckrfolco|ruck, ah k21:07
weshay|rucktty tomorrow21:07
weshay|ruckhappy birthday21:07
*** rfolco|ruck has quit IRC21:08
*** jbadiapa has quit IRC21:41
*** tosky has quit IRC22:40
*** rfolco|ruck has joined #oooq22:45
*** tosky has joined #oooq23:09
*** rfolco|ruck has quit IRC23:15
*** tosky has quit IRC23:19
*** TrevorV has quit IRC23:52

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!