Thursday, 2020-10-01

*** jistr has quit IRC00:14
*** jistr has joined #tripleo00:14
*** rfolco has joined #tripleo00:15
openstackgerritMerged openstack/tripleo-heat-templates stable/ussuri: Allow optional volumes for nova_libvirt container  https://review.opendev.org/75482900:35
*** rfolco has quit IRC00:41
*** rh-jelabarre has quit IRC00:56
*** pleimer has joined #tripleo00:59
openstackgerritIhar Hrachyshka proposed openstack/tripleo-heat-templates master: Allow to configure vxlan network type for OVN  https://review.opendev.org/75345301:09
*** rfolco has joined #tripleo01:12
*** Goneri has quit IRC01:23
*** rcernin has quit IRC01:28
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Improve bearer auth handling  https://review.opendev.org/74982001:40
EmilienMweshay|ruck for tomorrow, let's take a look at why molecule jobs fail on train now01:42
EmilienMhttps://review.opendev.org/#/c/75377801:42
EmilienMRETRY_LIMIT01:42
EmilienM2020-09-30 18:59:31.845028 | centos-8 |   "msg": "Failed to validate GPG signature for containerd.io-1.2.6-3.3.el7.x86_64"01:42
EmilienMhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e2a/753778/5/check/tripleo-ansible-centos-8-molecule-tripleo-container-manage/e2ad6d5/job-output.txt01:42
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: firewall: make ExtraFirewallRules role specific  https://review.opendev.org/75513301:43
*** rcernin has joined #tripleo01:44
openstackgerritMerged openstack/tripleo-ci master: Fix standalone irrelevant-files  https://review.opendev.org/75445201:45
openstackgerritRafael Folco proposed openstack/tripleo-ci master: [WIP] build report for container builds  https://review.opendev.org/75512402:10
*** rfolco has quit IRC02:15
*** pleimer has quit IRC02:29
*** HardCase has joined #tripleo02:52
HardCaseHey all, hoping to get some guidance.  Had a controller hard drive fail, tried rebuild but it would not pxe boot, decided to follow the RHOSP docs for redeploying and running into "Unable to attach VIF f1ec3cf7-5d1b-41d5-8df0-1c0b7f00a6b7, not enough free physical ports".  I can't seem to find why, thoughts?02:54
*** freenzyfriday has joined #tripleo03:10
openstackgerritMerged openstack/tripleo-heat-templates stable/train: [train-only] Fix unhealthy ovn_metadata_agent during hybrid state  https://review.opendev.org/75223003:12
*** freenzyfriday has quit IRC03:15
*** skramaja has joined #tripleo03:27
*** jmasud has joined #tripleo03:27
openstackgerritRabi Mishra proposed openstack/tripleo-heat-templates master: Use OS::Heat::None in place of net-config-noop.yaml  https://review.opendev.org/75520203:30
*** cloudnull has quit IRC03:34
*** cloudnull has joined #tripleo03:34
*** psachin has joined #tripleo03:35
*** cloudnull4 has joined #tripleo03:54
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Default cinder_volume_node_names to []  https://review.opendev.org/75521903:54
openstackgerritMerged openstack/tripleo-heat-templates stable/ussuri: Default cinder_volume_node_names to []  https://review.opendev.org/75521703:54
openstackgerritMerged openstack/puppet-tripleo master: Add unit tests for memcached manifests  https://review.opendev.org/75006903:54
openstackgerritMerged openstack/python-tripleoclient stable/ussuri: Fix tcib build  https://review.opendev.org/75538803:54
*** cloudnull has quit IRC03:55
*** cloudnull4 is now known as cloudnull03:55
openstackgerritRabi Mishra proposed openstack/tripleo-common master: Handle None config for networkConfig  https://review.opendev.org/75527504:04
*** ykarel|away has joined #tripleo04:12
*** ykarel|away is now known as ykare04:12
*** ykare is now known as ykarel04:12
*** evrardjp has quit IRC04:33
*** evrardjp has joined #tripleo04:33
*** ykarel_ has joined #tripleo04:34
*** ykarel has quit IRC04:36
*** shyamb has joined #tripleo04:43
*** shyam89 has joined #tripleo04:43
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: Prevent multinode upgrade from running dnf upgrade.  https://review.opendev.org/75531204:44
*** marios has joined #tripleo04:48
*** ysandeep|away is now known as ysandeep04:51
shyam89ykarel: Hi05:04
*** ratailor has joined #tripleo05:04
shyam89Does this code sets oslo_messaging_rabbit section in cinder.conf? https://github.com/openstack/puppet-cinder/blob/master/manifests/init.pp#L35905:04
shyam89I mean from the name, it clearly indicates the same. but in cinder.conf I see all these parameters of oslo_messaging_rabbit section are commented05:05
shyam89Is the code still used?05:06
ykarel_shyam89, yes that code set's messaging section in cinder.conf https://github.com/openstack/puppet-oslo/blob/master/manifests/messaging/rabbit.pp#L18005:10
*** ratailor_ has joined #tripleo05:10
*** ykarel_ is now known as ykarel05:10
shyam89ykarel: Okay.05:11
*** ratailor has quit IRC05:12
*** shyam89 has quit IRC05:19
*** shyamb has quit IRC05:19
*** shyamb has joined #tripleo05:20
*** shyam89 has joined #tripleo05:20
openstackgerritSergii Golovatiuk proposed openstack/tripleo-quickstart-extras master: Update cirros image from 3.6 to 4.0  https://review.opendev.org/75540105:21
ykarelshyam89, you said u see all commented in oslo_messaging_rabbit05:24
ykareldo you also see heartbeat_timeout_threshold commented?05:24
shyam89ykarel: let me check05:24
ykareli see that's being overridden https://github.com/openstack/tripleo-heat-templates/blob/stable/train/deployment/cinder/cinder-base.yaml#L12605:24
shyam89ykarel: yes that parameter is uncommented05:25
ykarelack05:27
shyam89ykarel: I think I need to add all default values in my puppet template and set only necessary from heat template05:27
shyam89https://github.com/shyam-biradar/triliovault-cfg-scripts/blob/tv3295/redhat-director-scripts/puppet5/trilio/templates/contego_nfs_conf.erb#L3705:27
ykarelshyam89, /me not aware about contego, but if config's default is set in service, then commenting/removing from configuration file doesn't make difference05:30
shyam89ykarel: okay05:31
shyam89I see RpcUseSsl parameter is only set in nova template. No other service sets this parameter.05:32
shyam89https://github.com/openstack/tripleo-heat-templates/blob/0b1900eadeb2c27a832fc2d6e0dc6e03ab2a4ef6/deployment/nova/nova-base-puppet.yaml#L28905:32
shyam89ykarel: Any thoughts there?05:33
shyam89Does other services does not support ssl over rabbit?05:33
*** bandini has joined #tripleo05:41
openstackgerritRabi Mishra proposed openstack/tripleo-heat-templates master: Use show base attribute for network/subnet attrs  https://review.opendev.org/75542805:45
*** udesale has joined #tripleo05:45
ykarelshyam89, i see RpcUseSsl is used by other services but in different way05:54
ykarelit's being used while generating default_transport_url https://opendev.org/openstack/puppet-tripleo/src/branch/master/manifests/profile/base/cinder.pp#L108-L11405:54
ykareldon't know why nova using differently05:54
ykarelbased on rpc param url generated with ?ssl=0 or ?ssl=105:55
shyam89ykarel: I see05:56
shyam89If transport url has this information, not sure why we need to set the same in oslo_messaging_rabbit05:56
shyam89ykarel: Maybe if ssl is true, then service reads cert file paths from this section05:57
shyam89ykarel: I am not finding this variable for cert file in any heat template https://github.com/openstack/puppet-cinder/blob/f919aaad47219f3484f875bf03878f66de3d34a7/manifests/init.pp#L30505:59
shyam89'$kombu_ssl_keyfile'05:59
shyam89If heat templates are not setting this variable then who else is setting it?06:00
*** bhagyashri is now known as bhagyashris06:02
*** lmiccini has joined #tripleo06:03
shyam89ykarel: If you get anything around this, please let me know.06:04
ykarelshyam89, is that variable set in your deployment?06:05
shyam89ykarel: Not sure yet, if we need to set or not. We are exploring this SSL on rabbitmq scenario06:07
ykarelshyam89, that's different driver for messaging and i don't think that's used, and as not used its config param shouldn't be set06:07
ykarelbut if it's being set in your deployment i can try to see why06:07
shyam89ykarel: Okay, got it. Then it means we don't need it06:08
shyam89We just want to follow any other openstack service06:08
shyam89Do you know, If rabbitmq has ssl enabled, how it's reading ssl certs?06:09
shyam89Which variable has that ssl cert info?06:09
ykarelshyam89, i can share logs for you for the job where ssl is enabled and u can see config option there06:10
shyam89ykarel: Sure, thanks06:10
shyam89Please forward06:10
ykarelshyam89, https://logserver.rdoproject.org/08/753808/1/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039/0fdbda8/logs/overcloud-controller-0/var/lib/config-data/puppet-generated/cinder/etc/cinder/cinder.conf.txt.gz06:13
ykarelhttps://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039&branch=stable%2Ftrain#06:13
shyam89ykarel: thanks06:14
*** bdodd has quit IRC06:18
*** udesale has quit IRC06:23
*** udesale has joined #tripleo06:23
*** sean-k-mooney1 has joined #tripleo06:26
*** shyam89 has quit IRC06:27
*** shyamb has quit IRC06:27
*** ykarel_ has joined #tripleo06:27
*** bdodd has joined #tripleo06:28
*** sean-k-mooney has quit IRC06:29
*** ykarel has quit IRC06:29
*** slaweq has joined #tripleo06:31
openstackgerritMatthias Runge proposed openstack/tripleo-heat-templates master: Add SendQueueLimit to collectd-amqp1  https://review.opendev.org/75528806:34
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: Use ansible_pkg_mgr instead of hardcoded yum  https://review.opendev.org/75523806:35
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: Use ansible_pkg_mgr instead of hardcoded yum  https://review.opendev.org/75523806:35
*** bogdando has joined #tripleo06:35
*** maciejjozefczyk_ has joined #tripleo06:38
openstackgerritRabi Mishra proposed openstack/tripleo-heat-templates master: Use OS::Heat::None in place of net-config-noop.yaml  https://review.opendev.org/75520206:41
openstackgerritMerged openstack/tripleo-common master: Improve bearer auth handling  https://review.opendev.org/74982006:43
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Clear cached facts based on the tag as well  https://review.opendev.org/75380806:43
*** jcapitao has joined #tripleo06:44
*** shyamb has joined #tripleo06:44
*** shyam89 has joined #tripleo06:44
*** maciejjozefczyk has joined #tripleo06:44
*** maciejjozefczyk_ has quit IRC06:44
*** ccamacho has joined #tripleo06:45
*** xek has joined #tripleo06:45
*** shyam89 has quit IRC06:48
*** shyamb has quit IRC06:48
*** shyamb has joined #tripleo06:48
*** shyam89 has joined #tripleo06:49
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: [WIP] Correct how the image_serve validation works  https://review.opendev.org/74395606:51
*** haleyb has quit IRC06:54
*** jonmasters has quit IRC06:54
*** ade_lee has quit IRC06:54
*** jtomasek has joined #tripleo06:56
*** michchap has quit IRC07:00
*** ykarel_ is now known as ykarel07:07
*** jfrancoa has joined #tripleo07:08
*** ratailor_ has quit IRC07:15
*** ccamacho has quit IRC07:17
*** amoralej|off is now known as amoralej07:17
*** rcernin has quit IRC07:19
*** shyam89 has quit IRC07:29
*** shyamb has quit IRC07:29
*** xek has quit IRC07:32
openstackgerritmathieu bultel proposed openstack/tripleo-validations master: Add tripleo-validations role for component testing  https://review.opendev.org/75539007:37
*** tosky has joined #tripleo07:39
*** rdopiera has joined #tripleo07:44
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: [WIP] Correct how the image_serve validation works  https://review.opendev.org/74395607:47
*** jbadiapa has joined #tripleo07:47
*** gfidente has joined #tripleo07:48
*** karthiks has joined #tripleo07:49
*** jpena|off is now known as jpena07:56
*** lucasagomes has joined #tripleo08:00
*** jpich has joined #tripleo08:03
*** akahat has quit IRC08:06
*** haleyb has joined #tripleo08:07
*** jonmasters has joined #tripleo08:07
*** ade_lee has joined #tripleo08:07
*** akahat has joined #tripleo08:08
*** jfrancoa has quit IRC08:14
openstackgerritFrancesco Pantano proposed openstack/tripleo-ansible master: [WIP] Compute dashboard_frontend_vip according to the haproxy frontend  https://review.opendev.org/75500408:15
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: Use ansible_pkg_mgr instead of hardcoded yum  https://review.opendev.org/75523808:17
openstackgerritFrancesco Pantano proposed openstack/tripleo-ansible master: [WIP] Compute dashboard_frontend_vip according to the haproxy frontend  https://review.opendev.org/75500408:20
*** ratailor has joined #tripleo08:20
*** jfrancoa has joined #tripleo08:31
*** shyamb has joined #tripleo08:36
*** shyam89 has joined #tripleo08:36
*** apetrich has joined #tripleo08:36
*** shyamb has quit IRC08:41
*** shyam89 has quit IRC08:41
*** derekh has joined #tripleo08:42
*** shyamb has joined #tripleo08:42
*** shyam89 has joined #tripleo08:42
*** jfrancoa has quit IRC08:43
openstackgerritSergii Golovatiuk proposed openstack/tripleo-ci master: Use cirros 0.4.0 image  https://review.opendev.org/75540208:45
*** ratailor has quit IRC08:46
*** tkajinam has quit IRC08:47
openstackgerritFrancesco Pantano proposed openstack/tripleo-ansible master: [WIP] Compute dashboard_frontend_vip according to the haproxy frontend  https://review.opendev.org/75500408:49
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations stable/ussuri: Add TripleO validation CLI script  https://review.opendev.org/75545108:51
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations stable/ussuri: Ensures script is executable  https://review.opendev.org/75545208:51
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations stable/ussuri: Change path for validation Ansible files  https://review.opendev.org/75545308:51
*** ratailor has joined #tripleo08:52
*** haleyb has quit IRC08:52
*** jonmasters has quit IRC08:52
*** ade_lee has quit IRC08:52
*** ysandeep is now known as ysandeep|away09:01
*** ratailor has quit IRC09:02
*** ratailor has joined #tripleo09:02
*** haleyb has joined #tripleo09:10
*** jonmasters has joined #tripleo09:10
*** ade_lee has joined #tripleo09:10
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations stable/ussuri: Ensures script is executable  https://review.opendev.org/75545209:10
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations stable/ussuri: Change path for validation Ansible files  https://review.opendev.org/75545309:10
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations stable/ussuri: Add tripleo-validation.py as script in setup.cfg  https://review.opendev.org/75545709:10
sshnaidmchandankumar, hi09:14
*** lmiccini has quit IRC09:19
openstackgerritRabi Mishra proposed openstack/tripleo-ansible master: Add some more nic templates[2]  https://review.opendev.org/75520109:20
openstackgerritFrancesco Pantano proposed openstack/tripleo-ansible master: [WIP] Compute dashboard_frontend_vip according to the haproxy frontend  https://review.opendev.org/75500409:27
*** shyam89 has quit IRC09:30
*** shyamb has quit IRC09:30
openstackgerritRabi Mishra proposed openstack/tripleo-ansible master: Add some more nic templates[2]  https://review.opendev.org/75520109:30
*** shyamb has joined #tripleo09:30
*** udesale_ has joined #tripleo09:30
*** shyam89 has joined #tripleo09:30
*** lmiccini has joined #tripleo09:32
*** udesale has quit IRC09:33
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: [DNM] Move package update to container prep  https://review.opendev.org/75546009:34
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Added tasks for building containers on CentOS-7  https://review.opendev.org/75241909:37
sshnaidmchandankumar, matbu  added deps repo ^09:38
sshnaidmmarios ^^09:38
sshnaidmsorry, matbu09:38
openstackgerritSagi Shnaidman proposed openstack/tripleo-ci master: Added CentOS-7 queens/train content provider job  https://review.opendev.org/75242109:39
openstackgerritRabi Mishra proposed openstack/tripleo-ansible master: Add more nic config templates[3]- multiple-nics-vlans  https://review.opendev.org/75546509:50
*** shyam89 has quit IRC09:57
*** shyamb has quit IRC09:57
openstackgerritFrancesco Pantano proposed openstack/tripleo-ansible master: [WIP] Compute dashboard_frontend_vip according to the haproxy frontend  https://review.opendev.org/75500409:59
openstackgerritFrancesco Pantano proposed openstack/tripleo-ansible master: [WIP] Compute dashboard_frontend_vip according to the haproxy frontend  https://review.opendev.org/75500410:01
*** ratailor has quit IRC10:04
*** ratailor has joined #tripleo10:07
openstackgerritMarios Andreou proposed openstack/tripleo-ci master: DNM add standalone-upgrade to tripleo-standalone-scenarios-pipeline  https://review.opendev.org/75340310:08
openstackgerritMarios Andreou proposed openstack/tripleo-quickstart-extras master: WIP adding standalone-upgrade to content-provider pipeline  https://review.opendev.org/75370810:08
openstackgerritMarios Andreou proposed openstack/tripleo-quickstart master: DNM add standalone-upgrade to tripleo-standalone-scenarios-pipeline  https://review.opendev.org/75547210:08
*** ysandeep|away is now known as ysandeep|sick10:09
*** ratailor has quit IRC10:09
openstackgerritMarios Andreou proposed openstack/tripleo-ci master: DNM add standalone-upgrade to tripleo-standalone-scenarios-pipeline  https://review.opendev.org/75340310:11
*** jcapitao has quit IRC10:13
*** holser has quit IRC10:14
*** ratailor has joined #tripleo10:14
*** ratailor has quit IRC10:15
*** ratailor has joined #tripleo10:15
*** holser has joined #tripleo10:16
*** nkinder has quit IRC10:18
*** nkinder has joined #tripleo10:19
*** rcernin has joined #tripleo10:21
*** abdysn has joined #tripleo10:24
*** rcernin has quit IRC10:26
*** rcernin has joined #tripleo10:26
sshnaidmAre there any problems with setuptools on centos7?10:30
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Added tasks for building containers on CentOS-7  https://review.opendev.org/75241910:32
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Added tasks for building containers on CentOS-7  https://review.opendev.org/75241910:33
*** lmiccini has quit IRC10:42
*** xek has joined #tripleo10:43
*** chem has quit IRC10:52
*** lmiccini has joined #tripleo10:56
openstackgerritMerged openstack/tripleo-heat-templates master: Use show base attribute for network/subnet attrs  https://review.opendev.org/75542810:59
openstackgerritGiulio Fidente proposed openstack/tripleo-ansible master: Add tripleo-lvmfilter role to restrict visible block devices for LVM2  https://review.opendev.org/69799011:02
*** abdysn has quit IRC11:19
*** abdysn has joined #tripleo11:19
openstackgerritFrancesco Pantano proposed openstack/tripleo-ansible master: Compute dashboard_frontend_vip according to the haproxy frontend  https://review.opendev.org/75500411:22
*** jpena is now known as jpena|lunch11:27
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates stable/ussuri: DNM Test centos8 upgrade jobs ussuri  https://review.opendev.org/73945711:29
*** xek has quit IRC11:30
*** xek has joined #tripleo11:34
openstackgerritFrancesco Pantano proposed openstack/tripleo-ansible master: Compute dashboard_frontend_vip according to the haproxy frontend  https://review.opendev.org/75500411:35
openstackgerritFrancesco Pantano proposed openstack/tripleo-ansible master: Compute dashboard_frontend_vip according to the haproxy frontend  https://review.opendev.org/75500411:37
*** hjensas is now known as hjensas|afk11:38
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Added tasks for building containers on CentOS-7  https://review.opendev.org/75241911:39
openstackgerritMarios Andreou proposed openstack/tripleo-quickstart-extras master: Remove train from HA conditional for standalone-upgrade  https://review.opendev.org/75549411:39
*** ratailor has quit IRC11:42
*** ratailor has joined #tripleo11:43
*** ratailor has quit IRC11:44
*** ratailor has joined #tripleo11:45
*** maciejjozefczyk has quit IRC11:47
*** ratailor has quit IRC11:49
*** rfolco has joined #tripleo11:57
*** rlandy has joined #tripleo11:58
*** rlandy is now known as rlandy|rover11:59
openstackgerritTakashi Kajinami proposed openstack/tripleo-heat-templates master: Allow to configure vxlan network type for OVN  https://review.opendev.org/75345311:59
*** b3nt_pin has joined #tripleo12:01
*** amoralej is now known as amoralej|lunch12:01
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: [WIP] Correct how the image_serve validation works  https://review.opendev.org/74395612:03
openstackgerritRonelle Landy proposed openstack/tripleo-heat-templates stable/train: Rely on templates for multinode updates job triggering  https://review.opendev.org/75534312:10
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: [WIP] Correct how the image_serve validation works  https://review.opendev.org/74395612:11
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient stable/train: Fix tcib build  https://review.opendev.org/75538912:12
EmilienM2020-09-30 18:59:31.845028 | centos-8 |   "msg": "Failed to validate GPG signature for containerd.io-1.2.6-3.3.el7.x86_64"12:14
EmilienMhave you folks seen that in molecule jobs on stable/train?12:14
EmilienMrlandy|rover: ^ fyi12:14
EmilienMhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e2a/753778/5/check/tripleo-ansible-centos-8-molecule-tripleo-container-manage/e2ad6d5/job-output.txt12:15
EmilienMit's probably the new ansible which requires GPG signed rpms unless disabled12:15
Tenguweshay|ruck: didn't click for now, but reading "selinux" and "we know" in the same line is pretty nice :).12:15
rlandy|roverEmilienM: - k .. will work on that12:15
*** raildo has joined #tripleo12:16
EmilienMrlandy|rover: I'm investigating as well12:17
EmilienMrlandy|rover: I found it12:17
EmilienMhttps://opendev.org/openstack/tripleo-ansible/src/branch/stable/train/zuul.d/playbooks/pre.yml#L54-L6012:17
rlandy|roverthat was quick :)12:17
EmilienMwe'll make cloudnull doing some pushups lol12:17
EmilienMi think it became my goal in life12:17
rlandy|roverok by me :)12:18
*** jpich has quit IRC12:18
*** jpich has joined #tripleo12:19
rlandy|roverEmilienM: want a LP bug for that?12:19
rlandy|roverpushups number required included12:19
rlandy|roverEmilienM: zbr pointed to related review https://review.opendev.org/#/c/752630/12:20
EmilienMrelated review indeed but I think we need to disable gpg check on that task12:21
EmilienMI'll create LP no worries12:21
*** haleyb has quit IRC12:22
rlandy|roverthanks12:22
*** haleyb has joined #tripleo12:24
zbrEmilienM: how is possible to get a broken signature on it? ....12:27
EmilienMwe don't import the gpg: https://download.docker.com/linux/centos/gpg12:27
EmilienMand it's now required12:27
EmilienMhttps://docs.ansible.com/ansible/latest/porting_guides/porting_guide_2.9.html#modules12:27
EmilienMit's even documented (a novel concept I know)12:27
EmilienMi'll send a patch12:27
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Assume Grafana and Ceph Dashboard to be on the storage or ctlplane nets  https://review.opendev.org/75520912:28
*** jpena|lunch is now known as jpena12:29
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: [train-only] install docker.com gpg key  https://review.opendev.org/75550612:32
EmilienMrlandy|rover: ^12:33
rlandy|roverEmilienM: thanks12:33
*** psachin has quit IRC12:35
EmilienMsshnaidm: do we have a story to use FQCN in our playbooks with the new Ansible version?12:36
sshnaidmEmilienM, not yet, which collections do you mean? podman_container?12:37
sshnaidmEmilienM, and which playbooks - CI/quickstart or tripleo?12:38
EmilienMeverything we have in tripleo12:38
openstackgerritSergii Golovatiuk proposed openstack/python-tripleoclient master: Replace logging with logging from oslo_log  https://review.opendev.org/75550712:39
sshnaidmEmilienM, I don't think we use any collections in CI playbooks.. so it's mostly about tripleo12:43
EmilienMright12:44
openstackgerritmathieu bultel proposed openstack/tripleo-validations master: Add tripleo-validations role for component testing  https://review.opendev.org/75539012:47
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: [DNM] Trigger tempest undercloud upgrade  https://review.opendev.org/75550912:49
*** udesale__ has joined #tripleo12:49
sshnaidmEmilienM, so we need to test 2.10 with tripleo and fix any issues12:49
sshnaidmEmilienM, maybe worth to think about adding collections requirements file12:50
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: [train-only] install docker.com gpg key  https://review.opendev.org/75550612:50
EmilienMsshnaidm: yeah12:50
EmilienMsshnaidm: also 2.10 is backward compatible for the FQCN stuff so we have time12:50
*** udesale_ has quit IRC12:51
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: Check mode support for 2 modules  https://review.opendev.org/75529912:51
openstackgerritRafael Folco proposed openstack/tripleo-ci master: [WIP] build report for container builds  https://review.opendev.org/75512412:51
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: Allow tripleo_firewall to work in check mode  https://review.opendev.org/75530112:51
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: Stop using profile_tasks as a base  https://review.opendev.org/75485512:52
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: Add image id compare  https://review.opendev.org/75377812:52
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: Make profile tasks host aware  https://review.opendev.org/75485712:52
*** pleimer has joined #tripleo12:58
openstackgerritMerged openstack/tripleo-heat-templates stable/ussuri: Assume Grafana and Ceph Dashboard to be on the storage or ctlplane nets  https://review.opendev.org/75520812:58
*** ekultails has joined #tripleo12:59
*** Goneri has joined #tripleo12:59
*** udesale_ has joined #tripleo13:02
openstackgerritMartin Mágr proposed openstack/puppet-tripleo master: [WIP] Add posibility to download scripts for sensubility  https://review.opendev.org/75441813:03
*** udesale__ has quit IRC13:05
openstackgerrityatin proposed openstack/tripleo-heat-templates master: [DNM] Test upgrade skip update  https://review.opendev.org/75551013:06
openstackgerritSergii Golovatiuk proposed openstack/python-tripleoclient master: Replace logging with logging from oslo_log  https://review.opendev.org/75550713:07
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ussuri: Implement a Minimal role  https://review.opendev.org/75510713:10
*** amoralej|lunch is now known as amoralej13:11
*** tbonds has quit IRC13:11
*** shyam89 has joined #tripleo13:18
*** shyamb has joined #tripleo13:18
openstackgerritMerged openstack/tripleo-ansible stable/train: [train-only] install docker.com gpg key  https://review.opendev.org/75550613:19
*** sean-k-mooney1 is now known as sean-k-mooney13:19
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart-extras master: add validations playbook for VF component testing  https://review.opendev.org/75538213:19
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo stable/queens: WIP DNM [queens-only] token flush only from bootstrap node  https://review.opendev.org/75551213:21
*** jpich has quit IRC13:21
*** jpich has joined #tripleo13:21
cloudnullEmilienM rlandy|rover - https://review.opendev.org/#/c/754460/3/zuul.d/playbooks/pre.yml@50 - I was seeing the same in the UBI backports13:21
cloudnullit seems the docker io gpg is no longer valid ...13:22
cloudnullI'll rebase my review on yours13:22
openstackgerritMerged openstack/tripleo-docs master: Add notes on removing novajoin  https://review.opendev.org/75275313:24
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible stable/train: Use the UBI8 image for testing  https://review.opendev.org/75446013:24
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart-extras master: add validations playbook for VF component testing  https://review.opendev.org/75538213:26
openstackgerritmathieu bultel proposed openstack/tripleo-ci master: Add validations playbook to the playbook execution  https://review.opendev.org/75551313:27
EmilienMcloudnull: you're welcome :D13:28
cloudnullTYVM :)13:28
*** tmazur has joined #tripleo13:28
* cloudnull does his pushups 13:28
sshnaidmwhat is best soft for taking screencast/video_record for Fedora (wayland)?13:28
cloudnullsshnaidm I'm using OBS13:29
EmilienMrecordmydesktop is good13:29
cloudnulland with the new version they've virtualcam which can be used in things like zoom/meet/bluejeans etc13:29
sshnaidmcool, thanks13:30
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/queens: [QUEENS-ONLY] Make ceph mons consistent with their systemd unit  https://review.opendev.org/75363613:30
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Add possibility to set logging source for Horizon  https://review.opendev.org/75551413:32
openstackgerrityatin proposed openstack/tripleo-heat-templates master: [DNM] Ensure openvswitch started post upgrade  https://review.opendev.org/75551513:33
*** aedc has joined #tripleo13:36
*** aedc has quit IRC13:36
*** slaweq has quit IRC13:36
*** rcernin has quit IRC13:38
*** slaweq has joined #tripleo13:42
*** xek has quit IRC13:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/train: Force container fetch  https://review.opendev.org/75530313:47
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/train: Force container fetch  https://review.opendev.org/75530313:47
*** chem has joined #tripleo13:51
*** shyam89 has quit IRC13:53
*** shyamb has quit IRC13:53
*** shyamb has joined #tripleo13:55
*** shyam89 has joined #tripleo13:55
EmilienMcloudnull: https://review.opendev.org/#/c/752324/ is failing to backport13:55
EmilienMhttps://739b5b5aed9a6d447975-907323b417218f46df6192f35c6995f8.ssl.cf2.rackcdn.com/752324/4/check/tripleo-build-containers-centos-7-buildah/543213e/logs/build.log13:55
cloudnullsure thing13:56
* cloudnull wonders if I used a py3-ism 13:56
EmilienMvery likely13:56
*** rascasoft has joined #tripleo14:01
cloudnullEmilienM is train still using Kolla ?14:01
cloudnullhttps://739b5b5aed9a6d447975-907323b417218f46df6192f35c6995f8.ssl.cf2.rackcdn.com/752324/4/check/tripleo-build-containers-centos-7-buildah/543213e/logs/buildah-builds/container-builds/4d2855cc-6b52-4d52-aa18-29da33bbcfa0/docker/base/Dockerfile14:01
EmilienMcloudnull: in this job, yes14:02
EmilienMit's the "legacy" job14:03
*** cloudnull has left #tripleo14:03
*** cloudnull has joined #tripleo14:03
cloudnullEmilienM can you resend, I lost the chat log on disconnect.14:03
* cloudnull fingers betrayed me 14:03
*** abdysn has quit IRC14:04
EmilienMhttps://739b5b5aed9a6d447975-907323b417218f46df6192f35c6995f8.ssl.cf2.rackcdn.com/752324/4/check/tripleo-build-containers-centos-7-buildah/543213e/logs/build.log14:04
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-common stable/train: Update container build to better reign in threads  https://review.opendev.org/75232414:05
cloudnull^ I think that is all that's needed.14:06
cloudnullhowever, I'm spinning a cent 7 instance to reproduce the issue14:06
openstackgerritMerged openstack/tripleo-quickstart-extras master: Fix containers prepare role  https://review.opendev.org/75530814:07
openstackgerritOliver Walsh proposed openstack/tripleo-docs master: Set GlanceBackendID to correct backend name for each stack  https://review.opendev.org/75552014:12
owalshabishop, fultonj: FYI ^14:12
openstackgerritOliver Walsh proposed openstack/tripleo-docs master: Set GlanceBackendID to correct backend name for each stack  https://review.opendev.org/75552014:12
abishopowalsh: thx, will take a look14:12
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Make NovaLibvirtOptVolumes role specific  https://review.opendev.org/75552314:15
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Make NovaLibvirtOptVolumes role specific  https://review.opendev.org/75552314:16
*** TrevorV has joined #tripleo14:16
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Make NovaLibvirtOptVolumes role specific  https://review.opendev.org/75552314:18
owalshmwhahaha: how about the other OptVolumes params?14:19
mwhahahawhich ones14:19
mwhahahathe ones for apis don't make sense14:19
mwhahahabecause you don't deploy multiple api versions14:20
mwhahahaLike NovaComputeOptVolumes?14:20
mwhahahathat one would make sense14:20
mwhahahai'll update that one as well14:20
owalshmwhahaha: OptEnv too https://review.opendev.org/53136614:21
mwhahahaya14:21
mwhahahai'll throw up a change for that as well14:21
mwhahahagood call14:21
owalshmwhahaha: ack, thanks14:21
*** shyam89 has quit IRC14:24
*** shyamb has quit IRC14:24
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Make NovaComputeOptVolumes and NovaComputeOptEnvVars role aware  https://review.opendev.org/75552714:26
mwhahahaowalsh: -^14:26
owalshmwhahaha: ack, thanks14:27
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Make NovaComputeOptVolumes and NovaComputeOptEnvVars role aware  https://review.opendev.org/75552714:30
*** xek has joined #tripleo14:33
*** shyamb has joined #tripleo14:37
*** shyam89 has joined #tripleo14:37
rlandy|roverbcafarel: hi .. due to https://bugs.launchpad.net/tripleo/+bug/1898046 and the last comment in https://review.opendev.org/#/c/749955 - can we revert this patch? is there a fix?14:40
openstackLaunchpad bug 1898046 in tripleo "Centos-8 Train OVB jobs are failing tempest - authenticated ssh - ERROR neutron.agent.linux.utils [-] Exit code: 2; Stdin: ; Stdout: ; Stderr: ping: sysctl: Name or service not known" [Critical,Triaged]14:40
bcafarelrlandy|rover: looking14:44
bcafarelhmm14:47
bcafarelrlandy|rover: looks like we need https://review.opendev.org/#/c/709100/ also backported14:51
rlandy|roverfrom Feb ... that was a long was back14:52
rlandy|roverbcafarel: ok, we can try rerun testing with that backport to train14:55
bcafarelyes, the mentioned backport was merged just yesterday (and was in ussuri) - but it needs another backport to go along it seems14:56
bcafarelchecking with #openstack-neutron folks :)14:56
bcafarelrlandy|rover: oh nice if that can be tested and confirmed, then we can add that backport too and hopefully have everything back in order14:57
*** hjensas|afk has quit IRC14:58
rlandy|roverk - let's see if we pick up the cherry-picked change ... https://review.opendev.org/#/c/755551/15:00
*** shyam89 has quit IRC15:07
*** shyamb has quit IRC15:07
weshay|ruckrlandy|rover, qq... answer as you have time..15:13
weshay|ruckrlandy|rover, any bugs or notes on what's failing in container-tools? https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?pipeline=openstack-dependencies-container_tools%2015:14
weshay|ruckwrong channel oops. meh15:14
rlandy|roverweshay|ruck: I have a track of failure15:14
rlandy|roverno bugs yet15:14
rlandy|roverwe agreed to CIX that yesterday15:15
rlandy|roverweshay|ruck: will add BZ/CIX this afternoon15:15
rlandy|roverit changes all the time though15:15
weshay|ruckaye15:15
weshay|ruckthank you15:15
rlandy|roverso we either need a running BZ15:15
rlandy|roverwith a standard heading15:16
rlandy|roveror a BZ with associated hackmd listing today's issue15:16
weshay|ruckslaweq, fyi https://review.opendev.org/#/c/755551/15:44
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: [DNM] Move package update to container prep  https://review.opendev.org/75546015:45
*** pojadhav is now known as pojadhav|afk15:48
openstackgerritPranali Deore proposed openstack/tripleo-heat-templates master: Enable glance sparse image upload  https://review.opendev.org/75095615:48
*** ykarel is now known as ykarel|away15:48
*** ykarel|away has quit IRC15:53
openstackgerritPranali Deore proposed openstack/tripleo-heat-templates master: Enable glance sparse image upload  https://review.opendev.org/75095615:53
*** jpich has quit IRC15:58
*** jmasud has quit IRC15:59
*** lucasagomes has quit IRC15:59
*** jpich has joined #tripleo15:59
*** jmasud has joined #tripleo15:59
*** dsneddon has quit IRC16:01
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Remove extra line breaking up container prep command  https://review.opendev.org/75536816:06
EmilienMekultails: do you plan to backport https://review.opendev.org/#/c/751097/ into train?16:07
EmilienM(i'm sure our performance team would say please do it)16:07
*** ssulliva has joined #tripleo16:08
*** bogdando has quit IRC16:08
*** rascasoft has quit IRC16:10
mariosmwhahaha: EmilienM: can you please see https://bugs.launchpad.net/tripleo/+bug/1895822/comments/21 when you have some time (train->ussuri upgrade - something wrong with networking and perhaps related to 'switch to HA by default')16:11
openstackLaunchpad bug 1895822 in tripleo "centos8 standalone-upgrade-ussuri fails tempest ping router IP" [Critical,Triaged] - Assigned to Alex Schultz (alex-schultz)16:11
*** ekultails has quit IRC16:11
mwhahahai blame bandini for HA related things16:11
*** lmiccini has quit IRC16:12
EmilienMbut that's too easy :D16:12
mariosmwhahaha: well he did merge the ha by default patch so ... clearly16:12
EmilienMi blamed bandini for less than that TBH16:13
mwhahahahe also the added teh ctonrole-plane-vip cmd arg for some reason16:13
mariosholser: fyi did some more digging today tl;dr br-ex is gone after the upgrade https://bugs.launchpad.net/tripleo/+bug/1895822/comments/2116:13
openstackLaunchpad bug 1895822 in tripleo "centos8 standalone-upgrade-ussuri fails tempest ping router IP" [Critical,Triaged] - Assigned to Alex Schultz (alex-schultz)16:13
mwhahahai have a feeling all thsi stuff "worked" just by happenstance and we need to understand how it's supposed to work first16:13
mwhahahaI didn't think we don't manage br-ex via os-net-config16:14
mwhahahai could be wrong however16:14
mwhahahai'd have to go figure out where that's managed from16:14
mwhahahabr-ex is defined in a neutron param somewhere16:14
holsermarios nice16:14
mariosmwhahaha: well i sanity checked a 'normal' standalone and it is there... and it has a route for it https://799a0e5cbc4205600635-877a0f70cfb612990952d1399a198d7a.ssl.cf5.rackcdn.com/750595/1/check/tripleo-ci-centos-8-standalone-upgrade/2ecbaf6/logs/undercloud/var/log/extra/network.txt16:14
holsermwhahaha I don't know if we manage, but what I know we reconfigure network on "upgrade"16:14
EmilienMyeah it's defined by NeutronPhysicalBridge16:15
mariosmwhahaha: its in the os-net-config data so we are managing/defining that16:15
* mwhahaha downloads the ansible to diff16:16
mariosmwhahaha: EmilienM: thanks for checking16:16
holsermarios I would move upgrade part from quickstart extras to tripleo ansible operator16:17
holseras it's very weird right now...16:17
mariosholser: yes operator for standalone-upgrade is something i want to look at soon16:18
mwhahahabr-ex comes from the ci network config fwiw16:18
holsermarios compare https://799a0e5cbc4205600635-877a0f70cfb612990952d1399a198d7a.ssl.cf5.rackcdn.com/750595/1/check/tripleo-ci-centos-8-standalone-upgrade/2ecbaf6/logs/undercloud/home/zuul/standalone-upgrade.sh16:18
mwhahahaso probably should check that between train/ussuri16:18
holserand https://799a0e5cbc4205600635-877a0f70cfb612990952d1399a198d7a.ssl.cf5.rackcdn.com/750595/1/check/tripleo-ci-centos-8-standalone-upgrade/2ecbaf6/logs/undercloud/home/zuul/tripleo_deploy.sh16:18
holserthey are kinda different16:18
mariosmwhahaha: hmm ack ok16:18
EmilienMhttps://opendev.org/openstack/tripleo-ansible/src/branch/stable/ussuri/tripleo_ansible/roles/tripleo_network_config/tasks/main.yml#L56-L6616:18
holserEmilienM that's correct16:19
mariosholser: they are different but same :) one just has the values in paramters at the top16:20
EmilienMit could be missing form the networkconfig16:20
mariosholser: don't think that is the problem16:20
mwhahahahttp://paste.openstack.org/show/798624/16:20
mwhahahait's not in network config in the install16:20
mwhahahait is in the network config in the upgrade16:20
mwhahahathose are the only references in the ansible bits16:20
mwhahahaso something changed in ussuri such that br-ex is now defined (???)16:20
mwhahahai don't think it's supposed to be defined16:21
mwhahahabecause i thought neutron added it?16:21
holsermwhahaha I love these puzzles... the system is so big and complex than noone understands it fully16:21
mwhahahaall that integration is voodoo to me16:21
holseryou need to walk through 5-10 people to find the right answer :P16:22
mariosmwhahaha: k man thanks for checking was mainly asking in case it jogged something ... don't mean for you to rabbit hole here. if something comes to you please add on the bug16:22
mwhahahait's all a rabbit hole16:22
* marios sigh16:22
holserlol16:22
holserand we are inside of it16:22
EmilienMi mean for once we get to not blame weshay|ruck16:22
mariosEmilienM: i think that is implicit so ... almost unnecessary?16:23
weshay|ruckah man.. I love being the center of attention16:23
* marios runs16:23
weshay|ruckthat's why I break shit16:23
* mwhahaha goes diffing env files16:24
*** udesale_ has quit IRC16:25
*** amoralej is now known as amoralej|off16:25
mwhahahaso the env files seem to be ok now, so it points to THT problems16:27
mwhahahaunless the tripleo upgrade command does some magically stuff (or maybe is missing something) from the regular deploy command16:28
mwhahahait should be noted that the upgrade command is including /usr/share/openstack-tripleo-heat-templates/environments/docker-ha.yaml where install does not16:29
mwhahahaoh nm it does now16:29
* mwhahaha is blind16:29
mariosmwhahaha: yeah we fixed that stuff... i posted https://review.opendev.org/#/c/742418/13/zuul.d/standalone-jobs.yaml and you posted https://review.opendev.org/#/c/753817/16:30
HardCaseHey all, hoping to get some guidance.  Had a controller hard drive fail, tried rebuild but it would not pxe boot, decided to follow the RHOSP docs for redeploying and running into "Unable to attach VIF f1ec3cf7-5d1b-41d5-8df0-1c0b7f00a6b7, not enough free physical ports".  I can't seem to find why, thoughts?16:31
*** jpich has quit IRC16:40
mariosHardCase: o/ hard to know but have you seen that https://ask.openstack.org/en/question/122009/problem-deployment-overcloud-cannot-attach-vif-not-enough-free-physical-ports/ seems similar to the error you're seeing might be16:41
openstackgerritMerged openstack/tripleo-specs master: Spec for network data v2 format  https://review.opendev.org/75243716:43
HardCasemarios Thanks for that, I did see this and looked into it but it seems to not apply to my setup.  It is entirely possible I have mucked something up and am just trying to find where.16:43
mariosHardCase: ack sorry it was worth a mention ;)16:46
*** skramaja has quit IRC16:46
mwhahahamarios: so i think there's a bug in train because br-ex is missing from the network config. alternatively it might be a bug in ussuir because it is defined in the standalone config16:46
HardCasemarios thank you for sending it my way, I appreciate the help16:47
mariosmwhahaha: hmm ack thanks for that.. noting to dig more tomorrow16:47
mwhahahai'll keep poking at it16:47
mariosmwhahaha: thank you appreciated16:47
mwhahahathough since it is there, i'm uncertain if that's actually a problem now16:48
mariosmwhahaha: we need to get this job voting asap. its what you get when the job doesn't vote this is like the 3/4 bug in a row on our way to making it green16:48
mariosmwhahaha: hoping its the last one :)16:48
mwhahahapffft keep dreaming16:48
marios;)16:48
mwhahaha+ sed -i s/interface_name/br-ex/g /etc/os-net-config/config.json",16:49
mwhahahai hate the the os-net-config stuff16:49
mwhahahaso it is there in both16:49
mwhahahaoh16:49
mwhahahais train ovn byd efault?16:49
mwhahaha<13>Oct  1 13:45:50 puppet-user: Notice: /Stage[main]/Ovn::Controller/Exec[br-ex]/returns: executed successfully16:49
mwhahahathat's line isn't in ussuri anymore16:50
mwhahahawait we lost ansible.log in the tar.bzip216:50
* mwhahaha flips tables16:50
mariosohdear16:50
* marios EOD16:52
mwhahahahttps://github.com/openstack/puppet-ovn/blob/stable/ussuri/manifests/controller.pp#L164-L17016:54
mwhahahano logner runs for whatever reason16:54
*** marios is now known as marios|out16:55
*** jtomasek has quit IRC16:57
*** derekh has quit IRC17:03
*** rdopiera has quit IRC17:05
*** jpena is now known as jpena|off17:05
*** ayoung has joined #tripleo17:07
mwhahahai think i might have found it17:11
mwhahahaEmilienM: did we finish backporting the network config bits? we've lost the run-os-net-config script thing17:12
mwhahahahttps://799a0e5cbc4205600635-877a0f70cfb612990952d1399a198d7a.ssl.cf5.rackcdn.com/750595/1/check/tripleo-ci-centos-8-standalone-upgrade/2ecbaf6/logs/undercloud/home/zuul/standalone-ansible-oewpzx4m/Standalone/NetworkConfig17:12
mwhahahathat's not the script anymore, it's the data17:13
mwhahahabut https://799a0e5cbc4205600635-877a0f70cfb612990952d1399a198d7a.ssl.cf5.rackcdn.com/750595/1/check/tripleo-ci-centos-8-standalone-upgrade/2ecbaf6/logs/undercloud/home/zuul/standalone-ansible-oewpzx4m/deploy_steps_playbook.yaml indicates it should be the script17:13
* mwhahaha wanders off for lunch and will pick back up later17:13
*** ekultails has joined #tripleo17:13
*** karthiks has quit IRC17:23
*** dsneddon has joined #tripleo17:23
EmilienMmwhahaha: AFIK the backports are completed, it's not the script anymore indeed and ramishra is converting it to native j2 templates so it's configured this way instead of relying on this NetworkConfig file iiuc17:42
mwhahahai wodner if the bug is there17:43
*** ykarel|away has joined #tripleo17:43
EmilienMi'm looking at the journal logs to see what happens with br-ex17:48
mwhahahatbh i think we've been lucky and we should actually switch the FIP network to be a different net17:48
mwhahahai think it's just magically worked for some reason17:49
mwhahahabut we end up with two interfaces on the 192.168.24.x network17:49
mwhahahaso routing gets lost17:49
mwhahahai thought there was a bz around this with train17:49
* mwhahaha goes looking17:49
mwhahahahttps://bugzilla.redhat.com/show_bug.cgi?id=1806100 wonder if that's it17:50
openstackbugzilla.redhat.com bug 1806100 in openstack-tripleo "OpenStack All-In-One post-install Gateway Not Found" [Medium,On_dev] - Assigned to beagles17:50
mwhahahai think for standalone if we're sharing the interface br-ctrlplane should be the neutron public interface17:53
mwhahahanot br-ex17:53
EmilienMmwhahaha: yeah we should create another net and use it for fips17:53
mwhahahahttps://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/deployment/standalone.html#example-1-nic-using-compute-with-tenant-and-provider-networks17:54
mwhahahawe need it configured like that17:54
mwhahahabut i don't think it's correct17:54
mwhahahaso that's teh bug is that it's magically worked, but br-ex should actually be tied to br-ctlplane or something17:54
mwhahahai recall the single interface thing being a very complex to config17:55
mwhahahawe document using br-ctlplane in that17:57
mwhahahaso i think the bug is that we're doing a br-ex at all17:57
openstackgerrityatin proposed openstack/tripleo-heat-templates master: [DNM] Test skip ovs upgrade  https://review.opendev.org/75551017:57
mwhahahaso i thought we used to configure br-ex in quickstart17:58
mwhahahabecause multipnode17:58
EmilienMwe could remove it for standalone jobs17:59
*** saneax has quit IRC17:59
mwhahahahttps://review.opendev.org/#/c/575564/18:00
mwhahahai can just blame you18:00
*** b3nt_pin is now known as beagles18:00
*** jonmasters has quit IRC18:00
*** ade_lee has quit IRC18:00
mwhahahafwiw roles/undercloud-setup/templates/vxlan_networking.sh.j2 configured teh br-ex18:01
mwhahahai wonder if that went away at some point18:01
EmilienMmore than 2 years ago, I was so young18:02
*** ccamacho has joined #tripleo18:02
mwhahahalet me propose switching that18:02
beaglesmwhahaha: regarding using "different network for FIP" agree whole-heartedly. there is a lot of confusion on neutron config for FIPs and it being conflated with the control plane or the tripleo external (a.k.a public api) network18:02
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Switch standalone default interface to br-ctlplane  https://review.opendev.org/75560718:04
mwhahahawonder if that'll fix it18:04
* mwhahaha shrugs and throws things at the wall to see if they stick18:05
mwhahaha  # re-use ctlplane bridge for public net, defined in the standalone18:05
mwhahaha  # net config (do not change unless you know what you're doing)18:05
mwhahahawe clearly do not know what we are doing18:05
*** bandini has quit IRC18:07
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates stable/ussuri: DNM Test centos8 upgrade jobs ussuri  https://review.opendev.org/73945718:08
*** ssulliva has left #tripleo18:09
*** marios|out has quit IRC18:09
openstackgerritMerged openstack/tripleo-heat-templates master: Deprecate novajoin  https://review.opendev.org/73035518:14
openstackgerritMerged openstack/python-tripleoclient master: Deprecate novajoin  https://review.opendev.org/73035418:14
*** ykarel|away has quit IRC18:20
rlandy|roverbcafarel: weshay|ruck: looks better with https://review.opendev.org/#/c/755551/ https://logserver.rdoproject.org/82/16882/12/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-train/c8f69c6/logs/overcloud-novacompute-0/var/log/containers/neutron/ovn-metadata-agent.log.txt.gz18:26
rlandy|roverpassing fs001 OVB18:26
rlandy|roversoniya29|ruck: ^^ fyi18:27
*** gchamoul has quit IRC18:31
*** gchamoul has joined #tripleo18:31
openstackgerritMerged openstack/tripleo-heat-templates stable/ussuri: Create container-puppet-tasks files per step in check mode  https://review.opendev.org/75510518:45
*** jonmasters has joined #tripleo18:47
*** ade_lee has joined #tripleo18:47
openstackgerritMerged openstack/tripleo-heat-templates master: firewall: make ExtraFirewallRules role specific  https://review.opendev.org/75513318:50
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Switch standalone default interface to br-ctlplane  https://review.opendev.org/75560718:54
*** iurygregory has quit IRC18:55
openstackgerritMerged openstack/tripleo-quickstart-extras master: Partial revert build-test-packages fix (build directory)  https://review.opendev.org/75303418:58
*** rlandy|rover is now known as rlandy|rover|mtg19:00
*** jmasud has quit IRC19:03
openstackgerritAlan Bishop proposed openstack/tripleo-ansible master: Add tripleo_multipathd role  https://review.opendev.org/74911719:11
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: Update cirros image from 3.6 to 4.0  https://review.opendev.org/75540119:16
openstackgerritJohn Fulton proposed openstack/tripleo-specs master: Introduce tripleo-ceph spec  https://review.opendev.org/72310819:22
openstackgerritMerged openstack/tripleo-ansible master: Compute dashboard_frontend_vip according to the haproxy frontend  https://review.opendev.org/75500419:25
openstackgerritMerged openstack/tripleo-ansible stable/train: Check mode support for 2 modules  https://review.opendev.org/75529919:25
openstackgerritMerged openstack/tripleo-ansible stable/train: Stop using profile_tasks as a base  https://review.opendev.org/75485519:25
openstackgerritMerged openstack/tripleo-ansible stable/train: Allow tripleo_firewall to work in check mode  https://review.opendev.org/75530119:25
openstackgerritMerged openstack/tripleo-ansible stable/train: Add image id compare  https://review.opendev.org/75377819:25
*** rlandy|rover|mtg is now known as rlandy|rover19:30
*** jmasud has joined #tripleo19:35
*** jmasud has quit IRC19:39
openstackgerritMerged openstack/tripleo-ansible stable/train: Make profile tasks host aware  https://review.opendev.org/75485719:41
*** fultonj has quit IRC19:42
*** fultonj has joined #tripleo19:43
*** fultonj has quit IRC19:43
*** iurygregory has joined #tripleo19:43
*** fultonj has joined #tripleo19:43
*** jmasud has joined #tripleo19:44
openstackgerritRafael Folco proposed openstack/tripleo-ci master: [WIP] build report for container builds  https://review.opendev.org/75512419:46
mwhahaharlandy|rover: did you ever get 8 stream working? looks like pacemaker isn't working for me19:51
rlandy|rovermwhahaha: the stream jobs are set up https://review.rdoproject.org/zuul/builds?pipeline=openstack-dependencies-centos8stream%20 - but so far no passes on the jobs19:53
rlandy|roverI haven't spent time debugging the failures yet19:53
mwhahahacontainer-build is broke19:54
*** jmasud has quit IRC19:55
mwhahahamissing cni network, anyway yea looks liek pacemaker doesn't work19:55
rlandy|rovermwhahaha: forwarding you email from mike burns19:55
mwhahahamaybe i'll throw things at bandini in the morning19:55
mwhahahawas trying to test out podman 2.x cause centos8 normal is on 1.6.4 (an older one too)19:55
rlandy|roverhe and bandini's discussion on the error19:55
*** gfidente has quit IRC19:57
mwhahahahrm some weird yaml errors19:57
rlandy|roversame on rhel 8 ... podman.x86_64                                 1.6.4-12.module+el8.2.0+6670+014d0ff8           @rhel-8-3-beta19:58
mwhahahamodule:rhel8 is 2.0.519:58
mwhahahamodule 2.0 is 1.6.4-15 on stream19:59
rlandy|roversorry, container tools 2 on rhel 819:59
mwhahahayea that's what centos819:59
rlandy|roverI have the container-tools:rhel8 job as well19:59
rlandy|roverthat's internal19:59
mwhahahalet me throw up a fix for OVNBridgeMappings19:59
mwhahahawe can blame hjensas20:00
rlandy|roverbasically we settled one CIX'ing these errors and putting them in pod-chain degraded20:00
rlandy|roverprod-chain20:01
mwhahahado we have a bug for the ovn::controler yaml fail20:01
rlandy|roverno bugs yet on stream at all20:02
mwhahahak20:02
mwhahahai'll make one20:02
rlandy|roverhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-dependencies-container_tools/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-container_tools-container-build-rhos-16.2/d562f7e/logs/undercloud/home/zuul/20:03
mwhahahahttps://bugs.launchpad.net/tripleo/+bug/189811320:03
openstackLaunchpad bug 1898113 in tripleo "centos8 stream job fails processing overcloud.yaml" [Medium,Triaged]20:03
rlandy|rovercontainer-tools log20:04
mwhahahahttps://github.com/containers/buildah/issues/252120:04
rlandy|roverCIX'ing that20:04
mwhahahaisn't it that?20:04
mwhahahawe need container-tools to get on with investigasting20:04
rlandy|roveryeah - the same error we were looking a while back20:05
rlandy|rovermissing layers20:05
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Quote lookup var  https://review.opendev.org/75564220:05
mwhahahathat should fix https://logserver.rdoproject.org/openstack-dependencies-centos8stream/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-centos8stream-master/f6ede61/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz20:06
mwhahahathough i didn't get that when i just ran an install on stream20:06
mwhahahaso not certain where that's coming from20:06
rlandy|roverthe job that gets to deploy doesn't build containers20:08
rlandy|roverso it's the known-working containers on a stream base  node - which should match your install??20:08
mwhahahayou mean building the containers?20:09
mwhahahai'm just trying the normal containers20:09
mwhahahain theory it shold only fail the bundle bits when i get there, but i'm not there yet20:09
mwhahahabecause pacemaker won't start20:09
mwhahahayou might be able to build with container-tools:1.020:10
mwhahahai'm not certain tho20:10
rlandy|roverthe container build job has never worked but the job with stream on the node and the regular containers works once20:12
rlandy|roverhttps://logserver.rdoproject.org/openstack-dependencies-centos8stream/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-centos8stream-master/30ff782/20:12
weshay|ruckrlandy|rover, ya.. so zuul /node is obviously not great.. https://api.us-east.open-edge.io:8080/swift/v1/AUTH_e02c11e4e2c24efc98022353c88ab506/zuul_opendev_logs_ea0/748718/5/gate/tripleo-ci-centos-8-standalone/ea0ec83/logs/20:13
weshay|ruckmissing logs20:13
mwhahahayea no idea how that worked :D20:13
rlandy|roverweshay|ruck: is that consistent?20:14
rlandy|roveronly one gate jobs with no logs20:14
rlandy|roverthat definitely failed late enough to have logs20:15
weshay|ruckmeh20:15
weshay|ruckno20:15
mwhahahaugh pcs auth command change20:15
weshay|ruckrlandy|rover, it's missing the node logs thogh20:15
rlandy|roverseen that once before20:18
rlandy|rovercollect logs bailed20:18
rlandy|rover localhost | Provider: vexxhost-ca-ymq-120:19
rlandy|rovercan't even blame some provider we never use20:20
openstackgerritPaul Leimer proposed openstack/puppet-tripleo master: Add changes for collectd libpod stats plugin  https://review.opendev.org/75483820:30
mwhahaharlandy|rover: fyi i think i found my pacemaker problem20:32
mwhahahaand it's stream specific20:32
mwhahahamaybe not :/20:34
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add bound_interface_ovs_options to overcloud.j2  https://review.opendev.org/75564620:35
bcafarelrlandy|rover: nice to see https://review.opendev.org/#/c/755551/ fixing train, we wil get it merged asap (well as fast as CI allows)20:36
openstackgerritPaul Leimer proposed openstack/puppet-tripleo master: Add changes for collectd libpod stats plugin  https://review.opendev.org/75483820:37
openstackgerritAlex Schultz proposed openstack/puppet-pacemaker master: Fix pcs 0.10 detection for 8-stream  https://review.opendev.org/75564920:42
mwhahaharlandy|rover: -^ that's what i hit20:42
rlandy|roverbcafarel: great - thanks20:44
rlandy|rovermwhahaha: nice - one less issue to log20:44
* mwhahaha tries again20:44
mwhahahastupid versions20:44
mwhahahawonder if we can just cut a release and drop the 0.9 stuff20:44
mwhahahamaybe i'll throw things at bandini tomorrow and find out20:45
*** tbonds has joined #tripleo20:48
rlandy|roverhttps://bugs.launchpad.net/tripleo/+bug/1898120 for the error from "Deploy the content provider registry"20:51
openstackLaunchpad bug 1898120 in tripleo "centos8 stream: Deploy the content provider registry fails with "Error: error configuring network namespace for container : Missing CNI default network"" [Medium,Triaged]20:51
mwhahahathat's likely because we nuke the default cni network byd efault20:51
mwhahahai was looking to fix that20:51
mwhahahabut you can't not have a network in podman20:52
mwhahahahttps://review.opendev.org/#/c/750780/20:52
mwhahahai'll poke at that one tomorrow20:52
* mwhahaha wanders off20:52
rlandy|rovermwhahaha: k, thanks20:52
*** jmasud has joined #tripleo20:57
*** rfolco has quit IRC21:07
*** freenzyfriday has joined #tripleo21:09
*** raildo has quit IRC21:13
*** freenzyfriday has quit IRC21:14
*** xek has quit IRC21:15
*** slaweq has quit IRC21:15
*** pleimer has quit IRC21:24
*** holser has quit IRC21:25
*** stevebaker has quit IRC21:29
*** stevebaker has joined #tripleo21:29
*** mgoddard has quit IRC21:30
*** social has quit IRC21:30
*** mgoddard has joined #tripleo21:36
openstackgerritMerged openstack/tripleo-ansible master: Ensure we catch new openvswitch disruption during upgrade/update.  https://review.opendev.org/75531021:39
*** holser has joined #tripleo21:42
*** freenzyfriday has joined #tripleo21:55
*** freenzyfriday has quit IRC21:59
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Rely on templates for multinode updates job triggering  https://review.opendev.org/75534322:12
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Adapt container health check for built-in podman health checks  https://review.opendev.org/75525022:21
openstackgerritMerged openstack/tripleo-heat-templates master: Add 'NovaAllowResizeToSameHost' parameter  https://review.opendev.org/75499222:21
openstackgerritMerged openstack/tripleo-heat-templates stable/train: [Train-only] Configure podman registries during a minor update.  https://review.opendev.org/75523722:21
openstackgerritMerged openstack/tripleo-validations master: Docs: Replace tags heading with a real heading  https://review.opendev.org/75524422:21
openstackgerritMerged openstack/puppet-tripleo master: Add Memcached certificate generation  https://review.opendev.org/74553222:21
openstackgerritMerged openstack/tripleo-validations master: Docs: Use correct spec link  https://review.opendev.org/75524622:21
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Centralized logging minor fixes  https://review.opendev.org/75355822:21
openstackgerritMerged openstack/tripleo-heat-templates master: Add redis to designate environment  https://review.opendev.org/75036222:21
openstackgerritMerged openstack/tripleo-heat-templates master: Allow partial override about SshServerOptions  https://review.opendev.org/72256522:21
*** rcernin has joined #tripleo22:24
*** jmasud has quit IRC22:30
*** jmasud has joined #tripleo22:31
*** rlandy|rover has quit IRC22:34
*** cyberpear has quit IRC22:34
*** tosky has quit IRC22:45
*** freenzyfriday has joined #tripleo22:46
*** freenzyfriday has quit IRC22:51
*** holser has quit IRC22:54
*** tkajinam has joined #tripleo23:00
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible stable/train: Use the UBI8 image for testing  https://review.opendev.org/75446023:01
*** TrevorV has quit IRC23:02
openstackgerritPurandhar Sairam Mannidi proposed openstack/tripleo-heat-templates master: Fixed Neutron environment file service descriptions  https://review.opendev.org/75525723:03
*** matbu has quit IRC23:03
*** social has joined #tripleo23:07
*** tmazur has quit IRC23:12
*** rfolco has joined #tripleo23:19
*** rfolco has quit IRC23:24
*** rfolco has joined #tripleo23:25
*** rfolco has quit IRC23:29
*** gthiemonge has quit IRC23:42
*** gthiemonge has joined #tripleo23:43
*** jonmasters has quit IRC23:54
*** ade_lee has quit IRC23:54
*** Goneri has quit IRC23:55
openstackgerritMerged openstack/tripleo-heat-templates stable/ussuri: Gather more extra stats with the collectd virt plugin  https://review.opendev.org/75509923:57
*** redrobot has quit IRC23:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!