Wednesday, 2021-03-03

*** johanssone has quit IRC00:16
*** tosky has quit IRC00:17
*** johanssone has joined #openstack-ansible00:19
*** manti has quit IRC00:19
*** manti has joined #openstack-ansible00:23
jamesdentonjrosser Looks like the ODL role for Ansible hasn't been updated in > 18 months: https://github.com/opendaylight/integration-packaging-ansible-opendaylight. I'm not gonna spend much more time on it and maybe we should consider next steps00:30
*** macz_ has quit IRC00:49
*** spatel has joined #openstack-ansible00:52
*** spatel has quit IRC00:57
*** spatel has joined #openstack-ansible01:07
*** Underknowledge has quit IRC01:08
*** Underknowledge has joined #openstack-ansible01:08
*** gyee has quit IRC01:17
*** Underknowledge2 has joined #openstack-ansible01:51
*** Underknowledge has quit IRC01:54
*** Underknowledge2 is now known as Underknowledge01:54
*** admin0 has quit IRC02:04
openstackgerritMerged openstack/openstack-ansible master: Bump ansible-base version and collections  https://review.opendev.org/c/openstack/openstack-ansible/+/77658102:29
*** Underknowledge has quit IRC02:38
*** macz_ has joined #openstack-ansible02:46
*** macz_ has quit IRC02:50
*** jamesdenton has quit IRC02:58
*** jamesdenton has joined #openstack-ansible02:58
openstackgerritMerged openstack/openstack-ansible-galera_server master: Configure my.cnf for server when galera_root_user is not root  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/77589303:07
*** dasp has quit IRC03:34
*** dasp has joined #openstack-ansible03:45
openstackgerritMerged openstack/openstack-ansible-os_gnocchi master: Drop distro tests  https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/77642504:02
openstackgerritMerged openstack/openstack-ansible-os_gnocchi master: Delete gnocchi_identity_setup  https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/77591804:02
*** shyamb has joined #openstack-ansible04:16
openstackgerritJames Denton proposed openstack/openstack-ansible-os_neutron master: Add integrated tests various Neutron deployment scenarios  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/77801504:21
*** spatel has quit IRC04:48
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-ansible05:33
*** shyamb has quit IRC06:24
*** jamesdenton has quit IRC06:27
*** jamesdenton has joined #openstack-ansible06:27
*** pto has joined #openstack-ansible06:54
*** pto has joined #openstack-ansible06:56
ptomgariepy: Yes! I did. The OpenStack part was straight forward, but I had some problems with Ubuntu 20.04 which have changed the way to blacklist pci devices. Here are user_variables.ini part: http://paste.openstack.org/show/803172/ and the playbook i use to configure the computes http://paste.openstack.org/show/803173/ - Any suggestions on how to embed the compute part in openstack ansible?07:02
*** luksky has joined #openstack-ansible07:19
*** waxfire0 has joined #openstack-ansible07:35
*** waxfire has quit IRC07:35
*** waxfire0 is now known as waxfire07:35
*** miloa has joined #openstack-ansible07:36
*** miloa has quit IRC07:45
*** rpittau|afk is now known as rpittau07:52
*** andrewbonney has joined #openstack-ansible08:14
*** jamesgibo has joined #openstack-ansible08:19
*** MickyMan77 has quit IRC08:30
*** gokhani has joined #openstack-ansible08:31
*** tosky has joined #openstack-ansible08:34
gokhaniHi folks, ı have a development environment which is installed by OSA Ussuri. ı have problems on nova-api side. I can observe rabbitmq timeout errors > http://paste.openstack.org/show/803175/ and rarely I am getting connection failed errors to rabbitmq on api side > http://paste.openstack.org/show/803176/. And ıt is strange behaviour now we don't08:37
gokhanihave any uwsgi processes on nova side. I doubt about uwsgi + nova. this is expected behaviour or there is a problem on nova, I am not sure. do you have any ideas about this ?08:37
gokhaniit opens rabbitmq uwsgi connection and after 3 minutes it gives timeout errors and last it creates a new connection08:58
*** Underknowledge has joined #openstack-ansible09:11
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts for dynamic_address_fact  https://review.opendev.org/c/openstack/openstack-ansible/+/77798909:12
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts for dynamic_address_fact  https://review.opendev.org/c/openstack/openstack-ansible/+/77798909:12
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts in common playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799009:12
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799609:12
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in group_vars  https://review.opendev.org/c/openstack/openstack-ansible/+/77799709:13
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in tests  https://review.opendev.org/c/openstack/openstack-ansible/+/77799809:13
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in AIO config  https://review.opendev.org/c/openstack/openstack-ansible/+/77799909:13
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in docs  https://review.opendev.org/c/openstack/openstack-ansible/+/77800009:14
*** spatel has joined #openstack-ansible09:15
*** shyamb has joined #openstack-ansible09:16
*** shyam89 has joined #openstack-ansible09:16
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts for dynamic_address_fact  https://review.opendev.org/c/openstack/openstack-ansible/+/77798909:38
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts in common playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799009:38
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799609:38
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in group_vars  https://review.opendev.org/c/openstack/openstack-ansible/+/77799709:38
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in tests  https://review.opendev.org/c/openstack/openstack-ansible/+/77799809:39
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in AIO config  https://review.opendev.org/c/openstack/openstack-ansible/+/77799909:39
*** spatel has quit IRC09:39
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in docs  https://review.opendev.org/c/openstack/openstack-ansible/+/77800009:39
*** SiavashSardari has joined #openstack-ansible09:52
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: WIP - Gather minimal facts and disable fact variables  https://review.opendev.org/c/openstack/openstack-ansible/+/77839609:53
*** sshnaidm|afk is now known as sshnaidm10:06
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_gnocchi master: Provide different package lists for install and wheel build  https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/77822210:10
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_gnocchi master: Move gnocchi pip packages from constraints to requirements  https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/77228110:10
*** shyam89 has quit IRC10:11
*** shyamb has quit IRC10:11
*** gshippey has joined #openstack-ansible10:15
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: WIP - Gather minimal facts and disable fact variables  https://review.opendev.org/c/openstack/openstack-ansible/+/77839610:29
*** shyam89 has joined #openstack-ansible10:37
*** shyamb has joined #openstack-ansible10:37
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts for dynamic_address_fact  https://review.opendev.org/c/openstack/openstack-ansible/+/77798910:50
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts in common playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799010:51
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts for dynamic_address_fact  https://review.opendev.org/c/openstack/openstack-ansible/+/77798910:55
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799610:55
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts in common playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799010:56
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in group_vars  https://review.opendev.org/c/openstack/openstack-ansible/+/77799710:57
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in tests  https://review.opendev.org/c/openstack/openstack-ansible/+/77799811:00
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts for dynamic_address_fact  https://review.opendev.org/c/openstack/openstack-ansible/+/77798911:00
*** luksky has quit IRC11:07
*** luksky has joined #openstack-ansible11:08
*** luksky has quit IRC11:09
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts for dynamic_address_fact  https://review.opendev.org/c/openstack/openstack-ansible/+/77798911:23
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts in common playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799011:24
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in AIO config  https://review.opendev.org/c/openstack/openstack-ansible/+/77799911:24
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799611:25
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in docs  https://review.opendev.org/c/openstack/openstack-ansible/+/77800011:25
*** luksky has joined #openstack-ansible11:25
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in group_vars  https://review.opendev.org/c/openstack/openstack-ansible/+/77799711:26
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: WIP - Gather minimal facts and disable fact variables  https://review.opendev.org/c/openstack/openstack-ansible/+/77839611:26
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in tests  https://review.opendev.org/c/openstack/openstack-ansible/+/77799811:26
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: WIP - Gather minimal facts and disable fact variables  https://review.opendev.org/c/openstack/openstack-ansible/+/77839611:27
jonherfor masakari to install on AIO stable/victoria i had to install pkg-config and libvirt-devel on the aio host manually, why is that not failing in ci? did i miss something in my setup?11:30
jrosserjonher: is yours an lxc install?11:31
jonherstandard aio, just copied over the aio -> /etc/openstack_deploy/conf.d/masakari.yml libvirt seems to be running on the host and not in lxc11:32
jrosserjonher: if you go here https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/772288 and press the 'Zuul Summary' tab you'll see that for CI all the job names include 'metal' which means that the LXC part is disabled - thats to keep the CI time as low as possible11:33
jonherah11:34
jrosserunfortunately that does introduce a fairly big gap as all the services get installed on the the same host11:34
jrosserso if a dependancy for X was previously installed by Y they all get mixed and it wont fail11:34
jrosserhowever in LXC they are separated rootfs so those kind of errors can then show up11:34
jrosserdid it want pkg-config and libvirt-devel when it was building the python wheels for masakari?11:36
jonheri'm trying  to paste a log on paste.openstack.org but it keeps on giving me a captcha and then cutting parts of the content11:37
jonherhttps://pastebin.com/a15URKpX11:38
jonherso playbook fails on the step of installing python packages in venv, masakari container seems to succeed building what it needs to, then on the host it fails to libvirt-python/setup.py11:39
jrosseri would expect that any wheel build would happen on the repo container rather than the host, just looking at the code11:44
jrosserthere is also another complexity here, that the libvirt python bindings should be taken from the host rather than compiled i think11:46
jrosserhttps://github.com/openstack/openstack-ansible-os_masakari/blob/master/vars/debian.yml#L31-L3211:46
jonheroh i see11:51
jrosserso imho there seem to be several things going on here11:55
jrosserfirst i'd expect the building to be done on the repo server11:55
jrosserand something is kind of messed up with masakari-monitors vs. libvirt-python11:56
*** shyam89 has quit IRC12:00
*** shyamb has quit IRC12:00
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: WIP - Gather minimal facts and disable fact variables  https://review.opendev.org/c/openstack/openstack-ansible/+/77839612:36
jonheri don't have enough knowledge yet to make changes to that process, is there a place to log this as a known issue? or could anyone have a look?  i'm guessing it's kind of a edge-case though so might not be very important/prioritized12:52
jrosseryou can file a bug here, would be really helpful https://bugs.launchpad.net/openstack-ansible12:53
jrosserincluding the pasted info would be good too12:53
jrosseri did have a quick look and the trouble with masakari-monitors is it directly has a python requirement on libvirt-python12:54
jrosserso that tries to be installed earlier in the process than we symlink the distro provided version of that package into the venv12:55
jrosserso i can see how this goes wrong, not exactly sure what to do about it though12:55
jrosserother things like cinder which use the ceph rbd python bindings load those at runtime, so theres no issue with ordering when the venv is installed12:56
jonherthis looks related to the same issues i had https://bugs.launchpad.net/openstack-ansible/+bug/188671912:56
openstackLaunchpad bug 1886719 in openstack-ansible "masakari-monitors wheel building failed for libvirt-python" [Undecided,New]12:56
jrosseryes that looks very similar12:59
*** rh-jlabarre has quit IRC13:01
*** rh-jelabarre has joined #openstack-ansible13:11
*** rh-jelabarre has quit IRC13:11
*** rh-jelabarre has joined #openstack-ansible13:12
mgariepymorning.13:30
mgariepyjrosser, my small patch for neutron is failing with  The new implementation of the resolver no longer supports these forms. A possible replacement is replacing the constraint with a requirement.. You can find discussion regarding this at https://github.com/pypa/pip/issues/8210.\nERROR: Links are not allowed as constraint13:33
mgariepyhave you see that ?13:33
mgariepyit's only faling on localhost for the check, all the containers seems to be installing just fine.13:33
mgariepyhttps://zuul.opendev.org/t/openstack/build/88e05286c67e4f079b5372f096a55dc313:33
mgariepyhttps://zuul.opendev.org/t/openstack/build/88e05286c67e4f079b5372f096a55dc3/log/logs/host/python_venv_build.log.txt#1113:34
*** spatel has joined #openstack-ansible13:40
mgariepypto, glad it work.13:44
mgariepyi usually configure the iommu stuf prior to run osa.13:44
ptoI think osa will overwrite some parts - e.g. sysctl.conf?13:44
jamesdentonmgariepy i think everything fails right now in os_neutron - i have patches to change from functional -> integrated and don't see those errors13:45
jamesdentonCould use some reviews on https://review.opendev.org/c/openstack/openstack-ansible/+/778008/. Will need that to merge first13:45
jamesdentonthese are the neutron patches: https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/77801513:45
*** pto has quit IRC13:52
mgariepypto i didn't configure passwtrough  on 20.04 yet. only 16 and 18.13:55
mgariepybut i only had vendor_iommu=on in grub. i do update the initramfs tool with pci_stub  /etc/initramfs-tools/modules  << pci_stub ids=10de:17c8,10de:0fb013:57
mgariepyand some blacklist for nouveau and nvidiafb13:57
*** ajg20 has joined #openstack-ansible14:17
*** watersj has quit IRC14:23
openstackgerritEbbex proposed openstack/openstack-ansible-ops master: apm-server gets fussy about file-permissions  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/77848114:55
*** SiavashSardari has quit IRC14:56
openstackgerritJonathan Rosser proposed openstack/ansible-hardening master: Use ansible_facts[] instead of fact variables  https://review.opendev.org/c/openstack/ansible-hardening/+/77848315:02
*** juanoterocas has joined #openstack-ansible15:02
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Convert host and container journal collection to python  https://review.opendev.org/c/openstack/openstack-ansible/+/73488315:03
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts for dynamic_address_fact  https://review.opendev.org/c/openstack/openstack-ansible/+/77798915:03
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts in common playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799015:03
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in AIO config  https://review.opendev.org/c/openstack/openstack-ansible/+/77799915:03
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799615:03
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in docs  https://review.opendev.org/c/openstack/openstack-ansible/+/77800015:03
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in group_vars  https://review.opendev.org/c/openstack/openstack-ansible/+/77799715:03
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in tests  https://review.opendev.org/c/openstack/openstack-ansible/+/77799815:03
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: WIP - Gather minimal facts and disable fact variables  https://review.opendev.org/c/openstack/openstack-ansible/+/77839615:03
*** luksky has quit IRC15:19
*** luksky has joined #openstack-ansible15:19
*** luksky has quit IRC15:19
spotzAbout for reveiws just ping15:32
*** miloa has joined #openstack-ansible15:33
*** miloa has quit IRC15:36
*** luksky has joined #openstack-ansible15:36
openstackgerritJonathan Rosser proposed openstack/ansible-hardening master: Use ansible_facts[] instead of fact variables  https://review.opendev.org/c/openstack/ansible-hardening/+/77848315:38
jrosserjamesdenton: do you think there is value in keeping the more esoteric neutron scenarios?15:51
jamesdentonTBD. At this point, probably not.15:52
jamesdentoni think ODL support needs to be deprecated, since it appears to be unmaintained at a lot of levels (outside of us)15:52
jamesdentonthe NSH and SFC scenarios can probably also be removed15:53
jamesdentontests, rather15:53
jrosserSFC seems to be just another neutron plugin, so it's not really a big deployment deal?15:53
jamesdentonright15:53
jamesdentonand we're not testing anything except to add a plugin15:53
jamesdentonso, happy to make that change now and simplify our lives. They all set to non-voting now15:54
jrosseryeah i was just looking at the results with one of those NV jobs timing out at 3hours15:54
jrosserthats kind of sad as the rest are passing in 1.5hours-ish15:54
jamesdentonyeah, that one seemed to hang on galera for a long time15:55
jrosseroh is that focal15:55
jamesdentonyes15:55
jrossergalera 10.5.8 + focal == oddness15:55
jamesdentongood to know15:55
jrosserhttps://jira.mariadb.org/browse/MDEV-2482915:55
jamesdentoni bumped everything to focal except those ODL jobs.15:56
jamesdentonthose are all non-value-add at this point, IMO15:56
jrosseri think you're right that so much 3rd party stuff is broken for ODL we shouldnt really spend time on it15:57
jrosserSFC is a bit pointless15:57
jrosserand NSH wants ODL it seems? so thats kind of decided by default15:58
jamesdentonthe NSH bit is a special version of OVS stuck at 2.915:58
jamesdentonwhich, looking at OVS, that may have all been rolled in15:58
jrosseri was looking in here https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/778015/8/tests/neutron-overrides-ovs-nsh.yml15:59
jamesdentonso, again, maybe unnecessary t this point15:59
jrosserreferences to ODL?15:59
jamesdentonyep, it was there before, too15:59
jrosserhuh15:59
jamesdentonNSH is for service chaining15:59
jamesdentonbut there's no real 'test' here for that, so unecessary15:59
jamesdentonwant me to just clean those up and toss a release note in here?16:01
jrosseri think so16:02
jrossereven the NSH stuff is pointing to some ancient PPA, not so sure whats going on there either16:03
jrosserlike you say it might be all in stock OVS these days16:03
jamesdentonright. so i will tweak the jobs, remove the cruft, and then circle back on those scenarios in a different patch16:03
openstackgerritJonathan Rosser proposed openstack/ansible-hardening master: Use ansible_facts[] instead of fact variables  https://review.opendev.org/c/openstack/ansible-hardening/+/77848316:07
*** gokhani has quit IRC16:19
openstackgerritJonathan Rosser proposed openstack/ansible-hardening master: Use ansible_facts[] instead of fact variables  https://review.opendev.org/c/openstack/ansible-hardening/+/77848316:22
*** macz_ has joined #openstack-ansible16:25
openstackgerritJames Denton proposed openstack/openstack-ansible master: Add Neutron Role Testing Overrides  https://review.opendev.org/c/openstack/openstack-ansible/+/77800816:33
*** macz_ has quit IRC16:46
*** macz_ has joined #openstack-ansible16:47
openstackgerritJames Denton proposed openstack/openstack-ansible-os_neutron master: Add integrated tests various Neutron deployment scenarios  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/77801516:54
*** luksky has quit IRC16:59
*** luksky has joined #openstack-ansible17:00
*** klamath_atx has quit IRC17:01
*** openstackgerrit has quit IRC17:02
*** spatel has quit IRC17:03
*** klamath_atx has joined #openstack-ansible17:07
*** spatel has joined #openstack-ansible17:07
*** macz_ has quit IRC17:27
jrosserjamesdenton: did you have an OVN AIO around?17:34
jrosseri'd be interested to know what `ansible aio1 -m debug -a "var=hostvars['aio1']['container_networks']"` looks like for OVN (and i guess thats generically the same for OVS?)17:38
jrosserultimately what i'm trying to understand is what should happen here for OVN https://github.com/openstack/openstack-ansible/blob/master/playbooks/common-playbooks/neutron.yml#L47-L5217:51
*** admin0 has joined #openstack-ansible18:08
*** rpittau is now known as rpittau|afk18:11
*** andrewbonney has quit IRC18:23
*** jamesgibo has quit IRC18:40
*** juanoterocas has quit IRC18:46
*** sshnaidm is now known as sshnaidm|afk19:00
*** fresta has quit IRC19:08
admin0my bootstrap is stuck on TASK [Install collection requirements with ansible galaxy]   .. is there a way to debug and see what exactly that script does ?19:08
admin0i figured out the debug part19:10
*** juanoterocas has joined #openstack-ansible19:14
*** mmercer has quit IRC19:39
*** mmercer has joined #openstack-ansible19:40
jamesdentonjrosser i do not, sorry19:45
jamesdentonactuall, i lied19:45
jamesdentonone sec19:45
jamesdentonjrosser http://paste.openstack.org/show/803201/19:46
jrosserinteresting19:47
jrosserno tunnel_addresss19:47
jamesdentonthe IP configurations is handled here: https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tasks/providers/setup_ovs_ovn.yml#L5619:50
jrosserwhere does neutron_local_ip come from?19:52
jrosserI guess what I mean is how that different from the tunnel dynamic address fact19:53
*** spatel has quit IRC19:58
jamesdentonjrosser https://github.com/openstack/openstack-ansible/blob/master/playbooks/common-playbooks/neutron.yml#L9920:00
*** spatel has joined #openstack-ansible20:00
jrosseroh!20:01
jrosserso i guess this kind of comes full circle :)20:02
jamesdentonand i think i'm missing some context here :)20:03
jrosserit's why I was wanting to know if tunnel_address was defined on an OVN AIO20:03
jrosserso i've been working on patches to gather the absolute smallest set of facts necessary as for compute/network nodes that can save a lot of runtime20:04
jrosserhence this https://review.opendev.org/c/openstack/openstack-ansible/+/77798920:04
jamesdentonfancy20:05
*** klamath_atx has quit IRC20:05
*** klamath_atx has joined #openstack-ansible20:07
jrosserthe only problem is that is failing on just the OVN jobs like this https://zuul.opendev.org/t/openstack/build/22b6dd92d4524bb4b288aa30fbd1bbf7/log/job-output.txt#2507620:07
jrosserand i'm kind of unsure if thats missing tunnel_address being legit and i need to allow for that, or its missing becasue of a bug20:07
*** ajg20 has quit IRC20:14
jamesdentonwell, curious how your task would fail but the subsequent one wouldn't (or hasn't) ?20:23
jrosserthe use of json_query in the second task with the || can be resistant to an undefined var20:25
jrosserbut the syntax of the second task is kind of obtuse and i'm not sure i understand the behaviour under all defined/undefined vars conditions20:26
jamesdentoni was wondering about that20:26
jrosserdo you think its correct that tunnel_address is undefined in this case?20:27
jamesdentonit would seem that way?20:29
jamesdentonultimately what is being used in thew aio is 172.29.236.10020:29
*** jamesgibo has joined #openstack-ansible20:30
jrosseroh, this maybe? https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.aio.j2#L7020:31
jamesdentonmayyyybe. i'd have to see how that stanza is used here20:32
*** jamesgibo has quit IRC20:32
jamesdentonin the OVN deploy that's defined on o_u_c but set to neutron_linuxbridge_agent20:32
jamesdentonso, ignored20:32
jamesdentonoverriding those anyway in /etc/openstack_deploy/user_variables_neutron_ovn.yml20:33
*** spatel has quit IRC20:35
*** spatel has joined #openstack-ansible20:38
jamesdentonjrosser this might be relevant: https://github.com/openstack/openstack-ansible/commit/b8802f5ce1dc922ff20cab0a46cd7d715323c46120:38
jamesdentonbrb20:39
jrossersure20:39
*** gyee has joined #openstack-ansible21:01
spatelhey! folks21:04
spatellook like lots of goodness going on21:05
*** fresta has joined #openstack-ansible21:20
*** gary_perkins has joined #openstack-ansible21:27
*** irclogbot_2 has quit IRC21:33
*** partlycloudy has quit IRC21:33
*** odyssey4me has quit IRC21:33
*** irclogbot_2 has joined #openstack-ansible21:34
*** partlycloudy has joined #openstack-ansible21:34
*** odyssey4me has joined #openstack-ansible21:34
jrosserjamesdenton: ah i see you're removing neutron_local_ip override here https://review.opendev.org/c/openstack/openstack-ansible/+/778008/6/tests/roles/bootstrap-host/templates/user_variables_neutron_ovn.yml.j221:36
jrossersomehow i'm not understanding "where do I specify the physical interface to use for tunnels"21:37
jamesdentonyeah, because it turns out, those variables are not available at that stage21:37
jamesdentonwait, i'm thinking of the opendaylight studfd21:37
* jrosser very confused :)21:37
jamesdentonlol21:37
jamesdentoni was getting an error, somewhere, ansible_host may have been coming back as localhost (name) and not ip and breaking something21:38
jrossersomehow we've missed defining what should be in o_u_c for OVN as 'sensible defaults"21:39
jrosseri was expecting to find an interface name that would be used to look up the local ip, like for linuxbridge21:39
jamesdentonnow, that could be true21:39
jamesdentonhttps://docs.openstack.org/openstack-ansible-os_neutron/latest/app-ovn.html21:40
jamesdentonyou will see there are some examples provided21:40
jamesdentonthe AIO overrides may not follow that guidance, however :D21:40
jrosseroh that makes sense now21:41
jamesdentonand it very well could have been a case of, "Well it works and I don't know that it's broken"21:42
jrosseri guess we need to update the template here https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.aio.j221:42
jrosserthats what created o_u_c for the AIO21:42
jrosserand br-vxlan is kind of an unhelpful name too21:43
jamesdentonwell, yes, but the neutron_provider_networks are overwritten by this: https://review.opendev.org/c/openstack/openstack-ansible/+/778008/6/tests/roles/bootstrap-host/templates/user_variables_neutron_ovn.yml.j2#1921:43
jamesdentonyes, i've changed sall my stuff to br-overlay21:43
jrosserfeels like these overrides are a hang-over from the functional tests21:44
jrosserwhere you didnt have the integrated repo playbooks to orchestrate all this stuff21:44
jamesdentonmaybe. we could simply setup a new template per scenario and copy accordingly21:44
jrosserwe already do things like this https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.aio.j2#L71-L8321:45
jrossercould have a conditional ovn section there21:45
jamesdentoni mean, if you don't mind blowing up that file a little bit, thats fine21:46
jamesdentonthere'd be one for OVS, too21:46
*** devtolu1__ has joined #openstack-ansible21:47
jrosseri think the value is in generating an o_u_c that someone can pretty much take and use, based on building an AIO for a secenario21:47
jamesdentonsure, i can see that21:47
jamesdentondo you want me to rework 778008, then?21:48
jrosserthanks for helping me understand, i was thinking there was some OVN magic that i wanst grasping21:48
jamesdentonoh, don't rely on me to remember or help with anything. :D21:48
jamesdentonbut you're welcome21:49
*** juanoterocas has quit IRC21:49
jrosserup to you on 778008, we could put another patch on top?21:50
jamesdentonif we can get the existing thing to pass, maybe we close the loop on that21:51
*** juanoterocas has joined #openstack-ansible21:51
jamesdenton(nothing more irritating than watching normally reliable jobs fail and the failing ones pass)21:52
jrosserlooks like debian has failed on 77801521:53
jamesdentontest_create_list_show_delete_endpoint21:53
jamesdentonamong others21:53
*** devtolu1__ has quit IRC21:54
jrosseri've been trying to catalog these random fails https://etherpad.opendev.org/p/osa-ci-failures21:55
jrosserif you find something specific then make a note of it21:55
jamesdentonadded it to the tempest identity line21:58
jrosserit's useful to see which are hurting us the most - focal/mariadb is a big problem right now21:58
*** jamesdenton has quit IRC22:15
*** jamesdenton has joined #openstack-ansible22:15
*** gshippey has quit IRC22:25
*** spatel has quit IRC22:28
*** spatel has joined #openstack-ansible22:39
*** spatel has quit IRC22:39
*** juanoterocas has quit IRC22:52
*** luksky has quit IRC23:39
*** mgariepy has quit IRC23:42
*** mgariepy has joined #openstack-ansible23:55

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!