Thursday, 2021-04-08

*** macz_ has joined #openstack-ansible00:37
*** macz_ has quit IRC00:47
*** spotz has quit IRC01:32
*** rh-jelabarre has quit IRC01:37
*** spatel_ has joined #openstack-ansible02:05
*** spatel_ is now known as spatel02:05
*** spatel has quit IRC02:11
*** evrardjp has quit IRC02:33
*** evrardjp has joined #openstack-ansible02:33
*** jonher has quit IRC03:17
*** fresta has quit IRC03:18
*** jonher has joined #openstack-ansible03:25
*** raukadah is now known as chandankumar04:39
*** rohit02 has joined #openstack-ansible04:42
*** shyamb has joined #openstack-ansible05:06
*** shyam89 has joined #openstack-ansible05:06
*** miloa has joined #openstack-ansible05:20
*** miloa has quit IRC05:23
*** poopcat has quit IRC06:07
*** poopcat has joined #openstack-ansible06:09
*** shyam89 has quit IRC06:24
*** shyamb has quit IRC06:24
*** d34dh0r53 has quit IRC06:26
*** d34dh0r53 has joined #openstack-ansible06:28
*** tosky has joined #openstack-ansible06:45
*** rpittau|afk is now known as rpittau07:01
*** andrewbonney has joined #openstack-ansible07:06
*** luksky has joined #openstack-ansible07:32
noonedeadpunkjrosser: but Cinder is not done yet anyway - for some of the services changes landed partially and there are additional challanges there. So there's a progress globally, but as for now things are pretty far from being complete08:11
*** macz_ has joined #openstack-ansible08:15
*** macz_ has quit IRC08:20
noonedeadpunkSome votes for https://review.opendev.org/q/project:openstack/openstack-ansible-os_trove+status:open+label:Verified%252B1 would be awesome, since there're already some conflicting changes... And really hard to build proper dependency tree...08:20
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Update trove configuration  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78457108:49
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Change default pool subnet  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78414508:56
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Use uWSGI for trove-api  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78420208:56
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Update trove configuration  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78457108:56
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Change default pool subnet  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78414508:59
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Add image upload option  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78437209:09
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Change default pool subnet  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78414509:09
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Use uWSGI for trove-api  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78420209:09
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Update trove configuration  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78457109:13
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: [DNM] Test tempest  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78438109:17
*** shyamb has joined #openstack-ansible09:24
*** shyam89 has joined #openstack-ansible09:24
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Update trove configuration  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78457109:26
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Update trove configuration  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78457109:29
*** sshnaidm|afk is now known as sshnaidm09:31
*** gshippey has joined #openstack-ansible09:49
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Update trove configuration  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78457110:07
*** sshnaidm has quit IRC11:01
*** sshnaidm has joined #openstack-ansible11:04
*** rh-jelabarre has joined #openstack-ansible11:24
*** mathlin has joined #openstack-ansible11:34
*** sshnaidm has quit IRC11:37
*** shyam89 has quit IRC11:37
*** shyamb has quit IRC11:37
*** sshnaidm has joined #openstack-ansible11:50
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Map dbaas and lbaas with role defaults  https://review.opendev.org/c/openstack/openstack-ansible/+/78411312:00
openstackgerritMerged openstack/openstack-ansible-os_mistral master: Switch default virtualenv to python3  https://review.opendev.org/c/openstack/openstack-ansible-os_mistral/+/77968112:29
openstackgerritMerged openstack/openstack-ansible-os_mistral master: Remove references to unsupported operating systems  https://review.opendev.org/c/openstack/openstack-ansible-os_mistral/+/77974112:29
*** luksky has quit IRC12:40
*** luksky has joined #openstack-ansible12:43
*** yasemind has joined #openstack-ansible12:50
*** spatel_ has joined #openstack-ansible12:59
*** spatel_ is now known as spatel12:59
*** shyamb has joined #openstack-ansible13:09
*** shyam89 has joined #openstack-ansible13:10
spatelnoonedeadpunk i am still running first RC1 victoria, do you think we are in good place to upgrade to correct one?13:13
spatelI am planning to upgrade it before i go upgrade to wallaby13:13
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Map dbaas and lbaas with role defaults  https://review.opendev.org/c/openstack/openstack-ansible/+/78411313:14
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Update trove configuration  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78457113:15
noonedeadpunkspatel: yep, I think we're fine13:16
noonedeadpunkif you use barbican, you might need to manually define barbican_simple_crypto_key in user_secrets13:17
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Fix u-c filter regex  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/78381113:18
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Return PyMySQL installation for distro installs  https://review.opendev.org/c/openstack/openstack-ansible/+/78495713:19
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Return PyMySQL installation for distro installs  https://review.opendev.org/c/openstack/openstack-ansible/+/78495713:20
*** shyam89 has quit IRC13:23
*** shyamb has quit IRC13:23
spatelcool! i am going to do that soon :)13:25
spatelnoonedeadpunk when generally we bump SHA ? (there are few good senlin patches got merged so i would like to have them part of stable/victoria :)13:26
spatelor may be in wallaby..13:27
noonedeadpunkI think next week13:27
noonedeadpunkBut you can actually override senlin SHA in your user_variables as well13:27
spatelsure that is what i am doing but i would like if general public also get good stuff :)13:28
spateljamesdenton today i am going to work on OVN ovsdb-server clustering test..13:29
spatelI know we don't have ansible playbook for that but i would like to have it soon.. I believe TripleO/Kolla-ansible providing that support but we are not, yet13:31
noonedeadpunkoh, btw13:32
noonedeadpunkthere's a bug regarding ovn13:32
noonedeadpunkmight be you might help somehow?13:32
spatelwhat is that?13:32
noonedeadpunkhttps://bugs.launchpad.net/openstack-ansible/+bug/192297813:32
openstackLaunchpad bug 1922978 in openstack-ansible "Ports fail to bind after compute host reboot when using OVN" [Undecided,Confirmed] - Assigned to James Denton (james-denton)13:32
spatelI want my future production on OVN so i will try my best to get everything done13:32
noonedeadpunkI think there's an issue in hostname overall, but might be there's some setting that can help to avoid this from happening...13:33
noonedeadpunkoh, jamesdenton have already assigned it :) fast :)13:34
spatelI heard about this when searching other bugs.. let me reproduce and see13:34
spatelthere is one more issue, decommissioned compute node.. OVN doesn't delete that node easily so there are some step you have to do.. i will try to reproduce that one also13:35
spatelThis is kind of OVN issue not OSA right - https://bugs.launchpad.net/openstack-ansible/+bug/192297813:37
openstackLaunchpad bug 1922978 in openstack-ansible "Ports fail to bind after compute host reboot when using OVN" [Undecided,Confirmed] - Assigned to James Denton (james-denton)13:37
*** NewJorg has quit IRC13:44
noonedeadpunkmight be configuration...13:46
*** rohit02 has quit IRC13:47
*** NewJorg has joined #openstack-ansible13:49
spatelpossible13:49
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Return PyMySQL installation for distro installs  https://review.opendev.org/c/openstack/openstack-ansible/+/78495713:52
*** spatel has quit IRC14:00
*** spatel_ has joined #openstack-ansible14:14
*** spatel_ is now known as spatel14:14
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: [DNM] Test tempest  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78438114:43
jamesdentonnoonedeadpunk yeah, i talked to OP and encouraged them to open the bug14:44
jamesdentonspatel i meant to ask you if you've rebooted your compute nodes since implementing OVN and if you had any issues after14:45
spateljamesdenton i have rebooted my all nodes multiple time, controller and both compute nodes and i had zero issue14:45
jamesdentondo you mind sending the following output? 'openstack compute service list' and 'ovs-vsctl list open_vswitch'?14:46
spatelmay be this issue is related to where you changed your hostname that may create issue and confusion for ovsdb14:47
spatelhold on let me send you14:47
spatel'ovs-vsctl list open_vswitch from northd container or compute?14:47
jamesdentoncompute14:47
spateljamesdenton here you go - http://paste.openstack.org/show/804297/14:51
jamesdentonok, thanks. OVSDB sets hostname in table to long name, while OP14:51
jamesdentonOP has short names listed in service list, and they need to match14:52
jamesdentondo you have a host override set for names by chance?14:52
spatelno i don't have anything fancy14:53
spatelall i have14:53
spatelcompute_hosts:14:53
spatel  os-compute-1:14:53
spatel    ip: 172.30.40.314:53
spatelovsdb doesn't like to change compute name, that could be the issue because it use name reference in db14:54
jamesdentonok, thanks. i will do a deploy and see what happens. in my env, they are shortnames14:55
spateli do have shortname also just host part not FQDN14:55
jamesdentonwell, in the playbook we set OVS hostname to ansible_host, but on a reboot it seems to change to long name14:55
spateloh!14:56
jamesdentonwhen there's a mismatch, though, the ports don't bind14:56
spatelovs should use Linux hostname (os provided right?)14:56
jamesdentonyeah, ultimately i would just take out that task and let ovs set the hostname, which appears to be long14:57
spatelthat is good idea to let ovs use what OS tell14:57
jamesdentoni'm just not sure what determines how the name is set in nova. your env is different than mine14:57
spatelhmm! i have multi-node deployment may be that is the difference14:58
jamesdentonhttp://paste.openstack.org/show/804299/14:58
jamesdentonso do i14:58
*** spotz has joined #openstack-ansible14:58
spateldoes your ovs-vsctl list open_vswitch showing full name including openstack.local ?15:00
jamesdentoni don't have OVS on this node, but when testing with OP we found it did have full name after reboot. And i installed OVS in the lab, set OVS hostname to shortname, rebooted, and it had changed to long name15:03
spatelhmm15:04
jamesdentonthat part is fine. i just need to figure how nova determines service name15:08
jamesdentonApr 08 15:00:07 lab-compute01 nova-compute[57159]: 2021-04-08 15:00:07.780 57159 DEBUG oslo_service.service [... - - - - -] host = lab-compute01 log_opt_values /.../oslo_config/cfg.py:258115:08
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: [doc] Document how to use separate RabbitMQ cluster  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78478115:08
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: [doc] Document how to use separate RabbitMQ cluster  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78478115:08
spateljamesdenton i have one more question related this doc - https://docs.openstack.org/openstack-ansible-os_neutron/latest/app-ovn.html15:13
spatelI don't have network_hosts group in my inventory then how does this section will work /etc/openstack_deploy/group_vars/network_hosts15:14
spatelI am also wondering why i don't have network_hosts group in my inventory, is that normal ?15:15
jamesdentoni think it's a dynamic group?15:31
jamesdentonbut i think that kernel module thing is outdated15:31
*** macz_ has joined #openstack-ansible15:32
spatelyes dynamic but when i do inventory-manager.py -G i can't see network_hosts15:34
spatelif we don't need that shouldn't we remove that from documentation ?15:34
jamesdentonjust needs to be tested, and then it can prob be removed, yep15:37
spateli didn't create that file :) and everything works great15:40
jamesdentonif it' included as an override for the AIO, then a patch that removes it and tests will be needed15:40
jrosseri have network_hosts here15:47
jrosseroh, well i defined them in o_u_c.yml :)15:48
jamesdentoni see i see15:49
spatelo_u_c.yml ?15:49
jrosseropenstack_user_config.yml15:49
jrosseri use it as "hosts which are dedicated network nodes"15:50
spateloh okay! technically there is not network_host in OVN design, each compute node is network node as well15:50
spatelno*15:50
jamesdentonin that case, the override is likely less necessary, since compute nodes would also need openvswitch kernel module15:51
jamesdentoni don't recall when that doc was updated (or why)15:51
jrosserspatel: you could configure it that way though if you wanted15:52
spatelagreed15:53
jrosserthe OVN design does sort of assume something DVR-alike15:53
jrosserin the examples afaik15:53
jrosserbut thats not to say it must be like that15:53
spatelalso beautify of OVN DVR is it doesn't waste public IPs like legacy DVR was doing15:53
spatelDVR is the beauty, why would someone deploy centralized network design and compromised with performance. (Earlier DVR was very complex to manage but with OVN its easy and built in function)15:55
*** rpittau is now known as rpittau|bbl15:57
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_tempest master: Add trove tempest support  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/78300215:58
mgariepyby default (via https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tasks/providers/setup_ovs_ovn.yml#L40) i think all nodes are configured to be GW. but it's not mandatory to do so.16:03
spatel+1 yes we choose that way but you are right, we can make dedicated network node if we want using that option16:08
jrosseri wonder what a migration strategy would be, other than "build a new cloud"16:12
spateldoes neutron can talk to both design simultaneously ML2/OVN or LinuxBridge and ML2/OVN?16:16
jamesdentonovs and lxb, yes16:17
jamesdentonthe other, i dunno16:17
spatelIf it does then we can build parallel universe to migrate to OVN16:18
*** rohit02 has joined #openstack-ansible16:22
*** sshnaidm has quit IRC16:43
*** sshnaidm has joined #openstack-ansible16:44
mgariepyovs to ovn is pretty straitforward i think. i've seen a talk from canonical i think that they we doing that. with minimal downtime16:44
jrosserhttps://www.openstack.org/videos/summits/virtual/Hassle-free-migration-from-OVS-to-OVN16:50
*** rohit02 has quit IRC16:56
mgariepyyep that one :D17:02
mgariepyi'vs also seen a really old one about ovs to lxb...17:03
jamesdenton:D17:06
jamesdentoni offer that as a proserv gig17:07
*** sshnaidm is now known as sshnaidm|afk17:10
*** rpittau|bbl is now known as rpittau17:44
*** andrewbonney has quit IRC17:44
openstackgerritMerged openstack/openstack-ansible-os_mistral master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_mistral/+/78154218:24
*** d34dh0r53 has quit IRC19:21
*** d34dh0r53 has joined #openstack-ansible19:22
*** dave-mccowan has joined #openstack-ansible19:40
*** spatel has quit IRC19:42
*** spatel_ has joined #openstack-ansible19:45
*** spatel_ is now known as spatel19:46
*** d34dh0r53 has quit IRC19:51
*** d34dh0r53 has joined #openstack-ansible19:51
*** yasemind has quit IRC20:01
openstackgerritMerged openstack/openstack-ansible-os_senlin master: Switch default virtualenv to python3  https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/77968920:10
spateljrosser  and noonedeadpunk and jamesdenton here is my OVN blog for external connectivity - https://satishdotpatel.github.io//openstack-ansible-ovn-deployment-part2/20:16
*** Underknowledge1 has joined #openstack-ansible20:22
*** dmsimard6 has joined #openstack-ansible20:24
*** akahat has quit IRC20:24
*** tosky_ has joined #openstack-ansible20:25
*** Underknowledge has quit IRC20:26
*** dmsimard has quit IRC20:26
*** dmsimard6 is now known as dmsimard20:26
*** trident has quit IRC20:26
*** crazzy has quit IRC20:26
*** tosky has quit IRC20:26
*** poopcat has quit IRC20:26
*** lemko has quit IRC20:26
*** Underknowledge1 is now known as Underknowledge20:27
*** lemko has joined #openstack-ansible20:27
*** trident has joined #openstack-ansible20:28
*** poopcat has joined #openstack-ansible20:28
*** tosky_ is now known as tosky20:28
*** akahat has joined #openstack-ansible20:37
*** gshippey has quit IRC20:55
jamesdentonthx spatel i look forward to reading it!21:14
*** rpittau is now known as rpittau|afk21:17
*** sshnaidm|afk is now known as sshnaidm|off21:24
*** spatel has quit IRC21:42
*** Underknowledge has quit IRC22:13
*** Underknowledge2 has joined #openstack-ansible22:13
*** Underknowledge2 is now known as Underknowledge22:14
*** macz_ has quit IRC23:06
*** tosky has quit IRC23:38

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!