| opendevreview | Merged openstack/openstack-ansible-os_heat master: Fix _service_users for multi-domain deployments https://review.opendev.org/c/openstack/openstack-ansible-os_heat/+/794770 | 00:06 |
|---|---|---|
| *** spatel has joined #openstack-ansible | 01:31 | |
| *** spatel has joined #openstack-ansible | 03:00 | |
| *** spatel has quit IRC | 03:19 | |
| *** spatel has joined #openstack-ansible | 03:22 | |
| opendevreview | Satish Patel proposed openstack/openstack-ansible-os_neutron master: Add ovn clustering support https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/794266 | 04:10 |
| opendevreview | Satish Patel proposed openstack/openstack-ansible-os_neutron master: Add ovn clustering support https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/794266 | 04:11 |
| *** spatel has quit IRC | 04:26 | |
| *** opendevreview has quit IRC | 04:26 | |
| noonedeadpunk | mornings | 06:09 |
| noonedeadpunk | would be awesome to land https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/795102 (or some alternative?) along with https://review.opendev.org/c/openstack/openstack-ansible/+/794795 | 06:10 |
| noonedeadpunk | to be able to recheck and merge all stuck from friday stuff | 06:10 |
| *** Adri2000 has joined #openstack-ansible | 06:48 | |
| *** odyssey4me has joined #openstack-ansible | 06:59 | |
| *** odyssey4me has quit IRC | 07:00 | |
| *** odyssey4me has joined #openstack-ansible | 07:01 | |
| *** andrewbonney has joined #openstack-ansible | 07:29 | |
| *** rpittau|afk is now known as rpittau | 07:30 | |
| jnamdar | hi noonedeadpunk | 07:54 |
| jnamdar | I'm trying to set up mistral and tacker on my aio, but I'm getting the regular error `Failed to set up vim monitoring: requests.exceptions.SSLError: HTTPSConnectionPool(host='10.0.2.15', port=8989): Max retries exceeded with url: /v2/workflow?scope=private&namespace= (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'tls_process_server_certificate', 'certificate verify failed')` | 07:55 |
| jnamdar | that seems to be tacker trying to contact mistral | 07:55 |
| jnamdar | I think I should put mistral_endpoint_type = internal somewhere but I'm not sure where ? I can't find it in the docs | 07:56 |
| *** miloa has joined #openstack-ansible | 08:13 | |
| miloa | Morning :) | 08:13 |
| *** luksky has joined #openstack-ansible | 08:14 | |
| jrosser | morning | 08:16 |
| miloa | I've got a question on os_nova in nova.conf.j2 in train version in the [neutron] section there is no "region_name" and username is nova_service_user_name and before (rocky version) it was neutron_service_user_name. We are trying to deploy on multiple region and we've got some issue like default security group not found when we try to deploy an instance. Could it be related with these | 08:18 |
| miloa | changes ? | 08:18 |
| *** tosky has joined #openstack-ansible | 08:39 | |
| *** opendevreview has joined #openstack-ansible | 09:44 | |
| opendevreview | Arx Cruz proposed openstack/openstack-ansible-os_tempest master: Generate list of failing tests https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/795264 | 09:44 |
| *** ioni has joined #openstack-ansible | 10:56 | |
| *** odyssey4me has quit IRC | 11:16 | |
| noonedeadpunk | miloa: regarding `region_name` it might be related, but neutron_service_user_name vs nova_service_user_name doesn't really matter | 11:22 |
| noonedeadpunk | jnamdar: I think we're missing `interface` inside `keystone_authtoken` section at least | 11:27 |
| *** ebbex has quit IRC | 11:27 | |
| noonedeadpunk | but I guess it's more then that actually | 11:27 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_tacker master: Update tacker config https://review.opendev.org/c/openstack/openstack-ansible-os_tacker/+/795303 | 11:44 |
| *** odyssey4me has joined #openstack-ansible | 12:01 | |
| jnamdar | noonedeadpunk: i'll try your changes on tacker.conf | 12:02 |
| jnamdar | but it looks related to the the mistral connection to me, not keystone | 12:03 |
| noonedeadpunk | I think iterface in `keystone_authtoken` might be used for retrieving endpoints from catalog as well | 12:04 |
| noonedeadpunk | as eventually you get mistral endpoint from keystone anyway | 12:04 |
| jnamdar | oh I see | 12:04 |
| jnamdar | noonedeadpunk: meh unfortunately it's still using the public endpoint or mistral | 12:20 |
| noonedeadpunk | hm.... | 12:20 |
| jnamdar | for* mistral | 12:21 |
| noonedeadpunk | But I think that connection should be made in other way isn't it? That it's mistral who should reach tacker? I actually no idea about this part as never used neither of these services... | 12:23 |
| noonedeadpunk | it's just what I see in https://docs.openstack.org/tacker/latest/reference/mistral_workflows_usage_guide.html | 12:23 |
| jnamdar | it seems like when I register a VIM, it's trying to create a workflow on mistral | 12:23 |
| noonedeadpunk | aha | 12:24 |
| jnamdar | also mistral is listed as a dependency of tacker IIRC | 12:24 |
| noonedeadpunk | yeah might be | 12:24 |
| noonedeadpunk | and have you catched stack trace of the error in logs? | 12:25 |
| noonedeadpunk | I think it also depends pretty much on barbican... | 12:25 |
| jnamdar | yeah | 12:25 |
| jnamdar | Seems like barbican can be turned off | 12:25 |
| jnamdar | it is by default in tacker.conf at least | 12:25 |
| jnamdar | use_barbican = False | 12:26 |
| noonedeadpunk | but log stack trace with error would be really hepfull as give a clue where start reading tacker code | 12:26 |
| jnamdar | i'll link my stack trace in a pastebin | 12:26 |
| noonedeadpunk | sounds good | 12:26 |
| noonedeadpunk | jnamdar: well, feels like mistral endpoint is not configurable for tacker.... | 12:32 |
| noonedeadpunk | https://opendev.org/openstack/tacker/src/branch/master/tacker/mistral/mistral_client.py#L20-L21 | 12:32 |
| *** spatel has joined #openstack-ansible | 12:32 | |
| noonedeadpunk | or it really should be addressed with `keystone_authtoken`... | 12:33 |
| jnamdar | here is the paste https://pastebin.com/raw/x56VpEzC | 12:33 |
| jnamdar | there are a bunch of openstack vim delete/register in there | 12:34 |
| jnamdar | noonedeadpunk: yeah I was afraid of that | 12:34 |
| jnamdar | what if I just updated the public endpoint of mistral with the internal url ? :| | 12:35 |
| jnamdar | nasty patch | 12:35 |
| noonedeadpunk | well, you can do that for testing at least... | 12:35 |
| noonedeadpunk | or you can disable ssl for public:) | 12:35 |
| jnamdar | mmh how can I do that? | 12:35 |
| jnamdar | in keystone conf? | 12:36 |
| spatel | jrosser i have solve my yesterday LXC issue after adding this - https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/794266/8/tasks/providers/setup_ovs_ovn.yml#94 | 12:36 |
| spatel | LXC aio works but metal is failing so looking into | 12:36 |
| noonedeadpunk | first of all set `mistral_service_publicuri_proto: http` | 12:37 |
| noonedeadpunk | and you will also need to override `haproxy_mistral_service` (if you're on master or V) to disable `haproxy_ssl` specifcily for it https://opendev.org/openstack/openstack-ansible/src/branch/master/inventory/group_vars/haproxy/haproxy.yml#L281-L290 | 12:38 |
| jnamdar | ok thx, I'm on ussuri so I don't need to modify haproxy's conf? | 12:39 |
| jnamdar | also is mistral_service_publicuri_proto is in mistral.conf ? | 12:39 |
| noonedeadpunk | it's https://opendev.org/openstack/openstack-ansible-os_mistral/src/branch/master/defaults/main.yml#L152 | 12:40 |
| noonedeadpunk | but you need to set it in user_variables.yml | 12:40 |
| noonedeadpunk | on U things even more nasty unfortunatelly :( | 12:40 |
| jnamdar | oh, I would need to rerun the playbook os-install-mistral then right? | 12:41 |
| noonedeadpunk | it's probably easier just to edit /opt/openstack-ansible/inventory/group_vars/haproxy/haproxy.yml | 12:41 |
| noonedeadpunk | yep | 12:41 |
| noonedeadpunk | and probably to remove public endpoint from keystone as well | 12:42 |
| opendevreview | Merged openstack/openstack-ansible-lxc_hosts master: Add CentOS 8.4 support https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/795102 | 12:53 |
| miloa | thanks noonedeadpunk, we will try to add region_name in the neutron section of nova.conf. | 12:58 |
| jnamdar | noonedeadpunk: i think connection with mistral is good now, thanks. I think there are some actions missing for tacker though, my openstack vim register is still failing | 14:01 |
| jnamdar | `Failed to run task [error=Failed to find action [action_name=tacker.vim_ping_action] in [namespace=], wf=vim_id_f7721da8-288a-44c2-8c39-aeff531d5194, task=monitor_ping_vimPingVIMTASK]` | 14:01 |
| jnamdar | I probably need to setup those actions in mistral, I hope they're in the docs somewhere lol | 14:01 |
| noonedeadpunk | yeah. might be. | 14:08 |
| noonedeadpunk | we indeed didn't payed enough attention to these services, but would be great if you could suggest improvements for config or roles | 14:08 |
| jnamdar | so far I met a lot of the same errors regarding certificate verification | 14:09 |
| jnamdar | across services | 14:09 |
| jnamdar | and those were usually fixed by setting the endpoint interface to internal like you suggested. on an AIO I guess those should be put to internal by default | 14:10 |
| jnamdar | otherwise I'm working on ussuri right now, so sometimes it's hard to tell whether something's already been fixed or not | 14:11 |
| jrosser | in general the services should communicate with each other on the internal endpoint | 14:11 |
| jrosser | so if they're not doing that and we can patch it to do so it would be good | 14:11 |
| jrosser | the AIO has both internal and external endpoints and ought to be as representative of a real deployment as is practical | 14:12 |
| jnamdar | mmh seems like it's still in development https://docs.openstack.org/tacker/latest/contributor/tacker_vim_monitoring.html | 14:21 |
| jnamdar | that's weird then, not sure why I'm getting this error if the feature's not done yet | 14:21 |
| jnamdar | i'll try to look at the #openstack-tacker chat for more info | 14:22 |
| noonedeadpunk | jnamdar: why do you think it's still in development? | 14:42 |
| noonedeadpunk | I think it's just link to the latest version? | 14:42 |
| jnamdar | noonedeadpunk: yeah you're right I misread that | 14:43 |
| jrosser | thats an interesting side effect of the OFTC move | 14:43 |
| jnamdar | I think the feature is up, but it does link to the latest version, not ussuri | 14:44 |
| jrosser | any stable branch of /contributor/ redirects to latest | 14:44 |
| noonedeadpunk | yeah.... | 14:44 |
| noonedeadpunk | also noticed that | 14:44 |
| noonedeadpunk | #startmeeting openstack_ansible_meeting | 15:00 |
| opendevmeet | Meeting started Tue Jun 8 15:00:18 2021 UTC and is due to finish in 60 minutes. The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| opendevmeet | The meeting name has been set to 'openstack_ansible_meeting' | 15:00 |
| noonedeadpunk | #topic rollcall | 15:00 |
| noonedeadpunk | \o/ | 15:00 |
| noonedeadpunk | hm, btw topic is not actually changed with meetingbot :( | 15:00 |
| jrosser | hello | 15:04 |
| noonedeadpunk | #topic office hours | 15:05 |
| noonedeadpunk | CentOS 8.4 <- this has been solved right now I think. CI is passing again, which is awesome. But timing as usual was awful | 15:05 |
| noonedeadpunk | but we also need to backport to V and I think also to U? | 15:06 |
| jrosser | oh yes i expect so | 15:06 |
| jrosser | thankfully they changes are small | 15:06 |
| noonedeadpunk | yeah, just one symlink:) | 15:07 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts stable/victoria: Add CentOS 8.4 support https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/795282 | 15:07 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts stable/ussuri: Add CentOS 8.4 support https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/795283 | 15:07 |
| noonedeadpunk | and thankfully 8.4 does not fail on libvirt firmware like stream still does | 15:07 |
| noonedeadpunk | as https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/793007 still failing.... | 15:08 |
| noonedeadpunk | So next we have 2 topics, that I expect to be merged by the end of the day | 15:09 |
| noonedeadpunk | #link https://review.opendev.org/q/topic:%22osa%252Fpki%22+(status:open%20OR%20status:merged) | 15:09 |
| noonedeadpunk | #link https://review.opendev.org/q/topic:%22osa%252Fbullseye%22+(status:open%20OR%20status:merged) | 15:09 |
| noonedeadpunk | Once this is done, we do RC1. And probably we can branch as well, but I'd wait till next week with branching roles at least | 15:11 |
| jrosser | yes - feels like all the major things are done now | 15:11 |
| noonedeadpunk | we also should do bunch of rechecks... | 15:11 |
| noonedeadpunk | as our gates were not really stable lately | 15:13 |
| noonedeadpunk | ok, then regarding https://bugs.launchpad.net/openstack-ansible/+bug/1930276 | 15:14 |
| opendevmeet | Launchpad bug 1930276 in openstack-ansible "Nova API not restarted when nova policy is updated" [Undecided,Triaged] - Assigned to Dmitriy Rabotyagov (noonedeadpunk) | 15:14 |
| noonedeadpunk | I'd say that it's really oslo bug. But I'm not sure if we should workaround it with triggering handlers on older branches | 15:15 |
| noonedeadpunk | as it can be reproduced only with json | 15:15 |
| noonedeadpunk | but it's also pretty much work I'd say.. | 15:15 |
| noonedeadpunk | I wasn't able to look into oslo.policy code yet :( But will try to this week | 15:16 |
| noonedeadpunk | I hope that just catching exception in correct place will do job | 15:16 |
| noonedeadpunk | as otherwise we should also trigger service restart when we're removing policy.yaml | 15:17 |
| spatel | noonedeadpunk jrosser i have installed aio_ovn_metal senario and seeing this - http://paste.openstack.org/show/806463/ | 15:18 |
| noonedeadpunk | But I a bit doubt regarding possibility of fixing json file, since they're deprecated for a while | 15:18 |
| spatel | inventory is totally empty is that ok ? | 15:18 |
| spatel | sorry we are in middle of meeting. | 15:18 |
| jrosser | even though the json is deprecated it's still supported in a lot of stable branchs | 15:20 |
| jrosser | i'd expect there to be an interest in fixing it if we can get a good bug report | 15:20 |
| noonedeadpunk | I missed oslo meeting yestarday to raise this :( | 15:20 |
| noonedeadpunk | fair ppint | 15:22 |
| noonedeadpunk | *point | 15:22 |
| jrosser | lets ask them about our bug | 15:22 |
| noonedeadpunk | I was asking but haven't pinged hberaud so get no answer:) | 15:23 |
| jrosser | ah well i just did, lets see if anything happens | 15:24 |
| noonedeadpunk | I guess they mostly following on channel during meetings | 15:25 |
| noonedeadpunk | regarding https://specs.openstack.org/openstack/openstack-ansible-specs/specs/xena/protecting-plaintext-configs.html - I think it's worth creating new repo for vault only after branching | 15:26 |
| noonedeadpunk | I saw folks have been asking here about backporting this work to previous branches, which is kind of important point for them. But I'd say that's not possible considering amount of work and requirement of vault role | 15:27 |
| jrosser | yes it looks awkward | 15:29 |
| noonedeadpunk | Oh! And regarding DDoS! What I think we can do - in python_venv_build, check for amount of hosts in the play and fail, in case there're more then let's say 5 hosts, and wheels won't be built for $reasons | 15:29 |
| jrosser | yes like safety net of some sort | 15:29 |
| noonedeadpunk | and maybe link to some doc about troubleshooting this? And suggest workaround of setting osa_serial to lower then 5 if it can't be fixed for any reason | 15:31 |
| jrosser | we can probably print out useful stuff in a fail: message about number of hosts, number of repo servers and stuff | 15:31 |
| noonedeadpunk | yeah, totally | 15:31 |
| jrosser | OS releases / architecture etc, to show why it's not worked | 15:31 |
| noonedeadpunk | yeah, really good idea. it would be easier to understand for deployer what he does wrong | 15:32 |
| noonedeadpunk | Also I was thinking of moving https://docs.openstack.org/openstack-ansible/rocky/admin/upgrades/distribution-upgrades.html to master as well in regards to focal upgrade? | 15:32 |
| noonedeadpunk | and do some critical note about that you can't just upgrade computes without having repo container | 15:33 |
| noonedeadpunk | but yeah, having repo container might be really tricky. Smth we probably should figure out in terms of the best way to sort this out | 15:33 |
| jrosser | ah - does that page not appear in all branches | 15:33 |
| noonedeadpunk | nope | 15:33 |
| noonedeadpunk | it's only for rocky | 15:34 |
| noonedeadpunk | it has been merged directly there | 15:34 |
| jrosser | right - rocky was xenial->bionic, but i guess that W is a really huge transition release for all OS | 15:34 |
| noonedeadpunk | yep | 15:34 |
| noonedeadpunk | well, for centos it would be relatively easy migration, but debian and ubuntu... | 15:35 |
| jrosser | theres a similar thing to bring arm nodes into an existing x86_64 cloud | 15:35 |
| jrosser | nothing prevents that other than missing a repo server | 15:35 |
| noonedeadpunk | eventually we have planned bionic->focal upgrade for autumn, so it will be adjusted anyway, but would be good to look into it in advance | 15:36 |
| noonedeadpunk | and the biggest thing here is actually lsync | 15:36 |
| jrosser | i feel like we maybe miss something here to bring in temporary / alternative repo hosts for specific cases | 15:36 |
| noonedeadpunk | you mean for being standalone (ie under proxy)? | 15:37 |
| jrosser | right, it's easy to point the build host at something else for an ansible group | 15:38 |
| jrosser | but not so easy to get the build results to appear at the LB | 15:38 |
| noonedeadpunk | ah | 15:38 |
| noonedeadpunk | I think we can leverage ACLs or smth like that | 15:39 |
| noonedeadpunk | an be a bit smarter here... | 15:39 |
| noonedeadpunk | actually nothing stopps us from having several group of backends | 15:39 |
| jrosser | oh well actually i wonder if overriding openstack_repo_url for a host group would work | 15:40 |
| noonedeadpunk | it probably should... but it's not that neat.. As you need to set it manually and define extra group for new OS | 15:41 |
| noonedeadpunk | and well, if you have more then 1 repo container per specific case... | 15:41 |
| noonedeadpunk | that would be not handy really | 15:42 |
| noonedeadpunk | oh, btw. I saw really weird failures during facts gathering after switching to min | 15:44 |
| jrosser | oh dear - anything specific? | 15:45 |
| noonedeadpunk | https://700a7e3ec90813bffe3e-a140c73e010d1e58296165dc52d0a2c3.ssl.cf2.rackcdn.com/788031/11/check/openstack-ansible-deploy-aio_lxc-debian-buster/c9ca1d5/logs/ara-report/results/3366.html | 15:45 |
| noonedeadpunk | And I saw it periodicly on different patches | 15:45 |
| noonedeadpunk | no details in stdout either | 15:46 |
| noonedeadpunk | so have literally no idea wtf is going on... | 15:47 |
| dmsimard | those are the worst | 15:48 |
| dmsimard | sometimes you can get the actual traceback by adding -vvv | 15:49 |
| noonedeadpunk | dmsimard: have you seen smth like that in other places? | 15:49 |
| dmsimard | ansible eats tracebacks unless it's -vvv | 15:49 |
| noonedeadpunk | yeah... but you need to catch it first... and until it's random and not really reproducable... | 15:49 |
| noonedeadpunk | at least I couldn't reproduce that relatively easily... | 15:50 |
| dmsimard | it's delegating the setup task that fails ? maybe one of the item from the list doesn't work for some reason | 15:50 |
| noonedeadpunk | well, it's a container on the same host... and in case of CI item consist of single element | 15:51 |
| noonedeadpunk | but that's actually what I also thought about | 15:52 |
| noonedeadpunk | I could imagine this happening in case of OOM but haven't found any proof in the log | 15:54 |
| jrosser | not found anything suspicious at all here | 15:57 |
| noonedeadpunk | but I also don't see it happening today... | 15:59 |
| noonedeadpunk | #endmeeting | 16:01 |
| opendevmeet | Meeting ended Tue Jun 8 16:01:01 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:01 |
| opendevmeet | Minutes: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2021/openstack_ansible_meeting.2021-06-08-15.00.html | 16:01 |
| opendevmeet | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2021/openstack_ansible_meeting.2021-06-08-15.00.txt | 16:01 |
| opendevmeet | Log: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2021/openstack_ansible_meeting.2021-06-08-15.00.log.html | 16:01 |
| *** rpittau is now known as rpittau|afk | 16:31 | |
| *** miloa has quit IRC | 16:36 | |
| opendevreview | Merged openstack/openstack-ansible master: Gather extra facts for healthcheck playbooks https://review.opendev.org/c/openstack/openstack-ansible/+/794795 | 16:42 |
| opendevreview | Merged openstack/openstack-ansible-rsyslog_client master: Replace linters test with integarted one https://review.opendev.org/c/openstack/openstack-ansible-rsyslog_client/+/794254 | 17:03 |
| opendevreview | Merged openstack/openstack-ansible-rsyslog_client master: Add support for debian bullseye https://review.opendev.org/c/openstack/openstack-ansible-rsyslog_client/+/791288 | 17:03 |
| *** b1tsh1ft3r has joined #openstack-ansible | 17:32 | |
| *** andrewbonney has quit IRC | 17:32 | |
| spatel | jrosser could you use your ninja skill to find out why this one failed? - https://zuul.opendev.org/t/openstack/build/b2a88bd86c6849dea5921a3fa373652d | 18:09 |
| jrosser | the OVN router is not accessible | 18:12 |
| jrosser | and i guess i'm wondering where teh ovn service logs are | 18:14 |
| spatel | teach me how do you finding error in logs, i did search RUN END etc.. but not seeing any good way to find error block | 18:15 |
| spatel | hmm i can see it now, tempest task failed | 18:17 |
| jrosser | oh i found them, they don't seem to be journal logs | 18:17 |
| jrosser | you have to repeatedly search for RUN END, there are 7 occurrences of that in each job | 18:18 |
| jrosser | so i think that something to look at (unrelated to the error) is if the ovn things make useful systemd journals | 18:20 |
| jrosser | and if they do we should be collecting them in the CI jobs | 18:20 |
| jrosser | theres not really anything useful in the ovn controller log from the host https://zuul.opendev.org/t/openstack/build/b2a88bd86c6849dea5921a3fa373652d/log/logs/host/ovn/ovn-controller.log.txt | 18:21 |
| spatel | agreed, these logs are general logs, may need to set debug for AIO so we have more logs data | 18:22 |
| spatel | i am trying to build AIO metal in my lab to experiment | 18:23 |
| spatel | yesterday i fixed OVN_LXC issue not getting metal issue | 18:24 |
| jrosser | these should have debug anyway | 18:26 |
| jrosser | what you need to do is see if there is anything better in journalctl -i ovn_northd | 18:26 |
| jrosser | and if there is we need to update the AIO log collection to grab those too | 18:27 |
| jrosser | here is where your router is created https://zuul.opendev.org/t/openstack/build/b2a88bd86c6849dea5921a3fa373652d/log/logs/host/neutron-server.service.journal-16-56-52.log.txt#5377-5412 | 18:27 |
| mgariepy | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b2a/794266/8/check/openstack-ansible-deploy-aio_metal_ovn-ubuntu-focal2/b2a88bd/logs/host/neutron-ovn-metadata-agent.service.journal-16-56-52.log.txt | 18:41 |
| mgariepy | that seems interesting Unable to open stream to unix:/var/run/openvswitch/db.sock to retrieve schema: No such file or directory | 18:42 |
| opendevreview | Merged openstack/openstack-ansible-os_tacker master: Update tacker config https://review.opendev.org/c/openstack/openstack-ansible-os_tacker/+/795303 | 18:46 |
| spatel | mgariepy i am building AIO metal in my lab to understand issue | 18:47 |
| opendevreview | Merged openstack/openstack-ansible-openstack_hosts master: Add CentOS 8.4 support https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/795103 | 18:47 |
| spatel | in metal case northd and ovn-controller both use ovsdb and may be something going on between them | 18:50 |
| mgariepy | spatel, what the right invocation to run the test locally ? | 19:00 |
| spatel | what do you mean by locally? | 19:01 |
| mgariepy | to run the test via run_tests.sh | 19:01 |
| mgariepy | in a vm | 19:01 |
| spatel | i am not following you.. what do you trying to do here? | 19:04 |
| spatel | what is run_tests.sh (sorry my CI knowledge is limited here) | 19:04 |
| mgariepy | jrosser, noonedeadpunk if i want to run the openstack-ansible-deploy-aio_metal_ovn-ubuntu-focal2 is there some args i can pass to run_test.sh to run it locally ? | 19:06 |
| spatel | mgariepy i am installing aio-ovn normal way using export SENARIO='aio_ovn_metal' | 19:12 |
| spatel | if you want to play in your PC | 19:13 |
| jrosser | run_test.sh is a bit awkward if you want to apply patches to roles, I generally just run the bootstrap / playbooks manually | 19:17 |
| mgariepy | ok | 19:19 |
| mgariepy | i tought that it was possible. | 19:20 |
| opendevreview | Merged openstack/openstack-ansible master: Add PKI role to integrated repo https://review.opendev.org/c/openstack/openstack-ansible/+/788031 | 19:41 |
| spatel | jrosser mgariepy something odd going on here - http://paste.openstack.org/show/806468/ | 19:49 |
| spatel | i will debug later tonight | 19:50 |
| spatel | its trying to start ovsdb 6640 on all interface 0.0.0.0:6640 but HAproxy already listening on it.. | 19:51 |
| spatel | i don't think we need HAProxy stanza for 6640 | 19:52 |
| jrosser | we do | 19:52 |
| *** b1tsh1ft_ has joined #openstack-ansible | 19:52 | |
| jrosser | the services should bind to their port on br-mgmt | 19:52 |
| jrosser | which is the .100 address | 19:52 |
| *** b1tsh1ft3r has quit IRC | 19:53 | |
| jrosser | and the vip bonds to .101 | 19:53 |
| jrosser | *binds | 19:53 |
| jrosser | looks like OVN has not had the “bind-to-mgmt” treatment | 19:53 |
| spatel | hmmm | 19:54 |
| jrosser | all of these things will have some settings in their config file setting the bind address | 19:54 |
| jrosser | which maybe we don’t configure yet? | 19:54 |
| spatel | i will take a look tonight.. i have to leave now :( | 19:55 |
| *** spatel has quit IRC | 19:58 | |
| mgariepy | looks like the ovsdb server is configured with 2 managers one on 127.0.0.1:6640 and the other on 6640 directly | 20:24 |
| opendevreview | Merged openstack/openstack-ansible stable/ussuri: Fix sahara backend URL https://review.opendev.org/c/openstack/openstack-ansible/+/794445 | 20:32 |
| *** gilou__ has joined #openstack-ansible | 20:33 | |
| jrosser | feels like we need to change some port numbers? | 20:36 |
| *** gilou_ has quit IRC | 20:40 | |
| *** b1tsh1ft_ has quit IRC | 21:28 | |
| *** b1tsh1ft3r has joined #openstack-ansible | 21:58 | |
| *** b1tsh1ft3r has quit IRC | 22:06 | |
| *** luksky has quit IRC | 22:10 | |
| *** fresta has joined #openstack-ansible | 22:43 | |
| *** tosky has quit IRC | 23:03 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!