16:00:44 <noonedeadpunk> #startmeeting openstack_ansible_meeting
16:00:45 <openstack> Meeting started Tue Sep  1 16:00:44 2020 UTC and is due to finish in 60 minutes.  The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot.
16:00:46 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
16:00:49 <openstack> The meeting name has been set to 'openstack_ansible_meeting'
16:00:50 <noonedeadpunk> #topic office hours
16:01:57 <noonedeadpunk> So, the main thing that needs to be announced, is that we have os_senlin repo https://opendev.org/openstack/openstack-ansible-os_senlin
16:02:17 <jrosser> spatel_: push a patch for senlin!
16:02:24 <noonedeadpunk> And spatel_ has previously volunteered to get the role for senlin project
16:02:30 <noonedeadpunk> yeah!
16:02:56 <jrosser> i was wondering about all these failing jobs for centos-7 on master
16:02:57 <noonedeadpunk> I guess it needs also https://review.opendev.org/#/c/748693/
16:03:11 <noonedeadpunk> oh, yeah, that's also great question....
16:03:26 <jrosser> two possible things we can do there - investigate with nova/oslo becasue it's the same error in lots of jobs
16:03:31 <jrosser> or we drop the centos-7 jobs
16:04:17 <noonedeadpunk> I also noticed that centos8 functional for galera fails, which means that probably cluster would be broken
16:04:37 <noonedeadpunk> and we're good only for aio deployments...
16:05:50 <noonedeadpunk> worth placing just noop task though...
16:06:02 <noonedeadpunk> as maybe it's related to 10.5 only...
16:06:48 <spatel_> noonedeadpunk: fyi, i am running centos8 with 3 controller nodes and my 3 node galera cluster (10.4) working fine.
16:06:49 <noonedeadpunk> btw returning to galera, I think we need to decide the desteny of galera_client role
16:07:01 <noonedeadpunk> spatel_: ok, good to know)
16:07:18 <noonedeadpunk> than may be really related to 10.5 which is quite another question
16:07:55 <openstackgerrit> Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-galera_server master: [DNM] noop  https://review.opendev.org/749354
16:08:57 <openstackgerrit> Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_cloudkitty stable/ussuri: Add CentOS 8 and Ubuntu Focal support  https://review.opendev.org/749355
16:12:10 <noonedeadpunk> jrosser: we can also add this single test to the blacklist as well
16:12:18 <noonedeadpunk> but tbh worth dropping centos7
16:13:07 <noonedeadpunk> I think we've almost finished cherry-picking everything to U
16:13:07 <admin0> my aio stops at this error: os_ceilometer : Initialize Gnocchi database by creating ceilometer resources  .. is that normal ?
16:13:10 <admin0> its an AIO
16:13:37 <noonedeadpunk> admin0: not really....
16:19:45 <jrosser> noonedeadpunk: what do you think of this https://zuul.opendev.org/t/openstack/build/86acf3990e094afaa2648c894a67e71d/log/logs/host/nova-compute.service.journal-14-17-08.log.txt#2781-2783
16:19:56 <jrosser> it is outside the venv, is that to be expected?
16:22:30 <noonedeadpunk> libvirt may generate this....
16:22:39 <noonedeadpunk> we symlink bunch of things into venv....
16:23:08 <noonedeadpunk> so such request may be kind of valid...
16:23:42 <noonedeadpunk> hm, but we don't symlink for centos7...
16:24:42 <noonedeadpunk> we do for 8 and ubuntu
16:25:45 <openstackgerrit> Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Decrease amount of jobs and update distros  https://review.opendev.org/746881
16:25:51 <noonedeadpunk> I've updated ^ to remove centos-7 jobs
16:27:06 <noonedeadpunk> but not sure I can just drop jobs....
16:27:42 <openstackgerrit> Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Decrease amount of jobs and update distros  https://review.opendev.org/746881
16:27:51 <noonedeadpunk> they can be used somewhere directly....
16:29:08 <jrosser> yes, need to do this http://codesearch.openstack.org/?q=openstack-ansible-deploy-aio_metal-centos-7
16:29:14 <jrosser> then a bunch of patches to undo all those
16:29:44 <jrosser> for each job we want to delete worth a check with codesearch
16:30:40 <noonedeadpunk> since we need quick fix reight now, let's drop them from template to unblock some things, and then will leave jobs removal for cleanup
16:31:17 <jrosser> i have some patches for the remainder of removing centos-7 and suse as well
16:31:27 <jrosser> should rebase those and get them in order to merge
16:32:11 <noonedeadpunk> Yeah, I guess it's about time to start this
16:32:29 <jrosser> i am kinda concerned about all this magnum endpoint stuff keeps coming up
16:32:33 <noonedeadpunk> (despite being pretty loaded now because of some incidents
16:32:45 <jrosser> seems to be recurring, cost us may weeks of debugging here
16:33:06 <jrosser> *many weeks
16:35:45 <noonedeadpunk> I was facing some issue but it was due to missing passing X-Forwarded-For in haproxy endpoint
16:37:06 <noonedeadpunk> As heat unlike all other services really rely on the output of endpoint root (ie 172.29.238.100:5000) so if he see there http, it will ignore keystone's endpoint and will ask for http
16:37:16 <noonedeadpunk> and answer there depends on proto passed
16:37:37 <noonedeadpunk> s/X-Forwarded-For/X-Forwarded-Proto/
16:50:03 <noonedeadpunk> sorry need to leave, so will end meeting 10 mins earlier
16:50:07 <noonedeadpunk> #endmeeting