16:00:21 <mnaser> #startmeeting openstack_ansible_meeting
16:00:24 <mnaser> #topic rollcall
16:00:25 <openstack> Meeting started Tue Nov 27 16:00:21 2018 UTC and is due to finish in 60 minutes.  The chair is mnaser. Information about MeetBot at http://wiki.debian.org/MeetBot.
16:00:26 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
16:00:28 <openstack> The meeting name has been set to 'openstack_ansible_meeting'
16:00:32 <mnaser> o/
16:00:39 <spotz> o/
16:00:43 <evrardjp> o/
16:01:33 <cloudnull> o/
16:01:46 <odyssey4me> o/ although I'm sharing with another meeting :/
16:01:49 <mnaser> i'm sorry, i haven't been updating things properly
16:02:10 <mnaser> last week highlights imho has been: odyssey4me getting us closer to running integrated for all roles
16:02:35 <mnaser> so please eyes on https://review.openstack.org/#/c/551791/
16:02:45 <odyssey4me> need one more core review for https://review.openstack.org/551791 - then I'll be porting those back so that we can do upgrade tests along with deploy tests
16:02:48 <mnaser> i thought i reviewd that
16:03:01 <mnaser> ok ill review this shortly after the meeting to get us the second +2
16:03:05 <odyssey4me> ta
16:03:13 <mnaser> other things is os_placement still in progress
16:03:24 <mnaser> we're having a lot of gate failures i think
16:03:59 <evrardjp> os_manila is also in progress
16:04:21 <evrardjp> (while of lesser importance than placement, I agree)
16:04:21 <mnaser> i can look at the centos jobs to help make them stable but if we're going to have always-red nonvoting jobs, i would want to remove them
16:04:45 <mnaser> it takes 1.5h of wasted upstream CI time on every job and if no one is actively looking at them.. makes it hard
16:04:58 <odyssey4me> bear in mind we agreed that distro jobs on master stay non-voting, regardless of consistent failures
16:05:21 <odyssey4me> this allows people to work on fixing things as we go, rather than having to focus on fixing it at the end of the cycle
16:05:36 <evrardjp> well the idea was to report back -- for example suse current breakages in horizon is on my todo list, even if I didn't get the chance to tackle it
16:05:37 <mnaser> odyssey4me: i agree, but it seems like there aren't a lot of eyes on them presently
16:06:10 <evrardjp> we need more ppl to help there, anyone, feel free to help ! :)
16:06:24 <odyssey4me> sure, but it'll be easier to troubleshoot and solve them once we're using integrated build for all tests - because everyone is more familiar with it
16:06:37 <mnaser> odyssey4me: yep, i agree
16:06:47 <mnaser> so just something to keep in mind
16:07:02 <openstackgerrit> Jonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Add support for aarch64 images  https://review.openstack.org/620032
16:07:06 <mnaser> we've identified a few responsible people per distro so just keep up with those and feel free to ping them when/if we need things
16:07:40 <mnaser> over the next few days i'm upgrading a few environments so https://review.openstack.org/#/q/topic:queens-to-rocky
16:07:57 <evrardjp> mnaser: great news!
16:07:57 <mnaser> that's most of what i've identified, anyone else (surely i missed things!)
16:08:16 <evrardjp> shouldn't that be a topic of the open discussion though? It's less a report, more a heads-up :p
16:08:59 <vakuznet> Review please https://review.openstack.org/#/c/618046/
16:09:31 <mnaser> sure
16:09:42 <mnaser> mostly just a "what i've been working on" thing, anyways
16:10:22 <mnaser> #topic bug triage
16:10:25 <mnaser> #link https://bugs.launchpad.net/openstack-ansible/+bug/1805239
16:10:26 <openstack> Launchpad bug 1805239 in openstack-ansible "missing logrotate of the syslog, daemon.log " [Undecided,New]
16:11:28 <mnaser> hm
16:11:36 <mnaser> we dont use rsyslog_client anymore right
16:11:49 <odyssey4me> we do, for suse
16:12:23 <evrardjp> maybe asking which branch does this apply?
16:12:33 <evrardjp> and if that is for hosts or containers?
16:12:50 <evrardjp> vakuznet: are you the owner of this bug?  ^
16:12:54 <mnaser> this says centos
16:12:55 <vakuznet> yes
16:13:05 <vakuznet> Queens, host
16:13:19 <evrardjp> vakuznet: we supposed master :)
16:13:23 <evrardjp> presumed*
16:13:33 <evrardjp> so yeah that could apply.
16:13:33 <mnaser> so in rocky we no longer use rsyslog stuff and moved to journals for everything afaik
16:13:40 <mnaser> it is a queens bug
16:13:51 <evrardjp> indeed.
16:14:05 <mnaser> vakuznet: are you able to push a patch regarding this?  i can help with how to get it properly landed if you have questions
16:14:36 <vakuznet> sure
16:14:47 <odyssey4me> I'm not feeling very well, so I'm going offline. I'll catch y'all tomorrow.
16:14:52 <mnaser> take care odyssey4me
16:15:08 <mnaser> vakuznet: cool, ill mark as confirmed/medium and assign to you is that ok?
16:15:40 <vakuznet> https://github.com/openstack/openstack-ansible/blob/master/playbooks/common-tasks/rsyslog-client.yml#L18
16:15:45 <evrardjp> see you later odyssey4me
16:16:04 <mnaser> vakuznet: we can talk about the potential fix after our meeting right now, is that okay? we're just triaging things right now
16:16:08 <mnaser> just to see bugs or not bugs :)
16:16:19 <vakuznet> ok
16:16:25 <evrardjp> and important or not :)
16:16:30 <evrardjp> or less*
16:17:06 <mnaser> #link https://bugs.launchpad.net/openstack-ansible/+bug/1804837
16:17:07 <openstack> Launchpad bug 1804837 in openstack-ansible "Failed to checkout version 0.5.1 of ansible-sshd for stable/pike" [Undecided,New]
16:17:10 <mnaser> wasnt this fixed?
16:17:17 * mnaser checks
16:18:03 <mnaser> evrardjp: do you know if the shabump includes it?
16:18:55 <mnaser> oh no shabump required
16:19:00 <mnaser> ok so this will be included in 16.0.23
16:20:04 <mnaser> #link https://bugs.launchpad.net/openstack-ansible/+bug/1804827
16:20:05 <openstack> Launchpad bug 1804827 in openstack-ansible "Keystone ldap only configures domain on one node" [Undecided,New]
16:20:28 <mnaser> aw darn
16:20:35 <evrardjp> sorry I was to something else
16:21:12 <mnaser> yep thats valid
16:21:19 <mnaser> regression by https://github.com/openstack/openstack-ansible-os_keystone/commit/096ed19665dad45fe9b1c1790ba599d90ccf233c
16:22:38 <evrardjp> I am still reading...
16:22:57 <mnaser> confirmed/high assigned to jesse .. problem is that we made a change to run ldap setup on one container only to avoid race conditions
16:23:12 <mnaser> but that also meant the steps to config the local config files were only happening on one container
16:23:28 <mnaser> so that patch caused it, it should simply do then when: on the os_keystone_domain task only, not the entire script
16:23:37 <evrardjp> yeah
16:23:51 <evrardjp> I saw your message
16:23:56 <evrardjp> great content in the bug
16:23:58 <evrardjp> I agree
16:24:05 <mnaser> #link https://bugs.launchpad.net/openstack-ansible/+bug/1804770
16:24:07 <openstack> Launchpad bug 1804770 in openstack-ansible "Pike -> Queens Upgrade: Documentation for OVS setup and neutron agent rebalancing missing" [Undecided,New]
16:24:47 <mnaser> thats an amazing bug
16:24:55 <mnaser> great docs included
16:25:51 <mnaser> posted asking for input
16:25:55 <cloudnull> oh wow, thats a bummer ...
16:25:59 <mnaser> if they want/can contribute it
16:26:00 <evrardjp> yeah
16:26:04 <cloudnull> jamesdenton had something on that the other day ?
16:26:18 <jamesdenton> yes - i can take it and work on docs updates
16:26:20 <mnaser> cloudnull: i think he might have been helping the bug repoter here
16:26:25 <cloudnull> ah .
16:26:32 <mnaser> jamesdenton: oh awesome, a lot of info was put there too, so ill assign to you, is that okay?
16:26:41 <cloudnull> i think its something we can generally add to the upgrade scripts / playbooks
16:27:29 <jamesdenton> sure thing.
16:27:35 <mnaser> thank you
16:27:56 <mnaser> oh thats an easy one
16:27:59 <mnaser> #link https://bugs.launchpad.net/openstack-ansible/+bug/1804695
16:28:01 <openstack> Launchpad bug 1804695 in openstack-ansible "Credentials needed to "Verifying OpenStack operation in openstack-ansible" step" [Undecided,New]
16:28:10 <openstackgerrit> Merged openstack/ansible-role-systemd_service master: Allow user/group to be overriden in unit section  https://review.openstack.org/620116
16:28:23 <mnaser> added as low-hanging-fruit, great if anyone wants to push up a small fix :)
16:29:04 <mnaser> #link https://bugs.launchpad.net/openstack-ansible/+bug/1804283
16:29:04 <openstack> Launchpad bug 1804283 in openstack-ansible "Rabbitmq Error: unable to connect to node 'rabbit@ostack-controller-01': nodedown" [Undecided,New]
16:29:36 <mnaser> so i run into this all the time
16:29:37 <mnaser> i have to do
16:29:43 <mnaser> rabbitmqctl -n rabbit@`hostname` blah
16:30:02 <mnaser> it's a bug, not sure how's the best way to resolve it, but maybe eliminated with nspawn
16:30:32 <mnaser> confirmed/medium -- i'll add a comment about it.. maybe someone has insight if there's an easy fix?
16:30:32 <evrardjp> mmm
16:30:36 <evrardjp> that rings me a bell
16:31:05 <evrardjp> mnaser: two questions for you
16:31:37 <evrardjp> what's in /etc/hosts , and what do you have HOST or HOSTNAME in your bashrc/environment ?
16:31:50 <evrardjp> oh third question, which branch?
16:32:26 <mnaser> evrardjp: those are probably good questions to add for the bug
16:32:28 <mnaser> :D
16:32:36 <evrardjp> well we don't know if what you had is the same
16:32:44 <evrardjp> but I can ask the questions.
16:32:49 <evrardjp> let me comment on the bug
16:32:49 <mnaser> it is the same issue :)
16:33:16 <mnaser> ill move onto the next one while you comment on that
16:33:21 <mnaser> #link https://bugs.launchpad.net/openstack-ansible/+bug/1803444
16:33:22 <openstack> Launchpad bug 1803444 in openstack-ansible "gnocchi playbook failing on 18.0.0" [Undecided,New]
16:34:28 <evrardjp> I think that might be a duplicate of another one we talked in the past
16:34:48 <mnaser> evrardjp: the gnocchi one?
16:35:24 <evrardjp> yeah, doesn't that ring you a bell?
16:35:34 <mnaser> yes, i didnt mark it as anything so it showed up next week :)
16:35:36 <evrardjp> It seems we talked about that in the past.
16:35:49 <evrardjp> hahah
16:35:51 <evrardjp> that's why
16:35:58 <mnaser> so i think the solution is to add `import_playbook` .. but i dunno the implications of doing that
16:36:17 <evrardjp> yeah we even discussed on what to do , but nobody got cycles, IIRC
16:36:49 <mnaser> okay well
16:36:55 <mnaser> confirmed medium and we can ask for that patch to be pushed up
16:37:30 <mnaser> #link https://bugs.launchpad.net/openstack-ansible/+bug/1802132
16:37:31 <openstack> Launchpad bug 1802132 in openstack-ansible "OpenStack Ansible dashboard not able to log in with admin credentials" [Undecided,New]
16:37:37 <evrardjp> mnaser: should we point to http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-11-20-16.00.log.html#l-73 ?
16:37:46 <evrardjp> ok let me add that link into the bug
16:37:50 <mnaser> yes that would be useful
16:38:50 <evrardjp> done
16:39:31 <evrardjp> I haven't tried horizon for ages
16:40:17 <mnaser> i dunno
16:40:49 <mnaser> i've deployed countless times and havent seen aynthing
16:41:05 <evrardjp> I recall horizon default endpoint policy to change to move to external by default, but I think we are explicit in endpoints usage. So it's probably not that, but I haven't touched horizon for a while, as I said earlier.
16:41:24 <mnaser> posted a comment requesting user_vars and etc
16:41:26 <evrardjp> yeah it seem to deploy just fine for me, but I haven't tested it.
16:41:27 <mnaser> but it doesnt fel likea bug
16:41:30 <evrardjp> yeah
16:41:43 <evrardjp> I have the impression something wrong got inserted in the horizon config
16:41:52 <evrardjp> making django scream
16:41:59 <mnaser> yup
16:42:04 <mnaser> #topic open discussion
16:42:05 <evrardjp> next?
16:42:09 <mnaser> thats all :)
16:42:16 <evrardjp> so upgrades? :)
16:42:25 <mnaser> going okay so far, i'll have a bunch of patches up
16:42:46 <mnaser> i will write an email to the mailing list about meeting engagement. i will maybe suggest we actually come up with another time, another method of communication or dropping it
16:42:47 <evrardjp> I think there were a few ppl asking for feedback
16:42:54 <evrardjp> we can say in the future you did just fine?
16:42:56 <evrardjp> :)
16:43:04 <mnaser> once my patches land
16:43:04 <mnaser> :P
16:43:08 <evrardjp> haha
16:43:11 <evrardjp> well
16:43:18 <evrardjp> tbh it's been always fluctuating
16:43:32 <evrardjp> sometimes you find 9 ppl, sometimes I felt pretty much alone
16:43:54 <evrardjp> I asked if the time was right, and at the end it was the best time.
16:44:11 <evrardjp> But I agree we shouldn't be only two in meetings.
16:44:35 <evrardjp> this is an opportunity for everyone to raise awareness of their work/issue, yet the media is not used...
16:44:41 <mnaser> yeah
16:44:43 * evrardjp shrugs
16:45:02 <mnaser> ill raise to ml
16:45:04 <evrardjp> mnaser: it was worse when we had two meetings a week
16:45:30 <mnaser> i can imagine
16:45:34 <evrardjp> I think having a meeting per week is the minimum, as one every two week will make our bug list and goal focus too thin
16:45:47 <evrardjp> bug list too big*
16:45:51 <mnaser> i dunno
16:45:58 <openstackgerrit> Merged openstack/openstack-ansible stable/queens: Add MariaDB infrastructure mirrors and disable nested virt  https://review.openstack.org/619718
16:46:01 <mnaser> i feel like we do a good job communicating things together at the same time
16:46:07 <mnaser> its an ML discussion which ill send write away
16:46:27 <evrardjp> yup, I think it's good to put it in the open at least.
16:46:52 <jrosser> perhaps we suffer today from not having the 1hr warning?
16:46:53 <evrardjp> I'm alwys for LESS meetings :D
16:47:10 <mnaser> jrosser: i dunno, the 1 hour warning usualyl doesn't help much
16:47:21 <mnaser> i'm more about the engagement
16:47:25 <evrardjp> oh yeah I am kinda not doing it anymore because I have other meetings
16:47:36 <evrardjp> mnaser: it has been working for me in the past though : )
16:47:51 <evrardjp> (at least for the beginning of the meeting)
16:47:51 <mnaser> i try to do it closer to the meeting
16:47:57 <mnaser> so people kinda still remember it
16:48:02 <evrardjp> haha
16:48:05 <mnaser> if you tell me about something that will happen in an hour surely ill forget :)
16:48:21 <evrardjp> that's because you're all over the place, not everyone is like you :p
16:48:56 <mnaser> ha
16:48:56 <mnaser> :P
16:49:00 <mnaser> anyone has any other topics?
16:49:05 <evrardjp> no other topic
16:50:16 <mnaser> cool, thanks everyone
16:50:17 <mnaser> #endmeeting