Tuesday, 2018-06-26

tux_I have VLAN 31 for my customer how does neutron will provide IP to VLAN 31 if infra node doesn't have VLAN 31 ???00:01
*** yolanda_ has joined #openstack-ansible00:06
*** yolanda__ has quit IRC00:09
tux_I can see dhcp namespace got created on neutron_agents_container but question is how does that namespace will talk to my VLAN 31 instance ?00:09
*** chyka has joined #openstack-ansible00:10
tux_I didn't create any router yet. Do i need to create router in-order to make it work?00:12
*** chyka has quit IRC00:15
*** tux_ has quit IRC00:43
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Adds the issuer to the CAs  https://review.openstack.org/57623400:44
*** tux_ has joined #openstack-ansible00:45
*** abelur_ has joined #openstack-ansible00:45
*** gregoryo has joined #openstack-ansible00:48
*** abelur_ has quit IRC00:48
*** tux_ has quit IRC00:49
*** dxiri has quit IRC00:56
*** tux_ has joined #openstack-ansible00:57
*** tux_ has quit IRC00:58
*** vurtz has quit IRC01:04
*** harryhuang_ has joined #openstack-ansible01:04
*** tux_ has joined #openstack-ansible01:23
*** cmart has joined #openstack-ansible01:28
*** yolanda__ has joined #openstack-ansible03:15
*** yolanda_ has quit IRC03:18
*** yolanda__ has quit IRC03:23
*** yolanda__ has joined #openstack-ansible03:29
*** yolanda_ has joined #openstack-ansible03:34
*** yolanda__ has quit IRC03:36
*** chyka has joined #openstack-ansible03:36
*** chyka has quit IRC03:41
*** cshen has joined #openstack-ansible03:43
*** yolanda__ has joined #openstack-ansible03:44
*** yolanda_ has quit IRC03:45
*** cshen has quit IRC03:47
*** yolanda_ has joined #openstack-ansible04:03
*** yolanda__ has quit IRC04:06
*** yolanda has joined #openstack-ansible04:08
*** poopcat has quit IRC04:08
openstackgerritMerged openstack/openstack-ansible-os_designate master: Add packages required for osprofiler  https://review.openstack.org/57350204:09
*** yolanda_ has quit IRC04:09
*** yolanda_ has joined #openstack-ansible04:10
*** yolanda has quit IRC04:13
*** hamzy has quit IRC04:17
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Add packages required for osprofiler  https://review.openstack.org/57349604:17
*** hamzy has joined #openstack-ansible04:18
*** Bhujay has quit IRC04:20
*** tux_ has quit IRC04:21
*** hamzy has quit IRC04:22
*** hamzy has joined #openstack-ansible04:36
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Set force=true when creating the rpc users  https://review.openstack.org/57798805:02
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Set force=true when creating the RPC users  https://review.openstack.org/57798805:02
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_glance master: Convert role to use a common systemd mount role  https://review.openstack.org/55218505:06
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add kibana custom dashboard  https://review.openstack.org/57794205:10
*** chyka has joined #openstack-ansible05:14
*** chyka has quit IRC05:19
*** Bhujay has joined #openstack-ansible05:20
openstackgerritMerged openstack/openstack-ansible-ops master: Add kafka output plugin to logstash  https://review.openstack.org/57694905:21
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Update when syntax and fix deprecation warnings  https://review.openstack.org/57475705:22
openstackgerritMerged openstack/openstack-ansible-ops master: Add kibana custom dashboard  https://review.openstack.org/57794205:31
openstackgerritMerged openstack/openstack-ansible-ops master: Remove the duplicated word  https://review.openstack.org/57745605:33
*** udesale has joined #openstack-ansible05:44
*** jmnk has joined #openstack-ansible05:49
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_glance master: Correct role rerun when using glance with NFS  https://review.openstack.org/57799305:57
cloudnullFolks, this is a pretty important change should a deployment be using NFS with glance. Pretty simple change overall, just need to make sure we're not trying to recreate directories unnecessarily.05:59
*** openstackgerrit has quit IRC06:04
*** mbuil has joined #openstack-ansible06:06
cloudnullhttps://review.openstack.org/#/q/starredby:cloudnull+status:open,n,z06:06
cloudnullthose are a couple important change we need to address, if folks get a change to review them it'd be greatly appreciated.06:07
*** biffi has joined #openstack-ansible06:15
*** vnogin has joined #openstack-ansible06:20
*** yolanda__ has joined #openstack-ansible06:21
*** cshen has joined #openstack-ansible06:23
*** yolanda_ has quit IRC06:24
*** openstackgerrit has joined #openstack-ansible06:25
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Set force=true when creating the RPC users  https://review.openstack.org/57798806:25
*** lvdombrkr has joined #openstack-ansible06:26
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Update physical host mapping for ansible 2.4+  https://review.openstack.org/57222906:31
ivvecloudnull: nearly up & running with new keepalived06:34
ivvestay tuned!06:34
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Update Ansible to 2.5.5  https://review.openstack.org/57800006:37
*** skyscraper has quit IRC06:37
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Set force=true when creating the RPC users  https://review.openstack.org/57798806:37
cloudnullivve nice!06:39
cloudnullI'm off to sleep. let me know how it goes, im interested if that's the fix and something we might be able to backport where appropriate.06:39
*** nicolasbock has joined #openstack-ansible06:40
ivvewill do06:44
ivveso far so good06:44
*** maybebuggy has joined #openstack-ansible06:48
*** gkadam has joined #openstack-ansible06:58
*** shardy has joined #openstack-ansible07:10
jrosserodyssey4me: i tested this locally and it worked https://review.openstack.org/#/c/568637/ however it got rebased last night and now fails in new and interesting ways in ci07:13
*** pcaruana has joined #openstack-ansible07:20
*** vnogin has quit IRC07:22
*** epalper has joined #openstack-ansible07:22
*** klippo has joined #openstack-ansible07:38
*** gillesMo has joined #openstack-ansible07:39
*** tosky has joined #openstack-ansible07:41
*** gillesMo has quit IRC07:42
*** gillesMo has joined #openstack-ansible07:42
*** lvdombrkr has quit IRC07:47
*** lvdombrkr has joined #openstack-ansible07:48
*** pmannidi has quit IRC07:51
*** lvdombrkr89 has joined #openstack-ansible07:56
*** lvdombrkr has quit IRC07:58
ivvecloudnull: okay so the verdict, it seems to work fine so far. i will do some more testing but no faults from keepalived. some things to concider. the keepalived.conf needs some rebuilding. absolute paths to binaries and some default user definition that i haven't checked into yet. also i would concider the ping check to use something else, its currently sending icmp to k-root server(s)07:58
ivvecan't remember the variable but its the in the keepalived playbook07:59
ivve193.0.14.129, this is the address08:00
jrosserivve: i think you can overrride that in your user vars08:02
*** mbuil has quit IRC08:11
*** gillesMo has quit IRC08:14
*** koukou has joined #openstack-ansible08:15
ivvejrosser: ofc but it should be some kinda default in user_variables.yml so that it is very obvious. perhaps in the user_variables.yml.example08:24
ivvei will submit something08:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Ensure that repo checks use the right values  https://review.openstack.org/56442208:27
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Ensure that the repo servers also use the pypi cache  https://review.openstack.org/56850208:27
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Remove default pip_links value  https://review.openstack.org/56863708:27
koukou Hello, on https://review.openstack.org/#/c/577384/ error is "percona-xtrabackup-2.3.10-1.el7.x86_64 Requires: libev.so.4", only centos fails. Fix should be: "In order to sucessfully install |Percona XtraBackup| ``libev`` package will need to be installed first. ``libev`` package can be installed from the `EPEL <https://fedoraproject.org/wiki/EPEL>`_ repositories."08:29
*** electrofelix has joined #openstack-ansible08:35
openstackgerritkourosh vivan proposed openstack/openstack-ansible-galera_server master: Fix xtrabackup install  https://review.openstack.org/57802808:37
*** rpittau has joined #openstack-ansible08:37
*** shardy has quit IRC08:38
*** gregoryo has quit IRC08:39
*** shardy has joined #openstack-ansible08:43
*** gkadam_ has joined #openstack-ansible08:44
*** gkadam has quit IRC08:45
*** gkadam_ has quit IRC08:45
*** gkadam_ has joined #openstack-ansible08:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Correct README  https://review.openstack.org/57803008:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Update README to include using the file-based backing store  https://review.openstack.org/57803108:47
*** gkadam__ has joined #openstack-ansible08:48
*** gkadam_ has quit IRC08:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Run each setup playbook individually  https://review.openstack.org/57803509:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Use package module properly  https://review.openstack.org/57803609:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Set tftp/pxe directory permissions using file module  https://review.openstack.org/57803709:00
*** tux_ has joined #openstack-ansible09:08
*** tux_ has quit IRC09:09
*** shardy has quit IRC09:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Ensure a consistent and readable style  https://review.openstack.org/57804309:13
*** shardy has joined #openstack-ansible09:13
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Ensure a consistent and readable style  https://review.openstack.org/57804309:14
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Enable saving and re-using file-based backing images  https://review.openstack.org/57804709:24
odyssey4mejrosser cloudnull ^ that's a string of patches to the MNAIO tooling which I'd appreciate reviews for - if there're any more ideas to improve how it's used, I'm game for doing more09:25
jrossersure will look09:26
jrosserwe had excellent success with ramdisk backing for the VM09:26
jrosserwhich i'm not sure ever got written up09:26
odyssey4meyep, I've not seen that exposed anywhere09:29
*** vnogin has joined #openstack-ansible09:29
odyssey4mejrosser: I'm thinking of adding a thing that allows the secondary disk appropriation to be configured as whatever file system you like, instead of forced usage of lvm09:35
jrosserodyssey4me: think is that /dev/shm is a basically a ramdisk09:36
jrosserand anything that gets stuck in there goes faaaaast but is ephemeral09:36
odyssey4meapparently so: https://www.cyberciti.biz/tips/what-is-devshm-and-its-practical-usage.html09:37
jrosserodyssey4me: on a big server (128G ram or so) it works straight out of the box just locating all the VM on /dev/shm, there really isnt much config to do09:42
jrosserodyssey4me: also an awful lot of time in the MNAIO is spent setting up many instances of basically the same VM09:44
jrosseri always though that was a very good place for some optimisation to make it boot some4 kind of base image, or PXEboot one and reuse it09:44
jrosserbecasue it really really hurts IO wise when it's booting all of that up09:45
odyssey4meyep, one of those patches implements the use of a base image for each vm - I'm looking now into extending that to base it on a single image downloaded - so there's a chain: base distro image -> server-specific image -> runtime image09:46
odyssey4methe only trouble with doing that is that the pxeboot is doing some nice things which a downloaded image won't have09:46
*** yolanda_ has joined #openstack-ansible09:50
odyssey4mehmm, it does look somewhat impractical to do what I was thinking as it would require re-implementing a bunch of the network/disk setup in ansible09:50
odyssey4meperhaps it's better to just use a file system which deduplicates09:50
odyssey4meit won't kill the IO though09:50
openstackgerritMerged openstack/openstack-ansible-os_panko master: Add packages required for osprofiler  https://review.openstack.org/57352609:52
*** yolanda__ has quit IRC09:53
jrosserodyssey4me: regarding this https://review.openstack.org/#/c/568637/ is there a reason the behaviour seemed to change when it was rebased?09:54
odyssey4meyeah, rebased without the others actually makes the pip_links work, but in a bad way - without https://review.openstack.org/564422 the pypi server being used for the build will always be upstream, instead of the repo server at the right time09:56
odyssey4meand without https://review.openstack.org/568502 the onmetal build breaks09:56
*** dxiri has joined #openstack-ansible09:56
jrosserdon't the patches always get applied to the head of the branch when tested? thats what i'm not quite following09:57
odyssey4meah no, this chain will be based on each other when implemented09:58
odyssey4mebut the whole chain will be rebased on top of the head of the branch09:58
*** dxiri has quit IRC10:01
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Correct Mac OS X instructions for virt-manager  https://review.openstack.org/57805310:02
jrosserodyssey4me: that /dev/shm backing store is applicable to AIO as well, i've done that with zfs+dedupe (same would go for btrfs) entirely in RAM on a 16G laptop10:06
jrosserkey is a choice of filesystem/container tech that can combine both snapshots and dedupe10:07
*** mbuil has joined #openstack-ansible10:08
*** cshen has quit IRC10:09
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Disable SSH key checks on host  https://review.openstack.org/57805910:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Disable SSH key checks on host  https://review.openstack.org/57805910:37
odyssey4mejrosser: it looks to me like this could be a run_once task? https://github.com/openstack/openstack-ansible-ops/blob/master/multi-node-aio/playbooks/deploy-vms.yml#L87-L9510:42
odyssey4meit seems to me that it's checking for whether the host is ready for guest imports, rather than verifying anything to do with the guests10:43
odyssey4meactually, it just doesn't need the with_items as far as I can see10:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Check capabilities only once  https://review.openstack.org/57806010:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Correct README  https://review.openstack.org/57803010:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Update README to include using the file-based backing store  https://review.openstack.org/57803110:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Run each setup playbook individually  https://review.openstack.org/57803510:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Use package module properly  https://review.openstack.org/57803610:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Set tftp/pxe directory permissions using file module  https://review.openstack.org/57803710:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Ensure a consistent and readable style  https://review.openstack.org/57804310:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Enable saving and re-using file-based backing images  https://review.openstack.org/57804710:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Correct Mac OS X instructions for virt-manager  https://review.openstack.org/57805310:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Disable SSH key checks on host  https://review.openstack.org/57805910:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Check capabilities only once  https://review.openstack.org/57806010:54
*** cshen has joined #openstack-ansible11:00
openstackgerritMerged openstack/openstack-ansible-plugins master: Update physical host mapping for ansible 2.4+  https://review.openstack.org/57222911:04
*** vnogin has quit IRC11:09
*** vnogin has joined #openstack-ansible11:10
*** cmart has quit IRC11:15
*** cshen has quit IRC11:17
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Improve change/error handling for VM define/create  https://review.openstack.org/57806711:19
*** cshen has joined #openstack-ansible11:20
openstackgerritMerged openstack/openstack-ansible-os_rally master: Switch to using project-templates  https://review.openstack.org/57751711:23
*** cmart has joined #openstack-ansible11:29
openstackgerritMerged openstack/openstack-ansible-openstack_openrc master: Switch to using project-templates  https://review.openstack.org/57749511:32
*** udesale has quit IRC11:33
*** ansmith has quit IRC11:48
*** cshen_ has joined #openstack-ansible11:49
*** cshen has quit IRC11:52
*** gillesMo has joined #openstack-ansible11:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Switch lxc_container_backing_store to default "dir"  https://review.openstack.org/57807911:56
*** shardy_ has joined #openstack-ansible12:12
*** shardy has quit IRC12:15
*** shardy_ is now known as shardy12:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Revert "Add LXC and PIP mirrors"  https://review.openstack.org/57808612:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Revert "Add LXC and PIP mirrors"  https://review.openstack.org/57808612:23
odyssey4mecloudnull mnaser logan- ^ please take a peek at that revert... it's necessary to keep everything working as it should be12:24
odyssey4memnaser: no worries, it's way more complicated than it should be :/12:34
mnaserodyssey4me: yeah I just kinda was like “oh those mirrors are missing from here” lol12:35
odyssey4methis is why I want to converge to a single test system12:35
odyssey4methere're just too many subtle differences12:35
odyssey4meand it takes a lot of code walking to unwind it all12:35
*** maybebuggy has quit IRC12:42
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Resolve all Ansible 2.5-related deprecation warnings  https://review.openstack.org/57809112:44
jrossercloudnull: perhaps this would be cleaner than using elasticdump https://github.com/rocknsm/rock-dashboards/blob/master/load.sh12:47
jrossernpm is causing me a pile of grief12:47
*** kysse has quit IRC13:03
*** KeithMnemonic has joined #openstack-ansible13:06
*** gillesMo has quit IRC13:08
koukouwe have a lot of failed jobs on 'Connection' object has no attribute 'container_user', why ?13:09
*** ansmith has joined #openstack-ansible13:10
*** jamesdenton has joined #openstack-ansible13:12
mnaserkoukou: https://review.openstack.org/#/c/577884/13:18
mnaserodyssey4me: ^ fwiw the above is passing13:24
mnaserhwoarang: as much as i'd like to update the commit message, that's another 2 hours or so of going through ci + queue time + potential timeouts because of issues at packethost.. and our gates are blocked, so it would be nice to land it today13:25
odyssey4mefair enough - what's the deal with packethost?13:25
*** tux_ has joined #openstack-ansible13:26
*** evrardjp has joined #openstack-ansible13:27
mnaserodyssey4me: for some reason our jobs seem to crash netwokring and the job times out13:28
mnaserit also turns out that neutron is affected because of the smaller mtu13:28
mnaserthere's a stacktrace in the logs which seems to be related to gro/lro/so and it loses everything13:29
*** evrardjp_ has quit IRC13:30
odyssey4memnaser: hmm, is this happening for role tests and integrated build tests?13:31
mnaserodyssey4me: yes, everything13:31
*** udesale has joined #openstack-ansible13:31
odyssey4meah ok, unfortunately that's a space I'm no good at :/13:32
cloudnullCores if we can get this one through too https://review.openstack.org/#/c/578079 it should help stable/queens out13:32
mnaserthat's a good one13:33
odyssey4meI wonder if jamesdenton or mbuil could perhaps help out?13:33
mnaserodyssey4me: i suspect it's an infra issue at that point13:34
jamesdentonyou rang?13:34
mnaserlol13:34
odyssey4mein infra issue as in the cloud provider is doing something funky which we can't work around?13:34
mnaseryes, i don't think it's something we can work around, i think it's a hypervisor issue from my experience but13:35
*** jwitko has joined #openstack-ansible13:35
odyssey4meok, so I take it that devstack's also hitting issues13:35
mnaseryep13:35
mnaserhttp://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2018-06-25.log.html#t2018-06-25T16:01:34   some discussion here13:35
odyssey4meaha, ok13:35
* odyssey4me puts jamesdenton back in the box.13:35
*** klamath has joined #openstack-ansible13:35
mnaserfun traceback at the time of crash http://logs.openstack.org/38/577838/1/check/openstack-ansible-functional-centos-7/089d056/logs/host/messages.txt.gz13:36
mbuilodyssey4me: how could I help you?13:36
mnaserand http://eavesdrop.openstack.org/irclogs/%23openstack-infra/latest.log.html#t2018-06-26T11:19:2413:36
mnasercloudnull: https://review.openstack.org/#/c/577884/ ill trade you for that one13:37
mnaser:P13:37
cloudnulldone13:39
mnaserthank you13:39
mgariepyquick and easy review https://review.openstack.org/#/c/577151/13:40
odyssey4membuil jamesdenton apologies, it appears that for now the issues at packethost are not something we can do anything about just yet, and mnaser has it covered for now... but thanks for responding!13:42
odyssey4mecloudnull: all those ops role patches are piled on top of each other :)13:43
odyssey4meI'm looking into making the vm storage back-end more pluggable instead of just having LVM or file.13:44
odyssey4meI figure that zfs or btrfs might be very nice and fast. :)13:44
jamesdentonno worries13:45
cloudnullyup. I refrained from +w if it had something functional being changed. I hope that someone else using it might be able to take a look to get those in.13:45
cloudnullI think a Btrfs OR zfs option would be fantastic13:46
cloudnullsmall, fast, light13:46
odyssey4mesounds good, d34dh0r53 has been using the tooling, so perhaps he can also take a peek13:46
cloudnull++13:46
cloudnullI have a build going so if he doesn't get to it I will circle back13:46
*** tux_ has quit IRC13:48
cloudnullhere's another fun one.13:48
cloudnullhttps://review.openstack.org/#/c/578000/13:48
cloudnullansible 2.5.4 has a bug in it https://github.com/ansible/ansible-modules-extras/issues/1278 which is noted in the commit message13:49
cloudnullchanging rabbitmq user password, like we'll do when converting from $BLAH_rabbitmq_password to $BLAH_oslomsg_$BLAH_password will fail13:50
cloudnullits fixed in 2.5.513:50
odyssey4mewell, that's always nice13:50
mbuilodyssey4me: ok , good luck :)13:52
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Correct README  https://review.openstack.org/57803013:53
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Update README to include using the file-based backing store  https://review.openstack.org/57803113:53
*** kysse has joined #openstack-ansible13:58
openstackgerritMaksim Malchuk proposed openstack/openstack-ansible master: Use standard env variables for the AIO bootstrap  https://review.openstack.org/57765214:04
*** cjloader has joined #openstack-ansible14:05
openstackgerritMaksim Malchuk proposed openstack/openstack-ansible stable/queens: Use standard env variables for the AIO bootstrap  https://review.openstack.org/57765314:05
*** biffi has quit IRC14:16
*** chhagarw has joined #openstack-ansible14:19
*** tux_ has joined #openstack-ansible14:23
*** tux__ has joined #openstack-ansible14:32
tux__cloudnull: morning14:33
tux__i have question for you14:33
*** tux_ has quit IRC14:35
*** DanyC has joined #openstack-ansible14:35
tux__I have this setting in my physical_interface_mappings = vlan:br-vlan,flat:eth12   and i want to get rid of flat:eth1214:36
tux__I think i need to remove container_interface: "eth12" & host_bind_override: "eth12" whole stanza from config.yml14:37
tux__anyone know how to do try test run on OSA ?14:37
d34dh0r53odyssey4me: which one?14:38
tux__I want to see what its changing ?14:38
cjloadercan I get another review on https://review.openstack.org/#/c/575504/?14:38
*** chhavi__ has joined #openstack-ansible14:41
*** chhagarw has quit IRC14:41
*** dxiri has joined #openstack-ansible14:43
openstackgerritMatthew Thode proposed openstack/openstack-ansible-os_octavia stable/queens: Adds the issuer to the CAs  https://review.openstack.org/57811814:44
openstackgerritweizj proposed openstack/openstack-ansible-os_glance master: Drop python-cinderclient usage  https://review.openstack.org/57812014:54
openstackgerritweizj proposed openstack/openstack-ansible-os_tempest master: Drop python-cinderclient usage  https://review.openstack.org/57812214:55
d34dh0r53alright ansible gods, wtf am I doing wrong here http://paste.openstack.org/show/724320/14:56
*** vnogin has quit IRC14:58
d34dh0r53nevermind, I'm a moron14:58
d34dh0r53^^ the answer to most of my questions14:58
*** cjloader_ has joined #openstack-ansible14:59
*** cjloader has quit IRC14:59
openstackgerritweizj proposed openstack/openstack-ansible-os_heat master: Drop python-cinderclient usage  https://review.openstack.org/57812315:00
*** vnogin has joined #openstack-ansible15:01
mnaserevrardjp, cloudnull: http://git.openstack.org/cgit/openstack/openstack-ansible/tree/tests/roles/bootstrap-host/defaults/main.yml#n206 do you know the reason behind that failure?15:01
mnasererr, behind the introduction of checksums there15:02
openstackgerritweizj proposed openstack/openstack-ansible-repo_build master: Drop python-cinderclient usage  https://review.openstack.org/57812415:02
mnaseri found it introduced here https://github.com/openstack/openstack-ansible/commit/51f4dec329d5b451450234990fcf8c6baa3fa80a15:02
*** FrankZhang has joined #openstack-ansible15:02
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible-os_blazar master: This patch ensures that the functional tests for Blazar pass.  https://review.openstack.org/57138815:07
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible-os_blazar master: This patch ensures that the functional tests for Blazar pass.  https://review.openstack.org/57138815:08
*** goldenfri has joined #openstack-ansible15:12
*** cshen_ has quit IRC15:12
*** Bhujay has quit IRC15:12
odyssey4med34dh0r53: all my patches against the ops repo (there are a few ;))15:14
d34dh0r53odyssey4me: ok, cool15:14
d34dh0r53odyssey4me: I'll take a look15:15
odyssey4metyvm15:15
*** vnogin has quit IRC15:20
mnaserhttps://wiki.openstack.org/wiki/Meetings/openstack-ansible#Meeting_section_.22Last_week_highlights.2215:22
mnaserplease add stuff if you have things to bring up :-)15:22
openstackgerritMerged openstack/openstack-ansible stable/queens: Switch lxc_container_backing_store to default "dir"  https://review.openstack.org/57807915:23
cjloader_odyssey4me: can you possibly look at https://review.openstack.org/#/c/575504/?15:26
cjloader_or cloudnull15:27
*** kysse has quit IRC15:36
odyssey4mecjloader_: that patch is doing exactly the opposite of what we've been trying to achieve which is to *reduce* group_vars15:40
cjloader_we need it though15:40
*** koukou has quit IRC15:40
cjloader_for Ironic15:41
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible-os_blazar master: This patch ensures that the functional tests for Blazar pass.  https://review.openstack.org/57138815:42
*** throwsb1 has joined #openstack-ansible15:42
*** pcaruana has quit IRC15:42
*** kysse has joined #openstack-ansible15:42
odyssey4mecjloader_ prometheanfire there's been a *massive* amount of feedback in https://review.openstack.org/#/c/561277/ which will improve the role and make it work better.. can we expect to see a set of patches based on that feedback some time soon? Some of the feedback actually will help to resolve this particular issue15:44
*** cjloader_ has quit IRC15:45
odyssey4mecjloader_ take a look at the work Tahvok has been doing and it should provide insight into the preferred way of dealing with the requirement you have: https://review.openstack.org/#/q/topic:cleanup_vars+(status:open+OR+status:merged)15:46
*** cjloader has joined #openstack-ansible15:46
*** kysse has quit IRC15:47
odyssey4meadding more group_vars increases the memory usage by ansible and decreases the performance, and this cycle that was identified as something to work on reducing where possible15:48
prometheanfireodyssey4me: I can probably look at it today, I just don't like having to basically rewrite the role being dumped on us (even if it really needs it)15:48
*** cjloader has quit IRC15:48
*** cjloader has joined #openstack-ansible15:48
*** cjloader has quit IRC15:48
*** cjloader has joined #openstack-ansible15:49
odyssey4meprometheanfire if the role is not actively maintained, then it becomes a lot of work when a contributor wants something done in it - better to actively maintain it over time if it matters to your needs, then the technical debt is spread out and contributions can be more agile...15:49
*** gyee has joined #openstack-ansible15:50
*** chyka has joined #openstack-ansible15:52
prometheanfireodyssey4me: agreed15:52
prometheanfireI just hate to be that first person, feels like my first neutron review15:52
*** lvdombrkr89 has quit IRC15:52
TahvokDo we have a meeting today?15:53
odyssey4meprometheanfire in terms of 'dumping it on you' - I could have done it myself in considerably less time than it took to write all those comments and guidance... my hope is that you can learn from it and become a more regular contributor... and writing the patches myself doesn't help that happen15:53
*** mbuil has quit IRC15:53
prometheanfireodyssey4me: I'm not mad at you about the 'dump' I do see it as a necessary thing, just unexpected work is all15:54
prometheanfirenot happy at the situation, but now that I have more time it should be good15:54
evrardjpis there a problem?15:54
prometheanfireand as for becoming more active, my focus may be more along the lines of stable-maint15:54
odyssey4meprometheanfire: oh sure, unfortunately that's what happens when a body of code is not actively maintained - and that's an issue when the community around it is smaller15:54
prometheanfireevrardjp: no15:54
prometheanfireodyssey4me: yarp15:55
odyssey4meTahvok: yes, I think mnaser is running it... ?15:55
mnaseryes i am15:55
Tahvokevrardjp not with us today?15:55
TahvokI have only a few minutes..15:56
evrardjpTahvok: hello15:56
evrardjpTahvok: what can I do?15:56
Tahvokmnaser: maybe you can answer me here even before the meeting? https://bugs.launchpad.net/openstack-ansible/+bug/177660615:56
openstackLaunchpad bug 1776606 in openstack-ansible "qemu-kvm missing on new compute hosts" [Undecided,Incomplete]15:56
Tahvokevrardjp: just say hello :)15:56
evrardjpTahvok: hello : )15:57
mnaserevrardjp: can you please help me and run the generate bugs thing if you have time?15:57
evrardjpit's been quite a busy day for me : )15:57
evrardjpmnaser: sure15:57
mnaseri'm trying to run it and.. struggling with pyenv and all sorts of other stuff15:57
mnaserthank you so much, its a bit my fault being last minute15:57
prometheanfireodyssey4me: one thing I've thought of to simplify configuration is to just create a map/dictionary that's matched against for the table here https://docs.openstack.org/ironic/latest/admin/upgrade-to-hardware-types.html15:57
mnaserTahvok: that's interesting.  we might not be installing qemu-kvm15:58
mnaserand i guess dependencies might have changed15:58
prometheanfireodyssey4me: each row of that table seems to be a supported config, you can't mix and match things15:58
logan-mnaser: i think we'll need to revive https://review.openstack.org/#/c/557484/ in light of the packethost mtu stuff15:58
mnaserTahvok: could you push up a patch adding qemu-kvm to that list?15:58
mnasermassive highlight incoming15:59
mnasercloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, bgmccollum, darrenc, JRobinson__, colinmcnamara, thorst, adreznec, eil397,15:59
mnaserqwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking, Tahvok, mnaser, nicolasbock15:59
mnaserosa meeting in t-1m15:59
spotzwoot15:59
Tahvokmnaser: yes, I'll create a review.15:59
mnaserTahvok: wonderful, please add me to it and ping me about it :)15:59
mnaser#startmeeting openstack_ansible_meeting16:00
openstackMeeting started Tue Jun 26 16:00:05 2018 UTC and is due to finish in 60 minutes.  The chair is mnaser. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
*** hamzy has quit IRC16:00
mnaser#topic rollcall16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)"16:00
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:00
*** openstack changes topic to "rollcall (Meeting topic: openstack_ansible_meeting)"16:00
mnasero/16:00
openstackgerritLogan V proposed openstack/openstack-ansible master: Bootstrap lxc_net mtu for gate  https://review.openstack.org/55748416:00
odyssey4meprometheanfire apologies, but I'm way out of context to be able to grok what you're talking about16:00
d34dh0r53o/16:00
Tahvoko/ for 5 minutes16:00
logan-o/16:00
mnaserTahvok: anything in particular you want us to start with if you'er around for 5? :-)16:00
prometheanfireo/16:00
ansmitho/16:00
Tahvokmnaser: no, you've already answered to my question16:01
mnaserwonderful16:01
evrardjpo/16:01
TahvokThanks a lot btw..16:01
mgariepyo/ for 10-15 min16:01
mnaserthank YOU :-)16:01
mnaser#topic last week highlights16:01
*** openstack changes topic to "last week highlights (Meeting topic: openstack_ansible_meeting)"16:01
evrardjpmnaser: sorry for the delay, my venvs are busted.16:01
mnaserevrardjp: np, we have sometime16:01
mnaserso, updates on my side16:01
jmccroryo/16:01
mnaserthe big breakages removing epel have mostly been resolved16:01
mnasertransition to rdo is pretty much complete, we use it in our jobs now entirely (yay)16:01
*** sew has joined #openstack-ansible16:01
odyssey4mew00t!16:02
mnaserrdo pushed up uwsgi so distro jobs are working16:02
mnaserwhich should help hwoarang efforts in adding distro support16:02
mnaserci jobs clean up is still in progress, heba from my side has patches up for all projects to update/add openstack-ansible-role-jobs project-template to make managing those jobs easier and more centralized16:02
hwoarango/ for 10 minutes16:02
mnaseryou can follow it here https://review.openstack.org/#/q/owner:%22Heba+Naser+%253Cheba%2540vexxhost.com%253E%22+is:open (we have been looking at unbreaking roles that are breaking out of that)16:03
mnaserwe merged a whole bunch of mirrors so our jobs should be more reliable (percona being a bad one).  mariadb is wip with infra (mirrors are almost up) and that will be a big unreliable one which will be fixed :)16:03
*** gyee has quit IRC16:03
mnaseri broke the world here - https://review.openstack.org/#/c/578086/ -- so thanks to odyssey4me for fixing my mistakes :)16:03
mnasercloudnull's been fixing nspawn stuff, which is cool because we can start landing fixes in that side (another yay)16:04
mnaserand finally, packethost was having issues regarding mtu/checksumming/etc.  logan- seems to be digging into that (i totally dragged you into that one, sorry)16:04
mnaserpackethost has been disabled, so timeouts should be gone, but hopefully i think logan- was talking about reviving that16:04
cloudnullo/16:04
mnasernow that's all for my monologue, anyone else has anything exciting they're working on the past week?16:04
* cloudnull is late but here :) 16:05
odyssey4methanks muchly both mnaser and logan- for climbing into that one16:05
hwoarangwhat is packethost?16:05
mnasermostly logan-, i just did the complaining16:05
hwoarangthe cloud provider or something else?16:05
mnaserhwoarang: packethost is a baremetal company provider who we have a cloud deployed on that was recently added to infra16:05
hwoarangaha ok16:05
mnaserhttps://www.packet.net/16:05
hwoarangthanks!16:05
logan-yep we should be able to get it working with https://review.openstack.org/#/c/557484/16:06
*** Taseer has quit IRC16:06
cjloadero/16:07
logan-the uplink interface has the correct mtu from dhcp, but the bridges we build always assume 1500, so the tldr is just set the lxc_net bridge to whatever the uplink is16:07
openstackgerritAlbert Mikaelyan proposed openstack/openstack-ansible-os_nova master: Add qemu-kvm to package list for ubuntu-16.04  https://review.openstack.org/57814016:07
mnaseryeah i figured that was a reason behind why it occured16:07
Tahvokmnaser: done ^16:07
mnaserTahvok: thank you16:08
TahvokI'm out guys. Will try to move my tennis session, so I could be full hour with you next time16:08
odyssey4meyep, seems sensible to me - it'll also help people with AIO's in other environments where the MTU is slightly lower than usual (private openstack clouds, for example)16:08
*** Taseer has joined #openstack-ansible16:09
mnaserhttps://review.openstack.org/#/c/576884/316:09
mnasercan i have eyes on that, it's the patch below setting upgrade jobs to nv16:09
mnaserso that will help push it into the gate so we can unblock gates16:09
mnaser(while we wait for the bugs list to go up :p)16:09
*** udesale has quit IRC16:09
mnaserhttps://review.openstack.org/#/c/577885/3 would also be cool to prepare things for mariadb mirrors work16:10
evrardjpmnaser: the bug list is up16:10
mnasersweet, thanks evrardjp.  i'll do my homework on time next time.16:10
*** kysse has joined #openstack-ansible16:10
mnaseri'll move to bug triage but please any cores have a look at the two changes above so we can unblock our gates16:10
mnaser#topic triage16:11
*** openstack changes topic to "triage (Meeting topic: openstack_ansible_meeting)"16:11
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/177866316:11
openstackLaunchpad bug 1778663 in openstack-ansible "Pike→Queens upgrade fails on final step in run_upgrade.sh (running haproxy-install.yml)" [Undecided,New]16:11
evrardjpmnaser: it's my fault, my code isn't UTF8 ready and ^ bug causes issues in python3.16:12
mnaserhttps://github.com/openstack/openstack-ansible/blob/stable/queens/scripts/run-upgrade.sh mentioned file16:12
odyssey4meI think there's a patch for that already - hang a sec16:12
mnaseroh its missing ${UPGRADE_PLAYBOOKS}16:12
mnaserhttps://github.com/openstack/openstack-ansible/blob/stable/queens/scripts/run-upgrade.sh#L20316:12
odyssey4mehttps://review.openstack.org/56985716:13
mnaserwait no, that's not it16:13
mnaser(at my comment)16:13
odyssey4meoh, unless I'm making a broad assumption without reading :o16:13
mnaserahhhh16:13
mnaserno i think that might be it16:13
evrardjpI am not sure we should use tags there16:14
mnaserevrardjp: user seems to report that everythign worked well when they did16:14
odyssey4metags aren't essential for that, but yeah - that patch fixes it16:14
odyssey4meI can modify the commit to add the bug ref if that'd be good for everyone?16:14
evrardjphttps://github.com/openstack/openstack-ansible/commit/21739027606df272f8caff0a4b36f5d2bd82681b16:14
evrardjpodyssey4me: yeah16:15
mnaserodyssey4me: do that quickly and we'll +A16:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Upgrade task missing equals on tag  https://review.openstack.org/56985716:15
evrardjpI think that's when the upgrade started to fail. And I can definitely it's during my "experiment month"16:15
odyssey4meok, done - although as I did it there were very many votes added :p16:16
mnasercan i get another core to +A that ^16:16
* mnaser pokes spotz again16:16
mnaseror that :p16:16
mnaserok cool16:16
odyssey4medone already16:16
spotzoh sure....16:16
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/177858616:16
openstackLaunchpad bug 1778586 in openstack-ansible "aio_lxc fils on Leap 42.3" [Undecided,New]16:16
evrardjpreviewed.16:16
mnaserhmm16:17
mnaserhwoarang: any idea about the above? ^16:17
nicolasbockI vote for hwoarang :)16:17
mnaserevrardjp: do we bug you about suse stuff or not yet16:17
mnaser:P16:17
evrardjphaha. good question.16:17
nicolasbockI have the env still up and can provide more details if necessary16:18
evrardjpofc you can : )16:18
nicolasbockI can also try to debug this myself, but I need someone to hold my hand ;)16:18
odyssey4mehmm, looks like a package conflict unless I'm reading it wrong?16:18
mnaserodyssey4me: yeah that's what i see it too16:19
mnaserbut our gates are ok for opensuse right now16:19
nicolasbockYes that's how I am reading it odyssey4me16:19
mnaserso im not sure how the state changed16:19
evrardjpmaster hasn't move that much since that patch16:19
mnaserare you using any special mirrors or something16:19
nicolasbockNo16:19
mnaserno corporate reverse or transparent proxy16:19
nicolasbockI created a kvm vm and run the normal AIO stuff16:19
nicolasbockNo, no procies16:19
nicolasbockproxies16:20
mnaserok16:20
mnaseri don't really know enough about zypper and friends :(16:20
hwoarangnicolasbock: can you put some repo info on the bug?16:20
evrardjpI will run a new leap42.3 with vbox when my host is setup16:20
evrardjpI will take it16:20
nicolasbockYes hwoarang16:20
evrardjpwonder why sysstat is required though16:21
odyssey4meit's likely best for nicolasbock, evrardjp and hwoarang to partner up to figure it out to confirm and triage... perhaps we leave current bug state and move on16:21
mnasercool, shall i assign to you evrardjp ? and it's nice nicolasbock is here too so we can do some more interactive debugging after the meeting (or whenever)16:21
openstackgerritMatthew Thode proposed openstack/openstack-ansible-os_octavia stable/queens: Adds the issuer to the CAs  https://review.openstack.org/57811816:21
odyssey4me?16:21
hwoarangsure16:21
evrardjpyup16:21
mnaserodyssey4me: i agree to that, cool16:21
nicolasbockYes, sounds good16:21
evrardjpthe dream team in action16:21
odyssey4meevrardjp: did you see what I did there? ;)16:21
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/177853716:21
openstackLaunchpad bug 1778537 in openstack-ansible "LXC bridge issue with networkd on CentOS 7" [Undecided,New]16:21
nicolasbockI attached the repo info hwoarang16:21
*** tux__ has quit IRC16:22
evrardjpodyssey4me: assign more work to ppl, great!16:22
mnasercloudnull: has been doing some networkd fixes16:22
nicolasbockevrardjp, :+1:16:22
mnasercloudnull: do you think the above might already be fixed?16:22
* cloudnull reading 16:22
odyssey4mewell, in this case the person did the prep themselves - they're asking for docs of known issues, which I think is fair16:22
cloudnullthat was a new issue tux was running into16:22
odyssey4meI think tux is the reporter16:23
*** epalper has quit IRC16:23
evrardjpmaybe we should have this networkd behavior optional, and distro based16:23
cloudnullI'm not sure what the issue was in the environment. from what I can tell the networkd setup was done by hand largely following mhayden's blog post.16:23
mnasercan we say this is confirmed and assign to cloudnull or was this resolved with the recent set of patches?16:23
logan-would be interesting to see iptables-save output from the host, ip addr / networkctl status output from the container, and see if lxc-net dnsmasq is running on the host16:23
mnaseror maybe incomplete and add what logan- is asking for?16:24
logan-im thinking either dnsmasq isnt running or the nat rules is missing16:24
cloudnullthat gate seems to run fine with networkd as it stands today .16:24
evrardjpor started at a wrong point16:24
odyssey4meperhaps we need a user story which discusses prepping the hosts with networkd config and shares the things that need knowing?16:24
evrardjpcloudnull: well we don't test what all deployers do -- rebooting things16:24
cloudnullso im not certain there's anything specifically wrong with networkd and centos16:25
mnaserthat's a good point odyssey4me16:25
evrardjpcloudnull: that's a gap in our testing we could cover in the future16:25
cloudnullin tux's case it wasn't working at all, nevermind a reboot.16:25
evrardjpodyssey4me: I am fine with the user story16:25
mnaseri dont think any other deployment tool tests rebooting things so we have other fun things to catch up on before that :P16:25
evrardjpbecause that's not part of the "osa" deploy itself16:25
cloudnullit was something off with lxcbr0 and NAT16:26
odyssey4mecloudnull: would you be up for writing up at least the skeleton of a user story given the networkd experience - I'm happy to make it pretty and have spotz make it prettier16:26
logan-yeah ive seen issues with dnsmasq not starting/restarting properly on eni->networkd conversions in lxc_hosts, but never issues on greenfield, so it seems like this will need some more diag16:26
cloudnullodyssey4me sure.16:26
evrardjplogan-: agreed with you16:26
spotzhehe16:26
evrardjpit's not the first one.16:26
cloudnullI have some tools running in the lab with an all networkd setup16:26
odyssey4meok, so assign to cloudnull for now - I'd say low but confirmed16:27
cloudnulli can doc that16:27
cloudnull++16:27
mnaseryay so given the resolution for this is 'soft notes', can i assign to cloudnull ?16:27
mnasercool16:27
evrardjpyeah sounds nice16:27
mnaserdone!16:27
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/177846316:27
openstackLaunchpad bug 1778463 in openstack-ansible "[magnum][pike] Image upload in playbook does not work" [Undecided,New]16:27
mnaserahhhhhhhhh16:27
mnaseri remember this16:27
mnaseri pushed up a patch16:27
*** cshen has joined #openstack-ansible16:27
evrardjpok great16:27
evrardjpthat sounds an easy fix16:28
mnaserlet me find it16:28
mnaserhttps://review.openstack.org/#/c/543256/16:28
openstackgerritMohammed Naser proposed openstack/openstack-ansible stable/queens: Run openstack_openrc before Magnum installation  https://review.openstack.org/57814716:28
mnaserbackport to stable/queens16:28
odyssey4mealrighty, so note the link to the change and assign to you?16:29
openstackgerritMohammed Naser proposed openstack/openstack-ansible stable/queens: Run openstack_openrc before Magnum installation  https://review.openstack.org/57814716:29
mnaserodyssey4me: if you don't mind i added a closes-bug16:29
mnaserill take the +2 back and yep assigned to me16:30
evrardjpfor the last part: https://github.com/openstack/openstack-ansible/blob/feef46a4b4af249fd3d2a48d1fad9f248d9b82e8/playbooks/os-keystone-install.yml#L22-L2916:30
mnaserjuggling workflows lol16:30
evrardjpodyssey4me: did you finish https://github.com/openstack/openstack-ansible/commit/d8fcd1ae5378ab623b4ca02d10037514dba97e03 ?16:30
evrardjpapplying to magnum too16:30
odyssey4mesure, although I don't think jeepyb will do things to the ticker given that the review is targeted to stable/queens16:30
odyssey4meit would do things to the bug if there was a series assignment, but OSA hasn't used those since newton IIRC16:31
spotzodyssey4me: Ok that made no sense to me:)16:31
spotzthe one before newton about the ticker16:31
mnaserhmm i see16:31
evrardjpodyssey4me: nevermind it's defaulted16:31
mnaserare we good on this one?16:32
evrardjpwith backports yes.16:32
odyssey4meevrardjp: not just yet - need to figure out how to get https://review.openstack.org/568142 fixed up - then will do other roles16:32
mnasercools16:32
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/177841216:32
openstackLaunchpad bug 1778412 in openstack-ansible "Create OpenStack-Ansible requirement wheels" [Undecided,New]16:32
odyssey4mespotz: will explain after16:32
spotzodyssey4me: thanks16:33
mnaseruser says16:33
mnaser"Please close this one, i think i don't have permission to close."16:33
evrardjpwill check if that's a real dupe16:33
odyssey4meyay, free bug close points16:33
mnaserlooks like that was related to mismatching libvirt16:33
mnaserwhich is something we've already resolved moving forward16:33
evrardjpyay16:33
mnaserwhat do we put as cancelled16:34
mnaserinvalid?16:34
prometheanfirewe've been looking at updating the requirement for libvirt-python on stable releases16:34
evrardjpmnaser: it's a real duplicate16:34
evrardjpmnaser: so clicking on top right16:34
mnaseroh mark as dup16:34
evrardjpthen 173031416:34
prometheanfiredistros seem to update libvirt not like other packages (which they pin more or less)16:34
odyssey4mehmm, I *think* we got this figured out16:34
evrardjpthen save16:34
*** kysse has quit IRC16:34
odyssey4memy memory is rusty16:34
evrardjpodyssey4me: ?16:35
odyssey4meIIRC this was a CentOS issue, and we resolved this by switching to symlinking the host libvirt-pyton into the venv, right?16:35
mnaserprometheanfire: yeah afaik centos just ignores what the constraints say..16:35
evrardjpwe are marking it as duplicate16:35
mnasertheir comment: "most of our team builds libvirt, we know what we're doing" *shrugs*16:35
odyssey4methis was the whole issue around centos using a different libvirt to everyone else16:35
mnaserBug 1730314 is already a duplicate of bug 1636567. You can only mark a bug report as duplicate of one that isn't a duplicate itself.16:36
openstackbug 1636567 in openstack-ansible "duplicate for #1730314 devstack mitaka installation fails with error "Running setup.py bdist_wheel for libvirt-python: finished with status 'error'" in Ubuntu 16.10" [High,Confirmed] https://launchpad.net/bugs/163656716:36
openstackbug 1636567 in openstack-ansible "devstack mitaka installation fails with error "Running setup.py bdist_wheel for libvirt-python: finished with status 'error'" in Ubuntu 16.10" [High,Confirmed] https://launchpad.net/bugs/163656716:36
*** kysse has joined #openstack-ansible16:36
odyssey4mehaha16:36
evrardjpmnaser: yeah you might have to track : )16:36
mnaserdependency solving yay16:36
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/177809816:36
openstackLaunchpad bug 1778098 in openstack-ansible "os_horizon role fails if horizon_custom_themes is specified" [Undecided,New]16:36
prometheanfiremnaser: yep, it was a cent issue16:36
mnaserit looks like we somehow already have a fix for this16:37
mnaserhmm this is weird16:37
mnaserso if you configure a theme, it expects it to be uploaded16:38
evrardjpthat is documented16:38
mnasero16:38
evrardjpjust a sec16:38
mnasercool16:38
evrardjpyeah the docs is bad16:39
evrardjphttps://docs.openstack.org/openstack-ansible-os_horizon/latest/16:39
evrardjpin default16:39
evrardjpit should be a more explicit thing16:39
*** sew has quit IRC16:39
evrardjpspotz: could you deal with this?16:39
spotzevrardjp: yeah16:39
prometheanfirewould updating the constraint in requrements help?16:40
evrardjpbasically writing a story about how to use a custom theme16:40
evrardjpit should be based on https://docs.openstack.org/openstack-ansible-os_horizon/latest/ default's explanation, mixed with the user's input of the bug above16:40
evrardjpexplaining another variable is required16:40
evrardjpit can be done in two steps: changing the defaults/main.yml to be more explicit, but also adding a complete user story16:40
evrardjpcool thanks16:41
mnaserspotz: are you cool with taking this on? :p16:42
odyssey4meapologies - took a little while to track down the patches which solved https://launchpad.net/bugs/163656716:42
openstackLaunchpad bug 1636567 in openstack-ansible "devstack mitaka installation fails with error "Running setup.py bdist_wheel for libvirt-python: finished with status 'error'" in Ubuntu 16.10" [High,Fix released] - Assigned to Jesse Pretorius (jesse-pretorius)16:42
spotzmnaser: Yeah, you know me I'll ask questions:)16:42
*** sew has joined #openstack-ansible16:42
mnaser++16:42
mnaserspotz: marking as confirmed, low and assigning to you :)16:43
spotzmnaser: okie:)16:43
mnaserlast one16:43
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/177808516:43
openstackLaunchpad bug 1778085 in openstack-ansible "Horizon health check fails when developer panels enabled" [Undecided,New]16:43
mnaserooou a regression perhaps16:44
evrardjphahah I KNEW it.16:44
evrardjpI suggest we assign that to cloudnull who did the first patch with the renames :p16:45
mnaserthe workaround/fix seems relatively reasonable16:45
odyssey4melol16:45
mnaseris that an ok fix?16:45
evrardjpmnaser: yes16:45
mnaserif it is, it's a matter of just pushing the patch16:45
odyssey4meman, those were done in mitaka - I'm surprised it's taken this long to surface16:45
cloudnullhttps://review.openstack.org/#/c/573318/16:45
cloudnullmaybe that helps?16:45
evrardjpdamn you really want to install elasticsearch pip package everywhere16:46
jrossercloudnull: that exposes the bug16:46
mnaseri wonder why that wasn't caught in ci16:47
evrardjpmnaser: different config : )16:47
odyssey4meI must say, installing the elasticsearch package everywhere by default makes me uncomfortable - no matter how useful it is, especially because the version override's also being done16:47
jrosseris it intalled by default?16:48
jrosser*installed16:48
evrardjpthat way it will.16:48
odyssey4meI'd really that was more of an opt-in, personally... but the operators should really be chiming in.16:48
mnaserif it doesn't hurt, i can't imagine it being too much of an issue.  the long term resolution would be adding some sort of opt-in thing16:48
evrardjpmnaser: it can hurt for packagers16:48
mnaserbut i dont want to burden contributions that don't hurt things personally16:48
mnasersure, that's why it can be opt in and supported in certain types of deployment16:49
odyssey4mehttps://review.openstack.org/#/q/topic:osprofiler+(status:open+OR+status:merged) looks to me like it went with adding by default, not opt-in16:49
evrardjpmnaser: I agree there.16:49
evrardjpodyssey4me: I asked for opt-in.16:49
cloudnullevrardjp https://review.openstack.org/#/c/573318/10/defaults/main.yml - that package is required16:49
evrardjpI didn't -2.16:49
mnaserwe don't have a huge team and we shouldn't start being super strict about these things that do "good" things at the end of teh day16:49
odyssey4mesure16:49
cloudnullthe driver we added is for elk,16:49
evrardjpcloudnull: ok I will -2 it then.16:50
cloudnullwithout it it wont do anything16:50
odyssey4meis it time that we have a generic 'I want these extra packages in every venv' variable that's used in all roles?16:50
evrardjpI am sad we arrive to that place16:50
evrardjpopt-in was the deal16:50
evrardjpthat's no opt-in16:50
cloudnullit has to be there for horizon16:50
jrossererr https://review.openstack.org/#/c/573526/3/defaults/main.yml what am i missing?16:50
mnaserok16:50
mnaseri'll ask that we take a step back first16:50
jrosseri thought those osprofiler patches all got changed to remove the elasticsearch pip install16:50
mnasercan someone push `horizon_server_name` change first16:51
mnaserwhich is for https://bugs.launchpad.net/openstack-ansible/+bug/177808516:51
openstackLaunchpad bug 1778085 in openstack-ansible "Horizon health check fails when developer panels enabled" [Undecided,New]16:51
evrardjpjrosser: same. Which was okay for me16:51
odyssey4memnaser: well, the reporter asked if that was a suitable fix - we can simply respond affirmatively16:51
cloudnullit did. all other roles are not adding the elasticsearch plugin.16:51
mnaserodyssey4me: ill push it up quickly :)16:51
odyssey4meperhaps the reporter will submit the patch, and I think we should provide that opportunity16:52
cloudnullhowever the driver we built for horizon is elasticsearch specific16:52
stuartgr1I reported the bug, I can submit a patch16:52
evrardjpcloudnull: I'd prefer if we write a user story about how this gets done. Because the implications are bigger than what you see.16:52
odyssey4melet's leave it as a new bug (so it's discussed again next week), but respond to the reporter16:52
odyssey4meah, and there we have stuartgr1 :)16:52
cloudnullevrardjp I'd love to know more about what those implications are?16:52
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_horizon master: Switch to using ansible_fqdn in horizon_server_name  https://review.openstack.org/57815116:53
mnaserodyssey4me: oops16:53
mnasersorry16:53
mnasersorry stuartgr1 :<16:53
odyssey4memnaser abandon :) let stuartgr1 go ahead16:53
evrardjpodyssey4me: that's a good idea16:53
evrardjpcloudnull: ofc16:53
mnaserstuartgr1: it's all yours :)16:53
stuartgr1ok, thanks16:53
mnaserplease let me know if you need help submitting the patch16:53
odyssey4mestuartgr1 thanks for asking in the bug, very often just pushing up a review with the bug reference would stimulate a faster response :)16:54
mnaser#topic open discussion16:54
*** openstack changes topic to "open discussion (Meeting topic: openstack_ansible_meeting)"16:54
mnaserodyssey4me: ++16:54
mnaserdo we want to discuss the issue regarding elasticsearch in os_horizon16:54
mnaserit looks like cloudnull agreed to drop it in all venvs except for horizon where it seems to be a requirement16:54
prometheanfirethe ironic role needs to be overhauled16:54
odyssey4meevrardjp cloudnull if we're ok with going with elasticsearch as the 'opinionated' way of doing profiling, then no opt-in is fine... adding opt-in sometimes adds more code for little benefit16:55
mnaseri think cloudnull did a fairly ok compromise by dropping it but having it in one role isn't that huge of a deal. :x16:55
mnaserprometheanfire: what type of work does it need right now?16:55
odyssey4mewell, fine IMO :)16:55
prometheanfireit's mainly in the hardware type stuff https://docs.openstack.org/ironic/latest/admin/upgrade-to-hardware-types.html16:55
prometheanfiremy first pass was at https://review.openstack.org/#/c/561277/16:55
mnaserwow that's a big document16:56
mnaserlol16:56
prometheanfiremy idea was to turn each classic driver into a key, with a list containing the rest of the values (hardware type, boot, deploy, inspect, management, power) as the value16:56
evrardjpodyssey4me: I disagree with you on the elasticsearch part, even if opinionated.16:56
odyssey4memuch of the overhaul is provided in detail in that review and has nothing to do with the hardware/ironic changes - it's just role code style and simplification to make maint easier16:56
cjloader+1 prometheanfire ironic role does need overhauled16:57
mnaserodyssey4me: do we feel like that's an extra thing that prometheanfire has to deal with16:57
mnaseras in: does it block his work? :x16:57
odyssey4methe ironic role as it stands today is a mitaka implementation which was overly complex and has had no maint except that which was required16:57
prometheanfireodyssey4me: sure, I was mainly seeking clarification about my plan to use that key/value(list) method for setting the keys16:57
prometheanfiremnaser: I'm more or less the 'ironic guy' here :P16:58
mnaseri'm all for improving things but it would be a bummer if prometheanfire gets stuck with having to clean it all up just to land their patch16:58
mnaser(i know we'll be over time, but it seems like we got some stuff to clear out)16:58
odyssey4meprometheanfire: yep, I think using a key:value mechanism was the suggested approach - following what's been done in nova/neutron/etc16:58
prometheanfiremnaser: there is that, but I'm willing to do the work16:58
mnaseroh cool, i'm happy to hear that16:58
prometheanfireodyssey4me: cool, that's the main guidance I was looking for16:58
mnaseri'm happy to help with reviews.16:58
odyssey4memnaser: unfortunately the role has reached a state where it can't pass tests, so it needs the overhaul to even get a pass16:59
mnaserodyssey4me: ugh, that's a bit of a bummer16:59
mnaseri can have a look and hack on a thing or two, but that would be on personal time (probably weekends)16:59
evrardjpfor the elasticsearch profiling, I think it's a very good user story, and we should explain how it's done anyway. We just give an extra override for horizon. Until it's made opt-in in the role and needs a simple boolean flip16:59
odyssey4meoverhauling the structure first, then implementing the deprecation changes would be a good approach - so that the overhauls can be back ported16:59
evrardjpthat would be nice17:00
evrardjpbut hard to do17:00
evrardjpoverhauling backport is something we need to accept as a community too17:00
mnaserso hear me out here17:00
odyssey4meprometheanfire: I'd even suggest disabling voting for the functional testing for the overhaul parts, then building up a chain of patches which does the overhaul in small bits and the updating last which includes turnig voting back on.17:00
mnaserdo we really need to backport the overhauls17:00
evrardjpno17:00
mnaserif it wasn't working in old releases, do we expect users to show up now and use it17:00
evrardjpthat's what I meant as "accept as a community too"17:01
mnasermaybe that can reduce the workload on prometheanfire (at the expense of a new user who tries to deploy newton ironic and that not working)17:01
odyssey4memnaser in order to enable back porting other work to make ironic work in queens/pike/etc, yes - right now the role is unmaintainable17:01
evrardjpI think we don't have to actively backport it.17:01
prometheanfireodyssey4me: it's depricated in queens, not rocky17:01
prometheanfireso the change over has to be backported17:01
mnaseroh i see17:01
prometheanfireat least that's what I've seen, I probably need to reconfirm that17:01
mnaserthis is a tough one.  i think we just have to do the hard/tough job of working on fixing that17:02
prometheanfiremnaser: yep17:02
evrardjpyup it seems to17:02
odyssey4memnaser: specifically newton/pike/queens onwards matters to RAX... newton is fine as far as I know, pike+ is broken17:02
prometheanfirethe good part about it being unmaintianed is that it should be easier to backport :P17:02
prometheanfirepike was fine17:02
evrardjpodyssey4me: prometheanfire mnaser I think that's the important part17:02
prometheanfirequeens works with cjloader's patches17:02
evrardjpif it's important for RAX, as member of the community, it can then bring the patches17:03
cjloaderI can help prometheanfire with the overhaul17:03
evrardjpwe'll vote for it, as any member of the community17:03
odyssey4meprometheanfire: ok, that's good news17:03
mnaseri know this might be unrelated but17:03
mnaseri hate asking this but prometheanfire are you currently with rax?17:03
evrardjpthat's great to see ppl at rax contributing to ironic : )17:03
prometheanfireI'm done with the topic unless others have questions17:03
prometheanfiremnaser: yarp17:03
evrardjpor at least os_ironic : )17:03
mnaserok cool!17:04
evrardjpcjloader: great17:04
mnaserso the backport best interest is in yours too17:04
mnaserdidnt want to have a load on you for something that you don't necessarily need :P17:04
mnasernow17:04
mnaserone more topic17:04
ansmithgood progress on qdrouterd role, looking to land base job if someone can take a look, https://review.openstack.org/#/c/575505/17:04
mnaseri see a happy xenial job, yay17:04
openstackgerritMerged openstack/openstack-ansible-tests master: Add repo_build pip cache  https://review.openstack.org/57688417:04
odyssey4meprometheanfire thanks for taking it on, and apologies for the burden, but trying to review any patches to ironic is a minefield and the overhaul will resolve that17:05
mnaseri'll have a look shortly.17:05
ansmithmnaser: thanks!17:05
mnaserelasticsearch and horizon.  i think cloudnull made an appropriate comprimise in dropping it from all roles17:05
evrardjpmnaser: odyssey4me we don't need a happy xenial job for this17:05
mnaserexcept horizon which it does not seem to be possible17:05
evrardjpansmith: *17:05
prometheanfireodyssey4me: si17:05
mnaseri don't think it's something that warrants a -2 at this point17:05
evrardjpmnaser: I see it as an obstacle for some deployers. We don't want to have obstacles :)17:06
mnaserwe're not in a state where we have full time contributors that we can ask for overhauls and adding opt-in systems for a contribution that is largely more of a part-time thing17:06
odyssey4meprometheanfire feel free to ping me if you're stuck, I'm happy to partner up to get it to a better place17:06
mnaseri don't see how it is an obstacle, an extra library in a venv17:06
mnaser(with my deployer hat on, i don't even KNOW what libraries go in the venv)17:06
mnaserif it works, it works17:06
cjloaderprometheanfire: same, I'd be happy to help17:06
cloudnullevrardjp what obstacle?17:07
evrardjpmnaser: it could be licensing.17:07
cloudnullits already part of global requirements17:07
cloudnullthere is no licensing17:07
evrardjpcloudnull: I have noted my comments on the bug17:07
prometheanfireodyssey4me: sure :D17:07
mnaserif its part of global requirements then it cant have license problems.  it's also apache-2.0 licensed so it's okay17:07
cloudnull^17:08
openstackgerritMerged openstack/openstack-ansible-tests master: Switch upgrade jobs to be non-voting  https://review.openstack.org/57788417:08
mnasera -2 of a core is kindof an effective veto of "i will refuse to merge this"17:08
mnasernot "i disagree with it"17:08
cloudnullif this is the stance we're going to take then we need to do a significant audit of the packages we install in the venvs.17:08
evrardjpcloudnull: I think we should do it indeed.17:09
odyssey4memy concern is more around us overriding the version - putting us out of sync with g-r/u-c... but if the project's contributors are happy to take the risk that come with that, it's fine to me17:09
cloudnullwe should also probably emove things like NFS from glance, and non-reference drivers from neutron.17:09
evrardjpcloudnull: this work of cleanup was already started this cycle17:09
mnaserwell, doing that in theory sure sounds like adding more pain for operators..17:09
evrardjpwe said we're gonna for new features next cycles, and clean this cycle. This doesn't seem aligned either17:09
mnaserthings happen.  resources disappear.  times disappears.17:09
mnaserwe've discussed this, we aren't all full time anymore so we have to understand that we need to operate in a different way17:10
mnaserthis can be handled differently if we all work full time on OSA, very easy to dedicate the time to clear it all out17:10
evrardjpcloudnull: I will work on removing the non-reference drivers. That's sadly what I will have to do I think.17:10
mnaserbut given a lot of us are doing this 'on the side', we need to be a bit more flexible to help continue the project to progress17:10
evrardjpmnaser: I think you're right on the flexibility17:10
mnaserworking the non reference driver makes me sad because we have users like OPNFV which uses ODL to test things17:10
odyssey4mewell, perhaps we need to be more opinionated17:10
mnaserand i was going to start pushing up some work to support opencontrail as an optoin17:11
evrardjpmnaser: but here, there is nothing that can't be done with a user story17:11
odyssey4mewe carry a very flexible framework, but more options means more work to maintain it17:11
mnaserbecause of customer demand17:11
cloudnullevrardjp I think removing the non-reference drivers would be a waist of time, on top of the fact it'd be detrimental for adoption.17:11
mnaserodyssey4me: thing is, we don't have to test and support them all.  we can still test the base scenario, but let's not take away the out-of-the-box experience17:11
mnaserOPNFV folks *love* OSA and use it for all their deployments, we'd hurt them if we took away this stuff.17:11
odyssey4mewe ideally need to try and implement facilities instead of specific things, as that means you get the basics and can plug other things in17:11
cloudnullwhat mnaser said,17:12
evrardjpcloudnull: it has a dobule effect: For me it shows the aptitude of having 3rd party extensions that can be written by everyone17:12
evrardjpmnaser: don't get me wrong, I don't want these to be removed17:12
mnaseri just want us to scope back and look at the specific problem here which is: installing elasticsearch in the horizon venv.17:12
logan-most if not all non reference drivers are installed optionally so its not an apples to apples comparison17:12
evrardjpI want to make sure it's part of a way to behave with 3rd party ways if necessary17:12
odyssey4meI mean for this specific case, wouldn't it be better to be able to set a flag to enable profiling, and have a var which sets which packages you want added to the venv? Instead of a hard-cded set of packages which you then have to remove if you don't want that thing?17:13
evrardjpagreed with logan- too  : p17:13
evrardjpodyssey4me: agreed with you too.17:13
d34dh0r53odyssey4me: ++, that's what I was thinking17:13
mnaserodyssey4me: i think evrardjp is ok with this, i'm just trying to not add extra workload on someone whos adding a productive useful change for 'optimizing'17:13
evrardjpI think we should have a profiling variable that can be flipped in group vars if necessary17:13
mnaserkinda like "Hey i showed up to help with this thing but instead ended up with a giant load of extra optimizations and requests"17:14
mnaserwhich again, totally cool if we're full time, but we're not, and so by doing that, that feature might just never land.17:14
evrardjpwell do you prefer land a hurtful feature for some ppl, helping some others, OR not merging?17:14
odyssey4meblast - I typed a bunch and pushed a bad key and lost it all17:15
evrardjpI'd prefer the patch to be okay for everyone17:15
cloudnullevrardjp what is this hurting ?17:15
mnaserdont see how it's hurtful17:15
cloudnullodyssey4me i hate it when i do that :)17:15
mnaserit's even part of openstack requirements so packagers won't have too bad of a time17:15
mnaserodyssey4me: so frustrating makes you even give up having to rewrite things sometimes lol17:15
odyssey4mebasically I suggest a more generic facility for each role - something like neutron_extra_optional_packages17:16
odyssey4methat can then be re-used for *anything* a deployer wants without having to override the ddefault package list as they have to today17:16
evrardjpthat's exactly what I suggested odyssey4me17:16
mnaserodyssey4me: i agree, but who's gonna do that work...17:16
mnasercloudnull: do you mind posting this on the ML so that we can have a discussion where we can kinda think about stuff and formulate answers17:17
*** tux_ has joined #openstack-ansible17:17
logan-it doesn't have to be implemented everywhere at once. just implement it in horizon for know so the pattern is established and can be implemented elsewhere as needed17:17
logan-for now*17:17
mnaserjust to kinda say "hey operators, what do you think about having elasticsearch in here"17:17
odyssey4meit'd be massively easier to do after moving to using the common venv build role, and I can implement something like that as a follow on - but there're no guarantees that'll make the Rocky release17:17
mnaserand "hey cores, what are your thoughts about that?"17:17
d34dh0r53odyssey4me: I can help implementing it17:18
logan-it basically already exists here: https://github.com/openstack/ansible-hardening/blob/1fd694a40c4d4013a2d407f043df99f3fc0e9e47/vars/redhat.yml#L63-L6917:18
cloudnullodyssey4me I added a way to inject any such package into the venv create and repo build role - https://review.openstack.org/#/c/574544/  https://review.openstack.org/#/c/574546/17:18
odyssey4mefor now it'd be a bit of a slog, but an easy common pattern17:18
logan-except for distro packages. but that pattern could be easily adopted for extra pip packages17:18
d34dh0r53I'm about to knock two things off my plate this week so I'll have some cycles17:18
mnaseroh that's awesome17:19
odyssey4mecloudnull: hmm, lemme look at those - that could be a good interim solution17:20
*** gyee has joined #openstack-ansible17:20
odyssey4meI'm not fond of taking intelligence out of the roles again, but if we can implement something that keeps it in the roles and uses another facility then that's cool17:20
odyssey4meor at least is easy to transition later17:20
mnaserok so conclusion to this: cloudnull maybe post to ML to discuss this, d34dh0r53 to help add 'opt-in' pattern?17:20
cloudnullhowever with horizon, because the config exists in python, if the lib does not exist and osprofiler is enabled, horizon breaks in terrible, cryptic ways.17:20
cloudnullso I guess we could cause it to fail if the lib is not found in the venv and elasticsearch is present in the connection string?17:21
evrardjpcloudnull: nothing a doc can't fix, as we need a doc anyway17:21
tux_cloudnull: hey you back!!! how do i run try ansible on openstack ?17:21
tux_i want to make changes and see if its going to right place using dry tun17:22
tux_run*17:22
odyssey4meI'm happy to look at that horizon review more closely when I have a fresh head. Right now it's the end of the day.17:22
mnasertux_: we're in the middle of a meeting, should be able to talk soon about that :)17:22
tux_:) enjoy! sorry17:22
odyssey4meI suspect we can find a happy medium17:22
mnaser++17:22
odyssey4mewhat's the review again?17:22
mnaserhttps://review.openstack.org/#/c/573318/17:22
mnaserprimarily https://review.openstack.org/#/c/573318/10/defaults/main.yml17:23
cloudnullevrardjp a doc can't fix this issue.17:23
cloudnullthe lib has to be present at venv buld time.17:23
mnaserfwiw all other projects got 'osprofiler' except this one is the one 'odd' case which i'm okay with making an exception17:23
cloudnullwe dont run pip install when the venv is available on teh repo server.17:23
odyssey4mecloudnull at a glance, could we have something like an 'optional' set of packages (much like neutron does) which puts those packages there at runtime if that option is enabled?17:24
evrardjpcloudnull: that can be in /etc/openstack_deploy like all the rest of the user_variables.17:24
cloudnullevrardjp so the user has to override the entire package list /17:24
mnasercan we please move this to a mailing list discussion, as i think it's more productive there?17:24
evrardjpomg that could be fixed by using a temp variables in vars/17:24
evrardjpthat's nothing17:24
mnaseri'd like to wrap up the meeting17:25
evrardjpconvenience has an end17:25
cloudnullodyssey4me yes. though that's a lot of extra tasks to accomplish something extreamly simple, with no known impact.17:25
prometheanfireI'd like to eat17:25
mnaserplease? :)17:25
evrardjpyeah17:25
evrardjpthanks for chairing17:25
mnaserif not, i'll post a message17:25
mnaserquoting the meeting17:25
cloudnullmnaser sure.17:25
mnaserand people can read17:25
mnaseryay17:25
mnaserthanks17:25
mnaserthat's much better17:25
evrardjphave a good day.17:25
mnaserTHANK YOU EVERYONE :)17:25
mnaser#endmeeting17:26
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://goo.gl/tTmdgs"17:26
openstackMeeting ended Tue Jun 26 17:26:00 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:26
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-06-26-16.00.html17:26
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-06-26-16.00.txt17:26
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-06-26-16.00.log.html17:26
mnaserprometheanfire: enjoy your meal17:26
prometheanfire:D17:26
*** vurtz has joined #openstack-ansible17:39
*** hamzy has joined #openstack-ansible17:50
openstackgerritDavid Wilde proposed openstack/openstack-ansible-ops master: Improve multi-node AIO robustness  https://review.openstack.org/57816217:52
*** electrofelix has quit IRC17:52
*** cjloader_ has joined #openstack-ansible17:54
*** cjloader has quit IRC17:54
*** cjloader_ has quit IRC17:54
*** cjloader has joined #openstack-ansible17:54
*** cshen has quit IRC17:56
*** cjloader has quit IRC18:01
*** cjloader has joined #openstack-ansible18:05
*** cjloader has quit IRC18:05
*** cjloader has joined #openstack-ansible18:05
*** poopcat has joined #openstack-ansible18:07
*** chhavi__ has quit IRC18:37
*** sew has quit IRC18:49
*** sew has joined #openstack-ansible18:54
*** cshen has joined #openstack-ansible18:59
*** yolanda__ has joined #openstack-ansible19:04
*** yolanda_ has quit IRC19:07
*** yolanda_ has joined #openstack-ansible19:09
*** sew has quit IRC19:09
*** yolanda__ has quit IRC19:12
*** vnogin has joined #openstack-ansible19:13
d34dh0r53odyssey4me: I reviewed your patches, I -1'd one of them as I addressed that with my patch, but I'll need to rebase once everything merges19:13
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Run each setup playbook individually  https://review.openstack.org/57803519:14
d34dh0r53cloudnull: ^ fyi19:14
*** yolanda__ has joined #openstack-ansible19:15
*** yolanda_ has quit IRC19:18
*** dxiri has quit IRC19:22
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Use package module properly  https://review.openstack.org/57803619:23
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Set tftp/pxe directory permissions using file module  https://review.openstack.org/57803719:23
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Ensure a consistent and readable style  https://review.openstack.org/57804319:23
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Enable saving and re-using file-based backing images  https://review.openstack.org/57804719:23
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Correct Mac OS X instructions for virt-manager  https://review.openstack.org/57805319:23
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Disable SSH key checks on host  https://review.openstack.org/57805919:23
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Check capabilities only once  https://review.openstack.org/57806019:23
openstackgerritMatthew Thode proposed openstack/openstack-ansible-os_octavia stable/queens: Adds the issuer to the CAs  https://review.openstack.org/57811819:35
*** vnogin has quit IRC19:35
*** hachi has quit IRC19:39
d34dh0r53damnit zuul19:54
*** zul has joined #openstack-ansible19:56
*** sew has joined #openstack-ansible20:02
*** dxiri has joined #openstack-ansible20:05
openstackgerritMerged openstack/openstack-ansible stable/queens: Upgrade task missing equals on tag  https://review.openstack.org/56985720:17
*** tux_ has quit IRC20:39
*** ansmith has quit IRC20:41
*** hamzy has quit IRC20:47
tomtom001Getting the following error when trying to run the octavia playbook for queens (http://paste.openstack.org/show/724340/) anyone had similar issue or know what it means?20:48
*** FrankZhang has quit IRC20:50
*** tux_ has joined #openstack-ansible20:54
ivvecloudnull: you around?21:00
*** zul has quit IRC21:02
cloudnullivve kinda , whats up ?21:09
cloudnulltomtom001 -cc xgerman_ ?21:09
xgerman_what’s up?21:09
cloudnullivve did you get the keepalived things working?21:10
cloudnullxgerman_ "Getting the following error when trying to run the octavia playbook for queens (http://paste.openstack.org/show/724340/) anyone had similar issue or know what it means?"21:10
xgerman_the system is trying to set up iptables rules — I think I configured it to ignore that error since I found it always erroring but still doing what I wanted21:11
ivvecloudnull: aye some improvements21:11
ivvecloudnull: keepalived doing its job properly now on hosts21:12
cloudnullthat's good!21:12
cloudnullbut?21:12
*** yolanda_ has joined #openstack-ansible21:12
ivveim not sure garps are being sent from ha routers properly21:12
ivvethere used to be a setting in l3_agent.ini21:13
xgerman_yeah, also which step was that. Scrolling at the end “No first item, sequence was empty.” wpuldn’t be the error I expect with iptables21:13
ivveperhaps thats the issue at hand21:13
cloudnullso its better with 3.2+ but still kinda broken.21:13
ivvewell its possible changes have to be done21:13
cloudnullis there an option we could set ?21:13
ivvei.e paths to binaries must be absolute21:14
ivveso ping and kill is used21:14
cloudnull?21:14
*** yolanda__ has quit IRC21:14
cloudnullis something in neutron itself ?21:14
ivvekeepalived21:14
cloudnulllike an override to the ping / kill binary ?21:14
cloudnulls/override/option/21:15
ivveit uses scripts21:15
xgerman_tomtom001: I need to know more. Octavia uses some heuristics to “guess” network settings - if they differ in your env. you will need to set them explicitly21:15
ivvevrrp_script21:15
cloudnullok. is there an interface we can use to customize that to make it better for l3+ha?21:15
ivvesend_arp_for_ha21:18
cloudnullit looks like neutron generates its own scripts https://github.com/openstack/neutron/blob/master/neutron/agent/linux/keepalived.py#L557-L56621:18
ivvethis was used during 16.0.0 neutron21:18
ivveyes for keepalived in neutron agents it configures its own21:19
ivvethose seem fine, apart from sending garps i think, possible due to this option. im going to test it out now21:19
ivvehttps://docs.openstack.org/ocata/config-reference/networking/samples/l3_agent.ini.html21:19
cloudnullhttps://docs.openstack.org/releasenotes/neutron/pike.html#upgrade-notes21:20
cloudnulllooks like that option was deprecated21:20
tomtom001xgerman_ ok I've setup in defaults/main.yml in octavia role the neutron defined network that octavia should use to contact the amphora instances.  What specifics do you need?21:21
cloudnullivve looks like deprecated in ocata https://docs.openstack.org/releasenotes/neutron/ocata.html#deprecation-notes21:21
cloudnullseems it arps whenever a new float is created ...21:21
*** FrankZhang has joined #openstack-ansible21:21
tomtom001xgerman_ I also installed openstack and saved the octavia for a later step in installation because it was asking for a network in neutron that doesn't exist in pre-install or during install.21:22
*** cshen has quit IRC21:22
xgerman_ok, here are all the network settings: https://github.com/openstack/openstack-ansible-os_octavia/blob/master/defaults/main.yml#L292-L31921:22
*** jwitko_ has joined #openstack-ansible21:22
xgerman_it will also create a neutron network by itself21:22
tomtom001xgerman_ oh I see, let me try and let it do that.21:23
xgerman_I think this setting goes sideways for you: https://github.com/openstack/openstack-ansible-os_octavia/blob/master/defaults/main.yml#L31221:23
xgerman_in a lot of cases we just set that directly…21:24
ivvecloudnull: i think i need more testing.. i had some issues with services possibly not restarted properly and in the right order. i restarted the entire environment recently21:25
*** jwitko has quit IRC21:26
ivvemoving around FLIPs is no issue21:26
tomtom001Yeah so: "msg": "(400) Client Error for url: http://10.80.20.24:9696/v2.0/networks.json Invalid input for operation: physical_network 'Octavia-Provider' unknown for VLAN provider network."21:27
*** jwitko_ has quit IRC21:27
tomtom001xgerman_ I was creating that in neutron first because I got the above error when trying to let octavia playbook do it.21:27
xgerman_yes, it will trying to guess the provider network by assuming you named the provider network (not the neutron one) lbaas-mgmt21:28
*** FrankZhang_ has joined #openstack-ansible21:29
xgerman_and it then reads the list of provider networks which have been added to ovs/linux-bridge21:29
tomtom001For the octavia_provider_network do you set the Name as shown?  http://paste.openstack.org/show/724341/21:30
tomtom001xgerman_ so the provider network would be br-mgmt then?21:30
*** FrankZhang has quit IRC21:30
xgerman_no, it;s the name you choose in /etc/openstack_deploy/user_config…21:31
xgerman_https://github.com/openstack/openstack-ansible-os_octavia/blob/master/tests/host_vars/octavia1.yml21:32
xgerman_or https://github.com/openstack/openstack-ansible-os_octavia/blob/master/tests/host_vars/octavia1.yml21:32
xgerman_err https://github.com/openstack/openstack-ansible-os_octavia/blob/master/tests/os_octavia-overrides.yml#L81-L8521:32
*** ggnel has quit IRC21:34
*** sew has quit IRC21:35
tomtom001xgerman_ so network_flat_networks needs to specify the provider network that octavia will use?21:36
tomtom001xgerman_ also, those neutron settings should be in user_variables.yml?21:38
xgerman_Well, the provider nets are usually declared there... yes, if you need to overwrite some of Octavia’s guesses that should go there21:39
*** ggnel has joined #openstack-ansible21:43
*** DanyC has quit IRC21:47
*** DanyC has joined #openstack-ansible21:47
*** DanyC has quit IRC21:52
openstackgerritMatthew Thode proposed openstack/openstack-ansible-os_ironic master: Overhaul ironic role  https://review.openstack.org/57821921:56
prometheanfiremnaser: odyssey4me https://review.openstack.org/578219 :D21:56
prometheanfireI made it a new review because I didn't like where the old review was going, I think this way is simpler21:57
prometheanfirepassed lint at least21:58
*** tux_ has quit IRC22:06
*** tux_ has joined #openstack-ansible22:06
*** yolanda__ has joined #openstack-ansible22:07
*** yolanda_ has quit IRC22:10
*** ggnel has quit IRC22:11
*** tux_ has quit IRC22:11
*** cjloader has quit IRC22:13
*** ggnel has joined #openstack-ansible22:14
*** sew has joined #openstack-ansible22:16
*** vurtz has quit IRC22:20
*** yolanda_ has joined #openstack-ansible22:21
*** lihi has quit IRC22:22
*** yolanda__ has quit IRC22:24
*** vurtz has joined #openstack-ansible22:24
*** lihi has joined #openstack-ansible22:25
d34dh0r53anyone know how to make zuul merge this https://review.openstack.org/#/c/578091/ ?22:30
d34dh0r53it's passed everything, I may have made it worse by removing and re-adding my workflow vote22:30
*** throwsb1 has quit IRC22:31
prometheanfired34dh0r53: be very nice to fungi :P22:33
prometheanfireiirc WF is checked at the start and end of a merge, not during22:33
*** ansmith has joined #openstack-ansible22:35
d34dh0r53yeah22:37
*** threestrands has joined #openstack-ansible22:38
*** threestrands has quit IRC22:38
*** threestrands has joined #openstack-ansible22:38
*** FrankZhang_ has quit IRC22:41
*** FrankZhang has joined #openstack-ansible22:42
openstackgerritDavid Wilde proposed openstack/openstack-ansible-ops master: Improve multi-node AIO robustness  https://review.openstack.org/57816222:44
*** sew has quit IRC22:47
*** sew has joined #openstack-ansible22:52
*** cmart has quit IRC22:59
*** sew has quit IRC23:03
*** nicolasbock has quit IRC23:06
*** tosky has quit IRC23:08
*** tux_ has joined #openstack-ansible23:17
*** tux_ has quit IRC23:21
*** chyka has quit IRC23:36
*** ggnel has quit IRC23:37
*** cjloader has joined #openstack-ansible23:37
*** cjloader has quit IRC23:41
openstackgerritMatthew Thode proposed openstack/openstack-ansible-os_ironic master: Overhaul ironic role  https://review.openstack.org/57821923:47
*** sew has joined #openstack-ansible23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!