Thursday, 2016-10-13

openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_nova: Delegate from first available compute host  https://review.openstack.org/38522100:04
*** sdake_ has joined #openstack-ansible00:11
*** sdake has quit IRC00:14
openstackgerritSteve Lewis (stevelle) proposed openstack/openstack-ansible-os_ceilometer: Update ceilometer app.wsgi template per upstream  https://review.openstack.org/38569700:14
*** agrebennikov has quit IRC00:15
*** hj-hpe has quit IRC00:16
*** jamesdenton has joined #openstack-ansible00:18
cloudnullgotta run bbl00:20
cloudnulllogan-: still looking into issue btw00:20
cloudnullthanks for the acces.00:20
cloudnull*access.00:21
*** aludwar has quit IRC00:22
*** adrian_otto has quit IRC00:26
*** thorst has joined #openstack-ansible00:28
*** aludwar has joined #openstack-ansible00:29
*** javeriak has quit IRC00:33
*** javeriak has joined #openstack-ansible00:34
*** jamesdenton has quit IRC00:36
*** markvoelker has joined #openstack-ansible00:40
*** javeriak has quit IRC00:41
*** markvoelker has quit IRC00:45
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_nova: Delegate from first available compute host  https://review.openstack.org/38522100:45
*** adrian_otto has joined #openstack-ansible00:47
*** cmart has quit IRC00:50
*** jamesdenton has joined #openstack-ansible01:05
*** fishcried has joined #openstack-ansible01:07
*** rmelero has quit IRC01:10
*** markvoelker has joined #openstack-ansible01:12
*** cmart has joined #openstack-ansible01:12
*** cmart has quit IRC01:17
mhaydenodyssey4me: got it sir01:21
*** adrian_otto has quit IRC01:30
*** adrian_otto has joined #openstack-ansible01:36
*** adrian_otto has quit IRC01:38
*** adrian_otto has joined #openstack-ansible01:40
logan-cloudnull: sure np ill hang on to those nodes till youre done. no rush01:45
*** thorst has quit IRC01:49
*** thorst has joined #openstack-ansible01:50
*** Mudpuppy_ has joined #openstack-ansible01:52
*** Mudpuppy has quit IRC01:53
openstackgerritLogan V proposed openstack/openstack-ansible: Configure Calico specific BIRD settings in OSA  https://review.openstack.org/38571001:55
*** thorst has quit IRC01:58
*** adrian_otto has quit IRC02:06
jamesdentonodyssey4me you still around?02:06
*** jcrst has quit IRC02:07
cloudnulljamesdenton: i think he's sleep02:09
cloudnullsomething I can help with ?02:09
jamesdentonha yeah, i just realized that. i didn't pay attention to timestamps :D02:09
jamesdentonnaw, i commented on bug and just wanted his feedback. I'm sure I'll get it in the AM :)02:10
cloudnullok02:10
jamesdentonthanks though!02:10
cloudnullanytime02:18
*** LiYuenan has joined #openstack-ansible02:23
openstackgerritMerged openstack/openstack-ansible: Change the common proxy cache manage tasks to be stateful  https://review.openstack.org/38562502:24
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: Prevent overlayfs use in test when kernel < 3.18 or release == trusty  https://review.openstack.org/35177602:31
cloudnulllogan-: odyssey4me: after much putzing about I've determined that OverlayFS should just be avoided on trusty.02:32
cloudnullspecifically the package libdbus-XXX is a dependency of openssh-server in trusty where it is NOT in xenial02:33
cloudnulli wrote some simple loops to drill deps down to everything potentially required and determined that there's really no way to get around installing that package and it's existance has issues when installed in a contianer using overlayFS02:34
*** hughmFLEXin has joined #openstack-ansible02:35
*** hughmFLEXin has quit IRC02:39
*** thorst has joined #openstack-ansible02:40
cloudnullit seems to manifest in a later kernels but the potential for combinations to break that seem like we should just stick to dir based containers on trusty even if it's running in an AIO02:41
*** thorst has quit IRC02:42
*** thorst has joined #openstack-ansible02:42
* neillc heads to the dentist02:43
*** thorst has quit IRC02:51
*** gus has quit IRC02:52
logan-makes sense cloudnull. probably not too many deployers building greenfield or new containers on n+trusty so i don't think turning it off will affect many. i expect most people's n+trusty will just be a m->n+trusty->n+xenial.. that's how i'm looking at it anyway.03:05
logan-has anyone used any of the various lxc connection plugins? ie https://github.com/Mic92/ansible-lxc or https://github.com/chifflier/ansible-lxc-ssh03:06
logan-curious how well they work and if there's any caveats03:07
cloudnulllogan-: last i checked I think we're the only deployment project support newton on trusty03:11
cloudnull*supporting03:11
cloudnulli've looked at chifflier03:11
cloudnullnot mic9203:11
cloudnullin newton the ssh plugin we use is lxc aware03:12
cloudnullhttps://github.com/openstack/openstack-ansible-plugins/blob/master/connection/ssh.py03:12
cloudnullit looks and feels like normal ssh but its really ssh > host + lxc03:13
logan-oh nice! I didn't realize we're doing that03:13
cloudnullyup. that was the point03:13
cloudnull:)03:13
cloudnullmission accomplished :p03:13
logan-so if i'm understanding correctly i could not have an ansible_host defined for my containers, and as long as the container has a physical_host with ssh host defined I should be able to target tasks at the container03:15
logan-oh and container_name on the container host03:16
*** adrian_otto has joined #openstack-ansible03:19
cloudnullyup03:19
*** adrian_otto has quit IRC03:19
cloudnullssh is no longer needed into the container.03:20
cloudnullwe  have it . but its not required from an ansible perspective03:20
logan-awesome03:20
cloudnullthere are some wait conditions that still assume ssh03:21
cloudnullbut for the work its not needed.03:21
*** janki has joined #openstack-ansible03:22
*** adrian_otto has joined #openstack-ansible03:25
*** adrian_otto has quit IRC03:26
*** adrian_otto has joined #openstack-ansible03:27
*** gouthamr has quit IRC03:33
*** adrian_otto has quit IRC03:35
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts: Create the netns dir within the base container image  https://review.openstack.org/38573103:47
*** thorst has joined #openstack-ansible03:49
*** thorst has quit IRC03:56
logan-seems like maybe an issue with the plugin detecting the container triggering vars cloudnull http://cdn.pasteraw.com/imog7jq1gt8kcmfojf4b23avrco4s8w04:02
logan-self.vars is an empty dict04:03
*** dragonmaster_ has joined #openstack-ansible04:11
*** cmart has joined #openstack-ansible04:12
cloudnulllogan-: http://cdn.pasteraw.com/kple5sbpqxdig2rx0gusx5t6qo3ev6d - the inventory needs a  couple more options.04:21
cloudnullyou really only need this http://cdn.pasteraw.com/1m489ospt7cya72j2yvrjkijpd392zi04:22
cloudnullin the inventory that is04:22
*** hybridpollo has left #openstack-ansible04:22
cloudnullthe plugin does a lookup on the host connects to it and uses lxc after that.04:22
cloudnullnote the "Container confirmed" lines04:23
cloudnulland the lxc-attach in the debug output04:24
*** appprod0 has quit IRC04:35
*** Mudpuppy_ has quit IRC04:43
*** Mudpuppy has joined #openstack-ansible04:44
*** Mudpuppy has quit IRC04:48
*** gtrxcb has joined #openstack-ansible04:52
*** thorst has joined #openstack-ansible04:54
*** cmart has quit IRC04:55
*** thorst has quit IRC05:01
*** Jack_Iv has joined #openstack-ansible05:24
*** Jack_Iv has quit IRC05:25
*** Jack_Iv has joined #openstack-ansible05:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Fix container log bind mount regression  https://review.openstack.org/38561905:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Change the common proxy cache manage tasks to be stateful  https://review.openstack.org/38575705:31
*** Jack_Iv has quit IRC05:38
*** Jack_Iv has joined #openstack-ansible05:38
*** javeriak has joined #openstack-ansible05:56
*** thorst has joined #openstack-ansible06:00
*** thorst has quit IRC06:06
*** ZuZuD has quit IRC06:09
*** vishwanathj is now known as vishwanathj_zzz06:16
openstackgerritMerged openstack/openstack-ansible-os_heat: Update paste, policy and rootwrap configurations 2016-10-12  https://review.openstack.org/38554406:25
*** rgogunskiy has joined #openstack-ansible06:25
openstackgerritMerged openstack/openstack-ansible-os_aodh: Update paste, policy and rootwrap configurations 2016-10-12  https://review.openstack.org/38554206:25
*** dragonmaster_ is now known as allanice00107:00
openstackgerritMerged openstack/openstack-ansible: Configure Calico specific BIRD settings in OSA  https://review.openstack.org/38571007:00
*** gus has joined #openstack-ansible07:01
openstackgerritPraveen N proposed openstack/openstack-ansible: [docs] Add network config example for test and prod  https://review.openstack.org/38527207:02
*** thorst has joined #openstack-ansible07:04
*** admin0 has joined #openstack-ansible07:07
*** thorst has quit IRC07:11
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create: Generate Static MAC addresses for containers  https://review.openstack.org/38580007:28
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: Prevent overlayfs use in test when kernel < 3.18 or release == trusty  https://review.openstack.org/35177607:30
*** evilt0ne has quit IRC07:30
*** evilt0ne has joined #openstack-ansible07:32
*** evilt0ne has quit IRC07:32
*** evilt0ne has joined #openstack-ansible07:32
*** drifterza has joined #openstack-ansible07:32
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create: Generate Static MAC addresses for containers  https://review.openstack.org/38580007:34
*** vdo has left #openstack-ansible07:35
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create: Generate Static MAC addresses for containers  https://review.openstack.org/38580007:35
*** berendt has quit IRC07:36
openstackgerritDonovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA.  https://review.openstack.org/37565507:36
*** evilt0ne has quit IRC07:37
*** evilt0ne has joined #openstack-ansible07:38
*** evilt0ne has quit IRC07:38
*** evilt0ne has joined #openstack-ansible07:38
*** gtrxcb has quit IRC07:38
drifterzacloudnull, you awake dude ?07:38
cloudnullkinda?07:38
cloudnull:)07:38
drifterzajeeze, pull an all nighter ?07:38
cloudnullon the way to crash in a min07:38
cloudnullrestless.07:38
drifterzaAh okay,07:39
drifterzain OSA can we deploy using ipv6 ?07:39
evrardjphey everyone07:42
evrardjpipv6 in osa is possible, depending on what you're looking for07:42
evrardjpif you have a ceph cluster, build it from scratch with v6 :D07:43
cloudnullwe can use v6 networks, but if you're looking for v6 on the control plane then not yet.07:43
drifterzano only on consumer plane07:43
cloudnullwe offer v6 provider networks in the OSIC07:44
cloudnullworks great07:44
drifterzado we have a deployment method for that kevin ?07:46
*** fops has quit IRC07:47
ioniyesterday i saw a review with nova novnc and protouri07:47
openstackgerritDonovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA.  https://review.openstack.org/37565507:47
ionii cannot ind it anymore07:47
*** fops has joined #openstack-ansible07:47
ionii had it on chat but i rebooted it and i don't have the logs enabled07:47
ionido you happen to know the review id?07:48
cloudnulldrifterza: https://twitter.com/cloudnull/status/76447535893454438407:49
cloudnullits not really anything special .07:49
ioniwhat's osic?07:49
drifterzawould be really cool if we could write plays to pin up the ipv6 part07:50
cloudnullioni: its a collaboration between intel and rackspace07:51
evrardjpcloudnull: for v6 in the control plane, it's not really different, we had a dual stack control plane in my previous company07:51
evrardjphaproxy needed the rewrite I already shown you, and keepalived was with its own config file, but the rest is kinda ok07:51
evrardjpwe implemented weird things here and there, but that's only specific to our install07:52
*** fops has quit IRC07:52
evrardjpbut we didn't really move 100% of the traffic to ipv6 to be honest07:53
cloudnulldrifterza: from an OSA perspective we simply added the networks into neutron and away it went.07:53
cloudnullthe entire config is in that pic.07:53
cloudnullwhile i love to pick on neutron its fairly robust.07:53
drifterzacertainly you need some advertising method for ipv607:53
cloudnullfor sure.07:53
drifterzaoh so it assumes thats in place07:54
cloudnullyes. it does.07:54
cloudnulland we used hardware to do it .07:54
drifterzahmmm07:54
cloudnullits dual stack 10/8 plumbed to a neutron router with a gateway using a public 172/2407:55
evrardjpcloudnull: you use one provider network right, you didn't go for prefix delegation with one net per tenant, right?07:55
drifterzaI thought you needed something like ipv6 radvd07:55
jrosserv6 control plane very interesting for me07:56
evrardjpdrifterza: it's included in neutron depending on what you configure/need07:56
cloudnullwe did not do prefix delegation07:56
cloudnullthat was busted in liberty07:56
drifterzaokay Ill read the neutron plays in more depth, we don't have a documented way to do this right07:56
evrardjpI'm pretty sure we hacked it together in liberty :D07:56
evrardjpbut yes, experimental tech07:57
evrardjpbut you don't need prefix delegation to have an ipv6 cloud for the customers07:57
cloudnulldrifterza: https://gist.github.com/cloudnull/4e34276a8e690fb54146d03a73ec44b4 this was the config, its been changed a bit from then to now , but that's the gist (pun intended) :)07:57
evrardjp:D07:57
cloudnullfrom a neutron setup point of view07:57
drifterzashot!07:57
drifterzawould like to get this going in my labs07:58
evrardjpahah using google07:58
cloudnulljrosser: v6 control plane would be interesting to me too07:58
cloudnullI was shooting to try and make it go in this cycle, maybe the next one.07:59
jrosserhow big is the gap07:59
jrosserdoing v4 just digs a bigger hole for us here that i'd rather not make worse08:00
allanice001hey all08:00
evrardjpjrosser: to be IPv6 only wouldn't require much work, it could require hacks, but I think it's doable quite easily, depending on what you really really want08:01
cloudnulljrosser: https://twitter.com/cloudnull/status/717519610761728000 -- i just did get enough time to make it go . :)08:02
ioniis there somebody that uses the last stable/newton and novnc setup?08:03
evrardjpcloudnull: I'd be happy to help you in this battle08:03
ionii cannot type anything in the console08:03
cloudnulljrosser: my personal plan of attack would be to use the unbound bits that logan- proposed for proper hostname resolution, Move the the IP generation into a proper ip manager (out of the dynamic inventory script), and convert all of the internal services to use DNS.08:04
evrardjpioni: that's not enough information for us, we don't know how you access it, which os you're trying etc.08:04
cloudnullthen we can set everything to use V6 and it "should" be transperent to the deployment itself.08:04
evrardjpcloudnull: that's a good plan08:05
evrardjpwe just need to care about rabbit08:05
evrardjpbut it's gonna be fine as rabbit works fine with v608:05
evrardjpbut we have to avoid names there08:05
cloudnullsure. i'm sure there will be exceptions.08:05
cloudnullioni: is this the iframe console ?08:06
ionicloudnull, yes08:06
cloudnullcan you click on the link to the page with only the console?08:06
cloudnulldoes that work?08:06
evrardjpwhen you think about it, http is a problem solved :D08:06
cloudnullohai btw/ allanice00108:07
evrardjpso all the openstack services could be quite easily moved to v6, and more so because they are behind a LB which could be v6 quit easily08:07
ionicloudnull, i'm clicking everywhere, in centos 7 for example any thing i press returns a [08:07
ioniubuntu nothing08:07
cloudnullneat.08:07
cloudnull:)08:07
evrardjpbut you see the console08:07
* cloudnull is a helper08:07
evrardjpyou see the prompt08:07
ioniyes08:07
evrardjpis your locale en_US ?08:08
ioniatkbd serio0: Unknown key pressed (translated set 2, code 0x0 on isa0060/serio0)08:08
ionicentos 7 returns this08:08
ioni:D08:08
ioniit used to work fine before upgrading to N08:08
evrardjpI haven't tried novnc for a while08:08
evrardjpwell if it worked and it doesn't anymore, file a bug and give your configs, we could help you better08:09
cloudnullioni: can you see if you have this commit https://review.openstack.org/#/c/385011/ ?08:09
ionii have that08:09
cloudnullidk if that's the issue but its novnc and console related.08:09
ioniwithout that,i wouldn't even had a console08:09
cloudnullok.08:09
cloudnullah. so progress .08:09
ioniand it's commited in os_nova so i got the update with latest sha modifications08:10
ioniopenstack console url show c13b50e7-a08f-437e-97d7-3341873921cb08:11
ioniopened the link08:11
cloudnullok.08:11
*** thorst has joined #openstack-ansible08:11
cloudnullok. i gotta get some shut eye.08:11
cloudnullioni: if you dont get it figured out in the next few hours. i'd be happy to take a look .08:12
cloudnulllet me know.08:12
ioniok08:13
*** fishcried has quit IRC08:13
ionieverything i found related to nknown key released (translated set 2, code 0x0 on isa0060/serio0). was an issue with bios08:14
ioniand they removed the batery and worked08:14
ionii was thinking that's a qemu issue but the old machines are still running from an older qemu08:14
*** evilt0ne has quit IRC08:15
admin0morning08:15
*** thorst has quit IRC08:16
*** evilt0ne has joined #openstack-ansible08:16
*** evilt0ne has quit IRC08:16
*** evilt0ne has joined #openstack-ansible08:16
openstackgerritMerged openstack/openstack-ansible: Fix container log bind mount regression  https://review.openstack.org/38561908:17
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Fix container log bind mount regression  https://review.openstack.org/38582108:22
*** LiYuenan has quit IRC08:23
*** haad1 has joined #openstack-ansible08:26
jrosserevrardjp: i'm under pressure not to build yet more stuff with rfc1918 v4 but thats nice-to-have rather than policy currently08:28
cloudnulljrosser: ++08:29
cloudnulli support this effort :)08:29
cloudnullok night all08:29
*** evilt0ne has quit IRC08:29
odyssey4meo/08:30
*** evilt0ne has joined #openstack-ansible08:31
evrardjpjrosser: well I understand you :)08:32
*** jcrst has joined #openstack-ansible08:36
*** karimb has joined #openstack-ansible08:36
odyssey4meandymccr thanks to mhayden the centralised scripts are now working - it was actually dead simple in the end... so your review of https://review.openstack.org/382314 & https://review.openstack.org/382306 would be appreciated08:37
*** karimb has quit IRC08:38
andymccrahh so just remove the ' '08:42
drifterzahey guys, so im including external roles now for monasca.08:44
drifterzahave a weird problem though08:44
drifterzahttp://logs.openstack.org/55/375655/78/check/gate-openstack-ansible-os_monasca-linters-ubuntu-xenial/16a67ea/console.html#_2016-10-13_07_49_03_53175508:44
drifterzaany idea08:44
odyssey4meandymccr that, and switching the order of paramters around in the script itself - https://review.openstack.org/38551108:45
*** asettle has joined #openstack-ansible08:46
odyssey4melooking for more reviews please: https://review.openstack.org/#/q/starredby:jesse-pretorius+project:%255Eopenstack/openstack-ansible.*+status:open08:46
odyssey4medrifterza see all thelint errors above it08:46
odyssey4meit looks like the storm role could do with some cleaning up08:47
drifterzayeah, but its an external galaxy role08:47
odyssey4meyou can tag its inclusion with 'skip_ansible_lint' and it should get ignored08:47
*** evilt0ne has quit IRC08:47
odyssey4mesure - you should push up a patch to fix those anyway - or pick a role which has lint testing08:48
odyssey4mein fact you should encourage the author to properly implement testing, including lint testing08:48
drifterzathe sigh08:49
*** evilt0ne has joined #openstack-ansible08:49
*** evilt0ne has quit IRC08:49
*** evilt0ne has joined #openstack-ansible08:49
*** jimbaker has quit IRC08:50
odyssey4medrifterza added a comment to what I think needs to be change08:51
odyssey4me*changed08:51
drifterzathanks dude08:51
drifterzaI'm hating this role08:51
drifterzareally08:51
openstackgerritDonovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA.  https://review.openstack.org/37565508:53
*** jimbaker has joined #openstack-ansible08:57
*** jimbaker has quit IRC08:57
*** jimbaker has joined #openstack-ansible08:57
odyssey4meevrardjp your thoughts? should we go with https://review.openstack.org/#/c/385272/6/etc/network/interfaces.d/openstack_interface.cfg.test.example or adjust it more to be like https://gist.github.com/busterswt/01e706086c6bc6108e66e06fc992d1c0 ?08:59
openstackgerritDonovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA.  https://review.openstack.org/37565509:00
evrardjpwell that's two different approaches, and I understand them both09:00
evrardjpthe last one forces the host management to be vlan tagged09:00
evrardjpwhich, in most enterprise cases, don't happen (pxe boot etc)09:01
*** berendt has joined #openstack-ansible09:01
evrardjpit also requires change in the switching, but that's most of the time the case09:01
*** askb has quit IRC09:01
evrardjpbut here the change has to happen after the host is provisionned (which could be part of the enterprise provisioning)09:01
odyssey4meevrardjp we're looking for something that will work - it can always we iterated on later09:02
evrardjpwell it depends on what you call work09:02
odyssey4mebut for release we just want something that illustrates how to do it09:02
evrardjpthat's my point, it's 2 different scenario :p09:02
odyssey4methere are always many ways to do it09:02
evrardjpyou said assigning completely one nic to osa, then I think james denton solution seems more elegant09:03
evrardjpand as you said it's not a problem of losing connectivity, so I'll adapt the review with that in mind09:04
*** fops has joined #openstack-ansible09:04
odyssey4methanks09:04
openstackgerritDonovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA.  https://review.openstack.org/37565509:04
*** fops has quit IRC09:04
*** fops has joined #openstack-ansible09:04
odyssey4meit does look, to me, like james' gist is the most elegant09:05
odyssey4mewe just need to adjust it to fit the IP/VLANa llocations09:05
openstackgerritDonovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA.  https://review.openstack.org/37565509:07
drifterzaapologies for the spam09:07
*** adrian_otto has joined #openstack-ansible09:08
openstackgerritMerged openstack/openstack-ansible-os_keystone: Use centralised Ansible test scripts  https://review.openstack.org/38230609:09
*** evilt0ne has quit IRC09:11
evrardjpodyssey4me: well I'd not say elegant or not, it's disruptive, but it's clean09:11
evrardjponly one nic09:12
odyssey4meI think at this point we just need to edit the patch to get it done09:12
odyssey4melemme take a stab at it quickly09:12
evrardjpok I can edit it if you want09:12
*** thorst has joined #openstack-ansible09:14
*** ChanServ has quit IRC09:14
*** jmccrory has quit IRC09:17
*** adreznec has quit IRC09:17
*** kamtamtun has quit IRC09:17
*** dalees has quit IRC09:17
*** raddaoui has quit IRC09:17
*** berendt has quit IRC09:17
*** janki has quit IRC09:17
*** johnmilton has quit IRC09:17
*** grumpycatt has quit IRC09:17
*** arif-ali has quit IRC09:17
*** Jack_Iv has quit IRC09:17
*** sdake_ has quit IRC09:17
*** openstackgerrit has quit IRC09:17
*** Maeca_ has quit IRC09:17
*** jascott1 has quit IRC09:17
*** z- has quit IRC09:17
*** timrc has quit IRC09:17
*** portante has quit IRC09:17
*** jduhamel has quit IRC09:17
*** galstrom_zzz has quit IRC09:17
*** Jolrael has quit IRC09:17
*** andymccr has quit IRC09:17
*** aludwar has quit IRC09:17
*** haasn has quit IRC09:17
*** xar- has quit IRC09:17
*** aetaric_ has quit IRC09:17
*** mgagne_ has quit IRC09:17
*** chris_hultin|AWA has quit IRC09:17
*** NachoDuck has quit IRC09:17
*** vishwanathj_zzz has quit IRC09:17
*** pjm6 has quit IRC09:17
*** mubix_ has quit IRC09:17
*** toan has quit IRC09:17
*** b3rn-n00dl3s has quit IRC09:17
*** calebb has quit IRC09:17
*** nwonknu has quit IRC09:17
*** prometheanfire has quit IRC09:17
*** xek_ has quit IRC09:17
*** dmsimard has quit IRC09:17
*** jwagner has quit IRC09:17
*** cjloader has quit IRC09:17
*** gfa1 has quit IRC09:17
*** d34dh0r53 has quit IRC09:17
*** h1nch has quit IRC09:17
*** fops has quit IRC09:17
*** haad1 has quit IRC09:17
*** irtermit- has quit IRC09:17
*** odyssey4me has quit IRC09:17
*** palendae has quit IRC09:17
*** batkins61 has quit IRC09:17
*** ikalnytskyi has quit IRC09:17
*** ggillies has quit IRC09:17
*** qwang has quit IRC09:17
*** afranc has quit IRC09:17
*** gaudenz_ has quit IRC09:17
*** neith has quit IRC09:17
*** rackertom has quit IRC09:17
*** serverascode has quit IRC09:17
*** maximov_ has quit IRC09:17
*** mgariepy has quit IRC09:17
*** FrankZhang has quit IRC09:17
*** _hanhart has quit IRC09:17
*** dolphm has quit IRC09:17
*** lbragstad has quit IRC09:17
*** mrhillsman has quit IRC09:17
*** adrian_otto has quit IRC09:17
*** asettle has quit IRC09:17
*** jcrst has quit IRC09:17
*** admin0 has quit IRC09:17
*** allanice001 has quit IRC09:17
*** phschwartz has quit IRC09:17
*** basilAB has quit IRC09:17
*** kencjohnston has quit IRC09:17
*** jasondotstar has quit IRC09:17
*** antonym has quit IRC09:17
*** vvro has quit IRC09:17
*** ioni has quit IRC09:17
*** julian1 has quit IRC09:17
*** sulo has quit IRC09:17
*** mhayden has quit IRC09:17
*** kong has quit IRC09:17
*** aleph1 has quit IRC09:17
*** Apsu has quit IRC09:17
*** sigmavirus has quit IRC09:17
*** homerp has quit IRC09:17
*** git-harry has quit IRC09:17
*** automagically has quit IRC09:17
*** mancdaz has quit IRC09:17
*** jroll has quit IRC09:17
*** johnthetubaguy has quit IRC09:17
*** Oku_OS has quit IRC09:17
*** cloudnull has quit IRC09:17
*** jhesketh has quit IRC09:17
*** hughsaunders has quit IRC09:17
*** jhesketh has joined #openstack-ansible09:19
*** rgogunskiy has quit IRC09:20
*** tlbr has quit IRC09:20
*** agireud has quit IRC09:20
*** thorst has quit IRC09:20
evrardjpwoot netsplits!09:23
*** askb has joined #openstack-ansible09:29
*** neith has joined #openstack-ansible09:35
*** evrardjp has quit IRC09:41
*** javeriak has quit IRC09:45
* drifterza netsplit09:54
*** grumpycatt has joined #openstack-ansible10:06
*** ioni has joined #openstack-ansible10:06
*** tlbr has joined #openstack-ansible10:06
*** janki has joined #openstack-ansible10:06
*** johnmilton has joined #openstack-ansible10:06
*** arif-ali has joined #openstack-ansible10:07
*** serverascode has joined #openstack-ansible10:07
*** mubix_ has joined #openstack-ansible10:07
*** adrian_otto has joined #openstack-ansible10:07
*** asettle has joined #openstack-ansible10:07
*** admin0 has joined #openstack-ansible10:07
*** phschwartz has joined #openstack-ansible10:07
*** basilAB has joined #openstack-ansible10:07
*** johnthetubaguy has joined #openstack-ansible10:07
*** antonym has joined #openstack-ansible10:07
*** kencjohnston has joined #openstack-ansible10:07
*** vvro has joined #openstack-ansible10:07
*** jasondotstar has joined #openstack-ansible10:07
*** julian1 has joined #openstack-ansible10:07
*** sulo has joined #openstack-ansible10:07
*** mhayden has joined #openstack-ansible10:07
*** sigmavirus has joined #openstack-ansible10:07
*** aleph1 has joined #openstack-ansible10:07
*** homerp has joined #openstack-ansible10:07
*** Apsu has joined #openstack-ansible10:07
*** git-harry has joined #openstack-ansible10:07
*** automagically has joined #openstack-ansible10:07
*** mancdaz has joined #openstack-ansible10:07
*** jroll has joined #openstack-ansible10:07
*** Oku_OS-away has joined #openstack-ansible10:07
*** cloudnull has joined #openstack-ansible10:07
*** evrardjp has joined #openstack-ansible10:09
*** maximov_ has joined #openstack-ansible10:09
*** kong has joined #openstack-ansible10:09
*** raddaoui has joined #openstack-ansible10:09
*** fops has joined #openstack-ansible10:09
*** haad1 has joined #openstack-ansible10:09
*** irtermit- has joined #openstack-ansible10:09
*** palendae has joined #openstack-ansible10:09
*** odyssey4me has joined #openstack-ansible10:09
*** batkins61 has joined #openstack-ansible10:09
*** ikalnytskyi has joined #openstack-ansible10:09
*** ggillies has joined #openstack-ansible10:09
*** qwang has joined #openstack-ansible10:09
*** afranc has joined #openstack-ansible10:09
*** gaudenz_ has joined #openstack-ansible10:09
*** _hanhart has joined #openstack-ansible10:09
*** mgariepy has joined #openstack-ansible10:09
*** FrankZhang has joined #openstack-ansible10:09
*** dolphm has joined #openstack-ansible10:09
*** lbragstad has joined #openstack-ansible10:09
*** mrhillsman has joined #openstack-ansible10:09
*** jmccrory has joined #openstack-ansible10:10
*** adreznec has joined #openstack-ansible10:10
*** kamtamtun has joined #openstack-ansible10:10
*** dalees has joined #openstack-ansible10:10
*** jmccrory has quit IRC10:10
*** adreznec has quit IRC10:10
*** kamtamtun has quit IRC10:10
*** dalees has quit IRC10:10
*** evrardjp has quit IRC10:10
*** maximov_ has quit IRC10:10
*** kong has quit IRC10:10
*** raddaoui has quit IRC10:10
*** fops has quit IRC10:10
*** haad1 has quit IRC10:10
*** irtermit- has quit IRC10:10
*** odyssey4me has quit IRC10:10
*** palendae has quit IRC10:10
*** batkins61 has quit IRC10:10
*** ikalnytskyi has quit IRC10:10
*** ggillies has quit IRC10:10
*** qwang has quit IRC10:10
*** afranc has quit IRC10:10
*** gaudenz_ has quit IRC10:10
*** mgariepy has quit IRC10:10
*** FrankZhang has quit IRC10:10
*** _hanhart has quit IRC10:10
*** lbragstad has quit IRC10:10
*** dolphm has quit IRC10:10
*** mrhillsman has quit IRC10:10
*** serverascode has quit IRC10:10
*** mubix_ has quit IRC10:10
*** adrian_otto has quit IRC10:10
*** asettle has quit IRC10:10
*** admin0 has quit IRC10:10
*** phschwartz has quit IRC10:10
*** basilAB has quit IRC10:10
*** vvro has quit IRC10:10
*** antonym has quit IRC10:10
*** jasondotstar has quit IRC10:10
*** kencjohnston has quit IRC10:10
*** julian1 has quit IRC10:10
*** sulo has quit IRC10:10
*** mhayden has quit IRC10:10
*** aleph1 has quit IRC10:10
*** Apsu has quit IRC10:10
*** automagically has quit IRC10:10
*** sigmavirus has quit IRC10:10
*** homerp has quit IRC10:10
*** mancdaz has quit IRC10:10
*** git-harry has quit IRC10:10
*** jroll has quit IRC10:10
*** Oku_OS-away has quit IRC10:10
*** johnthetubaguy has quit IRC10:10
*** cloudnull has quit IRC10:10
*** arif-ali has quit IRC10:10
*** ioni has quit IRC10:10
*** tlbr has quit IRC10:10
*** janki has quit IRC10:10
*** johnmilton has quit IRC10:10
*** grumpycatt has quit IRC10:10
*** ioni has joined #openstack-ansible10:17
*** mubix_ has joined #openstack-ansible10:22
*** grumpycatt has joined #openstack-ansible10:26
*** serverascode has joined #openstack-ansible10:27
*** asettle has joined #openstack-ansible10:27
*** admin0 has joined #openstack-ansible10:27
*** phschwartz has joined #openstack-ansible10:27
*** basilAB has joined #openstack-ansible10:27
*** johnthetubaguy has joined #openstack-ansible10:27
*** antonym has joined #openstack-ansible10:27
*** kencjohnston has joined #openstack-ansible10:27
*** vvro has joined #openstack-ansible10:27
*** jasondotstar has joined #openstack-ansible10:27
*** julian1 has joined #openstack-ansible10:27
*** sulo has joined #openstack-ansible10:27
*** mhayden has joined #openstack-ansible10:27
*** sigmavirus has joined #openstack-ansible10:27
*** aleph1 has joined #openstack-ansible10:27
*** homerp has joined #openstack-ansible10:27
*** Apsu has joined #openstack-ansible10:27
*** git-harry has joined #openstack-ansible10:27
*** automagically has joined #openstack-ansible10:27
*** mancdaz has joined #openstack-ansible10:27
*** jroll has joined #openstack-ansible10:27
*** Oku_OS-away has joined #openstack-ansible10:27
*** cloudnull has joined #openstack-ansible10:27
*** jmccrory has joined #openstack-ansible10:27
*** adreznec has joined #openstack-ansible10:27
*** kamtamtun has joined #openstack-ansible10:27
*** dalees has joined #openstack-ansible10:27
*** arif-ali has joined #openstack-ansible10:27
*** tlbr has joined #openstack-ansible10:27
*** janki has joined #openstack-ansible10:27
*** johnmilton has joined #openstack-ansible10:27
*** raddaoui has joined #openstack-ansible10:27
*** evrardjp has joined #openstack-ansible10:27
*** maximov_ has joined #openstack-ansible10:27
*** fops has joined #openstack-ansible10:27
*** haad1 has joined #openstack-ansible10:27
*** irtermit- has joined #openstack-ansible10:27
*** palendae has joined #openstack-ansible10:27
*** odyssey4me has joined #openstack-ansible10:27
*** batkins61 has joined #openstack-ansible10:27
*** ikalnytskyi has joined #openstack-ansible10:27
*** ggillies has joined #openstack-ansible10:27
*** qwang has joined #openstack-ansible10:27
*** afranc has joined #openstack-ansible10:27
*** gaudenz_ has joined #openstack-ansible10:27
*** _hanhart has joined #openstack-ansible10:27
*** mgariepy has joined #openstack-ansible10:27
*** FrankZhang has joined #openstack-ansible10:27
*** dolphm has joined #openstack-ansible10:27
*** lbragstad has joined #openstack-ansible10:27
*** mrhillsman has joined #openstack-ansible10:27
*** Jack_Iv has joined #openstack-ansible10:28
*** sdake_ has joined #openstack-ansible10:28
*** openstackgerrit has joined #openstack-ansible10:28
*** Maeca_ has joined #openstack-ansible10:28
*** jascott1 has joined #openstack-ansible10:28
*** z- has joined #openstack-ansible10:28
*** timrc has joined #openstack-ansible10:28
*** portante has joined #openstack-ansible10:28
*** jduhamel has joined #openstack-ansible10:28
*** galstrom_zzz has joined #openstack-ansible10:28
*** Jolrael has joined #openstack-ansible10:28
*** andymccr has joined #openstack-ansible10:28
*** kong has joined #openstack-ansible10:28
*** rackertom has joined #openstack-ansible10:28
*** d34dh0r53 has joined #openstack-ansible10:28
*** haasn has joined #openstack-ansible10:28
*** xar- has joined #openstack-ansible10:28
*** aetaric_ has joined #openstack-ansible10:28
*** mgagne_ has joined #openstack-ansible10:28
*** chris_hultin|AWA has joined #openstack-ansible10:28
*** NachoDuck has joined #openstack-ansible10:28
*** vishwanathj_zzz has joined #openstack-ansible10:28
*** pjm6 has joined #openstack-ansible10:28
*** toan has joined #openstack-ansible10:28
*** b3rn-n00dl3s has joined #openstack-ansible10:28
*** calebb has joined #openstack-ansible10:28
*** nwonknu has joined #openstack-ansible10:28
*** prometheanfire has joined #openstack-ansible10:28
*** xek_ has joined #openstack-ansible10:28
*** dmsimard has joined #openstack-ansible10:28
*** jwagner has joined #openstack-ansible10:28
*** cjloader has joined #openstack-ansible10:28
*** gfa1 has joined #openstack-ansible10:28
*** h1nch has joined #openstack-ansible10:28
odyssey4measettle could you please do a final pass through of https://review.openstack.org/385496 ?10:28
asettleodyssey4me: on it already :)10:29
odyssey4methanks10:29
openstackgerritMerged openstack/openstack-ansible: [DOCS] Update manual upgrade guide  https://review.openstack.org/38558210:29
*** serverascode has quit IRC10:29
*** ChanServ has joined #openstack-ansible10:30
*** tepper.freenode.net sets mode: +o ChanServ10:30
*** d34dh0r53 has quit IRC10:30
pjm6good morning all :)10:30
odyssey4meo/ pjm610:30
*** d34dh0r53 has joined #openstack-ansible10:30
*** rackertom has quit IRC10:32
*** tlbr is now known as Guest7632310:32
*** ioni is now known as Guest5808110:32
*** maximov_ has quit IRC10:32
*** karimb has joined #openstack-ansible10:32
*** adrian_otto has joined #openstack-ansible10:32
*** agireud has joined #openstack-ansible10:33
*** sdake_ has quit IRC10:35
*** neith has quit IRC10:35
*** neith has joined #openstack-ansible10:35
*** mubix_ has quit IRC10:35
*** mubix_ has joined #openstack-ansible10:35
*** raddaoui has quit IRC10:36
*** raddaoui has joined #openstack-ansible10:36
*** karimb has quit IRC10:37
*** karimb has joined #openstack-ansible10:37
evrardjpodyssey4me: that was a hard patchset10:38
evrardjpdocs, right :p10:38
odyssey4medocs are hard work10:39
odyssey4meputting all that together took me 6 hours yesterday10:39
odyssey4methe sample configs I mean10:39
*** rackertom has joined #openstack-ansible10:44
odyssey4meandymccr loving how many LOC are deleted in https://review.openstack.org/385852 :)10:44
andymccrodyssey4me: yeah i ahve the fix up too but im on vpn and git review is not being helpful right now :P10:44
*** Guest58081 has quit IRC10:45
*** Guest58081 has joined #openstack-ansible10:45
*** Guest58081 is now known as ioni10:45
odyssey4meandymccr well gert erf der ververpn10:45
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Use dictionary for service mappings  https://review.openstack.org/38585210:46
andymccrmeh its ok i added the proxycommand :P10:47
*** serverascode has joined #openstack-ansible10:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [docs] Provide example configurations  https://review.openstack.org/38549610:51
odyssey4methanks asettle - with regards to 'this environment' it's referring to the environment described on the page itself as a whole10:52
odyssey4meis there a way that I can make the context more clear?10:52
odyssey4memaybe it needs an intro or something?10:53
asettleodyssey4me: yeah I thought so. Hmm let me go have another look. I think it might just be easier instead of 'this environment' you say 'prod' or 'test' environment10:53
asettleIntro would actually be really helpful10:53
asettleDoes need some overarching 'this is a thing, and this is what it is' context10:53
*** hughsaunders has joined #openstack-ansible10:53
odyssey4meok, it does have an intro but I see that it needs some editing10:53
odyssey4melemme do some quickly10:53
odyssey4meI'll do it fairly free form, then you can correct my horrible arghlish10:54
*** maximov_ has joined #openstack-ansible10:55
asettleodyssey4me: ace :) shoot me a link when you're done10:57
asettleIt looks good! Tahnsk for updating this all :)10:57
openstackgerritDonovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA.  https://review.openstack.org/37565510:59
*** smatzek has joined #openstack-ansible11:02
odyssey4meevrardjp what is the correct term for a switch that supports bonded interfaces?11:03
*** sdake has joined #openstack-ansible11:03
odyssey4meport aggregation?11:03
odyssey4melink aggregation11:04
*** izaakk has quit IRC11:06
drifterzausually link11:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [docs] Provide example configurations  https://review.openstack.org/38549611:06
odyssey4measettle ^11:06
drifterzaLACP = link agg control prot11:06
*** izaakk has joined #openstack-ansible11:06
asettleodyssey4me: gimme a bit :) just doing other reviews11:07
odyssey4medrifterza yep, I used link aggregation11:07
odyssey4meit's a generic enough term11:07
drifterzayup11:07
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Use dictionary for service mappings  https://review.openstack.org/38585211:08
odyssey4meandymccr I dunno if you noticed my comment in an earlier PS11:09
*** sdake_ has joined #openstack-ansible11:11
evrardjpbond mode 4 is LACP11:12
evrardjpfor active-backup a dumb switch is enough11:12
evrardjplacp is link aggregation11:12
evrardjpwell I realise ppl answered here but still answered!11:13
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [docs] Provide example configurations  https://review.openstack.org/38549611:13
evrardjpwhen doing on different switches, it's probably MLAG you're looking for11:13
*** sdake has quit IRC11:13
odyssey4meevrardjp ah yes, I forgot that the config was active-backup and that nothing special is needed there11:13
evrardjpbut I doubt it's still what you are looking for :p11:13
evrardjpyup11:13
*** markvoelker has quit IRC11:14
odyssey4meevrardjp correct me if I'm wrong, but IIRC the switch doesn't need to be able to do VLAN's either for you to use VLAN tags11:14
odyssey4meif the switch doesn't do VLAN's it just means that you won't have isolation11:14
*** askb has quit IRC11:14
odyssey4meoh no, I'm wrong11:14
odyssey4meI was thinking about a flat network using multiple IP ranges11:15
odyssey4menvm11:15
evrardjpwell if it doesn't recognize/do something with vlans, it's still a vlan11:15
odyssey4meok asettle - doing a quick edit11:15
evrardjpthe frame doesn't change :p11:15
asettleodyssey4me: okay :)11:15
asettleSorry, just trying to clear up some docs stuff I'll be there in a second :011:15
asettle:)11:15
odyssey4meevrardjp so with a dumb hub/switch using the vlan tags will work? ie servers will be capable of talking to each other?11:16
evrardjpwell if the other side of the switch is configured exactly the same yes11:16
evrardjpbasically you're giving everything11:16
evrardjpa basic switch won't filter tags11:16
odyssey4meso neither the test or prod environment need anything more than a dumb switch?11:16
odyssey4mean L2 switch11:17
evrardjpwell you probably don't want that11:17
*** karimb has quit IRC11:17
evrardjpbut yes11:17
evrardjptechnically yes11:17
odyssey4mesure, you don't want that - not really, but in terms of setting expectations I want to give the minimum requirement11:17
evrardjpbut how do you ensure some native vlans for your storage environment?11:17
evrardjpbecause sometimes you need that :p11:17
odyssey4meso I'll take the requirement for a VLAN-capable switch out11:17
evrardjpwell a plain l2 switch could be enough11:18
evrardjpyou could technically remove that11:18
evrardjpalthough it cost 50 quid, if you can't afford 50 quid maybe worth leaving openstack world11:18
evrardjp:p11:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [docs] Provide example configurations  https://review.openstack.org/38549611:18
odyssey4meevrardjp haha, fair point :p11:19
odyssey4melook at you, using english words and all :p11:19
evrardjpand also you have a dumb switch that basically transfers all the frames so thanks for the useless isolation11:19
evrardjpbut who am I, right? :p11:20
evrardjpso (optional, highy-recommended) would be my choice11:20
odyssey4meI think anyone building a cloud should know that. If they don't, then they should just pack it up and go home.11:21
evrardjpyup11:21
evrardjpMLAG is different matter 'though11:22
evrardjpand it's quite standardly used in DCs11:22
jrosserwould be nice to have some pointers for people at the other end of the spectrum11:22
evrardjpjrosser: ?11:22
odyssey4meyeah, we had some fun getting MLAG working properly between two Arista switches back in a previous life11:22
*** thorst has joined #openstack-ansible11:22
jrosserit's not obvious to me if i can easily have racks of compute which are each their own bit of routed L311:22
odyssey4meit was a little weird, but eventually worked very well11:23
jrosserif i can define that grouping in osa, or even if i need to11:23
*** johnmilton has quit IRC11:23
jrosser(from a mgmt plane p.o.v i mean)11:23
odyssey4mejrosser so... it is potentially possible - and something I'd love someone to figure out11:23
evrardjpjrosser: including storage routed?11:23
evrardjpwe've done that11:24
jrosserthats easier i think11:24
evrardjpit's a terrible idea but it works11:24
evrardjpwe have in osa the additional routes for the networks11:24
jrosserwell im starting with a L3 leaf/spine network11:24
jrosserso some of this matters from the start11:24
evrardjpand basically osa is using mgmt network to connect11:24
odyssey4mejrosser I did this as a sketch of how one *might* do it, but I haven't had a chance to try it out: https://gist.github.com/odyssey4me/09d963776f8872f2562e477c5158a3e011:24
evrardjpwell depending on your requirements, it can change a lot in the topology, and you know it I guess :p11:26
*** sdake has joined #openstack-ansible11:27
odyssey4mejrosser note that I have no idea if that will even work, but I just wanted to capture it at the time after a discussion evrardjp and I had11:27
jrosserodyssey4me: ah there so az<n> corresponds to L3 domain11:27
jrosserwhich might well be one TOR switch worth of stuff11:27
odyssey4mejrosser yeah, each 'az' (ie availability zone) corresponds to a failure domain - which could be a rack, a rack row, a DC, whatever11:28
evrardjpI don't think for your use case you shouldn't go that far11:28
*** sdake_ has quit IRC11:28
evrardjpjrosser: could you leverage IS-IS to have a l3 controlplane for extending your vlans?11:29
odyssey4meI know we discussed that RabbitMQ, MariaDB, etc would very likely get a performance hit when implementing their traffic via L311:29
odyssey4meso what one might have to do is implement a flat network across AZ's for the infra, then do L3 for API's and such11:29
evrardjpwell I'm starting to be fancy here, let's discuss that another time :p11:29
jrosseri need to get anything going at all first :)11:30
odyssey4mebut yeah - it's all possible, and would likely take some work to figure out how to optimise it, but it *could* be done11:30
jrosserbut i have enough stuff to p.o.c it any which way i like11:30
evrardjpodyssey4me: it could be done in a lot of different ways11:30
evrardjpjrosser: ^11:30
evrardjpthe thing is, where do you want to rely on your networking too11:30
evrardjpfor me I always rely on putting my l2 matters on switches :p11:31
*** thorst has quit IRC11:31
odyssey4mejrosser with https://github.com/openstack/openstack-ansible-ops/tree/master/multi-node-aio you could make your test hardware go a long way :)11:31
odyssey4meevrardjp andymccr two backports and a simple review in here if you have a moment: https://review.openstack.org/#/q/starredby:jesse-pretorius+project:%255Eopenstack/openstack-ansible.*+status:open11:32
jrosseri have particular requirements pushing me toward calico too but that feels like not first step11:33
asettleodyssey4me: done. I've evened the pages out so they look similar :) sorry it took longer11:34
odyssey4measettle oh man, that hurts11:34
asettleHAHA sorry odyssey4me11:34
odyssey4melemme get it done11:35
asettleYou'er doing that thing where you do my edits, and tehn you do YOUR edits, adn then I edit your second edits plus your other edits11:35
asettleIt's a cool cycle we're in :p11:35
odyssey4measettle lies, you're not sorry11:36
odyssey4meyou take great pleasure in poking fun at my arghlish11:36
asettleOkay, maybe not. But I swear this appendix is going to look SO BEAUTIFUL once you're done :p11:36
odyssey4meyes, no longer the ugly baby it once was11:37
odyssey4measettle are you OK with the use of the word 'illustrative' instead of 'sample' for the intro?11:38
evrardjppushing my lucj here: https://review.openstack.org/#/c/351776/11:38
evrardjpluck* odyssey4me ^11:38
odyssey4meI feel that it's important to be clear that it's for illustration purposes.11:38
asettleodyssey4me: hmmm so, the only problem I have with 'illustrative' is it is kind of wafty instead of to the point like the rest of the content. I think if you're going to want to use illustration, I would go with any of the following: sample, prescription, explanatory, etc11:39
odyssey4meevrardjp it's for an AIO, we could just reduce it to check for 'trusty' and that's that11:39
odyssey4measettle ok, so 'sample' or 'example' is a preferred term?11:40
asettleodyssey4me: yep :) let's keep it familiar11:40
odyssey4meI was thinking more along the lines of 'illustrative example' - used only once right at the start11:40
odyssey4me'sample' on its own still feels a little too prescriptive to me11:41
*** retreved has joined #openstack-ansible11:41
odyssey4meie it's a small piece of a larger part11:41
odyssey4meok, I'll go with example11:41
asettleodyssey4me: I'm so glad you decided that on your own :P hahah sorry, wasn't looking at teh chan11:43
odyssey4meit's noisy up here in my head11:44
odyssey4measettle with regards to 'A production environment' versus 'This production environment'... I'm completely not good with using 'A'. Every production environment has different characteristics... I'm specifically describing *this* environment.11:45
asettleOkay, good point. Change that :)11:46
odyssey4meIn fact, I'm starting to think that referring to these as 'test' and 'prod' is a mistake.11:46
odyssey4meWe should perhaps rather just refer to 'Example A' and 'Example B'.11:46
odyssey4meA is small and simple - B is highly available11:46
asettleodyssey4me: hmmm but that would cause some issues because we already refer to them as test and prod throughout the guide11:50
asettleDiagrams etc11:50
asettleI don't think we can just change that now. That's a much larger change we CAN make.11:50
odyssey4meyeah, I think that'd be best11:51
odyssey4meI expect that we'll be expanding to more examples in the future.11:51
odyssey4meso for now we go with what we have11:51
*** johnmilton has joined #openstack-ansible11:52
*** thorst has joined #openstack-ansible11:52
*** smatzek_ has joined #openstack-ansible11:54
asettleyep :)11:54
asettleWe'll work on a plan later odyssey4me11:54
*** smatzek has quit IRC11:57
*** jamesdenton has quit IRC11:59
mhaydenmorning12:00
mhaydenodyssey4me / andymccr: i've broken enough stuff in OSA so i figured it might be worthwhile to fix something :P12:00
andymccrmhayden: are you OSA's chaos monkey? We're stronger because of it! :P12:01
*** kylek3h has quit IRC12:01
mhaydenandymccr: well, i'm more like odyssey4me's chaos monkey12:01
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Use dictionary for service mappings  https://review.openstack.org/38585212:02
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [docs] Provide example configurations  https://review.openstack.org/38549612:03
odyssey4measettle ^ round 1512:03
*** johnmilton has quit IRC12:04
asettleOkay odyssey4me :)12:04
*** johnmilton has joined #openstack-ansible12:04
*** sdake_ has joined #openstack-ansible12:05
openstackgerritDonovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA.  https://review.openstack.org/37565512:05
*** sdake has quit IRC12:06
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Use dictionary for service mappings  https://review.openstack.org/38585212:12
asettleodyssey4me: you didn't remove illustrative from line 13? https://review.openstack.org/#/c/385496/15/doc/source/install-guide/app-config-prod.rst12:13
*** williamcaban has joined #openstack-ansible12:14
*** markvoelker has joined #openstack-ansible12:14
odyssey4measettle you didn't ask me to - I thought that line was OK12:15
asettleodyssey4me: oh I didn't? Bummer. I'm a knob. let's remove all 'illustrative' to be consistent :)12:15
asettleThat is legit my only comment. otherwise, looks great dude :)12:15
odyssey4meokie dokey12:15
odyssey4meso change it to 'The configurations here are meant to be examples, not prescriptive.'12:16
odyssey4me?12:17
odyssey4mehmm, 'an example'12:17
odyssey4mebah, now it ruins the flow of that sentence12:18
drifterzathat R proper anglish boet12:18
admin0"WARNING: The following packages cannot be authenticated!", "  ubuntu-cloud-keyring" — why does this come ?12:18
odyssey4methe 'ive' at the end of each word made it all nice and flowing12:18
admin0TASK [keepalived : Add Ubuntu Cloud Archive keyring] ***************************12:18
admin0it comes up on others as well12:18
admin0looks like i am missing something in this new env12:18
asettleodyssey4me: "NOTE: The configurations in this example are not prescriptive"12:19
odyssey4meadmin0 in our gates it does that because we're using an apt cache from infra which doesn't authenticate the packages12:19
odyssey4measettle ah, much betterer12:19
*** karimb has joined #openstack-ansible12:19
evrardjpdrifterza: haha boet betekend iets anders in nederlands :p12:19
asettleodyssey4me: here all week12:19
drifterzaevrardjp, ne ?12:19
odyssey4measettle how do you do the markup for note again?12:19
asettle.. note::12:19
asettleAnd ensure the start of the note is one line under the 'n'12:19
*** markvoelker has quit IRC12:20
evrardjpwhat did boet mean in your sentence?12:20
drifterzalike brother or bro12:20
odyssey4measettle to be honest though, I think the sentence has lost its meaning now12:20
odyssey4meI think it better to remove it12:20
evrardjplike broer :)12:20
evrardjpok12:20
drifterzayup12:21
asettleodyssey4me: was about the say the same thing. I think it's fairly self explanatory that it is.12:21
asettleConsidering it's called "example production environment"12:21
asettle:p12:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [docs] Provide example configurations  https://review.openstack.org/38549612:21
odyssey4measettle ^ final round12:22
asettleLove your stuff odyssey4me12:22
openstackgerritDonovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA.  https://review.openstack.org/37565512:23
odyssey4meok, andymccr / mhayden / evrardjp it's your turn: https://review.openstack.org/38549612:26
evrardjpfine12:26
odyssey4melet's put the puppy to bed now12:26
* mhayden turns12:26
evrardjpdone12:28
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Use dictionary for service mappings  https://review.openstack.org/38585212:31
drifterzaJessie, ek skiem you Engels is nogals goed, word jy noe a soutie of wat ?12:32
drifterza;p12:33
odyssey4medrifterza ek was altyd a soutie :p12:33
drifterzane ?12:33
odyssey4meja, my van is Pretorius maar ek het Engels groot geword12:33
drifterzawel kyk my ma's se kant is duits en my pa se kant is nedelands en ek was Engels groot gemaak12:34
drifterzahoe weird.12:34
logan-cloudnull: followup on that ssh thing from last night. sorry i didnt give very good debugging output on what im seeing. this should show things a little better http://cdn.pasteraw.com/n3ulakcdntjo9ge2k4y1ttq34yv6uiz -- the container detection stuff isnt working in the ssh connection module because the dict its looking for the vars in is empty :( but my inventory is almost identical to that test one you put12:34
odyssey4meja, my Pa se kant is eintlik Afrikaans, maar sy Pa was engels12:34
*** kylek3h has joined #openstack-ansible12:35
odyssey4melogan- did you set the connection plugin to the one we have in our plugins repo?12:35
odyssey4melogan- for Newton 'openstack-ansible' sources /usr/local/bin/openstack-ansible.rc - if you execute 'ansible' you need to do that manually12:36
odyssey4meif we could figure out how to make that happen automatically it'd be nice12:36
logan-yeah it is using the plugins repo one there. that DEBUG line is what i'm using to verify that as it only is added to the osa ssh.py connection plugin12:36
asettleWhen did this channel turn Afrikaans?12:36
logan-im using an ansible.cfg in this case so not relying on envvars or anything12:37
mhaydenasettle: you wanna run the OSA weekly mtg today? i've got a meeting :(12:38
odyssey4melogan- does your ansible.cfg have the locaiton of the conneciton plugin set12:38
asettlemhayden: are you sure you want *me* to do that?12:38
asettle:p12:38
logan-yessir12:38
asettleI mean, I am happy to.12:38
asettlePoint me in the direction of all the things.12:38
mhaydenasettle: of course -- you're good at it!12:38
mhaydenasettle: agenda is here -> https://wiki.openstack.org/wiki/Meetings/openstack-ansible12:38
asettlemhayden: haha okay! Shoot me all the things I need :)12:38
asettleOh, you already on it.12:38
asettlego mhayden12:38
mhaydenasettle: the only two action items are things to be completed at the summit -> http://eavesdrop.openstack.org/meetings/openstack_ansible/2016/openstack_ansible.2016-10-06-16.02.html12:39
odyssey4melogan- FYI I tested the other available lxc connection plugins and learned some things: https://gist.github.com/odyssey4me/ec8f9316f74bca099c9f65f8fefb05a412:39
asettleSweet as :)12:39
mhaydenasettle: and you can see the commands i used for the various meeting things -> http://eavesdrop.openstack.org/meetings/openstack_ansible/2016/openstack_ansible.2016-10-06-16.02.log.html12:39
* asettle raises hand to mhayden12:40
asettleQuestion12:40
asettleDo I have to toot?12:40
admin0odyssey4me: i am not using the gates, but running the latest newton12:40
mhaydenasettle: you may certainly toot12:40
asettleOkay good, I like it.12:40
mhaydenbut watch out for andymccr -- he's long-winded12:40
admin0on a set of ubuntu 14.04 machines ( freshly redone )12:40
openstackgerritDonovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA.  https://review.openstack.org/37565512:40
asettlemhayden: I can handle that guy :p12:40
odyssey4meadmin0 are you using your own apt mirror? also, is it an AIO?12:40
admin0so surprized why i am facing this .. never faced this before12:40
asettle"No dinner for you if you keep going, now... "12:40
admin0its a multi node install12:40
* mhayden cannot confirm or deny12:40
admin0not an aio12:40
odyssey4meadmin0 we introduced the use of UCA for the first time in Newton12:40
asettleOn that note, I might go run my errands early then :)12:40
* mhayden tips his hat to asettle for the assist! :)12:41
admin0how do I fix it :D12:41
asettlemhayden: anytime :)12:41
asettlemhayden: shall I ping people the hour before?12:41
admin0whats an UCA :D12:41
odyssey4meadmin0 ok, so you're using the defaults then I guess?12:41
admin0universal ca ?12:41
odyssey4meadmin0 UCA = Ubuntu Cloud Archive12:41
admin0oh :D12:41
admin0:)12:41
admin0i am using the defaults12:41
* admin0 always uses the defaults :D12:41
mhaydenasettle: https://media.giphy.com/media/jt9FFt6f2Q0Te/giphy.gif12:41
odyssey4meUCA has updated packages like libvirt, openvswitch, haproxy, etc12:41
logan-ah cool odyssey4me. i was looking at the other 2 last night and the cloudnull informed me of the osa one so I decided to try it first. will take a look at your results :)12:42
admin0ok12:42
openstackgerritDonovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA.  https://review.openstack.org/37565512:42
odyssey4melogan- yeah, I learned that the stock lxc plugin is localhost only - and that the remote one via SSH was super-slow12:42
*** woodard has joined #openstack-ansible12:42
odyssey4meour one seems to work quite well - although we haven't yet started pulling openssh out of the containers to really give it a go12:42
admin0odyssey4me:  so how do I proceed with this ? how to get past this ?12:42
odyssey4meadmin0 is it failing, or just warning?12:43
admin0failing :(12:43
*** woodard has quit IRC12:43
odyssey4meadmin0 and which task - can you pastebin/share your user_variables.yml and a debug log of the failing task?12:43
admin0https://gist.githubusercontent.com/a1git/c27ffb24ac8e899ceb7b44e2b97479ab/raw/918b29a549dc63e8e979c39a68c57ddf04a5f820/gistfile1.txt12:43
*** woodard has joined #openstack-ansible12:44
mhaydenso i did a 13.3.3 to 13.3.4 upgrade yesterday and ended up with duplicated heat service entries12:44
mhaydenit didn't hurt anyhting, but i wasn't sure if someone else saw that12:44
odyssey4meadmin0 ah, that's in the keepalived role specifically - evrardjp any thoughts?12:44
mhaydeni couldn't see anything in the diff that would have caused that12:44
*** gouthamr has joined #openstack-ansible12:44
odyssey4meadmin0 it's plausible that the apt cache is stale12:45
odyssey4metry updating the apt cache?12:45
admin0multiple times12:45
admin0that was my first thought a well12:45
admin0as*12:45
*** kylek3h has quit IRC12:45
odyssey4mealso validate that you rstandard ubuntu repo has the 'ubuntu-cloud-keyring' packge?12:45
admin0hmm.. i can try to do the ubuntu-cloud-keyring install by hand12:45
asettleevrardjp: with your comment on here https://review.openstack.org/#/c/385496/ before merge, could you file a bug?12:45
asettleKthanks :p12:45
odyssey4meadmin0 is this trusty or xenial?12:46
*** klamath has joined #openstack-ansible12:46
admin0trusty12:46
*** klamath has quit IRC12:46
admin0xenian works fine:)12:47
admin0this test is on trusty12:47
admin0xenial*12:47
*** klamath has joined #openstack-ansible12:47
odyssey4meok, so the ubuntu-cloud-keysring file is in 'universe' - make sure that's configured in your apt sources12:48
admin0ok12:48
admin0universe is configured12:49
admin0E: Failed to fetch http://nl.archive.ubuntu.com/ubuntu/pool/universe/u/ubuntu-cloud-keyring/ubuntu-cloud-keyring_2012.08.14_all.deb  503  Service Unavailable :D12:49
odyssey4meadmin0 ah, I think you may be hitting the thing we fixed with https://review.openstack.org/385625 which is on its way to merging into newton right now12:50
odyssey4meie the package cache is a bit broken - check the repo container and see if you can find what's going on in the apt-cacher-ng log12:50
admin0i almost never do aio, but only multi nodes, so that description is true for multi-node as well12:50
admin0please merge now :D12:51
admin0so that i can git pull and move ahead12:51
admin0:D12:51
odyssey4meyes evrardjp - none of these drive-by comments :p register a bug already!12:51
evrardjpit's doen12:51
evrardjpdone12:51
evrardjpI had my process to not introduce bugs and still follow, I star all I have to do12:52
evrardjpbut yes, bug is for long term approach, and other ppl can take it!12:52
evrardjpadmin0: got an issue?12:52
evrardjpwith your keepalived?12:52
admin0i hear i need to wait for https://review.openstack.org/385625  to be available12:53
evrardjpoh it was mhayden12:53
evrardjpso issue?12:53
admin0packages cannot be authenticated  issue — on keepalived12:53
admin0add ubuntu cloud archive keyring12:53
admin0https://gist.githubusercontent.com/a1git/c27ffb24ac8e899ceb7b44e2b97479ab/raw/918b29a549dc63e8e979c39a68c57ddf04a5f820/gistfile1.txt this one12:53
odyssey4meevrardjp yeah, it's more than likely the package cache in the repo12:54
mgariepygood morning everyone12:55
odyssey4meie https://bugs.launchpad.net/openstack-ansible/+bug/1632826 & https://bugs.launchpad.net/openstack-ansible/+bug/163284712:55
openstackLaunchpad bug 1632826 in openstack-ansible "apt/yum cache causes problems when rebuilding" [Undecided,Fix released] - Assigned to Jesse Pretorius (jesse-pretorius)12:55
openstackLaunchpad bug 1632847 in openstack-ansible "repo_server package cache causing failures" [High,In progress] - Assigned to Kevin Carter (kevin-carter)12:55
evrardjpodyssey4me: I will still check if keepalived role has the proper keyring12:55
evrardjpauto latest, so yes that could be package cache of repo12:57
admin0how do i force an apt-get update on everythig ( that the anisble knows of ) ?12:58
evrardjpmhayden: do you mean duplicate entries in the service catalog?12:59
odyssey4melogan- it looks like you have the right bits12:59
mhaydenevrardjp: yessir12:59
odyssey4melogan- perhaps try extract those host vars into a yaml file like so? https://github.com/openstack/openstack-ansible-os_swift/blob/master/tests/group_vars/all_containers.yml12:59
evrardjpadmin0: ansible -m apt -a "update_cache=yes" all12:59
admin0thanks :)12:59
evrardjpgod damn it we need idempotency in this keystone module!13:00
evrardjp:p13:00
evrardjpmhayden: http https?13:00
evrardjpor does this really look the same?13:00
admin0we got no clue what you are looking at :D13:01
admin0 [WARNING]: Host file not found: /etc/ansible/hosts :D13:01
admin0i was hoping to piggyback on the openstack ansible inventory :)13:01
odyssey4meadmin0 you need to source /usr/local/bin/openstack-ansible.rc first13:01
evrardjpcd /opt/openstack-ansible/playbooks13:02
odyssey4meand yes, you need to be in that directory13:02
admin0\o/ :D13:02
admin0thanks13:02
evrardjpyw13:02
*** Mudpuppy has joined #openstack-ansible13:02
openstackgerritDonovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA.  https://review.openstack.org/37565513:03
admin0facts removed, all updated, manually installed ubuntu-cloud-keysring — retrying !13:04
Matiasmorning13:04
admin0\o13:04
* Matias back to business13:04
Matiasodyssey4me: you are fast, i was going to send a PR for this, but you already fixed it https://github.com/openstack/openstack-ansible/commit/ded68dd775f7187bbe4649d2e31346784c21ac6913:04
evrardjphey Matias it's been a while :)13:05
logan-odyssey4me: yep been there too :) http://cdn.pasteraw.com/qyywjcxqwauiukif0za30lcnjyyvv413:05
admin0it runs now ס₪₪₪₪§|(Ξ≥≤≥≤≥≤ΞΞΞΞΞΞΞΞΞΞ>13:06
*** cathrichardson has joined #openstack-ansible13:06
*** cathrichardson has quit IRC13:06
*** cathrichardson has joined #openstack-ansible13:07
*** Mudpuppy has quit IRC13:07
logan-also in case its an issue with that connection plugin working with 2.1.2.0 I also tried 2.1.1.013:09
logan-(same result)13:09
*** jperry has joined #openstack-ansible13:11
*** Mudpuppy has joined #openstack-ansible13:11
*** jheroux has joined #openstack-ansible13:14
drifterzahttp://logs.openstack.org/55/375655/90/check/gate-openstack-ansible-os_monasca-ansible-func-ubuntu-trusty/02e1439/console.html#_2016-10-13_12_53_56_78895413:20
drifterzaAny advise ? I'm using an galaxy role for external dependancies and I can't work out why the dict is not being picked up.13:21
drifterzaAnyone that can do a review and help me, would appreciate it.13:21
odyssey4melogan- if you give the container an IP address - perhaps it'll work? that's pretty much the main difference I see here13:22
Jack_IvHi guys! Can anybody help me ? https://github.com/ansible/ansible-modules-core/issues/525013:22
logan-if i set ansible_host=10.100.100.2 it just tries to connect to ssh on 10.100.100.2 directly13:23
odyssey4medrifterza don't use that role - it requires hash merging enabled, which is a terribad idea13:23
odyssey4mehttps://github.com/sansible/users_and_groups#ansiblecfg13:24
*** drifterza has quit IRC13:26
*** agrebennikov has joined #openstack-ansible13:27
*** pjm6 has quit IRC13:27
*** janki has quit IRC13:28
openstackgerritMerged openstack/openstack-ansible-os_nova: Delegate from first available compute host  https://review.openstack.org/38522113:30
evrardjpI'm avoiding sansible like the plague13:31
*** williamcaban has quit IRC13:31
admin0is this also a known thing ? RetryError: HTTPConnectionPool(host='internal.stack31.com', port=8181): Max retries exceeded with url: /os-releases/13.3.5/ (Caused by ResponseError('too many 503 error responses',))13:31
*** fguillot has joined #openstack-ansible13:31
evrardjpI think it's time to kill these 50313:32
admin0killall -9 503’s didn’t work :D13:32
evrardjp:p13:32
admin0of 10 physical servers, fails on pip install -U lxc-python213:32
evrardjpadmin0: what are you running right now?13:32
admin0on one13:32
admin0doh !13:32
*** agrebennikov has quit IRC13:33
*** smatzek_ has quit IRC13:33
admin0openstack-ansible setup-hosts13:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova: Delegate from first available compute host  https://review.openstack.org/38599113:37
*** haad1 has quit IRC13:37
admin0starting fresh again ..13:39
odyssey4meJack_Iv perhaps evrardjp can assist, I think he's got a setup to test something like that13:40
Jack_Ivodyssey4me, Thanks!13:41
*** haad1 has joined #openstack-ansible13:41
Jack_Ivevrardjp, If you are not busy, take a look, please https://github.com/ansible/ansible-modules-core/issues/525013:41
odyssey4meoh yes, logan- FYI there should be non-voting checks on os_neutron now for the calico environment13:42
logan-nice!13:42
logan-thanks13:42
odyssey4melogan- now we just need a test patch up to see if it works :)13:42
logan-haha yeah i was just looking at https://review.openstack.org/#/q/project:openstack/openstack-ansible-os_neutron to see if anything checked yet13:43
logan-nothing since the 8th13:43
evrardjpJack_Iv: I can't right now, my openstack playtoys are in rebuilding13:43
evrardjpbut I will follow this issue13:44
Jack_Ivevrardjp, Thank you!13:44
openstackgerritLogan V proposed openstack/openstack-ansible-os_neutron: Testing Calico check  https://review.openstack.org/38599213:44
*** markvoelker has joined #openstack-ansible13:47
*** aludwar has joined #openstack-ansible13:48
odyssey4meandymccr perhaps you'd care to review https://review.openstack.org/378930 now?13:53
odyssey4meseeing as you're aware of how it all works :)13:53
*** rgogunskiy has joined #openstack-ansible13:56
ionicloudnull, i did not managed to fix the novnc issue. I just tested on a newly installed env and i can replicate it13:56
odyssey4meioni can you register a bug please with the steps & config to reproduce?13:57
ioniodyssey4me, ok13:57
*** adrian_otto has quit IRC13:57
*** smatzek_ has joined #openstack-ansible13:57
odyssey4meioni you may need to include something like an apt package list too, just in case13:57
odyssey4meperhaps just have that in a gist for review13:57
ioniodyssey4me, ok, i'll mention the configuration13:58
ioniodyssey4me, i'll also test your patch related to nova-key distribution14:00
*** evrardjp has quit IRC14:00
*** evrardjp has joined #openstack-ansible14:00
*** adrian_otto has joined #openstack-ansible14:01
odyssey4mecloudnull argh, now that the OSIC nodepool max is low we're hitting all the build timeouts again14:01
*** jmckind has joined #openstack-ansible14:02
odyssey4meioni not my patch - jmccrory's :) I just did the backport14:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Prevent overlayfs use in test when kernel < 3.18 or release == trusty  https://review.openstack.org/35177614:07
*** sdake_ has quit IRC14:09
*** sdake has joined #openstack-ansible14:10
*** rromans has quit IRC14:11
*** rromans has joined #openstack-ansible14:11
*** agrebennikov has joined #openstack-ansible14:14
*** jamesdenton has joined #openstack-ansible14:14
openstackgerritMerged openstack/openstack-ansible: Fix container log bind mount regression  https://review.openstack.org/38582114:14
*** openstackgerrit has quit IRC14:18
*** openstackgerrit has joined #openstack-ansible14:19
*** Oku_OS-away is now known as Oku_OS14:22
*** spotz_zzz is now known as spotz14:22
cloudnullevrardjp: regarding https://review.openstack.org/#/c/385800 mind removing -2 even if you disagree? also why would we want to remain on a dynamic hardware address for containers which we know will be longed lived and we know will cause terrible issues (specifically in neutron) should a container be restarted?14:23
cloudnulleven if we're generating the mac in the same way being done before?14:23
cloudnullwe're just simply not allowing it to regenerate14:24
asettlecloudnull mattt andymccr d34dh0r53 hughsaunders b3rnard0 palendae Sam-I-Am odyssey4me serverascode rromans erikmwilson mancdaz _shaps_ BjoernT claco echiu dstanek jwagner ayoung prometheanfire evrardjp arbrandes mhayden scarlisle luckyinva ntt javeriak automagically spotz vdo jmccrory alextricity25 jasondotstar admin0 michaelgugino ametts v1k0d3n severion bgmccollum darrenc JRobinson__ asettle coli14:27
asettlenmcnamara thorst adreznec eil39714:27
asettleqwang nishpatwa_14:27
asettleGUYS DONT FORGET MEETING  in an hour and a half :D14:27
asettleI will be your host14:27
asettleGet jiggy with it14:27
cloudnullwooo.14:27
hughsaunderssuch ping so asettle14:27
cloudnullWOW!14:27
adreznecmuch early wow14:27
odyssey4measettle look at you, getting the time right and errithing14:27
prometheanfireasettle: you're turn?14:27
asettleodyssey4me: I know, tell me about it.14:27
asettleprometheanfire: DDAMN STRAIGHT14:27
asettleI'm taking over this joint14:27
prometheanfirek14:28
asettleadreznec: I just like to get you all pumped up, you know?14:28
asettlePREPARE14:28
admin0 i use self-generated HW:address :) tied to the ip bits14:28
admin0makes troubeshooting easier )14:28
asettleJust so everyone gets in the appropriate mood for hte kind of meeting I"ll be hosting: https://www.youtube.com/watch?v=Dmt45BF5SOM14:28
admin0asettle: meetings here: https://www.youtube.com/watch?v=BWPnjp12W5o14:29
* prometheanfire was hoping she'd catch that14:29
admin0recommended watch :)14:29
admin0office safe :)14:29
*** chris_hultin|AWA is now known as chris_hultin14:30
asettleAnd SO is the Lion King14:30
asettleThis is a dictatorship and I rule. Everyone watch the Lion King video plz.14:31
* asettle takes over in highly dramatic fashion14:31
hughsaundersasettle: you're planning a coup?14:31
asettlehughsaunders: when *dont* I plan a coup?14:31
cloudnulladmin0: ++14:33
admin0you watched :) “business.. business ..”14:33
* hughsaunders wonders what evrardjp thinks about that14:35
admin0all openstack flow/api images are old (not complete) .. you guys ( as in those in rackspace ) are the ones with a billion hours on it .. do you guys have an updated flow diagram ?14:35
evrardjpwhat?14:35
hughsaundersevrardjp: admin0's video14:35
admin0evrardjp is from where :D ?14:36
evrardjpA neighbour country14:36
prometheanfirethat was good14:36
admin0either belgium or germany :D14:37
admin0sorry france14:37
admin0germany is not metioned there14:37
prometheanfireneed to send that to a fiend I have over there14:38
evrardjpomg some parts are so true14:39
prometheanfireThe belgian parts? :P14:40
evrardjphe sounds obviously dutch14:40
prometheanfireshould send it to my belgian friend too :P14:40
odyssey4meheh admin0 I *just* registered this bug: https://bugs.launchpad.net/openstack-ansible/+bug/163309714:41
openstackLaunchpad bug 1633097 in openstack-ansible "Replace images with generated sphinx diagrams" [Wishlist,New]14:41
evrardjpwell the dutch part compared to the belgian part14:41
evrardjpthe belgian part isn't really accurate14:41
evrardjpbut the comparison is good14:41
admin0odyssey4me:  thanks14:41
odyssey4meadmin0 FYI the newton diagrams are reasonably up to date - we edited them for Newton - what do you think is wrong?14:41
admin0whats the belgiam part ?14:41
evrardjpjust watch it again then :p14:42
evrardjpand the restaurant part... it felt like amsterdam14:42
admin0not the location.. i mean the terms and how they start or what is involved in meetings14:43
admin0dutch is pretty accurate .. coffee and done14:43
*** adrian_otto has quit IRC14:44
evrardjpyup14:45
cloudnullodyssey4me: quick lets go recheck everyones jobs to get the nodepool max up :p14:47
odyssey4melol recheck them all14:47
odyssey4meeven the new infracloud is unable to complete an integrated build on time14:48
odyssey4meit gets very, very close14:48
odyssey4meoh good, all 3 jobs in the gate queue are on OSIC cloud1 - that's a good sign14:49
*** cmart has joined #openstack-ansible14:50
*** rgogunskiy has quit IRC14:51
odyssey4mecloudnull I take it that the OSIC 3500/3700 flavors relate to the Intel 3500/3700 SSD's?14:52
*** Andrew_jedi has joined #openstack-ansible14:53
*** omiday has quit IRC14:56
*** kylek3h has joined #openstack-ansible14:56
Andrew_jediFolks, can i use OSA with CentOS now ?14:58
prometheanfireiirc, yes14:59
prometheanfirethere's a centos gate right?14:59
prometheanfireor is that still wip?14:59
*** sdake has quit IRC15:00
cloudnullodyssey4me: yes.15:01
cloudnullwe're gating on 3 different hardware profiles.15:01
adreznecprometheanfire: I think there's centos gate (non-voting) for some projects15:02
cloudnulland collecting metrics on those15:02
adreznecNo integrated gate though15:02
adreznecSo still WIP, I guess15:02
prometheanfirek15:02
*** sdake has joined #openstack-ansible15:05
odyssey4meadreznec centos is in the integrated gate - but experimental only15:05
*** adrian_otto has joined #openstack-ansible15:05
adreznecodyssey4me: Ah ok, must have missed that15:05
odyssey4meAndrew_jedi not just yet - mgariepy has been slowing working through the various issues and is busy working on getting nova to work15:05
odyssey4meAndrew_jedi so we have all the infrastructure working, and voting on centos - and we have keystone, glance, cinder and neutron working on centos15:06
odyssey4menext steps are nova, then swift - then we have a minimum use-case for testing with an integrated build15:06
mgariepyAndrew_jedi, odyssey4me nova is getting further but i still have some issues.15:09
*** smatzek_ is now known as smatzek15:09
openstackgerritMerged openstack/openstack-ansible: Switch the repo_server role to master  https://review.openstack.org/38568415:10
openstackgerritMerged openstack/openstack-ansible: [docs] Add network config example for test and prod  https://review.openstack.org/38527215:10
*** phalmos has joined #openstack-ansible15:11
mgariepyAndrew_jedi, i'll do what I can to land it in Ocata15:13
*** phalmos_ has joined #openstack-ansible15:14
Andrew_jedimgariepy odyssey4me : Thanks!15:14
Andrew_jedimgariepy: Are you coming to Barcelona ?15:15
mgariepyAndrew_jedi, no, but i'll probably go to boston as it's only 4 hour drive from me.15:16
*** phalmos has quit IRC15:16
odyssey4meAndrew_jedi I'm pretty sure that mgariepy would love some help. :)15:16
Andrew_jedimgariepy: Gotcha!15:16
odyssey4meWe're all helping a bit... but most of the contributors are Ubuntu users - so we implemented CentOS support up to keystone/glance/cinder as a labour of love.15:17
odyssey4me(it took two cycles)15:17
Andrew_jediodyssey4me: That's what i have in mind. Getting some red hat shops to start trying out OSA instead of Director.15:17
odyssey4meThis is the last stretch, and totally doable with 2-3 people across all the integrated roles within this cycle.15:18
*** asettle has quit IRC15:18
*** dragonmaster has joined #openstack-ansible15:18
*** dragonmaster is now known as allanice00115:18
*** asettle has joined #openstack-ansible15:18
*** haad1 has quit IRC15:19
Andrew_jediodyssey4me: Got it. Let's see if we can convince some people to help out here. Having OSA support for CentOS will be in the best interest of people sitting with certain red hat licenses.15:23
*** afred312 has joined #openstack-ansible15:23
*** omiday has joined #openstack-ansible15:23
odyssey4meAndrew_jedi Yes, 'Operators' :)15:23
odyssey4meie not vendors15:23
*** weezS has joined #openstack-ansible15:24
Andrew_jediYep, exactly :)15:24
odyssey4meThat said, it would be awfully nice if the vendors decided to pitch in and consume the toolset we provide. :)15:25
mgariepyodyssey4me, indeed it would be nice.15:25
mgariepyquick questions: /etc/openstack_deploy/openstack_inventory.json can I destroy this file in order to get it updated with the latest config change i have made ?15:26
mgariepy^^ (it's on kilo)15:26
*** phalmos_ has quit IRC15:27
mgariepyI removed some nova_nova_conf_overrides in openstack_user_config for containers and it is stuck with the old value.15:28
mgariepyOr should I just edit the json file ?15:28
*** Andrew_jedi has quit IRC15:29
odyssey4memgariepy if you destroy that file, any existing containers will no longer be in your inventory15:29
odyssey4memgariepy so rather edit the file15:29
odyssey4memgariepy FYI In Newton thanks to palendae I believe we've made it clean up after itself. :)15:29
mgariepyhaha great.15:29
mgariepybut I have some policital issue before I can upgrade this small cloud ;)15:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [docs] Add network config example for test and prod  https://review.openstack.org/38604915:31
*** asettle has quit IRC15:33
*** asettle has joined #openstack-ansible15:33
*** fguillot has quit IRC15:38
*** irtermit- is now known as irtermite15:39
*** woodard has quit IRC15:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Prevent overlayfs use in test when kernel < 3.18 or release == trusty  https://review.openstack.org/35177615:43
*** woodard has joined #openstack-ansible15:43
*** appprod0 has joined #openstack-ansible15:45
*** Andrew_jedi has joined #openstack-ansible15:46
ionievrardjp, what do you mean "client locales"?  client as the one that opens the browser with the console?15:48
*** vishwanathj_zzz is now known as vishwanathj15:48
*** admin0 has quit IRC15:50
evrardjpyes, but also the system locales etc15:50
ioniok, client is also windows, same issue15:50
ioninothing changed15:50
odyssey4meany cores around, we need a rapid review of this backport please: https://review.openstack.org/38604915:50
openstackgerritMerged openstack/openstack-ansible: Change the common proxy cache manage tasks to be stateful  https://review.openstack.org/38575715:51
odyssey4mejmccrory automagically cloudnull d34dh0r53 stevelle mattt hughsaunders andymccr mhayden evrardjp asettle rromans backport review please: https://review.openstack.org/38604915:54
evrardjpok15:54
palendaeodyssey4me, mgariepy the scripts/inventory-manage.py file allows you to remove hosts, if that's what you're after15:55
palendaeBut simply re-running dynamic_inventory,py should update values15:55
odyssey4mepalendae in newton, not kilo15:55
palendaeAh15:55
* palendae cant' remember when that was addressed15:55
*** javeriak has joined #openstack-ansible15:56
asettleOn that note15:56
asettlecloudnull mattt andymccr d34dh0r53 hughsaunders b3rnard0 palendae Sam-I-Am odyssey4me serverascode rromans erikmwilson mancdaz _shaps_ BjoernT claco echiu dstanek jwagner ayoung prometheanfire evrardjp arbrandes mhayden scarlisle luckyinva ntt javeriak automagically spotz vdo jmccrory alextricity25 jasondotstar admin0 michaelgugino ametts v1k0d3n severion bgmccollum darrenc JRobinson__ asettle coli15:57
asettlenmcnamara thorst adreznec eil39715:57
asettleqwang nishpatwa_15:57
asettleMeeting in 5 minutes15:57
palendaeasettle, aye aye o715:57
asettleHAUL ASS TO MEETING ROOM 4 PLZ15:57
asettleFor those playing along at home, that's #openstack-meeting-415:57
odyssey4me#openstack-meeting-4 for the lazy15:57
* palendae taps ctrl-pgdown15:57
odyssey4melol15:57
palendaeThere, ass hauled15:57
*** woodard has quit IRC15:57
asettleMeeting in openstack-meeting-4 now hoomans :)16:01
*** phalmos has joined #openstack-ansible16:03
*** michaelgugino has joined #openstack-ansible16:03
*** hughmFLEXin has joined #openstack-ansible16:05
*** phalmos has quit IRC16:08
*** phalmos has joined #openstack-ansible16:14
*** allanice001 has quit IRC16:14
*** karimb has quit IRC16:16
*** hughmFLEXin has quit IRC16:18
*** Mudpuppy has quit IRC16:20
*** Mudpuppy has joined #openstack-ansible16:21
*** Mudpuppy has quit IRC16:25
*** hughmFLEXin has joined #openstack-ansible16:26
*** Mudpuppy has joined #openstack-ansible16:27
*** TxGirlGeek has joined #openstack-ansible16:36
palendaeDo we support Ansible 2.1 yet?16:37
odyssey4mepalendae in newton+ yes16:37
palendaeLooks like some of the modules will need at least 2.116:37
palendaeCool16:37
odyssey4mewe're shipping with 2.1.1 in newton16:37
odyssey4me2.1.2 is buggy16:38
odyssey4me2.2 is near RC IIRC - so if we need to do any module rewriting we should probably ensure we support 2.1 and 2.216:38
jmccrorydoes stable/newton still need to be able to run on 1.9?16:38
odyssey4mejmccrory it already can't16:38
stevelleez meeting, I didn't have to say anything :D16:38
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create: Generate Static MAC addresses for containers  https://review.openstack.org/38580016:38
jmccroryyeah, didn't think it did16:38
palendaeodyssey4me, Probably, yeah. Was mostly just looking at stuff in the upstream extras/core repos16:39
odyssey4me2.2 brings some pretty crazy performance gains, so I'd think we want to get on that ASAP - and possibly even make it so in newton16:40
palendaeCool16:40
palendaeI'll be out tomorrow and Monday, so module research will probably be slow til at least Tuesday16:40
odyssey4mepalendae if you put up an etherpad where you make notes, perhaps jmccrory will add to your notes seeing as he barely sleeps :p16:41
palendaeYep16:41
jmccroryi've looked at os_image a little while ago, it can pretty much a drop in replacement for our glance module16:41
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create: Generate Static MAC addresses for containers  https://review.openstack.org/38580016:42
*** sdake_ has joined #openstack-ansible16:42
palendaejmccrory, Nice16:42
odyssey4mejmccrory there was a recent update to our module for magnum - so that may need re-assessment16:42
jmccroryjust uploads images, from disk instead of url though so will also be more reliable and fix https://bugs.launchpad.net/openstack-ansible/+bug/153864216:42
openstackLaunchpad bug 1538642 in openstack-ansible "Cirros Image creation failures" [Undecided,In progress] - Assigned to Hugh Saunders (hughsaunders)16:42
cloudnullevrardjp odyssey4me updated based on some of your feedback16:42
cloudnullit'd be nice to get some more review on that.16:42
odyssey4mecloudnull evrardjp is out for the day16:43
*** woodard has joined #openstack-ansible16:43
odyssey4melogan- so the test scripts make some assumptions16:44
openstackgerritMerged openstack/openstack-ansible: [docs] Provide example configurations  https://review.openstack.org/38549616:44
odyssey4meone is that the ANSIBLE_INVENTORY is in {toxinidir}/tests/inventory16:44
odyssey4meunless otherwise told16:44
odyssey4mefor os_neutron we set https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tox.ini#L2616:44
palendaejmccrory, https://etherpad.openstack.org/p/osa-ocata-modules16:45
odyssey4mebecause that's the default inventory for most of the tests16:45
palendaeAlso added to the Summit etherpad16:45
odyssey4melogan- for the calico test it should get overwritten: https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tox.ini#L15416:45
*** fguillot has joined #openstack-ansible16:45
*** hughmFLEXin has quit IRC16:45
*** hwoarang has quit IRC16:45
*** sdake has quit IRC16:46
*** hughmFLEXin has joined #openstack-ansible16:46
*** hwoarang has joined #openstack-ansible16:47
logan-interesting odyssey4me. and yet we see a linuxbridge_agent running in the check. maybe we need to move that inventory setting into the setenv of the functional tests themselves16:47
logan-although if the ovs one is working...16:47
logan-ah I do see tox says it is using calico_inventory in the console log16:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests: Add more diagnostic info to Ansible playbook execution  https://review.openstack.org/38608216:48
odyssey4melogan- ^ that would be useful to figure out what's going on16:49
odyssey4mecloudnull jmccrory reviews please16:49
palendaeDebugging hooks are always useful16:50
*** woodard has quit IRC16:52
*** woodard has joined #openstack-ansible16:53
odyssey4mestevelle you're lurking too :) a review would be most kind16:54
*** hughmFLEXin has quit IRC16:54
stevellemuch multi-tasking16:54
stevellegood thing we like multi-tasking16:55
cloudnullI think we need to figure someting out here https://review.openstack.org/#/c/385800/ -- evrardjp may be against the approach and that's fine but we need to do something. In Mitaka > Newton (same with liberty > mitaka) there is at least 1 manditory container restart which can, and will, make l3 tenant (using the linuxbridge or OvS agent) networks unusable should a deployment be using l2pop (which many clouds are if they'16:55
cloudnullre long lived).16:55
cloudnullinsight would be greatly appreciated.16:55
*** hughmFLEXin has joined #openstack-ansible16:56
odyssey4mecloudnull I think a bug report giving more detail about what the problem is would go a long way to helping reviewers understand why it's needed16:57
odyssey4meeither that or the commit message needs to be more whitespace, more sentences, and less brain dump16:57
odyssey4meon initial review I had no idea that this was to assist with upgrades16:58
*** weezS has quit IRC16:58
cloudnullnot really upgrades. just issues with rotating macs when a container is restared16:59
cloudnullupgrades cause that16:59
mhaydenasettle: thanks for doing the meeeeeeting16:59
*** vishwana_ has joined #openstack-ansible16:59
cloudnullbut there are plenty of reasons that a container would need to be restarted.16:59
cloudnullalso more data is in the release note.16:59
*** fops has quit IRC16:59
cloudnulland the inline comment17:00
*** sdake_ is now known as sdake17:01
palendaefor neutron/rabbitmq, changing the MAC address on a simple restart seems pretty bad to me17:01
palendaeUpgrade or no17:01
cloudnull^17:01
palendaeI don't know enough about the ARP layer to respond to evrardjp's comment though17:02
asettlemhayden: you're most welcome. I think I'm fired though :p17:02
*** vishwanathj has quit IRC17:03
asettleI made bad jokes and did wrong things.17:03
asettleAll the above.17:03
palendaeasettle, How's that different from any other day? >.>17:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [docs] Provide example configurations  https://review.openstack.org/38609117:03
palendaecloudnull, iirc only neutron and rabbitmq do the heavy lifting inside containers, right?17:03
palendaeCompute is always on a physical host so it matters less there17:03
cloudnullmariadb could be in that group too17:04
asettlepalendae: usually I tend to do the write things and make bad jokes (hahahahha ahhh too funny i'll see myself out)17:04
cloudnullthough i've not seen issues with rotating macs w/ regard to maria17:04
palendaeGothca17:04
palendaeMy initial thought was computes, but then I remembered those are pretty much all physical17:04
palendaeI suppose someone could do those in containers with the right storage set up, but I've not seen one of those17:04
palendaeasettle, Did you start with the wine early today?17:04
odyssey4meanother backport review please cores: https://review.openstack.org/38609117:05
*** phalmos has quit IRC17:06
odyssey4mecloudnull yeah, understood - honestly I didn't realise that LXC did that17:06
odyssey4mejmccrory automagically cloudnull d34dh0r53 stevelle mattt hughsaunders andymccr mhayden evrardjp asettle rromans backport reviews please: https://review.openstack.org/38609117:07
palendaeodyssey4me, LXC is pretty hands off in a lot of cases17:08
spotzI feel left out:(17:08
palendaeIt could use a few more smarts sometimes17:08
odyssey4mepalendae well, it kinda should be17:08
palendaeodyssey4me, configurable smarts :p17:08
odyssey4meI I did assume that once a NIC for a container was created, it retained its MAC over restarts17:09
odyssey4meI guess that I shouldn't have assumed that they worked like VM's. :p17:09
cloudnullI knew this was happening however in doing the Liberty > Mitaka upgrade I got to experience the issues first hand at scale under load.17:09
cloudnullI wasn't aware it was a problem17:09
cloudnulluntil a couple of days ago.17:09
palendaeYeah, sounds like it was only uncovered with load17:09
odyssey4meoh yeah, I can imagine the L3 down time must have been terribad17:10
cloudnullyea. we have roughly 2k vms running and l3 went down17:10
odyssey4mehaving to rebuild the routing tables due to a new MAC - that's some awful down time right there17:10
cloudnullto recover we had to nuke the vxlan interfaces and restart the linuxbridge agent17:10
cloudnullFDB was all pissed off on the compute side while everything looks happy on the neutron_agent side.17:11
cloudnullit was only after noticing the mac changed that I went down this rabbit hole17:11
odyssey4mecloudnull punch please? https://review.openstack.org/38608217:11
asettlepalendae: lol if only. Still working, can't wine.17:12
*** kjw3 has joined #openstack-ansible17:12
odyssey4mestevelle cloudnull also, punch this backport please? https://review.openstack.org/38609117:12
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [docs] Add network config example for test and prod  https://review.openstack.org/38604917:13
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create: Generate Static MAC addresses for containers  https://review.openstack.org/38580017:14
*** appprod0 has quit IRC17:14
* palendae piles on the review train17:15
palendaehttps://review.openstack.org/#/c/385271/ is a fairly easy one17:15
palendaeI think from a new contributor17:15
chris_hultinGot a question: I'm looking at the global overrides section of openstack_user_config.yml, and looking at the "container_interface" and "host_bind_override" values, but my hosts all have different devices for the same network17:29
openstackgerritMerged openstack/openstack-ansible-tests: Add more diagnostic info to Ansible playbook execution  https://review.openstack.org/38608217:31
*** hj-hpe has joined #openstack-ansible17:36
*** Mudpuppy_ has joined #openstack-ansible17:37
*** Mudpuppy has quit IRC17:40
*** appprod0 has joined #openstack-ansible17:43
*** hughmFLEXin has quit IRC17:44
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Move flush handles to the end of the tasks  https://review.openstack.org/38610917:47
*** hughmFLEXin has joined #openstack-ansible17:49
*** phalmos has joined #openstack-ansible17:50
*** cathrichardson has quit IRC17:53
*** cfarquhar has joined #openstack-ansible17:55
*** weezS has joined #openstack-ansible17:56
odyssey4mebtw afk for a while17:56
*** cathrichardson has joined #openstack-ansible17:57
*** javeriak has quit IRC17:59
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_heat: Add os_heat role functional tests for gate  https://review.openstack.org/38279018:02
*** shanec has joined #openstack-ansible18:03
*** appprod0 has quit IRC18:04
*** rgogunskiy has joined #openstack-ansible18:07
*** shanec_ has joined #openstack-ansible18:07
jrossercloudnull: for some other non openstack stuff we turn ip into mac addr via <const>:<const>:<const>:<lower-3-octets-of-ip>18:07
jrosserthat guarantees uniqueness in the l2 domain and makes everything completely deterministic18:07
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create: Generate Static MAC addresses for containers  https://review.openstack.org/38580018:08
*** rgogunskiy has quit IRC18:08
*** shanec has quit IRC18:09
cloudnullawesome!18:09
cloudnulljrosser: might you have a script or function that does that which you'd be interested in sharing?18:10
cloudnulli can make one. but it's easier if you already have an implementation .18:10
cloudnulland im lazy :)18:10
*** Andrew_jedi has quit IRC18:11
openstackgerritMerged openstack/openstack-ansible: Prevent overlayfs use in test when kernel < 3.18 or release == trusty  https://review.openstack.org/35177618:12
jrosserits just a mass of yaml files that then turn into our dhcp/dns config18:13
jrosservery manual18:13
cloudnullok .18:13
stevellewe should rub some xslt on it18:13
cloudnullI will look at making a contraption18:13
*** rgogunskiy has joined #openstack-ansible18:13
*** rgogunskiy has quit IRC18:14
*** fops has joined #openstack-ansible18:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Prevent overlayfs use in test when kernel < 3.18 or release == trusty  https://review.openstack.org/38612818:19
*** sdake_ has joined #openstack-ansible18:19
*** sdake has quit IRC18:20
*** javeriak has joined #openstack-ansible18:22
openstackgerritMerged openstack/openstack-ansible: Remove xrange for run both Python 2 and Python 3  https://review.openstack.org/38527118:23
*** Andrew_jedi has joined #openstack-ansible18:23
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create: Generate Static MAC addresses for containers  https://review.openstack.org/38580018:23
*** gouthamr has quit IRC18:24
*** vishwana_ has quit IRC18:27
*** vishwanathj has joined #openstack-ansible18:28
*** phalmos has quit IRC18:29
*** phalmos has joined #openstack-ansible18:31
jrossercloudnull: if you use that ipv4 <> mac mapping something nicely magical happens when you make an eui-64 ipv6 address :)18:33
*** Jack_Iv has quit IRC18:35
*** Jack_Iv has joined #openstack-ansible18:35
cloudnulloh. good point. OUI + FF FE + NIC == WIN!18:35
openstackgerritMerged openstack/openstack-ansible-os_heat: Add os_heat role functional tests for gate  https://review.openstack.org/38279018:36
cloudnullno more manual config, no need for DHCP :)18:36
cloudnulltyvm RFC237318:37
*** Andrew_jedi has quit IRC18:37
palendaecloudnull, That's weird math for getting Windows18:39
cloudnullha.18:39
*** hughmFLEXin has quit IRC18:41
*** hughmFLEXin has joined #openstack-ansible18:44
*** chris_hultin is now known as chris_hultin|AWA18:45
*** shanec_ has quit IRC18:46
*** Jack_Iv has quit IRC18:48
*** Jack_Iv has joined #openstack-ansible18:49
*** michauds has joined #openstack-ansible18:49
*** galstrom_zzz is now known as galstrom18:49
*** admin0 has joined #openstack-ansible18:50
jrollit looks like osa-ironic doesn't use upper-constraints when not in dev mode, is that intentional? https://github.com/openstack/openstack-ansible-os_ironic/blob/stable/mitaka/tasks/ironic_install.yml#L5118:53
jroll(in mitaka)18:53
jrollactually, in master too18:54
admin0hi .. i have a stuck task:    start cluster with wsrep18:54
admin0latest stable/mitaka18:54
jrollhttps://github.com/openstack/openstack-ansible-os_ironic/blob/master/tasks/ironic_install.yml#L5018:54
*** gouthamr has joined #openstack-ansible18:54
admin0sorry .. i meant newton18:55
admin0stable/newton18:55
openstackgerritMerged openstack/openstack-ansible-os_swift: Use dictionary for service mappings  https://review.openstack.org/38585218:56
odyssey4mejroll yes, because it's expected that when not in dev mode you're using the integrated build - where we use u-c19:00
odyssey4meif you aren't then you should know what you're doing19:00
admin0hi odyssey4me .. know a quick fix for start cluster with wsrep ?19:00
odyssey4mejroll I expect that we're going to have to change all that in the next cycle or two as disparate requirements for projects become more of a thing19:01
jrollodyssey4me: ah, ok, I'm not aware of this integrated build thing... can you point me at that?19:01
*** sdake has joined #openstack-ansible19:01
odyssey4meadmin0 yes, the docs tell you how to rebootstrap19:01
admin0its at setup-infra time19:01
odyssey4mejroll  https://github.com/openstack/openstack-ansible19:01
jrollodyssey4me: for context, looking at https://bugs.launchpad.net/openstack-ansible/+bug/1632436/ and thinking it's a dependency issue19:01
openstackLaunchpad bug 1632436 in openstack-ansible "os_ironic uses wrong keystone_authtoken config keys" [Undecided,In progress] - Assigned to Charles Farquhar (cfarquhar)19:01
admin0i did followed the docs to do  the galera-boostrap command19:01
admin0but stuck @ the same place19:01
admin0its greenfield .. so will delete all galera containers and give it another shot19:02
odyssey4mejroll these are the pinned SHA's for the most recent mitaka tag: https://github.com/openstack/openstack-ansible/blob/13.3.4/playbooks/defaults/repo_packages/openstack_services.yml19:02
jrollodyssey4me: oh, the main thing, I'll poke around19:02
*** shanec_ has joined #openstack-ansible19:02
jrollodyssey4me: so libraries aren't pinned via u-c then?19:02
odyssey4methat'll help you figure that out - we use that sha's u-c as a python requirements upper bound19:03
jrollah ok19:03
odyssey4mejroll whatever's in u-c is the pin19:03
odyssey4mejroll we update those SHA's every two weeks - I'll be doing a release tomorrow and updating the pins19:03
jrollodyssey4me: okay, this makes sense, thanks19:04
*** sdake_ has quit IRC19:04
odyssey4mewe only do the services from git sources - we rely on their requirements to determine which libraries to get and use u-c for the upper bound19:04
* jroll hrms at this bug then19:04
*** hughmFLEXin has quit IRC19:05
odyssey4meheh, that kinda makes sense - conductor doesn't use the keystone_authtoken section I don't think19:05
odyssey4meonly the API ever will as it's the only thing that needs to talk to users and other services, right?19:06
jrollthe API uses it for validating tokens, the conductor uses it for talking to glance and neutron19:06
odyssey4meI wonder if that config section should even be read by conductor19:06
odyssey4meah19:06
odyssey4meso one is using keystoneauth1 and another is using python-keystoneclient19:06
*** adrian_otto has quit IRC19:07
jrollwell, the api uses keystone_middleware in mitaka, and the conductor just uses service clients19:07
jrolle.g. python-neutronclient19:07
jrollI believe, I'd have to look again19:07
odyssey4methat would make sense - and is why it's breaking19:07
*** adrian_otto has joined #openstack-ansible19:07
odyssey4mefor the other services - aren't there their own sections with their own auth creds?19:08
jrollidk, we test admin_username etc in CI19:08
*** hughmFLEXin has joined #openstack-ansible19:08
jrollin newton, yes, not in mitaka19:08
odyssey4meit perhaps falls back to using keystone_authtoken if there aren't any19:08
jrolle.g. neutron: https://github.com/openstack/ironic/blob/stable/mitaka/ironic/dhcp/neutron.py#L8119:08
odyssey4meoh dear, then it's all brokenness19:09
odyssey4mebasically you have two incompatible library consumers19:09
odyssey4meso the only way to fix it is to either disable auth, or to find the last available library that supported both the new configs and the old19:09
jrollwell, no, we test admin_tenant_name, admin_user, and admin_password in CI19:09
jrolland it works fine in the api as well19:10
odyssey4methen we have the ability to override the upper constraint for that environment19:10
odyssey4meok, if you can get a pip freeze for a working set, with a working config into that bug log then andymccr and I can take a peek in the morning19:11
jrollalthough... CI is keystone v2, idk what version mitaka OSA deploys, maybe that's why19:11
jrollsure19:11
odyssey4meaha, yes19:11
odyssey4methe issue is the use of keystone v319:11
jrollI'd think the authtoken middleware could use both... maybe not.19:11
odyssey4mealright, that's easy enough then - for the ironic deployment just force the use of keystone v219:11
jrollok, yeah, we didn't fully support v3 in mitaka19:11
jrollyep19:11
jrollwant me to make a note there?19:12
jroll(already doing it)19:12
odyssey4meyeah - just note that keystone v3 will not work with ironic for Mitaka19:12
ionijust noticed something19:12
odyssey4meso the service catalog must have v2 endpoints and you must use it19:12
ionithe containers do not retain the system timezone19:12
ionithe new ones19:13
ionithe old ones do19:13
jrollcfarquhar: ^^ fyi, keystone v2 vs v319:13
*** shanec_ has quit IRC19:13
odyssey4mestevelle jmccrory anyone around for the second backport review? https://review.openstack.org/#/c/386128/19:13
jrollodyssey4me: thanks for the help :)19:14
*** shanec_ has joined #openstack-ansible19:14
cloudnullioni: the system timezone isn't being inherited ?19:14
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [docs] Provide example configurations  https://review.openstack.org/38609119:14
ionicloudnull, no19:14
cloudnullhum.19:14
ioniroot@ctrl1:~# date19:14
ioniThu Oct 13 22:14:39 EEST 201619:14
ioniroot@ctrl1:~# ssh ctrl1_gnocchi_container-700ecc6719:14
ioniroot@ctrl1-gnocchi-container-700ecc67:~# date19:15
ioniThu Oct 13 19:14:42 UTC 201619:15
ionithat's why it was messing with ceilometer and gnocchi19:15
ioni:D19:15
odyssey4meyeah, the TZ is a setting in /etc19:15
odyssey4meso why would it be19:15
cloudnullioni: can you ``cat /etc/localtime``19:15
ioniodyssey4me, the old container that i didn't destroy, still have the EEST timezone19:15
ionicloudnull, container or host?19:15
cloudnullboth19:16
odyssey4mewe could probably fix that up by changing it in the image19:16
odyssey4methe cache I mean19:16
ionicloudnull, sure you want cat?19:16
cfarquharThanks jroll and odyssey4me19:16
ionicloudnull, https://paste.xinu.at/u0I94l/19:16
*** jcrst has joined #openstack-ansible19:16
cloudnullls -al /etc/localtime to localtime if its a link19:16
ioninot a link19:17
ionignocchi container i destroyed today19:17
odyssey4meok, going afk again for a bit19:17
cloudnullok.19:17
ionialong with ceilometer19:17
cloudnullmy hosts are both /etc/localtime -> /usr/share/zoneinfo/Etc/UTC19:17
ionisadly i don't setup my controller and compute nodes to utc19:18
ionii should do that19:18
*** javeriak has quit IRC19:18
cloudnullim always on /usr/share/zoneinfo/Etc/UTC that's interesting though we should change that to ensure they're in-sync19:18
ionisomething changed in stable/newton compared with mitaka19:19
ioniit's the first time i destroyed through a container19:19
odyssey4mecloudnull just add it to the files to copy over into the cache in the lxc_hosts role19:20
cloudnullso you're host is on /usr/share/zoneinfo/EET right?19:20
cloudnullodyssey4me: yea that's what I'm thinking we can do19:20
ionieest19:21
ionicloudnull, EEST19:22
*** klamath_ has joined #openstack-ansible19:26
*** klamath has quit IRC19:26
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts: Copy system localtime when creating container cache  https://review.openstack.org/38618719:27
cloudnullioni: ^19:27
ionicloudnull, going to test it now19:29
ionii guess setup-hosts should fix that19:30
cloudnullit'll fix it in the base container.19:30
cloudnullsadly it wont do much for your existing containers.19:30
cloudnullyou can change the  /etc/localtime  in your existing containers or you can push the file from the hosts into the containers.19:31
cloudnullI'll looking at an upgrade step right now to ensure we get that right too,19:31
ionihmm19:32
ioniok, maybe the upgrade step are going to hurt somebody19:32
ionii'm ok with keeping the same timezone at create19:32
*** klamath_ has quit IRC19:33
*** asettle has quit IRC19:34
*** karimb has joined #openstack-ansible19:35
openstackgerritMerged openstack/openstack-ansible: [docs] Add network config example for test and prod  https://review.openstack.org/38604919:35
*** jcrst has quit IRC19:35
*** TxGirlGeek has quit IRC19:45
*** TxGirlGeek has joined #openstack-ansible19:45
*** Jack_Iv has quit IRC19:48
*** dxiri has joined #openstack-ansible19:50
dxiriHi everyone!19:50
dxiriI just finished installing an AIO using openstack-ansible, but I have no idea about where to login into horizon or which credentials to use19:51
dxiriwhere can I find that?19:51
logan-dxiri: check sudo grep 'auth_admin' /etc/openstack_deploy/user_secrets.yml19:52
logan-that will give you the keystone auth admin password, which is your admin password for horizon19:52
*** TxGirlGeek has quit IRC19:54
dxirimmm, all is blank in there19:54
dxirioh no wait...wrong file,19:55
dxiriit does have a bunch of stuff but it's encrypted already19:55
ioni"encrypted"19:57
ionithe long string IS the password19:57
ioni:D19:57
dxiriomg really? lol19:57
ionia bunch of numbers and letters right?19:58
dxiriright, thought it was some md5-hash or something19:58
odyssey4mehttp://docs.openstack.org/developer/openstack-ansible/newton/install-guide/verify-operation.html#verifying-the-dashboard-horizon :)19:59
*** TxGirlGeek has joined #openstack-ansible20:00
*** weezS has quit IRC20:01
dxirithanks!20:02
dxiriroot@aio1-utility-container-1a690cbc:/# openstack user list20:02
dxiriAn unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-2a19fb1b-f9fb-4be4-90af-0f5bb8874128)20:02
dxiriseems like its not working yet20:02
dxiriand trying horizon gives me "secure connection failed" on firefox20:03
stevelleyou do have to 'source openrc' before the CLI would work, not sure if you got that dxiri20:06
dxirialready did :)20:06
*** chris_hultin|AWA is now known as chris_hultin20:06
*** weezS has joined #openstack-ansible20:06
dxiribut I think I know the problem20:06
stevelleyeah, I guess that error msg says yo udid20:06
dxiriI intended to put about 10gigs of ram on the VM20:06
dxiriturns out I put only 120:07
dxiri:P20:07
stevelle:D that could be an issue20:07
dxiriso probably a lot of services failed to start20:07
dxirihaha20:07
*** askb has joined #openstack-ansible20:07
ionidmesg20:07
ioniyou should see oom-killer if this is the case20:08
stevelleseems like galera would be pretty well non-functional under 1g, never mind other services20:10
odyssey4mewow, yes - 8 GB RAM min - otherwise it'll fall apart20:10
odyssey4medxiri what did you deploy - from stable/newton, or from the 14.0.0.0b2 tag?20:10
*** jcrst has joined #openstack-ansible20:11
*** johnmilton has quit IRC20:12
dxiri   14  git checkout stable/mitaka20:12
dxiri   16  git checkout 13.3.420:12
dxirithat20:12
dxiriisn't mitaka the stable one?20:15
odyssey4meah ok - yeah that's stable20:15
dxiricool20:15
odyssey4mewe're issuing the tag RC tag for newton tomorrow20:15
odyssey4meit *should* be the final tag before release next week thu20:15
*** javeriak has joined #openstack-ansible20:15
odyssey4meany testing you can do to help (and register bugs) would be appreciated :)20:17
dxirithis is whole new ground for me :) I'm really confortable with linux but this is completely different20:17
dxiriso many moving parts :)20:17
dxiribut sure!20:17
odyssey4mehaha, welcome to openstack20:17
dxirimy goal is to deploy a small 3 node cloud on our lab so we can spin up testing VMs that house some CDN software20:18
odyssey4mewell, then this may help you: http://docs.openstack.org/developer/openstack-ansible/install-guide/app-config-test.html20:18
*** adrian_otto has quit IRC20:18
*** openstackgerrit has quit IRC20:19
odyssey4methe newton version of that is almost merged, when it is you'll find new content in http://docs.openstack.org/developer/openstack-ansible/newton/install-guide/app-config-test.html20:19
*** openstackgerrit has joined #openstack-ansible20:19
dxiriuuuuuuuuu dude, this looks extremely similar :)20:19
dxirito what I want to do20:19
dxiriso, lets say I want to extend that in the near future, can I just add new nodes at will?20:20
odyssey4mecheck the prod setup for something similar, with a bit more variation20:20
*** javeriak has quit IRC20:20
dxirisay another controller for redundancy, or more block storage20:20
odyssey4meyep - you just add more hosts into the host groups that matter to you20:20
dxiribut the docs advise against re-running the whole thing again, so I guess you just need to run the specific playbooks you are after?20:21
odyssey4meif you don't want some services, you just don't put that group into your openstack_user_config.yml20:21
odyssey4meyou absolutely can run again - it's only the AIO that warns against running 'run-playbooks' again because the AIO is a dev tool20:21
odyssey4mefor production deployments you don't use run-playbooks - you run the playbooks directly20:22
odyssey4meie http://docs.openstack.org/developer/openstack-ansible/newton/install-guide/run-playbooks.html20:22
dxiriah, that makes sense :)20:23
odyssey4methe AIO is a development and CI tool - not meant for production - it does some funny networking stuff20:23
dxiriyep I noticed, but it was the simplest to start with20:24
dxiriso I can get to know how this is laid out20:24
dxirihorizon still doesn't want to come up :(20:24
dxiriopenstack user list is working now20:24
odyssey4meif you just rebooted, you may need to wait a bit20:25
dxiriis there such a thing as service horizon restart?20:25
odyssey4mebut due to the resource constraints it may also have blown up20:25
dxiriI rebooted about 10-15 mins ago20:25
dxiri10GB of RAM and 8vcpus20:25
odyssey4meyeah, you can lxc-attach into the horizon container and restart apache20:25
dxirithat's what I am running on20:25
odyssey4meor you can use ansible to reach into the container and do it for you :)20:25
dxirios-horizon-install.yml20:26
dxiriso just run that playbook again?20:26
odyssey4mejmccrory chris_hultin the os_magnum role tests keep timing out due to the very long build time - is there a way we can cut some of that time down?20:26
*** meteorfox has quit IRC20:27
odyssey4medxiri to use ansible to do anything you would do via shell you can use ad-hoc ansible commands20:27
chris_hultinodyssey4me: Do you know what part of it is taking the most time?20:27
odyssey4mechris_hultin I honestly haven't dug into the logs at all20:27
odyssey4mejust putting it out there in the hopes that someone does :)20:27
odyssey4medxiri see for example a shell command you may be familiar with: http://docs.openstack.org/developer/openstack-ansible/mitaka/install-guide/ops-galera-recovery.html#multi-node-failure20:28
odyssey4meansible <target_host> -m shell -a "<shell command to execute>"20:29
odyssey4medxiri so for instance to restart apache on all horizon hosts: ansible horizon_all -m shell -a "service apache2 restart"20:29
*** meteorfox has joined #openstack-ansible20:29
odyssey4meyou'll need to be in the /opt/openstack-ansible/playbooks directory for all ansible command execution20:29
*** smatzek has quit IRC20:30
dxiriI think I have a half baked install20:31
dxiriaio1_horizon_container-4b31ac5b | FAILED | rc=1 >>20:31
dxiriapache2: unrecognized service20:31
odyssey4meoh yeah, sounds like it20:31
*** javeriak has joined #openstack-ansible20:32
odyssey4metrash and rebuild the AIO - this time with enough RAM ;)20:32
dxiriyep, on it now20:32
dxiriI am having fun and boss is cool with this so no pressure :)20:32
odyssey4meFYI the secrets are randonly generated per install - that's why you thought it was 'encrypted'20:33
odyssey4mebefore the deploy you can change them to something else if you like20:33
odyssey4mebut once it's deployed you can't20:33
odyssey4mewe have a big read warning note about that :) http://docs.openstack.org/developer/openstack-ansible/newton/install-guide/configure.html#configuring-service-credentials20:34
odyssey4meanytime time for me to go afk again - have fun!20:34
*** rmelero has joined #openstack-ansible20:35
spotznight odyssey4me20:35
jmccrorychris_hultin odyssey4me : looks like it's ~40 minutes to set up everything required, and then the tempest tests taking the rest of the time20:38
dxiriodyssey4me: thanks a lot for all the help!20:38
chris_hultinjmccrory: Problem is, we need every bit of OpenStack, basically. Heat, Nova, Cinder, Identity, Neutron20:38
jmccroryyeah...20:38
evrardjpcloudnull: I'm back for a few moments. If you make it optional, wouldn't it fix my problem with that, and would it solve your problem?20:43
cloudnullyes. but we'd be turning it on by default on the services that matter (neutron, rabbitmq, galera) so it'd be optionally enabled by default.20:44
*** sdake has quit IRC20:44
cloudnullalso i'm failing to see what the net negative is ?20:44
agrebennikovhey odyssey4me, not sure you are a right person for this question, but still....20:45
agrebennikovthe dynamic inventory20:45
cloudnullif the mac is always changing which is now known to cause problems and we can stop that using the same general process used to generate the always changing mac what is the apprehension ?20:45
agrebennikovthere is a script for dyn inventory as well as group_vars folder20:45
agrebennikovam I supposed to change tha parameters in that folder ever?20:46
evrardjpcloudnull: we have to fix the root cause of the issue20:48
cloudnullwhich is the changing mac20:48
evrardjpwhy would that be a problem? fdb tables building is supposed to be fine20:48
evrardjpif I spawn up a new device on a network I am supposed to see it20:49
cloudnullright, and in an AIO that works fine.20:49
cloudnulladd 500 hosts and roughly 2000 vms and that goes away20:50
evrardjpso question20:50
cloudnullin the fullness of time it'd work.20:50
evrardjpdo we have to implement a workaround for all the cases, where it's not supposed to happen at the first time?20:50
cloudnullbut downtime while the fullness of time is taking place is not an option20:50
evrardjpbut what is the problem?20:51
evrardjpare the fdb tables full?20:51
evrardjpis the learning too slow?20:51
cloudnullno. they're wrong.20:51
evrardjpis the population failing?20:51
evrardjpshould we change the protocol for learning?20:51
cloudnulll2pop only pushes on changes.20:51
evrardjpand it's l2pop only?20:51
cloudnullso you see failed and stale entries20:51
evrardjpwell arp stale entries happen all the time20:52
evrardjpthey expire20:52
cloudnullthey will expire in the fullness of time.20:52
cloudnullthe fix then is to delete the vxlan interfaces20:52
cloudnulland restart the agents20:52
evrardjpwhich is dependent of the implementation we agree20:52
cloudnullthen let everything rebuild20:52
evrardjpwhich is definitely ugly I agree20:52
cloudnulland the root cause is a changed mac address20:53
evrardjpso the problem is the mac learning is too slow or doesn't scale for your use case20:53
evrardjpfixing the mac adress makes everything simple20:53
evrardjpbut won't solve any other issue you will have with your arp tables for the rest of your network20:53
evrardjpbut anyway, other question20:54
openstackgerritMerged openstack/openstack-ansible: Prevent overlayfs use in test when kernel < 3.18 or release == trusty  https://review.openstack.org/38612820:54
cloudnulladding a node into the stack will learn everything needed but dealing with those properties everytime we need to restart a container is bad.20:54
evrardjp2000vms 500 hosts, how much entries are we talking here20:54
evrardjphow much containers?20:55
evrardjpmany*20:55
evrardjpit's nothing much20:55
cloudnulljust a three node control plane20:55
evrardjpyeah20:55
cloudnullbut there's an entry for every compute node, tenant network, router, etc.20:55
evrardjpshouldn't we try to find what's the real cause here?20:55
*** smatzek has joined #openstack-ansible20:55
evrardjpI mean it looks like an interesting scaling issue problem20:55
cloudnullso why do you want to see a random mac on container restart?20:57
cloudnullhow is that better?20:57
evrardjpI don't care about the randomness or not -- I care about the base system to work20:57
evrardjpwe shouldn't have to hack20:57
cloudnullwhat's the hack?20:57
cloudnullgenerally speaking mac addresses dont change.20:58
evrardjphopefully we are not at static mac addresses, we are still at fixed dynamic mac address20:58
cloudnullIMO the hack is that they currently do20:58
evrardjpright?20:58
*** weezS has quit IRC20:58
evrardjpwell it was done for a reason20:58
*** sdake has joined #openstack-ansible20:59
cloudnullw hat was?20:59
evrardjpyou restart your container and boom it will force others to refresh their table for it with the new arp that comes with the new interface20:59
openstackgerritAndrey Grebennikov proposed openstack/openstack-ansible: Added "service_region" to user_variables.yml  https://review.openstack.org/38622520:59
evrardjpbut yes we can say it's fixed and not necessary20:59
evrardjpI don't argue negatively about having it "fixed" or not21:00
evrardjp(I hate the term static because it makes me think static arp entry)21:01
cloudnullwould 's/static/fixed/g' in the changes make it better ?21:01
evrardjpI argued about the fact that we should fix the problem with mac learning21:02
evrardjpwell it scares me less, but it's not the point ;)21:02
evrardjpall the code we have to carry for something that should work... I just don't like it21:03
evrardjpI will remove the vote and leave to others21:03
*** weezS has joined #openstack-ansible21:03
cloudnullmac learning works but i'd rather not take a cloud down while things are being learned.21:03
cloudnullwhich is compounded by agent intervals and general load.21:04
*** jamielennox is now known as jamielennox|away21:04
evrardjpyou had a learning storm21:04
*** karimb has quit IRC21:04
evrardjpfor your neutron container I guess then21:04
evrardjpyour neutron container restarted and then everything had to learn it!21:05
evrardjpis that  your pain?21:05
cloudnullyup. which includes the compute nodes.21:05
evrardjpyup21:05
cloudnullit was around an hour of downtime until we nuked the interfaces and restarted the agents.21:06
cloudnullin that hour some tenant networks came back21:06
evrardjpcorrupted fdb tables21:06
cloudnulllots of failed entries.21:07
evrardjpand using l2pop or using standard linux system learning vxlan mechanism?21:08
*** retreved has quit IRC21:08
evrardjpI guess standard21:08
*** retreved has joined #openstack-ansible21:09
cloudnullall pointing to devices no longer on the network.21:09
evrardjpwell it doesn't matter21:09
cloudnullwe're using l2pop21:09
cloudnullbut that's because this env has been up for a long while21:09
evrardjpcloudnull: yup that's what I understood21:09
evrardjpand because it's not static it's a pain to flush tables21:09
evrardjpwhere is bgp when we need it21:10
evrardjp:p21:10
cloudnullthat would've been nice21:10
evrardjpwell bgp evpn seems a good thing for your issue but even before going that far21:10
evrardjpI understand why you'd want to prevent this kind of possible errors21:11
evrardjpby having less moving parts for neutron21:11
evrardjpstill if I destroy a neutron instance and recreate a new one, it shouldn't take hours to converge21:11
evrardjp:p21:11
cloudnullthat's the thing. dstroy 1 / add 1 no big deal.21:12
cloudnullexcept for routers.21:12
cloudnullwhich are scheduled using the chance schduler21:12
cloudnulldistributing various routers throughout the stack21:12
cloudnullthat'll over within 5 min21:13
cloudnullunless l3ha is enabled21:13
evrardjplet's not go that far21:13
evrardjpwe have a problem right before that21:13
cloudnullour issue was load and scale.21:14
cloudnullwe cycled the containers all over 30 min period because we we're trying to roll the restart out without impacting uptime21:15
evrardjpyes indeed, but let's not change the architecture right now, because it's not that big21:15
cloudnullit didn't help21:15
evrardjpsure21:15
evrardjpwhy doesn't lxc for example drop the current mac address and reuse it21:15
evrardjplet's start with that21:16
cloudnullit does with that change :)21:16
evrardjpyes because you force it yourself21:16
cloudnulli mean i have code to handle it but setting a fixed mac is part of lxc21:16
cloudnullwe have a dynamic mac21:16
evrardjpI understand that we use the xx.xx.xx part21:17
evrardjpjust making sure it's the right thing too21:17
evrardjpwhy one first instantiation of the container, wouldn't the mac address be kept in the config?21:17
openstackgerritFrédéric Guillot proposed openstack/openstack-ansible-os_almanach: Add .gitreview file  https://review.openstack.org/38623321:18
openstackgerritCharles Farquhar proposed openstack/openstack-ansible-os_ironic: Configure ironic to use keystone v2  https://review.openstack.org/38623421:18
cloudnulllxc doesn't manage the config nor is there a daemon that keeps track of such things21:18
*** chris_hultin is now known as chris_hultin|AWA21:19
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: Create minor playbook to sync TZ data  https://review.openstack.org/38623521:22
evrardjpI hate bringing the proxy arp21:22
evrardjpon the table21:22
cloudnullhttp://www.funtoo.org/Linux_Containers21:22
cloudnull"It is a very good idea to assign a static MAC address to your container using lxc.network.hwaddr. If you don't, LXC will auto-generate a new random MAC every time your container starts, which may confuse network equipment that expects MAC addresses to remain constant."21:23
openstackgerritCharles Farquhar proposed openstack/openstack-ansible-os_ironic: Configure ironic to use keystone v2  https://review.openstack.org/38623421:24
cloudnullalso "LXD will setup a fixed MAC address for you (as a volatile key). You can either change that with “lxc config edit” or you can just add the macvlan nic device to the container directly and then set the hwaddr key there." -- https://www.stgraber.org/2016/03/19/lxd-2-0-your-first-lxd-container-312/21:24
cloudnullso in LXD they're system will do this for you.21:24
evrardjpI understand that network equipment don't like mac flapping21:25
evrardjp:p21:25
evrardjpI lost a switch once with that, but whatever, they are meant for that!21:26
evrardjpand it makes sense that lxd handles that properly21:26
evrardjpso it's a good step forward21:26
jrosseri have to deal with .1x mac auth21:26
evrardjpoh21:26
jrosserall this talk of random mac is making me feel quite unwell :)21:27
cloudnulldeath to random mac21:27
evrardjpwell it's not supposed to be random all the time21:27
evrardjpit's for the life of the container21:27
evrardjpwe are just fixing it for its multiple lifes in case of reboots21:28
evrardjpthat's the question right?21:28
evrardjplike I said above, I don't see a problem itself of having it fixed21:28
cloudnullyes. when the container is restarted it currently gets a new mac. and that makes cloud sad.21:29
*** fguillot has quit IRC21:29
evrardjpI just want to make sure the learning is fine, and resilient21:29
*** Andrew_jedi has joined #openstack-ansible21:29
evrardjpcloudnull: I understand the problem21:29
cloudnulland the internet seems to agree that defining a fixed mac makes cloud not sad. :)21:30
logan-i don't get why rabbit/galera keeps coming up21:30
evrardjpall of that we agreed21:30
*** michauds has quit IRC21:30
logan-just curious why would they be sensitive to mac address changes21:31
logan-network node makes sense, thats a lot of cam table entries to update, just not seeing the translation to rabbit/galera21:32
cloudnullgalera is an assumption due to it being part of a Synchronous cluster.21:33
cloudnullrabbitmq same thing however we know it has a lot more network sensitivity21:34
*** jheroux has quit IRC21:34
*** Jeffrey4l__ has quit IRC21:35
*** Jeffrey4l_ has joined #openstack-ansible21:35
evrardjplogan-: I don't know but I'm not surprised. Let's see this erlang conversation "I can't contact my container" "Please try to contact your container" " But I'm trying to contact it" "Do it again"21:35
evrardjpterrible joke21:35
cloudnullgenerally frustrations in erlang21:35
spotzaccurate though evrardjp21:35
evrardjpcloudnull: what if we template the mac address in the container-interface.ini.j2, and we use a conditional?21:36
evrardjpif dynamic: 00:16:3e:xx:xx:xx , and if not, boom, generated mac address?21:36
odyssey4meagrebennikov generally the ideal is that all config happens in user space - ie in /etc/openstack_deploy/ - never in the code tree itself21:37
cloudnulllike i said before, im ok with that. but what's the negative of just setting it?21:37
evrardjpwell that's not better21:37
evrardjpwhat I just proposed is terrible21:37
evrardjpignore this21:37
cloudnullletting it be dynamic has known downsides but is there an upside?21:38
evrardjpgod I wish the world would be v6 with static mac addresses and no privacy extensions + good firewalling21:38
*** shasha_t_ is now known as shasha_tavil21:39
evrardjpcloudnull: I guess it's due to our non-ephemeral nature of the containers21:39
evrardjpif it was ephemeral you'd probably prefer new macs/ips and grat arp21:39
odyssey4meour containers are not ephemeral though21:40
cooljsince we are treating containers like hosts it makes sense to have persistent hardware addresses. 2c.21:40
evrardjpthe question is what's the risk now for current existing things, and how do we upgrade21:40
odyssey4methey are long lived21:40
odyssey4methat's the point cloudnull brought up right at the start21:40
evrardjpthe transition seems ok and the workaround seems not bad21:40
odyssey4mewhy should our containers not be treated like VM's in a VMWare world?21:41
odyssey4meand if we choose to rebuild a container with a new MAC, so be it21:41
evrardjpwell maybe we should use lxd then21:41
neillcmorning21:41
*** javeriak has quit IRC21:41
odyssey4meI am with logan- on this though - let's be selective about where we do this. We treat some of our containers as ephemeral and some as not.21:41
evrardjpodyssey4me: oh I think we all agree21:42
odyssey4meThis will be a concept we need to start applying to upgrades soon to cut some of the upgrade nonsense that happens.21:42
evrardjpodyssey4me: I'd prefer see in the implementation: having it optional with the minimum of code to maintain21:43
evrardjpthat was my point21:43
evrardjpthe option could then simply be a var overriden in the group_vars21:43
odyssey4mecoolj FYI, treating them like hosts may just go away ;) but that doesn't change the fact that some are longer lived and that MAC consistency is important for easier transitions, even if we replace a container's content21:44
evrardjpdepending on which group21:44
odyssey4meevrardjp so yes, then switch to a -1 vote and allow the review process to achieve that21:44
odyssey4meand if the initial implementation merges and you don't like it, improve on it21:44
evrardjpdone21:44
odyssey4methis is very early in the cycle, there is a lot of time to try this out and see how it goes - then improve21:45
evrardjpbut that's what I said in my first comment21:45
odyssey4methis is why we have a 6 month dev cycle where nothing is released21:45
agrebennikovodyssey4me, so literally if I need to allow keystone region variable to be changed - I put the variable to the group_vars and explain how to specify it in the user_variables, right?21:45
odyssey4meagrebennikov no need - just add your var and value into user_variables.yml21:45
odyssey4methere is already a var for it in group vars, so all you do is override the var & value in user_vars21:46
evrardjpcloudnull: I still think l2pop was a terrible choice for the mac population in the tunnelz21:46
evrardjpbut not your fault :)21:46
odyssey4meagrebennikov that's why this is in the user_vars file: https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/user_variables.yml#L16-L1921:47
*** weezS has quit IRC21:48
*** javeriak has joined #openstack-ansible21:48
agrebennikovodyssey4me, I see now, thanks)21:50
odyssey4meagrebennikov so if you add 'service_region: RegionTwo' in user_variables.yml then that will override the value in group_vars21:51
agrebennikovodyssey4me, yep, I got it21:51
agrebennikovodyssey4me, we are pretty new to ansible, were in the puppet world before, so sometimes it is difficult to realize all these nuances21:51
agrebennikovespecially with vars overrides21:52
odyssey4meagrebennikov we do use variable precedence in a slightly odd way due to our desire to try and separate code from config21:54
odyssey4mewe're getting better at simplifying things21:54
*** jamielennox|away is now known as jamielennox21:55
*** spotz is now known as spotz_zzz21:59
*** jperry has quit IRC22:00
agrebennikovodyssey4me, did you guys actually try to deploy osa into different regions with shared keystone?22:03
odyssey4meagrebennikov sure, it has been done - typically with individual inventories per region22:03
agrebennikovlike when I deploy the first cloud entirely, and then change the region and update inventory leaving same keystone nodes22:03
odyssey4meie each region is its own deployment22:04
odyssey4meyou can then setup a global cluster if you want, or a central keystone - it all depends on the architecture you're looking for22:04
agrebennikovno, my question is if I need same keystone nodes in the second region22:04
odyssey4meok, so you want to use the same keystone back-end for multiple regions?22:04
*** jmckind has quit IRC22:04
odyssey4mesame keystone endpoints22:04
agrebennikovnot just the backend22:05
cloudnullok im off, cheers all.22:05
agrebennikovodyssey4me, nope)) have same keystone services, but have another set of endpoints with another region name22:05
odyssey4meso dyou you want to setup the db and service independently - then have multiple compute/object storage regions use that set?22:05
agrebennikovodyssey4me, pretty much like that, but I can set up keystone together with the first region22:06
agrebennikovbut it doesn't really matter22:06
odyssey4methere are many ways to skin that cat22:06
odyssey4meok, so setup region one with everything22:06
cooljlater cloudnull22:06
agrebennikovso literally the second region will have to utilize existing keystone22:07
*** jamesdenton has quit IRC22:07
agrebennikovdoes it work fine?22:07
agrebennikovfrom the OSA perspective I mean22:07
odyssey4methen for region 2, don't allocate any hosts to the identity_hosts host group - and for that setup override all the galera/keystone settings to use the first one22:07
odyssey4meoh sure - it will be a lot of variable overriding and a bit of a pain to get setup - but it'll work22:07
agrebennikovodyssey4me, ah, I see22:07
agrebennikovwell, will try really soon))22:08
logan-agrebennikov: i've been looking at this multi region stuff some lately. what odyssey4me is what i'm looking at doing for a 1st phase. full osa stack in region 1, separate osa deployment/inventory in region 2 with no keystone or horizon.22:08
logan-the more resilient way to do it is put keystone on a separate galera cluster that spans both regions22:08
agrebennikovlogan-, agree22:09
logan-https://openstack.nimeyo.com/58101/openstack-operators-milti-site-keystone-%26-galera https://etherpad.opnfv.org/p/multisite_identity_management have some great info about that22:09
odyssey4meyes - the far better way is to create a global galera cluster and use the capabilities it has to do wan sync22:09
odyssey4methen use that for your keystone endpoints in each region22:09
*** thorst has quit IRC22:09
odyssey4methat way each region has 2 or more galera nodes, but the data is synchronised across all regions22:10
odyssey4meone data back-end, regional endpoints22:10
logan-yep-- i think for phase one we're going to have keystone in one region only, and then once we work thru the logistics of managing the multi-region galera cluster and the config tuning differences from the regular galera setup, we'll migrate to keystone per region22:10
odyssey4mebut if you do that, be sure to use fernet tokens :)22:10
agrebennikovodyssey4me, I completely disagree with this approach22:10
agrebennikovI mean replicate keystone galera22:10
*** Andrew_jedi has quit IRC22:11
odyssey4meof course another way is to use an LDAP back-end, with local DB's which are only used for shadow accounts and services22:11
agrebennikovwe debated with keystone folks on the last summit regarding exactly this point22:11
agrebennikovright22:11
agrebennikovsomething like that22:11
*** TxGirlGeek has quit IRC22:11
odyssey4meall-in-all there are many options, and all of them are possible - it really depends on your environment and usage profile22:12
agrebennikovbut right now I have a bit another usecase - it is literally centralized keystone, not 2 different ones with shared DB22:12
odyssey4mesure, that is often how people start22:13
openstackgerritMerged openstack/openstack-ansible: [docs] Provide example configurations  https://review.openstack.org/38609122:13
agrebennikovthat's how real customer manages 20 clouds of 3000 nodes overall right now :(22:13
odyssey4meanother deployment model often discussed is centralised keystone and horizon, them regionalised compute which use the centralised keystone22:13
agrebennikovthis ^^ is the model I'm talking about right nwo22:14
agrebennikovnow22:14
agrebennikovI personally don't like it22:14
agrebennikovI prefer having fully independent clouds with same ldap backend for users, same roles IDs and tenants created automatically based on the ldap groups22:15
logan-http://cdn.pasteraw.com/s5nd9xtvwzdxo0lmhsxsqgtndmqm2ss is a POC I did to set up something similar to what you're saying agrebennikov. you would set up your regionOne as normal. and this config would be part of your regionTwo deploy22:15
agrebennikovthat's how you get your fernet token valid in both clouds22:15
odyssey4mehaha, if only we could be handed decisions we liked all the time - wouldn't life be grand? :)22:16
openstackgerritBjoern Teipel proposed openstack/openstack-ansible-os_cinder: Add remote procedure call tunables to cinder  https://review.openstack.org/36074922:16
logan-so as odyssey4me was saying, no identity_hosts defined in regionTwo, and this would null out your horizon deploy in regionTwo also.22:17
agrebennikovodyssey4me, well, I'm pretty lucky - I managed to get my customer share my point of view22:17
odyssey4meyep, although you wouldn't need to modify the env.d/horizon file in newton - you could just use the more granular host groups and opt to not deploy the dashboard_hosts22:18
agrebennikovlogan-, does master_region_keystone_address exist in the playbooks?22:18
logan-no it is a variable i created to reflect the keystone endpoint in regionOne22:18
agrebennikovlogan-, or it is something specific?22:18
agrebennikovhm22:18
odyssey4meagrebennikov nope - that could be 'foo_baz: blah' - it was used so as not to repeat the value in the variables lower down22:18
agrebennikovso is it just used somewhere in "when" statement?22:18
odyssey4me(in that same paste)22:19
logan-it is only used relative to that config. keystone_service_adminuri and keystone_service_internaluri reference it22:19
*** smatzek has quit IRC22:19
agrebennikovah))22:19
agrebennikovcrap22:19
agrebennikovdidn't notice22:19
odyssey4me:)22:19
agrebennikovwy always overcomplicate it? :)22:19
agrebennikovwhy22:19
cooljdry22:20
*** agireud has quit IRC22:21
*** batkins61 has quit IRC22:21
odyssey4mealright, the last newton patch needed for the next RC has merged - lemme put the RC request in, then I'm out for the night22:21
*** woodard_ has joined #openstack-ansible22:22
logan-the other big catch with doing this is you will need to either copy all of the service keystone auth passwords from user_secrets across your regions, or you will need to create override vars for all of these https://github.com/openstack/openstack-ansible-os_nova/blob/master/defaults/main.yml#L168 --ie maybe set nova_service_user_name: "nova_{{ nova_service_region }}" etc..22:22
*** woodard has quit IRC22:25
*** galstrom is now known as galstrom_zzz22:25
*** woodard_ has quit IRC22:26
*** kylek3h has quit IRC22:27
dxiriodyssey4me: had to start from scratch :P22:27
dxirilets see if this time it works out :)22:27
odyssey4medxiri the best way to learn is to fail, and fail again22:28
dxiriodyssey4me: totally agree :)22:28
dxirias long as you don't fail on the same place everytime22:28
odyssey4meandymccr and everyone, Newton RC3 has been proposed: https://review.openstack.org/38625822:30
odyssey4meI expect that we'll see the tag created tomorrow, giving us all next week to find any critical bugs.22:30
odyssey4mewell, this tag will become the release if we don't before Thu22:31
odyssey4mealright, that's me out for the night - chat tomorrow all!22:32
dxirilets say I want to try this rc3, how can I upgrade after when its stable?22:33
dxirijust wondering if I should be doing the deployment with that instead of mitaka22:33
cooljnight odyssey4me22:34
*** cathrichardson has quit IRC22:37
*** asettle has joined #openstack-ansible22:37
*** cmart has quit IRC22:40
jmccrorydxiri: for upgrading from rc3, you'd just need to checkout a newer newton release tag, update roles, and re-run the playbooks http://docs.openstack.org/developer/openstack-ansible/newton/upgrade-guide/minor-upgrade.html22:41
*** asettle has quit IRC22:42
*** phalmos has quit IRC22:44
*** admin0 has quit IRC22:45
dxirijmccrory: nice! thank you!22:45
*** evilt0ne has joined #openstack-ansible22:56
*** evilt0ne has quit IRC22:57
*** evilt0ne has joined #openstack-ansible22:58
*** weezS has joined #openstack-ansible22:58
*** vishwanathj has quit IRC22:59
*** agireud has joined #openstack-ansible22:59
*** weezS has quit IRC23:00
*** hughmFLE_ has joined #openstack-ansible23:04
*** hughmFLEXin has quit IRC23:05
*** hughmFLE_ has quit IRC23:08
*** jamielennox is now known as jamielennox|away23:20
*** v1k0d3n has joined #openstack-ansible23:22
*** agrebennikov has quit IRC23:28
*** cfarquhar has quit IRC23:32
*** jamielennox|away is now known as jamielennox23:35
*** galstrom_zzz is now known as galstrom23:37
*** rmelero has quit IRC23:41
*** galstrom is now known as galstrom_zzz23:43
*** javeriak has quit IRC23:45
*** shanec_ has quit IRC23:48
*** sdake_ has joined #openstack-ansible23:51
*** retreved has quit IRC23:52
*** sdake has quit IRC23:52
*** retreved has joined #openstack-ansible23:52

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!