Monday, 2017-05-22

*** jamielennox|away is now known as jamielennox00:02
*** pmannidi has quit IRC00:03
*** markvoelker has quit IRC00:11
*** thorst_afk has joined #openstack-ansible00:19
*** thorst_afk has quit IRC00:24
*** pmannidi has joined #openstack-ansible00:25
*** pmannidi is now known as pmannidi|Trg00:25
*** pmannidi|Trg is now known as pmannidi00:25
*** yifei has joined #openstack-ansible00:28
*** cuongnv has joined #openstack-ansible00:56
*** adreznec has quit IRC00:59
*** hw_wutianwei has joined #openstack-ansible01:00
*** adreznec has joined #openstack-ansible01:01
*** thorst_afk has joined #openstack-ansible01:02
*** thorst_afk has quit IRC01:04
*** SerenaFeng has joined #openstack-ansible01:24
*** cNilesh has joined #openstack-ansible01:30
*** zul has quit IRC01:44
*** thorst_afk has joined #openstack-ansible01:58
*** thorst_afk has quit IRC01:58
*** jamielennox is now known as jamielennox|away02:00
*** winggundamth has joined #openstack-ansible02:18
*** thorst_afk has joined #openstack-ansible02:57
*** thorst_afk has quit IRC02:57
*** jhesketh_ is now known as jhesketh03:08
*** thorst_afk has joined #openstack-ansible03:28
*** fergus has quit IRC03:42
*** fergus has joined #openstack-ansible03:42
*** woodard has quit IRC03:43
*** woodard has joined #openstack-ansible03:44
*** thorst_afk has quit IRC03:46
*** woodard has quit IRC03:48
*** jamielennox|away is now known as jamielennox03:53
*** SerenaFeng has quit IRC04:15
*** hybridpollo has quit IRC04:37
*** fergus has quit IRC04:46
*** nyloc has joined #openstack-ansible04:46
*** fergus has joined #openstack-ansible04:46
*** udesale has joined #openstack-ansible04:47
*** shausy has joined #openstack-ansible05:12
*** shausy has quit IRC05:12
*** weezS has quit IRC05:17
*** pranavb has joined #openstack-ansible05:19
*** cuongnv has quit IRC05:25
*** winggundamth has quit IRC05:28
*** SerenaFeng has joined #openstack-ansible05:32
*** cuongnv has joined #openstack-ansible05:38
*** thorst_afk has joined #openstack-ansible05:43
*** jvidal has joined #openstack-ansible05:45
*** thorst_afk has quit IRC05:48
*** weezS has joined #openstack-ansible05:50
evrardjpgood morning everyone05:55
*** tobberydberg has joined #openstack-ansible05:56
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Move to a all/ group var folder  https://review.openstack.org/46627806:07
evrardjpif someone could vote on https://review.openstack.org/#/c/463659/ that would be great06:09
*** Oku_OS-away is now known as Oku_OS06:11
*** chas has joined #openstack-ansible06:19
*** markus_z has joined #openstack-ansible06:21
*** armaan has joined #openstack-ansible06:32
prometheanfireevrardjp: hi06:34
*** os-slack1 has quit IRC06:34
prometheanfireevrardjp: commit message title could be better, I assume this is for leapfrog?06:35
prometheanfireand I didn't know we were targeting juno as a start06:35
*** chas has quit IRC06:37
*** chas has joined #openstack-ansible06:37
openstackgerritKevin Lefevre proposed openstack/openstack-ansible-os_designate stable/ocata: Standardize the testing for Designate  https://review.openstack.org/46566306:39
*** chas has quit IRC06:41
*** chas has joined #openstack-ansible06:41
*** thorst_afk has joined #openstack-ansible06:44
*** thorst_afk has quit IRC06:49
*** vnogin has joined #openstack-ansible06:52
*** chas has quit IRC06:55
*** shardy has joined #openstack-ansible06:55
*** chas has joined #openstack-ansible06:55
*** vnogin has quit IRC06:56
*** chas has quit IRC06:57
*** chas has joined #openstack-ansible06:57
*** SerenaFeng has quit IRC06:57
*** tobberyd_ has joined #openstack-ansible07:03
evrardjpprometheanfire: the code is OSA is already there to leapfrom from J. We are now adding the feature to leapfrog from K07:03
evrardjpto N07:03
*** SerenaFeng has joined #openstack-ansible07:06
*** chas has quit IRC07:06
*** chas has joined #openstack-ansible07:06
*** tobberydberg has quit IRC07:06
*** chas has quit IRC07:11
prometheanfireah07:11
*** pcaruana has joined #openstack-ansible07:11
*** pcaruana has quit IRC07:12
*** pcaruana has joined #openstack-ansible07:13
*** drifterza has joined #openstack-ansible07:17
*** vnogin has joined #openstack-ansible07:30
*** david-lyle has quit IRC07:36
*** mpranjic has quit IRC07:39
*** mpranjic has joined #openstack-ansible07:42
*** david-lyle has joined #openstack-ansible07:42
*** thorst_afk has joined #openstack-ansible07:45
*** david-lyle has quit IRC07:46
*** chas has joined #openstack-ansible07:47
*** thorst_afk has quit IRC07:50
*** gouthamr has joined #openstack-ansible07:51
*** manheim_ has joined #openstack-ansible07:58
*** david-lyle has joined #openstack-ansible08:03
*** fergus has quit IRC08:04
*** fergus has joined #openstack-ansible08:04
hwoaranggood morning08:14
*** tobberyd_ has quit IRC08:14
hwoarangdoes anyone make any sense of this http://paste.openstack.org/show/610124/ ? node is set to rabbitmq@container1 but rabbitmqctl is executed with -n ' ' (ie empty node)08:15
* hwoarang grabs some coffee08:15
*** pbandark has joined #openstack-ansible08:17
*** gouthamr has quit IRC08:19
evrardjpgood morning hwoarang08:25
evrardjpit looks like your rabbitmq isn't properly started/bootstrapped.08:26
evrardjpwhich version are you running? Do you have HOSTNAME= set in your env vars somewhere?08:27
hwoarangevrardjp: let me check. but isn't it suspicous that the module does not take the 'node' param into consideration?08:30
evrardjpthat's highly suspicious08:30
hwoarangi checked the source, it seems that -n parameter is only used if you passed a node parameter but it doesn't seem to work like this...08:30
evrardjpthat's why I am talking about this hostname thing08:30
evrardjpcould you also manually check the playbook to see what's going on for your variables?08:31
evrardjpand I still don't know which version you are running08:31
evrardjpif stable/ocata, you're running ansible < 2.308:32
hwoarangHOSTNAME is set in /etc/profile and ansible is 2.3.0.008:32
evrardjpoh.08:32
evrardjp /etc/profile on your physical host?08:33
hwoarangyes08:33
evrardjpcould you unset that?08:33
evrardjpI thought I fixed this.08:33
evrardjpplease unset the HOSTNAME from the host, and re-try to start your playbook08:33
hwoarangwhere is this fix supposed to be? in the rabbitmq_server role or somewhere else?08:34
evrardjpansible08:34
hwoarangah08:34
evrardjpahah, no I get it.08:34
evrardjpwell could you try without it, to see if it works better?08:34
evrardjpBut I think this one is a different one.08:34
pjm6good morning all08:35
evrardjphwoarang: please test that the module is receing the proper arguments too.08:42
hwoarangyeah it does :(08:42
hwoarangbut let me check...08:42
evrardjpso you did add debugging on the play level08:42
drifterzahello08:42
evrardjpdrifterza: hello!08:42
hwoarangi did add some printfs at the rabbitmq_user.py file08:42
evrardjpit's been a while!08:42
evrardjppjm6: good morning08:43
drifterzaindeed, hows things ?08:43
evrardjpgood and you?08:43
evrardjphwoarang: good.08:43
drifterzaGood thanks.08:43
evrardjphwoarang: do you see something weird about hostname?08:43
*** karimb has joined #openstack-ansible08:44
evrardjpoh yeah I forgot to tell you why I'm obsessed with the hostname hwoarang08:44
hwoarangchecking because i need to see how to run only this specific task08:44
evrardjpit's because if it's in the environment when running a rabbitmq command, it overrides whatever you give in the cli08:44
hwoarangand i am not sure why the container has the same env with the host08:44
hwoarangbecause HOSTNAME in the container is the same with host08:45
hwoarangsomething is fishy08:45
evrardjpthat part is correct08:45
evrardjpwhen creating a container we copy the nev08:45
evrardjpenv08:45
evrardjplike profile08:45
hwoaranghmm08:45
evrardjpfor example if there are proxy set up etc.08:45
evrardjpI still think we should change that, but hey, I'm not the only one :p08:46
*** thorst_afk has joined #openstack-ansible08:46
evrardjpassuming we can't change that, if the container + host doesn't have the HOSTNAME it should work.08:46
hwoaranglet me gather some more output08:47
evrardjpIn your case my fix doesn't apply, which makes 100% sense.08:47
hwoarangbecause it does not make much sense08:47
evrardjpwhat doesn't make sense?08:47
evrardjpwell IMO rabbitmqctl sucks.08:48
evrardjpit shouldn't behave like that08:48
hwoarangthe module says that it executes [/usr/sbin/rabbitmqctl', '-q', '-n', 'rabbit@container1']08:48
hwoarangyet the ansible output says it's -n ' ' instead08:48
evrardjpyeah08:48
hwoarangand segfaults....08:49
evrardjpthat's what I'm telling you08:49
evrardjpinput is not the same as output08:49
evrardjp[/usr/sbin/rabbitmqctl', '-q', '-n', 'rabbit@container1'] is your input + ENV08:49
hwoarangso ansible is not reporting the input to the _exec method?08:49
hwoarangoh that SUCKS!08:49
evrardjpwait08:49
evrardjpthe ansible input is right08:50
*** tobberydberg has joined #openstack-ansible08:50
evrardjpit's the output that tricks you08:50
evrardjpif you do08:50
evrardjp(at least IIRC)08:50
hwoarangi thought that the output was the same with input :(08:50
evrardjpHOSTNAME=babar /usr/sbin/rabbitmqctl', '-q', '-n', 'rabbit@container1'08:50
evrardjpthe output will give your08:50
evrardjpyou08:50
evrardjp(without the ,_08:51
evrardjp)08:51
andymccrwasnt babr the elephant character? :P08:51
evrardjp /usr/sbin/rabbitmqctl -q -n ''08:51
hwoarangthat sucks...08:51
evrardjpandymccr: yes indeed.08:51
evrardjpBecause foo bar isn't fun enough.08:51
*** SerenaFeng has quit IRC08:52
andymccrhaha ba bar instead of foo bar :P08:52
evrardjpwell when it's about finding interesting examples, I don't rely on foo/bar. I prefer babar, tintin, haddock.08:52
andymccrhaddock is the best.08:52
*** SerenaFeng has joined #openstack-ansible08:52
andymccrwhat about asterix/dogmatix etc? :D08:52
evrardjpsometimes MILOU comes08:52
evrardjpbut you don't know milou ofc08:53
andymccrmilou is snowy - according to google :D08:53
evrardjpyou name it snowy or something like that08:53
evrardjpyeah08:53
evrardjpI kinda don't use spirou that much08:53
andymccrdont recognize that one08:53
evrardjpI guess too long08:53
evrardjpinteresting one by Franquin.08:54
*** tobberydberg has quit IRC08:54
*** chhavi has joined #openstack-ansible08:55
evrardjpThe question is why these are all comic book chars. I don't know yet.08:56
evrardjphwoarang: to come back to your issue I'm not 100% certain this is your issue08:57
hwoarangwell good thing is that centos7 works so i do have an issue on my end :)08:57
evrardjpplease start by unsetting any reference of HOSTNAME just in case.08:58
hwoarangyeah08:58
evrardjpeverywhere :p, containers, physical hosts.08:58
*** tobberydberg has joined #openstack-ansible09:02
*** thorst_afk has quit IRC09:05
*** electrofelix has joined #openstack-ansible09:17
*** pranavb has quit IRC09:27
*** stuartgr has joined #openstack-ansible09:30
*** pranavb has joined #openstack-ansible09:40
*** yifei has quit IRC09:40
*** SerenaFeng has quit IRC09:45
hwoarangevrardjp: unsetting HOSTNAME before the rabbitmq_user call seems to do something different09:47
hwoarangso that's a good start09:47
hwoarangfails a bit after that because the physical hostname is used inside the container but one step at a time09:48
*** cuongnv has quit IRC09:49
*** cNilesh has quit IRC09:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate stable/ocata: Reduce init restart/kill times  https://review.openstack.org/46071709:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate stable/ocata: Use internalURL by default for Neutron  https://review.openstack.org/46506409:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate stable/ocata: Optimise apt cache update task  https://review.openstack.org/46285009:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate stable/ocata: Ensure the components are isolated from the system  https://review.openstack.org/46015509:54
*** ivve has quit IRC09:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate stable/ocata: Fix for lookup and get_url occuring in different places  https://review.openstack.org/46378509:54
*** ivve has joined #openstack-ansible09:55
evrardjphwoarang: yes that's what I thought.09:59
*** kjz1 has joined #openstack-ansible09:59
*** kjz has quit IRC10:00
*** thorst_afk has joined #openstack-ansible10:02
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/newton: Add gnocchiclient constraints to global pins  https://review.openstack.org/46666010:06
odyssey4mejoelgriffiths ^ I don't know why I didn't think of doing that before, but that should do away with the user vars workaround10:06
*** thorst_afk has quit IRC10:07
*** chas has quit IRC10:08
*** chas has joined #openstack-ansible10:09
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer stable/newton: Revert "Pin gnocchiclient to comply with optional deps"  https://review.openstack.org/46666310:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer stable/newton: Revert "Pin gnocchiclient to comply with optional deps"  https://review.openstack.org/46666310:10
hwoarangevrardjp: so is a sensible approach to unset this variable when we have a task with the rabbitmq_user module?10:10
hwoarangnot sure which layer needs to be "fixed"10:11
*** chas has quit IRC10:13
openstackgerritMerged openstack/openstack-ansible-os_designate stable/ocata: Standardize the testing for Designate  https://review.openstack.org/46566310:20
evrardjphwoarang: let me think a little, but yes it seems sensible10:25
evrardjpI'll have a look at the module itself10:25
evrardjpalternatively we could patch the connection plugin to do it10:27
evrardjpor10:28
evrardjpwe just stop wiring this env file10:28
evrardjpand only write what's relevant to us10:28
evrardjpand make sure it's possible for a deployer to override it10:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/newton: Add missing tempest_venv_bin group_var  https://review.openstack.org/46667010:32
hwoarangi am curious why centos does not have this issue10:33
hwoarangi am going to investigate10:33
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/newton: Add missing tempest_venv_bin group_var  https://review.openstack.org/46667010:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/newton: Add missing tempest_venv_bin group_var  https://review.openstack.org/46667010:36
evrardjphwoarang: https://github.com/ansible/ansible/blob/devel/lib/ansible/module_utils/basic.py#L2361-L236410:38
hwoaranghmm10:38
evrardjpif we want we could change the rabbitmq10:38
evrardjpto use the environ_update10:39
evrardjpthe rabbitmq modules*10:39
hwoaranginteresting...10:39
evrardjpwell I guess for the centos/suse difference, maybe some has HOSTNAME, some don't, at provisioning times10:39
evrardjphwoarang: not worth time right now I'd say. Too much pain to get these merged10:40
evrardjpI'll at least file a bug, see what they say.10:41
*** chas has joined #openstack-ansible10:43
hwoarangi need to check if i am doing anything wrong in the lxc roles10:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/newton: Add missing tempest_venv_bin group_var  https://review.openstack.org/46667010:45
drifterzahow do we currently do autoscalling ?10:45
*** tobberydberg has quit IRC10:45
*** chas has quit IRC10:47
*** chas has joined #openstack-ansible10:47
evrardjpandymccr: is there someone already fixing the nova issues?10:53
andymccrevrardjp: which issue specifically?10:53
andymccrim working on that upgrade bug now10:53
odyssey4medrifterza do you mean autoscaling as in the service provided by a combination of openstack services? if so, then it's up to the deployer to ensure that the config is set and the architecture is right for their needs10:53
*** toddnni has quit IRC10:54
drifterzaodyssey4me, I'm thinking more on the lines of, backend services needing to scale to more containers for example.10:54
drifterzawithout manual intervention10:55
odyssey4mewe do not currently implement any sort of automatic scaling10:55
drifterzathat would require metric monitoring of some sort?10:55
odyssey4meyou can scale by adding more hosts or adding more containers to hosts, depending on what you're looking to do10:56
drifterzaI'm thinking that 2 am call that requires something to be added10:56
drifterzaetc..10:56
odyssey4meyeah, it'd need metric monitoring and quite a few changes to how we implement the inventory10:56
drifterzawould be kinda cool, sort of like k8s10:56
odyssey4meWe've seen a 3 infra node environment scale to 500 compute nodes though... so while it'd be cool, there isn't really a need for it10:57
drifterzahas there been any considerations on how to monitor the infra ?10:58
drifterzanot perscribed monitoring, but rather a means.10:58
evrardjpandymccr: latest patch of nova_role in master changed the code that did the nova_virt_type during detection10:59
evrardjpI think there is a problem somewhere there, because it's sometime skipping the task and not setting anything.10:59
evrardjpI will probably have a patch then10:59
andymccrevrardjp: ok cool - how did it pass gates?10:59
odyssey4medrifterza there's been some work going into putting together a generic set of monitoring scripts in the repo openstack/monitorstack11:00
odyssey4mehttps://github.com/openstack/monitorstack11:00
*** toddnni has joined #openstack-ansible11:00
odyssey4methose can be used for zabbix, nagios or whatever11:00
*** fergus has quit IRC11:01
*** smatzek has joined #openstack-ansible11:01
evrardjpandymccr: I haven't a patch yet to fix this yet.11:02
evrardjpBut it should be done soon11:02
evrardjpI guess I know the issue.11:03
evrardjpor I will soon when I'll read the patch that broke it :p11:03
andymccrhahaha11:04
andymccrevrardjp: ok cool let me know if you need more info11:04
andymccror rather11:04
andymccrneed help :P11:04
andymccrdunno why i said info11:04
*** vnogin has quit IRC11:04
asettleWhhy not both!11:05
*** thorst_afk has joined #openstack-ansible11:18
*** chhavi has quit IRC11:20
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_nova master: Ensure tasks are not skipped  https://review.openstack.org/46668711:21
odyssey4meevrardjp ah, I think I see where the os_nova role is failing to get the virt type11:21
evrardjpandymccr: odyssey4me ^11:21
evrardjpodyssey4me: see my commit message :)11:21
*** toddnni has quit IRC11:22
odyssey4meevrardjp hehe, yeah - you got it exactly11:22
*** armaan has quit IRC11:23
evrardjpodyssey4me: at the same time I have realised this needs a refactor :p11:24
evrardjpwhat can run on itself is definitely a fact :p11:24
*** armaan has joined #openstack-ansible11:24
evrardjpbut why do we need it ephemeral?11:24
evrardjp:p11:24
odyssey4mewhat do you mean?11:24
odyssey4methinking about it, we could actually just set qemu as the default, then let set_fact override it11:25
evrardjpset_fact: nova_virt_type: kvm blablabla set_fact nova_virt_type powervm ...11:25
evrardjpyes !11:25
evrardjpnext commit11:25
evrardjpand using host facts to not look it up over and over again.11:25
odyssey4meheh, well actually a local fact would be better11:26
evrardjpexactly11:26
evrardjpsomething simple as a shell script we would drop11:26
evrardjpthat returns "kvm" "powervm" or "qemu"11:26
evrardjp:p11:26
odyssey4meyep, using this mechanism: http://serverascode.com/2015/01/27/ansible-custom-facts.html11:27
*** shardy has quit IRC11:27
evrardjpyes, exactly what I had in mind. :p11:27
odyssey4meperhaps you should register a bug for it to remind yourself ;)11:27
drifterzawhat does rackspace call your team odyssey4me ?11:27
drifterzais it devops11:27
hwoarangevrardjp: another reason why centos and suse behave differently is that centos7 uses 3.6.X and suse 3.5.X so maybe rabbitmqctl was fixed in the meantime...11:28
odyssey4medrifterza heh, no11:28
odyssey4medrifterza we're part of a software engineering team11:28
*** armaan has quit IRC11:28
evrardjphwoarang: interesting. You mean both had HOSTNAME set, and one didn't had the failure? Interesting11:29
evrardjpvery interesting11:29
hwoarangyeah11:29
hwoarangcentos has HOSTNAME set. suse also has HOST set as well11:29
hwoarangboth have the same value11:29
* hwoarang context switches to galera_server11:30
evrardjpafk lunch11:32
evrardjpwoops.11:32
evrardjpwell I guess you all know that I am starving.11:32
*** karimb has quit IRC11:32
*** toddnni has joined #openstack-ansible11:33
ioniis it ok that now gnocchi client is not available in gnocchi container?11:34
ioniin utility container gnocchi returns that it cannot connect on localhost11:34
ioniso it doesn't get its endpoint for some reason11:35
ionii'm on ocata11:35
*** udesale has quit IRC11:36
*** zul has joined #openstack-ansible11:36
*** armaan has joined #openstack-ansible11:38
evrardjpmmm11:40
evrardjpI am no expert and the only thing I can remember about endpoints change was for master (keystone versionless)11:43
evrardjpanyone else?11:43
*** admin0 has joined #openstack-ansible11:44
*** askb has quit IRC11:44
admin0\o11:44
admin0from june, i will be doing OSA full time \o/11:45
*** jvidal has quit IRC11:54
evrardjpadmin0: lucky you. We expect your commits then!11:54
admin0i think that is a yes :)11:54
openstackgerritMerged openstack/openstack-ansible-security master: [Docs] Fix missing hyphen in status  https://review.openstack.org/46649211:56
openstackgerritMerged openstack/openstack-ansible-security master: [Docs] Put FAQ after getting started docs  https://review.openstack.org/46649311:56
openstackgerritMerged openstack/openstack-ansible-security stable/ocata: [Docs] Fix deprecation docs for RHEL 6 content  https://review.openstack.org/46649111:56
*** yifei has joined #openstack-ansible11:56
odyssey4meandymccr we should probably get https://review.openstack.org/466099 merged asap, and port that one back to newton11:56
jrosser_odyssey4me: https://github.com/openstack/openstack-ansible-plugins/commit/67d9ed2491fb01a6904df39fc826e4f4db897abe <- that seems good on ocata, just got our lab redeployed with that patch11:57
odyssey4mejrosser_ oh good, would you like to propose the patch then?11:57
jrosser_and you are right there are still a few bits to address, db connectivity check etc11:58
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-plugins stable/ocata: Support delegation in strategy plugin  https://review.openstack.org/46670311:59
*** yifei has quit IRC12:00
odyssey4methanks12:01
*** fabg has joined #openstack-ansible12:05
*** pranavb has quit IRC12:06
*** jvidal has joined #openstack-ansible12:09
fabgioni: for gnocchi client in utility container, after source openrc, export OS_AUTH_TYPE=password and then do a "gnocchi status"12:09
*** armaan has quit IRC12:16
openstackgerritMerged openstack/openstack-ansible-security stable/ocata: Do not update grub if grub not used  https://review.openstack.org/46379712:16
*** armaan has joined #openstack-ansible12:16
*** admin0 has quit IRC12:19
*** armaan has quit IRC12:20
*** jgriffiths has quit IRC12:22
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_nova master: Fix upgrades to map existing nova instances to cell1  https://review.openstack.org/46671712:28
*** foutatoro has joined #openstack-ansible12:30
ionifabg, thanks for the hint12:32
ionifabg, is that a bug?12:32
*** admin0 has joined #openstack-ansible12:33
*** armaan has joined #openstack-ansible12:34
fabgioni: don't really know ? I got this info from the irc… Just know about this issue… ;-)12:39
*** chhavi has joined #openstack-ansible12:39
*** retreved has joined #openstack-ansible12:41
*** admin0 has quit IRC12:46
openstackgerritAlexandra Settle proposed openstack/openstack-ansible master: [ops-guide] Adds links to networking info in ops and networking guide  https://review.openstack.org/46672112:48
evrardjpweirdly I don't have the same behavior on a PoC on my machine and in the gates. Same version of ansible. Not the same env.12:55
evrardjphttp://logs.openstack.org/87/466687/1/check/gate-openstack-ansible-os_nova-ansible-func-ubuntu-xenial/91ba86d/console.html#_2017-05-22_11_44_02_39649312:55
evrardjpif anyone knows why it tries to load common/drivers/kvm/nova_compute_kvm_install.yml instead of tasks/drivers/kvm/nova_compute_kvm_install.yml I'm all ears (probably an env var)12:56
*** karimb has joined #openstack-ansible12:56
*** admin0 has joined #openstack-ansible12:56
*** hogwash has joined #openstack-ansible12:59
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Add venv_tag local fact  https://review.openstack.org/46672313:00
*** manheim_ has quit IRC13:01
*** esberglu has joined #openstack-ansible13:01
*** jheroux has joined #openstack-ansible13:01
odyssey4mepalendae evrardjp ^ I intend to apply that as a pattern, so any thoughts are welcome.13:01
*** manheim_ has joined #openstack-ansible13:02
*** retreved has quit IRC13:02
*** esberglu has quit IRC13:03
*** udesale has joined #openstack-ansible13:05
*** esberglu has joined #openstack-ansible13:05
*** coolkil has joined #openstack-ansible13:05
*** zul has quit IRC13:05
*** esberglu_ has joined #openstack-ansible13:06
*** klamath has joined #openstack-ansible13:06
evrardjpodyssey4me: you want to ensure that a host x has a version y of code, right?13:06
*** manheim_ has quit IRC13:06
*** klamath has quit IRC13:06
evrardjpthis way we can later fetch info on a smaller matrix13:06
evrardjpright?13:06
*** retreved has joined #openstack-ansible13:06
odyssey4meI just want to record the version of software implemented as a fact.13:07
*** klamath has joined #openstack-ansible13:07
odyssey4meThis will allows us to serialise the playbook based on the facts of the targets.13:07
odyssey4meie for a new deployment, don't serialise - for an existing deployment, serialise13:07
odyssey4meso if you're doing a version upgrade, it'll serialise the playbook13:08
logan-nice13:08
odyssey4meso this is to try and implement rolling upgrades13:08
odyssey4meinitially I'm just focusing on minor upgrades, but major upgrades will come later13:08
evrardjpyes as we discussed, it's an approach I like.13:09
evrardjp:D13:09
evrardjpnot sure how you're gonna serialize but that's for later :)13:09
*** esberglu has quit IRC13:09
evrardjpat least you can skip what you don't want13:09
odyssey4meyes, this should also allow us to skip the entire set of install tasks if the tag deployed is the same as the tag intended for deployment13:10
odyssey4meie just a config change13:10
*** zul has joined #openstack-ansible13:11
*** rcarrillocruz has quit IRC13:11
odyssey4meof course using tags is more efficient, but this opens the opportunity to optimise for people who don't know ansible all that well13:11
logan-how does this fact look when it is loaded? ansible_local.venv_tag? or ansible_local.keystone.general.venv_tag?13:11
odyssey4melogan- the latter13:12
*** woodard has joined #openstack-ansible13:12
*** cpuga has joined #openstack-ansible13:12
odyssey4mehttps://pastebin.com/rrNA40ev13:12
*** vnogin has joined #openstack-ansible13:13
*** woodard has quit IRC13:13
*** woodard has joined #openstack-ansible13:14
*** cpuga_ has joined #openstack-ansible13:15
odyssey4mefor those in the UK, a new channel has been started: #openstack-uk - please join if you're interested git-harry mancdaz andymccr asettle boxrick1 jrosser_ hughsaunders robcresswell and any others who I may not know are in the UK13:16
evrardjpI'll join anyway.13:16
*** armaan has quit IRC13:16
mancdazodyssey4me why a new channel?13:17
asettleLooks like it might be for openstack days UK13:17
asettleIn Sept13:17
asettleCommunity stuff?13:17
odyssey4memancdaz not my initiative, ask dabukalam :) I'm just passing the message on.13:17
mancdazfair enough13:17
*** cpuga has quit IRC13:18
*** admin0_ has joined #openstack-ansible13:18
dabukalammancdaz: just somewhere to collect UK people, make people aware of days, and local UG meetups13:18
dabukalamlike this one https://www.meetup.com/Manchester-OpenStack-Meetup/events/239507652/13:18
dabukalam:D13:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create master: Add variant local fact  https://review.openstack.org/46672713:21
odyssey4medabukalam you're such a spammer :p13:21
*** cathrich_ has joined #openstack-ansible13:21
*** cathrichardson has quit IRC13:22
odyssey4melogan- you raise a good point re local facts - perhaps we should collect all of OSA's static local facts in an 'openstack-ansible' fact file and use a section for each role?13:22
odyssey4meor perhaps just do that for the openstack stuff at least13:22
odyssey4methe infra stuff could perhaps be seperate13:22
*** markvoelker has joined #openstack-ansible13:22
odyssey4meevrardjp ^ thoughts?13:23
evrardjpStill thinking13:23
evrardjpwe'll have multiple files if we are loading things dynamically13:24
*** jwitko has joined #openstack-ansible13:25
evrardjpbut I don't see a problem of having multiple files, or having a few files next to an "openstack" one13:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create master: Add variant local fact  https://review.openstack.org/46672713:25
odyssey4meyes, obviously dynamic fact generation will have to be excluded from the pattern, that's why I suggested this only for 'static local facts'13:26
odyssey4meevrardjp I think I like using 'openstack_ansible.fact' and having a section for each role - so [keystone] for keystone, etc13:28
evrardjpyup, but you have to remember you're gonna have supported_virt_types.fact for example13:29
evrardjpI am fine with openstack_ansible.fact13:29
evrardjpbecause it's still predictable13:30
*** kylek3h has quit IRC13:30
evrardjpI'd be against using ansible_hostname as a filename for example13:30
odyssey4mehmm, I see that the file name is a parent13:31
evrardjppredictable and consistent accross hosts of a group I mean13:31
*** admin0_ has quit IRC13:32
*** manheim_ has joined #openstack-ansible13:32
*** fabg has quit IRC13:34
*** smatzek has quit IRC13:34
*** markvoelker has quit IRC13:35
*** fabg has joined #openstack-ansible13:35
evrardjpopenstack_ansible [keystone] lxc_container_variant: default is fine for me13:35
*** markvoelker has joined #openstack-ansible13:35
evrardjpbut I'm not sure we need to track that inside the container13:36
logan-yeah that sounds good13:36
evrardjpthat doesn't make sense to me, but the idea is there13:36
evrardjpfor me it's the host that has a knowledge of running containers. Containers don't need to be "self aware" of their version13:37
evrardjpbut that's maybe details13:37
evrardjpcontainers are implementation details for the hosts, where venvs version are implentation details of the deployed code (therefore on the containers)13:38
evrardjpbut any hack is good at our point :p13:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Add venv_tag local fact  https://review.openstack.org/46672313:40
odyssey4meevrardjp logan- ^13:41
odyssey4meevrardjp the lxc-container-create role targets containers, so if we were to do, for example, a rolling replacement, we'd be reacting to the facts for the container not the host13:42
*** drifterza has quit IRC13:42
odyssey4meIt's also the easiest way to track per-container variants used - otherwise the host's fact file would have to contain an entry for every container.13:43
odyssey4meIT'll be somewhat messy, and I'd rather tackle that if/when we move towards making the containers a service/property of the host instead of a host in its own right,13:43
evrardjpodyssey4me: it started with a good idea.13:43
evrardjpodyssey4me: I agree with that part13:44
evrardjpI mean the reading fact of linked to the inventory13:44
odyssey4meevrardjp ok, back to thekeystone patch13:45
odyssey4meI made it a var for maintenance purposes, not to allow changes - that's why it's in vars/main.yml13:45
evrardjpplease not the var :p13:45
evrardjpyes13:45
odyssey4meif you think that's too tempting, then I can change it13:45
evrardjpoh yes13:45
evrardjpansible_local[whatwasthefilenameagain?DamnIhavetoreadthevar]13:46
evrardjpfrom outside the role13:46
*** udesale has quit IRC13:46
evrardjpthat's a good example of what I think we should avoid (same as inventory_hostname)13:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Add venv_tag local fact  https://review.openstack.org/46672313:48
evrardjpif we keep one single file, we could even have the file created in lxc_container_create.13:50
odyssey4mewell, evrardjp logan- what do you think - should we store the infrastructure facts in the same file, or do something different?13:51
odyssey4mesame file seems fine to me13:52
logan-same file13:52
logan-osa managed infra seems appropriate there13:52
*** schwicht has joined #openstack-ansible13:52
odyssey4meyep13:52
palendaeInfra facts like mariadb versions?13:53
odyssey4mepalendae well, I'll be pushing up a patch for that shortly - as it'll be a dyanmic fact it'll be a different file13:53
evrardjphwoarang: I got an idea13:53
*** hogwash has quit IRC13:53
palendaeodyssey4me: Ah; what would be in the same file here then?13:54
evrardjphwoarang: what if on the tasks themselves we directly do environment: hostname: {{ ansible_hostname }}13:54
*** ivveh has joined #openstack-ansible13:54
odyssey4methis file will be for static facts only - for for example the variant used when creating the container13:54
palendaeSure13:54
admin0if every bridge in the nodes are ovs bridges, does OSA still create containers on top of it, or does it need to be a LinuxBridge at some point ?13:55
palendaeI'm not 100% sure what you mean by 'infrastructure' here, but fewer files is fine by me :p13:55
odyssey4mein our artifacted deployment the variant is <service name>-<release tag>, so that'll allow us to flip the recreate switch :)13:55
evrardjpodyssey4me: don't forget the group_by :)13:56
*** fabg has quit IRC13:56
*** fabg has joined #openstack-ansible13:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create master: Add variant local fact  https://review.openstack.org/46672713:56
*** kylek3h has joined #openstack-ansible13:56
palendaeevrardjp: Replied on https://review.openstack.org/#/c/466108/13:57
palendaeAlso going to need at least one more patch on https://review.openstack.org/#/c/461884/, evidently I messed up the conditonal I spent an hour trying to formulate, heh13:57
*** smatzek has joined #openstack-ansible13:58
*** cjloader_ has joined #openstack-ansible14:00
evrardjppalendae: yes14:02
evrardjp"'mac' in ansible_local"14:02
*** smatzek_ has joined #openstack-ansible14:02
evrardjp"inventory_hostname in ansible_local['mac']"14:02
evrardjpIIRC14:02
palendaeAhh14:02
palendaeWouldn't that be around the whole line?14:02
palendaeSince there's an "or"?14:03
evrardjpyes, that's what I just did?14:03
odyssey4medo we really need to use local facts for the static mac recreation?14:03
evrardjpwell it makes sense to me14:03
odyssey4mesurely we can just gather the network facts for the existing container, then use those to recreate it?14:03
palendaeevrardjp: They were separate lines, just wondering :p14:03
evrardjpwait14:03
odyssey4meunless you're trying to allow a time period between destroy and create for some reason?14:04
evrardjpodyssey4me: if you have a better approach we can iterate :)14:04
palendaeodyssey4me: It's possible, yes; I had another patch that tried this but it was much messier than this. 1s14:04
*** lostRhino has joined #openstack-ansible14:04
palendaehttps://review.openstack.org/#/c/453333/714:05
evrardjpbut it's kinda simple right now: You have a fact? Use it, You don't? Generate and use directly + create the fact14:05
*** smatzek has quit IRC14:06
odyssey4mesure, alright - I don't want to throw a spanner in the works... it was just a thought that popped into my head14:07
evrardjpwell the thing is, for those who exist already, we don't want to destroy their mac address14:07
palendaeodyssey4me: I don't think you're wrong, but the weird hoops for accessing the facts as they were wasn't desirable in my mind14:07
evrardjpelse it would be simpler :p14:07
palendaeMy first pass did gather them into local facts just before deletion14:08
palendaeThen try to access them, but the fact name used is wonky14:08
evrardjppalendae: I think current one is quite elegant14:08
palendaeevrardjp: I'm not sure I would call it that, but I do think it's a bit safer14:09
palendaeJust in case someone does something "wrong" and deletes containers manually14:09
evrardjpI think it could have been cleaner if we started from a blank sheet, but we aren't14:09
palendaeRight14:09
*** fabg has quit IRC14:09
evrardjpas a reminder, from the first iteration of mac storage: I personally find this disgusting :p14:10
palendaeevrardjp: Same14:10
evrardjpbut we are where we are :p14:10
palendaeWe're doing a lot of the work that docker/lxd would do but in a templating language14:11
evrardjpwe just need bgp14:11
evrardjpmp-bgp14:11
evrardjpthat would be good enough14:12
*** fabg has joined #openstack-ansible14:12
evrardjpbut then it becomes too complex14:12
evrardjpfor some pp14:13
evrardjpppl*14:13
openstackgerritMerged openstack/openstack-ansible-os_nova stable/ocata: Remove default for nova_console_keymap  https://review.openstack.org/46609914:16
*** jgriffiths has joined #openstack-ansible14:18
*** piliman974 has joined #openstack-ansible14:18
neithhello all14:19
*** redaudit has joined #openstack-ansible14:20
*** jvidal has quit IRC14:21
*** fabg has quit IRC14:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Add venv_tag local fact  https://review.openstack.org/46672314:24
*** cjloader_ has quit IRC14:24
odyssey4melogan- evrardjp ^ forgot to change the fact conditional too14:25
klamathcloudnull odyssey4me found the error with https://gist.github.com/odyssey4me/4af6a759b7ce1a4df9b36df412f57f0a horizon_keystone_endpoint: "{{ keystone_service_publicurl }}/v3" hits the public keystone endpoint that wont allow admin to login to horizon14:25
evrardjpodyssey4me: and fixed my laziness of . moved properly to [' ']14:26
odyssey4meyes, it's beautiful again :p14:27
*** fabg has joined #openstack-ansible14:27
evrardjp. is so easy to type and python is too lenient14:29
evrardjpjinja*14:29
*** markvoelker_ has joined #openstack-ansible14:29
openstackgerritLogan V proposed openstack/openstack-ansible-plugins master: Add container-aware connection plugin tests  https://review.openstack.org/46674314:29
*** sliver has joined #openstack-ansible14:30
mhaydenmpranjic: good comment on Debian 9 vs 814:30
mhaydeni need to take a looksee there14:30
*** mcrafty has quit IRC14:32
*** markvoelker has quit IRC14:33
*** woodard has quit IRC14:33
*** david-lyle has quit IRC14:34
*** vnogin has quit IRC14:34
evrardjpcould someone help me on something?14:34
*** david-lyle has joined #openstack-ansible14:35
evrardjphttp://logs.openstack.org/87/466687/1/check/gate-openstack-ansible-os_nova-ansible-func-ubuntu-xenial/91ba86d/logs/ara/file/a33dc9f6-0c6a-49a9-a362-8e38a3cacea6/#line-1614:35
evrardjphttp://logs.openstack.org/87/466687/1/check/gate-openstack-ansible-os_nova-ansible-func-ubuntu-xenial/91ba86d/logs/ara/result/0c57bde2-e451-401f-8896-1e32ceb9c970/14:35
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_nova master: [WIP] Ensure tasks are not skipped  https://review.openstack.org/46668714:36
evrardjpThis is really weird.14:36
odyssey4meyeah, saw that earlier - did a little poking around but gave up14:37
odyssey4mewithout actually building a test environment, that's a hard one to figure out14:37
*** vnogin has joined #openstack-ansible14:37
evrardjpoh yes that remind me!14:37
evrardjpthat what I was starting up.14:37
andymccrhmm14:38
evrardjpLIFO work14:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Add venv_tag local fact  https://review.openstack.org/46675014:38
andymccrseems wonky - common isnt even listed in the role structure for ansible best practices.14:38
*** admin0 has quit IRC14:39
logan-playbook_dir is probably a low precedence fallback14:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Add venv_tag local fact  https://review.openstack.org/46675014:40
odyssey4meI think that logan- may just be right on the money there14:40
*** weezS has quit IRC14:41
logan-since the include is occurring in tasks/drivers/qemu/nova_compute_qemu.yml, maybe try "../kvm/nova_compute_kvm_install.yml" as the task file path14:41
*** armaan has joined #openstack-ansible14:42
*** fabg has quit IRC14:42
*** smatzek_ is now known as smatzek14:42
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Add venv_tag local fact  https://review.openstack.org/46675414:43
openstackgerritMerged openstack/openstack-ansible-ops master: Make possible to start leap from K  https://review.openstack.org/46365914:43
openstackgerritMerged openstack/openstack-ansible-ops master: Implement CLI test picker  https://review.openstack.org/46610814:44
openstackgerritLogan V proposed openstack/openstack-ansible-plugins master: Add container-aware connection plugin tests  https://review.openstack.org/46674314:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_heat master: Add venv_tag local fact  https://review.openstack.org/46675514:45
cloudnullmornings14:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron master: Add venv_tag local fact  https://review.openstack.org/46675714:47
openstackgerritMerged openstack/openstack-ansible-plugins stable/ocata: Support delegation in strategy plugin  https://review.openstack.org/46670314:47
*** admin0 has joined #openstack-ansible14:48
*** schwicht has quit IRC14:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Add venv_tag local fact  https://review.openstack.org/46675814:48
openstackgerritMerged openstack/openstack-ansible stable/newton: Add gnocchiclient constraints to global pins  https://review.openstack.org/46666014:48
*** fabg has joined #openstack-ansible14:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift master: Add venv_tag local fact  https://review.openstack.org/46675914:51
*** david-lyle has quit IRC14:52
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Add venv_tag local fact  https://review.openstack.org/46676114:55
*** lucasxu has joined #openstack-ansible14:56
*** piliman974 has quit IRC14:56
*** piliman974 has joined #openstack-ansible14:57
*** fabg has quit IRC14:58
mpranjicmhayden: thnx14:59
mpranjicmhayden: I am testing migrations from deb8 to deb9. it is really stable14:59
neithwould you used a RAID0 of 6 drives or a lvm stripped volume with 6 drivers to host /var/lib/nova?14:59
mpranjicit is in freeze for quite some time now. looks ready to me14:59
mhaydenmpranjic: seems to run fine on debian testing15:02
mhaydeni just ran it right quick15:02
mpranjicnice15:04
*** woodard has joined #openstack-ansible15:06
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-lxc_container_create master: Write MAC addresses to local facts folder  https://review.openstack.org/46188415:07
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-lxc_container_create master: Add option to recreate containers  https://review.openstack.org/46340315:08
*** woodard has quit IRC15:08
*** woodard has joined #openstack-ansible15:09
openstackgerritMerged openstack/openstack-ansible-tests master: test-prepare-host: Remove useless filter for RedHat network ifcfg files  https://review.openstack.org/46642115:09
andymccrhttps://review.openstack.org/#/c/466717/ - reviews por favor :) fixes the upgrade issues on nova, will need a backport to stable/ocata.15:09
openstackgerritMerged openstack/openstack-ansible-tests master: SUSE: Remove post-up/post-down scripts from default ifcfg files  https://review.openstack.org/46642215:09
openstackgerritMerged openstack/openstack-ansible-os_ceilometer stable/newton: Revert "Pin gnocchiclient to comply with optional deps"  https://review.openstack.org/46666315:10
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Add variant local fact  https://review.openstack.org/46672715:11
*** Oku_OS is now known as Oku_OS-away15:18
openstackgerritMerged openstack/openstack-ansible-os_designate stable/ocata: Fix for lookup and get_url occuring in different places  https://review.openstack.org/46378515:19
*** coolkil has quit IRC15:24
*** fabg has joined #openstack-ansible15:24
*** cjloader_ has joined #openstack-ansible15:24
*** galstrom_zzz is now known as galstrom15:25
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-ops master: Make usage of exceptions more uniform  https://review.openstack.org/46676915:25
palendaeevrardjp: ^ added the keystone exception catching15:25
*** weezS has joined #openstack-ansible15:26
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_aodh master: Add venv_tag local fact  https://review.openstack.org/46677015:28
*** jvidal has joined #openstack-ansible15:28
*** armaan has quit IRC15:28
*** armaan has joined #openstack-ansible15:29
*** hogwash has joined #openstack-ansible15:29
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_barbican master: Add venv_tag local fact  https://review.openstack.org/46677115:29
openstackgerritMerged openstack/openstack-ansible-os_glance master: Add venv_tag local fact  https://review.openstack.org/46675415:34
*** fabg has quit IRC15:34
*** markvoelker_ has quit IRC15:35
*** jvidal has quit IRC15:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer master: Add venv_tag local fact  https://review.openstack.org/46677915:36
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-ops master: Allow graceful exiting with SIGINT and SIGTERM  https://review.openstack.org/46678015:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate master: Add venv_tag local fact  https://review.openstack.org/46678115:38
openstackgerritMerged openstack/openstack-ansible-os_heat master: Add venv_tag local fact  https://review.openstack.org/46675515:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_gnocchi master: Add venv_tag local fact  https://review.openstack.org/46678315:40
xdfilstupid question: where do I submit a bug?15:41
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon master: Add venv_tag local fact  https://review.openstack.org/46678415:41
*** piliman974 has quit IRC15:42
*** hogwash has quit IRC15:42
andymccrxdfil: https://bugs.launchpad.net/openstack-ansible/+filebug15:42
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic master: Add venv_tag local fact  https://review.openstack.org/46678615:42
*** piliman974 has joined #openstack-ansible15:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum master: Add venv_tag local fact  https://review.openstack.org/46678815:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_molteniron master: Add venv_tag local fact  https://review.openstack.org/46678915:45
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Add venv_tag local fact  https://review.openstack.org/46672315:45
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-ops master: Allow graceful exiting with SIGINT and SIGTERM  https://review.openstack.org/46678015:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Add venv_tag local fact  https://review.openstack.org/46679015:46
*** fabg has joined #openstack-ansible15:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_rally master: Add venv_tag local fact  https://review.openstack.org/46679115:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_sahara master: Add venv_tag local fact  https://review.openstack.org/46679215:48
*** jvidal has joined #openstack-ansible15:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_trove master: Add venv_tag local fact  https://review.openstack.org/46679315:49
*** admin0 has quit IRC15:50
*** admin0 has joined #openstack-ansible15:50
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_trove master: Add venv_tag local fact  https://review.openstack.org/46679315:51
*** admin0 has quit IRC15:51
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-ops master: Allow graceful exiting with SIGINT and SIGTERM  https://review.openstack.org/46678015:51
palendaeodyssey4me: ^ should be the last general framework thing we need, unless we want an aggregated log file15:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum master: Add venv_tag local fact  https://review.openstack.org/46678815:51
odyssey4mepalendae if we could log to syslog, then it'll aggregate for us15:52
palendaeodyssey4me: I mean like aggregate in terms of x failures of y attempts15:53
palendaeI guess we can shove there and parse later15:53
odyssey4mepalendae to make it useful in the gate we will need some sort of parsable summary so that we can make it fail if it hits a threshold15:53
palendaeRight15:54
palendaeOk, I'll make it go to syslog and output some sort of summary15:54
odyssey4meit could do log to a file/syslog, but output a summary to stdout.15:55
palendaeSure15:55
palendaeI'll run with that that assumption15:55
openstackgerritMerged openstack/openstack-ansible-os_molteniron master: Add venv_tag local fact  https://review.openstack.org/46678915:55
odyssey4mecool, thanks15:55
*** woodard has quit IRC15:55
*** woodard has joined #openstack-ansible15:56
*** jvidal has quit IRC15:56
*** manheim_ has quit IRC15:57
odyssey4mepalendae small spelling error in https://review.openstack.org/46676915:58
*** lbragstad has joined #openstack-ansible15:58
*** pcaruana has quit IRC15:59
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-ops master: Allow graceful exiting with SIGINT and SIGTERM  https://review.openstack.org/46678015:59
palendaeodyssey4me: fixed15:59
openstackgerritMerged openstack/openstack-ansible-ops master: Make usage of exceptions more uniform  https://review.openstack.org/46676916:02
*** david-lyle has joined #openstack-ansible16:03
*** lucasxu has quit IRC16:04
*** udesale has joined #openstack-ansible16:05
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Add venv_tag local fact  https://review.openstack.org/46677116:05
logan-odyssey4me: https://review.openstack.org/#/c/466791/ in case you didnt see it16:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_rally master: Add venv_tag local fact  https://review.openstack.org/46679116:08
odyssey4meah, thanks logan- - missed it16:08
odyssey4memhayden is clearly a terrible reviewer, or trusts me way too much16:08
mhaydenodyssey4me: they followed the pattern!16:08
odyssey4mehaha, perhaps just a little too closely ;)16:08
mhaydenhaha, yeah, i missed one of those16:09
*** chas has quit IRC16:09
*** jvidal has joined #openstack-ansible16:09
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Add venv_tag local fact  https://review.openstack.org/46675716:10
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Add venv_tag local fact  https://review.openstack.org/46675016:10
openstackgerritMerged openstack/openstack-ansible-ops master: Allow graceful exiting with SIGINT and SIGTERM  https://review.openstack.org/46678016:12
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Add venv_tag local fact  https://review.openstack.org/46676116:13
*** mikal has quit IRC16:14
*** mikal has joined #openstack-ansible16:16
*** lucasxu has joined #openstack-ansible16:18
*** pbandark has quit IRC16:19
openstackgerritMerged openstack/openstack-ansible-os_nova master: Fix upgrades to map existing nova instances to cell1  https://review.openstack.org/46671716:20
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Add venv_tag local fact  https://review.openstack.org/46677016:22
*** udesale has quit IRC16:22
*** fabg has quit IRC16:26
*** drifterza has joined #openstack-ansible16:29
*** armaan has quit IRC16:31
*** armaan has joined #openstack-ansible16:32
*** vnogin has quit IRC16:33
*** jvidal has quit IRC16:35
openstackgerritMerged openstack/openstack-ansible-os_nova master: Add venv_tag local fact  https://review.openstack.org/46675816:36
openstackgerritMerged openstack/openstack-ansible-os_trove master: Add venv_tag local fact  https://review.openstack.org/46679316:37
*** kjw3 has joined #openstack-ansible16:37
openstackgerritMerged openstack/openstack-ansible-os_rally master: Add venv_tag local fact  https://review.openstack.org/46679116:44
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Add venv_tag local fact  https://review.openstack.org/46679216:44
*** markus_z has quit IRC16:45
*** lostRhino has left #openstack-ansible16:45
openstackgerritMerged openstack/openstack-ansible-os_gnocchi master: Add venv_tag local fact  https://review.openstack.org/46678316:49
*** jvidal has joined #openstack-ansible16:49
*** weezS has quit IRC16:49
xdfilIs memcached syncronized between the memcached containers? is it active/active ?16:55
*** jvidal has quit IRC16:56
*** galstrom is now known as galstrom_zzz16:58
xdfilnevermind I found the info I was looking for17:00
openstackgerritMerged openstack/openstack-ansible-os_designate master: Add venv_tag local fact  https://review.openstack.org/46678117:03
*** galstrom_zzz is now known as galstrom17:04
odyssey4mexdfil memcache has no concept of a cluster17:12
*** marst_ has joined #openstack-ansible17:13
*** piliman974 has quit IRC17:13
*** lucasxu has quit IRC17:14
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Add venv_tag local fact  https://review.openstack.org/46678417:16
*** admin0 has joined #openstack-ansible17:16
*** jmccrory_away is now known as jmccrory17:18
*** piliman974 has joined #openstack-ansible17:25
openstackgerritMerged openstack/openstack-ansible-os_ironic master: Add venv_tag local fact  https://review.openstack.org/46678617:32
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Add venv_tag local fact  https://review.openstack.org/46679017:32
*** armaan has quit IRC17:32
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server master: [WIP] Use local facts for MariaDB status  https://review.openstack.org/46682717:34
odyssey4mepalendae ^ I'd appreciate your review of the python script there - it's an adaptation of the library that git-harry did some time ago17:35
palendaeOk17:36
palendaeWait17:37
palendaeIt's just deleted17:37
palendaeOh nm17:37
palendaeI get it17:37
palendaeRead too fast :)17:37
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible master: DO NOT MERGE - testing integrated gate w/ceilo  https://review.openstack.org/45378817:38
odyssey4meThanks palendae - I'll work on its placement and the replacement of all the existing complicated stuff that uses the existing module and various CLI things17:38
odyssey4metomorrow17:39
palendaeSure thing17:39
*** rpittau_ has joined #openstack-ansible17:42
*** gouthamr has joined #openstack-ansible17:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683117:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683217:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/newton: Add venv_tag local fact  https://review.openstack.org/46683317:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683417:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_gnocchi stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683517:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_sahara stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683617:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_rally stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683717:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_trove stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683817:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683917:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_aodh stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684017:47
openstackgerritMerged openstack/openstack-ansible-os_magnum master: Add venv_tag local fact  https://review.openstack.org/46678817:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684117:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest stable/newton: Add venv_tag local fact  https://review.openstack.org/46684217:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684317:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684417:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/newton: Add venv_tag local fact  https://review.openstack.org/46684517:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_barbican stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684617:49
*** gouthamr has quit IRC17:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684717:49
*** rpittau_ has quit IRC17:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_heat stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684817:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684917:49
*** kjw3 has quit IRC17:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create stable/ocata: Add variant local fact  https://review.openstack.org/46685017:50
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create stable/newton: Add variant local fact  https://review.openstack.org/46685117:50
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum stable/ocata: Add venv_tag local fact  https://review.openstack.org/46685317:50
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum stable/newton: Add venv_tag local fact  https://review.openstack.org/46685517:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic stable/newton: Add venv_tag local fact  https://review.openstack.org/46685617:57
*** poopcat has joined #openstack-ansible18:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_gnocchi stable/newton: Add venv_tag local fact  https://review.openstack.org/46685718:00
*** admin0 has quit IRC18:01
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_sahara stable/newton: Add venv_tag local fact  https://review.openstack.org/46685818:02
*** kjw3 has joined #openstack-ansible18:02
*** armaan has joined #openstack-ansible18:02
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_rally stable/newton: Add venv_tag local fact  https://review.openstack.org/46685918:04
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/newton: Add venv_tag local fact  https://review.openstack.org/46686018:05
*** weezS has joined #openstack-ansible18:05
*** albertcard1 has joined #openstack-ansible18:05
*** poopcat has quit IRC18:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_aodh stable/newton: Add venv_tag local fact  https://review.openstack.org/46686118:07
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder stable/newton: Add venv_tag local fact  https://review.openstack.org/46686218:08
cloudnull^ odyssey4me on the rampage !18:09
mpranjicagain :)18:09
*** chas has joined #openstack-ansible18:09
cloudnullalways !18:09
cloudnull:D18:09
mpranjicodyssey4me: no more coffee for you! :)18:10
mpranjiclemesee some of those ...18:10
mhaydenscotch + coffee18:10
mpranjic:D18:10
mhaydenso on the centos side, i'm wondering if we can get some speedups from re-enabling fastestmirror and setting a more aggressive timeout18:10
mhaydenwe've still got that damned tempest/libvirt bug18:11
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone stable/newton: Add venv_tag local fact  https://review.openstack.org/46686318:11
*** jwitko_ has joined #openstack-ansible18:11
palendaemhayden: Well that sure sounds like a good setting to enable :D18:11
mpranjicmhayden: how much is centos slower than same setup on ubuntu?18:11
*** rcarrillocruz has joined #openstack-ansible18:11
mhaydensomething about how tempest asks for a VM makes libvirtd upset18:11
*** admin0 has joined #openstack-ansible18:11
mhaydenmpranjic: well there are still some issues with python 2.7.5 on centos w/ansible18:11
mhaydenfor some reason, it gets quicker if you install a newer version of python18:11
mhaydenand gets close to ubuntu's usual speed18:11
palendaemhayden: And that's separate from the Xenial issue?18:12
mhaydenhaha, right18:12
mhayden:|18:12
* mhayden collapses18:12
mhaydeni thought centos7 would be a more fun place, but now i have 2 problems18:12
mpranjicthat is weird18:12
mhaydenkinda like doing kubernetes the first time18:12
*** lucasxu has joined #openstack-ansible18:12
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_heat stable/newton: Add venv_tag local fact  https://review.openstack.org/46686418:12
*** retreved_ has joined #openstack-ansible18:13
palendaemhayden: Is it a specific version of Ansible?18:13
mhaydennah18:13
mhaydennot specific to ansible18:13
palendaeAh18:13
mhayden2.7.5 on CentOS 7 has some peculiar slowdowns w/ansible when it comes to running pip and yum18:13
palendaeWelp, time to rewrite it all in Go18:13
mhaydenmost other things are fairly similar in timings18:14
mhaydenhaha18:14
palendaeyum or dnf?18:14
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance stable/newton: Add venv_tag local fact  https://review.openstack.org/46686518:14
palendaedid not finish18:14
mhaydenyum18:14
mhaydendnf is going to be in RHEL 8, The Ocho18:14
palendaeAh, ok18:14
*** retreved has quit IRC18:14
*** chas has quit IRC18:14
*** jwitko has quit IRC18:14
mpranjicyeah, it is in fedora atm18:15
palendaeRight18:15
mhaydencan't wait til it comes out so i can call it "The Ocho"18:15
mhaydeni'm weird18:15
mhaydenvery well aware18:15
mpranjic:)18:15
palendaeI'd call it that too18:15
odyssey4memhayden well, there are local mirrors or reverse proxies for RDO which I don't think we're using18:15
odyssey4methe centos and epel mirrors should already be set to use the infra mirrors18:15
openstackgerritMerged openstack/openstack-ansible-security master: Move tasks to 'accounts' file  https://review.openstack.org/46649518:15
mpranjictoobad red hat  is restricting  rhel so much18:16
odyssey4meif you could spend some time mucking with https://review.openstack.org/462872 you might get some improved speed18:16
odyssey4meI haven't had the time to get back to it18:16
mpranjicthey would benefit more to take ubuntu's approach: os and patches free but you can pay for support18:16
palendaempranjic: Probably makes their life easier18:16
mpranjicatm I have no valid rhel subscription to try stuff18:16
*** stuartgr has quit IRC18:16
odyssey4meit's easy enough to get an eval subscription18:17
mhaydenmpranjic: well, read a few articles and you'll find that canonical isn't always friendly about ubuntu18:17
*** retreved_ has quit IRC18:17
mhaydenusing it for free, that is18:17
odyssey4memhayden I expect you should probably port https://review.openstack.org/466099 back to newton too?18:17
mhaydenboth approaches have their issues18:17
* mhayden ganders18:17
mpranjicmhayden: really? will check it out...18:17
mhaydenodyssey4me: i can't verify that the bug exists there18:18
mhaydenbut if you want me to bring it back there, i can18:18
odyssey4memhayden ah ok, I guess we'll do it reactively if someone asks for it18:18
* mhayden reacts18:18
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: Add venv_tag local fact  https://review.openstack.org/46677918:19
mpranjicmhayden: we use debian for entire stack at work. have Ubuntu for Tower since it is not supportted on Debian18:19
mpranjicand developers mostly have Ubuntu on laptops18:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer stable/ocata: Add venv_tag local fact  https://review.openstack.org/46686618:19
mpranjicbut I didn't stumble upon canonical issues you mentioned.. will google a bit ...18:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer stable/newton: Add venv_tag local fact  https://review.openstack.org/46686718:21
*** admin0 has quit IRC18:21
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-ops master: Add syslog logging handler  https://review.openstack.org/46686818:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/ocata: Fix upgrades to map existing nova instances to cell1  https://review.openstack.org/46686918:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate stable/ocata: Perform an atomic policy file change  https://review.openstack.org/46687018:23
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-ops master: Add syslog logging handler  https://review.openstack.org/46686818:24
*** gouthamr has joined #openstack-ansible18:24
*** armaan has quit IRC18:30
*** armaan_ has joined #openstack-ansible18:30
*** chas has joined #openstack-ansible18:31
*** chas has quit IRC18:35
openstackgerritMerged openstack/openstack-ansible-os_aodh stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684018:38
*** vnogin has joined #openstack-ansible18:39
*** lucasxu has quit IRC18:41
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Added an ALL is_metal scenario  https://review.openstack.org/44937218:41
*** albertcard1 is now known as poopcat18:41
*** esberglu_ has quit IRC18:42
hwoarangevrardjp: sorry for the delay18:42
hwoarangyeah good idea but i want to understand the issue first :/18:42
hwoarangso my plan is to use the centos rpm as provided by upstream and see if the 3.6.X version fixes it18:42
*** electrofelix has quit IRC18:43
*** lucasxu has joined #openstack-ansible18:43
*** esberglu has joined #openstack-ansible18:44
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: [WIP] Testing using a common SystemD init role  https://review.openstack.org/46617918:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer stable/ocata: Source template files from git or deploy host  https://review.openstack.org/46687418:48
*** armaan_ has quit IRC18:51
*** armaan has joined #openstack-ansible18:51
*** manheim_ has joined #openstack-ansible18:51
*** gouthamr has quit IRC18:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/ocata: Gnocchi: Update URL used to source default configs  https://review.openstack.org/46498518:55
*** manheim_ has quit IRC18:55
openstackgerritMerged openstack/openstack-ansible-lxc_container_create stable/ocata: Add variant local fact  https://review.openstack.org/46685018:55
openstackgerritMerged openstack/openstack-ansible-lxc_container_create stable/newton: Add variant local fact  https://review.openstack.org/46685118:56
*** retreved has joined #openstack-ansible18:56
*** lostRhino has joined #openstack-ansible18:57
palendaeDoes anyone know where rsyslog puts the 'user' facility logfiles on Ubuntu?18:57
palendaeI'd think /var/log/user.log, but not seeing it18:57
*** Mannheim has joined #openstack-ansible18:57
openstackgerritMerged openstack/openstack-ansible-os_rally stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683718:57
*** lucasxu has quit IRC18:58
*** admin0 has joined #openstack-ansible18:59
*** retreved_ has joined #openstack-ansible18:59
*** hybridpollo has joined #openstack-ansible19:00
openstackgerritMerged openstack/openstack-ansible-os_aodh stable/newton: Add venv_tag local fact  https://review.openstack.org/46686119:00
*** retreved has quit IRC19:01
*** smatzek has quit IRC19:02
*** smatzek has joined #openstack-ansible19:02
*** lucasxu has joined #openstack-ansible19:03
openstackgerritMerged openstack/openstack-ansible-os_rally stable/newton: Add venv_tag local fact  https://review.openstack.org/46685919:03
*** hybridpolio has joined #openstack-ansible19:04
*** hybridpollo has quit IRC19:04
openstackgerritMerged openstack/openstack-ansible-os_barbican stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684619:05
openstackgerritMerged openstack/openstack-ansible-os_glance stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684919:06
openstackgerritMerged openstack/openstack-ansible-os_heat stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684819:06
openstackgerritMerged openstack/openstack-ansible-os_heat stable/newton: Add venv_tag local fact  https://review.openstack.org/46686419:06
openstackgerritMerged openstack/openstack-ansible-os_gnocchi stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683519:08
openstackgerritMerged openstack/openstack-ansible-os_gnocchi stable/newton: Add venv_tag local fact  https://review.openstack.org/46685719:08
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/newton: Add venv_tag local fact  https://review.openstack.org/46683319:08
*** hybridpolio is now known as hybridpollo19:08
openstackgerritMerged openstack/openstack-ansible-os_trove stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683819:09
openstackgerritMerged openstack/openstack-ansible-os_glance stable/newton: Add venv_tag local fact  https://review.openstack.org/46686519:10
*** chas has joined #openstack-ansible19:12
lostRhinocan anyone help out - i know its late in the day - but we are getting an error during the “galera_client : Install pip packages” portion of our install of OSAD… its a fairly long error that points to the openstack/upper-constraints (see here: http://paste.openstack.org/show/610269/ ) we know the fix - is to run “ansible -a "systemctl restart keepalived" compute-infra_hosts”19:12
lostRhinois there a reason why this is happening or a way to avoid it - there seems to be a issue with keepalived not starting/restarting, we’re not sure why this started - we were having successful builds before and now it stops…19:12
lostRhinoany help would be appreciated19:12
mhaydenpalendae: 14.04 or 16.04?19:12
cloudnulllostRhino: normally that's due to an problem w/ the load balancer.19:13
cloudnullusing haproxy ?19:13
palendaemhayden: 14.04 on the utility containers. Looks like we leave the user and local7 facilities unconfigured19:13
lostRhinoyes currently19:13
palendaeIt's not vital to what I'm doing right now, so I'm gonna punt on that19:13
openstackgerritMerged openstack/openstack-ansible-os_sahara stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683619:13
cloudnulllostRhino: I'd check to see if the hap is running and that the backends are up19:14
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-ops master: Log failure percentage before exiting  https://review.openstack.org/46687819:14
lostRhinowell as along as we restart keepalived it will continue - but we have to get on our provisioner and then run openstack-ansible setup-infrastructure19:14
lostRhinoto continue with the install - which is a pain in the @**19:14
openstackgerritMerged openstack/openstack-ansible-os_keystone stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684719:16
openstackgerritMerged openstack/openstack-ansible-os_keystone stable/newton: Add venv_tag local fact  https://review.openstack.org/46686319:17
*** chas has quit IRC19:17
openstackgerritMerged openstack/openstack-ansible-os_ceilometer stable/newton: Add venv_tag local fact  https://review.openstack.org/46686719:18
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-ops master: Log failure percentage before exiting  https://review.openstack.org/46687819:18
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible master: DO NOT MERGE - testing integrated gate w/ceilo  https://review.openstack.org/45378819:18
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683219:19
openstackgerritMerged openstack/openstack-ansible-os_magnum stable/ocata: Add venv_tag local fact  https://review.openstack.org/46685319:20
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/newton: Add venv_tag local fact  https://review.openstack.org/46684519:20
lostRhinocloudnull: any other things I should look for?  Thanks for your help….19:22
openstackgerritMerged openstack/openstack-ansible-os_cinder stable/newton: Add venv_tag local fact  https://review.openstack.org/46686219:22
*** lostRhino has left #openstack-ansible19:23
*** lostRhino has joined #openstack-ansible19:23
cloudnulllostRhino: so you're seeing the vip flip back and forth ?19:24
cloudnullwhich is causing the issues?19:24
*** hogwash has joined #openstack-ansible19:24
cloudnulland restarting keepalived is fixing it ?19:24
lostRhinohow would I check that ?  or know the vip is fliping back and forth?19:24
lostRhinoyes restarting keepalive is fixing it19:24
cloudnullstop keepalived and hap on the second haproxy node.19:25
lostRhinoi just got done doing the setup-infrasturcte19:25
cloudnullget it stable on the one and continue the installation19:25
lostRhinodone and done sir19:25
cloudnullyou can always add to it19:25
cloudnullwithout having to redploy19:25
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683119:26
cloudnullonce the cloud is online and stable you can circle back and get multi-node haporxy running correctly19:26
cloudnullno sense in fighting that battle upfront if you don't have to.19:26
cloudnullthat said, evrardjp should be around in the am19:26
cloudnulland is our resident keepalived export19:26
cloudnull**expert19:26
lostRhinoyeah I just dont get why it worked well a couple weeks again and now its stopping mid build19:27
*** drifterza has quit IRC19:27
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/newton: Add venv_tag local fact  https://review.openstack.org/46684219:28
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684119:28
lostRhinoon this one service …19:28
cloudnulllostRhino: really hard to say, the logs should show the disconnects.19:28
lostRhinowhich logs -19:29
lostRhino:eek:19:29
cloudnullI think /var/log/keepalived-notifications.log ?19:30
openstackgerritMerged openstack/openstack-ansible-os_cinder stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684319:31
*** whiteveil has joined #openstack-ansible19:33
lostRhino2017-05-22 17:12:16 Trying to restart haproxy to get out of faulty state19:33
lostRhino2017-05-22 17:12:55 Unknown state19:33
lostRhino2017-05-22 18:47:08 Unknown state19:33
*** chas has joined #openstack-ansible19:33
lostRhinoanyways - I’m outta here cloudnull - I’ll be back tomorrow to follow up - thanks for the pointers/tips/help19:34
*** lostRhino has left #openstack-ansible19:34
openstackgerritMerged openstack/openstack-ansible-os_designate stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683419:35
openstackgerritMerged openstack/openstack-ansible-os_designate stable/ocata: Use internalURL by default for Neutron  https://review.openstack.org/46506419:35
openstackgerritMerged openstack/openstack-ansible-os_designate stable/ocata: Optimise apt cache update task  https://review.openstack.org/46285019:35
openstackgerritMerged openstack/openstack-ansible-os_designate stable/ocata: Ensure the components are isolated from the system  https://review.openstack.org/46015519:35
openstackgerritMerged openstack/openstack-ansible-os_designate stable/ocata: Reduce init restart/kill times  https://review.openstack.org/46071719:35
cloudnullanytime .19:35
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-ops master: Log failure percentage before exiting  https://review.openstack.org/46687819:36
cloudnulllet me know how it goes ‎lostRhino‎19:36
openstackgerritMerged openstack/openstack-ansible-os_nova stable/ocata: Add venv_tag local fact  https://review.openstack.org/46683919:38
openstackgerritMerged openstack/openstack-ansible-os_nova stable/newton: Add venv_tag local fact  https://review.openstack.org/46686019:38
*** chas has quit IRC19:38
*** whiteveil_ has joined #openstack-ansible19:43
*** admin0 has quit IRC19:43
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-ops master: Log failure percentage before exiting  https://review.openstack.org/46687819:44
openstackgerritMerged openstack/openstack-ansible-os_magnum stable/newton: Add venv_tag local fact  https://review.openstack.org/46685519:44
*** admin0 has joined #openstack-ansible19:45
*** whiteveil has quit IRC19:46
*** whiteveil_ is now known as whiteveil19:46
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/newton: Add venv_tag local fact  https://review.openstack.org/46685619:47
*** chhavi has quit IRC19:48
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/ocata: Add venv_tag local fact  https://review.openstack.org/46684419:49
openstackgerritMatthew Thode proposed openstack/openstack-ansible-ops master: make the default base network match variables.sh  https://review.openstack.org/46688319:53
*** chas has joined #openstack-ansible19:54
*** smatzek has quit IRC19:55
*** armaan_ has joined #openstack-ansible19:56
*** smatzek has joined #openstack-ansible19:58
*** chas has quit IRC19:59
*** armaan has quit IRC19:59
openstackgerritMerged openstack/openstack-ansible-os_ceilometer stable/ocata: Add venv_tag local fact  https://review.openstack.org/46686620:03
*** mpranjic_ has joined #openstack-ansible20:04
*** mpranjic_ has quit IRC20:04
*** weezS has quit IRC20:05
*** vnogin has quit IRC20:08
*** admin0 has quit IRC20:11
*** chas has joined #openstack-ansible20:15
*** chas has quit IRC20:19
*** admin0 has joined #openstack-ansible20:21
*** weezS has joined #openstack-ansible20:22
*** lbragstad has quit IRC20:26
*** karimb has quit IRC20:33
*** smatzek has quit IRC20:34
*** weezS has quit IRC20:35
*** chas has joined #openstack-ansible20:36
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-ops master: Catch all errors and provide failure summary  https://review.openstack.org/46687820:38
*** hogwash has quit IRC20:38
*** weezS has joined #openstack-ansible20:39
*** chas has quit IRC20:41
*** hogwash has joined #openstack-ansible20:49
*** askb has joined #openstack-ansible20:53
*** hogwash has quit IRC20:54
*** gouthamr has joined #openstack-ansible20:54
*** chas has joined #openstack-ansible20:57
*** thorst_afk has quit IRC20:58
*** thorst_afk has joined #openstack-ansible20:59
*** NeilHanlon_ is now known as NeilHanlon20:59
*** NeilHanlon has quit IRC20:59
*** NeilHanlon has joined #openstack-ansible20:59
*** retreved_ has quit IRC21:00
jgriffithsIs there are way to sepcify "flat_networks = provider21:01
jgriffiths" and "network_vlan_ranges = provider" in openstack ansible?21:01
*** chas has quit IRC21:02
*** thorst_afk has quit IRC21:03
*** whiteveil has quit IRC21:05
*** woodard has quit IRC21:09
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible stable/newton: Updated from global requirements  https://review.openstack.org/46690921:09
*** aludwar has quit IRC21:10
*** hogwash has joined #openstack-ansible21:11
*** gouthamr has quit IRC21:13
*** hogwash has quit IRC21:16
*** gouthamr has joined #openstack-ansible21:16
*** chas has joined #openstack-ansible21:18
openstackgerritJimmy McCrory proposed openstack/openstack-ansible master: [WIP] Update Ansible to 2.3.1.0-0.1.rc1  https://review.openstack.org/46691221:19
*** aludwar has joined #openstack-ansible21:21
*** chas has quit IRC21:22
*** esberglu has quit IRC21:24
openstackgerritMerged openstack/openstack-ansible-os_swift master: Add venv_tag local fact  https://review.openstack.org/46675921:30
*** jheroux has quit IRC21:30
*** galstrom is now known as galstrom_zzz21:31
*** thorst_afk has joined #openstack-ansible21:36
*** chas has joined #openstack-ansible21:39
*** cpuga_ has quit IRC21:39
*** esberglu has joined #openstack-ansible21:39
*** thorst_afk has quit IRC21:40
*** gouthamr has quit IRC21:41
*** jwitko has joined #openstack-ansible21:41
*** armaan_ has quit IRC21:42
*** chas has quit IRC21:43
*** jwitko_ has quit IRC21:44
*** cjloade__ has joined #openstack-ansible21:50
*** cjloader_ has quit IRC21:54
*** admin0 has quit IRC21:54
*** cjloade__ has quit IRC21:55
*** lucasxu has quit IRC21:58
*** chas has joined #openstack-ansible21:59
*** chas has quit IRC22:04
*** weezS has quit IRC22:10
*** Mannheim has quit IRC22:12
*** kylek3h has quit IRC22:12
*** manheim_ has joined #openstack-ansible22:20
*** chas has joined #openstack-ansible22:20
*** manheim__ has joined #openstack-ansible22:23
*** chas has quit IRC22:25
*** klamath has quit IRC22:25
*** manheim_ has quit IRC22:26
jgriffithsIs there a way to delete a single neutron agent container so I can have openstack-ansible recreate it22:40
*** manheim__ has quit IRC22:40
cloudnulljgriffiths: yes.22:41
cloudnullyou can target the container22:41
*** chas has joined #openstack-ansible22:41
cloudnullopenstack-ansible lxc-container-destroy.yml lxc-container-create.yml --limit $CONTAINER_NAME22:41
jgriffithsI'm not sure I know what you mean. Sorry22:41
cloudnullopenstack-ansible os-neutron-install.yml22:42
cloudnull^ jgriffiths with those two commands you should be able to recreate the specific contianer and redeploy neutron things inside it22:42
jgriffithsYeah. I do that. I just wanted to delete a container. Can I do that without messing everything up22:42
cloudnullyou could even limit that last command with something like .22:42
cloudnullopenstack-ansible os-neutron-install.yml --limit all_containers22:42
cloudnullso that it omits the compute nodes.22:43
cloudnullas for "flat_networks = provider", what are you looking for ?22:43
jgriffithsRight now. Everything just took a crap. I found your github about provider networks earlier today22:44
jgriffithslxc-container-destroy blows away the entire environment, no?22:44
jgriffithsThat would be bad.22:45
*** chas has quit IRC22:46
jgriffithsFor the networks, we have a bunch of very specific VLANS we need to connect to individual tenants. I'm not a networking person, but I'm beind told they are provider networks. When I looked at an existing envirnment, that's the setting they had in the ml2 plugin configuration22:47
jgriffithsRight now, I have one container that's not responding and I can't get it back up.22:48
jgriffithsI want to blow it away and re-run setup-hosts to recreate it. Does "openstack-ansible lxc-container-destroy.yml --limit  "node003_neutron_agents_container-46918615" wirk?22:51
jgriffithsWork - omg22:51
jgriffithsI'm afraid to run that22:54
cloudnulljgriffiths: sorry saw a Squirrel22:58
cloudnullif you run that playbook with the limit it wont kill the entire env.22:58
jgriffithshaha.22:58
cloudnullthe limit is important in that context.22:58
logan-run it with --list-hosts first22:59
logan-to verify it is going to do what you think it will do22:59
cloudnull^ thats a good way to validate it22:59
openstackgerritMerged openstack/openstack-ansible stable/newton: Updated from global requirements  https://review.openstack.org/46690922:59
jgriffithsThank you22:59
*** thorst_afk has joined #openstack-ansible23:00
cloudnullin your example, I'd run ``openstack-ansible lxc-container-destroy.yml lxc-container-create.yml --limit  "node003_neutron_agents_container-46918615"23:00
jgriffithsI just ran the destroy. No I'm trying to run the create and it's looking for the ond container23:01
jgriffithsThanks for the help btw23:01
logan-rm /etc/openstack_deploy/ansible_facts/node003_neutron_agents_container-46918615 after destroy23:01
cloudnullnp23:01
cloudnull^ good point.23:02
*** chas has joined #openstack-ansible23:02
cloudnulljgriffiths: which release?23:02
jgriffithsNewton23:02
cloudnullcool.23:02
cloudnullthat should do it :)23:03
jgriffithslawl. Now it's not defined. haha23:03
jgriffithsfatal: [node003_neutron_agents_container-46918615]: FAILED! => {"changed": false, "failed": true, "module_stderr": "Error: container node003_neutron_agents_container-46918615 is not defined\n", "module_stdout": "", "msg": "MODULE FAILURE"}23:03
*** thorst_afk has quit IRC23:04
*** thorst_afk has joined #openstack-ansible23:05
logan-which playbook?23:05
logan-after destroy, delete the cached fact and then run "openstack-ansible lxc-containers-create.yml --limit node003_neutron_agents_container-46918615; openstack-ansible os-neutron-install.yml --limit all_containers;"23:05
jgriffithsos-neutron-install.yml23:06
jgriffithsls23:06
jgriffithsmt23:06
*** chas has quit IRC23:06
*** thorst_afk has quit IRC23:09
jgriffithsGod. I really hate to waste all this help on my inability to do Ansible. I deleted the /etc/openstack_deploy/ansible_facts/node003_neutron_agents_container-46918615' file but os-neutron-install tells me the it's not defined.23:11
logan-did you run the lxc-containers-create.yml first?23:12
*** cpuga has joined #openstack-ansible23:13
jgriffithshaha. Of course I didn't. That's it~23:13
jgriffithsThanks!23:13
jgriffithsfg23:14
jgriffithsI've been trying to get VLANs to work in my Ansible config. Everytime I tried to create a instance, it couldn't attach a port.23:16
cloudnullare you seeing a vif type binding failure ?23:16
*** jamesdenton has joined #openstack-ansible23:16
*** weezS has joined #openstack-ansible23:17
cloudnulland do you have https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.aio#L46-L54 ?23:17
cloudnullin your openstack_user_config?23:17
jgriffithsYes. Both of those things. The flat and the vlan. I was thinking it was the missing veth settings in the br-vlan.cfg file though. I found the settings on something you wrote cloudnull.23:18
jgriffithsI was adding them to my br-vlan, when I lost half my nodes23:18
cloudnulldo your compute hosts have eth12 ?23:19
jgriffithsYes23:19
cloudnullok.23:19
*** jamesden_ has joined #openstack-ansible23:20
jgriffithsOne last Ansible question if you don't mind.23:20
cloudnulla lot of the time we'll see a vif type failure when something can not bind23:21
*** jamesdenton has quit IRC23:21
cloudnullcheck to make sure your neutron linux-bridge-agents are running23:21
cloudnullmaybe stop one on a given compute node, and start it in the foreground23:21
cloudnullso that you can see the direct log output23:21
jgriffithsThey were. That's the problem now though. I'm still trying to recover from the broekn node and the facts are trying to use configuration settings from some time ago23:22
cloudnullif it hangs or otherwise does very little (or stacktraces) It's likely that theres a misconfiguration somewhere23:22
cloudnullyou are free to destroy all of the facts if that helps .23:22
jgriffithsI wish I had spoken to you before everything blew up23:22
*** piliman974 has quit IRC23:23
jgriffithsThat's safe?23:23
*** chas has joined #openstack-ansible23:23
cloudnullrm /etc/openstack_deploy/ansible_facts/*23:23
cloudnullif they don't exist, they'll be recreated23:23
*** piliman974 has joined #openstack-ansible23:24
cloudnullsorry, I've been fairly absent these last couple of weeks.23:25
cloudnullworking on too many things at once23:25
* cloudnull knows he23:25
jgriffithsGod. No. Thanks! Last week was hell trying to get this thing running.23:25
* cloudnull knows he's preaching to the Choir :)23:26
jgriffithsI'm doing a full lxc-create now.23:27
*** chas has quit IRC23:27
cloudnullwhile that will iterate through the containers, it will only create things that are missing .23:28
*** weezS has quit IRC23:28
cloudnullit should be fairly quick23:28
openstackgerritMerged openstack/openstack-ansible-os_designate stable/ocata: Perform an atomic policy file change  https://review.openstack.org/46687023:29
*** jamesden_ has quit IRC23:30
jgriffithsOh. I have eth12 because of "pre-up ip link add br-vlan-veth type veth peer name eth12 || true" this, don't I?23:30
jgriffithsThat wasn't there when I was having the trouble. I added it right before I lost half my nodes.23:31
cloudnulldid that half have that stanza?23:31
*** pmannidi has quit IRC23:31
jgriffithsNo. I added it to the br-vlan interface. I lost br-mgmt23:32
cloudnullhttps://github.com/openstack/openstack-ansible/blob/master/etc/network/interfaces.d/aio_interfaces.cfg#L52-L5923:32
cloudnullso those lines are needed to make the veth bits go23:32
jgriffithsYeah. That's where I got it from (that and a github repo by somenody named cloudnull)23:33
cloudnulland make sure you dont have a duplicate of this line https://github.com/openstack/openstack-ansible/blob/master/etc/network/interfaces.d/aio_interfaces.cfg#L5923:33
* cloudnull hides23:33
jgriffithshaha.23:33
cloudnullyou can however have multiple ports assigned to bridge_ports, something like """bridge_ports eth2 br-vlan-veth"""23:34
cloudnulldid you figure out why mgmt went down ?23:34
jgriffithsI lost two nodes. No idea why yet23:35
cloudnullok.23:35
cloudnullare the other interfaces up ?23:35
jgriffithsHalf. Yes, it's small. It's supposed to get really big23:35
jgriffithsYeah, actually23:35
jgriffithsThey're all up now23:35
cloudnulleven mgmt ?23:35
jgriffithsifdown ifup fixed them all23:35
cloudnullcosmic rays?23:35
cloudnull:)23:35
jgriffithsI rebooted node003 though. That caused a whole host of other problems. Agent still refused to start on any nodes.23:36
cloudnullso ifup/down on infra nodes will break the containers connections to the veth, so if you do that there make sure to run the lxc-veth-check command after23:37
jgriffithsAgent is throwing "MessagingTimeout" on every node, but all the other containers are running just fine23:37
jgriffithsOh23:37
cloudnullthat sounds like rabbitmq has died23:37
jgriffithsOkay23:37
jgriffithsYeah, you would think so, but everything else is working23:38
cloudnullor maybe not able to communicate due to link breakage23:38
cloudnullansible -m shell -a 'lxc-veth-check' hosts23:38
cloudnulljust to do a blanket check across the environment.23:38
cloudnullif the link is busted the command will attempt to fix it23:39
jgriffithscontainer node002_neutron_agents_container-7abef153 had a broken veth 7abef153_eth12 not being plugged into br-vlan: this issue is now res23:39
cloudnullif it can't fix it, it will tell you23:39
cloudnullboom!23:39
jgriffithsOh. I just had a loose wire23:41
jgriffithsRunning setup-hosts to see if the agent will come backup. Probably should have limited it23:42
jgriffithsIs lxc-veth-check yours?23:44
*** chas has joined #openstack-ansible23:44
jgriffithsIn https://github.com/openstack/openstack-ansible/blob/master/etc/network/interfaces.d/aio_interfaces.cfg#L52-L59 , why is there an IP on the interface?23:45
*** chas has quit IRC23:48
cloudnullyea that tool was written by me but, its part of the lxc-hosts role.23:51
cloudnullthe IP is there on that interface for the gate.23:51
cloudnullwe create vms using the flat netowrk23:51
cloudnulland ensure we can access and install things within them23:51
cloudnullyou wont need that in 90% of prod deployments.23:52
jgriffithsFor some reason, a bad setting I made a long time ago is still popping up in  openstack_inventory.json and it's causing setup-hosts to fail23:52
cloudnullwhat settin g?23:54
jgriffiths /etc/openstack_deploy/openstack_inventory.json:                    "POC_Web_Net-interface_address": {23:55
jgriffithsI was playing with the interfaces this morning, and the change doesn't want to go away23:55
cloudnullis that in the openstack _user_config.yml or any of the files within /etc/openstack_deploy/conf.d23:55
cloudnull?23:55
*** pmannidi has joined #openstack-ansible23:55
jgriffithsNowhere. I grepped the entire /etc and /opt directories and only found it in the inventory file.23:56
cloudnullok, sadly, you have to delete that entry by hand or revert to an earlier inventory version that doesn't have it23:57
jgriffithsOkay. I can do that23:57
jgriffithsI think.23:57
jgriffithsIt's pissed at me again though23:57
cloudnullthere's the openstack_inventory.tar which contains timestamp'd version of inventory23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!