Monday, 2015-04-20

*** daneyon has joined #openstack-ansible00:08
*** darrenc is now known as darrenc_afk00:12
*** sacharya has joined #openstack-ansible00:13
*** darrenc_afk is now known as darrenc00:22
*** mahito has joined #openstack-ansible00:23
*** sdake has quit IRC00:29
*** javeriak has quit IRC00:36
*** sacharya has quit IRC00:45
*** mahito_ has joined #openstack-ansible01:36
*** mahito has quit IRC01:40
*** mahito_ has quit IRC01:56
*** mahito has joined #openstack-ansible01:58
openstackgerritJimmy McCrory proposed stackforge/os-ansible-deployment: Avoid restarting RabbitMQ server unnecessarily  https://review.openstack.org/17524602:04
*** britthou_ has quit IRC02:13
*** britthouser has joined #openstack-ansible02:13
*** stevemar has joined #openstack-ansible02:14
*** sdake has joined #openstack-ansible02:21
*** sdake has quit IRC03:23
openstackgerritJimmy McCrory proposed stackforge/os-ansible-deployment: Avoid restarting RabbitMQ server unnecessarily  https://review.openstack.org/17525303:25
*** ishant has joined #openstack-ansible04:04
*** subscope has joined #openstack-ansible04:25
*** subscope has quit IRC04:47
*** ishant has quit IRC05:13
*** javeriak has joined #openstack-ansible05:22
*** ishant has joined #openstack-ansible05:38
*** javeriak_ has joined #openstack-ansible06:12
*** javeriak has quit IRC06:14
*** stevemar has quit IRC06:40
*** stevemar has joined #openstack-ansible06:54
*** subscope has joined #openstack-ansible07:10
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Applying copy_update to all policy.json files  https://review.openstack.org/17527907:17
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Bump the tempest defcore repository version to master  https://review.openstack.org/17498307:20
openstackgerritMerged stackforge/os-ansible-deployment: Applying copy_update to all policy.json files  https://review.openstack.org/17502408:00
openstackgerritMerged stackforge/os-ansible-deployment: Enable dashboard scenario test  https://review.openstack.org/17488408:01
openstackgerritMerged stackforge/os-ansible-deployment: Enable dashboard scenario test  https://review.openstack.org/17489008:01
*** stevemar has quit IRC08:06
openstackgerritMerged stackforge/os-ansible-deployment: Avoid restarting RabbitMQ server unnecessarily  https://review.openstack.org/17524608:28
*** mahito has quit IRC08:34
*** ishant has quit IRC09:28
*** javeriak_ has quit IRC09:59
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Applying copy_update to all policy.json files  https://review.openstack.org/17527911:00
svgWhat's the reasoning behind the ssh_retry.py connection plugin?12:23
odyssey4mesvg it automatically retries connections within the ansible pipeline when ansible fails to connect on the first attempt12:25
svgthe question is, why is this needed in this project?12:25
odyssey4meit's not essential for production in any way, as you're able to simply re-run the playbook if you want to - but for gate testing and similar automation it's useful12:25
odyssey4mewe've submitted a PR for it upstream, but it's yet to be merged12:26
svgI'm seeing sometimes containers that aren't properly started, so I thought perhaps that was one of the reasons12:26
odyssey4meand it is no longer in this project - it got removed from master before the kilo tag was cut - it's only in the juno/icehouse branches for legacy12:26
svgah ok12:27
odyssey4mesvg nope, the plugin only affects ansible connecting to a target - it doesn't affect the target host at all as it only runs on the ansible host12:27
svgyes, bbut if a container takes some more time to be available, that might have been a workaround12:30
svgrebooting the metal host, I noticed it sometimes took quite a while for the containers to come up12:30
svgat one time, they came 'up' quickly, but ssh wan't properly started - I had to restart it on a bunch of containers to be able to contact the container12:31
*** jaypipes has joined #openstack-ansible12:33
odyssey4mesvg that wasn't the purpose, the issue we found was that the ssh connections would fail sometimes regardless of the fact that openssh-server was listening and the target was fully running... it was to workaround an intermittent failure. What you're seeing is not something we've heard of before, so if you get to the bottom of it it'd be great to know what solved it.12:40
odyssey4meBy the way, which branch/tag did you build from again?12:40
svgjuno12:40
svg10.1.212:40
odyssey4meYou may wish to take a look at the updates in 10.1.3 and 10.1.4 will also be released in the next few weeks. Some of those updates may assist with issues you find.12:42
svgI'm doing a full bare deploy nog with 10.1.2 (with my ceph patch), and will test upgrading to 10.1.3 etc after that12:50
svgsee, just got the issue again right now:12:50
svgfailed: [dc1-rk4-ch1-bl1_neutron_server_container-11315017] => {"elapsed": 180, "failed": true}12:50
svgmsg: Timeout when waiting for 10.16.9.188:2212:50
svgWhen manually ssh-ing into that container, it fails too, and after a second try (where i added -v), it suddenly works12:51
svg:-s12:51
odyssey4methat does sound similar to what we used ssh_retry to workaround12:51
*** sdake has joined #openstack-ansible12:56
*** KLevenstein has joined #openstack-ansible13:01
cloudnullmornings13:38
matttmiguelgrinberg: can you ping me when you're online?13:40
matttcloudnull: morning!13:40
*** sigmavirus24_awa is now known as sigmavirus2413:42
cloudnullhows it mattt :)13:44
odyssey4mesvg it may be an idea to actually add some sort of port/wait/retry check before trying to access the containers.13:44
odyssey4meo/ cloudnull top o' the morning to ya13:45
cloudnullpip pip ta!13:45
odyssey4mecloudnull just fyi - it would seem to me that the rsyslog server may not actually be implementing a listening rsyslog and storing the logs13:51
*** Mudpuppy has joined #openstack-ansible13:57
*** Mudpuppy has quit IRC13:58
*** Mudpuppy has joined #openstack-ansible13:59
odyssey4mecloudnull I'm not seeing any logs on the rsyslog server in /var/log/rsyslog, which is why I think we have a bug there13:59
*** sdake has quit IRC13:59
cloudnullodyssey4me is that for the AIO ?14:05
odyssey4mecloudnull yup14:05
cloudnulllooks like it not being deployed https://github.com/stackforge/os-ansible-deployment/blob/master/scripts/run-playbooks.sh#L82-L8414:05
*** sdake has joined #openstack-ansible14:05
odyssey4mecloudnull hah, good find14:05
cloudnullbut it is when you call the meta play https://github.com/stackforge/os-ansible-deployment/blob/master/playbooks/setup-infrastructure.yml#L2114:06
cloudnullso thats my bad,14:06
cloudnullseems i forgot to update the gate scripts.14:06
odyssey4meok, I was using run-playbooks, so easy fix :)14:06
cloudnulldo we have an open bug for that ?14:06
odyssey4mecloudnull not yet, I was just trying to sanity check my findings before doing so14:07
odyssey4meI need to afk for a bit - can you sort it out quickly?14:07
odyssey4meodd though, I just ran the rsyslog-install play and still nothing14:09
odyssey4methe only config in place is /etc/rsyslog.d/50-default.conf14:09
odyssey4mebbiab14:10
*** jwagner_away is now known as jwagner14:14
*** alextric_ is now known as alextrcitiy14:18
*** sdake has quit IRC14:21
*** sdake has joined #openstack-ansible14:23
*** daneyon_ has joined #openstack-ansible14:24
*** sdake_ has joined #openstack-ansible14:24
*** daneyon has quit IRC14:26
*** sdake has quit IRC14:28
cloudnullodyssey4me i'll file the issue and trackdown the issues.14:34
*** stevemar has joined #openstack-ansible14:39
*** sdake has joined #openstack-ansible14:44
alextrcitiynice workaround: https://github.com/stackforge/os-ansible-deployment/blob/f3d2e15256b5be7f995b0587fbb6e672e4945fe1/playbooks/roles/os_nova/handlers/main.yml#L2814:47
alextrcitiyjust saying ;014:47
alextrcitiy:)*14:47
*** sdake_ has quit IRC14:47
alextrcitiyBeats writing a different task for each service14:47
openstackgerritSerge van Ginderachter proposed stackforge/os-ansible-deployment: [WIP] first shot at implementing Ceph/RBD support  https://review.openstack.org/17322914:54
openstackgerritMiguel Alejandro Cantu proposed stackforge/os-ansible-deployment: Implement Ceilometer[WIP]  https://review.openstack.org/17306714:57
alextrcitiyOh dang we have a kilo branch now14:57
alextrcitiyI'll submit this for kilo14:57
svgHmz, seems I shouldn't have rebased that updated 3rd patch? https://review.openstack.org/#/c/173229/14:58
odyssey4mealextrcitiy the approach in general would be to proposed initially to master, then backported to kilo/etc15:01
alextrcitiyodyseey4me: Will do :)15:01
cloudnullsvg you can rebase to your hearts desire :)15:01
svgcloudnull: well, looking at the diff etween 2 and 3 (taking 2 as base) there's a bunch of changes from the main branch15:02
svgso not easy to see the difference between 1 and 3 or 2 and 315:07
*** sacharya has joined #openstack-ansible15:21
openstackgerritKevin Carter proposed stackforge/os-ansible-deployment: Adds rsyslog-install.yml in to the gate scripts.  https://review.openstack.org/17545015:30
cloudnullodyssey4me ^15:30
openstackgerritKevin Carter proposed stackforge/os-ansible-deployment: Adds rsyslog-install.yml in to the gate scripts.  https://review.openstack.org/17545515:35
*** jlvillal has quit IRC15:52
*** jlvillal has joined #openstack-ansible15:52
*** Bjoern___ has joined #openstack-ansible15:52
*** sdake_ has joined #openstack-ansible15:57
*** sdake has quit IRC16:00
*** daneyon has joined #openstack-ansible16:02
*** sdake has joined #openstack-ansible16:02
*** daneyon_ has quit IRC16:04
*** sdake_ has quit IRC16:05
openstackgerritMerged stackforge/os-ansible-deployment: Applying copy_update to all policy.json files  https://review.openstack.org/17527916:05
svgthe kilo branch contains metal/common/filter_plugins/ipaddr.pyc  metal/common/lookup_plugins/dig.pyc16:11
svgis that an error?16:11
svgsound slike something forgotten to erase, I see16:12
sigmavirus24svg: try "git clean -f"16:13
odyssey4mesvg I'm not seeing those?16:14
svggit clean -f doesnt delete them16:14
svgouch16:15
* svg slaps himsef with a large trout16:16
sigmavirus24Oh if they're ignored you might need to do -X with -f16:17
sigmavirus24e.g., git clean -Xf16:17
cloudnullhahahaha16:17
*** sdake has quit IRC16:23
*** sdake has joined #openstack-ansible16:25
alextrcitiyDo i have to do anything special to use default role variables across different roles?16:48
alextrcitiyi.e using ceilometer default role variables in the swift role16:48
cloudnullalextrcitiy you'd have to make set the value in the group_vars/all.yml16:50
cloudnullfor all of the roles that you want to impact.16:50
alextrcitiycloudnull: I see. Thanks :)16:51
*** sdake_ has joined #openstack-ansible16:57
*** sdake has quit IRC17:00
openstackgerritKevin Carter proposed stackforge/os-ansible-deployment: Revert heat's keystone_authtoken configuration  https://review.openstack.org/17544917:01
openstackgerritKevin Carter proposed stackforge/os-ansible-deployment: Revert heat's keystone_authtoken configuration  https://review.openstack.org/17548817:05
cloudnullpalendae d34dh0r53 : can you do the need full's on those two patches ^17:05
*** sdake has joined #openstack-ansible17:06
alextrcitiyandymccr: Did you do some work on the swift plays?17:07
alextrcitiyandymccr: I'm wondering if you know anything about adding swift system users through the play17:08
alextrcitiyOr a task rather17:08
*** sdake_ has quit IRC17:09
*** daneyon_ has joined #openstack-ansible17:11
*** daneyon has quit IRC17:12
palendaecloudnull: Looks like needfuls have been done17:13
openstackgerritMiguel Alejandro Cantu proposed stackforge/os-ansible-deployment: Implement Ceilometer[WIP]  https://review.openstack.org/17306717:23
openstackgerritMerged stackforge/os-ansible-deployment: Adds rsyslog-install.yml in to the gate scripts.  https://review.openstack.org/17545017:26
*** javeriak has joined #openstack-ansible18:05
openstackgerritMerged stackforge/os-ansible-deployment: Adds rsyslog-install.yml in to the gate scripts.  https://review.openstack.org/17545518:11
*** sdake_ has joined #openstack-ansible18:14
*** sdake has quit IRC18:18
*** jmccrory_ has joined #openstack-ansible18:27
*** sdake has joined #openstack-ansible18:30
*** galstrom_zzz is now known as galstrom18:31
openstackgerritMark DeVerter proposed stackforge/os-ansible-deployment: Adds dhcp_domain to dhcp_agent.ini  https://review.openstack.org/17552718:31
*** sdake_ has quit IRC18:34
openstackgerritIan Cordasco proposed stackforge/os-ansible-deployment: Adds dhcp_domain to dhcp_agent.ini  https://review.openstack.org/17552718:35
*** galstrom is now known as galstrom_zzz18:41
openstackgerritMerged stackforge/os-ansible-deployment: Revert heat's keystone_authtoken configuration  https://review.openstack.org/17548818:52
andymccralextrcitiy: sure, the swift user/group should get added as a task in the swift_pre_install.yml18:54
alextrcitiyandymccr: Sounds good. thanks for the info18:56
andymccrhaha sorry was delayed, was there an issue with it? or you just wanted to know if it happened18:56
alextrcitiyandymccr. no worries. There is no issue. I just need to add the swift system user to the ceilometer system group as part of making swift play nicely with ceilo18:57
alextrcitiyI should of assumed it was in pre-tasks..i guess i just wasn't thinking at the time18:57
andymccrhaha no worries, it did get moved when it was galaxified, but i think its also a lot more generic now so it'll be pretty similar to the other roles18:58
alextrcitiyawesome18:58
alextrcitiythank you18:58
openstackgerritMerged stackforge/os-ansible-deployment: Revert heat's keystone_authtoken configuration  https://review.openstack.org/17544919:01
*** jwagner is now known as jwagner_away19:50
openstackgerritMark DeVerter proposed stackforge/os-ansible-deployment: Adds dhcp_domain to dhcp-agent.ini  https://review.openstack.org/17555219:53
openstackgerritJimmy McCrory proposed stackforge/os-ansible-deployment: Reorder common apt repo tasks  https://review.openstack.org/17555419:56
*** sacharya1 has joined #openstack-ansible20:07
*** sacharya has quit IRC20:10
*** JRobinson__ has joined #openstack-ansible20:11
*** fawadkhaliq has joined #openstack-ansible20:19
*** bilal has joined #openstack-ansible20:19
*** sacharya1 has quit IRC20:35
*** sacharya has joined #openstack-ansible20:37
*** sdake_ has joined #openstack-ansible20:40
*** sdake has quit IRC20:44
*** sdake has joined #openstack-ansible20:52
*** sdake_ has quit IRC20:56
*** stevemar has quit IRC20:58
*** bilal has quit IRC21:08
*** JRobinson__ is now known as JRobinson__afk21:22
*** jaypipes has quit IRC21:26
*** Bjoern___ has quit IRC21:46
*** Mudpuppy_ has joined #openstack-ansible21:54
*** Mudpuppy has quit IRC21:57
*** Mudpuppy_ has quit IRC21:59
*** JRobinson__afk is now known as JRobinson__22:00
*** fawadkhaliq has quit IRC22:24
*** jaypipes has joined #openstack-ansible22:37
*** KLevenstein has quit IRC22:46
*** sigmavirus24 is now known as sigmavirus24_awa23:46
*** openstackgerrit has quit IRC23:58
*** openstackgerrit has joined #openstack-ansible23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!