Saturday, 2016-03-05

*** galstrom is now known as galstrom_zzz00:08
*** thorst has joined #openstack-ansible00:12
*** skamithi13 has joined #openstack-ansible00:16
openstackgerritMerged openstack/openstack-ansible-lxc_hosts: Fix apparmor profile load handler  https://review.openstack.org/28785500:17
*** skamithi14 has quit IRC00:19
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-rabbitmq_server: Upgrade RabbitMQ Server to 3.6.1-1  https://review.openstack.org/28861700:22
openstackgerritMerged openstack/openstack-ansible-repo_build: Remove allow-all-external from pip install/wheel commands  https://review.openstack.org/28833200:31
*** phalmos has quit IRC00:42
*** sigmavirus24 is now known as sigmavirus24_awa00:43
*** markvoelker has quit IRC00:45
*** woodard has quit IRC00:46
*** woodard has joined #openstack-ansible00:46
*** skamithi13 has quit IRC00:51
*** Andrew_jedi has joined #openstack-ansible00:53
*** Andrew_jedi has quit IRC00:58
NepocFor those that are interested if you want to replace all ip: 1.2.3.4 with something like ip: "{{my_controller_ip}}" you should define the variable at the top of user_variables.yml as it seems to be read first.01:05
*** sdake has joined #openstack-ansible01:06
Nepocor at least early enough01:06
*** Andrew_jedi has joined #openstack-ansible01:14
*** Andrew_jedi has quit IRC01:25
*** sdake has quit IRC01:43
*** markvoelker has joined #openstack-ansible01:46
*** busterswt has joined #openstack-ansible01:47
*** busterswt has quit IRC01:51
*** keedya has quit IRC01:54
*** keedya has joined #openstack-ansible01:56
openstackgerritMerged openstack/openstack-ansible-os_tempest: Add curl to bindep requirements  https://review.openstack.org/28868102:00
openstackgerritMerged openstack/openstack-ansible-os_nova: Add curl to bindep requirements  https://review.openstack.org/28867802:02
openstackgerritMerged openstack/openstack-ansible-specs: Add curl to bindep requirements  https://review.openstack.org/28869202:03
openstackgerritMerged openstack/openstack-ansible-rsyslog_server: Add curl to bindep requirements  https://review.openstack.org/28869002:05
openstackgerritMerged openstack/openstack-ansible-py_from_git: Add curl to bindep requirements  https://review.openstack.org/28868502:05
openstackgerritMerged openstack/openstack-ansible-repo_build: Add curl to bindep requirements  https://review.openstack.org/28868702:05
openstackgerritMerged openstack/openstack-ansible-pip_install: Add curl to bindep requirements  https://review.openstack.org/28868202:06
openstackgerritMerged openstack/openstack-ansible-pip_lock_down: Add curl to bindep requirements  https://review.openstack.org/28868302:06
openstackgerritMerged openstack/openstack-ansible-plugins: Add curl to bindep requirements  https://review.openstack.org/28868402:06
openstackgerritMerged openstack/openstack-ansible-os_nova: Role should default to no external SSL termination  https://review.openstack.org/28877302:08
openstackgerritMerged openstack/openstack-ansible-os_keystone: Role should default to no external SSL termination  https://review.openstack.org/28875702:09
openstackgerritMerged openstack/openstack-ansible-os_heat: Role should default to no external SSL termination  https://review.openstack.org/28876902:09
*** Mudpuppy has quit IRC02:11
*** Mudpuppy has joined #openstack-ansible02:11
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-rabbitmq_server: Upgrade RabbitMQ Server to 3.6.1-1  https://review.openstack.org/28861702:30
*** thorst has quit IRC02:42
*** thorst has joined #openstack-ansible02:43
*** furlongm has quit IRC02:50
*** thorst has quit IRC02:51
*** aslaen has joined #openstack-ansible03:07
*** Andrew_jedi has joined #openstack-ansible03:17
*** Andrew_jedi has quit IRC03:22
*** Andrew_jedi has joined #openstack-ansible03:24
*** fawadkhaliq has quit IRC03:37
*** Andrew_jedi has quit IRC03:39
*** Andrew_jedi has joined #openstack-ansible03:42
*** aslaen has quit IRC03:44
*** Andrew_jedi has quit IRC03:46
*** thorst has joined #openstack-ansible03:49
*** cemmason has joined #openstack-ansible03:51
*** Andrew_jedi has joined #openstack-ansible03:52
*** cemmason has quit IRC03:55
*** cemmason has joined #openstack-ansible03:55
*** zhangjn has quit IRC03:56
*** thorst has quit IRC03:56
*** zhangjn has joined #openstack-ansible03:59
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-lxc_container_create: Add curl to bindep requirements  https://review.openstack.org/28866104:02
*** Andrew_jedi has quit IRC04:17
*** Andrew_jedi has joined #openstack-ansible04:40
*** Andrew_jedi has quit IRC04:53
*** thorst has joined #openstack-ansible04:54
*** Andrew_jedi has joined #openstack-ansible04:57
openstackgerritMerged openstack/openstack-ansible: Ensure that the repo-server uses upper-constraints  https://review.openstack.org/28840504:58
*** Mudpuppy_ has joined #openstack-ansible04:59
*** thorst has quit IRC05:01
*** keedya has quit IRC05:02
*** Mudpuppy has quit IRC05:02
*** Andrew_jedi has quit IRC05:03
*** Andrew_jedi has joined #openstack-ansible05:09
*** Andrew_jedi has quit IRC05:14
*** Mudpuppy_ has quit IRC05:39
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-lxc_container_create: Add curl to bindep requirements  https://review.openstack.org/28866105:49
*** thorst has joined #openstack-ansible05:59
*** thorst has quit IRC06:06
*** phiche has joined #openstack-ansible06:34
*** phiche1 has joined #openstack-ansible06:34
*** phiche has quit IRC06:38
openstackgerritStanley Kamithi proposed openstack/openstack-ansible-specs: Virtual AIO Using Vagrant  https://review.openstack.org/28509006:42
*** fawadkhaliq has joined #openstack-ansible06:54
*** fawadkhaliq has quit IRC06:56
*** phiche has joined #openstack-ansible07:05
*** phiche1 has quit IRC07:05
*** thorst has joined #openstack-ansible07:05
*** mgoddard has joined #openstack-ansible07:06
*** thorst has quit IRC07:11
*** woodard has quit IRC07:43
*** javeriak has joined #openstack-ansible07:52
*** rgogunskiy has joined #openstack-ansible07:53
*** rgogunskiy has quit IRC07:54
*** javeriak_ has joined #openstack-ansible07:55
*** Andrew_jedi has joined #openstack-ansible07:56
*** javeriak has quit IRC07:56
*** phiche1 has joined #openstack-ansible08:00
*** phiche has quit IRC08:02
*** Andrew_jedi has quit IRC08:04
*** Andrew_jedi has joined #openstack-ansible08:04
*** thorst has joined #openstack-ansible08:09
*** thorst has quit IRC08:16
*** mathlin1 has joined #openstack-ansible08:22
*** javeriak_ has quit IRC08:41
*** woodard has joined #openstack-ansible08:44
*** mgoddard has quit IRC08:48
*** woodard has quit IRC08:50
*** neilus has joined #openstack-ansible08:54
*** Andrew_jedi has quit IRC08:59
*** phiche has joined #openstack-ansible09:00
*** phiche1 has quit IRC09:01
*** admin0 has joined #openstack-ansible09:01
*** dalees` has quit IRC09:05
*** thorst has joined #openstack-ansible09:14
*** dalees` has joined #openstack-ansible09:17
*** thorst has quit IRC09:20
*** Andrew_jedi has joined #openstack-ansible09:44
*** woodard has joined #openstack-ansible09:46
*** javeriak has joined #openstack-ansible09:46
*** javeriak_ has joined #openstack-ansible09:49
*** woodard has quit IRC09:51
*** javeriak has quit IRC09:51
*** admin0 has quit IRC10:15
*** thorst has joined #openstack-ansible10:18
*** mathlin1 has quit IRC10:21
*** thorst has quit IRC10:26
*** thorst has joined #openstack-ansible11:23
*** thorst has quit IRC11:30
*** pcaruana has quit IRC11:34
*** javeriak_ has quit IRC11:44
*** Andrew_jedi has quit IRC11:47
*** woodard has joined #openstack-ansible11:48
*** woodard has quit IRC11:52
*** Trident has joined #openstack-ansible11:55
*** Andrew_jedi has joined #openstack-ansible12:06
*** phiche has quit IRC12:09
*** phiche has joined #openstack-ansible12:09
*** thorst has joined #openstack-ansible12:28
*** Andrew_jedi has quit IRC12:30
*** admin0 has joined #openstack-ansible12:31
*** admin0 has quit IRC12:32
*** admin0 has joined #openstack-ansible12:33
*** admin0 has quit IRC12:34
*** admin0 has joined #openstack-ansible12:35
*** thorst has quit IRC12:36
*** javeriak has joined #openstack-ansible12:43
*** phiche has quit IRC12:47
*** javeriak has quit IRC12:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client: Initial commit for bindep requirements  https://review.openstack.org/28786912:51
*** Andrew_jedi has joined #openstack-ansible12:52
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server: Initial commit for bindep requirements  https://review.openstack.org/28787012:54
*** thorst has joined #openstack-ansible12:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Initial commit for bindep requirements  https://review.openstack.org/28787212:57
*** thorst has quit IRC13:02
*** thorst has joined #openstack-ansible13:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon: Role should default to no external SSL termination  https://review.openstack.org/28878613:09
*** thorst has quit IRC13:11
*** openstackgerrit_ has quit IRC13:17
*** openstackgerrit_ has joined #openstack-ansible13:18
*** neilus has quit IRC13:21
*** woodard has joined #openstack-ansible13:49
*** Mudpuppy has joined #openstack-ansible13:52
*** woodard has quit IRC13:54
*** Mudpuppy has quit IRC13:56
*** Mudpuppy has joined #openstack-ansible13:57
*** javeriak has joined #openstack-ansible14:02
*** Mudpuppy has quit IRC14:04
*** cemmason1 has joined #openstack-ansible14:06
*** cemmason has quit IRC14:06
*** javeriak has quit IRC14:07
*** thorst has joined #openstack-ansible14:08
*** cemmason1 has quit IRC14:10
*** cemmason has joined #openstack-ansible14:10
*** neilus has joined #openstack-ansible14:12
*** cemmason1 has joined #openstack-ansible14:14
*** cemmason has quit IRC14:15
*** thorst has quit IRC14:15
*** neilus has quit IRC14:16
*** cemmason has joined #openstack-ansible14:18
*** cemmason1 has quit IRC14:19
*** openstackgerrit_ has quit IRC14:20
*** openstackgerrit_ has joined #openstack-ansible14:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-specs: Specs: Remove other-requirements  https://review.openstack.org/28887014:22
*** cemmason has quit IRC14:22
*** cemmason1 has joined #openstack-ansible14:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-specs: Remove other-requirements from specs repo  https://review.openstack.org/28887014:22
*** neilus has joined #openstack-ansible14:32
*** openstackgerrit_ has quit IRC14:32
*** openstackgerrit_ has joined #openstack-ansible14:33
*** phiche has joined #openstack-ansible14:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Resolve directory creation race condition  https://review.openstack.org/28887314:49
*** woodard has joined #openstack-ansible14:50
*** sdake has joined #openstack-ansible14:51
*** woodard has quit IRC14:55
*** sdake_ has joined #openstack-ansible14:56
*** sdake has quit IRC14:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: [DO NOT MERGE] Diagnostic debugging  https://review.openstack.org/28887615:06
*** thorst has joined #openstack-ansible15:13
bgmccollumseeing gate failures where DNS isn't resolving, so apt packages aren't installing. have seen in both OVH and RAX...15:19
*** thorst has quit IRC15:21
bgmccollumOVH - http://logs.openstack.org/59/279859/12/check/gate-openstack-ansible-dsvm-commit/2292777/logs/ansible_cmd_logs/add_neutron_agent_checksum_rule.log15:21
bgmccollumRAX - http://logs.openstack.org/59/279859/12/check/gate-openstack-ansible-dsvm-commit/74f952f/logs/ansible_cmd_logs/add_neutron_agent_checksum_rule.log15:21
*** karimb has joined #openstack-ansible15:22
*** sdake_ is now known as sdake15:24
bgmccollumsomething is breaking either DNS or the network by the time it tries to install that package...15:26
*** galstrom_zzz is now known as galstrom15:26
*** galstrom is now known as galstrom_zzz15:27
jmccrorybgmccollum wonder if it could be related to this: https://github.com/openstack/openstack-ansible-lxc_hosts/commit/fe999d17150ca1011a8b2bedfc9ba6d0a5affcb315:28
jmccroryorder of post-up commands for lxc bridge changed slightly, not sure if that would have any effect15:30
*** karimb has quit IRC15:30
jmccrorynoticed that container create test is also starting to fail because it's expecting a different ip to be assigned to the container's first interface: http://logs.openstack.org/73/288873/1/check/gate-openstack-ansible-lxc_container_create-ansible-func-ubuntu-trusty/47654e2/console.html#_2016-03-05_14_56_06_10615:34
bgmccollumhmm...thanks for the pointers. still digging.15:36
*** galstrom_zzz is now known as galstrom15:36
bgmccollumlooks like odyssey4me might be debugging something too -- https://review.openstack.org/#/c/288876/15:37
jmccrorythinking these independent roles are going to need an integrated gate merge test, troubleshooting's getting tricky15:43
*** javeriak has joined #openstack-ansible15:44
*** woodard has joined #openstack-ansible15:44
*** javeriak_ has joined #openstack-ansible15:48
*** javeriak has quit IRC15:49
*** woodard_ has joined #openstack-ansible15:50
*** woodard_ has quit IRC15:51
*** woodard has quit IRC15:52
*** phalmos has joined #openstack-ansible15:59
openstackgerritByron McCollum proposed openstack/openstack-ansible-lxc_container_create: [WIP] Test external connectivity for containers  https://review.openstack.org/28890916:00
*** thorst has joined #openstack-ansible16:01
*** thorst has quit IRC16:08
*** thorst has joined #openstack-ansible16:09
*** galstrom is now known as galstrom_zzz16:12
openstackgerritByron McCollum proposed openstack/openstack-ansible-lxc_container_create: [WIP] Test external connectivity for containers  https://review.openstack.org/28890916:15
*** thorst has quit IRC16:17
*** cemmason1 has quit IRC16:22
*** cemmason has joined #openstack-ansible16:22
*** cemmason1 has joined #openstack-ansible16:25
*** cemmason has quit IRC16:27
*** cemmason1 has quit IRC16:28
*** cemmason has joined #openstack-ansible16:28
*** cemmason1 has joined #openstack-ansible16:30
*** cemmason has quit IRC16:32
*** cemmason1 has quit IRC16:34
*** cemmason has joined #openstack-ansible16:34
*** cemmason1 has joined #openstack-ansible16:36
*** cemmason has quit IRC16:38
*** cemmason1 has quit IRC16:43
*** cemmason has joined #openstack-ansible16:44
*** cemmason has quit IRC16:47
*** cemmason1 has joined #openstack-ansible16:47
*** woodard has joined #openstack-ansible16:51
*** thorst has joined #openstack-ansible16:52
*** woodard has quit IRC16:56
*** galstrom_zzz is now known as galstrom17:08
*** sdake_ has joined #openstack-ansible17:17
*** sdake has quit IRC17:18
odyssey4mebgmccollum it's not DNS, it's just that all hosts need an apt-get update added as a forced task in the tests17:20
odyssey4mejmccrory good pointer on the race condition, can you whip up a patch for that quickly?17:20
odyssey4mejmccrory also, notice that somehow the 'lxc-ls -f' task is running against the containers... I have no idea how that test ever worked - it should run against the host17:21
*** admin0 has quit IRC17:21
jmccroryodyssey4me: sure, also been looking more into lxc errors. the formatting on /etc/networking/interfaces.d/lxc-net-bridge.cfg has some issues17:22
odyssey4meand yes, we need to sort out functional tests for the roles - and depends-on integration tests... I'll work on that this week17:22
odyssey4mejmccrory yeah, it's likely due to the 'feature' added in https://github.com/openstack/openstack-ansible-lxc_hosts/commit/fe999d17150ca1011a8b2bedfc9ba6d0a5affcb317:22
jmccrorywhitespace not being kept and defaults/lxc_net_gateway should be null17:23
jmccrorynone/None get evaluated as strings17:23
jmccroryso the 'not none' jinja2 isn't being met17:23
odyssey4me:( buggy Ansible 1.9x17:23
odyssey4meif you can figure out a fix for that it'd be awesome17:24
odyssey4meassuming you're wanting to do so on a weekend :p17:24
jmccroryyep looking forward to 2 to help clean a lot of this stuff up17:24
odyssey4mewe're picking up loads of bad assumption bugs, which is good17:24
jmccroryor at least make errors more obvious17:25
odyssey4meI'm context switching between DIY stuff in the kitchen and debugging, so I'm here and there a bit until later once the DIY is done17:25
odyssey4meI have a scotch in-hand, so it's all good. :)17:26
*** sdake has joined #openstack-ansible17:27
jmccroryhah nice17:28
*** sdake_ has quit IRC17:29
*** sdake_ has joined #openstack-ansible17:31
Andrew_jediodyssey4me: cheers !17:34
*** sdake has quit IRC17:34
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-lxc_hosts: Create /openstack/log base directory  https://review.openstack.org/28891817:37
*** galstrom is now known as galstrom_zzz17:37
*** phiche has quit IRC17:39
*** phiche has joined #openstack-ansible17:39
*** zhangjn has quit IRC17:40
*** zhangjn has joined #openstack-ansible17:41
bgmccollumodyssey4me: i don't think it's the apt cache. The error says it can't resolve the domain, and I think jmccrory has picked up on this with some of his points above.17:42
*** admin0 has joined #openstack-ansible17:43
odyssey4memaybe we should revert the changes in templates/lxc-net-bridge.cfg.j2 from https://github.com/openstack/openstack-ansible-lxc_hosts/commit/fe999d17150ca1011a8b2bedfc9ba6d0a5affcb3 in a sensible way (ie still use the bool cast, but return the formatting and logic to the same as before17:44
odyssey4meif that improvement to the mechism is needed, it can always come in in a subsequent patch17:44
odyssey4mebgmccollum if you can whip up the patch, jmccrory and I can merge it :)17:44
bgmccollumOut around town at the moment. Might be a few hours till I'm back at a computer.17:45
odyssey4mealright, considering that it's a broken state fix I think it's fair for me simply to merge it after a decent test17:47
jmccroryi'll help test if you have something in the works17:48
odyssey4mejmccrory I don't - busy finishing mounting cupboards - so if you're able to get there first, then do it17:50
jmccroryalright17:50
odyssey4meI'll be more actively back at the keyboard in an hour or two17:51
*** woodard has joined #openstack-ansible17:52
*** woodard has quit IRC17:57
*** jwitko has quit IRC18:01
*** phiche has quit IRC18:12
*** phiche has joined #openstack-ansible18:12
*** thorst has quit IRC18:18
*** thorst has joined #openstack-ansible18:18
*** thorst has quit IRC18:27
*** sdake_ is now known as sdake18:27
*** mathlin1 has joined #openstack-ansible18:28
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-lxc_hosts: Make corrections to LXC bridge template file  https://review.openstack.org/28892618:30
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-lxc_hosts: Make corrections to LXC bridge template file  https://review.openstack.org/28892618:32
odyssey4mejmccrory some feedback on the comment of the patch18:36
odyssey4mejmccrory maybe we should have a set of tests and compare the result to the expected result?18:36
jmccroryyeah, working on one now to make sure the bridge has expected ip18:36
odyssey4meie implement the default, test, then implement a change to cover an alternative scenario, then test again18:37
odyssey4meI'm thinking quite simply having a sample file and doing a compiritive checksum of the two files18:37
odyssey4mebut I don't want to delay it too much - that could be a follow-on patch18:38
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_horizon: Role should default to no external SSL termination  https://review.openstack.org/28878618:38
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-lxc_hosts: Make corrections to LXC bridge template file  https://review.openstack.org/28892618:39
odyssey4meautomagically weekend working? :p18:39
jmccroryah ok, yep. make sense18:39
jmccrorymakes*18:40
odyssey4mejmccrory there's nothing to say that the tests can't have other files around - this is all new ground18:40
automagicallyodyssey4me: Just trying to make sure I can get the SSL stuff wrapped up. Feeling bad that its effecting gate18:40
odyssey4meie having sample files to verify expected results might be one of the simplest ways to compare, to test with and to showcase to people who want to do unusual things18:41
odyssey4methe test are also there to protect against regressions18:41
odyssey4meautomagically I made a small tweak earlier based on cloudnull's suggestion - hope you don't mind18:41
automagicallyNot in the least18:41
*** scarlisle has joined #openstack-ansible18:43
*** dcd has joined #openstack-ansible18:43
*** mathlin1 has quit IRC18:46
*** woodard has joined #openstack-ansible18:53
*** woodard has quit IRC18:58
*** phalmos has quit IRC19:00
*** unlaudable has joined #openstack-ansible19:00
*** sdake_ has joined #openstack-ansible19:06
*** sdake has quit IRC19:08
openstackgerritMerged openstack/openstack-ansible-os_neutron: Add curl to bindep requirements  https://review.openstack.org/28867719:08
openstackgerritMerged openstack/openstack-ansible-os_keystone: Add curl to bindep requirements  https://review.openstack.org/28867519:09
openstackgerritMerged openstack/openstack-ansible-os_horizon: Add curl to bindep requirements  https://review.openstack.org/28867319:09
openstackgerritMerged openstack/openstack-ansible-os_heat: Add curl to bindep requirements  https://review.openstack.org/28867219:09
openstackgerritMerged openstack/openstack-ansible-os_cinder: Add curl to bindep requirements  https://review.openstack.org/28867019:09
openstackgerritMerged openstack/openstack-ansible-os_glance: Add curl to bindep requirements  https://review.openstack.org/28867119:10
openstackgerritMerged openstack/openstack-ansible-lxc_hosts: Create /openstack/log base directory  https://review.openstack.org/28891819:10
*** sdake has joined #openstack-ansible19:10
openstackgerritMerged openstack/openstack-ansible-os_ceilometer: Add curl to bindep requirements  https://review.openstack.org/28866819:11
openstackgerritMerged openstack/openstack-ansible-os_aodh: Add curl to bindep requirements  https://review.openstack.org/28866619:12
openstackgerritMerged openstack/openstack-ansible-openstack_openrc: Add curl to bindep requirements  https://review.openstack.org/28866519:12
*** sdake_ has quit IRC19:12
odyssey4meI do love the quick turnaround time in the independent repositories :)19:12
openstackgerritMerged openstack/openstack-ansible-memcached_server: Add curl to bindep requirements  https://review.openstack.org/28866319:12
openstackgerritMerged openstack/openstack-ansible-ironic: Add curl to bindep requirements  https://review.openstack.org/28866019:12
odyssey4meonce we have functional tests in there it'll be amazing19:12
openstackgerritMerged openstack/openstack-ansible-openstack_hosts: Add curl to bindep requirements  https://review.openstack.org/28866419:13
*** cemmason1 has quit IRC19:14
*** zhangjn has quit IRC19:15
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning: Add curl to bindep requirements  https://review.openstack.org/28865719:15
*** cemmason has joined #openstack-ansible19:16
openstackgerritMerged openstack/openstack-ansible-specs: Remove other-requirements from specs repo  https://review.openstack.org/28887019:16
odyssey4mein other news, patch testing on the weekend is great from a zuul queue standpoint :)19:17
odyssey4meautomagically jmccrory not sure if you've seen http://status.openstack.org/zuul/ ?19:17
automagicallyIts looking pretty good19:17
*** zhangjn has joined #openstack-ansible19:18
jmccroryyep, weekends are nice19:18
*** thorst has joined #openstack-ansible19:18
odyssey4meanother interesting page, although the audience is typically infra: http://grafana.openstack.org/19:18
*** cemmason1 has joined #openstack-ansible19:20
automagicallyGood time to get some rechecks in19:20
*** cemmason has quit IRC19:20
jmccroryoh that's cool19:20
automagicallyodyssey4me: FYI, I rebased this as you had requested: https://review.openstack.org/#/c/287435/ Can you remove your -119:21
logan-looks like a new pool just came online today? http://grafana.openstack.org/dashboard/db/nodepool-osic?panelId=12&fullscreen19:22
odyssey4meautomagically done19:23
automagicallythank you sir19:23
*** cemmason has joined #openstack-ansible19:24
odyssey4meautomagically FYI, you were talking about getting your employer to contribute nodepool resources - here're the details: http://docs.openstack.org/infra/system-config/contribute-cloud.html19:24
automagicallyYep, been having some internal conversations about it already19:24
automagicallyPositive response so far19:24
*** cemmason1 has quit IRC19:24
odyssey4melogan- yeah, it came online yesterday although they may not have fully started using it yet...19:24
odyssey4meautomagically so at around 100 instances, at 8GB RAM/8 vCPU's and 80GB storage... that's likely around 10 compute nodes or so I would guess19:25
odyssey4mebut being a nodepool provider is an excellent way to have an active test bed19:26
odyssey4meas infra has many providers, your cloud can go offline if need be... but it gives you a place to put experimental infrastructure, monitoring, etc down which makes for a good 'staging' environment19:26
automagicallyYeah, we’ve definitely got some capacity lying around, the challenge will be to get this effort prioritized relative to other work19:27
*** cemmason1 has joined #openstack-ansible19:29
*** thorst has quit IRC19:29
odyssey4meautomagically yeah, it's not necessarily an easy sell19:30
*** cemmason has quit IRC19:30
*** weezS has joined #openstack-ansible19:33
*** cemmason1 has quit IRC19:34
*** cemmason has joined #openstack-ansible19:34
*** cemmason has quit IRC19:37
*** cemmason has joined #openstack-ansible19:38
*** dcd has quit IRC19:38
*** dcd has joined #openstack-ansible19:39
*** cemmason has quit IRC19:43
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-lxc_hosts: Make corrections to LXC bridge template file  https://review.openstack.org/28892619:43
*** cemmason has joined #openstack-ansible19:43
automagicallyHmm, looks like gates failing on http://logs.openstack.org/36/288636/2/check/gate-openstack-ansible-dsvm-commit/a07d57a/logs/ansible_cmd_logs/add_neutron_agent_checksum_rule.log “ Could not resolve 'iad.mirror.rackspace.com'"19:44
*** dcd has quit IRC19:44
jmccroryautomagically lxc bridge interface file is broken19:45
automagicallyAh, that’ll do it19:45
automagicallySaw you working on that, but didn’t put 2 and 2 together19:45
*** phiche1 has joined #openstack-ansible19:46
odyssey4meyeah, we unfortunately allowed a 'rider feature' though19:46
jmccroryheh yeah, it's a little tougher to follow cause and effect with everything split out now19:46
*** phiche has quit IRC19:46
*** cemmason1 has joined #openstack-ansible19:46
jmccroryodyssey4me ^ that adds the comparison test, looks gross but passing19:47
*** cemmason has quit IRC19:47
odyssey4meautomagically a little quick on the trigger finger there :)19:49
odyssey4mejmccrory looks sane, we can add more test on top of it, as that only covers the default19:49
*** cemmason1 has quit IRC19:50
automagicallyDidn’t realize you were thinking about adding more tests19:50
*** cemmason has joined #openstack-ansible19:51
openstackgerritMerged openstack/openstack-ansible-lxc_hosts: Make corrections to LXC bridge template file  https://review.openstack.org/28892619:51
odyssey4meautomagically typically reviews should have at least two cores vote - it's a convention in OpenStack in general - a single core vote and +A should be the exception for particular circumstances when it's gate-breaking and there aren't two cores available to vote19:52
automagicallyMy bad19:52
odyssey4meno worries, I agree with your vote - and just wanted to see whether it passed the gate19:52
automagicallyI only +A when I saw it pass gate19:53
odyssey4menow let's see what happens with https://review.openstack.org/288909 and https://review.openstack.org/28887619:53
*** woodard has joined #openstack-ansible19:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: [DO NOT MERGE] Diagnostic debugging  https://review.openstack.org/28887619:56
odyssey4mejmccrory while debugging the container_create tests I found a similar failure, except it was weird - the containers showed no addresses in 'lxc-ls -f'19:58
odyssey4meafter leaving it for 10 mins or so, they suddenly showed addresses19:58
odyssey4methere's clearly some sort of secret sauce going on there - I saw that the dnsmasq service is actively set to bypass failure, which I hadn't noticed before19:59
*** woodard has quit IRC19:59
jmccrorysaw that myself, but it looked like it was because the interface wasn't brought up correctly since the gateway line was smashed up against the netmask and set to 'none' in the interface file20:01
jmccroryhmm didn't have addresses show up later though20:02
*** unlaudable has quit IRC20:02
odyssey4mejmccrory yeah, it does seem to be behaving that way in the gate test20:03
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-lxc_container_create: [WIP] Test external connectivity for containers  https://review.openstack.org/28890920:04
odyssey4meI'd really love for us to go through each role and dissect it, then document why things are done the ways that they're done20:04
automagically+1 to that20:05
odyssey4methere's a lot of stuff in this code base that carries experience from history, but without the 'why' it makes it hard to debug sometimes... but also hard to evaluate whether something still belongs x years later20:05
*** hybridpollo has joined #openstack-ansible20:05
jmccroryi'm all for that too20:05
odyssey4methis code base started on Ubuntu Precise... and while we have removed some stuff that was there from that time, I expect that there's still a lot of historical workarounds that may not be required any ore20:05
odyssey4memaybe the Ubuntu 16.04 and Ansible 2 refactoring will provide that opportunity20:06
*** dcd has joined #openstack-ansible20:08
*** mathlin1 has joined #openstack-ansible20:09
jmccroryexternal connectivity's back, still failing on output of 'lxc-ls -f' though20:09
odyssey4mejmccrory yeah, that test looks borked to me - I have no idea how it ever worked20:11
jmccrorynot sure exactly what would've changed the ordering. test wants assigned address first, output is local dhcp first20:11
odyssey4meit's running lxc-ls -f without a delegation to the host20:11
odyssey4mesee the container1 & container2 debug output - it's the same for both: http://logs.openstack.org/76/288876/2/check/gate-openstack-ansible-lxc_container_create-ansible-func-ubuntu-trusty/75a3ece/console.html#_2016-03-05_20_04_59_54820:12
odyssey4meI think the test is better done against the host.20:12
odyssey4meBut, of course, I wonder how this ever passed.20:12
odyssey4mesee how http://logs.openstack.org/76/288876/2/check/gate-openstack-ansible-lxc_container_create-ansible-func-ubuntu-trusty/75a3ece/console.html#_2016-03-05_20_04_59_578 is showing both vars as the same value20:13
jmccroryyeah...don't know how it ever would. it's overwriting the lxc_output fact20:15
odyssey4methis is why I think it's better to break that from running against the containers, to running against the host20:15
odyssey4meone command, one host, one result20:15
jmccroryoh ok, so i don't think it ever has passed. it was part of the initial commit as an independent repo https://github.com/openstack/openstack-ansible-lxc_container_create/commit/8f8cf55eddaed1d6670071e185289de07940012620:16
odyssey4mejmccrory sure, but other changes have gone in since then: https://review.openstack.org/#/q/project:openstack/openstack-ansible-lxc_container_create20:18
odyssey4meunfortunately without the debug output we can't tell what worked then and why it's not working now20:18
odyssey4methis is why I'm a believer in having the human readable output plugin20:19
odyssey4meit gives us debug in a sensible way20:19
odyssey4mealthough I do want to rewrite that plugin to be more concise20:19
jmccrorylooked at it a little while ago, all those functions it redefines and passes are unnecessary. ansible will pass them already20:21
jmccrorybut yeah, really useful and would like to see if in more IRR test logs20:23
odyssey4mejmccrory yep, it's a very very old style of doing the plugins from back when selective overriding wasn't possible20:23
odyssey4meI'm not fond of how the other plugin sorts the tasks either. I'd prefer to see all the tasks in their order, with the profiling ino.20:24
odyssey4me*info20:24
odyssey4meif that was done then I'd be happy to see the callback plugins be a default configuration20:24
jmccroryand not limited to 10?20:24
odyssey4meyep20:25
odyssey4meunfortunately I just haven't had the chance to sit down and work all that out20:25
odyssey4meit'll probably take a day, but there's always something more important to do :p20:25
*** thorst has joined #openstack-ansible20:38
*** weezS has quit IRC20:42
*** Andrew_jedi has quit IRC20:42
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_heat: Adding Vagrantfile for local developer testing  https://review.openstack.org/28893420:43
*** thorst has quit IRC20:43
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_heat: [DOCS] Cleanup the role docs for consistency and clarity  https://review.openstack.org/28893520:45
admin0odyssey4me: i have one cluster .. i want to add another one as regions .. need pointers :D20:46
admin0or a way that is easy to replicate20:46
admin0for the third one20:46
odyssey4meadmin0 did you add one as a region already?20:47
odyssey4meie as a second region?20:47
admin0the default is always region one right ?20:47
odyssey4meadmin0 yeah, but a few days back I gave you the pointers to make your one point to another20:47
odyssey4mefor keystone20:47
* odyssey4me should really do a blog post about that one20:48
admin0:D20:48
admin0do you have a blog site ?20:48
admin0of other stuff with openstack/ansible20:48
odyssey4meadmin0 haha, not really - one post20:48
odyssey4meok, two: http://odyssey4me.github.io/20:49
admin0:D20:49
odyssey4meI have hoped to set aside the time to do at least one a month, but that just hasn't happened.20:50
admin0yes .. thats everyone wishlist :D20:51
odyssey4meI have been a bit more active speaking though: http://www.slideshare.net/JessePretorius/20:51
*** javeriak_ has quit IRC20:58
odyssey4mejmccrory are you going to tackle updating the tests for lxc_container_create, or shall I?21:00
jmccroryodyssey4me you can, i'm still troubleshooting something else21:01
odyssey4mejmccrory cool, on it21:02
*** admin0 has quit IRC21:04
*** fawadkhaliq has joined #openstack-ansible21:12
*** elopez has joined #openstack-ansible21:13
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-rabbitmq_server: Upgrade RabbitMQ Server to 3.6.1-1  https://review.openstack.org/28861721:13
*** admin0 has joined #openstack-ansible21:23
*** cemmason has quit IRC21:39
*** cemmason has joined #openstack-ansible21:39
openstackgerritByron McCollum proposed openstack/openstack-ansible-lxc_container_create: [WIP] Test external connectivity for containers  https://review.openstack.org/28890921:41
*** thorst has joined #openstack-ansible21:41
bgmccollumodyssey4me oops, clobbered your patch...21:42
*** cemmason has quit IRC21:43
bgmccollumfixing21:43
*** cemmason has joined #openstack-ansible21:43
bgmccollumoh maybe it was jmccrory ... either way fixing21:44
*** cemmason1 has joined #openstack-ansible21:46
*** cemmason has quit IRC21:47
openstackgerritByron McCollum proposed openstack/openstack-ansible-lxc_container_create: [WIP] Test external connectivity for containers  https://review.openstack.org/28890921:47
*** thorst has quit IRC21:48
*** thorst has joined #openstack-ansible21:48
*** dcd has quit IRC21:50
*** cemmason1 has quit IRC21:51
*** cemmason has joined #openstack-ansible21:51
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-rabbitmq_server: Upgrade RabbitMQ Server to 3.6.1-1  https://review.openstack.org/28861721:51
*** admin0 has quit IRC21:55
*** cemmason1 has joined #openstack-ansible21:55
*** cemmason has quit IRC21:56
*** weezS has joined #openstack-ansible21:57
*** cemmason has joined #openstack-ansible21:59
*** cemmason1 has quit IRC21:59
*** cemmason has quit IRC22:02
*** cemmason has joined #openstack-ansible22:02
*** cemmason has quit IRC22:05
*** cemmason has joined #openstack-ansible22:05
*** cemmason has quit IRC22:08
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Test container creation based on IP address  https://review.openstack.org/28894222:14
openstackgerritByron McCollum proposed openstack/openstack-ansible-lxc_container_create: [WIP] Test external connectivity for containers  https://review.openstack.org/28890922:15
odyssey4mebgmccollum jmccrory thoughts on  https://review.openstack.org/288942 ?22:18
bgmccollumpeeking at it now22:18
bgmccollumodyssey4me is there a -F option for status (running) that can be added?22:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Test container creation based on IP address  https://review.openstack.org/28894222:22
odyssey4mebgmccollum sure, it can be filtered for that - I thought that might be overkill though22:22
jmccrorythink it'll need another test to make sure container is accessible over assigned ip, seems to be where other roles are failing right now22:24
jmccroryodyssey4me just saw what you were talking about earlier. no ip addresses listed on containers until about 10 minutes later22:25
bgmccollumodyssey4me i got something similar to pass in the test connectivity review, so i think we're on the right track22:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Test container creation based on IP address  https://review.openstack.org/28894222:26
odyssey4me^ that now only checks for running containers22:27
*** fawadkhaliq has quit IRC22:27
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Test container creation based on IP address  https://review.openstack.org/28894222:31
odyssey4me^ and now allows any number of additional addresses, before or after the one we want22:32
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Test container creation based on IP address  https://review.openstack.org/28894222:33
odyssey4mejmccrory nice catch on the target - I had forgotten to change that in the review, my code had it22:34
odyssey4me*my test had it22:34
*** sdake has quit IRC22:38
jmccroryodyssey4me cool, passed now. still don't know where 10.0.3.x addresses are coming from22:43
openstackgerritByron McCollum proposed openstack/openstack-ansible-lxc_container_create: [WIP] Test external connectivity for containers  https://review.openstack.org/28890922:43
odyssey4mejmccrory they come from the default lxcbr022:43
bgmccollumjmccrory those are the lxc managed DHCP address22:43
bgmccollumwhat he said22:43
odyssey4mebgmccollum see https://github.com/openstack/openstack-ansible/blob/master/playbooks/lxc-containers-create.yml - that's the was the role is designed, although I agree it's funky22:43
bgmccollumodyssey4me but when it gets to the tests, maybe there should be two plays, one for testing from the host, one for testing from the containers?22:44
odyssey4mebgmccollum see https://review.openstack.org/#/c/288942/5/tests/test.yml22:44
odyssey4methat file has many playbooks in it22:45
odyssey4mewe should split them into individual files to make it more logical22:45
jmccrorythe default dhcp range should be overridden by the test though https://github.com/openstack/openstack-ansible-lxc_container_create/blob/master/tests/test.yml#L3422:45
bgmccollumoh you accounted for this already...looks good22:46
odyssey4mejmccrory ok, I'm going to try and rebase https://review.openstack.org/288942 on master and squash https://review.openstack.org/288340 into it - that should pass22:46
*** thorst has quit IRC22:46
odyssey4mejmccrory ah, another bug then :p22:47
*** thorst has joined #openstack-ansible22:47
openstackgerritMerged openstack/openstack-ansible-os_swift: Removing unneeded with_items usage for clarity  https://review.openstack.org/28743522:47
jmccroryconfusing though because i haven't been able to reproduce it in vagrant yet22:47
jmccrorymy containers are getting 2 10.100.100.x addresses22:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Test container creation based on IP address  https://review.openstack.org/28894222:50
cloudnullo/ everyone22:50
bsvo7 Mr. cloudnull22:51
jmccroryhey22:51
odyssey4meo/ cloudnull - how're you feeling? have you beat the 'flu down yet?22:51
cloudnullodyssey4me: nope22:51
cloudnulli think i have yet another one22:51
cloudnulli blame asettle22:51
odyssey4meblast22:51
odyssey4mehot toddies22:51
cloudnullyup22:51
cloudnullalready in progress22:52
odyssey4meif they don't kill the 'flu at least they make you feel good22:52
cloudnulldrink enough to forget your sick. :)22:52
odyssey4memy whiskey just ran dry :/22:52
cloudnulljmccrory: if you run the tests the containers will have two of those addresses. one is assigned by the lxc-dnsmaq process the other is done in the lxc-container create role.22:53
cloudnullthe 10x addresses are the test addresses used in the loaded inventory22:53
cloudnullrather. 10.100.100.10x22:53
odyssey4mehmm, it's hanging: https://jenkins07.openstack.org/job/gate-openstack-ansible-lxc_container_create-ansible-func-ubuntu-trusty/12/console22:54
*** thorst has quit IRC22:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Test container creation based on IP address  https://review.openstack.org/28894222:55
* odyssey4me beats jenkins into submission22:55
jmccrorycloudnull: any idea how these 10.0.3.x are getting through? http://logs.openstack.org/42/288942/5/check/gate-openstack-ansible-lxc_container_create-ansible-func-ubuntu-trusty/92b973d/console.html#_2016-03-05_22_40_26_28822:56
odyssey4meheh, it suddenly strikes me that although I meant that as a joke, it's not a very nice one... :/ apologies22:56
*** admin0 has joined #openstack-ansible22:56
openstackgerritByron McCollum proposed openstack/openstack-ansible-lxc_container_create: [WIP] Test external connectivity for containers  https://review.openstack.org/28890922:56
cloudnull10.0.3.x is the default lxc address.22:57
cloudnullif that is getting in the lxc-host role isnt setting the address space up correctly ,22:57
cloudnullor maybe we've backed that out ?22:57
cloudnullidk22:57
bgmccollumthe `lxc_net_dhcp_range` doesn't seem to be referenced in the role...22:58
odyssey4meugh, the bindep fallback sets up mysql, postgresql and all sorts of nonsense22:58
*** woodard has joined #openstack-ansible22:58
jmccrorybgmccollum supposed to override in lxc_hosts https://github.com/openstack/openstack-ansible-lxc_hosts/search?q=lxc_net_dhcp_range22:59
bgmccollumugh role separation22:59
bgmccollum;(22:59
cloudnullbgmccollum: https://github.com/openstack/openstack-ansible-lxc_container_create/blob/master/tests/test.yml#L3422:59
cloudnullits in the test .23:00
bgmccollumyeah i just need to clone all the roles and grep across all the tings23:00
cloudnullso maybe the role is just not doing the right thing23:00
jmccroryweird thing is, everything looks good on my local vms. just not in the gate23:00
jmccrorycontainer1  RUNNING  10.100.100.101, 10.100.100.124  -     YES (onboot, openstack)23:01
jmccrorycontainer2  RUNNING  10.100.100.102, 10.100.100.37   -     YES (onboot, openstack)23:01
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Test container creation based on IP address  https://review.openstack.org/28894223:01
odyssey4mejmccrory cloudnull bgmccollum FYI, without other-requirements, the lxc-container-create process will likely hang the instance due to the other junk on the instance23:02
cloudnullis all of this because of the infra image changes?23:02
odyssey4mecloudnull yeah, but at least we're getting a consistent image across providers now23:03
*** woodard has quit IRC23:03
cloudnullah. thats good.23:03
cloudnullbut damn, theres been a lot of code churn because of it23:03
odyssey4meit's also making us find all sorts of bad assumptions for the roles and resolve them, so it's all good23:03
odyssey4mejust a little distracting I guess23:04
cloudnullyea its all good stuff23:04
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Test container creation based on IP address  https://review.openstack.org/28894223:05
odyssey4mecloudnull in other new, infra is adding an OSIC nodepool target23:05
cloudnullnice!23:05
odyssey4meSee  http://grafana.openstack.org/dashboard/db/nodepool-osic?panelId=12&fullscreen23:06
cloudnullthat'll be awesome23:06
odyssey4meyup, most certainly23:06
*** weezS has quit IRC23:06
*** mathlin1 has quit IRC23:10
cloudnullodyssey4me:  is that online now?23:11
openstackgerritByron McCollum proposed openstack/openstack-ansible-lxc_container_create: [WIP] Test external connectivity for containers  https://review.openstack.org/28890923:11
odyssey4mecloudnull yeah, but not much going to it yet - I think they're still busy setting up the mirrors and such23:12
odyssey4meblast, https://jenkins06.openstack.org/job/gate-openstack-ansible-lxc_container_create-ansible-func-ubuntu-trusty/7/console is hanging again23:13
*** sdake has joined #openstack-ansible23:13
odyssey4mewe're a go - jmccrory cloudnull review of https://review.openstack.org/288942 please23:15
*** ShannonM has joined #openstack-ansible23:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Implement human readable logging for functional tests  https://review.openstack.org/28847623:19
*** phiche has joined #openstack-ansible23:19
stevelleodyssey4me: why is the task name less helpful in that?23:20
odyssey4mestevelle ?23:21
stevelle"Test whether the role produced expected results"  vs "Ensure expected containers are detected" or such23:21
*** phiche1 has quit IRC23:21
*** sdake has quit IRC23:21
odyssey4mestevelle that's the playbook name, see the tasks below it23:21
stevelleyou broke from using post-tasks23:21
odyssey4mestevelle yeah, it needs a different target23:22
odyssey4methe previous play acted against the containers - the test play executes against hosts23:22
stevellegot it23:22
odyssey4meor *the* host23:22
cloudnullim off again. more toddies.23:32
cloudnulltalk to you all soon.23:32
odyssey4meget well soon cloudnull23:32
openstackgerritByron McCollum proposed openstack/openstack-ansible-lxc_container_create: [WIP] Test external connectivity for containers  https://review.openstack.org/28890923:33
odyssey4meI'm out for the night too everyone. Thanks for the help and company. :)23:33
bgmccollumcheers23:34
openstackgerritByron McCollum proposed openstack/openstack-ansible-lxc_container_create: [WIP] Test external connectivity for containers  https://review.openstack.org/28890923:45
*** neilus has quit IRC23:45
*** ShannonM has quit IRC23:48
*** fawadkhaliq has joined #openstack-ansible23:48
*** ShannonM has joined #openstack-ansible23:50
openstackgerritMerged openstack/openstack-ansible-lxc_container_create: Test container creation based on IP address  https://review.openstack.org/28894223:50
*** thorst has joined #openstack-ansible23:53
*** phiche has quit IRC23:53

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!