Thursday, 2018-02-01

*** rstarmer has quit IRC00:12
*** tobberydberg__ has quit IRC00:20
*** tobberydberg__ has joined #openstack-ansible00:20
*** yifei1 has joined #openstack-ansible00:22
*** tobberydberg__ has quit IRC00:27
*** chyka has quit IRC00:30
openstackgerritwangqiang-bj proposed openstack/openstack-ansible-os_ceilometer master: fix misspelling of 'configuration' and 'list'  https://review.openstack.org/53419500:55
*** gus has quit IRC01:07
*** gus has joined #openstack-ansible01:08
*** lbragstad has quit IRC01:10
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_barbican master: Zuul: Remove project name  https://review.openstack.org/53975601:11
*** rstarmer has joined #openstack-ansible01:21
*** lbragstad has joined #openstack-ansible01:31
*** tobberydberg__ has joined #openstack-ansible01:31
*** tobberydberg__ has quit IRC01:45
*** aludwar has quit IRC01:46
*** rstarmer has quit IRC01:47
*** chyka has joined #openstack-ansible01:53
*** chyka has quit IRC01:58
*** rstarmer has joined #openstack-ansible01:59
*** yifei1 has quit IRC02:08
*** tobberydberg__ has joined #openstack-ansible02:23
*** threestrands has joined #openstack-ansible02:27
*** threestrands has quit IRC02:27
*** threestrands has joined #openstack-ansible02:27
*** tobberydberg__ has quit IRC02:29
*** rstarmer has quit IRC02:32
*** rstarmer has joined #openstack-ansible03:02
*** idlemind has quit IRC03:05
*** tobberydberg__ has joined #openstack-ansible03:07
*** armaan has quit IRC03:12
*** armaan has joined #openstack-ansible03:13
*** tobberydberg__ has quit IRC03:14
*** guhcampos has quit IRC03:14
*** dave-mccowan has quit IRC03:48
*** idlemind has joined #openstack-ansible03:51
*** tobberydberg__ has joined #openstack-ansible03:51
*** sawblade_ has quit IRC03:56
*** tobberydberg__ has quit IRC03:57
*** rstarmer has quit IRC04:03
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_swift master: Zuul: Remove project name  https://review.openstack.org/53980904:33
*** akasurde has joined #openstack-ansible04:34
*** akasurde has joined #openstack-ansible04:34
*** tobberydberg__ has joined #openstack-ansible04:36
*** akasurde has quit IRC04:41
*** tobberydberg__ has quit IRC04:44
*** markvoelker has quit IRC04:57
*** poopcat1 has quit IRC05:11
*** chyka has joined #openstack-ansible05:15
*** bhujay has joined #openstack-ansible05:18
*** hybridpollo has quit IRC05:19
*** chyka has quit IRC05:20
*** tobberydberg__ has joined #openstack-ansible05:22
*** tobberydberg__ has quit IRC05:29
*** germs has quit IRC05:46
*** tobberydberg__ has joined #openstack-ansible05:46
*** threestrands has quit IRC05:48
*** tobberydberg__ has quit IRC05:50
*** tobberydberg__ has joined #openstack-ansible05:50
*** gkadam has joined #openstack-ansible05:53
*** tobberydberg__ has quit IRC05:55
*** rstarmer has joined #openstack-ansible05:59
*** indistylo has joined #openstack-ansible06:02
*** tobberydberg__ has joined #openstack-ansible06:04
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_designate master: Zuul: Remove project name  https://review.openstack.org/53982406:14
*** tobberydberg__ has quit IRC06:20
*** Taseer has quit IRC06:22
*** tobberydberg__ has joined #openstack-ansible06:26
*** Taseer has joined #openstack-ansible06:33
*** tobberydberg__ has quit IRC06:35
*** Taseer has quit IRC06:41
*** Taseer has joined #openstack-ansible06:42
*** armaan has quit IRC06:55
*** armaan has joined #openstack-ansible06:55
*** tobberydberg__ has joined #openstack-ansible06:58
*** markvoelker has joined #openstack-ansible06:58
*** cshen has quit IRC07:18
*** gkadam has quit IRC07:19
*** indistylo has quit IRC07:24
*** indistylo has joined #openstack-ansible07:24
*** DanyC has quit IRC07:28
*** markvoelker has quit IRC07:32
*** tobberydberg__ has quit IRC07:38
*** pcaruana has joined #openstack-ansible07:47
Taseerevrardjp: what is wrong with openstackdocstheme => http://logs.openstack.org/91/522491/71/check/requirements-check/52ff2c8/job-output.txt.gz#_2018-01-31_11_44_22_76845707:57
evrardjpthat is probably not us07:58
evrardjpwill have a look later07:58
evrardjpyou can ignore07:58
*** sxc731 has joined #openstack-ansible07:58
*** peri has joined #openstack-ansible08:01
Taseerokay08:01
Taseerevrardjp: should the congress service be running as per => http://logs.openstack.org/91/522491/71/check/openstack-ansible-functional-ubuntu-xenial/4160bd7/logs/openstack/congress1/congress/congress-server.log.txt.gz08:02
evrardjpwill have a look later too.08:03
evrardjpbut it looks ok at first.08:03
evrardjpbut it's just 3 lines from a log.08:04
*** bhujay has quit IRC08:05
Taseerthe api verification is failed.08:05
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit  https://review.openstack.org/52249108:13
*** mbuil has joined #openstack-ansible08:16
evrardjpwill have a look at the latest test08:21
*** markvoelker has joined #openstack-ansible08:29
*** bhujay has joined #openstack-ansible08:33
*** hamza21 has joined #openstack-ansible08:38
*** indistylo has quit IRC08:53
*** shardy has joined #openstack-ansible08:54
evrardjpandymccr: or odyssey4me if you're there, I'd like a vote on this: https://review.openstack.org/#/c/536372/ . Because I wrote the first patch, I'd like another pair of eyes before merging.08:54
evrardjpWant to use this new venv for all the roles, like it's done on keystone08:55
evrardjpfor keystone08:55
*** DanyC has joined #openstack-ansible09:02
*** markvoelker has quit IRC09:03
*** pbandark has joined #openstack-ansible09:05
*** DanyC has quit IRC09:06
*** Taseer has quit IRC09:09
*** Taseer has joined #openstack-ansible09:14
*** indistylo has joined #openstack-ansible09:17
*** pcaruana has quit IRC09:19
*** pcaruana has joined #openstack-ansible09:19
*** exodusftw has quit IRC09:29
*** indistylo has quit IRC09:32
*** exodusftw has joined #openstack-ansible09:36
*** gameon has joined #openstack-ansible09:38
*** sxc731 has quit IRC09:39
*** indistylo has joined #openstack-ansible09:46
evrardjphwoarang: do you mind if I edit: https://review.openstack.org/#/c/536374/1 ?09:47
evrardjpit's details09:47
*** lihi has quit IRC09:47
*** lihi has joined #openstack-ansible09:47
hwoarangohhh09:48
hwoarangmy bad09:48
hwoarangyeah please go ahead09:48
*** hamza21 has quit IRC09:49
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_nova master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53987509:51
*** gameon_ has joined #openstack-ansible09:52
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_nova master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53987509:52
*** gameon has quit IRC09:53
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-galera_server master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53637409:53
*** hamza21 has joined #openstack-ansible09:54
evrardjphwoarang: done09:54
evrardjphwoarang: I am doing the series of patches for all the roles now, it's biting us in different places, so I think it's time09:55
hwoarangmerci beaucoup09:55
evrardjpwe'll need to wait for the depends on to merge though09:55
evrardjphaha09:55
evrardjpperfect french!09:55
odyssey4meo/ looking09:56
evrardjpoh great!09:56
odyssey4meseems like a good start!09:57
evrardjpwe only have nova, galera, cinder, neutron, keystone, swift, glance  to do, so nova and galera are already up.09:57
odyssey4methis patch fixes an issue which needs porting back all the way to newton urgently, as it fixes a bug which breaks the console on *every* run on the os_nova role09:57
odyssey4mehttps://review.openstack.org/#/c/539583/09:58
odyssey4melooks like there're some other bugs getting in the way of it passing gate though09:58
evrardjpodyssey4me: yeah that one09:58
odyssey4mespecifically this on centos: http://logs.openstack.org/83/539583/1/check/openstack-ansible-functional-centos-7/4278647/logs/ara/result/e6e50287-48c4-433e-b510-c7d2e581a1cc/09:58
odyssey4meand then this is an odd one I haven't seen? http://logs.openstack.org/83/539583/1/check/openstack-ansible-upgrade-ubuntu-xenial/1b51c2c/job-output.txt.gz#_2018-01-31_16_58_26_24711509:58
evrardjpodyssey4me: yeah, that's what I am fixing09:58
evrardjpit's the venv thing09:59
evrardjpif you merge the depends on + my nova patch + mhayden's patch you can merge your patch09:59
evrardjp:D09:59
odyssey4mewhich patches are those?09:59
evrardjpnova: https://review.openstack.org/#/c/539875/09:59
*** markvoelker has joined #openstack-ansible10:00
evrardjphttps://review.openstack.org/#/c/534891/10:00
evrardjpwe also have these ones as extra: https://review.openstack.org/#/c/539688/ https://review.openstack.org/#/c/539724/10:00
evrardjpjust for fun10:00
odyssey4meand another dependent patch then: https://review.openstack.org/#/c/539635/110:01
evrardjpok let me fix cinder, neutron, swift, glance real quick now :D10:01
evrardjpodyssey4me: good catch.10:03
odyssey4meone small tweak on https://review.openstack.org/#/c/539875/210:04
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_nova master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53987510:06
evrardjpodyssey4me: done10:06
*** john51_ has joined #openstack-ansible10:08
odyssey4meoh man, major loves installing packages async, but that reduces the chances of the install task succeeding because async doesn't retry on failure10:08
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_nova master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53987510:09
*** john51 has quit IRC10:09
*** john51_ has quit IRC10:13
*** sxc731 has joined #openstack-ansible10:13
*** john51 has joined #openstack-ansible10:14
openstackgerritMerged openstack/openstack-ansible-tests master: Clean imports in code  https://review.openstack.org/53940010:14
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_keystone master: Use the tests ansible-previous venv  https://review.openstack.org/53988310:14
evrardjpodyssey4me: yeah, and on top of that, you can get issues real fast with locks if you don't pay attention10:15
evrardjpbut this package install that taks 4 minutes... really?10:15
evrardjpI mean I guess on top of the other packages10:15
openstackgerritJames E. Blair proposed openstack/openstack-ansible-ops master: Zuul: Remove project name  https://review.openstack.org/53988410:16
*** aruns has joined #openstack-ansible10:28
*** indistylo has quit IRC10:29
*** markvoelker has quit IRC10:33
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_nova master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53987510:35
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_cinder master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53989610:38
*** chyka has joined #openstack-ansible10:39
*** santacloud has joined #openstack-ansible10:41
*** armaan has quit IRC10:42
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53989710:42
*** armaan has joined #openstack-ansible10:43
*** chyka has quit IRC10:44
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_swift master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53989910:46
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_glance master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53990210:53
openstackgerritMerged openstack/openstack-ansible-tests master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53637211:00
*** olivierbourdon has joined #openstack-ansible11:02
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Fix SELinux policy filenames  https://review.openstack.org/53963511:07
*** Aju has joined #openstack-ansible11:09
*** armaan has quit IRC11:09
*** armaan has joined #openstack-ansible11:09
*** Chealion_ has joined #openstack-ansible11:10
*** kmARC_ has joined #openstack-ansible11:11
*** afranc has quit IRC11:11
*** Chealion has quit IRC11:11
*** sdake has quit IRC11:11
*** hwoarang has quit IRC11:11
*** kmARC has quit IRC11:11
*** ianw has quit IRC11:11
*** AndyWojo has quit IRC11:11
*** ildikov has quit IRC11:11
*** Chealion_ is now known as Chealion11:11
*** kmARC_ is now known as kmARC11:11
*** idlemind has quit IRC11:11
*** MeltedLux has quit IRC11:11
*** idlemind has joined #openstack-ansible11:11
*** AndyWojo has joined #openstack-ansible11:11
*** ildikov has joined #openstack-ansible11:11
*** sdake has joined #openstack-ansible11:11
*** sdake has quit IRC11:11
*** sdake has joined #openstack-ansible11:11
*** hwoarang has joined #openstack-ansible11:12
*** ianw has joined #openstack-ansible11:12
*** MeltedLux has joined #openstack-ansible11:12
*** pbandark has quit IRC11:15
*** indistylo has joined #openstack-ansible11:17
*** pbandark has joined #openstack-ansible11:18
*** exodusftw has quit IRC11:18
*** aruns has quit IRC11:20
*** exodusftw has joined #openstack-ansible11:24
*** indistylo has quit IRC11:25
*** sxc731 has quit IRC11:25
*** markvoelker has joined #openstack-ansible11:30
*** gameon_ has quit IRC11:35
*** rstarmer has quit IRC11:39
*** stuartgr has joined #openstack-ansible11:40
*** pbandark has quit IRC11:41
*** sxc731 has joined #openstack-ansible11:42
*** pbandark has joined #openstack-ansible11:45
*** indistylo has joined #openstack-ansible11:46
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_glance master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53990211:54
openstackgerritJames E. Blair proposed openstack/openstack-ansible-pip_install master: Zuul: Remove project name  https://review.openstack.org/53991911:57
*** sxc731 has quit IRC11:59
*** markvoelker has quit IRC12:04
*** dave-mccowan has joined #openstack-ansible12:13
*** hamza21 has quit IRC12:19
openstackgerritMerged openstack/openstack-ansible-os_nova master: Fix SELinux file contexts for nova's ssh keys  https://review.openstack.org/53489112:31
odyssey4meevrardjp do you want https://review.openstack.org/536374 merged now as-is, or are you holding it back for any particular reason? not sure if you want to adjust based on the other reviews?12:42
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Improve console install and restart services appropriately  https://review.openstack.org/53958312:51
*** hamza21 has joined #openstack-ansible12:52
openstackgerritPeriyasamy Palanisamy proposed openstack/openstack-ansible master: add networking-bgpvpn into openstack services  https://review.openstack.org/53955912:55
odyssey4mecores - any chance for a review of https://review.openstack.org/539611 please?13:00
odyssey4meit's a backport13:00
*** markvoelker has joined #openstack-ansible13:01
openstackgerritMerged openstack/openstack-ansible master: Add user agent for haproxy health checks  https://review.openstack.org/53286313:03
*** zenirc369 has quit IRC13:11
*** shardy is now known as shardy_mtg13:12
mhaydenmorning13:17
evrardjpodyssey4me: I think it's fine13:17
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_octavia master: Zuul: Remove project name  https://review.openstack.org/53994513:17
*** woodard has joined #openstack-ansible13:18
*** aruns has joined #openstack-ansible13:19
*** armaan has quit IRC13:20
*** indistylo has quit IRC13:22
*** hamza21 has quit IRC13:22
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova stable/pike: Fix SELinux file contexts for nova's ssh keys  https://review.openstack.org/53994813:26
mhaydenso the async task for the selinux packages on lxc_hosts brought centos within 90 seconds of Ubuntu13:27
mhaydensmall wins13:27
*** tannazn has joined #openstack-ansible13:27
mhaydenevrardjp: not sure if you're happy enough for +2 here https://review.openstack.org/#/c/539724/13:27
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: Remove openstack-selinux package from os_nova  https://review.openstack.org/53968813:29
*** shardy_mtg is now known as shardy13:31
*** kstev has joined #openstack-ansible13:32
*** markvoelker has quit IRC13:33
*** markvoelker has joined #openstack-ansible13:33
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron master: [TEST] Test os_neutron with SELinux enforcing  https://review.openstack.org/53969013:33
*** SerenaFeng has joined #openstack-ansible13:35
odyssey4mewe should likely get https://review.openstack.org/539601 in asap mhayden ?13:37
* mhayden looks13:37
mhaydenah yes13:38
* mhayden has applied a deuce and a half13:38
mhaydenlook at idlemind getting in there to review -- nice!13:38
*** kstev has quit IRC13:39
*** kstev has joined #openstack-ansible13:40
mgariepymorning everyone13:41
mhaydenohai mgariepy13:42
mgariepyStarted playing with a new epyc server yesterday :D13:43
mgariepygot some weird issue with repo-build.13:43
mgariepypython segfault randomly when building the pkg.13:43
bhujayhi all with suse  compute node can we use rbd as backend ? if no , is there any future road map13:48
mgariepyfrom pike/master: sha  4d75c3b47645781602c1d52a50b7c8c2f1e0f98f13:48
*** sawblade6 has joined #openstack-ansible13:49
openstackgerritMerged openstack/openstack-ansible-os_barbican stable/pike: Add CentOS 7 deployment support  https://review.openstack.org/53825913:49
mgariepyhttp://paste.openstack.org/show/658313/13:49
mgariepypip segfault. with different pkg13:49
mgariepypip segfault. when building different venv13:50
*** aruns__ has joined #openstack-ansible13:53
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Use systemd module instead of command  https://review.openstack.org/53995513:54
openstackgerritMerged openstack/openstack-ansible-galera_server stable/ocata: Zuul: Remove project name  https://review.openstack.org/53888313:54
*** aruns has quit IRC13:55
*** SerenaFeng has quit IRC13:56
openstackgerritMerged openstack/openstack-ansible-repo_build stable/pike: Correct manifest index of openstack git folders  https://review.openstack.org/53961114:00
*** ArchiFleKs has quit IRC14:00
openstackgerritMerged openstack/openstack-ansible-galera_server master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53637414:01
openstackgerritMerged openstack/openstack-ansible stable/pike: container_host can be replaced by physical_host on is_metal  https://review.openstack.org/53831514:04
mhaydenso when we install rabbitmq, we start the server on node 0, do stuff, set a cookie, then stop the server, and start it again14:05
mhaydenis the first start necessary?14:05
mhaydenit adds a fair amount of time to the deployment14:05
mhaydeni figured there must be a reason ;)14:05
*** jhesketh has quit IRC14:12
*** robcresswell has left #openstack-ansible14:13
*** jhesketh has joined #openstack-ansible14:13
*** stuartgr has quit IRC14:13
*** ArchiFleKs has joined #openstack-ansible14:16
mhaydenmgariepy: ugh, segfaults make me wanna throw chairs14:17
mhaydenreminds me of compiling custom modules for apache 214:17
openstackgerritMerged openstack/openstack-ansible-galera_server stable/pike: Fix Galera socket for RedHat  https://review.openstack.org/53960114:18
*** mwe1 has quit IRC14:19
mhaydenand there was much rejoicing14:20
evrardjp:)14:21
odyssey4memgariepy that segfault is quite weird - given that our pip version is fixed, I doubt it's pip itself - perhaps something that's changed in python or the kernel recently?14:22
evrardjpI am thinking of underlying libs.14:23
evrardjpThe ideal would be able to reproduce it at 100% of the time14:23
evrardjpsee when it happens (cryptography?)14:24
mgariepyit was quite random.14:27
mgariepyfailed 3 times worked the last time.14:27
*** mwe1 has joined #openstack-ansible14:28
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_magnum master: Zuul: Remove project name  https://review.openstack.org/53862714:33
*** esberglu has joined #openstack-ansible14:35
*** jwitko has joined #openstack-ansible14:36
mgariepyalso got some weird timings on tatsk times yesterday: http://paste.openstack.org/show/658229/14:36
openstackgerritMerged openstack/openstack-ansible-ops master: Zuul: Remove project name  https://review.openstack.org/53988414:40
*** bhujay has quit IRC14:40
*** mwe1 has quit IRC14:43
mgariepyhttps://paste.ubuntu.com/26501005/14:46
mgariepysegfault again this morning.14:46
mgariepyneutron and rally failed to build.14:46
openstackgerritMerged openstack/openstack-ansible-ceph_client master: Zuul: Remove project name  https://review.openstack.org/53967214:46
openstackgerritMerged openstack/openstack-ansible-os_monasca-agent master: Zuul: Remove project name  https://review.openstack.org/53962914:46
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Install SELinux packages asynchronously  https://review.openstack.org/53972414:46
*** woodard has quit IRC14:48
*** mwe1 has joined #openstack-ansible14:49
cloudnullmornings14:51
lbragstadevrardjp: one quick question on https://review.openstack.org/#/c/533314/614:53
* lbragstad passes cloudnull the coffee14:54
* cloudnull needs more14:54
openstackgerritMerged openstack/openstack-ansible-pip_install master: Zuul: Remove project name  https://review.openstack.org/53991914:56
evrardjplbragstad: depends on your use case?14:56
evrardjplbragstad: if you mean in role testing, I think we have an override.14:56
*** ndusek has joined #openstack-ansible14:57
evrardjpbut that's a valid concern14:57
evrardjpwhat I am concerned with is how this works for now right now for you14:57
evrardjpyou want it with memcached on localhost for dev, right?14:57
lbragstadi guess i'm thinking about it from the perspective that someone is doing an install but not overriding the default cache variable (just assuming caching will be deployed locally with keystone and somehow relying on that)14:57
lbragstadi just noticed the default was changing14:58
evrardjpWe'd probably want to allow people to disable caching, and to enable memcached on memcached dedicated nodes if they have a prod environment14:58
lbragstadright - i don't think my concern is really valid for production deploys...14:58
lbragstadsince I bet people would probably override that to shard data over the cache14:59
evrardjplbragstad: So I have included an auto wiring for prod deploys14:59
odyssey4meideally our test should implement more than one memcache instance for caching14:59
lbragstadoh14:59
lbragstadok - cool!14:59
odyssey4meit's been a while since I checked, but I think there's only one right now15:00
evrardjphttps://review.openstack.org/#/c/538235/15:00
odyssey4meevrardjp I'm specifically talking about the os_keystone tests, not the integrated build15:00
lbragstadhttps://review.openstack.org/#/c/538235/1/inventory/group_vars/keystone_all.yml@49 i assume15:01
lbragstadnice15:01
evrardjplbragstad: so by default, the prod deploys wire things up to prod memcached servers, and tests have no caching, because we don't install memcached iirc. Else I can wire these for testing.15:01
odyssey4meyep, the old default of localhost was meaningless15:01
lbragstadevrardjp: that's totally up to you, i just saw a changing default and red lights started flashing :)15:02
evrardjplbragstad: and the red flashing lights were not from a policeman, but from an os_keystone role test?15:03
evrardjp:D15:03
lbragstadlol - yep15:03
*** aruns__ has quit IRC15:04
evrardjpI am interested to know if there is an interest of testing without memcached15:05
lbragstadthat's a good question... i know we rely on memcache pretty heavily15:05
*** mattt has joined #openstack-ansible15:06
evrardjpwell, I assumed it made sense to test without caching first.15:11
evrardjpbut I see the opposite in facts :)15:11
evrardjpLet's adapt the role to make it so. And still allow the user to disable it.15:12
evrardjplet me fix that quick15:12
*** olivierbourdon has quit IRC15:14
openstackgerritMerged openstack/openstack-ansible-os_glance master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53990215:18
*** stuartgr has joined #openstack-ansible15:19
evrardjpgot sidetracked. Will work on it right now!15:21
evrardjprealized it was working out of pure luck before.15:21
evrardjpthat was a joke :)15:22
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53989615:25
evrardjplbragstad: odyssey4me ok, I quickly checked the wiring. During keystone (and many other) role test, we install (in the infrastructure part) memcached, for the memcached_all group. For keystone, and for many role, we have a group memcached_all in the inventory, which is wired to infra.15:30
evrardjpinfra115:30
evrardjpwhen doing the memcached role, we pass test-vars, which point to that group, and gives something named memcached_servers15:31
odyssey4meok, so we have one memcache host then15:31
lbragstadnice15:31
evrardjpat zero place, we are using it.15:31
evrardjpbecause it's not wired to keystone_memcached_servers (let me double check with os_keystone-overrides)15:31
evrardjpso unless mistaken, we are deploying memcached for nothing.15:32
lbragstadahhh15:32
evrardjpbecause the meta/main on memcached was removed in P, we didn't even use it.15:32
evrardjpI mean, since that time we don't use it in role tests15:32
evrardjpI think I went through this process when I did the patch, but I already forgot.15:33
evrardjpmaybe I should document myself more.15:33
evrardjpanyway, long story short, we can wire things up for all the roles easily with that patch.15:33
*** Leo_m has joined #openstack-ansible15:33
evrardjpin the same way we did for the integrated build15:33
evrardjpand it would work for keystone particularily too.15:34
openstackgerritMerged openstack/openstack-ansible-os_swift master: Zuul: Remove project name  https://review.openstack.org/53980915:34
openstackgerritMerged openstack/openstack-ansible-os_swift master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53989915:34
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Zuul: Remove project name  https://review.openstack.org/53994515:34
*** woodard has joined #openstack-ansible15:36
evrardjpI'll add the auto wiring to all containers if we want to test clustering too.15:38
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests master: Add memcached servers wiring  https://review.openstack.org/53999315:41
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests master: Add memcached servers wiring  https://review.openstack.org/53999315:42
evrardjplbragstad: now, with that ^ you can choose the scenario you want for your testing. if you want we have two tests, one with clustering, one with just one memcached.15:43
evrardjp(if I implement the scenarios)15:45
evrardjpdepends on what you need. You ask, and I make it happen.15:45
evrardjp:D15:45
lbragstadthat sounds awesome!15:47
*** eglute_s is now known as eglute15:52
evrardjpexcept if I am tired and blind, and can't follow code today. I am abiding the same rules as clustering (CAP theorems?), so I am eventually consistent.15:53
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-lxc_hosts master: Change default for sshd to only all keybased auth  https://review.openstack.org/53902015:55
lbragstadlol - CAP totally applies to code :)15:58
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Fix memcache caching w/ multiple cache servers  https://review.openstack.org/53331416:00
openstackgerritMerged openstack/openstack-ansible-os_nova master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53987516:00
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Zuul: Remove project name  https://review.openstack.org/53975616:00
*** openstacking_123 has joined #openstack-ansible16:00
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_keystone master: Test keystone with a memcached cluster  https://review.openstack.org/54000116:06
evrardjplbragstad: could you give me your opinion on my comment here: https://review.openstack.org/#/c/540001/116:08
openstackgerritMerged openstack/openstack-ansible master: Enable Heat in Horizon if Heat is installed  https://review.openstack.org/53828716:10
*** santacloud has quit IRC16:10
*** ndusek has quit IRC16:10
*** SerenaFeng has joined #openstack-ansible16:11
*** rstarmer has joined #openstack-ansible16:14
*** rstarmer has quit IRC16:14
*** RandomTech has joined #openstack-ansible16:15
evrardjpanswered.16:15
cloudnullif anyone has time to give https://review.openstack.org/#/c/527749 a look it'd be greatly appreciated.16:28
*** chyka has joined #openstack-ansible16:34
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible master: [DOC]: admin: troubleshooting: Fix code-block statements  https://review.openstack.org/54002816:35
RandomTechcloudnull: im not entirely sure what im looking at, but it sounds good in theory16:43
*** pcaruana has quit IRC16:45
*** nurdie_ has joined #openstack-ansible16:47
nurdie_should a container on "controller1" be able to communicate with a container on "controller2"? I'm getting a No route to host that is perplexing me on a fresh ansible deployment16:48
nurdie_Specifically, they are openstack services containers (galera). infrastructure is 3 controllers, all running haproxy and keepalived16:49
*** nurdie_ is now known as nurdie16:50
openstackgerritMerged openstack/openstack-ansible-galera_server stable/newton: Zuul: Remove project name  https://review.openstack.org/53887616:52
openstackgerritMerged openstack/openstack-ansible-os_cloudkitty stable/ocata: Zuul: Remove project name  https://review.openstack.org/53861116:52
*** shardy has quit IRC16:52
*** SerenaFeng has quit IRC16:55
*** armaan has joined #openstack-ansible17:01
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/newton: Zuul: Remove project name  https://review.openstack.org/53852517:11
*** aruns__ has joined #openstack-ansible17:12
*** peri has quit IRC17:18
cloudnullnurdie: yes.17:19
cloudnullspecifically for galera the three containers will all talk to one another directly17:19
cloudnullthe openstack services will then use the loadbalancer to connect to the galera infrastructure17:19
*** jwitko_ has joined #openstack-ansible17:20
*** jwitko has quit IRC17:22
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/ocata: Zuul: Remove project name  https://review.openstack.org/53851417:24
openstackgerritMerged openstack/openstack-ansible-repo_build master: Zuul: Remove project name  https://review.openstack.org/53892617:34
*** armaan has quit IRC17:35
*** kstev has quit IRC17:37
idlemindcloud is up and running ... oddly, if i deploy 2 ubuntu-xenail instances the first creates the second times out saying the volume wasn't able to be created and timed out. watching the logs i never see the request for the second volume. i'm running centos w/selinux disabled. anyone seen this? instances created via horizon ui17:38
*** aruns__ has quit IRC17:39
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/pike: Zuul: Remove project name  https://review.openstack.org/53876317:39
idlemindredploying 2 more ubuntu xenial instances, 1 completes the other fails17:41
idlemindcirros completes just fine17:44
idlemindannoyingly so17:44
idlemindso i'm wondering if it something to do w/how fast the block device mapping process is17:44
*** kstev has joined #openstack-ansible17:47
*** guhcampos has joined #openstack-ansible17:49
*** mbuil has quit IRC17:55
*** Leo_m has quit IRC17:55
*** Leo_m has joined #openstack-ansible17:56
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_molteniron master: Zuul: Remove project name  https://review.openstack.org/54007117:59
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Use a venv with previous ansible version for upgrades  https://review.openstack.org/53989717:59
idlemindmine seems to be timeouts for block device creation in nova.conf ... i'll have to tweak my user_config.yml after lunch and see how she goes18:01
*** chyka has quit IRC18:07
*** chyka has joined #openstack-ansible18:07
*** sxc731 has joined #openstack-ansible18:09
*** hamza21 has joined #openstack-ansible18:16
*** openstackgerrit has quit IRC18:18
*** openstackgerrit has joined #openstack-ansible18:20
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/pike: Zuul: Remove project name  https://review.openstack.org/53851818:20
*** openstacking_123 has quit IRC18:24
*** aruns__ has joined #openstack-ansible18:24
*** sxc731 has quit IRC18:25
openstackgerritAntony Messerli proposed openstack/openstack-ansible-ops master: [WIP] Replace pxelinux with iPXE support in MNAIO  https://review.openstack.org/53932718:26
*** jbadiapa_ has joined #openstack-ansible18:33
*** jbadiapa has quit IRC18:35
*** sxc731 has joined #openstack-ansible18:41
openstackgerritMerged openstack/openstack-ansible-os_cinder master: tasks: cinder_qos: Use exact match for QoS rules  https://review.openstack.org/53249418:42
*** _jbadiapa has joined #openstack-ansible18:48
*** jbadiapa_ has quit IRC18:49
openstackgerritMerged openstack/openstack-ansible-os_molteniron master: Zuul: Remove project name  https://review.openstack.org/54007118:59
*** poopcat has joined #openstack-ansible19:01
*** germs1 has joined #openstack-ansible19:02
nurdiehttps://send.firefox.com/download/e6768c9001/#zaroG-YVZeUqJ9AmjNA-1w19:03
nurdieWould this setup cause network problems for an ansible deployment? VIP is on 10.21.8.0/24. Internal and external VIP is the same19:04
nurdiei've spent weeks setting this up, and days trying to get the ansible deployment to work correctly. i'm having issues with some of the service containers finding routes to service containers on other controllers19:06
nurdieall of the service containers speaking on the first controller seem fine, but not on the other controllers. ping works great across all networks, but if I try to ssh from galera2 to galera1, for instance, i get no route to host19:09
jrossernurdie: i dont believe it is a good idea to have the internal and external vip the same19:10
nurdieshould i just pick an arbitrary internal network for the internal VIP?19:10
jrosserit needs to be on the openstack mgmt network19:11
jrosserits how the internals all talk to each other19:11
nurdiebut the external vip should be on something else?19:11
jrosserthas your public api endpoint for users19:11
jrosserhowever you define external for your use case19:11
nurdiethe mgmt network is also the network that provides the cluster with WAN access right?19:12
cloudnullnurdie: the internal and external vip have to be different however they can be on the same subnet.19:12
openstackgerritMerged openstack/openstack-ansible master: Add scaffolding for multiple container techs  https://review.openstack.org/52774919:12
openstackgerritMerged openstack/openstack-ansible master: [DOC]: admin: troubleshooting: Fix code-block statements  https://review.openstack.org/54002819:12
nurdieo_o19:12
*** sxc731 has quit IRC19:13
nurdieso, internal: 192.168.1.2, and external: 192.168.1.3 would be better than having them the same?19:13
cloudnullyes19:13
cloudnullwe terminate ssl using HAProxy on the external VIP, if the two are the same the defaults will not want to work well with one another.19:13
nurdieis that likely the root of my routing issues? i've noticed that it could be VIP related, that's why i mentioned it. it seems like keepalived has a hard time determining where to ARP19:14
nurdieahhh19:14
cloudnullyou could disable all of the SSL bits19:14
cloudnullbut I'd not recommend that19:14
nurdieno SSL will remain19:14
nurdiei will give that a shot. thanks!19:14
*** stuartgr has quit IRC19:15
jrossernurdie: remember the exaples in the doc appendix are only really good enough for proof of concept19:16
jrosserif youre hooking the mgmt net to a wan or even worse the internet you need to stop and think19:16
cloudnull^19:16
cloudnulltruth.19:17
cloudnulljrosser: we sshould add that statement to the docs !19:17
* cloudnull is only half joking :)19:17
nurdiewell it's all behind a NAT, so it's not publicly accessible19:17
nurdieso mgmt should be a segregated non routed network?19:18
nurdiedownstream from the switch*19:18
cloudnullit is in most of my deployments.19:18
nurdieand br-vxlan will be the net that allows internet access?19:19
cloudnullfor us that's br-vlan but yes.19:20
nurdieinteresting. i definitely have understood this horribly lol19:20
nurdiedo your public api endpoints also route through br-vlan?19:21
cloudnullno all of our public endpoints are on a totally separate network.19:22
nurdiethat get routed through which bridge?19:22
nurdieor not a bridge19:23
cloudnullnot a bridge in our case19:23
*** sxc731 has joined #openstack-ansible19:23
nurdiein my case, this could be bond0 for us, before vlan tagging happens, or a seperate vlan19:23
nurdiei think i'm starting to grasp it19:24
nurdiei'm going to do some more reading. thanks for the help cloudnull and jrosser!19:24
cloudnull++ anytime19:24
jrossercloudnull: this so needs another appendix19:29
jrosserjust a high level diagram of something worthy of connecting to the internet and how that would be arranged19:29
cloudnull++19:29
jrosserthere is *so* much confusion with the appendix showing everything on the mgmt network19:29
cloudnullI think that would help quite a few folks19:29
jrossershould also cover where/how to make an external net land on br-external/br-vlan19:31
jrosserbecasue thats also a massive hidden trap with everyhting collapsed on the infra nodes, which is fine for POC19:31
jrosserbut totally not fine imho for real use case19:31
cloudnull++19:32
cloudnullI would absolutely agree.19:32
cloudnullgetting a real world network topology documented would be great19:33
cloudnulloye, jrosser you going to the PTG?19:33
jrosserdubin isnt that far, so its possible19:33
cloudnullwell if you're there maybe we can work on it in person :)19:33
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Use the tests ansible-previous venv  https://review.openstack.org/53988319:33
openstackgerritMerged openstack/openstack-ansible-os_nova master: Improve console install and restart services appropriately  https://review.openstack.org/53958319:33
jrosseryeah that would be cool, cause over the last 12mo i've had all this pain too19:34
jrosserand am in the fortunate position to have enough resources to make my POC be as you'd do it for real19:34
idlemindhttps://ask.openstack.org/en/question/65282/instance-failed-to-create-due-to-block-device-setup-timeout/19:36
idlemindany ideas on how i'd adjust my user_config.yml to adjust the nova timers that are mentioned here?19:36
idlemindcompute_hosts: ... something ... ?19:36
openstackgerritJames E. Blair proposed openstack/openstack-ansible-tests master: Zuul: Remove project name  https://review.openstack.org/54010919:40
cloudnullidlemind: looking19:41
idlemindthx trying to find references to it myself but my kung fu is not strong19:42
cloudnullidlemind: so you need  block_device_allocate_retries=600 and block_device_allocate_retries_interval=1 set?19:43
idlemindya those seem to be the values but i'm not certain they are curring in pike+19:52
nurdiecloudnull, jrosser, this is why i did internet through br-mgmt: https://docs.openstack.org/project-deploy-guide/openstack-ansible/ocata/app-config-prod.html19:56
nurdielook at the last bullet point on the introduction19:56
cloudnullidlemind: https://github.com/openstack/openstack-ansible/blob/37525c357152eaccd381f854b49533934860669f/deploy-guide/source/app-advanced-config-override.rst#overriding-conf-files -- here is how you can add it to the config19:57
cloudnulland here is an example implementing the change for the ceph host19:57
cloudnullhttp://paste.openstack.org/show/658354/19:57
cloudnullidlemind: opps wrong paste.19:58
cloudnullhttp://paste.openstack.org/show/658355/19:58
cloudnull^ that is the right one19:58
cloudnullsee line 4-719:58
*** sxc731 has quit IRC20:02
idlemindhey that looks like the variables i'm looking20:04
idlemindfor20:04
idlemindi'll give it a whirl see if it breaks my testing cloud20:05
idlemindthx20:05
idlemindi was looking in nova but it comes in under cinder ... interesting20:05
cloudnullhum.20:06
cloudnullyea you might need to add that host_vars bit to the nova-compute hosts too20:06
idlemindi'm no expert tho i just read and trial / error20:06
cloudnullok going to go grab a bite. bbl20:07
idlemindthanks tty in a bit20:07
*** aruns__ has quit IRC20:10
*** pbandark has quit IRC20:12
jrossernurdie: thats cool, as you've got to get your install packages etc from somewhere, unless you're tring to do an "offline install" which is very much harder20:19
nurdiejrosser, i was just letting y'all know, because you called me crazy for hooking br-mgmt to WAN :p20:20
jrosserwell slightly wonky turn of phrase i guess :)20:20
jrosserwhat i really meant (i think) was that the "external" network for the external vip and wherever you want your users VM to appear arent dealt with much in those examples20:21
nurdielol20:21
nurdieyup i'm starting to understand that20:21
jrosserand depending on "lots of things" everywhere has different ideas about how that should be done20:22
nurdiei really appreciate the help. i'm sure i'll have more questions as I progress :320:22
*** germs1 has quit IRC20:44
nurdiejrosser, i'm getting even more confused now20:46
jrossersorry :(20:47
nurdieon that page that I linked for you, their production example debian based /etc/network/interfaces has br-mgmt as their default gateway20:47
jrosserok20:48
nurdiebut you argue that that is bad20:49
cloudnullnurdie: here's an old example but something that was taken from one of my environments http://paste.openstack.org/show/65835820:50
cloudnullit looks like all of our example network files have been made generally simpler.20:51
*** woodard has quit IRC20:51
nurdiecloudnull, and the external VIP for that example would just be on the 10.240.0.0/22 network (bond0)?20:55
nurdieinternal VIP could be anything on the br-mgmt network20:56
nurdieam i understanding that correctly now?20:56
cloudnullnurdie: in that example, that was an infra host with no access to the external network.21:02
cloudnullthe internal VIP would have been on the 172.29.236.0/22 network21:02
cloudnullwhich is the mgmt on vlan 2176 (CONTAINER_NET)21:03
nurdiegot it. i'm gonna play with that. many many thanks cloudnull21:03
cloudnullat rax we use a lot of F5 in front of our clouds, or stand alone HAProxy nodes.21:03
cloudnullwe don't normally have loadbalancer functions on the infra hosts.21:04
cloudnullthat's not to say you can't21:04
cloudnulland I know lots of folks that do combine LB and infra hosts.21:04
cloudnullbut we don't in prod21:05
nurdieare there underlying issues with it?21:05
nurdieor is it just a finnacky config?/21:05
*** hamza21 has quit IRC21:06
cloudnullnope, just concerns with crossing the networking streams :)21:06
nurdieah21:06
nurdieok21:06
cloudnullnothing that we do that would prohibit you from combining those functions21:07
cloudnullI just don't do it due to the increased attack surface.21:09
*** RandomTech has quit IRC21:12
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_heat master: Zuul: Remove project name  https://review.openstack.org/54014321:21
*** ianychoi_ has joined #openstack-ansible21:21
*** ianychoi has quit IRC21:24
*** guhcampos_ has joined #openstack-ansible21:32
idlemindjrosser i'll agree external connectivity isn't clearly defined in the examples. i've tusseled along a fair bit figuring out how i want the vms in the cloud to get connectivity outbound. i'm sure it's a fairly complicated bit in setting everything up but maybe the examples should have a 5th bridge called br-ex or br-ext (i think i've seen both tossed around in other docs around the openstack world) and make it just a21:33
idlemindflat network that if you manage to get it mapped on the linux side to a network (vlan) on your lan you'll get at least 1 easy going external network to play with. i know br-vlan in the examples is presented as a "flat" and as a "vlan" but it's not as clear cut to ppl reading the openstack 1, 2, 3 guide via ansible.21:33
jrosserthat is confusing too i think, the flat vs. vlan21:34
jrosserparticularly as OSA will be a lot of peoples first venture into openstack21:35
*** woodard has joined #openstack-ansible21:35
idlemindya i ended up doing qinq via the br-vlan in my first cloud cuz i fudged my br-vlan, flat in my user_config.yml ... ppl w/o a strong networking background and a lot of not for home use home lab gear probably couldn't do that21:36
idlemindmaybe that can be my first contribution ... how to get your osa cloud on the interwebs21:36
openstackgerritJames E. Blair proposed openstack/openstack-ansible-openstack_openrc master: Zuul: Remove project name  https://review.openstack.org/54014921:41
*** olivierbourdon has joined #openstack-ansible21:45
*** germs1 has joined #openstack-ansible21:48
*** germs1 has quit IRC21:48
*** olivierbourdon38 has joined #openstack-ansible21:48
*** armaan has joined #openstack-ansible21:53
*** olivierbourdon has quit IRC21:55
nurdiejrosser, I agree. Flat network was a misleading term, and I didn't know it was an industry standard term for a network segment without VLAN tags21:56
nurdiei had to break some things and then google it21:56
*** threestrands has joined #openstack-ansible21:59
*** threestrands has quit IRC22:00
*** threestrands has joined #openstack-ansible22:00
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_keystone master: Zuul: Remove project name  https://review.openstack.org/54015922:01
openstackgerritchandu proposed openstack/openstack-ansible-os_neutron stable/ocata: Remove duplicated of neutron_designate_enabled variable in Stable/Ocata Branch. this cause warning while running setup-openstack.yml play  https://review.openstack.org/54016022:03
*** dave-mccowan has quit IRC22:30
*** olivierbourdon38 has quit IRC22:54
openstackgerritJames E. Blair proposed openstack/openstack-ansible-repo_server master: Zuul: Remove project name  https://review.openstack.org/54017423:01
*** dxiri has joined #openstack-ansible23:02
*** olivierbourdon38 has joined #openstack-ansible23:02
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add nspawn container driver  https://review.openstack.org/47701723:04
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: add networking-bgpvpn into openstack services  https://review.openstack.org/53955923:06
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Update all SHAs for master  https://review.openstack.org/53913123:07
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add nspawn container driver  https://review.openstack.org/47701723:16
DimGRhi23:17
cloudnullo/ DimGR23:17
DimGRhow did the renovation go :P23:18
cloudnullits still going :)23:21
cloudnullold wall is gone, sheetrock is patch, stair banisters and railing go in on monday23:21
*** esberglu has quit IRC23:24
*** kstev has quit IRC23:28
*** Leo_m has quit IRC23:35
*** esberglu has joined #openstack-ansible23:36
*** kstev has joined #openstack-ansible23:44
*** esberglu_ has joined #openstack-ansible23:45
*** kstev1 has joined #openstack-ansible23:47
*** esberglu has quit IRC23:47
*** kstev has quit IRC23:48
*** esberglu_ has quit IRC23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!