Monday, 2017-12-04

*** thorst has joined #openstack-ansible00:16
*** thorst has quit IRC00:21
*** Oku_OS-away has joined #openstack-ansible00:22
*** mancdaz has joined #openstack-ansible00:22
*** yifei has joined #openstack-ansible00:23
*** woodard_ has quit IRC00:48
*** woodard has joined #openstack-ansible00:48
*** sboyron has quit IRC00:50
*** thorst has joined #openstack-ansible00:52
*** thorst has quit IRC00:57
*** thorst has joined #openstack-ansible01:27
*** thorst has quit IRC01:28
*** thorst has joined #openstack-ansible01:29
*** thorst has quit IRC01:30
*** openstackgerrit has joined #openstack-ansible01:32
openstackgerritKaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca-agent master: Fix default role missing pip packages  https://review.openstack.org/52502201:32
*** thorst has joined #openstack-ansible02:01
*** hw_wutianwei has joined #openstack-ansible02:04
*** thorst has quit IRC02:06
*** thorst has joined #openstack-ansible02:10
*** thorst has quit IRC02:14
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_designate master: Fix ansible-lint test failures  https://review.openstack.org/52503102:47
*** thorst has joined #openstack-ansible03:17
*** thorst has quit IRC03:22
*** chhavi has joined #openstack-ansible03:40
*** thorst has joined #openstack-ansible03:57
*** cuongnv has joined #openstack-ansible03:59
*** thorst has quit IRC04:02
*** weezS has joined #openstack-ansible04:13
*** weezS has quit IRC04:19
*** udesale has joined #openstack-ansible04:25
*** udesale has quit IRC04:25
*** udesale has joined #openstack-ansible04:25
*** bhujay has joined #openstack-ansible04:29
*** dasTor has quit IRC04:35
*** dasTor has joined #openstack-ansible04:35
*** thorst has joined #openstack-ansible04:37
*** thorst has quit IRC04:41
*** m|y|k has joined #openstack-ansible04:42
*** m|y|k has quit IRC04:42
*** thorst has joined #openstack-ansible05:10
*** thorst has quit IRC05:15
*** andymccr has quit IRC05:32
*** andymccr has joined #openstack-ansible05:33
*** cloudnull has quit IRC05:33
*** thorst has joined #openstack-ansible05:37
*** cloudnull has joined #openstack-ansible05:41
*** thorst has quit IRC05:42
*** thorst has joined #openstack-ansible05:45
*** thorst has quit IRC05:50
*** hybridpolio has quit IRC06:00
*** thorst has joined #openstack-ansible06:24
*** thorst has quit IRC06:29
*** jbadiapa has joined #openstack-ansible06:33
*** gkadam_ has quit IRC06:47
*** thorst has joined #openstack-ansible06:57
*** thorst has quit IRC07:01
*** mardim has quit IRC07:03
jafehagood morning07:07
*** jvidal has joined #openstack-ansible07:14
*** dayou has quit IRC07:14
*** cshen has joined #openstack-ansible07:23
*** askb_ has joined #openstack-ansible07:25
*** askb_ has quit IRC07:29
*** michelv has joined #openstack-ansible07:31
*** jafeha has quit IRC07:33
*** indistylo has joined #openstack-ansible07:33
*** askb_ has joined #openstack-ansible07:34
*** thorst has joined #openstack-ansible07:36
*** thorst has quit IRC07:41
*** mardim has joined #openstack-ansible07:44
*** rgogunskiy has joined #openstack-ansible07:45
evrardjpgood morning07:46
*** mardim has quit IRC07:47
*** shardy has joined #openstack-ansible07:48
*** pmannidi has quit IRC07:50
evrardjphwoarang: are you there? I have some proposition for gate issues due to the packages/lxc for centos/suse: what if we remove the suse/centos jobs from gates, but keep them in the check state, as voting. We'd still need to pass there before going further. But we don't double the risks.07:55
evrardjpalso, cores: we need to merge this: https://review.openstack.org/#/c/524961/07:56
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-openstack_hosts master: Run pip once and for all  https://review.openstack.org/52496207:59
*** jafeha has joined #openstack-ansible08:01
jafehagood morning again08:01
evrardjpgood morning jafeha :)08:01
evrardjpI am clueless about this issue: http://logs.openstack.org/24/504224/23/check/openstack-ansible-deploy-all_metal-ubuntu-xenial/72f8220/job-output.txt.gz#_2017-12-03_16_55_11_16248308:01
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_keystone master: [DNM] debug why on metal fails on gates and not on my machine.  https://review.openstack.org/52495408:05
*** mardim has joined #openstack-ansible08:08
*** epalper has joined #openstack-ansible08:11
*** gkadam_ has joined #openstack-ansible08:15
*** mbuil has joined #openstack-ansible08:17
*** sxc731 has joined #openstack-ansible08:21
*** pcaruana has joined #openstack-ansible08:23
openstackgerritPeriyasamy Palanisamy proposed openstack/openstack-ansible-specs master: blueprint spec for opendaylight bgpvpn support  https://review.openstack.org/52317108:27
hwoarangevrardjp: hello. What gate issues with lxc? What broke again?08:33
evrardjpoh no it's the usual download timeouts things08:41
evrardjphwoarang: but now that you're there, could you give this https://review.openstack.org/#/c/524961/ a nudge?08:42
evrardjpsame for this: https://review.openstack.org/#/c/515405/08:43
evrardjpboth would unblock gates08:43
hwoarangevrardjp: well what timeouts? :(08:44
hwoarangthe lxc downloads from images.linuxcountainers.org? or the cache preparation? because the cache preparation was due to mirror changes from pip_install to openstack_hosts that we fixed on friday08:44
evrardjpyes08:45
evrardjpthe images08:45
evrardjpbut that happens once in a while08:45
evrardjpthat's not really a problem, just a minor annoyance08:45
evrardjpI thought this could be a different way of thinking08:45
evrardjpstill require a pass, but not two.08:46
*** sboyron has joined #openstack-ansible08:46
evrardjpI think the more urgent is those 2 I gave you, because they are SURE blocking some of my patches :p08:46
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-openstack_hosts master: Run pip once and for all  https://review.openstack.org/52496208:47
hwoarangiirc we have some harcoded dns entiries for linuxcontainers.org08:48
hwoarangso we may be missing some server side load balancing :/08:48
evrardjpwell let me paste you a link when this comes again08:49
evrardjpalso fun stuff, I think the rabbitmq version bump kinda destroyed some things for suse.08:51
evrardjphttp://logs.openstack.org/66/524166/1/check/openstack-ansible-functional-opensuse-423/0cc191a/job-output.txt.gz#_2017-12-03_13_44_48_46025408:52
evrardjpbut right now the priority is to the other two.08:52
*** ThomasS has quit IRC08:56
*** vnogin has joined #openstack-ansible08:57
*** armaan has joined #openstack-ansible08:59
*** hamza21 has joined #openstack-ansible08:59
*** vnogin has quit IRC09:01
hwoaranghmm09:05
evrardjpodyssey4me: thanks for the reviews!09:07
evrardjpand good morning :)09:07
evrardjphwoarang: I will work on the rabbitmq issue for suse now09:08
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate master: Use group_names to check a host belongs to group  https://review.openstack.org/52327509:10
hwoaranglet me know if you need help09:11
evrardjpright now I will build my first opensuse on my machine :p09:11
*** pbandark has joined #openstack-ansible09:12
*** SerenaFeng has joined #openstack-ansible09:13
*** SerenaFeng has quit IRC09:15
hwoarangthe rabbitmq failure is strange because we install the package from the  distro repos09:16
hwoarangnot from upstream09:16
hwoaranglets see09:16
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Run ARA only if enabled  https://review.openstack.org/51221609:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Only build ARA report when test fails  https://review.openstack.org/51221709:18
evrardjpI thought that was previous, and we upgrade to something with packages09:19
evrardjpoh you mean the defaults09:19
evrardjplet me check09:19
*** sboyron has quit IRC09:21
*** vnogin has joined #openstack-ansible09:24
hwoarangyeah09:24
openstackgerritMerged openstack/openstack-ansible-plugins master: Follow symlinks in the lookup  https://review.openstack.org/52496109:25
*** sboyron has joined #openstack-ansible09:29
*** SmearedBeard has joined #openstack-ansible09:29
*** armaan has quit IRC09:31
*** rodolof has joined #openstack-ansible09:32
*** armaan has joined #openstack-ansible09:33
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests master: Fix gate overrides  https://review.openstack.org/52510809:36
evrardjphwoarang: ^09:36
hwoaranghmm09:37
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use one play for container creation  https://review.openstack.org/52510909:37
*** sboyron has quit IRC09:38
hwoarangevrardjp: it worked before so can you explain a situation where the result is bad?09:38
evrardjplet me rephrase that english thing09:38
hwoarangim curous09:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/pike: Follow symlinks in the lookup  https://review.openstack.org/52511109:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/ocata: Follow symlinks in the lookup  https://review.openstack.org/52511209:41
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/newton: Follow symlinks in the lookup  https://review.openstack.org/52511309:41
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests master: Fix SUSE gate overrides outside gates  https://review.openstack.org/52510809:43
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests master: Fix SUSE gate overrides outside gates  https://review.openstack.org/52510809:44
evrardjphwoarang: better english ^09:44
evrardjplike what odyssey4me could have said recently, that's less chewbacca-ey09:46
evrardjpI don't remember what he said, but it was very imaged.09:46
hwoarangah that's better09:46
evrardjphaha. Knew it!09:46
openstackgerritPeriyasamy Palanisamy proposed openstack/openstack-ansible-os_neutron master: add bgpvpn ml2 config support  https://review.openstack.org/52259809:47
evrardjpit all makes sense to me when I see the code in front of me, but I still have trouble to translate in english and project to other ppl minds. It's an effort :p09:47
hwoaranghahah09:48
evrardjphwoarang: what I have noticed is that the change started to appear between the 1 and 2 of december09:49
odyssey4meevrardjp you'll need to add something like https://review.openstack.org/#/c/515405/ to https://github.com/openstack/openstack-ansible-tests/blob/79e11d35d2749ef99616495cd11942ce8a43a5e6/test-install-openstack-hosts.yml09:49
evrardjp(for rabbitmq, not for my language skills)09:49
evrardjpodyssey4me: true, we are not reusing the integrated for all of this.09:50
evrardjpthanks!09:50
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/pike: Remove jinja2 delimiters from when clause  https://review.openstack.org/52511709:53
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests master: Prepare containers with openstack-hosts role  https://review.openstack.org/52511809:53
openstackgerritPeriyasamy Palanisamy proposed openstack/openstack-ansible-os_neutron master: add bgpvpn ml2 config support  https://review.openstack.org/52259809:56
*** Smeared_Beard has joined #openstack-ansible09:58
*** SmearedBeard has quit IRC09:59
odyssey4meevrardjp some feedback in https://review.openstack.org/52511810:00
evrardjpodyssey4me: do we need the serial 1?10:04
evrardjpin the Playbook for creating containers10:04
evrardjpif we do not, I remove it and it's faster when doing the openstack_hosts10:04
odyssey4mehttps://review.openstack.org/52159810:05
evrardjpmmm10:06
evrardjpmaybe we should still keep the 2 plays for now, and consolidate on this patch 521598?10:06
evrardjpthere doesn't seem to have consensus10:06
odyssey4mewhich is why you shouldn't mck with that piece10:07
odyssey4methe consensus is that we're happy to drop serial 1, but only if it's explained10:07
evrardjpok let me adapt my patch real quick10:07
odyssey4meright now it's just being dropped with no reference to the original reason it was put there10:07
odyssey4memost tests don't have that many containers, so series doesn't matter that much10:08
openstackgerritMerged openstack/openstack-ansible-plugins stable/ocata: Follow symlinks in the lookup  https://review.openstack.org/52511210:08
openstackgerritMerged openstack/openstack-ansible-plugins stable/newton: Follow symlinks in the lookup  https://review.openstack.org/52511310:08
odyssey4meserial: 1 I mean10:08
*** cuongnv has quit IRC10:10
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests master: Prepare containers with openstack-hosts role  https://review.openstack.org/52511810:10
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests master: Prepare containers with openstack-hosts role  https://review.openstack.org/52511810:10
*** vnogin has quit IRC10:10
evrardjpupdated.10:10
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests master: Prepare containers with openstack-hosts role  https://review.openstack.org/52511810:12
evrardjpgood catch!10:12
*** vnogin has joined #openstack-ansible10:12
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests master: Prepare containers with openstack-hosts role  https://review.openstack.org/52511810:13
evrardjphwoarang: https://review.openstack.org/#/c/525118/5 should be enough to make the rabbitmq work. I've tried an early patchset on my machine and it went further than rabbit.10:17
hwoaranghmm but why...10:18
evrardjpodyssey4me: I don't know if you've seen but we've finally bumped pike sha's. It seems the sweet spot is around 2h15.10:19
evrardjpof run time10:19
evrardjphwoarang: because this way we ensure we apply repo management to containers too?10:19
evrardjpI will have patches to improve the lxc_container_create and lxc_hosts10:19
evrardjphttps://review.openstack.org/#/c/524865/ is for uca file management, so we can use the uca file when copying data from hosts to containers10:20
hwoarangevrardjp: yeah but i mean i dont understand why that patch fixes rabbitmq10:20
evrardjpfor suse, I don't know what we do in the lxc_hosts copy steps I will have a look10:20
hwoarangfor suse10:20
evrardjphwoarang: probably because of the version available10:21
odyssey4mehwoarang it's because the pip_install role doesn't have the repo management any more10:21
odyssey4meevrardjp broke everything ;)10:21
hwoarangbut we don't use external repo for rabbitmq10:21
hwoarangwe use the one from the default repos so we don't care if external repos have been applied or not10:21
evrardjpwe use the openstack ones Pike right?10:21
hwoarangand default repos are always in the zuul images10:21
hwoaranghmm10:21
evrardjpI thought 42.3 was like very old rabbitmq10:22
hwoarangthat may makes sense. rabbitmq may be comming from the cloud repo10:22
hwoarang:/10:22
hwoarangok then i get it now10:22
evrardjp3.5.8 from 42.310:22
evrardjpyeah10:22
hwoaranggood point10:22
evrardjpbut yes I broke everything. I think it's for the best in the long run10:22
evrardjpbut it is quite a ride.10:23
evrardjp:)10:23
*** vnogin has quit IRC10:23
openstackgerritMerged openstack/openstack-ansible-plugins stable/pike: Follow symlinks in the lookup  https://review.openstack.org/52511110:23
evrardjpthe lookup merge is fast!10:23
*** ianychoi_ is now known as ianychoi10:24
*** electrofelix has joined #openstack-ansible10:24
*** vnogin has joined #openstack-ansible10:27
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-galera_client master: Remove pip_install dependency  https://review.openstack.org/52496310:29
*** zkynet has joined #openstack-ansible10:30
*** hamza21 has quit IRC10:32
evrardjpodyssey4me: I'd like your opinion on this: http://logs.openstack.org/24/504224/23/check/openstack-ansible-deploy-all_metal-ubuntu-xenial/094621a/job-output.txt.gz#_2017-12-04_09_08_11_59488410:33
evrardjpI thought of doing like what we do in rpc, replace aio1 with $(hostname) in all the /etc/openstack_deploy files.10:33
evrardjpjust a well placed sed.10:33
evrardjpwould you do that, or go for 1) a different templating in the bootstrap-host role, for the generation of the o_u_c and the conf.d/*10:34
evrardjp2) adapt the hosts file10:35
odyssey4mea simple sed should do that, and would cause less confusion10:35
evrardjpok.10:35
odyssey4metemplating out the files could be done later, if at all10:35
evrardjpI don't like the idea of touching this bash thingy for /etc/hosts.10:35
evrardjpthat's too big of a job.10:36
*** taseer1 has joined #openstack-ansible10:38
*** Taseer has quit IRC10:39
*** taseer2 has joined #openstack-ansible10:39
*** ThomasS has joined #openstack-ansible10:40
ThomasShi10:41
ThomasSdoes anyone know how to fix the object/object bug when uploading an image in horizon?10:41
ThomasScan it be fixed in pike with a configuration change?10:41
*** stuartgr has joined #openstack-ansible10:42
*** taseer1 has quit IRC10:43
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Build everything on metal  https://review.openstack.org/50422410:44
ThomasSit looks like i am hitting this bug10:44
ThomasShttps://bugs.launchpad.net/horizon/+bug/170370810:44
openstackLaunchpad bug 1703708 in OpenStack Dashboard (Horizon) "Horizon image upload with bad Glance CORS config fails with "[object Object]"" [High,Fix released] - Assigned to Pascal Boutin (pboutin)10:44
*** armaan has quit IRC10:45
*** rodolof has quit IRC10:45
ThomasSthis looks like it is presenting a better error message but not a solution for the wrong cors config :-)10:45
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_keystone master: [DNM] debug why on metal fails on gates and not on my machine.  https://review.openstack.org/52495410:46
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron master: Fix swift port conflict  https://review.openstack.org/52487410:49
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Change opendaylight default port  https://review.openstack.org/52487310:49
evrardjpmardim: mbuil could you re-review: https://review.openstack.org/#/c/524874/ ?10:50
*** vnogin has quit IRC10:50
*** armaan has joined #openstack-ansible10:54
*** armaan has quit IRC10:57
*** gun1x has left #openstack-ansible11:00
odyssey4meevrardjp FYI found the issue with the docs publishing: https://review.openstack.org/52515411:03
mardimevrardjp, I will after lunch :)11:04
*** armaan has joined #openstack-ansible11:06
*** vnogin has joined #openstack-ansible11:11
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_server master: Allow the upstream pypi mirror to be changed  https://review.openstack.org/52515511:12
*** taseer2 is now known as Taseer11:14
openstackgerritMerged openstack/openstack-ansible-specs master: Simplify repo management  https://review.openstack.org/52107811:20
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Remove old fact cleanup tasks  https://review.openstack.org/52348111:21
evrardjpodyssey4me: good catch.11:22
*** hamza21 has joined #openstack-ansible11:41
*** shardy has quit IRC11:44
*** ivveh has joined #openstack-ansible11:45
*** shardy has joined #openstack-ansible11:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Set the default pip index to use the pypi cache when possible  https://review.openstack.org/52280211:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Set the default pip index to use the pypi cache when possible  https://review.openstack.org/52280211:53
*** smatzek has joined #openstack-ansible11:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Set the default pip index to use the pypi cache when possible  https://review.openstack.org/52280212:02
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Set the default pip index to use the pypi cache when possible  https://review.openstack.org/52280212:04
*** savvas_ has quit IRC12:08
*** savvas has joined #openstack-ansible12:08
*** michelv has quit IRC12:11
*** hamza21 has quit IRC12:12
*** michelv has joined #openstack-ansible12:14
*** hamza21 has joined #openstack-ansible12:17
*** sxc731 has quit IRC12:17
openstackgerritMerged openstack/openstack-ansible-tests master: Prepare containers with openstack-hosts role  https://review.openstack.org/52511812:19
ThomasSdoes nobody know how to configure the cors corretly in OSA to fix the error on image upload in horizon?12:19
ThomasShttps://bugs.launchpad.net/horizon/+bug/170370812:19
openstackLaunchpad bug 1703708 in OpenStack Dashboard (Horizon) "Horizon image upload with bad Glance CORS config fails with "[object Object]"" [High,Fix released] - Assigned to Pascal Boutin (pboutin)12:19
*** armaan has quit IRC12:20
*** armaan has joined #openstack-ansible12:20
*** chhavi has quit IRC12:23
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Use Ansible 2.4  https://review.openstack.org/52277812:26
*** hamza21 has quit IRC12:31
*** zkynet has quit IRC12:31
*** vnogin has quit IRC12:32
*** vnogin has joined #openstack-ansible12:32
*** sep has joined #openstack-ansible12:33
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Force the uca filename  https://review.openstack.org/52486512:37
*** vnogin has quit IRC12:42
*** hw_wutianwei has quit IRC12:43
*** woodard_ has joined #openstack-ansible12:49
*** woodard has quit IRC12:49
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron master: Add OVS-NSH support for opensuse  https://review.openstack.org/52463512:51
*** Mr_Smurf has joined #openstack-ansible12:54
*** wspthr has quit IRC12:55
Mr_SmurfDo I have have to upgrade every version step when upgrading minor versions or can I just go the the latest in one jump?12:55
*** wspthr has joined #openstack-ansible12:57
*** vnogin has joined #openstack-ansible12:58
odyssey4meMr_Smurf you should be able to upgrade to the latest minor rev in one go12:58
*** sboyron has joined #openstack-ansible12:59
Mr_Smurfodyssey4me: I was trying to upgrade only one of the mgmt nodes first to see if stuff works but setup-infrastructure.yml on my repo container does not fetch everything i need13:00
odyssey4meMr_Smurf did you follow this process? https://docs.openstack.org/openstack-ansible/pike/user/minor-upgrade.html13:01
Mr_SmurfI'm upgrading newton from 14.0.7 to 14.2.12 (https://docs.openstack.org/openstack-ansible/newton/upgrade-guide/minor-upgrade.html)13:02
Mr_SmurfI get the empty directory /var/www/repo/os-releases/14.2.12 but it does not fetch anyting from git and I don't get anything new under /var/www/repo/venvs/13:03
odyssey4meMr_Smurf ok, did you do bootstrap-ansible after doing the new checkout? also, if you run repo-build.yml does it fail the build tasks, or skip them?13:05
Mr_SmurfI did repo build with --limit to one of the repo containers but I will try to run without limits13:07
*** sboyron has quit IRC13:07
odyssey4meMr_Smurf yeah, the repo build does not destroy any data so it's safe to do so - also it decides which repo container to do the build on so I don't think limit will work there13:08
odyssey4meif you used limit previously, then it's probably better to use repo-install.yml so that repo_server runs first13:08
Mr_Smurfok, I'll try that :)13:09
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use one play for container creation  https://review.openstack.org/52510913:10
*** vnogin has quit IRC13:10
Mr_SmurfIt seems to be doing stuff :)13:10
Mr_Smurfwell, it exploded in the end though... (item=need_wheel_build) => {"failed": true, "item": "need_wheel_build", "msg": "Destination file /etc/ansible/facts.d/openstack_ansible.fact not writable"}13:11
Mr_SmurfI do not have any /etc/ansible directory in the repo container so I can understand if it is not writeable13:11
odyssey4meMr_Smurf ah, you may need to run lxc-containers-create first to get that created13:13
Mr_Smurfso how much will explode when I run that?13:15
odyssey4meif you're concerned about it affecting other services, run with --limit lxc_hosts,repo_all13:15
odyssey4melxc_hosts is included just to get facts from them - no changes will be made there13:16
Mr_Smurfok, good :)13:16
Mr_SmurfI was planing to upgrade the services on one of the mgmt-nodes first to see that evertying is working13:18
openstackgerritMerged openstack/openstack-ansible-os_designate master: Fix ansible-lint test failures  https://review.openstack.org/52503113:18
*** zkynet has joined #openstack-ansible13:18
mhaydenmorning folks13:20
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-galera_client master: Remove pip_install dependency  https://review.openstack.org/52496313:22
openstackgerritMerged openstack/openstack-ansible-repo_server master: Allow the upstream pypi mirror to be changed  https://review.openstack.org/52515513:24
evrardjpThomasS: https://gist.github.com/evrardjp/5f1ae8d1afdf7b23d3224bc55388adab ?13:24
mgariepymorning13:28
*** armaan has quit IRC13:29
ThomasSlet me check13:29
*** armaan has joined #openstack-ansible13:30
ThomasSi will try this one thanks :-)13:31
*** armaan has quit IRC13:32
*** armaan has joined #openstack-ansible13:33
*** portante has quit IRC13:35
openstackgerritMerged openstack/openstack-ansible-os_designate master: Use group_names to check a host belongs to group  https://review.openstack.org/52327513:35
*** lihi has quit IRC13:35
*** oanson has quit IRC13:35
*** portante has joined #openstack-ansible13:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/pike: Gather more logs when running tests  https://review.openstack.org/52486313:37
ThomasS@evrardjp upload works now flawless, on completion it shows [object Object] again13:37
*** lihi has joined #openstack-ansible13:37
*** oanson has joined #openstack-ansible13:37
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate stable/pike: Fix ansible-lint test failures  https://review.openstack.org/52518013:40
ThomasSuploading a larger iso fails with same error. maybe only the first one worked because i used the small cirros image13:41
openstackgerritMerged openstack/openstack-ansible-os_glance stable/pike: Remove jinja2 delimiters from when  https://review.openstack.org/52486713:41
ThomasSno the object object error pops up immediately13:41
*** chhavi has joined #openstack-ansible13:43
*** woodard_ has quit IRC13:43
evrardjpmmm13:43
evrardjpI am no expert in all of that13:44
*** woodard has joined #openstack-ansible13:44
evrardjpI think this could be a different thing13:44
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/pike: Remove jinja2 delimiters from when clause  https://review.openstack.org/52511713:45
*** bhujay has quit IRC13:46
ThomasSok, but thanks for helping with that anyway13:47
evrardjpso it's helping for small uploads but not large uploads?13:47
ThomasSi guess everyone has this problem when deploying pike with OSA13:47
ThomasSi will try again13:47
evrardjpI don't know13:47
evrardjpI can try later.13:47
*** jamesdenton has joined #openstack-ansible13:48
odyssey4meThomasS are you using ceph or swift or file system for the glance back-end?13:48
ThomasSceph13:48
openstackgerritManuel Buil proposed openstack/openstack-ansible-os_neutron master: Provide support for SFC deployments  https://review.openstack.org/51090913:50
odyssey4meThomasS hmm, perhaps logan- will be online later and can confirm the issue or suggest changes of config13:51
odyssey4meI'v eonly ever hear dissues like that when using ceph and I suspect that there's a horizon config that needs changing, assuming you're experiencing this in horizon?13:51
*** michelv has quit IRC13:51
odyssey4meI wonder if this might not relate? https://review.openstack.org/#/c/516751/13:53
*** thorst has joined #openstack-ansible13:59
ThomasSyes it it only in horizon14:02
ThomasSworks from the utility container14:02
*** vnogin has joined #openstack-ansible14:02
*** hamza21 has joined #openstack-ansible14:03
ThomasSso it looks like the mentioned horizon bug14:04
ThomasShttps://bugs.launchpad.net/horizon/+bug/170370814:04
openstackLaunchpad bug 1703708 in OpenStack Dashboard (Horizon) "Horizon image upload with bad Glance CORS config fails with "[object Object]"" [High,Fix released] - Assigned to Pascal Boutin (pboutin)14:04
odyssey4meThomasS are the settings shown in the bug set in your horizon container?14:05
ThomasSno14:07
ThomasSi was using the defaults from OSA14:07
odyssey4meis there a cors section in your glance-api.conf?14:07
odyssey4metry adding https://review.openstack.org/#/c/516751/ to your horizon role and re-run the horizon playbook and see if it helps?14:08
ThomasSi added this  https://gist.github.com/evrardjp/5f1ae8d1afdf7b23d3224bc55388adab14:08
ThomasSand done a glance-config run14:08
*** mbuil has quit IRC14:09
odyssey4meoh ok, personally I've never seen how the cors stuff should work so I can't really advise there, but I do suspect that the patch I mentioned may help14:10
odyssey4meit would seem that glance itself is working fine, given that it works from the utility container14:10
ThomasSi kept the default14:11
ThomasShorizon_images_allow_location: False14:11
ThomasSyeah i guess it is really a horizon problem14:11
ThomasSsetting this to true will not help i guess14:12
odyssey4meah, I see that's the default and it seems you're right14:12
odyssey4meI'm out of ideas for now then - hopefully someone else can help a bit later when the US crew comes online.14:14
evrardjpyeah, maybe robcresswell can help too, I remember we discussed CORS in the past with him.14:15
logan-reading up.. horizon uploads to glance failing?14:16
logan-backing store shouldn't really matter on that. glance api interaction is the same either way. usually its a CORS issue14:16
logan-the best place to troubleshoot that is in the browser console14:17
logan-you'll probably see the browser blocking the upload request to the glance api due to it being on a different hostname/protocol/whatever than horizon14:18
logan-last time this came up i put up an example cors config: https://gist.github.com/Logan2211/32fa5fb0c6e0c2775b14ede5174d6c0714:18
logan-another option is setting horizon's glance upload mode to legacy14:18
evrardjplogan-: I think I pasted something based on your paste14:18
evrardjpI remember we had that conversation14:19
logan-we should improve docs around this issue14:19
evrardjpbut now I can't say why it would work on cirros vs a large image14:20
logan-yeah true14:20
evrardjpI agree, or have better defaults14:20
evrardjpI mean this could probably be wired in group vars14:20
logan-i'm not sure how you would do that14:20
logan-it is domain specific14:20
*** goldenfri has joined #openstack-ansible14:21
*** sxc731 has joined #openstack-ansible14:21
logan-suppose maybe you could have the wiring ready to consume openstack_cors_allowed_origin and leave openstack_cors_allowed_origin undefined14:22
evrardjplogan-: well if move the use of external_lb_vip_address to using external_lb_fqdn, we can then use14:22
evrardjpthat value to use it in14:22
evrardjpallowed_origin by default14:22
logan-it wouldn't help much for my use14:22
logan-my api endpoints are on api.region.cloud.domain.net and my horizon is on cloud.domain.net14:22
logan-the external_lb_vip_address isnt an issue14:23
logan-the same host is already allowed14:23
logan-the issue could arise from having IP based vip_address and access the horizon thru a domain name14:23
logan-(because horizon would use the IP based catalog endpoint to reach glance)14:23
evrardjpyeah I understand, a difference between horizon url and endpoint basically14:24
logan-right14:24
evrardjpthat's simple to fix too14:24
evrardjpwe can, while we run the horizon play, use that to compare with the service catalog14:24
ThomasSok14:24
ThomasSi will try your settings and do a horizon confifg14:25
ThomasSwill report back14:25
evrardjpthen if we have something different, enable CORS for this different thing14:25
evrardjpThomasS: we are talking about future state here :)14:25
logan-osa doesn't know about my alias14:25
jamesdentonWhat is the best method for defining a secondary group file - to perform tasks against groups that are aren't defined in the dynamic inventory? Is that possible?14:25
logan-depends what version of osa jamesdenton14:25
jamesdentonThis is.. 1414:25
evrardjpyeah and depends for what too :)14:25
evrardjpN14:26
evrardjpmmm14:26
evrardjpwhat do you want to achieve?14:26
evrardjpwhy not adding your own group?14:26
evrardjpinto the dynamic inventory?14:26
*** mbuil has joined #openstack-ansible14:26
jamesdentonBasically just want to perform a maintenance against all hosts, but in waves. So wave1 would include these 15 hosts, wave 2 another 15, etc14:26
evrardjplogan-: what do you mean by "doesn't know about my alias" ?14:26
evrardjpthe service catalog must still know the api endpoints, right?14:27
logan-evrardjp: the url used to access horizon is not configured in osa anywhere except for my cors configuration14:27
logan-horizon isn't an api endpoint14:27
evrardjpok so the external_lb_vip_address isn't what's used for horizon14:27
logan-providing a list of cors hosts is not something you can accurately detect14:27
logan-correct14:27
logan-it needs to be deployer provided14:27
evrardjpyeah in that case, that wouldn't work.14:27
evrardjpbut you know stuff :p14:28
evrardjpyou're now in pro-league14:28
logan-you would not need to configure cors for external_lb_vip_address if that is the address you access horizon on14:28
evrardjp(not Jupiler)14:28
logan-because horizon on external_lb_vip_address == glance on external_lb_vip_address14:28
*** sboyron has joined #openstack-ansible14:28
evrardjplogan-: exactly14:28
evrardjpso using it to see if there is a difference between endpoints seem fair.14:28
evrardjpBut when you think about use cases14:29
evrardjpmost ppl will probably use external_lb_vip_address for all the openstack bits including endpoints, and if they need to put horizon on a different domain, they would configure JUST horizon differently14:29
evrardjpso there is probably little to no value of that detection system.14:30
*** smatzek has quit IRC14:31
*** smatzek has joined #openstack-ansible14:31
evrardjpand I don't think doing a CORS on allowed_origin: * is a good default.14:31
logan-yeah14:31
evrardjpso yeah, docs is probably our best bet. When ThomasS will have figured out why the image upload fails in his case, we should probably start writing a use case document14:32
evrardjpin the docs14:32
evrardjpjamesdenton: I see, you could use serial for example14:34
Mr_Smurfshould the /etc/ansible/facts.d/openstack_ansible.fact file in the containers have more info than [lxc] variant = default in them?14:34
evrardjpif it's for compute nodes, you can probably configure different files in conf.d14:35
evrardjpto split in different things14:35
evrardjpit would still be the same group, but you can remove files before running, and restore after. Ugly but works.14:36
*** smatzek has quit IRC14:36
Mr_SmurfI get the error "msg": "'dict object' has no attribute 'ansible_processor_vcpus'" but ansible_processor_vcpus exists in the file for the container in /etc/openstack_deploy/ansible_facts/14:36
logan-yeah would be good to get some bugs opened when this comes up with a dump of catalog, browser console error, and url horizon url14:36
logan-horizon url*14:36
jamesdentonthank you, evrardjp. I will check that out!14:36
evrardjpMr_Smurf: /etc/ansible/facts.d/openstack_ansible.fact are what's named "local facts", there are facts that are computed on the remote node.14:37
evrardjp /etc/openstack_deploy/ansible_facts/ are on the deploy node14:37
evrardjpwhat's missing in your case is a gather_facts: True in a playbook14:37
evrardjpjamesdenton: backup everything beforehand14:38
evrardjp:)14:38
evrardjpbecause messing with the inventory is NEVER good :p14:38
evrardjpbut IIRC, that's what cloudnull was doing in OSIC14:38
jamesdentonYeah for now I will stick to a long --limit string, but i will look into something else in the future14:38
evrardjplogan-: duely noted. Will remember to ask that.14:38
evrardjpjamesdenton: in ansible 2.4 that will be SUPER easy.14:39
evrardjpI can promise you that.14:39
evrardjpBut it won't be backported.14:39
jamesdentonno worries. Everyone will just upgrade to the latest release.14:44
jamesdenton:D14:44
evrardjp:)14:45
evrardjpnever heard that before.14:45
evrardjp:D14:45
*** sboyron has quit IRC14:46
*** thorst has quit IRC14:46
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Remove keystone_token_driver variable  https://review.openstack.org/52349514:47
openstackgerritMerged openstack/openstack-ansible master: Adapt to openstack_hosts/pip_install changes  https://review.openstack.org/51540514:48
*** thorst has joined #openstack-ansible14:48
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Reduce console output in gate jobs  https://review.openstack.org/52472114:49
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Avoid using 'roles' reserved variable  https://review.openstack.org/52466014:50
*** sboyron has joined #openstack-ansible14:51
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_swift stable/pike: Remove sleep option from service handlers  https://review.openstack.org/52522114:51
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_swift stable/ocata: Remove sleep option from service handlers  https://review.openstack.org/52522214:52
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_swift stable/pike: Remove jinja2 delimiters from when  https://review.openstack.org/52522314:52
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron stable/pike: Remove send_arp_for_ha option  https://review.openstack.org/52522414:52
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_horizon stable/pike: Remove enable_{firewall,vpn} options  https://review.openstack.org/52522514:52
*** bhujay has joined #openstack-ansible14:53
*** gouthamr has joined #openstack-ansible14:53
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Use Ansible 2.4  https://review.openstack.org/52277814:54
*** vnogin has quit IRC14:56
* mhayden is getting his backport on14:56
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_keystone stable/pike: Remove keystone_token_driver variable  https://review.openstack.org/52522714:57
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Fix crontab errors on CentOS/SUSE  https://review.openstack.org/52068214:57
*** rgogunskiy has quit IRC14:57
*** esberglu has joined #openstack-ansible14:58
mhaydencloudnull / evrardjp: if y'all get a moment for this quick one -> https://review.openstack.org/52394114:58
*** weezS has joined #openstack-ansible14:58
*** smatzek has joined #openstack-ansible14:59
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Build everything on metal  https://review.openstack.org/50422415:00
evrardjpmhayden: sure15:01
evrardjpI am stuck anyway, can't figure out things rn.15:01
evrardjpmhayden: do you know you're on schedule?15:02
*** indistylo has quit IRC15:02
evrardjpthis week it's the deprecatations week.15:02
evrardjp:)15:02
mhaydenooh fancy15:02
* mhayden didn't know he was on schedule15:02
*** vnogin has joined #openstack-ansible15:03
*** sboyron has quit IRC15:03
*** thorst has quit IRC15:03
*** woodard has quit IRC15:04
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Remove the curly braces in when  https://review.openstack.org/52486615:06
evrardjpyeah this week we should go over projects and see what's deprecated, and adopt our templates15:07
evrardjpso I planned to check all the pike deprecations this week15:08
evrardjpmhayden: https://etherpad.openstack.org/p/osa-queens-m2-deprecations15:11
*** phalmos has joined #openstack-ansible15:12
*** bhujay has quit IRC15:13
*** bhujay has joined #openstack-ansible15:19
cloudnullmornings15:20
evrardjpmoring cloudnull !15:21
hwoaranggood morning!15:21
mhaydenevrardjp: woot15:22
ThomasShi15:22
mhaydenohai ThomasS15:22
ThomasSso i done this config https://gist.github.com/Logan2211/32fa5fb0c6e0c2775b14ede5174d6c0715:22
evrardjpyup?15:22
ThomasSand also done horizon-config15:22
*** phalmos has quit IRC15:22
ThomasSfiest upload works again with any image size and shows object/object after completion15:23
ThomasSnext upload does not work :-(15:23
cloudnullhows it on this fine day ?15:23
*** thorst has joined #openstack-ansible15:24
*** hamza21 has quit IRC15:24
*** sxc731 has quit IRC15:26
*** esberglu_ has joined #openstack-ansible15:27
*** thorst has quit IRC15:29
*** esberglu has quit IRC15:29
*** vnogin has quit IRC15:34
*** vnogin has joined #openstack-ansible15:40
*** hw_wutianwei has joined #openstack-ansible15:41
*** phalmos has joined #openstack-ansible15:43
openstackgerritMerged openstack/openstack-ansible-plugins master: Add basic plugin support for nspawn type containers  https://review.openstack.org/49068915:44
*** sboyron has joined #openstack-ansible15:51
openstackgerritMerged openstack/openstack-ansible-tests master: Fix SUSE gate overrides outside gates  https://review.openstack.org/52510815:51
*** sxc731 has joined #openstack-ansible15:52
*** jvidal has quit IRC15:53
*** esberglu_ has quit IRC15:56
*** esberglu has joined #openstack-ansible15:56
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Add OVS-NSH support for opensuse  https://review.openstack.org/52463516:00
*** michelv has joined #openstack-ansible16:02
*** armaan has quit IRC16:02
Adri2000hi16:03
*** armaan has joined #openstack-ansible16:03
Adri2000I'm a bit concerned about https://git.openstack.org/cgit/openstack/openstack-ansible-lxc_container_create/commit/?h=stable/pike&id=05b84528d100ab73b91e119dd379a8ed0726db7d16:03
Adri2000just deployed this on a prod environment with a 3-node galera16:04
Adri2000and some of the changes triggered a restart of *all* the lxc containers, including the galera ones, at the same time16:04
Adri2000galera doesn't like it ...16:04
evrardjpWOW.16:06
evrardjpI didn't see it16:06
evrardjpoh yeah I was on holiday.16:06
*** zkynet has quit IRC16:07
evrardjpI see what it was done there.16:07
evrardjpcloudnull: spotz mhayden ^ check at this. This is not good.16:08
*** armaan has quit IRC16:09
evrardjpI bumped the role, as I usually do, so I am also responsible.16:09
evrardjpWhat should we do to detect this16:10
mgariepythat would be really nice to be able to detect this.16:12
mgariepycan we add a reno notes at least to warn users that it can happen ?16:13
odyssey4mewell, is this in a released version - or is it at the head?16:13
evrardjpit probably is.16:13
odyssey4meif at the head, then we have detected it ;)16:13
evrardjpit is already tagged I think16:13
evrardjplet me double check16:13
openstackgerritMerged openstack/openstack-ansible-tests stable/pike: Disable offloading in test by default  https://review.openstack.org/52486016:15
*** hw_wutianwei has quit IRC16:15
evrardjpit is not tagged!16:15
*** sboyron has quit IRC16:15
evrardjpAnyway, we should still be careful.16:15
evrardjpit's stable...16:16
evrardjpI mean stable is in the title.16:16
odyssey4meI'll bet the change to add create=dir was the cause: https://github.com/openstack/openstack-ansible-lxc_container_create/blob/master/tasks/lxc_container_config.yml#L4416:17
Adri2000odyssey4me: this, and the task "Write default container config" as well I think16:18
Adri2000possibly16:18
Adri2000because it is changed in that commit, and it has a notify to restart containers16:19
evrardjpodyssey4me: I am doubting of the need of the backport, tbh. This looks more like a feature than a bug.16:19
odyssey4methis may have something to do with the same issue: https://review.openstack.org/#/c/524735/116:21
openstackgerritMerged openstack/openstack-ansible-os_designate stable/pike: Fix ansible-lint test failures  https://review.openstack.org/52518016:22
*** vnogin has quit IRC16:23
odyssey4mewe can implement the thing to prevent the restart from happening on a new environment, so it'll prevent that until the next major upgrade16:23
mgariepywould it be possible to have the galera and rabbitmq cluster to restart container only 1 at the time and wait for the cluster et be back to a healthy state before doing the next one ?16:24
odyssey4memgariepy right now this is happening in lxc-containers-create, which touches all containers at once16:24
odyssey4mewe either need to allow the restart not to happen, then make it happen later in serial - or we need to switch to a JIT container-create execution which only runs against the container in the playbook that runs in serial anyway16:25
evrardjpI am fine with that, but this is code that can break, I was more thinking of something that wouldn't pass gates if we are changing too many things.16:26
evrardjpI don't know how we can do that16:26
mgariepyserial restart would be nice but also restarting like neutron agent container can do some damage.16:27
evrardjpthe only thing I see is the container uptime, which we won't be able to use in our gates16:27
evrardjpyeah and things like that.16:27
evrardjpwe should maybe have minor update testing in periodics that shows downtime?16:28
spotzI like odyssey4me's idea16:28
odyssey4mewell, unfortunately the JIT thing cannot and should not be backported - it's a big change16:28
evrardjpyeah16:28
*** thorst has joined #openstack-ansible16:28
evrardjpminor update testing something we can do. From tag x to head of branch.16:28
evrardjpif we see downtime, we can use that before tagging next release.16:29
odyssey4mesure16:29
evrardjpwe still release every 2 weeks, so it's good enough for deployers I guess?16:29
evrardjpit's a lot of work though16:29
evrardjpbut I think it could be a good thing16:30
evrardjpwhat do you think odyssey4me ?16:30
odyssey4mesure, if people are actually going to watch it16:31
evrardjpI am supposed to watch periodic logs every day, but I admit, I do that every 2 days. we have so many things pending right now...16:32
odyssey4mefor now better to try to resolve this issue before the next release16:33
*** thorst has quit IRC16:33
evrardjpAnd that would catch issues like the one Adri2000 just mentioned. In any case, without Adri2000 we wouldn't have known for this.16:33
evrardjpperiodics or not.16:33
evrardjpagreed odyssey4me .16:33
*** Cronix has joined #openstack-ansible16:35
evrardjpany idea there?16:36
mgariepycan we have a special test for commits that are tagging release ?16:36
evrardjpto solve the issue? Backporting the patch you pasted odyssey4me ?16:36
evrardjpmgariepy: we could technically, but these would be long tests.16:36
evrardjpSo I am sure these are best left as periodics.16:37
mgariepyhow long does it take ? 2h ?16:37
evrardjpif you have to deploy version x and do a minor update to latest, I suspect more than that.16:37
mgariepyhave it run automatically when you bump release would be better IMO.16:38
evrardjpprobably max 4h.16:38
mgariepywow. that's long.16:38
odyssey4meoh bugger - there's a regression in there too16:38
evrardjpodyssey4me: in there?16:38
odyssey4melemme push up some patches16:38
evrardjpshould we revert?16:38
evrardjpyou are all scaring me now.16:39
odyssey4meno, it adds more value than the pain it creates - and I think the other backends are being used already by some16:39
openstackgerritManuel Buil proposed openstack/openstack-ansible-os_neutron master: Provide support for SFC deployments  https://review.openstack.org/51090916:39
savvashey guys, any support for Murano in the pipeline? Or recommended deployment for use with OpenStack Ansible?16:40
*** bhujay has quit IRC16:40
*** chyka has joined #openstack-ansible16:41
evrardjpsavvas: murano isn't in the pipeline. I heard people interested by it, but I haven't seen commits.16:41
odyssey4meis the murano project still alive?16:41
openstackgerritManuel Buil proposed openstack/openstack-ansible-os_neutron master: Provide support for SFC deployments  https://review.openstack.org/51090916:42
savvasit caught my interest when watching this https://www.youtube.com/watch?time_continue=1680&v=Su4X2w-X-IE16:43
evrardjpodyssey4me: I don't think murano is still alive.16:44
savvasmm16:46
odyssey4meoh, never mind - turns out the regression I thought I spotted is not there16:47
evrardjpthat's the good news.16:47
evrardjpdon't tell me there is a bad news that go with it.16:47
evrardjp:)16:47
odyssey4mewell, I suspect that https://github.com/openstack/openstack-ansible-lxc_container_create/commit/c82c7a60e9df2931ab0b456deb26b615d9ccd4e6 is the cause of the restarts - but that patch is actually good to have... we just did not cater for preventing the restart16:48
savvashttps://docs.openstack.org/murano/latest/ does seem to be maintained still16:48
openstackgerritMerged openstack/openstack-ansible-os_swift stable/pike: Remove jinja2 delimiters from when  https://review.openstack.org/52522316:48
odyssey4mewell, as it turns out we already have a var preventing the restart in the role: https://github.com/openstack/openstack-ansible-lxc_container_create/blob/master/handlers/main.yml#L3416:55
*** woodard has joined #openstack-ansible16:56
*** esberglu has quit IRC16:56
*** esberglu has joined #openstack-ansible16:58
*** thorst has joined #openstack-ansible17:02
*** woodard has quit IRC17:08
*** woodard has joined #openstack-ansible17:08
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install master: Add find-links, even when not being locked down  https://review.openstack.org/52525717:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Set the default pip index to use the pypi cache when possible  https://review.openstack.org/52280217:11
openstackgerritMerged openstack/openstack-ansible-os_keystone stable/pike: Remove keystone_token_driver variable  https://review.openstack.org/52522717:12
openstackgerritMerged openstack/openstack-ansible-tests stable/pike: Gather more logs when running tests  https://review.openstack.org/52486317:13
openstackgerritMerged openstack/openstack-ansible-os_swift stable/ocata: Remove sleep option from service handlers  https://review.openstack.org/52522217:14
*** udesale has quit IRC17:17
*** chyka has quit IRC17:20
*** chyka has joined #openstack-ansible17:21
odyssey4meAdri2000 can you give us your source version and current version from that minor upgrade?17:23
*** michelv has quit IRC17:27
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Change deprecated nova_metadata_ip option  https://review.openstack.org/52394117:32
*** SerenaFeng has joined #openstack-ansible17:37
*** SerenaFeng has quit IRC17:37
*** galstrom_zzz is now known as galstrom17:38
*** galstrom is now known as galstrom_zzz17:38
*** gkadam_ has quit IRC17:38
openstackgerritManuel Buil proposed openstack/openstack-ansible master: Add networking-sfc repo to repo_packages  https://review.openstack.org/52526417:39
*** thorst_ has joined #openstack-ansible17:41
*** thorst has quit IRC17:44
*** mbuil has quit IRC17:45
*** thorst_ has quit IRC17:51
mhaydenis it possible to specify an extra pip wheel to be built with repo_build?17:57
* mhayden hunts17:57
*** indistylo has joined #openstack-ansible17:58
stuartgris there a way to assign compute nodes into nova availability zones during deployment, or does it have to be done after the deployment is complete?17:58
*** epalper has quit IRC17:59
*** wspthr has quit IRC18:01
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Fix swift port conflict  https://review.openstack.org/52487418:01
*** thorst has joined #openstack-ansible18:02
*** wspthr has joined #openstack-ansible18:04
*** chhavi has quit IRC18:05
*** thorst has quit IRC18:07
*** Cronix has quit IRC18:08
*** cshen_ has joined #openstack-ansible18:12
*** thorst has joined #openstack-ansible18:15
ArchiFleKsodyssey4me: it was from 16.0.4 to head of stable/pike, I have to admit we are not using tags but the stable/pike, but we will switch to tags from now on18:18
*** jwitko_ has joined #openstack-ansible18:20
*** thorst has quit IRC18:20
ArchiFleKsevrardjp: I think it is possible to prevent at least galera or some container group (like neutron) to restart even when the handler is called, with the lxc_container_allow_restarts var. If we use the group_var / host_var mecanism in /etc/openstack_deploy that you pushed a while ago. Right ?18:21
*** cshen_ has quit IRC18:22
*** thorst has joined #openstack-ansible18:24
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron master: Ensure LBaaSv2 deployment is tested  https://review.openstack.org/52527218:35
*** RandomTech has joined #openstack-ansible18:35
*** hamza21 has joined #openstack-ansible18:36
*** thorst has quit IRC18:38
mhaydenfedora's COPR is down18:40
mhaydenso that will break CentOS 7's LXC pkgs for a bit :/18:40
*** sxc731 has quit IRC18:40
*** thorst has joined #openstack-ansible18:41
*** thorst has quit IRC18:43
* mhayden needs to figure out if we can get that mirrored :/18:43
mgariepymhayden, do you know why it's down that often ?18:43
mhaydeni have no idea18:43
mhaydenbah https://status.fedoraproject.org/18:45
* mhayden will look around in infra land to see if we can mirror it18:45
evrardjpmhayden: could you submit a patch to move the jobs to -nv temporarily?18:45
mhaydenDuring the week of 2017-12-04 - 2017-12-08, all Fedora Infrastructure servers get moved18:46
mhaydenhttps://status.fedoraproject.org/q4maint.html18:46
mhaydenEGADS18:46
*** gkadam_ has joined #openstack-ansible18:47
RandomTechhey anyone here familar with rabbitmq?18:52
RandomTechwe are having rabbit mq error out/fail during our setup18:52
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_glance master: Fix systemd init template for program override  https://review.openstack.org/52477818:59
*** weezS has quit IRC19:04
*** stuartgr has quit IRC19:04
*** juliovp01 has joined #openstack-ansible19:06
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_glance master: Fix systemd init template for program override  https://review.openstack.org/52477819:07
*** weezS has joined #openstack-ansible19:08
*** gouthamr has quit IRC19:20
*** vnogin has joined #openstack-ansible19:24
*** savvas_ has joined #openstack-ansible19:26
*** savvas_ has quit IRC19:27
*** vnogin has quit IRC19:28
*** savvas_ has joined #openstack-ansible19:28
RandomTechmhayden: you availible a second. im having a probem with my setup19:28
*** sxc731 has joined #openstack-ansible19:36
*** gouthamr has joined #openstack-ansible19:37
mhaydenRandomTech: just got back from eating -- what's the issue?19:39
mhaydenalso, which branch/tag are you deploying?19:39
RandomTechwe used '# git clone -b 16.0.1 https://git.openstack.org/openstack/openstack-ansible \   /opt/openstack-ansible' for the pull as per the documention here: https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/deploymenthost.html19:41
RandomTechone second while i get the error messages compiled in a paste19:41
Adri2000odyssey4me: yeah as ArchiFleKs said, so went openstack-ansible 27fa064a0eb2c2b17c361e176abe06375f8dc55f (16.0.4) to 16c69046bfd90d1b984de43bc6267fece6b75f1c (head)19:41
*** juliovp0_ has joined #openstack-ansible19:41
*** thorst has joined #openstack-ansible19:42
Adri2000btw, regarding the lxc_container_allow_restarts mechanism I noticed it's used in scripts/run-upgrade.sh. so at least it means a major upgrade wouldn't be hit by this issue19:42
*** sxc731 has quit IRC19:43
*** juliovp0_ has quit IRC19:43
*** juliovp0_ has joined #openstack-ansible19:44
RandomTechmhayden: here it is: http://paste.openstack.org/show/628118/19:44
*** chyka_ has joined #openstack-ansible19:44
RandomTechwe tried rerunning it and i split up the error messages accordingly19:44
*** gouthamr has quit IRC19:45
*** juliovp01 has quit IRC19:45
*** dave-mccowan has joined #openstack-ansible19:45
*** cshen_ has joined #openstack-ansible19:46
mhaydenhmm, looks like the cluster somehow got interrupted19:46
mhaydenis only one of the nodes misbehaving?19:46
RandomTechit didnt get to the point in which it could try to join the others from what i could tell19:47
*** chyka has quit IRC19:47
RandomTechwe can send you a full run log if it would help but it would take a moment to grab19:47
RandomTechthe palybook decided to stop after the errors listed there instead of completing19:48
mgariepycloudnull, are you around ?19:48
*** chyka_ has quit IRC19:49
mhaydenRandomTech: well, one option is to go into your third node there and stop rabbitmq completely and restart it19:49
RandomTechokay it does seem that it may be only that container19:49
mhaydenjust to see if something needs to get cleared19:49
mhaydenwhen it's gotten really out of hand before, i've thrown out the container and rebuilt it19:50
RandomTechso doing the teardown and rerunning setup-infrastructure?19:50
*** thorst has quit IRC19:51
*** chyka has joined #openstack-ansible19:54
mhaydenyou could tear down that third rabbitmq container, then rerun lxc-container-create.yml, then rerun the rabbitmq playbook19:58
mhaydenbut i wonder if you can just run start_app inside that container and make it happy19:58
*** chyka has quit IRC19:59
*** hybridpollo has joined #openstack-ansible20:01
*** hamza21 has quit IRC20:01
*** savvas_ has quit IRC20:02
*** armaan has joined #openstack-ansible20:03
*** thorst has joined #openstack-ansible20:04
mhaydenugh, python-ldap wants pyasn1-modules>0.1.5 but upper constraints limits to 0.1.020:05
mhaydenin pike20:05
* mhayden digs20:05
*** cshen_ has quit IRC20:06
*** hybridpollo has quit IRC20:09
*** indistylo has quit IRC20:12
*** hybridpollo has joined #openstack-ansible20:14
RandomTechmhayden: is the version the documentation says to clone outdated. i noticed it doesnt match up with  the version the documentation is named after20:18
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_keystone master: Add pyldap to Keystone packages  https://review.openstack.org/52529720:20
*** cshen_ has joined #openstack-ansible20:21
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_keystone stable/pike: Remove python-ldap and add pyldap  https://review.openstack.org/52529920:22
mhaydenRandomTech: not sure what you're asking20:22
*** juliovp0_ has quit IRC20:22
*** juliovp01 has joined #openstack-ansible20:23
RandomTechif you go to: "https://docs.openstack.org/openstack-ansible-haproxy_server/pike/" its labeled 16.0.2 but it has you run a command to clone 16.0.120:23
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_keystone stable/pike: Remove python-ldap and add pyldap  https://review.openstack.org/52529920:23
mhaydenthe 16.0.2 docs should be very close20:23
*** juliovp0_ has joined #openstack-ansible20:25
*** juliovp0_ has quit IRC20:25
*** juliovp01 has quit IRC20:27
*** cshen_ has quit IRC20:34
*** armaan has quit IRC20:34
*** cshen_ has joined #openstack-ansible20:34
*** gouthamr has joined #openstack-ansible20:36
*** vnogin has joined #openstack-ansible20:38
*** savvas_ has joined #openstack-ansible20:38
RandomTechya, mhayden i just wasnt sure if that page needed updating20:42
*** armaan has joined #openstack-ansible20:45
*** vnogin has quit IRC20:50
*** gkadam_ has quit IRC20:51
*** thorst has quit IRC20:56
*** chyka has joined #openstack-ansible21:02
*** thorst has joined #openstack-ansible21:02
*** chyka has quit IRC21:02
*** armaan has quit IRC21:04
*** savvas_ has quit IRC21:05
*** chyka has joined #openstack-ansible21:05
*** shardy has quit IRC21:05
*** thorst has quit IRC21:07
*** cshen_ has quit IRC21:08
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron master: Ensure LBaaSv2 deployment is tested  https://review.openstack.org/52527221:08
*** woodard has quit IRC21:13
*** thorst has joined #openstack-ansible21:17
*** vnogin has joined #openstack-ansible21:19
*** thorst has quit IRC21:20
*** thorst has joined #openstack-ansible21:21
*** smatzek has quit IRC21:23
*** cshen_ has joined #openstack-ansible21:26
*** vnogin has quit IRC21:29
*** vnogin has joined #openstack-ansible21:32
*** thorst has quit IRC21:36
*** pcaruana has quit IRC21:39
*** cshen_ has quit IRC21:44
*** cmart has joined #openstack-ansible21:45
*** SerenaFeng has joined #openstack-ansible21:45
*** SerenaFeng has quit IRC21:46
*** SerenaFeng has joined #openstack-ansible21:47
*** vnogin has quit IRC21:48
*** cshen_ has joined #openstack-ansible21:50
*** thorst has joined #openstack-ansible21:50
*** thorst has quit IRC21:54
*** vnogin has joined #openstack-ansible21:56
*** cshen_ has quit IRC21:58
*** gouthamr has quit IRC22:04
*** RandomTech has quit IRC22:06
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron stable/pike: Change deprecated nova_metadata_ip option  https://review.openstack.org/52533322:07
*** thorst has joined #openstack-ansible22:10
*** thorst has quit IRC22:14
cmartHi folks -- my dynamic inventory script is generating inventory with ansible_host of "null" for all the containers. This is causing a template in the HAProxy role to fail. Anyone else run into this recently?22:18
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_glance master: Fix systemd init template for program override  https://review.openstack.org/52477822:19
*** phalmos has quit IRC22:22
*** pmannidi has joined #openstack-ansible22:43
openstackgerritFrank Zhang proposed openstack/openstack-ansible-ops master: User marker to skip completed plays  https://review.openstack.org/52533922:44
openstackgerritFrank Zhang proposed openstack/openstack-ansible-ops master: Use marker to skip completed plays  https://review.openstack.org/52533922:45
*** thorst has joined #openstack-ansible22:53
*** weezS has quit IRC22:56
*** thorst has quit IRC22:58
*** savvas has quit IRC23:03
*** gouthamr has joined #openstack-ansible23:08
*** jose-phillips has joined #openstack-ansible23:18
jose-phillipsHi23:18
jose-phillipsone question23:18
jose-phillipsif i use openstack-ansbile23:18
jose-phillipsim able to modify some configurations by hand23:18
jose-phillips?23:18
*** esberglu has quit IRC23:18
*** esberglu has joined #openstack-ansible23:19
*** esberglu has quit IRC23:23
cmartjose-phillips, the short answer is yes you can, but which configurations are you talking about?23:24
jose-phillipscinder.conf23:24
jose-phillipsim using juju but juju when i perform some changes to cinder.conf inside of a container23:24
jose-phillipsafter reboot the confiuration lost23:24
jose-phillipsthe question is if i switch to openstack-ansible i will able to modify cinder.conf23:24
jose-phillipsand the changes will be persistent23:25
cmartYes, persistent until the next time you run OSA and the config is re-generated23:25
cmartwhat changes do you want to make to cinder.conf?23:25
jose-phillipsi need to add a new section called [NetApp]23:25
jose-phillipsand the netapp storage filler settings23:26
jose-phillipsalso change enable_backends = NetApp23:26
jose-phillipson default section23:26
cmartI don't use it, but a quick search that OSA claims to support NetApp backend for Cinder: https://docs.openstack.org/openstack-ansible-os_cinder/latest/configure-cinder.html#configuring-cinder-to-use-a-netapp-appliance23:26
cmartso if that ends up working for your needs, then you won't need to edit cinder.conf by hand at all :)23:27
jose-phillips:)23:27
jose-phillipsgreat23:27
jose-phillipsanother question23:27
jose-phillipsim new on OSA23:27
jose-phillipsi never used before23:27
jose-phillipsis possible with osa install openstack without ceph and swift23:28
cmartit's preferable to just have OSA deploy whatever config you want. but you can certainly modify cinder.conf afterward, and that'll persist until it's overwritten by another OSA deployment.23:28
jose-phillipsthat i really dont need it23:28
cmartyes. I have a production cluster running right now without either Ceph or Swift. they are optional.23:28
jose-phillipsCool23:28
jose-phillipswell time to left behind fuel and juju23:28
jose-phillips:)23:28
jose-phillipswhat about here23:29
jose-phillipsis easy?23:29
cmartI don't understand23:30
cmartyour question23:30
jose-phillipssorry i forgot the question lol23:30
jose-phillipshahah23:30
jose-phillipsi mean23:30
jose-phillipsis easy here upgrade openstack23:30
jose-phillipswith osa?23:30
jose-phillipsright now on my fuel deployment im complety stuck with mitaka23:30
jose-phillipsand juju it's imposible configure netapp23:30
cmartyes. It's straightforward to upgrade an OSA-deployed cluster to the next version of OpenStack. Done it more than once (albeit only in test environments!)23:31
*** esberglu has joined #openstack-ansible23:31
cmartI think that's a design goal of the project, to always provide an upgrade path.23:31
cmart(obviously you need to have an existing cluster already deployed with OpenStack-Ansible for the upgrade to be smooth)23:32
jose-phillipslol23:32
jose-phillipsi know23:32
jose-phillipswell i guess is time to trying it23:32
jose-phillipsbtw who support really ansible?23:32
cmartenjoy. OSA is kind of a beast, but so much nicer than the alternatives, I think23:33
jose-phillipsfor example fuel is supported by Mirantis23:33
jose-phillipsjuju by cannocial23:33
cmartAnsible was acquired by Red Hat a few years ago23:33
*** thorst has joined #openstack-ansible23:33
*** thorst has quit IRC23:33
jose-phillipsanother question ansible can be added to MAAS to control the physical hardware?23:34
cmart(and OpenStack-Ansible originated with Rackspace, I think most of the core contributors work there. Rackspace uses OSA to support their private cloud offering)23:34
cmartjose-phillips I deploy my OpenStack hosts with MaaS, so I think the answer is "yes"23:34
jose-phillipsand ansible?23:35
cmartoh wait, now I'm not sure what you're asking23:35
jose-phillipsjuju integrates with maas to control the hardware23:35
jose-phillipsansible is able to control the hardware thru MAAS api?23:35
cmartah I see. OSA has no particular integration with MaaS that I'm aware of. I use MaaS to deploy my hosts, but I do it "by hand"23:36
jose-phillipscool23:36
jose-phillipsi guess i will try it23:36
jose-phillipsalso ansible perform containers right23:36
jose-phillips?23:36
cmartthe trickiest thing is probably setting up the network requirements on your hosts (interfaces and bonds).. once you figure that out the rest is smoother23:36
cmartif by "Ansible perform containers" you mean that OSA uses Ansible to deploy OpenStack services inside containers, then the answer is yes23:37
jose-phillipscool23:38
jose-phillipswell im destroying my juju environment to start over again23:38
*** smatzek has joined #openstack-ansible23:38
*** esberglu has quit IRC23:39
jose-phillipsi already have configured the network with maas but i guess i have to perform the bridges inside of each node23:39
*** smatzek has quit IRC23:43
*** thorst has joined #openstack-ansible23:45
cmartyes, it's not too bad. Here we made this https://github.com/cyverse/openstack-ansible-host-prep to make the process easier, some of it's a little old but I'm still using it now to build a Pike cloud23:47
*** woodard has joined #openstack-ansible23:47
cmartprob best to just follow the OSA docs :)23:48
*** thorst has quit IRC23:49
*** thorst has joined #openstack-ansible23:51
*** thorst has quit IRC23:55
*** woodard has quit IRC23:56
*** gouthamr has quit IRC23:56
*** gouthamr has joined #openstack-ansible23:58
*** cmart has quit IRC23:58
*** ianychoi has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!