Friday, 2017-08-18

EmilienMowalsh: if you want to actually test ssh access in CI, please change commit message in https://review.openstack.org/494284 and add Depends-On on the patches you're working on00:01
EmilienMthanks! ttyl00:01
*** rhallisey has quit IRC00:02
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Restore and split nova metadata api docker service out of nova-api.  https://review.openstack.org/49472700:04
*** achadha has joined #tripleo00:09
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295500:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067800:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171126200:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142500:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)00:10
openstackLaunchpad bug 1711262 in tripleo "tripleo job are overwriting nameserver with 8.8.8.8" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)00:10
openstackLaunchpad bug 1711425 in tripleo "Impossible to ssh a VM when TripleO is containerized" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)00:10
*** achadha has quit IRC00:13
openstackgerritOliver Walsh proposed openstack/tripleo-common master: Add NovaMetadata to nova-api image params  https://review.openstack.org/49475000:14
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Restore and split nova metadata docker service out of nova-api.  https://review.openstack.org/49472700:15
fultonjmirror erros on https://review.openstack.org/#/c/479288 . thanks for rechecking EmilienM00:15
pradkEmilienM, yes i am, http://paste.openstack.org/show/618730/00:16
*** rbowen has quit IRC00:32
*** tzumainn has quit IRC00:32
*** rbowen has joined #tripleo00:32
*** limao has joined #tripleo00:35
*** bfournie has joined #tripleo00:35
*** limao_ has joined #tripleo00:40
*** limao has quit IRC00:40
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Restore and split nova metadata docker service out of nova-api.  https://review.openstack.org/49472700:42
*** ecerquei_ has joined #tripleo01:00
*** gvrangan_odl has joined #tripleo01:02
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295501:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067801:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171126201:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142501:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)01:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)01:10
openstackLaunchpad bug 1711262 in tripleo "tripleo job are overwriting nameserver with 8.8.8.8" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)01:10
openstackLaunchpad bug 1711425 in tripleo "Impossible to ssh a VM when TripleO is containerized" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)01:10
*** fzdarsky_ has joined #tripleo01:11
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Restore and split nova metadata docker service out of nova-api.  https://review.openstack.org/49472701:13
*** fzdarsky has quit IRC01:14
*** dixiaoli has joined #tripleo01:16
*** pradk has quit IRC01:21
*** dobson has quit IRC01:23
*** zzzeek has quit IRC01:23
*** dobson has joined #tripleo01:24
*** zzzeek has joined #tripleo01:24
*** tonyb has quit IRC01:24
*** zzzeek has quit IRC01:25
*** tonyb has joined #tripleo01:25
*** zzzeek has joined #tripleo01:25
*** limao_ has quit IRC01:27
openstackgerritMerged openstack/tripleo-heat-templates master: Remove iscsid from TLS everywhere docker environment  https://review.openstack.org/49442901:28
*** limao has joined #tripleo01:29
*** eck` is now known as eck`gone01:30
*** limao has quit IRC01:30
*** limao has joined #tripleo01:33
*** numans has joined #tripleo01:37
*** pradk has joined #tripleo01:40
*** ecerquei__ has joined #tripleo01:51
*** ecerquei_ has quit IRC01:51
*** gvrangan_odl has quit IRC01:53
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: WIP Filter image list by deployed services  https://review.openstack.org/49476702:01
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295502:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067802:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171126202:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142502:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)02:10
openstackLaunchpad bug 1711262 in tripleo "tripleo job are overwriting nameserver with 8.8.8.8" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)02:10
openstackLaunchpad bug 1711425 in tripleo "Impossible to ssh a VM when TripleO is containerized" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)02:10
*** achadha has joined #tripleo02:16
*** dmacpher has joined #tripleo02:22
openstackgerritMerged openstack/tripleo-heat-templates master: Make cinder-manage db sync run on only one controller during upgrade  https://review.openstack.org/49179902:23
openstackgerritMerged openstack/tripleo-quickstart-extras master: Fix set_overcloud_workers=False being ignored for >mitaka  https://review.openstack.org/49358602:23
openstackgerritMerged openstack/os-net-config master: Make onboot parameter for ifcfg configuration configurable  https://review.openstack.org/48513202:23
openstackgerritMerged openstack/tripleo-ui master: Download logs interface  https://review.openstack.org/47393302:24
openstackgerritMerged openstack/tripleo-ui master: Update updatePlan action  https://review.openstack.org/48919602:24
*** rlandy has quit IRC02:26
openstackgerritzenghui.shi proposed openstack/os-net-config master: Add NIC Mapping Reporting Feature  https://review.openstack.org/38351602:30
*** achadha has quit IRC02:43
openstackgerritMerged openstack/tripleo-heat-templates master: Add support for installing Ceph MDS via ceph-ansible  https://review.openstack.org/47942602:50
openstackgerritMerged openstack/tripleo-quickstart master: Rename centos repositories created by quickstart  https://review.openstack.org/49405602:50
pabelanger8 merges in a row02:53
*** artom has quit IRC02:59
fultonjyay!03:04
*** limao has quit IRC03:09
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295503:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067803:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171126203:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142503:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)03:10
openstackLaunchpad bug 1711262 in tripleo "tripleo job are overwriting nameserver with 8.8.8.8" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)03:10
openstackLaunchpad bug 1711425 in tripleo "nova metadata broken in containerized environment" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)03:10
openstackgerritOpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements  https://review.openstack.org/49276803:12
openstackgerritMerged openstack/puppet-tripleo master: Release Pike rc1 - 7.3.0  https://review.openstack.org/49437803:16
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/48739803:23
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/48814803:23
*** gvrangan_odl has joined #tripleo03:28
*** axisys has joined #tripleo03:38
*** axisys has left #tripleo03:40
*** udesale has joined #tripleo03:42
pabelangerEmilienM: weshay: mwhahaha: baseurl is empty: http://logs.openstack.org/16/462916/29/gate/gate-tripleo-ci-centos-7-containers-multinode/2a10a0f/logs/undercloud/etc/yum.repos.d/delorean-current.repo.txt.gz I see an issue with the logic used to build: http://logs.openstack.org/16/462916/29/gate/gate-tripleo-ci-centos-7-containers-multinode/2a10a0f/logs/undercloud/home/jenkins/repo_setup.sh.txt.gz03:43
pabelangerwe still directly hit rdoproject.org with curl, so it it is possible for that to fail03:43
pabelangerwe can get that via nodepool RDO PROXY variable in /etc/ci/mirror_info.sh03:44
pabelangerwill create a bug in the morning03:44
stevebakerpabelanger: thanks for all this03:47
*** psahoo has joined #tripleo03:52
*** bogdando has joined #tripleo04:03
*** gkadam has joined #tripleo04:09
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295504:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067804:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171126204:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142504:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)04:10
openstackLaunchpad bug 1711262 in tripleo "tripleo job are overwriting nameserver with 8.8.8.8" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)04:10
openstackLaunchpad bug 1711425 in tripleo "nova metadata broken in containerized environment" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)04:10
*** ykarel has joined #tripleo04:13
EmilienMpabelanger: I don't understand how it's possible04:19
EmilienMpabelanger: this is the script that setup repos http://logs.openstack.org/16/462916/29/gate/gate-tripleo-ci-centos-7-containers-multinode/2a10a0f/logs/undercloud/home/jenkins/repo_setup.sh.txt.gz04:20
EmilienMhttp://logs.openstack.org/16/462916/29/gate/gate-tripleo-ci-centos-7-containers-multinode/2a10a0f/logs/undercloud/home/jenkins/repo_setup.log.txt.gz#_2017-08-18_03_34_1004:21
EmilienMpabelanger: is it consistent?04:21
*** links has joined #tripleo04:23
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Enable pingtest on containers-multinode-upgrade  https://review.openstack.org/49426804:24
pabelangerEmilienM: --silent in curl command isn't exposing the error04:24
pabelangerEmilienM: it is likey the DNS failed04:24
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Upgrade CI test - never merge  https://review.openstack.org/46100004:24
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Upgrade CI test - never merge  https://review.openstack.org/46100004:24
pabelangerEmilienM: so, we should remove --silent and also curl from reverse proxy cache for rdo04:24
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs010: enable tempest  https://review.openstack.org/49428404:26
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/newton: SSHD Service extensions  https://review.openstack.org/49426304:27
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Move common multinode role setup from tripleo-ci  https://review.openstack.org/48740804:27
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Add featureset for 3nodes multinode job  https://review.openstack.org/48615504:27
*** fultonj has quit IRC04:28
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch scenario007 to run Tempest  https://review.openstack.org/49429304:28
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch scenario004 to run Tempest  https://review.openstack.org/49111304:28
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch scenario003 to run Tempest  https://review.openstack.org/49429004:28
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch scenario002 to run Tempest  https://review.openstack.org/49110204:28
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Enable pingtest on 2 scenarios container jobs  https://review.openstack.org/49012904:28
pabelangerand EOD now04:28
*** ebarrera has quit IRC04:30
EmilienMpabelanger: wow late for you04:32
EmilienMpabelanger: I thought the dns issue was fixed04:32
EmilienMhttps://review.openstack.org/#/c/494545/ still in gate04:32
EmilienMwe'll see tomorrow04:32
*** aditya_r has joined #tripleo04:39
*** nyechiel has joined #tripleo04:45
*** dixiaoli has quit IRC04:48
openstackgerritOpenStack Proposal Bot proposed openstack/os-apply-config master: Updated from global requirements  https://review.openstack.org/49486404:49
openstackgerritOpenStack Proposal Bot proposed openstack/os-collect-config master: Updated from global requirements  https://review.openstack.org/49486604:49
openstackgerritOpenStack Proposal Bot proposed openstack/os-refresh-config master: Updated from global requirements  https://review.openstack.org/49486704:49
openstackgerritOpenStack Proposal Bot proposed openstack/python-tripleoclient master: Updated from global requirements  https://review.openstack.org/49491604:52
*** yprokule has joined #tripleo04:54
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/48739804:54
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/48814804:54
*** pgadiya has joined #tripleo04:55
*** brault has quit IRC05:00
*** stendulker has joined #tripleo05:03
openstackgerritMerged openstack-infra/tripleo-ci master: Set undercloud nameserver to localhost 127.0.0.1  https://review.openstack.org/49454505:05
*** jfrancoa has joined #tripleo05:07
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295505:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067805:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171126205:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142505:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)05:10
openstackLaunchpad bug 1711262 in tripleo "tripleo job are overwriting nameserver with 8.8.8.8" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)05:10
openstackLaunchpad bug 1711425 in tripleo "nova metadata broken in containerized environment" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)05:10
*** nyechiel has quit IRC05:13
*** aditya_ra has joined #tripleo05:14
*** limao has joined #tripleo05:16
*** aditya_r has quit IRC05:16
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo stable/ocata: Remove extra keystone admin haproxy listen and allow TLS  https://review.openstack.org/49494705:18
*** dixiaoli has joined #tripleo05:19
*** limao has quit IRC05:21
*** limao has joined #tripleo05:21
*** limao has quit IRC05:21
*** janki has joined #tripleo05:22
*** limao has joined #tripleo05:25
*** ratailor has joined #tripleo05:25
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Add param to configure snat mechanism  https://review.openstack.org/49386105:27
bandinimorning05:28
openstackgerritNuman Siddique proposed openstack/tripleo-quickstart master: Add fset030 for OVN with containerized oc  https://review.openstack.org/49062405:29
jaosoriorbandini: sup duuude05:31
jaosoriorhow's it giong?05:31
*** marios has joined #tripleo05:34
*** dpawar has joined #tripleo05:37
*** iranzo has joined #tripleo05:38
openstackgerritNuman Siddique proposed openstack/tripleo-heat-templates master: Support deploying OVN as container services  https://review.openstack.org/46886005:40
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Adds PostUpgradeConfigStepsDeployment to drive post config ansible  https://review.openstack.org/49387805:40
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Readd OpenDayLight docker images  https://review.openstack.org/49495105:40
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Readd OpenDayLight docker images  https://review.openstack.org/49495105:41
bandinijo jaosorior, running around getting containers running ;)05:42
bandinijaosorior: how are you doing?05:42
bandinijaosorior: do you need me to review anything?05:43
*** jbadiapa has joined #tripleo05:44
*** ecerquei__ has quit IRC05:44
*** ecerquei__ has joined #tripleo05:44
jaosoriorbandini: you know I always need reviews :D05:45
jaosoriorbandini: you need me to review or help with anything?05:45
bandinieheh05:46
jaosoriorbandini: I need a review for this one https://review.openstack.org/#/c/491437/ it almost merged but there was a bug, so I blocked it and fixed it. Can you check it out when you have time?05:46
bandinijaosorior: maybe this one https://review.openstack.org/#/c/491705/ (although I need to check with marios)05:47
bandinion it05:47
*** bogdando has quit IRC05:48
jaosoriorbandini: so right now your patch requires that folks don't give a tag in the image? I think gfidente had a similar issue.05:48
bandinijaosorior: now it *does* require that there is a tag, which is the case today upstream and downstream05:49
jaosoriorbandini: this was his fix https://review.openstack.org/#/c/491759/05:49
* bandini looks05:49
jaosoriorbandini: I think you need to use gfidente's yaql. Cause folks might give a host (with the protocol prepended) and that'll mess up your yaql05:50
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Heat]  https://review.openstack.org/49139905:50
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Aodh]  https://review.openstack.org/49141105:50
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mistral]  https://review.openstack.org/49347105:50
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Gnocchi]  https://review.openstack.org/49143305:50
bandinijaosorior: agreed (although my yaql does work in all cases *as long as there is a tag*). thanks!05:51
jaosoriorbandini: oh, does it?05:51
jaosoriorlet me re-read it05:51
bandiniyeah it just takes everything except the right-hand tag05:52
bandinijaosorior: is there no way in HOT to make giulio's work a function we can reuse?05:53
jaosoriorbandini: oh, I think he actually needed to get the host05:53
bandiniyeah I think so05:53
jaosoriorbandini: and you probably don't need that05:53
jaosoriorjust the tag05:53
jaosorioralright05:53
bandinifwiw the patch works, I test it daily05:54
jaosoriorbandini: why do you need to bind mount stuff if you're just tagging the image?05:55
jaosoriorbandini: https://review.openstack.org/#/c/491705/6/docker/services/pacemaker/cinder-backup.yaml05:55
*** mdnadeem has joined #tripleo05:55
bandinijaosorior: because I run docker commands inside this temporary container which would otherwise fail05:55
jaosoriorohhhh05:56
jaosoriornow I get it05:56
jaosoriorbandini: scored05:56
bandiniand I need to do it there so it is before any step2, so that when we create the bundle it is always with ':pcmklatest'05:56
jaosoriorbandini: that part I had actually understood :D05:57
bandinieheh05:57
bandiniI'll try to discuss the review with 'the inimitable chem and marios' today05:58
*** nyechiel has joined #tripleo05:58
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260706:00
*** jprovazn has joined #tripleo06:00
*** hanish has joined #tripleo06:06
marioso/ bandini jaosorior06:09
jaosoriormarios: yo dude, how's life?06:09
mariosjaosorior: well, its friday !06:10
marios\o/06:10
mariosand i'm off next week \o/06:10
bandini"nothing can bring you down on a Friday"06:10
*** ooolpbot has joined #tripleo06:10
* marios collapses06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295506:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067806:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171126206:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142506:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)06:10
jaosoriorhaha fuuuck yeah :D\06:10
openstackLaunchpad bug 1711262 in tripleo "tripleo job are overwriting nameserver with 8.8.8.8" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)06:10
openstackLaunchpad bug 1711425 in tripleo "nova metadata broken in containerized environment" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)06:10
bandinimarios: wowowow ;)06:10
mariosjaosorior: i think i was running on fumes like ~ 3 weeks ago06:10
mariosnow i have no idea06:10
*** jaganathan has joined #tripleo06:11
marios09:10 < bandini> "nothing can bring you down on a Friday"06:11
jaosoriormarios: so what's your plan for next week?06:11
marioswell, gfidente06:11
bandiniahahahah06:11
mariosbandini: ^^ but otherwise right06:11
mariosjaosorior: mojito mon-wed and then tequila shots thu through next weekend06:12
bandinithat sounds like the best PTO evah06:12
jaosoriorhahaha06:12
jaosoriorfuuuuck yeah06:12
jaosoriormarios: travelling anywhere?06:12
mariosjaosorior: no staying locally with the family its a good time of year to be in cyprus ;)06:13
bandinias long as gfidente is not in cyprus as well, though06:13
jaosoriornow I want a tequila :/06:13
mariosbandini: thats what i keep saying06:13
bandini;)06:13
jaosoriorlol06:13
mariosjaosorior: well its afternoon, somewhere06:13
jaosorioruhm.... good point :P06:14
* bandini stocked up on Mezcal and Sal de Gusano06:14
mariosttyl bandini lets catch up this afternoon on the update stuff? we can use the 'usual' slot seems it works for most?06:14
bandinimarios: yessir!06:14
mariosbandini: cool thanks06:14
jaosorioruhm.... Mezcal06:15
*** aufi has joined #tripleo06:15
jaosoriorI'm running out of it :(06:15
*** nyechiel has quit IRC06:18
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [DNM] testing selinux  https://review.openstack.org/49496006:20
jaosoriormarios: if you have some time could you check this out https://review.openstack.org/#/c/491437/ ?06:23
*** ykarel has quit IRC06:26
mariosjaosorior: ack noted06:31
*** ykarel has joined #tripleo06:32
*** dpawar has quit IRC06:33
*** pdeore has joined #tripleo06:33
*** rcernin has joined #tripleo06:41
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: CPU threads range format for derive parameters  https://review.openstack.org/48058706:44
*** aditya_ra has quit IRC06:45
*** amoralej|off is now known as amoralej06:45
*** masco has joined #tripleo06:47
*** jlinkes has joined #tripleo06:50
*** jpich has joined #tripleo06:52
*** gvrangan_odl has quit IRC06:53
openstackgerritJan Provaznik proposed openstack/tripleo-heat-templates master: Let mds create manila key and fs  https://review.openstack.org/48249606:54
*** cylopez has joined #tripleo06:56
*** snecklifter has joined #tripleo06:57
*** snecklifter has quit IRC06:58
*** zshi has quit IRC07:00
*** zshi has joined #tripleo07:01
*** ebarrera has joined #tripleo07:02
lvdombrkrguys, after i run Introspection there is hung Waiting for messages on queue and no answer07:03
lvdombrkrwhat can be main reasons?07:03
*** ebarrera has quit IRC07:06
*** ebarrera has joined #tripleo07:07
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295507:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067807:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171126207:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142507:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)07:10
openstackLaunchpad bug 1711262 in tripleo "tripleo job are overwriting nameserver with 8.8.8.8" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)07:10
openstackLaunchpad bug 1711425 in tripleo "nova metadata broken in containerized environment" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)07:10
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/ocata: Make cinder-manage db sync run on only one controller during upgrade  https://review.openstack.org/49497607:10
*** mrch has joined #tripleo07:10
*** dpawar has joined #tripleo07:11
*** tesseract has joined #tripleo07:13
*** dpawar has quit IRC07:15
*** pgadiya has quit IRC07:16
*** ccamacho has joined #tripleo07:17
*** gkadam is now known as gkadam-afk07:18
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add logging documentation  https://review.openstack.org/48913407:21
*** aditya_r has joined #tripleo07:21
*** jpena|off is now known as jpena07:24
*** brault has joined #tripleo07:24
jaosoriormandre: that metadata patch should proooobably be tested when the metadata server is ran on another node.07:28
mandrejaosorior: I noticed you had comments on https://review.openstack.org/#/c/494727/07:28
jaosoriormandre: naaah, lets merge it. But that should be addressed at some point07:28
mandrejaosorior: hey :)07:28
jaosoriormandre: got a deployment where we could try that out?07:29
*** pgadiya has joined #tripleo07:29
mandrejaosorior: nah, my env is foobar atm, I need to bring it back in shape07:30
mandreI'll let you +a the patch if you feel comfortable with it07:31
mandreyou already did it, thanks07:31
*** dpawar has joined #tripleo07:32
*** pcaruana has quit IRC07:32
*** florianf has joined #tripleo07:33
*** gvrangan has joined #tripleo07:36
openstackgerritMerged openstack/tripleo-heat-templates master: Containerize Manila Share for HA  https://review.openstack.org/48268007:39
owalshjaosorior, mandre: I'll take a look at that this afternoon07:39
*** egonzalez has joined #tripleo07:40
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175907:41
*** dpawar has quit IRC07:42
*** jbadiapa_ has joined #tripleo07:43
openstackgerritMerged openstack-infra/tripleo-ci master: Revert "Installs openssh packages that try to workaround sshd start problem"  https://review.openstack.org/49403907:43
openstackgerritMerged openstack/tripleo-common master: Automatically retry introspection for failing nodes  https://review.openstack.org/46291607:43
openstackgerritMerged openstack/tripleo-heat-templates master: Provide sample environment for composable roles  https://review.openstack.org/48722607:43
*** ykarel has quit IRC07:45
mandreowalsh: ack, thanks for quickly fixing the nova metadata service yesterday07:45
*** ykarel has joined #tripleo07:45
*** jbadiapa has quit IRC07:45
openstackgerritMerged openstack/puppet-tripleo master: Move barbican's database creation to mysql profile  https://review.openstack.org/49395307:45
*** gkadam-afk is now known as gkadam07:46
jaosoriormandre: by the way, once you get a deployment going, can you check that horizon is actually working?07:49
jaosoriormandre: I was trying to do TLS for containerized horizon, and am getting errors... then I decided to try with the containerized deployment without TLS at all. And I get the same issue. So I think horizon isn't actually working at all :/07:49
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable listening on TLS for the internal network for horizon  https://review.openstack.org/48959607:50
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS for containerized horizon  https://review.openstack.org/49498907:50
*** jbadiapa_ has quit IRC07:51
jaosoriormarios: could you check this one out as well https://review.openstack.org/#/c/489596/ ?07:51
*** jbadiapa_ has joined #tripleo07:51
mandrejaosorior: will do, I haven't checked horizon in a while. it was working fine at some point07:52
*** paramite has joined #tripleo07:54
*** pcaruana has joined #tripleo07:54
*** athomas has joined #tripleo07:54
*** bogdando has joined #tripleo07:55
*** aditya_r has quit IRC07:55
*** jtomasek has joined #tripleo07:57
jaosoriormandre: at least it didn't work for me, maybe I messed up my env or something08:01
*** dpawar has joined #tripleo08:02
mariosbandini: i think nit @ https://review.openstack.org/#/c/491705/6/docker/services/pacemaker/cinder-volume.yaml08:02
flaper87bogdando: ++ for working on the ansible-kubespray08:02
*** dixiaoli has quit IRC08:02
*** lyarwood has joined #tripleo08:03
bandinimarios: thanks, looking08:04
bandinimarios: you're right. I'll also add manila-share to the services since it just merged08:06
*** dixiaoli has joined #tripleo08:07
mariosbandini: cool08:08
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295508:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067808:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171126208:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142508:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)08:10
openstackLaunchpad bug 1711262 in tripleo "tripleo job are overwriting nameserver with 8.8.8.8" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)08:10
openstackLaunchpad bug 1711425 in tripleo "nova metadata broken in containerized environment" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)08:10
mariosjaosorior: done08:11
*** derekh has joined #tripleo08:12
*** hewbrocca_afk is now known as hewbrocca08:16
*** bogdando has quit IRC08:16
openstackgerritAdriano Petrich proposed openstack/python-tripleoclient master: Remove the unused function "create_default_plan"  https://review.openstack.org/47886508:17
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Tag the ha containers with 'pcmklatest' at deploy time  https://review.openstack.org/49170508:20
*** aditya_r has joined #tripleo08:20
*** michapma has quit IRC08:21
*** michapma has joined #tripleo08:21
*** mcornea has joined #tripleo08:23
*** aditya_ra has joined #tripleo08:24
*** lucas-afk is now known as lucasagomes08:27
*** aditya_r has quit IRC08:27
*** bogdando has joined #tripleo08:29
*** fzdarsky_ is now known as fzdarsky08:33
marioschem: will you backport this https://review.openstack.org/#/c/491799/ - i ask because i updated https://review.openstack.org/#/c/493878/6/puppet/services/pacemaker/cinder-volume.yaml for the merge conflict (and it removes it again, at least for master/Pike, your one was for Ocata?)08:33
chemmarios: already backported https://review.openstack.org/#/c/494976/108:33
chemmarios: it only need loves now :)08:34
marioschem: loved08:35
chemmarios: thanks :)08:35
*** anshul has joined #tripleo08:36
*** dixiaoli has quit IRC08:36
*** bnemec has quit IRC08:39
*** dixiaoli has joined #tripleo08:39
*** bnemec has joined #tripleo08:40
*** skramaja has joined #tripleo08:42
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo stable/ocata: Remove extra keystone admin haproxy listen and allow TLS  https://review.openstack.org/49494708:46
honzacan i get a quick review on this mistral workflow?  https://review.openstack.org/#/c/493819/09:04
*** gfidente has joined #tripleo09:09
*** gfidente has quit IRC09:09
*** gfidente has joined #tripleo09:09
d0ugalhonza: sure!09:09
honzad0ugal: \o/ thanks09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295509:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067809:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142509:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)09:10
openstackLaunchpad bug 1711425 in tripleo "nova metadata broken in containerized environment" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)09:10
d0ugalhonza: LGTM09:11
honzasweet09:11
*** salmankhan has joined #tripleo09:15
jaosoriorbandini: hey dude, so did you agree on anything regarding that tag? was the review fine then?09:16
openstackgerritMerged openstack/tripleo-heat-templates master: Refactor setup_docker_host.sh as host_prep_tasks  https://review.openstack.org/46916309:17
*** aditya_ra has quit IRC09:18
*** ykarel is now known as ykarel|lunch09:18
*** aditya_r has joined #tripleo09:19
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/49412709:19
bandinijaosorior: I think so yes,i just fixed a typo, made the variable name clearer and added manila-share. I will discuss it this afternoon in a call as well09:20
*** akrivoka has joined #tripleo09:20
bandinijaosorior: feel free to revote, I won't merge anything before the call anyway09:22
*** fzdarsky has quit IRC09:22
*** limao has quit IRC09:23
*** tosky has joined #tripleo09:23
*** deadnull has joined #tripleo09:24
openstackgerritMerged openstack-infra/tripleo-ci master: Set the undercloud_docker_registry_mirror for upstream jobs  https://review.openstack.org/49464409:25
openstackgerritMerged openstack-infra/tripleo-ci master: Create a whitelist for /etc configs  https://review.openstack.org/49397309:26
*** deadnull has quit IRC09:27
*** deadnull has joined #tripleo09:27
*** ebarrera has quit IRC09:28
*** ebarrera has joined #tripleo09:28
*** ykarel|lunch has quit IRC09:32
*** ykarel|lunch has joined #tripleo09:33
*** pgadiya has quit IRC09:35
*** shardy has joined #tripleo09:39
*** jbadiapa_ has quit IRC09:41
jankijaosorior, hey09:42
jaosoriorjanki: hello09:46
jankijaosorior, do you have a minute? Want to talk about barbican api patch09:46
*** pgadiya has joined #tripleo09:47
jaosoriorwhat's up?09:48
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175909:49
jankijaosorior, the latest recheck fails. If you see error, it is stderr: ERROR: (sqlite3.OperationalError) unable to open database file",09:49
jankijaosorior, http://logs.openstack.org/51/481451/18/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container/6005247/logs/undercloud/var/log/postci.txt.gz09:50
jaosoriorjanki: right09:50
jankijaosorior, should I just recheck or it could be any another issue? I checked db connection syntax in puppet module and its correct (//// instead of ///, this is common reason for such error)09:51
jaosoriorjanki: what's the connection string?09:51
jankijaosorior, or is the way of d update incorrect in the yaml file?09:51
jankis/d/db09:52
jankijaosorior, https://github.com/openstack/puppet-barbican/blob/master/manifests/db.pp#L5209:52
jaosoriorjanki: lets first check, what's the actual connection db string that was written down, and lets check if that's what's expected09:52
jaosoriorjanki: yeah, that's the deafult. So it seems it's using the default, and not what we should be passing through t-h-t or puppet-tripleo09:52
*** deadnull has quit IRC09:53
jankijaosorior, in tht, it is /usr/bin/bootstrap_host_exec barbican_api su barbican -s /bin/bash -c '/usr/bin/barbican-manage db upgrade'"09:54
jaosoriorjanki: yeah, but that's the command that was given for the database upgrade. Not the database connection string.09:54
jaosoriorjanki: which is something that you would need to check in the logs of that job. There should be somewhere the configuration in /etc/barbican/barbican.conf, and there we could find the connection string09:55
jankijaosorior, ohh ya. but then in tht, there is no db connection given right09:55
jankijaosorior, any specific folder that will have the conf file?09:55
jaosoriorjanki: looking09:56
jaosoriorjanki: alright09:56
jaosoriorso09:56
jaosoriorthat's a multinode job09:56
jaosoriorso you'll find the overcloud logs in http://logs.openstack.org/51/481451/18/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container/6005247/logs/subnode-2/09:56
jaosoriorsubnode-2 directory09:56
jaosoriorso we then go to /var/log/09:56
jaosoriorand you'll find the container configurations in http://logs.openstack.org/51/481451/18/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container/6005247/logs/subnode-2/var/log/config-data/09:57
jaosoriorso, moving on to barbican09:57
jaosoriorwe can see this http://logs.openstack.org/51/481451/18/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container/6005247/logs/subnode-2/var/log/config-data/barbican/etc/barbican/09:57
*** jbadiapa_ has joined #tripleo09:57
jaosoriorand, for a very strange reason it seems that barbican.conf is missing09:57
jaosoriorwhich might explain the issue09:57
*** ykarel|lunch has quit IRC09:57
jaosoriornow what needs to be figured out is why it's missing :)09:57
*** ykarel|lunch has joined #tripleo09:57
jaosoriora wrong bind-mount somewhere maybe?09:58
jankijaosorior, may be becasue the configapiimage patch is not merged yet?09:59
jaosoriorjanki: uhm...09:59
jaosoriorit isn't?09:59
jaosoriorjanki: I'm honestly not sure. Thought that would be handled by the depends-on09:59
jankijaosorior, no. it has yours +209:59
jaosoriormarios: is this ready to merge https://review.openstack.org/490848 ?\09:59
jaosoriorjanki: also, it seems that we're manually bind mounting the /etc/ directories. IIRC mandre came up with another solution for that, which is used in the other docker templates10:00
jankijaosorior, checking10:01
mariosjaosorior: yeah i think so it isn't a big change, just adds to the update_tasks that shardy just above that block https://review.openstack.org/#/c/490848/5/common/deploy-steps.j210:01
mariosjaosorior: well it has depends-on so it won't merge immediately anyway10:01
mariosjaosorior: thanks for checking10:01
*** pcaruana has quit IRC10:02
jaosoriorjanki: so we're missing the usage of https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/aodh-api.yaml#L88-L92   and it's used like this https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/aodh-api.yaml#L13210:02
jaosoriormarios: done10:02
jaosoriorpradk: you around?10:03
mariosty jaosorior10:03
*** ykarel|lunch has quit IRC10:03
jankijaosorior, I just landed to the same commit10:03
jankiwill edit accordingly and see10:03
jaosoriorjanki: awesome, thanks :)10:03
jistrgfidente: i see what the problem is w/r/t the scenario001 job. There was a regression in https://review.openstack.org/#/c/48393010:03
jankijaosorior, keep you posted. thanks for all the help :)10:03
jistrgfidente: i'll submit a fix shortly10:03
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Allow Sensu to connect to RabbitMQ cluster  https://review.openstack.org/49514910:03
jaosoriorjanki: happy to help. This is honestly not an intuitive nor easy platform :/10:04
gfidentejistr wow thanks10:04
*** udesale has quit IRC10:04
*** ykarel has joined #tripleo10:05
gfidenteso if we had merged it earlier, the offending patch would have failed scenario00110:05
gfidente:D10:05
jistryea ;)10:05
*** tellesnobrega has quit IRC10:09
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: Add options to use local DLRN and CentOS mirrors  https://review.openstack.org/49426210:10
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295510:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067810:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142510:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)10:10
openstackLaunchpad bug 1711425 in tripleo "nova metadata broken in containerized environment" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)10:10
openstackgerritAttila Darazs proposed openstack-infra/tripleo-ci master: Use local mirrors for multinode during DLRN build  https://review.openstack.org/49453710:11
openstackgerritAttila Darazs proposed openstack/puppet-tripleo master: GATE TEST: do not merge  https://review.openstack.org/49453810:12
*** adarazs is now known as adarazs_lunch10:13
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Containarise Barbican API  https://review.openstack.org/48145110:18
*** pcaruana has joined #tripleo10:22
openstackgerritAthlan-Guyot sofer proposed openstack/instack-undercloud master: Make sure selinux permissions are correct on ~/.ssh.  https://review.openstack.org/49515710:22
*** fzdarsky has joined #tripleo10:24
*** cylopez has quit IRC10:26
*** limao has joined #tripleo10:29
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: CI/OOOQ compatibility in enable-ssh-admin script  https://review.openstack.org/49516010:38
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Set Overcloud_hosts  https://review.openstack.org/49516110:38
*** stendulker_ has joined #tripleo10:39
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Convert scenario001-multinode-containers job to ceph-ansible  https://review.openstack.org/47928810:41
*** stendulker has quit IRC10:42
*** aditya_r has quit IRC10:42
*** stendulker_ has quit IRC10:44
openstackgerritJan Provaznik proposed openstack/tripleo-heat-templates master: Let mds create manila key and fs  https://review.openstack.org/48249610:46
*** jkilpatr has quit IRC10:46
*** gvrangan has quit IRC10:47
*** jaganathan has quit IRC10:47
*** pgadiya has quit IRC10:51
*** sri_ has joined #tripleo10:54
owalshjaosorior: thinking about running nova-metadata standalone...10:56
*** limao has quit IRC10:57
*** limao has joined #tripleo10:57
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Make configurable docker registry WIP  https://review.openstack.org/49448310:58
*** shardy is now known as shardy_lunch10:58
*** daidv has quit IRC11:00
*** dpawar has quit IRC11:00
*** limao has quit IRC11:01
*** limao has joined #tripleo11:02
*** limao has quit IRC11:03
jaosoriorowalsh: ?11:03
*** limao has joined #tripleo11:03
*** pgadiya has joined #tripleo11:04
*** gvrangan has joined #tripleo11:04
owalshjaosorior: sorry, just checking something... has it ever been a composible service?11:05
owalshjaosorior: looks like it should always have been part of the nova-api service11:06
jaosoriorowalsh: no, that's why I thought it would get problematic for folks, since now it appears as a composable service, even though it can't actually be ran in a node separate from nova-api11:06
*** jkilpatr has joined #tripleo11:07
owalshjaosorior: I'm thinking the path of least resistance is to merge it back into nova-api for now and look at making it composible in queens11:07
jaosoriorowalsh: so that's what I was thinking, but it seems folks were not very keen on that :/11:09
jaosoriorowalsh: what do you think? should we just try to fix it and make it work on a separate node? or just document the current situation and that's it?11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295511:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067811:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142511:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)11:10
openstackLaunchpad bug 1711425 in tripleo "nova metadata broken in containerized environment" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)11:10
owalshjaosorior: well... making it composible smells like a new feature to me, and it doesn't have an FFE so...11:11
jaosoriorowalsh: ok, docs it is11:11
owalshjaosorior: I could maybe merge the yaml into nova-api, would be cleaner11:12
owalshjaosorior: but doesn't really change anything for the end user11:12
jaosoriorowalsh: lets first wait until your commit merges, since that fixes the issue for now. And then we can propose to folks to have it in the nova-api tempalte with the explanation. See what folks think.11:12
owalshjaosorior: works for me, thanks11:13
jaosoriorowalsh: thanks for looking into it11:13
*** lucasagomes is now known as lucas-hungry11:13
*** akrivoka has quit IRC11:14
owalshjaosorior: np... oh, also TLS isn't an option for metadata api I assume11:14
*** limao_ has joined #tripleo11:15
owalshjaosorior: AFAIU this API is called from the instance VMs, which wouldn't have the certs etc...11:16
jaosoriorowalsh: doesn't it go through neutron metadata, which passes the request to nova-metadata?11:17
jaosoriorowalsh: cause neutron-metadata would actually trust the CA cert, and be able to do requests to nova-metadata11:18
*** limao has quit IRC11:18
owalshjaosorior: ah, yea it does so we could have TLS. Is that possible with eventlet services?11:18
jaosoriorowalsh: we can set a tLS proxy in front of it11:20
jaosoriorowalsh: https://review.openstack.org/#/q/status:open+branch:master+topic:bp/tls-via-certmonger+message:%255E.*metadata.*11:20
jaosoriorowalsh: but this is needed first https://review.openstack.org/#/c/494648/11:20
owalshjaosorior: sweet :-)11:21
jaosoriorowalsh: and it seemed to me like it would work https://www.suse.com/communities/blog/vms-get-access-metadata-neutron/11:22
jaosoriorowalsh: so, the instance isn't aware at any point that the request goes through the network encrypted. That's handled by the neutron-metadata server, which would go to the TLS proxy, and the TLS proxy to nova-metadata11:23
*** limao_ has quit IRC11:23
jaosoriorowalsh: still gotta figure out vncproxy though11:23
*** _jbadiapa has joined #tripleo11:24
owalshjaosorior: vncproxy is the only remaining nova TLS service yea?11:25
jaosoriorowalsh: well there are more, such as mistral, ironic, ceph and manila. But those are scoped for OSP13. So, for OSP12 it's vncproxy and redis that are missing. plus containerized rabbitmq.11:26
*** deadnull has joined #tripleo11:26
*** jbadiapa_ has quit IRC11:26
*** deadnull has quit IRC11:26
jaosoriorowalsh: well, rabbitmq with TLS and containerized is working with HA, but not in non-ha. so yeah, it's kinda weird11:26
*** akrivoka has joined #tripleo11:27
*** limao has joined #tripleo11:27
owalshjaosorior: hmm that is weird. I'll stop bother you now :-) thanks!11:28
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Certmonger: Make postsave command configurable  https://review.openstack.org/49408511:28
owalshbothering11:28
jaosoriorowalsh: duuude, no worries.11:28
openstackgerritOpenStack Proposal Bot proposed openstack/diskimage-builder master: Updated from global requirements  https://review.openstack.org/49480011:29
*** ratailor has quit IRC11:29
jaosoriorowalsh: I think I'll get non-ha containerized rabbitmq with SSL working today.11:29
jaosoriorowalsh: but if you could help out with a bit of research on what we would need to configure for vncproxy, that would be great.11:30
openstackgerritOpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements  https://review.openstack.org/49276811:30
*** limao has quit IRC11:32
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Heat]  https://review.openstack.org/49139911:33
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Aodh]  https://review.openstack.org/49141111:33
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mistral]  https://review.openstack.org/49347111:33
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Gnocchi]  https://review.openstack.org/49143311:33
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mixed-1]  https://review.openstack.org/49519511:33
*** fzdarsky has quit IRC11:34
*** dpawar has joined #tripleo11:34
openstackgerritNuman Siddique proposed openstack/tripleo-quickstart-extras master: Support container_override_args  https://review.openstack.org/49525811:39
openstackgerritNuman Siddique proposed openstack/tripleo-quickstart master: Add fset030 for OVN with containerized oc  https://review.openstack.org/49062411:40
lvdombrkrguys, when i run Introspect to node i see in remote machine that there is error "eth0 and eth1" still down, waiting11:41
lvdombrkror something like this11:41
openstackgerritOpenStack Proposal Bot proposed openstack/python-tripleoclient master: Updated from global requirements  https://review.openstack.org/49491611:42
*** pgadiya has quit IRC11:43
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/48739811:44
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/48814811:44
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-validations master: Updated from global requirements  https://review.openstack.org/49527811:44
jaosoriorjanki: commented https://review.openstack.org/#/c/481451/1911:44
*** pdeore has quit IRC11:44
jankijaosorior, because uwsgi package was removed from dockerfile?11:46
jaosoriorjanki: we're running over httpd. those flags set it to run without it.11:46
jaosoriorso httpd won't be configured and the deployment will fail.11:46
jankijaosorior, ohh, ohk. will edit11:46
*** kbyrne has quit IRC11:46
*** kbyrne has joined #tripleo11:47
*** adarazs_lunch is now known as adarazs11:48
*** cylopez has joined #tripleo11:48
*** gvrangan has quit IRC11:49
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Set Overcloud_hosts  https://review.openstack.org/49516111:49
*** fzdarsky has joined #tripleo11:49
*** ansmith has quit IRC11:50
*** gkadam has quit IRC11:50
*** gkadam has joined #tripleo11:51
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Containarise Barbican API  https://review.openstack.org/48145111:51
jankijaosorior, ^11:51
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Reintroduce OVERCLOUD_HOSTS exporting  https://review.openstack.org/49516111:51
jaosoriorjanki: you re-added sync to the barbican-manage command11:52
jaosoriorthat'll fail11:52
jaosoriorjanki: aah, I know what happened.11:52
jaosoriorjanki: so I posted patch #1811:53
owalshjaosorior: ack, will do11:53
jaosoriorand I think you grab the latest patch11:53
jaosoriorso my changes got overwritten11:53
*** gkadam has quit IRC11:53
*** gkadam has joined #tripleo11:54
jaosoriorjanki: commented again.11:54
jankijaosorior, ya. editing right away11:54
jaosoriorjanki: haha, no rush, was just commenting :)11:54
jankijaosorior, want to get it merged asap. with every new patch merged, this will keep on editing11:55
jaosoriorjanki: true that11:55
*** rhallisey has joined #tripleo11:56
jankijaosorior, also, docker-centos-tripleoupstream.yaml is deleted now and user needs to create env file with a separate command. I am assuming the images to be included in this new file will come from overcloud-containers.yaml in ooo-common. correct?11:57
jaosorioryes11:57
*** rhallisey has quit IRC11:58
*** rhallisey has joined #tripleo11:58
*** ykarel has quit IRC11:58
jankiso for opendaylight, it is not available in overcloud-containers.yaml because we dont enable it by default. so this patch makes sense?11:58
jankihttps://review.openstack.org/#/c/49495111:58
jankijaosorior, ^11:58
jaosorior+211:59
*** ykarel has joined #tripleo12:00
*** pgadiya has joined #tripleo12:00
jankijaosorior, you are a boon :)12:00
jaosoriorhappy to help12:01
*** dpawar has quit IRC12:03
*** derekh has quit IRC12:06
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Containarise Barbican API  https://review.openstack.org/48145112:06
*** shardy_lunch is now known as shardy12:07
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: Add options to use local DLRN and CentOS mirrors  https://review.openstack.org/49426212:07
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS everywhere/haproxy: Remove empty postsave command  https://review.openstack.org/49528812:08
*** abishop has joined #tripleo12:09
*** pgadiya has quit IRC12:09
*** artom has joined #tripleo12:09
*** artom has quit IRC12:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295512:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067812:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142512:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)12:10
openstackLaunchpad bug 1711425 in tripleo "nova metadata broken in containerized environment" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)12:10
*** artom has joined #tripleo12:10
openstackgerritMerged openstack/puppet-tripleo stable/ocata: Enable innodb_buffer_pool_size configuration  https://review.openstack.org/49057712:11
openstackgerritMerged openstack/tripleo-quickstart master: enable enable_opstools_repo where opstools are deployed  https://review.openstack.org/49472412:11
openstackgerritMerged openstack/tripleo-common master: Use correct path in healthcheck scripts  https://review.openstack.org/49352812:11
*** gvrangan has joined #tripleo12:13
*** ebarrera has quit IRC12:14
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/48739812:14
*** sseago has quit IRC12:15
*** ebarrera has joined #tripleo12:16
openstackgerritAlan Bishop proposed openstack/tripleo-common master: Use NovaVcpuPinSet when deriving HCI parameters  https://review.openstack.org/48923912:17
*** trown|outtypewww is now known as trown12:18
*** jaganathan has joined #tripleo12:18
*** jcoufal has joined #tripleo12:20
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Certmonger: Make postsave command configurable  https://review.openstack.org/49408512:20
jistrtrown: good morning :) Can you please review https://review.openstack.org/495161 when you have time?12:21
*** rcernin has quit IRC12:21
*** rlandy has joined #tripleo12:22
trownjistr: whoops thanks for fixing that, and in a good way too!12:23
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: WIP: Remove package if service stopped and disabled  https://review.openstack.org/47988612:23
jistrtrown: cool, thanks12:23
trownjistr: I saw that I deleted that in my rebase, but was thinking of role_name.hosts being enough12:24
trownbut overcloud is not a role_name12:24
*** pchavva has joined #tripleo12:25
jistrtrown: yea i went with a role approach in ps1 on that patch, but then realized it would break OVERCLOUD_ROLES value12:25
*** pkovar has joined #tripleo12:25
*** psahoo has quit IRC12:26
jistrtrown: we need that variable for enable-ssh-admin.sh, which creates tripleo-admin user, which in turn enables all Ansible execution from Mistral12:26
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Tag the ha containers with 'pcmklatest' at deploy time  https://review.openstack.org/49170512:28
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo stable/ocata: Always start httpd at the same time  https://review.openstack.org/49375412:31
*** dciabrin has quit IRC12:33
*** dciabrin has joined #tripleo12:33
*** lucas-hungry is now known as lucasagomes12:33
*** pkovar has quit IRC12:34
*** dougbtv has joined #tripleo12:34
*** jpena is now known as jpena|lunch12:36
*** thrash|g0ne is now known as thrash12:36
*** rcernin has joined #tripleo12:38
*** catintheroof has joined #tripleo12:40
*** catinthe_ has joined #tripleo12:41
*** catintheroof has quit IRC12:41
openstackgerritOpenStack Proposal Bot proposed openstack/os-refresh-config stable/pike: Updated from global requirements  https://review.openstack.org/49529212:41
*** dprince has joined #tripleo12:42
*** aditya_r has joined #tripleo12:42
*** marrusl has joined #tripleo12:43
*** dixiaoli has quit IRC12:43
*** oidgar has joined #tripleo12:43
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175912:46
rlandymrunge: hello - regarding your patch: https://review.openstack.org/#/c/472638 - the environment files are being reworked and the undercloud flavor change is being included in https://review.openstack.org/#/c/494674/3/config/environments/rdocloud_ovb.yml12:48
rlandyI added you as a reviewer to the rework patches12:49
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Add logrotate with crond service  https://review.openstack.org/49005012:52
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable TLS for containerized RabbitMQ  https://review.openstack.org/49363212:52
*** dpawar has joined #tripleo12:53
*** dpawar has quit IRC12:53
*** dpawar has joined #tripleo12:54
*** cylopez has quit IRC12:55
*** cylopez has joined #tripleo12:57
*** eck`gone is now known as eck`12:58
*** dpawar has quit IRC12:58
*** tzumainn has joined #tripleo12:59
*** ansmith has joined #tripleo13:01
*** florianf has quit IRC13:01
jaosoriorbandini: could you check these out https://review.openstack.org/#/q/status:open+branch:master+topic:bp/tls-via-certmonger+message:%255E.*metadata.* ?13:02
*** toure has joined #tripleo13:02
jaosoriorjistr: ^^13:02
*** gvrangan has quit IRC13:03
*** gvrangan has joined #tripleo13:04
*** masco has quit IRC13:05
*** jaosorior has quit IRC13:05
mariosmwhahaha: o/ hi i just tried to make my case @ https://review.openstack.org/#/c/474578/11 - thanks for checking it when you get some time :)13:06
*** morazi has joined #tripleo13:08
*** liverpooler has joined #tripleo13:08
adarazsamoralej, pabelanger, weshay: I think we're good on the latest patchset \o/ http://logs.openstack.org/38/494538/3/check/gate-tripleo-ci-centos-7-undercloud-oooq/b38b8f8/logs/delorean_logs/b3/77/b377cdcf6eb0d642593babb1de34935cf76e7c4a_dev/rpmbuild.log.txt.gz13:09
*** florianf has joined #tripleo13:09
adarazseverything should be coming from the mirrors/proxy except for DLRN and rdoinfo.13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295513:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067813:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142513:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)13:10
openstackLaunchpad bug 1711425 in tripleo "nova metadata broken in containerized environment" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)13:10
amoralejadarazs, i looks fine13:12
weshayadarazs, nice13:13
*** ramishra has quit IRC13:15
*** jmelvin has joined #tripleo13:16
*** yprokule_ has joined #tripleo13:17
*** skramaja has quit IRC13:18
*** yprokule has quit IRC13:20
*** yprokule_ is now known as yprokule13:20
*** ramishra has joined #tripleo13:21
openstackgerritSaravanan KR proposed openstack/python-tripleoclient master: Add a warning message for the list of unused parameters  https://review.openstack.org/49530013:22
pabelangeramoralej: amoralej: weshay: great work, we should see about reviewing your patches first things today. we just hit the issue in gate: http://logs.openstack.org/35/494235/3/gate/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-puppet/87a3fef/logs/delorean_logs/05/84/0584784dd43d27d67bcc1583cdb5631dbffd5cba_dev/rpmbuild.log.txt.gz13:27
pabelangeradarazs: ^13:28
trownI +2'd them already13:28
tdasilvahello, i'm trying to deploy with composable roles and I'm getting this error: http://paste.openstack.org/show/618772/13:29
tdasilvaanybody has any ideas?13:29
*** gvrangan has quit IRC13:29
*** hewbrocca is now known as hewbrocca_afk13:29
amoralejpabelanger, using mirrors is good but i still wonder why we do see so many issues downloading packages there, we are building packages all the time in delorean servers and we don't see similar issues13:30
amoraleji haven't seen a similar issue in our delorean server in ages13:30
*** jaganathan has quit IRC13:31
*** tellesnobrega has joined #tripleo13:31
pabelangeramoralej: cloud provider networking is one issue, we also find rdoproject.org unstable at our scale too.13:32
amoralejpabelanger, ok, you saw more problems in trunk.rdoproject.org or in buildlogs?13:33
pabelangeramoralej: another thing we could do, and need to see if possible with mock, is bind mount the existing rpm cache on the host, so we don't duplicate downloads also13:33
pabelangeramoralej: both, yes13:33
*** oidgar has quit IRC13:34
pabelangeramoralej: http://status.openstack.org/elastic-recheck/#1674681 is some history about buildlogs.centos.org13:34
pabelangerhttp://status.openstack.org/elastic-recheck/#1469730 for RDO / EPEL13:35
pabelangerThe last one is pretty much non issue any more, with reverse proxy cache13:35
amoralejpabelanger, nice, let's see if we can reduce issues to ~0 with fix in dlrn build13:36
larsksEmilienM: sorry I missed your ping last night. I'll take a look, although it's probably going to be Monday...13:37
pabelangerEmilienM: yes, we do still have some DNS issues, but they affect all centos-7 images. We have a fix in openstack-infra ready, and going to test today. Tripleo is now mitigating that by forcing undercloud nameserver to 127.0.0.113:37
pabelangeramoralej: ++13:38
*** amoralej is now known as amoralej|off13:40
*** jpena|lunch is now known as jpena13:40
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Generalize OVB settings to fit feature set pattern  https://review.openstack.org/49465913:41
weshayEmilienM++13:41
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: WIP create default settings for environment types  https://review.openstack.org/49467413:41
weshaycontainer upgrade tests are looking good!13:42
weshaymatbu, ^13:42
mandrehas anyone tried to run quickstart with a fedora 26 host? weshay?13:42
weshaymandre, you'll hit a support check if you do that13:43
weshaywe don't have fedora in a ci system13:43
weshayso we don't officially support it13:43
matbuweshay: well no really13:43
weshayit's in the doc13:43
matbuweshay: the ping test is still failing13:43
mandreweshay: I'm disabling this check :)13:43
matbuweshay: or maybe i missed something ?13:43
weshaymandre, ya.. so what we say is .. it's possible it will work13:43
weshaymatbu, /me looking at http://cistatus.tripleo.org/13:44
weshaymatbu, upgrade containers 2-4 is yellow :)13:44
weshayan improvement13:44
matbuweshay: yep they probably don't trigger the ping test13:44
mandreweshay: it used to work for me on fedora 24 but I've then updated my box and now it fails in a weird way on 2613:44
weshaymandre, if you would like more eyes.. open a lp and maybe someone else can jump in with you13:45
mandreweshay: ack, will do13:46
weshaygeez.. status page has 30mb of json13:46
weshaymatbu, 4/6 last jobs passed  on gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container-upgrades-nv13:47
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Add OpenDayLight docker images  https://review.openstack.org/49495113:47
matbuweshay: im lagging, but this one is still red right : gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv ?13:47
weshaymatbu, we have a 60% pass rate today vs.. a 4% pass rate yesterday13:47
matbuweshay: nice13:47
matbuweshay: your patch solve a big tons of failure i guess13:48
weshaygate-tripleo-ci-centos-7-containers-multinode-upgrades-nv has a 71% pass rate today13:48
weshaymatbu, meh.. there were several patches I think13:48
matbuweshay: can you show a passing one ?13:48
weshaymatbu, not sure if all this has merged yet13:48
matbuweshay: i have pushed one yesterday for the pingtest stuffs13:48
weshayhttp://logs.openstack.org/49/495149/1/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/f7e562f/13:48
matbubut im still fighting  to reproduce the ping test failure13:49
weshaymatbu, ya.. so validate or tempest is not running13:50
matbuyep13:50
matbuim working on fixing that13:50
matbu(validate at least13:50
matbu)13:50
weshaymatbu, thank you!13:51
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates master: DO NOT MERGE. Test only.  https://review.openstack.org/49530413:52
mwhahahahappy friday or something13:52
gfidentejprovazn am I reading it right you got it green?13:55
shardyHmm, anyone looking at issues with the ovb jobs?  Seem to be hitting timeouts on many of them atm13:55
jprovazngfidente, hopefully :), the problem was that CI complained about  unknown system user "manila" (although this user is included in the overcloud-full image)13:57
atothanyone care to enlighten me about norpm? I gather that it is why my packages aren't being installed for the lbaasv2 stuff13:57
jprovazngfidente, puppet silently passes (with success code) in such sitaution13:58
shardyatoth: you mean the puppet package provider?13:58
atothshardy, I believe so13:58
shardyatoth: we disable package install by default, you can change it by passing EnablePackageInstall: true in an environment file13:58
*** anshul has quit IRC13:59
shardyatoth: the idea is the overcloud-full image should contain all the bits you need, so each node gets exactly the same packages etc13:59
*** sri_ has quit IRC13:59
shardyatoth: but optionally you could have a "thin" image without all the needed packages via EnablePackageInstall: true13:59
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Tag the ha containers with 'pcmklatest' at deploy time  https://review.openstack.org/49170514:00
atothshardy, I'm trying to update scenario003-multinode14:00
shardyatoth: ah, I thought the multinode jobs already enabled package install, sec14:00
atothshardy, do you think I should have that issue while running that scenario?14:00
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo master: Configure cache when setting up docker_registry  https://review.openstack.org/49445114:00
atothshardy, you're a faster typer than I :-)14:00
gfidentejprovazn so I left a comment about 1 issue with user/mode in ceph-external14:01
gfidenteand then there is the pep8 issue with params description mismathing but then I'd try to merge it14:01
mrungerlandy: thanks, I saw the patches, but didn't had the time to look at them in detail yet14:03
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo master: Configure cache when setting up docker_registry  https://review.openstack.org/49445114:03
jprovazngfidente, I was hoping that the last patchset fixes the pep8 issue, apparently not :/14:03
rlandymrunge: no rush - those patches are still WIP - just wanted to let you know about that rework so you'll understand if we abandon your original patch14:03
EmilienMlarsks: no need14:04
*** yprokule has quit IRC14:04
*** yprokule_ has joined #tripleo14:04
openstackgerritNuman Siddique proposed openstack/tripleo-quickstart-extras master: Support container_override_args  https://review.openstack.org/49525814:05
*** yprokule_ is now known as yprokule14:05
mrungerlandy: yes, it makes sense to integrate one-liners in bigger patches. Great stuff on making ovb more generic14:06
shardy -e /usr/share/openstack-tripleo-heat-templates/environments/deployed-server-bootstrap-environment-centos.yaml14:06
shardyatoth: ^^ AFAICS that should already set EnablePackageInstall: true14:06
openstackgerritNuman Siddique proposed openstack/tripleo-quickstart master: Add fset030 for OVN with containerized oc  https://review.openstack.org/49062414:06
jprovazngfidente, one thing regarding file mode, currently I use the same as for openstack keyring - root ownership and read permission for all. IMO it's too generous/insecure as there is read perms for anybody, did you consider restriction e.g. for group only?14:07
*** janki has quit IRC14:07
atothshardy, is that automatically tied into the scenario or (as it appears to me) should be added to the deployment command?14:08
shardyatoth: it's already in the configuration for the job, you can see it in the console.log14:08
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295514:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067814:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171142514:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)14:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)14:10
openstackLaunchpad bug 1711425 in tripleo "nova metadata broken in containerized environment" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)14:10
shardyhttp://logs.openstack.org/13/485213/3/check/gate-tripleo-ci-centos-7-scenario003-multinode-upgrades-nv/f747d09/logs/subnode-2/var/log/neutron/server.txt.gz#_2017-07-21_18_30_10_99914:13
*** pkovar has joined #tripleo14:13
shardyatoth: so that's the error right?  what package is needed to resolve that, or could it be missing configuration settings?14:13
atothshardy, checking my local logs for the deployed-server-bootstrap-environment-centos.yaml inclusion ,I had to comment out the controller and compute SoftwareConfig settings14:14
atothshardy, digging out the packages for you now....14:15
*** ramishra has quit IRC14:15
atothshardy, openstack-neutron-lbaas.noarch and python-neutron-lbaas.noarch14:16
*** ramishra has joined #tripleo14:17
atothshardy, I do not see the inclusion of   deployed-server-bootstrap-environment-centos.yaml locally, I'll add it to the deploy line and see if that resolves it14:18
*** bogdando has quit IRC14:18
shardyatoth: Ok, or if you're not using a pre-deployed server like in CI, just add EnablePackageInstall: true to an environment for local testing14:18
tdasilvashardy: any pointers on what might be happening here: http://paste.openstack.org/show/618772/ ?14:19
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: WIP create default settings for environment types  https://review.openstack.org/49467414:19
atothshardy, ok, thanks, I'll let you know how it goes.14:19
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Generalize OVB settings to fit feature set pattern  https://review.openstack.org/49465914:20
*** _jbadiapa has quit IRC14:21
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Generalize OVB settings to fit feature set pattern  https://review.openstack.org/49465914:21
openstackgerritMerged openstack/tripleo-heat-templates master: TLS everywhere/docker: add nova services to environment  https://review.openstack.org/49443014:21
openstackgerritMerged openstack/tripleo-common master: Add NovaMetadata to nova-api image params  https://review.openstack.org/49475014:21
*** yprokule has quit IRC14:22
pabelanger2 more merges :)14:22
openstackgerritJan Provaznik proposed openstack/tripleo-heat-templates master: Let mds create manila key and fs  https://review.openstack.org/48249614:22
openstackgerritMerged openstack/tripleo-heat-templates master: Restore and split nova metadata docker service out of nova-api.  https://review.openstack.org/49472714:23
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default  https://review.openstack.org/47241214:23
pabelangertoday is going to be telling for tripleo CI I think. Right now we are at 6hr32min delay in gate14:23
pabelangerI am hoping to cut that in 1/2 today14:24
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: Remove printing the introspection status  https://review.openstack.org/49424914:24
shardytdasilva: if you're running a recent t-h-t version, you'll need to rebase your custom roles_data.yaml to include some new data added e.g in https://review.openstack.org/#/c/482623/28/roles_data.yaml14:24
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: moving docker registry config to environment  https://review.openstack.org/49464714:25
shardytdasilva: Oh wait14:25
shardytdasilva: that is the issue, but you found a bug in overcloud.j2.yaml14:25
*** dansmith is now known as superdan14:26
shardyyour roles_data should work, but without adding support for the deprecated NovaComputeSchedulerHints parameter14:26
shardybut I didn't spot that is hard-coded in the overcloud template, sec let me fix it14:26
tdasilvashardy: it was on purpose that i found that bug ;)14:26
*** karthiks has quit IRC14:26
tdasilvajk14:26
shardytdasilva: haha, good work :)14:27
tdasilvashardy: thanks for looking14:27
*** MVenesio has joined #tripleo14:27
*** MVenesio has quit IRC14:28
*** itlinux has joined #tripleo14:28
*** MVenesio has joined #tripleo14:28
*** mdnadeem has quit IRC14:28
*** ekultails has joined #tripleo14:29
*** beagles has joined #tripleo14:30
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: Remove printing the introspection status  https://review.openstack.org/49424914:30
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Adds PostUpgradeConfigStepsDeployment to drive post config ansible  https://review.openstack.org/49387814:35
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Remove SchedulerHints params from overcloud template  https://review.openstack.org/49532414:35
*** itlinux has quit IRC14:36
shardytdasilva: ^^ try that14:36
shardytdasilva: note you will still want to rebase your roles_data.yaml to add the deprecated parameters if any of your environments use them14:36
shardy(or switch them to use the new not deprecated params instead s/NovaCompute/Compute/g14:36
*** _jbadiapa has joined #tripleo14:37
*** itlinux has joined #tripleo14:37
vkmcowalsh, hey :) sorry I didn't come back to you yesterday regarding the nova/ironic/mistral thing... shall I file a bug so we keep track of it and we add some more information on how we handle validations?14:38
mariosshardy: do you think my last comment in https://review.openstack.org/#/c/493878/7 is true... i.e. "" vs '' could cause the error there (TypeError: sequence item 6: expected string or Unicode, list found ) - if you get a chance not urgent thanks14:38
d0ugalvkmc: I think a bug to track new validation ideas would be useful.14:38
vkmcd0ugal, that should be filed on Mistral, right?14:39
d0ugalvkmc: tripleo14:39
vkmcd0ugal, k, will report then14:39
vkmcthanks14:39
d0ugalvkmc: the validation would be added to triple-common14:39
d0ugalthank you!14:39
vkmcoh right14:39
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Change the default name of white list file  https://review.openstack.org/49532714:39
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Adds PostUpgradeConfigStepsDeployment to drive post config ansible  https://review.openstack.org/49387814:40
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: Mock out the creation of the tempest config  https://review.openstack.org/49532814:41
*** aditya_r has quit IRC14:41
EmilienMmatbu: pingtest still failing after an upgrade to containers: http://logs.openstack.org/00/461000/44/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/d8539f9/logs/undercloud/home/jenkins/overcloud_validate.log.txt.gz#_2017-08-18_07_06_4514:43
EmilienMmatbu: it fails here: http://logs.openstack.org/00/461000/44/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/d8539f9/logs/subnode-2/var/log/containers/glance/api.log.txt.gz#_2017-08-18_07_06_45_57314:45
EmilienMmatbu: it sounds like swift isn't working well14:45
*** ramishra has quit IRC14:46
tdasilvashardy: so I tried adding the deprecated parameters and kicked off another deploy (without our patch) and it seems to be deploying...no errors yet, is that expected?14:48
*** iranzo has quit IRC14:48
shardymarios: hey I don't think that would cause the error, but looking for possible other reasons14:48
*** iranzo has joined #tripleo14:49
*** iranzo has quit IRC14:49
*** iranzo has joined #tripleo14:49
shardytdasilva: so you added the deprecated_param_scheduler_hints: 'NovaComputeSchedulerHints' to your roles_data.yaml?14:49
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP: Adds pacemaker update_tasks for Pike minor update workflow  https://review.openstack.org/48656714:49
shardytdasilva: if so then yes that would also solve your problem14:50
*** jfrancoa has quit IRC14:50
tdasilvashardy: yes, that's what i did14:50
tdasilvashardy: just so it's clear, with your patch I wouldn't need those deprecated options in the roles_data.yaml?14:51
owalshvkmc: hi, yea, it would good to file a bug14:51
shardytdasilva: yes, but in general I think we'll reccomend folks to include them in their roles_data.yaml so they get a warning if they use any of the old deprecated parameter names14:51
tdasilvashardy: ah ok...yeah, it was in the original file where I copied it from under /usr/share/... but then I removed just to simplify the file, but will keep it there now :)14:52
owalshEmilienM, dprince: re nova-metadata... seems it's never been a composable service, just an add-on to nova-api14:52
mariosack thanks for looking shardy14:53
*** ramishra has joined #tripleo14:53
EmilienMowalsh: ok14:53
vkmcowalsh++14:54
owalshEmilienM, dprince: so any objections to leaving it as-is for pike and working on splitting it out from nova api in queens?14:54
EmilienMowalsh: wfm14:54
EmilienMowalsh: btw, I tested and it works fine: https://review.openstack.org/#/c/494284/14:54
EmilienMowalsh: running tempest now works fine14:54
owalshEmilienM: ack, yea, and CI was on my side last night :-)14:54
dprinceowalsh: correct14:55
dprinceowalsh: just an 'add-on', but it was at least working before14:55
*** paramite has quit IRC14:55
*** itlinux has quit IRC14:56
dprinceowalsh: waiting till queens if fine by me as well to split them14:56
pradkgfidente, so regarding mounting /etc/ceph .. i understand EmilienM 's concern on mounting that dir even if ceph is not deployed per https://review.openstack.org/#/c/482500/14:56
owalshEmilienM, dprince: great, thanks14:56
EmilienMyeah that's not very clean imho14:56
pradkgfidente, even though its not erroring, perhaps we could add some if checks to see if ceph is enabled and only mount/create that dir?14:57
EmilienMowalsh, dprince: yeah we can clean that up in queens, I'm ok with it14:57
shardymarios: I think I might have spotted the problem, comment added14:57
radeznumber80: ping, have you continued to deploy the aarch bits?14:58
number80radez: not recently14:58
*** jaganathan has joined #tripleo14:58
radezhm :/ k, I'm trying to sort out what's going wrong with my ooo deploy, but iirc you were using packstack?14:59
*** colonwq has quit IRC15:01
*** fzdarsky has quit IRC15:01
*** bogdando has joined #tripleo15:02
matbuEmilienM: yep i saw that this mroning15:03
matbuEmilienM: im trying to reproduce it to debug15:03
EmilienMmatbu: I think swift upgrade isn't done yet15:03
EmilienMtdasilva: you confirm? ^15:03
number80radez: yes, I hadn't even enough disk or RAM to try 3o on aarch6415:03
*** colonwq has joined #tripleo15:04
radeznumber80: I've been collecting hardware :)15:04
pabelangerEmilienM: mwhahaha: how long does it usually take to run TASK [overcloud-deploy : Deploy the overcloud] ?15:04
tdasilvaEmilienM: I'm aware of this patch: https://review.openstack.org/#/c/494008/15:04
mariosshardy: thanks very much checking it15:04
matbuEmilienM: so there is an alternative of the ping test15:04
matbuthen15:04
EmilienMmatbu: we need https://review.openstack.org/#/c/494008/4/docker/services/swift-ringbuilder.yaml I think15:04
EmilienMpabelanger: let me check15:05
matbuEmilienM: is it possible to add the review to the chain of the reviews ?15:05
EmilienMpabelanger: http://logs.openstack.org/68/492768/5/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/f828de5/logs/ara_oooq/file/1470ea87-37a1-46de-a1ed-e840c16e6b20/#line-115:06
EmilienMpabelanger: 43 min on that job15:06
EmilienMmatbu: yes I will15:06
matbuEmilienM: cool15:06
EmilienMmatbu: I'm also thinking at disabling swift on that job, we should run swift on one scenario already15:06
pabelangerEmilienM: k, pushing 1:10:38.744464 on vexxhost currently.15:07
pabelangerEmilienM: have a patch up to reduce vexxhost back to 20 nodes15:07
matbuEmilienM: yep make sense15:08
EmilienMmatbu: scenario002 already cover swifts15:08
EmilienMi'll remove it from the basic job15:09
EmilienMand use file instead15:09
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Adds PostUpgradeConfigStepsDeployment to drive post config ansible  https://review.openstack.org/49387815:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295515:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067815:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)15:10
*** links has quit IRC15:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Attila Darazs (adarazs)15:10
owalshradez: did I read that right - you're deploying ooo on aarch64?15:11
*** tzumainn has quit IRC15:11
*** ebarrera has quit IRC15:11
*** tzumainn has joined #tripleo15:11
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: ci: don't deploy swift on basic multinode job  https://review.openstack.org/49534815:12
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Upgrade CI test - never merge  https://review.openstack.org/46100015:14
EmilienMmatbu: trying again without swift15:14
*** aufi has quit IRC15:15
*** fzdarsky has joined #tripleo15:16
EmilienMmarios, matbu, chem: it would be great to update the tripleo-docs with the steps to upgrade from Ocata to Pike, (and make sure quickstart follows the exact steps from the doc, like https://review.openstack.org/#/c/494590/)15:16
*** egonzalez has quit IRC15:16
EmilienMcan we take an action on that? (launchpad bug, etc)15:17
radezowalsh: yup, collecting fixes to submit some patches to add aarch support to rdo15:17
radezowalsh: I can provision machines so far and the deploy fails after network configuration and before puppet starts to run15:18
matbuEmilienM: yep i'll take care of that15:18
EmilienMmatbu: thx15:18
matbuEmilienM: thank you for the review ^15:18
owalshradez: cool, I'm interested in the details, looking at ppc64le support15:18
matbuEmilienM: keep me in touch of the status of the job, i won't be so far from my keyboard in the next few hours15:18
radezowalsh: sure, wanna catch up on a bjs or something to chat?15:18
EmilienMmatbu: ack15:19
owalshradez: next week ok? sneaking away soon, and on PTO monday15:19
radezowalsh: you bet, enjoy ur time off. ping me when you're back. I'd love to trade notes15:20
*** udesale has joined #tripleo15:21
owalshradez: will do. I don't have much to trade yet though, just starting to look at this15:22
openstackgerritMerged openstack/puppet-tripleo master: Create separate resource for HAProxy horizon endpoint  https://review.openstack.org/49143715:23
openstackgerritMerged openstack/puppet-tripleo master: Enable TLS in the internal network for horizon  https://review.openstack.org/48959315:23
openstackgerritMerged openstack/tripleo-ui master: Run generated messages file through prettier  https://review.openstack.org/48661315:23
openstackgerritMerged openstack/python-tripleoclient master: Adds when in upgrade_tasks playbook written by config download  https://review.openstack.org/49174915:23
radezowalsh: no worries, I can share what I've got so far and see if it helps you get going15:24
openstackgerritMerged openstack/python-tripleoclient master: Remove the unused function "create_default_plan"  https://review.openstack.org/47886515:24
openstackgerritMerged openstack/tripleo-common master: Publish logs before exporting them  https://review.openstack.org/49381915:24
pabelangerBlam!15:24
pabelangeranother 6 merges15:24
pabelangeron a roll today15:24
owalshradez: sweet, ttyl & have a good weekend15:25
openstackgerritMerged openstack/tripleo-heat-templates master: Enable listening on TLS for the internal network for horizon  https://review.openstack.org/48959615:25
*** MVenesio has quit IRC15:25
EmilienMpabelanger: we need more ! always more :)15:27
mariosEmilienM: ack thanks for reminder15:27
EmilienMmarios: I've got upgrade workings in CI now, let's polish the way we test and we're in better shape15:27
*** atoth has quit IRC15:27
weshaywoot!15:28
pabelangerEmilienM: weshay: mwhahaha: okay, I think we're finally seeing the light of day for gate pipeline. Right now, back down to sub 3hrs gate, and good indications jobs will keep passing.  Currently infra issues appear to be issue with infracloud-vanilla mirror, seeing 502 bad gateway back from buildlogs:15:29
pabelangerhttp://logs.openstack.org/39/494639/1/gate/gate-tripleo-ci-centos-7-nonha-multinode-oooq/4014b45/logs/undercloud/home/jenkins/install_packages.sh.log.txt.gz#_2017-08-18_15_08_37 and general load issues in vexxhost15:29
pabelangerSo, lets land the DLRN mirror fixes today15:29
pabelangerand we can now start looking into specific jobs that are failing15:29
weshayyup yup15:29
*** fzdarsky has quit IRC15:29
openstackgerritMerged openstack/tripleo-validations master: Updated from global requirements  https://review.openstack.org/49527815:30
weshayadarazs, this one right? https://review.openstack.org/#/c/494262/15:31
EmilienMI'll approve it once it works in all ci jobs15:32
weshaytrown, rlandy daily standup15:32
EmilienMpabelanger: do you remember in which oooq log we can see if delorean building is using mirrors?15:34
rajinirEmilienM Have a bunch of pending patches, that was granted FFE ( puppet-tripleo and Heat templates). Need some help on reviews/merge15:34
adarazsEmilienM: I checked the failed scenario gate and it doesn't seem relevant.15:34
EmilienMadarazs: yeah, let's recheck to kick off another run15:34
EmilienMrajinir: can you link by gerrit topic maybe? We'll have a look15:35
adarazsEmilienM: for example this: http://logs.openstack.org/35/494235/3/gate/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-puppet/87a3fef/logs/delorean_logs/05/84/0584784dd43d27d67bcc1583cdb5631dbffd5cba_dev/rpmbuild.log.txt.gz15:35
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Add options to use local DLRN and CentOS mirrors  https://review.openstack.org/49426215:35
adarazsEmilienM: you can see the repos around the top part.15:35
pabelangerEmilienM: mock.log should have listing of available repos15:35
rajinirhttps://www.irccloud.com/pastebin/UlB2BZxF/Pending%20reviews15:36
EmilienMadarazs: it fails, see http://logs.openstack.org/35/494235/3/gate/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-puppet/87a3fef/logs/delorean_logs/05/84//0584784dd43d27d67bcc1583cdb5631dbffd5cba_dev/rpmbuild.log.txt.gz15:37
EmilienM  3:mariadb-config-10.1.20-1.el7.x86_64: [Errno 256] No more mirrors to try.15:37
rajinirEmilienM: Pasted the reviews above15:37
EmilienMit's using buildlogs.centos.org15:37
*** jprovazn has quit IRC15:37
*** jmelvin has quit IRC15:37
EmilienMI don't see mirrors on http://logs.openstack.org/35/494235/3/gate/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-puppet/87a3fef/logs/delorean_logs/05/84//0584784dd43d27d67bcc1583cdb5631dbffd5cba_dev/mock.log.txt.gz15:37
adarazsEmilienM: which change is that log from?15:37
EmilienMadarazs: the one you linked ^^15:38
*** iranzo has quit IRC15:38
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Add upgrade task to move swift ring files to be reachable by docker  https://review.openstack.org/49351815:38
EmilienMadarazs: 2 min ago you linked something, I used this one.15:38
adarazshmm, sec.15:38
adarazslet me check if that's the correct one :)15:38
pabelangerthink 494538 will show it15:39
pabelangerbut needs to be rechecked again15:39
*** jlinkes has quit IRC15:41
*** achadha has joined #tripleo15:42
*** atoth has joined #tripleo15:43
adarazsEmilienM, pabelanger: yep, I remember that worked. but zuul didn't post the multinode logs to https://review.openstack.org/494538 because of these weird merge error15:44
adarazswhich doesn't make sense.15:44
pabelangeradarazs: that is because somebody rebased one of the depends-on patches, so zuul dequeues the jobs in 494538.  A recheck there will cause the jobs to run again15:46
adarazsah, okay.15:46
*** mrch has quit IRC15:47
*** aditya_r has joined #tripleo15:48
gfidentejistr https://review.openstack.org/#/c/479288/ thanks!15:49
tdasilvashardy: so that deployment seems to be just "stuck", looking at overcloud_deploy.log and that seems to be the previous deployment. do we write the log to a temp location while deploying?15:54
tdasilvashardy: stuck here: http://paste.openstack.org/show/618784/15:55
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Render port templates via j2  https://review.openstack.org/49536715:56
ansiwentrown: is it possible to use quickstart in a way, that the virthost is also becomeing the compute node, so I have a "baremetal" effect? I'm setting up real-time stuff and would like to avoid setting up everything twice on the host and on the compute node (if nested RT works at all)15:57
shardytdasilva: Unfortunately we don't, but if you do ps ax | grep puppet on the node, you'll see the heat hook running puppet apply - you can kill it and re-run manually with --debug added to see where it's stuck15:57
shardytdasilva: note you'll need to add "step: 3" to one of the files under /etc/puppet/hieradata15:57
shardybut the other data should all still be valid15:57
ansiwentrown: I hope you understand what I mean. that the undercloud deploys the compute-node directly on the host, so that the overcloud VMs will basically run in parallel to the undercloud VMs on the host.15:58
openstackgerritOpenStack Proposal Bot proposed openstack/python-tripleoclient master: Updated from global requirements  https://review.openstack.org/49491615:58
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/48739816:00
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/48814816:00
openstackgerritMerged openstack/tripleo-heat-templates master: Also write an upgrade_tasks_playbook  https://review.openstack.org/49084816:01
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Make configurable docker registry WIP  https://review.openstack.org/49448316:01
tdasilvashardy: grepping for puppet returns nothing16:01
tdasilvaheat does16:01
*** shardy has quit IRC16:03
*** achadha has quit IRC16:08
*** jpich has quit IRC16:09
*** jtomasek has quit IRC16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295516:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067816:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)16:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)16:10
*** pcaruana has quit IRC16:12
*** tesseract has quit IRC16:12
*** rcernin has quit IRC16:12
homeskireload16:17
*** bogdando has quit IRC16:17
weshaytrown, can't this go into an env config? https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset-multinode-common.yml16:21
*** pkovar has quit IRC16:23
*** thrash is now known as thrash|biab16:23
trownweshay: well I think we would want those with libvirt as well... we have too many places where the name multinode actually means deployed server16:23
weshaytrown, agree on the name conflict16:24
weshayso is that sudo tech debt until we fix that?16:25
trownweshay: but those settings seem more like featureset-deployed_server-common.yml16:25
weshayagree..16:25
trownweshay: and would probably be better done via the include mechanism you have been doing16:25
weshayand I hope we can have a deployed-server env file16:25
weshaylike we have for baseos16:26
weshaytrown, or that16:26
weshayya.. I'm revving on the vars16:26
weshaynow16:26
weshaybrb16:26
*** salmankhan has quit IRC16:27
*** marios has quit IRC16:27
ansiwentrown: did you read my messages from before?16:27
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Add storage backends env files for containerized deployment  https://review.openstack.org/49537016:28
trownansiwen: sorry missed that16:28
trownansiwen: but probably not16:28
*** salmankhan has joined #tripleo16:29
*** itlinux has joined #tripleo16:29
ansiwentrown: probably it's not possible with quickstart, or probably it's not possible at all?16:29
trownansiwen: there is definitely no configuration for it in quickstart... not sure if it is possible or not16:30
*** itlinux has quit IRC16:31
ansiwentrown: I see, thanks!16:31
* weshay reads16:33
*** salmankhan has quit IRC16:33
mwhahahaEmilienM: https://review.openstack.org/#/c/474578/ do you still want to hold off on that since talking to marios?16:34
EmilienMmwhahaha: where is the undercloud-upgrade job ??? in https://review.openstack.org/#/c/474578/16:37
EmilienMah nevermind16:37
EmilienMmwhahaha: I'm fine merging it16:37
EmilienMmwhahaha: I'm just trying to limit the risks here16:37
EmilienMI'm approving it16:37
*** ramishra has quit IRC16:37
mwhahahak16:37
EmilienMbut if it proves to not working well, I won't hesitate to revert16:38
mwhahahaworks for me16:38
*** itlinux has joined #tripleo16:38
mwhahahathat should be our standard course of action anyway :D16:38
*** ykarel has quit IRC16:39
*** karthiks has joined #tripleo16:40
*** gkadam has quit IRC16:41
*** mcornea has quit IRC16:43
*** catinthe_ has quit IRC16:43
*** aditya_ra has joined #tripleo16:44
*** catintheroof has joined #tripleo16:45
*** lucasagomes is now known as lucas-afk16:46
openstackgerritEmilien Macchi proposed openstack/tripleo-ui master: Release 7.3.0 (pike rc1)  https://review.openstack.org/49537316:46
EmilienMjrist: needed asap ^16:46
*** aditya_r has quit IRC16:47
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: More fixes for the Ceph docker images url parsing  https://review.openstack.org/49537416:47
jristEmilienM: noted16:48
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Prepare reno for TripleO Pike RC1  https://review.openstack.org/49537516:50
openstackgerritMerged openstack/tripleo-docs master: Further document disable node updates  https://review.openstack.org/49368016:50
jristEmilienM: mind looking here? https://review.openstack.org/#/c/469608/16:51
jristEmilienM: that is the last piece needed (for sure) for logging16:52
*** thrash|biab is now known as thrash16:52
jristEmilienM: otherwise I can +1 that tag16:52
EmilienMjrist: sad there is no release note16:52
jristlol16:52
jristdangit16:52
jristhonza: ^ :)16:52
EmilienMthey are very often missed16:52
EmilienMpoor users16:52
jrist;_;16:53
jristI totally forgot about that for this16:53
*** gfidente is now known as gfidente|afk16:54
openstackgerritEmilien Macchi proposed openstack/tripleo-puppet-elements master: Prepare reno for TripleO Pike RC1  https://review.openstack.org/49537616:54
openstackgerritEmilien Macchi proposed openstack/tripleo-image-elements master: Prepare reno for TripleO Pike RC1  https://review.openstack.org/49537716:56
*** ykarel has joined #tripleo16:58
*** jpena is now known as jpena|off17:03
*** itlinux has quit IRC17:03
*** rbowen has quit IRC17:08
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295517:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067817:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)17:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)17:10
*** ykarel has quit IRC17:11
*** karthiks has quit IRC17:12
*** karthiks has joined #tripleo17:12
*** pkovar has joined #tripleo17:14
jristEmilienM: https://twitter.com/ossia/status/89832115557621350817:19
EmilienMheh17:20
*** rbowen has joined #tripleo17:23
*** achadha has joined #tripleo17:24
*** achadha has quit IRC17:24
*** achadha has joined #tripleo17:25
atothEmilienM, beagles, so I think I'm down to the last issue (hopefully), which seems to be that neutron_lbaas.services.loadbalancer.plugin.LoadBalancerPluginv2 is not defined. I see that Kolla had the same issue for this and others and they updated a config.py file.  I'm wondering what the equivalent would be here.17:28
*** cylopez has quit IRC17:29
EmilienMatoth: cool17:29
*** aditya_r has joined #tripleo17:29
atothEmilienM, any thoughts on where to define it here?17:30
*** aditya_ra has quit IRC17:31
*** jbadiapa_ has joined #tripleo17:31
*** tosky has quit IRC17:32
*** itlinux has joined #tripleo17:34
*** _jbadiapa has quit IRC17:34
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Separate config_volume for ringbuilder  https://review.openstack.org/49400817:43
*** brault has quit IRC17:44
pabelangerEmilienM: adarazs: weshay: this looks right now: http://logs.openstack.org/38/494538/3/check/gate-tripleo-ci-centos-7-undercloud-oooq/39d277e/logs/delorean_logs/91/d3/91d38f182a0d2f092ccf38215e146206bea5a8ce_dev/mock.log.txt.gz17:49
*** brault has joined #tripleo17:49
weshayyup17:50
*** homeski_ has joined #tripleo17:54
pabelangeranother DLRN mirror failure in gate: http://logs.openstack.org/05/494005/3/gate/gate-tripleo-ci-centos-7-containers-multinode/0b0501a/logs/delorean_logs/e0/ef/e0ef2ebd1f8c11f79451a91f279879ac61c1951e_dev/root.log.txt.gz17:54
*** itlinux has quit IRC17:54
pabelangergood thing we have a patch :)17:54
*** brault has quit IRC17:55
*** pkovar has quit IRC17:56
*** tosky has joined #tripleo17:57
pabelangerweshay: EmilienM: mwhahaha: I think next week, I want to start looking into OVB jobs and maybe see about killing off your private http proxy in tripleo-test-cloud-rh1.  Not sure it is needed any more at this point17:57
openstackgerritNuman Siddique proposed openstack/tripleo-quickstart master: Add fset030 for OVN with containerized oc  https://review.openstack.org/49062417:58
pabelangerthen a lot of the HTTP_PROXY logic could be removed17:58
weshaypabelanger, those will be moving in the very near future17:58
weshaynot sure if that would be a top priority for your time17:58
pabelangerweshay: ya, rdocloud is another thing to talk about too :)17:58
weshaypabelanger, I think we do need a proxy for containers in rdocloud though17:58
pabelangerweshay: ya, RDOcloud should setup the same mirror infrastrucutre we have today. It should be easy to reproduce17:59
weshayaye17:59
weshayrlandy, fyi ^17:59
*** morazi has quit IRC18:01
*** itlinux has joined #tripleo18:05
*** florianf has quit IRC18:07
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295518:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067818:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)18:10
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: Generalize OVB settings to fit feature set pattern  https://review.openstack.org/49540518:12
*** salmankhan has joined #tripleo18:13
*** leitan has joined #tripleo18:13
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: WIP create default settings for environment types  https://review.openstack.org/49540718:13
*** jcoufal has quit IRC18:13
*** itlinux has quit IRC18:16
EmilienMweshay: I got pingtest working after an upgrade \o/18:16
weshayEmilienM++18:16
EmilienMhttp://logs.openstack.org/00/461000/45/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/300ed3c/logs/undercloud/home/jenkins/overcloud_validate.log.txt.gz#_2017-08-18_17_59_1718:16
EmilienMweshay: I'll test with tempest as well18:21
EmilienMweshay: is the whitelist problem fixed?18:21
*** aditya_r has quit IRC18:21
*** jcoufal has joined #tripleo18:22
*** trown is now known as trown|lunch18:23
openstackgerritPradeep Kilambi proposed openstack/puppet-tripleo stable/ocata: Move gnocchi::api resource to run with wsgi setup  https://review.openstack.org/48943718:25
weshayEmilienM, I would only know if I ran it locally, I don't think it is18:25
EmilienMrajinir: we're waiting your answer on https://review.openstack.org/#/c/49107818:26
*** salmankhan has quit IRC18:29
*** dprince has quit IRC18:32
*** catinthe_ has joined #tripleo18:33
*** catinth__ has joined #tripleo18:33
*** udesale has quit IRC18:34
*** catintheroof has quit IRC18:35
*** catinthe_ has quit IRC18:37
*** achadha has quit IRC18:39
*** achadha has joined #tripleo18:39
EmilienMatoth: I'm going to close https://blueprints.launchpad.net/tripleo/+spec/lbaasv2-service-integration for pike cycle and mark it as implemented - but please keep working in the CI thing18:46
EmilienMtrozet: moving https://blueprints.launchpad.net/tripleo/+spec/quickstart-opnfv to queens-1 unless we have made progress but I haven't seen updates from michapma on this one18:46
openstackgerritMerged openstack/tripleo-docs master: Update Pike storage documentation for ceph-ansible  https://review.openstack.org/48715518:46
openstackgerritMerged openstack/tripleo-docs master: Drop stable branch section from earlier than Newton  https://review.openstack.org/49323218:46
openstackgerritMerged openstack/tripleo-docs master: Don't use deprecated/removed cli args in net-iso docs  https://review.openstack.org/49401918:47
EmilienMrajinir: you need to follow what mwhahaha said (alex) he asked to rebase to avoid conflict so we can merge it on time18:48
*** jaganathan has quit IRC18:48
EmilienMrajinir: please do it or it won't merge on time18:48
*** itlinux has joined #tripleo18:49
*** dprince has joined #tripleo18:49
*** prad_ has joined #tripleo18:49
*** prad_ is now known as prad18:49
EmilienMgfidente|afk: any thoughts on closing https://blueprints.launchpad.net/tripleo/+spec/tripleo-ceph-ansible ? sounds like the work is done18:50
EmilienMand almost gated18:50
openstackgerritgreghaynes proposed openstack/diskimage-builder master: Add networkd-dhcp element  https://review.openstack.org/45941918:53
atothEmilienM, sounds like a plan18:54
EmilienMdprince: can you rebase https://review.openstack.org/#/c/442716 please? do you want it in pike? I see ironic inspector need that18:56
*** salmankhan has joined #tripleo18:56
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Certmonger: Make postsave command configurable  https://review.openstack.org/49408518:59
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Certmonger: Make postsave command configurable  https://review.openstack.org/49408518:59
*** jbadiapa_ has quit IRC19:01
dprinceEmilienM: yes19:03
dprinceEmilienM: so many rebases for these19:04
EmilienMdprince: I'm happy if we can merge it today19:04
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: enable pingtest on scenarios container upgrade jobs  https://review.openstack.org/49541319:09
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Upgrade CI test - never merge  https://review.openstack.org/46100019:10
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295519:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067819:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)19:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)19:10
*** paramite has joined #tripleo19:10
*** itlinux_ has joined #tripleo19:10
*** pchavva has quit IRC19:10
*** brault has joined #tripleo19:12
EmilienMpabelanger: approving https://review.openstack.org/#/c/494262/19:12
pabelangerEmilienM: ++19:13
EmilienMpabelanger: https://review.openstack.org/#/c/494537 will be the real activation19:13
EmilienMI'll monitor it19:13
pabelangerack19:13
*** leitan has quit IRC19:14
*** CaptTofu has quit IRC19:15
*** itlinux_ has quit IRC19:15
*** itlinux has quit IRC19:15
*** brault has quit IRC19:16
*** jbadiapa_ has joined #tripleo19:17
*** itlinux_ has joined #tripleo19:18
*** itlinux has joined #tripleo19:18
*** salmankhan has quit IRC19:18
*** salmankhan has joined #tripleo19:21
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Drop step_config as top level docker requirement  https://review.openstack.org/44271619:21
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: docker: Add unit tests on service_name  https://review.openstack.org/44275519:21
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker templates to configure Ironic inspector  https://review.openstack.org/45782219:21
dprinceEmilienM: ^^19:22
*** beagles has left #tripleo19:26
owalshSlower: freenode has set mode +R so I can't reply19:27
Slowerowalsh: ah ok19:27
owalshSlower: unless you /mode Slower -R19:27
Slowerowalsh: anyway.. I'm just testing upstream.. that going to be enough? :)19:27
owalshSlower: not for the restart policy issue, that was downstream only19:28
owalshSlower: but I think the issue of the virtlogd socket not existing on restart should be resolved by https://review.openstack.org/46911619:29
Slowerowalsh: correct19:29
*** greghayn1 has joined #tripleo19:34
*** DrBacchus has joined #tripleo19:34
*** greghaynes has quit IRC19:34
*** DrBacchus has quit IRC19:34
*** DrBacchus has joined #tripleo19:34
*** greghayn1 has left #tripleo19:35
*** rbowen has quit IRC19:35
*** DrBacchus is now known as rbowen19:35
*** jkilpatr has quit IRC19:35
*** pchavva has joined #tripleo19:36
*** dsariel has joined #tripleo19:40
*** trown|lunch is now known as trown19:44
*** jkilpatr has joined #tripleo19:50
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: Add containers periodic test  https://review.openstack.org/47574719:52
*** rbowen has quit IRC19:53
*** rbowen has joined #tripleo19:54
*** salmankhan has quit IRC19:54
*** homeski_ has quit IRC19:55
*** salmankhan has joined #tripleo19:57
*** prad has quit IRC19:59
*** pchavva has quit IRC20:02
*** homeski_ has joined #tripleo20:04
*** ansmith has quit IRC20:09
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295520:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067820:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)20:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)20:10
*** dougbtv has quit IRC20:12
*** ekultails has quit IRC20:19
EmilienMdprince: thanks20:20
*** homeski has quit IRC20:20
*** salmankhan has quit IRC20:21
*** itlinux_ has quit IRC20:22
*** itlinux has quit IRC20:22
*** salmankhan has joined #tripleo20:24
*** homeski_ is now known as homeski20:28
*** homeski has quit IRC20:28
*** homeski has joined #tripleo20:28
*** itlinux has joined #tripleo20:29
*** itlinux_ has joined #tripleo20:30
*** dprince has quit IRC20:32
pabelangerEmilienM: some slowdown in gate today because of DNS issue on overcloud. Have patch ready for infra, but likely monday at this time before we merge it20:34
pabelangerEmilienM: aside from that, things are looking good20:34
*** salmankhan has quit IRC20:36
*** jcoufal has quit IRC20:38
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: WIP create default settings for environment types  https://review.openstack.org/49467420:39
*** eck` is now known as eck`gone20:42
*** homeski has quit IRC20:46
*** homeski has joined #tripleo20:46
*** homeski has quit IRC20:47
*** itlinux has quit IRC20:48
*** itlinux_ has quit IRC20:48
*** trown is now known as trown|outtypewww20:48
openstackgerritTim Rozet proposed openstack/tripleo-quickstart-extras master: Add opendaylight to collect-logs  https://review.openstack.org/49404320:49
openstackgerritTim Rozet proposed openstack/tripleo-quickstart-extras master: Add opendaylight to collect-logs  https://review.openstack.org/49404320:50
pabelangerEmilienM: actually, it looks like you also have overcloud_dns_servers, we need to ensure they are also 127.0.0.1 for jobs.  Going to see what they default to now20:50
EmilienMpabelanger: ok good20:54
EmilienMpabelanger: just fyi I'm afk monday to thursday included - alex will be around20:54
*** itlinux_ has joined #tripleo20:58
*** itlinux has joined #tripleo20:58
pabelangerEmilienM: it is possible OVB is using 8.8.8.8, but I haven't looked much at those jobs currently21:00
EmilienMlet me check21:03
*** abishop has quit IRC21:04
EmilienMpabelanger: http://logs.openstack.org/37/494537/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/b0470ca/logs/undercloud/etc/resolv.conf.txt.gz21:05
EmilienMit's trying 10.1.8.10 first21:05
*** rlandy is now known as rlandy|afk21:05
EmilienMbnemec: any idea what is this ip?21:05
pabelangerEmilienM: Ya, that is wrong. It should use unbound service there too21:05
bnemecEmilienM: It's local to rh1.21:05
pabelangeris that node from nodepool? or heat?21:05
bnemecWe had to use that back in the day because DNS traffic was killing the bastion.21:06
EmilienMalso https://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci-quickstart/config/testenv/ovb.yml#n3821:06
pabelangerYa, move to RDOCloud changes some of this too. So, not really looking at OVB ATM21:07
pabelangerbut want too once on RDO21:07
EmilienMok21:07
EmilienMso no change now21:07
EmilienMmaybe we could switch to another dns though21:07
EmilienMwithout rate limit?21:07
pabelangerunless you want to make OVB and tripleo-quickstart be the same. Because 1 setup DNS in overcloud, the other doesn't21:07
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295521:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067821:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)21:10
*** salmankhan has joined #tripleo21:11
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Add converge step to the container upgrade  https://review.openstack.org/49459021:12
*** paramite has quit IRC21:13
*** superdan is now known as dansmith21:19
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Mount ceph config on gnocchi statsd  https://review.openstack.org/49463921:22
*** catintheroof has joined #tripleo21:22
*** catinth__ has quit IRC21:25
*** salmankhan has quit IRC21:27
*** saneax_-_ has quit IRC21:33
*** itlinux_ has quit IRC21:33
*** itlinux has quit IRC21:33
openstackgerritMerged openstack/tripleo-quickstart master: fs010: enable tempest  https://review.openstack.org/49428421:44
*** ansmith has joined #tripleo21:45
*** yamahata has joined #tripleo21:46
*** rlandy|afk is now known as rlandy21:46
*** catintheroof has quit IRC21:57
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Move common multinode role setup from tripleo-ci  https://review.openstack.org/48740822:02
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Add featureset for 3nodes multinode job  https://review.openstack.org/48615522:08
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch scenario007 to run Tempest  https://review.openstack.org/49429322:08
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch scenario004 to run Tempest  https://review.openstack.org/49111322:08
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Enable pingtest on 2 scenarios container jobs  https://review.openstack.org/49012922:09
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch scenario003 to run Tempest  https://review.openstack.org/49429022:09
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch scenario002 to run Tempest  https://review.openstack.org/49110222:09
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295522:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067822:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)22:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)22:10
*** gvrangan has joined #tripleo22:10
EmilienMI'm seeing this random error when deploying in containers: http://logs.openstack.org/13/495413/1/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container/d57a124/logs/subnode-2/var/log/messages.txt.gz#_Aug_18_20_33_2522:13
EmilienMSlower: have you seen this before? ^22:13
EmilienMit makes the overcloud deployment failing22:13
EmilienMhttp://logs.openstack.org/13/495413/1/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container/d57a124/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-08-18_20_33_5022:13
*** bnemec has quit IRC22:15
openstackgerritMerged openstack/tripleo-docs master: Update SSL docs to refer to the generated environments  https://review.openstack.org/49426922:17
openstackgerritMerged openstack/tripleo-docs master: Document relation between self-signed certs and parameters  https://review.openstack.org/49427822:18
*** akrivoka has quit IRC22:21
*** salmankhan has joined #tripleo22:23
*** gfidente|afk has quit IRC22:26
*** rlandy has quit IRC22:29
openstackgerritMerged openstack/puppet-tripleo stable/ocata: Always start httpd at the same time  https://review.openstack.org/49375422:37
openstackgerritMerged openstack/os-net-config stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49471222:38
openstackgerritMerged openstack/os-apply-config stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49470822:38
openstackgerritMerged openstack/os-apply-config stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike  https://review.openstack.org/49470922:38
openstackgerritMerged openstack/os-apply-config master: Updated from global requirements  https://review.openstack.org/49486422:38
openstackgerritMerged openstack/os-collect-config stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49471022:38
openstackgerritMerged openstack/os-collect-config master: Updated from global requirements  https://review.openstack.org/49486622:38
openstackgerritMerged openstack/os-refresh-config stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49471322:38
openstackgerritMerged openstack/os-refresh-config stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike  https://review.openstack.org/49471422:38
openstackgerritMerged openstack/os-refresh-config master: Updated from global requirements  https://review.openstack.org/49486722:39
openstackgerritMerged openstack/os-refresh-config stable/pike: Updated from global requirements  https://review.openstack.org/49529222:39
pabelangernice merge stream23:04
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295523:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171067823:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)23:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1710678 in tripleo "DLRN not configured to use regional mirrors" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)23:10
*** dhill_ has quit IRC23:11
openstackgerritMerged openstack/tripleo-heat-templates master: Workaround for RHEL registration as "localhost"  https://review.openstack.org/49466923:14
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Configure the set of tests to execute in scenario001  https://review.openstack.org/49037623:15
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Configure the set of tests to execute in scenario001  https://review.openstack.org/49037623:17
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Don't disable satellite repo after registration  https://review.openstack.org/49545023:18
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Workaround for RHEL registration as "localhost"  https://review.openstack.org/49545123:23
*** achadha has quit IRC23:23
*** achadha has joined #tripleo23:23
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Workaround for RHEL registration as "localhost"  https://review.openstack.org/49545123:25
EmilienMmwhahaha: backports ^23:25
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/newton: Don't disable satellite repo after registration  https://review.openstack.org/49545223:25
*** achadha_ has joined #tripleo23:26
*** achadha has quit IRC23:28
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/newton: Workaround for RHEL registration as "localhost"  https://review.openstack.org/49545323:29
*** tosky has quit IRC23:29
*** achadha_ has quit IRC23:30
openstackgerritMerged openstack/tripleo-heat-templates master: scenario002/container: run Barbican non-containerized  https://review.openstack.org/49373423:37
pabelangerEmilienM: so I noticed a little difference with DLRN mirrors patch23:48
pabelangerhttp://logs.openstack.org/05/494005/3/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/df822b8/logs/delorean_logs/93/3e/933e7c69330d253ea2f84f50c996c6441c3ed5f6_dev/mock.log.txt.gz repos23:48
pabelangeroriginal repos ^23:48
openstackgerritMerged openstack/tripleo-heat-templates master: scenario002/multinode: do not run containerized Zaqar  https://review.openstack.org/49400523:48
pabelangerhttp://logs.openstack.org/38/494538/3/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/ba3beaf/logs/delorean_logs/91/d3/91d38f182a0d2f092ccf38215e146206bea5a8ce_dev/mock.log.txt.gz new repos23:48
pabelangerin new there is now delorean-current23:49
pabelangernot sure we want that23:49
pabelangeror do we?23:50
pabelangerquickstart-centos-opstools and quickstart-centos-ceph-jewel were also added23:51
openstackgerritMerged openstack/tripleo-quickstart-extras master: Change the default name of white list file  https://review.openstack.org/49532723:51
pabelangerEmilienM: I am not familiar enought with DLRN to know which repos should be enabled or not23:51
pabelangerokay, looking at https://review.openstack.org/#/c/494262/4/roles/build-test-packages/tasks/main.yml seem that is what was done23:52
EmilienMyes we need both23:53
EmilienMI'm not sure about delorean-current23:54
EmilienMonly for some packages, related to tripleo repos23:54
EmilienMyeah it's good23:54
EmilienMI checked23:54
pabelangerwfm23:54
EmilienM(I hope)23:54
EmilienMweshay: if you can maybe double check http://logs.openstack.org/38/494538/3/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/ba3beaf/logs/delorean_logs/91/d3/91d38f182a0d2f092ccf38215e146206bea5a8ce_dev/mock.log.txt.gz23:54
EmilienMI *think* this is good23:55
EmilienMbut I might have missed something23:55
EmilienMI need to disconnect from now, see you in a wekk23:55
pabelangerEmilienM: I looked at logs at https://review.openstack.org/494538/ and that was the only thing I see23:55
pabelangerlater23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!