Wednesday, 2017-08-30

pabelangerand enqueue into gate00:00
pabelangerokay, so lets look at others again00:00
pabelangerEmilienM: actually, what is still using tripleo-ci for multinode, anything?00:01
*** achadha_ has joined #tripleo00:01
EmilienMpabelanger: https://review.openstack.org/#/q/topic:tripleo/critical00:01
EmilienMpabelanger: no voting job00:02
EmilienMpabelanger: the tripleo-ci patch isn't critical imho00:02
EmilienMwe need the oooq though00:02
*** achadha_ has quit IRC00:02
pabelangerokay, we can look at that in the morning00:02
EmilienMyea00:02
EmilienMpabelanger: https://review.openstack.org/#/q/topic:tripleo/critical are the patches you can enqueue please00:03
*** achadha_ has joined #tripleo00:03
*** achadha has quit IRC00:03
*** achadha has joined #tripleo00:04
EmilienMpabelanger: https://review.openstack.org/#/c/498975 as well00:06
*** achadha_ has quit IRC00:07
pabelanger1 min, swap failed again00:07
EmilienMdamn00:08
*** achadha has quit IRC00:09
pabelangerya, 498772 will need to be abandoned then restored00:09
pabelangerI cannot do that from CLI just yet00:09
EmilienMpabelanger: ok let me do it00:10
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168955600:10
openstackLaunchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140300:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291000:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383200:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386800:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)00:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)00:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)00:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)00:10
EmilienMpabelanger: done00:10
*** EmilienM sets mode: +o bnemec00:10
pabelangerokay, lets see if these jobs catch00:11
EmilienMpabelanger: why 498975 isn't in gate?00:13
pabelangerI'm waiting to make sure 498772 is okay00:13
*** ebarrera has quit IRC00:13
*** ebarrera has joined #tripleo00:14
EmilienMok00:14
EmilienMwe'll need to backport the revert as well00:15
pabelangerk00:16
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: Revert "Adds execution of post-upgrade validations on undercloud upgrade"  https://review.openstack.org/49897500:16
EmilienMdamn it pushed over on master00:16
*** toure is now known as toure|gone00:17
openstackgerritEmilien Macchi proposed openstack/instack-undercloud stable/pike: Revert "Adds execution of post-upgrade validations on undercloud upgrade"  https://review.openstack.org/49899000:17
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: Revert "Adds execution of post-upgrade validations on undercloud upgrade"  https://review.openstack.org/49897500:17
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: Revert "Adds execution of post-upgrade validations on undercloud upgrade"  https://review.openstack.org/49897500:17
EmilienMok done00:18
*** limao has joined #tripleo00:23
*** ecerquei has quit IRC00:26
*** ecerquei has joined #tripleo00:27
EmilienMpabelanger: it failed00:27
EmilienMscenario00300:27
EmilienMpabelanger: http://logs.openstack.org/74/498074/12/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/41e5b9b/console.html#_2017-08-30_00_18_23_38396500:27
EmilienMactually they all failed00:28
EmilienMovs_vxlan_bridge: command not found00:30
EmilienMabandonning https://review.openstack.org/#/c/498074/ and restoring00:32
EmilienMpabelanger: please promote ^00:32
pabelangerEmilienM: ya, swap might be broken00:34
pabelangerso until we fix in openstack-infra, going to hold off00:35
EmilienMpabelanger: what can I do?00:35
pabelangerEmilienM: waiting game right now sadly00:35
EmilienMok00:35
EmilienMpabelanger: if I'm afk during 1h, would you need me if it's fixed within the next 60 minutes?00:36
EmilienMto abandon / restore things?00:36
EmilienMor can you do it yourself?00:36
EmilienMpabelanger: I'm adding you core on tripleo projects just for this evening so you can abandon / restore (just in case I'm afk)00:37
*** ebarrera has quit IRC00:38
pabelangerEmilienM: shouldn't be needed, I'm a gerrit admin00:38
EmilienMah00:38
* EmilienM unset you core00:38
pabelangerEmilienM: I'll make sure these get enqueued00:39
EmilienMpabelanger: ok so I'm afk 60 min and keep my phone with me in case but I'm not sure I'm useful at this time and I need to do something00:39
pabelangerEmilienM: enjoy!00:39
*** psahoo has joined #tripleo00:53
*** rlandy|bbl is now known as rlandy00:54
*** tzumainn has quit IRC00:55
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168955601:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140301:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291001:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383201:10
openstackLaunchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386801:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)01:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)01:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)01:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)01:10
dmsimardpabelanger, EmilienM: is there a fix for https://bugs.launchpad.net/tripleo/+bug/1713868 ?01:10
dmsimardor something in progress01:11
stevebakerdmsimard: https://review.openstack.org/#/c/498986/01:11
dmsimardok, thanks01:12
dmsimardThere was no bug link in the review so it didn't comment in the bug, I added the review01:12
pabelangerya, my bad01:12
pabelangeronce 498994,1 lands, I'll enqueue topic:tripleo/critical again01:14
dmsimardnp, just helping track things down01:14
stevebakerpabelanger: is this "Fix the disk layout" FAILED something which needs investigation? http://logs.openstack.org/72/498772/2/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/3531a69/logs/ara/'01:18
pabelangerstevebaker: ya, 498994 is the revert01:20
stevebakerpabelanger: ok01:21
pabelangeralready enqueued into gate01:21
dmsimardweshay: I left a few comments in https://review.openstack.org/#/c/498074/01:21
*** ecerquei has quit IRC01:28
*** itlinux has joined #tripleo01:34
EmilienMpabelanger: 994 was the root cause of swap issue?01:36
dmsimardEmilienM: we're not sure yet01:37
pabelangerEmilienM: no root cause, but made it worse01:37
pabelangerso, revert, get more data, see how to actually fix http://status.openstack.org/elastic-recheck/#170610301:38
EmilienMOk01:38
EmilienMI'm back on computer in 20m01:38
pabelangerEmilienM: no rush, still another 45mins until it lands01:39
pabelangerthen we can enqueue again01:39
EmilienMOk01:39
*** limao has quit IRC01:43
*** limao has joined #tripleo01:44
*** limao_ has joined #tripleo01:47
*** limao has quit IRC01:48
*** tbarron|errand is now known as tbarron01:53
pabelanger498986,2 is going to merge02:02
pabelangerwaiting on 498994,102:02
tbarrontrying to upgrade an ocata undercloud to master, "openstack undercloud upgrade" fails immediately with "__init__() got an unexpected keyword argument 'url'"02:03
tbarrondoes this ring a bell with anyone ^^^ ?  Hopefully I'm just doing something dumb.02:03
*** garyk has joined #tripleo02:04
openstackgerritMerged openstack/tripleo-quickstart-extras master: In-tree function ovs_vxlan_bridge  https://review.openstack.org/49898602:06
*** limao_ has quit IRC02:09
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168955602:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140302:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291002:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383202:10
openstackLaunchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386802:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)02:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)02:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)02:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)02:10
*** bkopilov has quit IRC02:12
*** garyk has quit IRC02:13
dmsimardEmilienM: which quick multinode scenario would be worth adding to devstack-gate ? There's a lot of things in flux right now in devstack-gate and we might have been able to catch that ovs bridge thing, for example.02:13
dmsimardThere will be other changes like that on the way as we migrate devstack-gate to ansible and zuul v302:14
EmilienMI'm back02:15
EmilienMdmsimard: I'm not sure infra would be happy to run tripleo jobs on devstack gate02:16
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: ensure easy_install and pip are installed  https://review.openstack.org/49900802:16
EmilienMI would rather spend time on removing dependencies on devstack-gate02:16
dmsimardEmilienM: I can fight to at least put one non-voting job in there, as long as it's not one of those 3hrs long job02:17
dmsimardthe multinode complete in <1hr right ?02:17
dmsimardI'm helping with reviews for the foreseeable future so I'll try and make sure we pay attention to it02:18
pabelangerexperimental is another too02:18
dmsimardpabelanger can help too02:18
dmsimardexperimental doesn't run as often though02:18
EmilienMdmsimard: our jobs are 1h or so02:19
pabelangerI think you could make an arguement for experimental job on devstack-gate, then check experimental too when ready for final smoke test02:19
EmilienMI don't think experimental fits with the use case here02:19
dmsimardthat's fine, we have ~1h30 jobs in devstack-gate right now02:19
dmsimardpabelanger: I haven't seen experimental being used a lot, not sure we can rely on it02:19
EmilienMok where are we now02:20
EmilienMwow https://review.openstack.org/#/c/498986/ is merged02:20
pabelangerdmsimard: same as check, you just have to type check experimental to trigger it02:20
EmilienMhttps://review.openstack.org/#/c/498975/ is not02:20
pabelanger498994 is merging now02:20
pabelangerso, I'll requeue things in a moment02:20
EmilienMok02:21
dmsimardEmilienM: I sent in https://review.openstack.org/#/c/499005/ and we'll collect data from https://review.openstack.org/#/c/499007/ by re-checking a good amount of times02:21
EmilienMdmsimard: cool02:23
*** limao has joined #tripleo02:23
dmsimardthe retry was already shown to work but we don't want to introduce it unless we're sure it resolves it02:23
*** lblanchard has quit IRC02:24
*** lblanchard has joined #tripleo02:26
pabelangerokay, 3 patches enqueue again02:29
pabelangershould be able to start some rechecks on others02:29
EmilienMgood02:30
pabelangerSo, this time around, anything that fails a recheck, lets audit the logs02:30
EmilienMok02:30
pabelangerand make sure elastic-recheck knows of the failure02:30
EmilienMpabelanger: I think https://review.openstack.org/#/c/498772/ was missed02:30
pabelangerotherwise, regressions sneak in when we are blindly rechecking02:30
pabelangerno,498772 is there02:31
pabelangerOh02:31
pabelangerhmm02:31
EmilienMpabelanger: and 498975?02:31
pabelangerya02:31
pabelangerthat didn't enque02:31
pabelangerenqueue*02:32
EmilienMok02:32
pabelangerk, enqueued now02:33
EmilienMk02:33
EmilienMI see it02:34
EmilienMfinger crossed02:34
pabelangershould land02:34
pabelangerif it doesn't we have new issues02:34
pabelangerI'll check back in 30mins02:34
EmilienMpabelanger: I stay here the next 3h minimum02:37
EmilienMmaybe 2 in fact next meeting at 5am :D02:37
itlinuxhello all.. does anyone know what's the best way to add a new theme? the old one I had do not work on Ocata. TY02:49
*** limao has quit IRC02:49
EmilienMpabelanger: I don't know how to thank you02:55
EmilienMso I'll just say it in french02:55
EmilienMfwiw02:55
EmilienMmerci02:55
pabelangernp :)03:00
*** lblanchard has joined #tripleo03:03
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168955603:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140303:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291003:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383203:10
openstackLaunchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386803:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)03:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)03:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)03:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)03:10
*** udesale has joined #tripleo03:18
*** chlong has quit IRC03:21
pabelangerEmilienM: btw: http://status.openstack.org/elastic-recheck/#1713127 is another tripleo issue we should look into, but not tonight03:21
* EmilienM clicks03:21
EmilienMwait I saw this one03:21
EmilienMpabelanger: I'm creating a CI escalation on this one03:22
EmilienMbandini: ^ when you're up, please have a look at https://bugs.launchpad.net/tripleo/+bug/171312703:23
openstackLaunchpad bug 1713127 in tripleo "tripleo fails to deploy in ci : Failed to call refresh: /usr/bin/clustercheck" [High,Triaged]03:23
pabelangerEmilienM: cool03:23
pabelangerhaven't seen it fail since we created elastic-recheck query, but ya, somebody should look if they know more about it03:24
EmilienMpabelanger: we will for sure03:25
EmilienMpabelanger: you should go to bed03:25
EmilienMpabelanger: jobs finish in 1h03:25
EmilienMit's super late for you03:25
EmilienMwhen all of this merge, I'll recheck everything that I abandonned to kill the gate queue03:26
*** ramishra has joined #tripleo03:26
EmilienMand hopefully get some merges03:26
pabelangerYa, will be online until this lands, just to be sure03:26
pabelangerbut ya, let loose the rechecks, and we'll audit in the morning the failures03:26
*** yamahata has quit IRC03:27
EmilienMpabelanger: now? or in 1h once the stuff merge?03:30
pabelangerEmilienM: ya, to be safe, until gate merges03:30
EmilienMI'll wait ok03:31
*** bkopilov has joined #tripleo03:32
*** gkadam_ has joined #tripleo03:33
*** limao has joined #tripleo03:35
*** limao has quit IRC03:39
*** links has joined #tripleo03:40
*** mdnadeem has joined #tripleo04:01
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168955604:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140304:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291004:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383204:10
openstackLaunchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386804:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)04:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)04:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)04:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)04:10
*** ykarel has joined #tripleo04:19
*** pdeore__ has joined #tripleo04:20
EmilienMwe're almost done04:23
EmilienMmerges should arrive soon04:23
pabelangerYup04:24
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Sudo fix overcloud-custom-tht-script.sh.j2  https://review.openstack.org/49901804:25
openstackgerritMerged openstack-infra/tripleo-ci master: Multinode jobs should not build images  https://review.openstack.org/49877204:26
EmilienMboom one04:27
EmilienMhttps://review.openstack.org/#/c/498074/ is gonna land as well04:28
EmilienMthe other one as well :D04:28
openstackgerritMerged openstack/tripleo-quickstart-extras master: use pip to install delorean  https://review.openstack.org/49807404:28
stevebakeroosh04:28
pabelangerEmilienM: ya, most of those jobs are actually running faster too, compared to job timeouts04:29
EmilienMnice04:30
EmilienMwhen the last one merge, i'll proceed to all rechecks04:30
EmilienMand wish a good night to pabelanger :D04:30
EmilienMpabelanger: could we promote the backport as well? https://review.openstack.org/#/c/498990/04:31
EmilienMor I guess I can just recheck04:31
EmilienMand approve04:31
pabelangerYa, recheck them first04:32
pabelangereverything behind them will fall in line04:32
pabelanger2017-08-30 04:33:34.316012 | Job timeout set to: 51 minutes04:33
pabelangerlots of time to spare now04:33
openstackgerritMerged openstack/instack-undercloud master: Revert "Adds execution of post-upgrade validations on undercloud upgrade"  https://review.openstack.org/49897504:34
EmilienMand BOOM04:34
pabelanger:)04:34
EmilienMpabelanger: bonne nuit04:35
EmilienMrecheck party now04:35
pabelangerrecheck away, we'll deal with failures in morning04:35
pabelangerlater04:35
EmilienMk04:35
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: In-tree ovs_vxlan_bridge function from devstack-gate  https://review.openstack.org/49898504:37
EmilienMweshay: are you still around?04:39
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add support for Dell EMC VMAX ISCSI Backend  https://review.openstack.org/48939304:41
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add support for Dell EMC VMAX Manila Backend  https://review.openstack.org/49109404:42
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add support for Dell EMC Isilon Manila  backend  https://review.openstack.org/48889604:42
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Support for Dell EMC VNX Manila Driver  https://review.openstack.org/49064204:42
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Don't use docker-network.yaml env  https://review.openstack.org/49772204:43
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Don't use docker-network.yaml env  https://review.openstack.org/49772004:43
*** yamahata has joined #tripleo04:45
*** garyk has joined #tripleo04:51
*** limao has joined #tripleo04:55
EmilienMweshay: things are better now, we can go ahead and approve patches that you wanted04:58
EmilienMweshay: we'll see tomorrow04:58
jaosoriorEmilienM: need any reviews?04:58
EmilienMstevebaker: please baby sit your patches on https://bugs.launchpad.net/tripleo/+bug/1689556 and https://bugs.launchpad.net/tripleo/+bug/1691403 - so we can get them merged ASAP04:58
openstackLaunchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)04:58
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)04:58
*** shreshtha has joined #tripleo04:59
EmilienMjaosorior: not afik, I go to bed now. I sent update to ML04:59
EmilienMjaosorior: thanks though04:59
* EmilienM afk now04:59
jaosoriorEmilienM: have a good one04:59
EmilienMjaosorior: please make review and see what patches are waiting to be merged05:00
EmilienMjaosorior: when things are merged, see if they need backport05:00
EmilienMjaosorior: if you find my patches on gerrit a bunch of things can be reviewed, I'll let you find them, I'm off for now05:00
EmilienMhttps://review.openstack.org/#/q/owner:%22Emilien+Macchi+%253Cemilien%2540redhat.com%253E%22+status:open05:01
jaosoriorno worries. Starting my review round now. Making coffee05:02
jaosoriorEmilienM: have a good night dude05:02
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168955605:10
openstackLaunchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140305:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291005:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383205:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386805:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)05:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)05:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)05:10
*** dparkes has quit IRC05:10
*** udesale__ has joined #tripleo05:13
*** udesale has quit IRC05:15
*** achadha has joined #tripleo05:17
*** pdeore__ has quit IRC05:20
*** pdeore__ has joined #tripleo05:20
*** yolanda has quit IRC05:21
*** pdeore__ has quit IRC05:25
*** yprokule has joined #tripleo05:26
*** ratailor has joined #tripleo05:26
*** daidv has quit IRC05:26
*** daidv has joined #tripleo05:26
*** dpawar has joined #tripleo05:31
*** mdnadeem has quit IRC05:31
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-common master: Support fernet key rotation with containers  https://review.openstack.org/49902805:32
*** pdeore__ has joined #tripleo05:33
*** pgadiya has joined #tripleo05:47
*** marios has joined #tripleo05:48
*** iranzo has joined #tripleo05:53
*** aufi has joined #tripleo05:58
*** limao has quit IRC05:59
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260706:00
*** limao has joined #tripleo06:00
*** gchamoul has quit IRC06:04
*** janki has joined #tripleo06:05
*** gchamoul has joined #tripleo06:06
*** honza has quit IRC06:06
*** honza has joined #tripleo06:07
*** agurenko has joined #tripleo06:07
*** honza is now known as Guest7428306:07
*** jfrancoa has joined #tripleo06:07
*** dparkes has joined #tripleo06:09
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168955606:10
openstackLaunchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140306:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291006:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383206:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386806:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)06:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)06:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)06:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)06:10
lvdombrkrhello guys, does anyone can help configure simple network isolation yaml file only for external network? i need it to test ssl in my lab06:10
*** skramaja has joined #tripleo06:18
jaosoriormandre: you around?06:21
*** jprovazn has joined #tripleo06:21
*** mdnadeem has joined #tripleo06:27
jankimandre, hey06:28
*** masco has joined #tripleo06:28
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-common master: Support fernet key rotation with containers  https://review.openstack.org/49902806:38
*** cschwede has joined #tripleo06:39
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Remove semicolons  https://review.openstack.org/49882206:39
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: manila: set "host" to "hostgroup"  https://review.openstack.org/49866406:41
*** rcernin has joined #tripleo06:42
openstackgerritMerged openstack/tripleo-heat-templates master: Add missing Docker service  https://review.openstack.org/49884206:42
openstackgerritMerged openstack/tripleo-heat-templates master: Use Python to compute release notes version  https://review.openstack.org/49888206:42
openstackgerritMerged openstack/puppet-tripleo stable/newton: Release 5.6.2 (newton)  https://review.openstack.org/49885806:43
openstackgerritMerged openstack/tripleo-ui master: Add logging documentation  https://review.openstack.org/48913406:43
*** pcaruana has joined #tripleo06:43
*** jtomasek has joined #tripleo06:45
*** Guest74283 is now known as honza_06:48
marioswin 706:50
*** itlinux has quit IRC06:51
*** florianf has joined #tripleo06:52
*** daidv has quit IRC06:54
*** daidv has joined #tripleo06:54
*** milan has joined #tripleo06:57
*** yolanda has joined #tripleo06:57
*** oidgar has quit IRC06:58
lvdombrkrfolks did any deployed overcloud with ssl without network isolation?07:00
*** milan has quit IRC07:04
*** ebarrera has joined #tripleo07:05
*** achadha has quit IRC07:06
*** saneax has quit IRC07:07
*** aditya_r has joined #tripleo07:08
*** limao has quit IRC07:08
*** honza_ is now known as honza07:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168955607:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140307:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291007:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383207:10
openstackLaunchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386807:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)07:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)07:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)07:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)07:10
*** limao has joined #tripleo07:10
*** saneax has joined #tripleo07:12
*** limao has quit IRC07:12
*** limao has joined #tripleo07:12
openstackgerritSaravanan KR proposed openstack/tripleo-common master: Added a kolla config file for building contaner images with qemu uid  https://review.openstack.org/49905307:15
*** saneax_-_ has joined #tripleo07:15
openstackgerritSaravanan KR proposed openstack/tripleo-common master: Added a kolla config file for building contaner images with qemu uid  https://review.openstack.org/49905307:15
*** saneax_-_ has quit IRC07:16
mandrejaosorior: hey07:16
mandrejanki: hey too :)07:16
*** dpawar has quit IRC07:16
*** dsariel has quit IRC07:18
jaosoriormandre: hey dude, gonna need some help with fernet key rotation, got time bluejeans?07:18
*** jpich has joined #tripleo07:18
jankimandre, openstack overcloud container image prepare --env-file ~/docker_registry.yaml --service-environment-file /usr/share/openstack-tripleo-heat-templates/environments/services-docker/neutron-opendaylight.yaml will result in just ODLimage pull.07:19
lvdombrkrfolks did any deployed overcloud with ssl without network isolation?07:19
mandrejaosorior: I'll ping you after breakfast and shower, I think it's better :)07:19
jaosoriormandre: lets do that, gives me time to brew more coffee07:19
*** tesseract has joined #tripleo07:19
jankihow about we add a default -e file + other -e with specific envs07:19
*** jaganathan has joined #tripleo07:20
jaosoriorlvdombrkr: public ssl or internal ssl?07:20
mandrejanki: yeah, you need to pass all the environments you're normally passing when deploying, in that case the environment/docker.yaml file07:20
jankimandre, can we make environment/docker.yaml default? because w/o that, all the images will be pulled.07:21
mandrejanki: so -e environments/docker.yaml -e environments/services-docker/neutron-opendaylight.yaml07:21
jankimandre, also how to implement if-else for Neutron-server image?07:22
mandrejanki: we have open bug (at least downstream) with patches to make containers the default07:22
*** anshul has joined #tripleo07:22
mandrejanki: I think you did it right with the if-else in your tripleo-common patch, let me check again07:23
jankimandre, ack. Alos how to implement if-else based on env-files. I tried "if environments/services-docker/neutron-opendaylight.yaml in service-environement-file, set neutron-driver = odl" but getting error07:24
*** cylopez has joined #tripleo07:25
mandrejanki: oh I see what you mean, so you're wondering how to implement the logic in python-tripleoclient07:25
*** bogdando has joined #tripleo07:25
jankimandre, I am wondering how to implement if-else in overcloud-containers.yaml.j2 for imagename: "{{namespace}}/{{name_prefix}}neutron-server{{name_suffix}}-opendaylight:{{tag}}07:26
jankimandre, getting ODL Image is solved with -e. how to get odl specific neutron image with -e07:26
jankimandre, I tried specifying only  OS::TripleO::Services::OpenDaylightApi for  imagename: "{{namespace}}/{{name_prefix}}neutron-server{{name_suffix}}-opendaylight:{{tag}} but no success07:27
jankimandre, we need j2 to figure out that environments/services-docker/neutron-opendaylight.yaml is specified and hence choose neutron-server image accordingly07:28
mandrejanki: can you maybe paste somewhere the overcloud_containers.yaml file you generate with and without the -e?07:28
lvdombrkrjaosorior: for test purposes it will be enought reach dashboard with ssl07:28
mandrejanki: I'll be back in a few minutes07:28
jankimandre, ya. give me a min07:28
jaosoriorlvdombrkr: public ssl then07:29
jaosoriorlvdombrkr: not sure how that will go, since the haproxy endpoints might end up only pointing to the SSL endpoints.07:29
jaosoriorlvdombrkr: I recommend using network isolation. HAve you checked these docs http://tripleo.org/install/advanced_deployment/network_isolation.html ?07:30
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: Derive Params OvsPmdCoreList compute issue  https://review.openstack.org/49881607:30
*** dsariel has joined #tripleo07:32
lvdombrkrjaosorior: i tried create some simple network-isolation only with one network - external, bet without any succes..this is my config file http://paste.openstack.org/raw/619857/07:32
jaosoriorlvdombrkr: how did it fail?07:34
*** jpena|off is now known as jpena07:34
*** dpawar has joined #tripleo07:36
jankimandre, I have commented on the patch https://review.openstack.org/#/c/498383/07:41
lvdombrkrjaosorior: it didnt fail but as i understood there should be publicVIP which i cant ping and reach?07:41
*** egonzalez has joined #tripleo07:41
jaosoriorlvdombrkr: well, by default you can't reach it in the undercloud, but you could configure the vlan to be able to.07:42
*** ffiore has joined #tripleo07:43
jaosoriorlvdombrkr: for instance, quickstart will generate a script called ./overcloud-prep-network.sh that will do just that07:43
jaosoriorlvdombrkr: for instance, for me it looks like the following http://paste.openstack.org/show/619858/07:43
lvdombrkrjaosorior: how can i now which is publicVIP IP?07:45
jaosoriorlvdombrkr: you can set a predefined one07:45
jankiEmilienM, Hi07:45
therveI'm looking at https://bugs.launchpad.net/tripleo/+bug/1713832 if someone wants to exchange some ideas (marios ?)07:45
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)07:45
jaosoriorlvdombrkr: http://tripleo.org/install/advanced_deployment/node_placement.html?highlight=predictable#predictable-ips07:46
jaosoriorlvdombrkr: so you would need to set PublicVirtualFixedIPs: [{'ip_address':'10.1.1.9'}]07:46
jaosoriorlvdombrkr: using the IP that you actually want. I just copied from those docs07:46
*** florianf has quit IRC07:47
mariostherve: o/ hey i had a quick look but want to revisit as well07:50
lvdombrkrjaosorior: i can add it just to my network-env.yaml?07:50
lvdombrkrwhich i paste for you?07:50
thervemarios, Chatting with Christian to try to understand what's happening07:50
jaosoriorlvdombrkr: sure07:50
thervemarios, I don't see where your patch uses websocket though?07:50
*** oidgar has joined #tripleo07:51
therveIt actually seems to be polling instead07:51
mariostherve: yeah it isn't clear to me how they are connected. my patch adds some validations that run only on the end of undercloud upgrade  *(https://review.openstack.org/#/c/474578/11/instack_undercloud/undercloud.py )... so they aren't run in fact on the job that the bug points at. i am not sure if the refactoring i did there (the _get_session and _wait_for_mistral_execution added there) may be involved07:53
mariosthough as that is also used for the 'pre-deployment' validations (which is the next line after the PUT error in the log)07:53
thervemarios, Yeah, it's possible your patch just highlighted an existing issue07:54
thervemarios, Just ftr, it's master, pike, ocata... ?07:54
mariostherve: well master and pike looks like (the patch landed to master and it shoud be on stable/pike, well it won't be after the revert lands)07:55
mariostherve: it isn't on ocata07:55
therveOK07:55
openstackgerritAdriano Petrich proposed openstack/tripleo-quickstart-extras master: Change where the modify script logs  https://review.openstack.org/49907007:56
*** florianf has joined #tripleo07:57
openstackgerritAdriano Petrich proposed openstack/instack-undercloud master: Add an hourly cron trigger for tripleo-ui logging  https://review.openstack.org/46960807:58
*** suuuper has joined #tripleo08:00
lvdombrkrjaosorior: "Creating Custom Interface Templates" this is a necessery step or i can skip it?08:01
*** tosky has joined #tripleo08:02
*** achadha has joined #tripleo08:07
mandrejanki: I replied on the review, basically we need to implement the logic in python-tripleoclient and pass the neutron_driver variable when rendering the template08:07
openstackgerritShivanand Tendulker proposed openstack/tripleo-common master: Adds support to configure 'ilo_port' for 'pxe_ilo' driver  https://review.openstack.org/49907508:08
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168955608:10
openstackLaunchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140308:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291008:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383208:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386808:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)08:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)08:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)08:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)08:10
*** achadha has quit IRC08:11
*** sshnaidm has quit IRC08:15
*** sid1 has joined #tripleo08:15
*** fzdarsky|afk has joined #tripleo08:17
*** lucas-afk is now known as lucasagomes08:17
*** sid1 has quit IRC08:17
openstackgerritMerged openstack/puppet-tripleo stable/newton: Enable innodb_buffer_pool_size configuration  https://review.openstack.org/49057808:17
*** milan has joined #tripleo08:17
*** sid1 has joined #tripleo08:18
*** mcornea has joined #tripleo08:19
*** ykarel is now known as ykarel|lunch08:22
*** sid1 has quit IRC08:27
jaosoriorlvdombrkr: not entirely sure to be honest.08:30
lvdombrkrjaosorior: but if i understood corecctly i just need to add this http://paste.openstack.org/raw/619861/ to my deploy command and it shoult create isolate network?08:34
*** fzdarsky|afk is now known as fzdarsky08:35
*** sid1 has joined #tripleo08:36
jaosoriorlvdombrkr: as far as I understand, yeah08:36
openstackgerritMerged openstack/instack-undercloud stable/pike: Revert "Adds execution of post-upgrade validations on undercloud upgrade"  https://review.openstack.org/49899008:37
lvdombrkrjaosorior : thanks, but looks its dont make any changes in my env. at all...08:38
*** dbecker has joined #tripleo08:40
*** snecklifter has joined #tripleo08:40
*** dbecker has quit IRC08:41
jaosoriorlvdombrkr: might wanna wait for other folks to log in then08:42
jaosoriormandre: ready yet? :O08:42
lvdombrkrjaosorior: okey, thanks for assist anyway08:42
mandrejaosorior: in ~10 min08:43
jaosoriorhaha sure sure08:43
lvdombrkrfolks who can help with simple network isolation creation?08:43
*** psachin has joined #tripleo08:44
*** dparkes has quit IRC08:46
*** sid2 has joined #tripleo08:48
*** stendulker has joined #tripleo08:48
*** paramite has joined #tripleo08:48
openstackgerrityolanda.robla proposed openstack/tripleo-image-elements master: Update ironic-agent-multipath element  https://review.openstack.org/49908208:49
*** sid1 has quit IRC08:50
*** ykarel|lunch is now known as ykarel08:53
*** sid1 has joined #tripleo08:54
*** jaosorior has quit IRC08:55
jankimandre, hey. I saw the comment. I am not clear with what you are saying. you want to have both --neutron-driver and -e pass for prepare command? Please feel free to submit a patch with what you are suggesting08:55
*** dparkes has joined #tripleo08:56
lvdombrkrfolks who can help with simple network isolation creation?08:57
*** sid2 has quit IRC08:58
*** jaosorior has joined #tripleo09:00
remix_tjlvdombrkr: which kind of setup?09:00
*** dsariel has quit IRC09:01
lvdombrkrremix_tj: i have one controller node and one compute node right now without network-isolation. i want test ssl in overcloud, so i need publicVIP and for this as i understood i need network isolation. i create simple network-env.yaml for one external network (http://paste.openstack.org/raw/619861/) add it to deploy command but no make changes in my env at all09:03
lvdombrkrremix_tj: maybe i need to add some additional tampletes to my deploy command, or something like that09:05
*** sshnaidm has joined #tripleo09:06
*** dparkes has quit IRC09:06
*** hewbrocca_afk is now known as hewbrocca09:08
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168955609:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140309:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291009:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383209:10
openstackLaunchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386809:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)09:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)09:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)09:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)09:10
*** sid2 has joined #tripleo09:10
jankimandre, can you check ocmment on https://review.openstack.org/#/c/498743/09:12
lvdombrkrremix_tj: any ideas?09:12
*** psachin has quit IRC09:12
remix_tjlvdombrkr: i see that all the resource_registry entries are commented out. In my setup all that resource registries are uncommented and pointing to a file containing the networking configuration09:12
remix_tjof each kind of host09:13
*** sid1 has quit IRC09:14
lvdombrkrremix_tj: can you paste your network config?09:17
remix_tjlvdombrkr: sure09:18
*** limao has quit IRC09:18
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: WIP:Mount vhost_sockets director for vhost-user socket creation  https://review.openstack.org/49908609:18
*** akrivoka has joined #tripleo09:20
remix_tjlvdombrkr: https://pastebin.com/zxinFMpK i'm also splitting different vlans in different nics by usage09:22
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui stable/pike: Imported Translations from Zanata  https://review.openstack.org/49874709:25
*** psahoo has quit IRC09:31
lvdombrkrremix_tj: thanks, looks a lit bit difficult i thought it is simpler09:32
*** dpawar has quit IRC09:33
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Allow composable scenarios without deployed server environment  https://review.openstack.org/49909409:34
remix_tjlvdombrkr: there are already prepared templates in t-h-t, you can start from here09:36
mandrejaosorior: sorry, my 10 min turned out to me more like 1 hour09:39
lvdombrkrremix_tj: thanks im not sure with template i need to use09:40
mandrejaosorior: wanna bluejeans?09:40
*** pkovar has joined #tripleo09:40
remix_tjlvdombrkr: depends on what's your setup. There are several: singlenic, multiple nics....09:41
lvdombrkrremix_tj: i have one nic with provision network in compute and controller thats all09:41
remix_tjlvdombrkr: only one nic for controller and computers?09:41
*** aditya_r has quit IRC09:42
*** dparkes has joined #tripleo09:43
*** dpawar has joined #tripleo09:43
jaosoriormandre: sure09:44
lvdombrkrremix_tj: right now i have one compute node and one controller node, in each node there is plugged in one physical cable to swich (which is provisioning network)  second nic of each i can plug in external network09:44
*** dsariel has joined #tripleo09:44
*** jpich has quit IRC09:45
remix_tjlvdombrkr: try with multiple-nics/{compute,controller}.yaml you find in /usr/share/... somewhere09:46
openstackgerritAttila Darazs proposed openstack-infra/tripleo-ci master: Use release specific repos during containers build  https://review.openstack.org/49868809:50
openstackgerritMerged openstack/tripleo-common stable/pike: Add stunnel to redis image for tls  https://review.openstack.org/49866209:51
openstackgerritJanki Chhatbar proposed openstack/python-tripleoclient master: Add neutron_driver value to prepare command  https://review.openstack.org/49874309:52
openstackgerritJanki Chhatbar proposed openstack/python-tripleoclient master: Add neutron_driver value to prepare command  https://review.openstack.org/49874309:54
lvdombrkrremix_tj: thanks i will try09:54
lvdombrkrremix_tj: maybe you know that does mean: Could not fetch contents for file:///scripts/run-os-net-config.sh09:58
lvdombrkrafter i start deploy?09:58
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-docs master: Add missing quote from mistral command to run key rotation  https://review.openstack.org/49909810:04
*** morazi has quit IRC10:05
remix_tjlvdombrkr: fix paths to absoule paths instead of relative ones10:06
*** achadha has joined #tripleo10:09
*** dsariel has quit IRC10:10
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168955610:10
openstackLaunchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140310:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291010:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383210:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386810:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)10:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)10:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)10:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)10:10
lvdombrkrremix_tj: thanks10:12
*** achadha has quit IRC10:14
openstackgerritMerged openstack/puppet-tripleo stable/pike: Enable config for docker daemon debug  https://review.openstack.org/49865310:15
honzaapetrich: it passed ci!  i can't believe my eyes!10:16
apetrichhonza, woot!10:18
* apetrich dances 10:18
*** cylopez has quit IRC10:25
*** leseb has quit IRC10:29
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Make archive policy configurable  https://review.openstack.org/49829610:33
lvdombrkrremix_tj: can i add to overcloud deploy also this https://github.com/cybertron/tripleo-network-templates/blob/master/simple/network-isolation.yaml10:36
lvdombrkr?10:36
*** jkilpatr has quit IRC10:36
*** ffiore has quit IRC10:37
*** dpawar has quit IRC10:39
*** thrash|g0ne is now known as thrash10:42
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Heat]  https://review.openstack.org/49139910:45
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Aodh]  https://review.openstack.org/49141110:45
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mistral]  https://review.openstack.org/49347110:45
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Ceilometer]  https://review.openstack.org/49039210:45
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Neutron]  https://review.openstack.org/48995710:45
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Gnocchi]  https://review.openstack.org/49143310:45
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mixed-1]  https://review.openstack.org/49519510:45
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Nova]  https://review.openstack.org/49910810:45
honzad0ugal: mwhahaha: EmilienM: This finally passed ci thanks to apetrich, let's do another round of voting ASAP please https://review.openstack.org/#/c/46960810:49
*** leseb has joined #tripleo10:51
*** sshnaidm is now known as sshnaidm|afk10:51
*** beagles has joined #tripleo10:52
*** dpawar has joined #tripleo10:53
openstackgerrityolanda.robla proposed openstack/tripleo-image-elements master: Update ironic-agent-multipath element  https://review.openstack.org/49908210:57
*** ffiore has joined #tripleo10:58
*** oneswig has joined #tripleo11:00
openstackgerritMartin André proposed openstack/python-tripleoclient master: Add neutron_driver value to prepare command  https://review.openstack.org/49874311:01
mandrejanki: ^^ I've updated the patch, note I haven't tried11:02
jankimandre, this is better. same logic different representation. I will try in some time. thanks :)11:03
*** bkopilov has quit IRC11:04
*** sid2 has quit IRC11:05
openstackgerritTom Barron proposed openstack/tripleo-heat-templates stable/ocata: manila: set "host" to "hostgroup"  https://review.openstack.org/49911111:05
mandrejanki: nice, thanks11:06
*** gbarros has quit IRC11:07
*** adarazs is now known as adarazs_lunch11:07
*** jkilpatr has joined #tripleo11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168955611:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140311:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291011:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383211:10
openstackLaunchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386811:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)11:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)11:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)11:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)11:10
openstackgerritJustin Kilpatrick proposed openstack/tripleo-quickstart-extras master: WIP: Disruption detection and some stack update roles  https://review.openstack.org/49795011:11
lvdombrkr remix_tj: interesting there is no changes in my env after deploy11:15
*** lucasagomes is now known as lucas-hungry11:16
openstackgerritMartin André proposed openstack/tripleo-common master: Make curl healthchecks work with internal TLS  https://review.openstack.org/49880511:19
*** ffiore has quit IRC11:21
*** dpawar has quit IRC11:22
openstackgerritMarios Andreou proposed openstack/instack-undercloud master: Revert "Revert "Adds execution of post-upgrade validations on undercloud upgrade""  https://review.openstack.org/49911611:26
openstackgerritJavier Peña proposed openstack/tripleo-quickstart-extras master: [WIP] Allow pre-installed DLRN  https://review.openstack.org/49911711:28
openstackgerritMarios Andreou proposed openstack/instack-undercloud master: Revert "Revert "Adds execution of post-upgrade validations on undercloud upgrade""  https://review.openstack.org/49911611:29
*** stendulker has quit IRC11:30
remix_tjlvdombrkr: i think network setup is difficult to update after first deployment...11:30
*** bfournie has quit IRC11:33
*** ansmith has quit IRC11:36
*** yamahata has quit IRC11:37
lvdombrkrremix_tj: mhmm...you think i need to delete stack and re-deploy?11:37
remix_tjcould be a nice idea11:38
*** morazi has joined #tripleo11:38
*** paramite has quit IRC11:40
lvdombrkrfolks, is there posibility to update network setup after overcloud deployment?11:41
lvdombrkrremix_tj: okey, thank you for assist11:41
*** dprince has joined #tripleo11:45
*** shreshtha has quit IRC11:46
*** paramite has joined #tripleo11:46
*** dtantsur|afk is now known as dtantsur11:48
*** jprovazn has quit IRC11:49
*** sid1 has joined #tripleo11:50
*** adarazs_lunch is now known as adarazs11:51
*** pgadiya has quit IRC11:54
*** gkadam_ has quit IRC11:54
*** psachin has joined #tripleo11:56
*** sshnaidm|afk is now known as sshnaidm11:57
pabelangermorning12:02
*** jpena is now known as jpena|lunch12:02
*** pradk has joined #tripleo12:02
EmilienMhey12:02
bogdandohi12:02
pabelangerlooking at logs, I see 14 merges12:03
pabelangernot too bad12:03
openstackgerritMerged openstack/tripleo-heat-templates master: Support HA for OVN DBs containers using pacemaker bundle  https://review.openstack.org/48437612:03
pabelangeralso looks like we are about to have another wave12:03
EmilienMgreat12:04
*** cylopez has joined #tripleo12:05
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Support deploying OVN as container services  https://review.openstack.org/49829712:05
openstackgerritMerged openstack/tripleo-heat-templates master: Use integers for rabbitmq ports  https://review.openstack.org/49871112:05
pabelangerI also think we solved our issues with buildslogs.centos.org, I haven't seen an infracloud-vanilla failure since yesterday afternoon12:05
*** bfournie has joined #tripleo12:06
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Use Python to compute release notes version  https://review.openstack.org/49912312:06
pabelangerthese next 2 jobs in top of gate on running on vexxhost, lets see if they timeout or merge12:06
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add missing Docker service  https://review.openstack.org/49912412:06
*** leseb has quit IRC12:07
*** fzdarsky has quit IRC12:07
*** egonzalez has quit IRC12:07
*** ykarel has quit IRC12:07
*** thrash has quit IRC12:07
*** lifeless has quit IRC12:07
*** brault has quit IRC12:07
*** owalsh has quit IRC12:07
*** PhilSliderS has quit IRC12:07
*** jeblair has quit IRC12:07
*** hamzy has quit IRC12:07
*** social has quit IRC12:07
*** sdoran has quit IRC12:07
*** social_ has joined #tripleo12:07
*** brault_ has joined #tripleo12:07
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Use integers for rabbitmq ports  https://review.openstack.org/49912512:07
*** jeblair_ has joined #tripleo12:07
*** trown|outtypewww is now known as trown12:07
*** owalsh has joined #tripleo12:07
EmilienMjaosorior: backport ^12:07
*** fzdarsky has joined #tripleo12:07
*** ykarel has joined #tripleo12:07
*** psachin has quit IRC12:07
*** egonzalez has joined #tripleo12:07
*** hamzy has joined #tripleo12:07
*** PhilSliderS has joined #tripleo12:09
*** lucas-hungry is now known as lucasagomes12:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168955612:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140312:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291012:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383212:10
openstackLaunchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386812:10
*** ooolpbot has quit IRC12:10
*** percevalbot has quit IRC12:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)12:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)12:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)12:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)12:10
*** jprovazn has joined #tripleo12:10
*** kbyrne has quit IRC12:10
jaosoriorEmilienM: thanks12:11
*** tesseract has quit IRC12:11
*** kbyrne has joined #tripleo12:12
*** achadha has joined #tripleo12:12
*** jlabarre has joined #tripleo12:12
*** percevalbot has joined #tripleo12:13
*** morazi has quit IRC12:13
openstackgerritKarthik S proposed openstack/tripleo-heat-templates master: Provide DPDK nic configs and add multiqueue config  https://review.openstack.org/47453312:13
*** jpich has joined #tripleo12:14
*** morazi has joined #tripleo12:14
jaosoriorone character docs fix https://review.openstack.org/#/c/499098/12:14
jrist\o/12:16
jristhooray12:16
jristhttps://review.openstack.org/#/c/46960812:16
*** ratailor has quit IRC12:16
jristplease to be reviewing ^12:16
jristjust need a few more +1s, +2, +A12:16
*** achadha has quit IRC12:16
*** rhallisey has joined #tripleo12:16
akrivokajtomasek: question regarding https://review.openstack.org/#/c/496381/2/src/js/actions/PlansActions.js - the 'title' that you are returning there - what is it and where is it used?12:16
pabelangerEmilienM: potentially 20 merges incoming, all depends on vexxhost right now.12:16
EmilienMjrist: you need review on https://review.openstack.org/#/c/499070/12:16
EmilienMpabelanger: wow ok12:17
jristah12:17
jristthanks EmilienM yes12:17
pabelangerEmilienM: a quick look at logs show it took 40min to fetch docker containers, but that should be from local mirror. Will check logs and ask mnaser if he sees a networking issue12:18
jtomasekakrivoka: Hi, that's where I am saving the name from plan-environment.yaml but it is not really used now12:18
*** agurenko has quit IRC12:18
jtomasekakrivoka:  but I am realising that since we're looking for the plan-environment.yaml by name, it never happens that planName is different from name from plan-environment12:18
pabelangerEmilienM: how did the rechecks go? I haven't looked for failures just yet12:19
akrivokajtomasek: yes, that's what was confusing me :)12:19
*** jcoufal has joined #tripleo12:20
EmilienMpabelanger: I'm in a mtg now12:20
EmilienMpabelanger: but I'm looking as well12:20
jaosoriormandre: using docker restart worked12:20
jaosoriormandre: seems it was an issue with the docker_container ansible resource12:20
openstackgerritMerged openstack/tripleo-docs master: Add missing quote from mistral command to run key rotation  https://review.openstack.org/49909812:20
mandrejaosorior: hey cool, so you can try to shell out from the ansible task maybe?12:21
jristpabelanger: yeah passed12:21
*** lifeless_ has joined #tripleo12:22
*** leseb has joined #tripleo12:22
*** thrash has joined #tripleo12:22
*** sdoran has joined #tripleo12:22
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-common master: Support fernet key rotation with containers  https://review.openstack.org/49902812:22
jaosoriormandre: this is what I did ^^12:22
pabelangerjrist: great12:22
jaosoriormandre: I get an error output from mistral, cause that playbook ends up in a warning, because of the rm that I do. It says (you should use the file resource)12:22
jaosoriormandre: but it's just a warning, it actually worked :D12:23
mandrejaosorior: nice :)12:23
*** ffiore has joined #tripleo12:24
*** gchamoul has quit IRC12:24
*** ecerquei has joined #tripleo12:24
pabelanger30mins to validate tempest and collect logs, going to be close12:25
*** tesseract has joined #tripleo12:26
*** gchamoul has joined #tripleo12:27
lvdombrkrremix_tj:   ExternalNetCidr: 10.5.40.0/22 in your network is a same as managment network?12:27
remix_tjlvdombrkr: yes it is12:28
lvdombrkrremix_tj: so physicaly you have plug into controller two cables provision and external yes?12:31
*** rlandy has joined #tripleo12:31
*** dprince has quit IRC12:31
*** adarazs is now known as adarazs_brb12:31
*** abishop has joined #tripleo12:32
*** dprince has joined #tripleo12:33
remix_tjlvdombrkr: my hosts have 6 nics, on first there is provisioning on 3rd and 4th a bond with some vlans, and 5th and 6th another bond some other vlans12:33
pabelangerEmilienM: okay, cool, they are going to merge! Incoming merge bomb.12:33
pabelanger5hr3mmin down to 1hr9min :)12:34
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-common master: Support fernet key rotation with containers  https://review.openstack.org/49902812:36
*** aditya_r has joined #tripleo12:36
sshnaidmdoes this error look familiar to somebody? ERROR: Error in 77 output role_data: No function "#operator_+" matches supplied arguments  http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-oooq/2207760/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-08-30_09_37_1112:38
*** garyk has quit IRC12:40
*** ansmith has joined #tripleo12:41
openstackgerritMerged openstack/tripleo-heat-templates master: Use switch to containers instead of take over playbook for ceph-ansible  https://review.openstack.org/49624312:41
openstackgerritMerged openstack/puppet-tripleo master: Add /etc/ceph into pacemaker bundles  https://review.openstack.org/49835612:41
openstackgerritMerged openstack/tripleo-heat-templates master: Remove src_ceph from manila kolla_config  https://review.openstack.org/49849212:41
openstackgerritMerged openstack/tripleo-heat-templates master: Change ManageEventPipeline to true  https://review.openstack.org/49844012:42
*** liverpooler has quit IRC12:42
openstackgerritMerged openstack/tripleo-quickstart-extras master: Make image path for tempest configurable  https://review.openstack.org/49831412:42
pabelangerC-C-C-COMBO BREAKER12:42
openstackgerritMerged openstack/tripleo-quickstart master: fs017: run tempest like fs006  https://review.openstack.org/49857312:42
openstackgerritMerged openstack/tripleo-heat-templates master: Add clustercheck to service list for scenarios  https://review.openstack.org/49847412:43
*** oneswig has quit IRC12:43
openstackgerritMerged openstack/tripleo-quickstart-extras master: Removing TestNetworkBasicOps from skip list  https://review.openstack.org/49854412:43
openstackgerritMerged openstack/tripleo-quickstart-extras master: tempest/exclude: remove TestEncryptedCinderVolumes  https://review.openstack.org/49856012:43
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Nova]  https://review.openstack.org/49910812:43
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add port security option for OVB with no network isolation  https://review.openstack.org/49683812:43
openstackgerritMerged openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/48739812:43
openstackgerritMerged openstack/tripleo-heat-templates master: Add support for Dell EMC VMAX ISCSI Backend  https://review.openstack.org/48939312:43
openstackgerritMerged openstack/tripleo-heat-templates master: container ovs-agent, ensure br-ex exists  https://review.openstack.org/49369512:43
openstackgerritMerged openstack-infra/tripleo-ci master: Don't use docker-network.yaml env  https://review.openstack.org/49772012:43
openstackgerritMerged openstack/tripleo-heat-templates master: Add support for Dell EMC VMAX Manila Backend  https://review.openstack.org/49109412:44
openstackgerritMerged openstack/tripleo-heat-templates master: Add support for Dell EMC Isilon Manila  backend  https://review.openstack.org/48889612:44
openstackgerritMerged openstack/tripleo-quickstart master: Don't use docker-network.yaml env  https://review.openstack.org/49772212:44
openstackgerritMerged openstack/tripleo-ui stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49763512:44
openstackgerritMerged openstack/tripleo-ui master: Update reno for stable/pike  https://review.openstack.org/49763612:44
openstackgerritMerged openstack-infra/tripleo-ci master: Use local cirros image for tempest tests  https://review.openstack.org/49831512:45
*** pchavva has joined #tripleo12:45
jistrwow :)12:45
pabelangermuch wow12:46
EmilienMyes12:46
pabelangersuch working CI12:46
EmilienMwe need more of THAT12:46
EmilienMok now backports12:46
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Use switch to containers instead of take over playbook for ceph-ansible  https://review.openstack.org/49913112:47
openstackgerritAndy Smith proposed openstack/tripleo-heat-templates master: OpenStack containerized qdrouterd service  https://review.openstack.org/47904912:47
pabelangerhave to run an errand, back in 90mins12:47
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates stable/pike: Add clustercheck to service list for scenarios  https://review.openstack.org/49913312:48
jristWHOAAAAA12:48
jristpabelanger++12:48
*** tzumainn has joined #tripleo12:49
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/pike: Add /etc/ceph into pacemaker bundles  https://review.openstack.org/49913412:49
jristhonza: https://review.openstack.org/#/c/46960812:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Remove src_ceph from manila kolla_config  https://review.openstack.org/49913512:50
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Change ManageEventPipeline to true  https://review.openstack.org/49913612:50
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: container ovs-agent, ensure br-ex exists  https://review.openstack.org/49913712:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add support for Dell EMC Unity Manila Backend  https://review.openstack.org/49858212:52
honzajrist: yes?12:53
*** japestinho has joined #tripleo12:53
jristhonza: you can +1 it since the latest patch isn't you :)12:53
jristjust sayin'12:53
honza:D12:53
honzajrist: 10x +1 doesn't equal 2x +2 :)12:53
jristlol12:53
jrist:(12:53
*** bkopilov has joined #tripleo12:56
sshnaidmfyi https://bugs.launchpad.net/tripleo/+bug/171400512:56
openstackLaunchpad bug 1714005 in tripleo "CI. periodic master job fails because "ERROR: Error in 77 output role_data: No function "#operator_+" matches supplied arguments"" [Critical,Triaged]12:56
*** adarazs_brb is now known as adarazs12:57
*** agurenko has joined #tripleo12:58
*** links has quit IRC13:00
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add support for Dell EMC VMAX ISCSI Backend  https://review.openstack.org/49913913:01
thervesshnaidm, Issue with heat?13:06
sshnaidmtherve, may be13:06
*** jpena|lunch is now known as jpena13:06
openstackgerritMerged openstack/tripleo-validations stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49763713:07
openstackgerritMerged openstack/tripleo-validations stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike  https://review.openstack.org/49763813:08
therveNow to know what ServiceChain 77 is...13:09
*** atoth has quit IRC13:10
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291013:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383213:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386813:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171400513:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)13:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)13:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)13:10
openstackLaunchpad bug 1714005 in tripleo "CI. periodic master job fails because "ERROR: Error in 77 output role_data: No function "#operator_+" matches supplied arguments"" [Critical,Triaged]13:10
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Add a lightweight UC template/role data for deployed-servers  https://review.openstack.org/49914413:10
*** artom has quit IRC13:13
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates stable/pike: Change ManageEventPipeline to true  https://review.openstack.org/49913613:13
*** jaganathan has quit IRC13:13
openstackgerritJanki Chhatbar proposed openstack/python-tripleoclient master: Add neutron_driver value to prepare command  https://review.openstack.org/49874313:15
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Add a lightweight UC template/role data for deployed-servers  https://review.openstack.org/49914413:15
*** catintheroof has joined #tripleo13:15
*** pdeore__ has quit IRC13:17
*** masco has quit IRC13:17
*** garyk has joined #tripleo13:18
*** Goneri has joined #tripleo13:23
*** pdeore__ has joined #tripleo13:24
jristcan someone from instack-undercloud bless this? https://review.openstack.org/#/c/46960813:26
jristwe need it for RC213:26
jristmwhahaha: ^ ?13:26
*** pradk has quit IRC13:27
EmilienMjrist: we're in a mtg, please wait13:33
EmilienMunless someone else can review this code13:33
jristo13:34
jristsorry13:34
jristdidn't know :)13:34
EmilienMjrist: planning :)13:34
lvdombrkrremix_tj:can you look into my config files : http://paste.openstack.org/raw/619893/13:34
*** dsariel has joined #tripleo13:35
lvdombrkr remix_tj: maybe there will be some feedback from you13:35
*** leitan has joined #tripleo13:35
remix_tjlvdombrkr: i'll take a look and let you know13:36
*** ebarrera has quit IRC13:36
*** ebarrera has joined #tripleo13:36
*** aditya_r has quit IRC13:36
lvdombrkrremix_tj: thanks. in few words i just want get publicVIP to test ssl13:37
*** aditya_r has joined #tripleo13:37
*** aditya_r has quit IRC13:39
*** cdearborn has joined #tripleo13:41
jaosoriorbandini: could you check this out https://review.openstack.org/#/c/496520/ ?13:41
jaosoriorjistr: ^13:42
*** lblanchard has joined #tripleo13:43
*** lblanchard has quit IRC13:43
*** jmelvin has joined #tripleo13:44
*** mrch has joined #tripleo13:44
*** lblanchard has joined #tripleo13:44
openstackgerritThomas Herve proposed openstack/tripleo-heat-templates master: Use list_concat in place of yaql  https://review.openstack.org/49915713:44
*** liverpooler has joined #tripleo13:44
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates master: Maintain ceph-osd package only on nodes hosting CephOSD service  https://review.openstack.org/49692113:47
oidgarhi guys, I have a question regarding overcloud controller hostname13:48
oidgarafter deploying overcloud, when I run hostnamectl inside the controller I get both static and transient name13:48
oidgaranyone knows why the transient name is configured?13:49
*** dpawar has joined #tripleo13:50
*** trown is now known as trown|brb13:54
*** liverpooler has quit IRC13:55
*** liverpooler has joined #tripleo13:55
openstackgerrityolanda.robla proposed openstack/tripleo-image-elements master: Update ironic-agent-multipath element  https://review.openstack.org/49908213:56
openstackgerrityolanda.robla proposed openstack/tripleo-image-elements master: WIP: Update ironic-agent-multipath element  https://review.openstack.org/49908213:57
jaosoriorjistr: thanks!13:58
*** trown|brb is now known as trown13:59
jistrnp :)13:59
toskyuhm, how can I see the reason why half of my containers are unhealthy?13:59
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260714:00
jistrtosky: could be this? https://bugs.launchpad.net/tripleo/+bug/171318314:00
openstackLaunchpad bug 1713183 in tripleo "cron containers show as unhealthy" [High,In progress] - Assigned to Dan Prince (dan-prince)14:00
toskyjistr: uhm, not only the 4 touched by that14:00
toskybut more in general, that bug and the review does not explain why the health check should be overridden14:00
*** mrch has quit IRC14:00
openstackgerritThomas Herve proposed openstack/tripleo-common master: Make some tweaks to swift logging  https://review.openstack.org/49893014:00
toskyor better, I don't understand it :)14:01
mandretosky: there are a few more patches in the pipes beside the one jistr linked, https://review.openstack.org/#/c/497792/ and https://review.openstack.org/#/c/498805/14:02
jistrIIRC it was that the containers images have health checks meant for the actual services, but we do more than that with the images -- crons, one time tasks, etc14:02
jistrand for those tasks the health checks don't match, so they report false alarms14:02
toskymandre: about https://review.openstack.org/#/c/498805/ - should sahara-api be affected as well?14:03
toskyI see it as unhealthy (even if *cough* this is not exactly RDO)14:03
toskymandre: no, sorry, sahara-engine is unhealthy; sahara-api is fine14:04
*** links has joined #tripleo14:04
mandretosky: I see sahara-engine relies on healthcheck_port that should be taken care of with https://review.openstack.org/#/c/497792/14:05
toskymandre: oh, ok; I will wait for that patch then14:05
toskymandre: or can I just manually apply it to a deployed system for testing, or does it require a redeploy?14:06
*** stendulker has joined #tripleo14:06
*** links has quit IRC14:06
*** pcaruana has quit IRC14:06
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291014:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171383214:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171386814:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171400514:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)14:10
openstackLaunchpad bug 1713868 in tripleo "devstack-gate doesn't provide ovs_vxlan_bridge function anymore" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger)14:10
openstackLaunchpad bug 1714005 in tripleo "CI. periodic master job fails because "ERROR: Error in 77 output role_data: No function "#operator_+" matches supplied arguments"" [Critical,Triaged]14:10
*** skramaja has quit IRC14:11
*** agurenko has quit IRC14:11
mandretosky: you can 'docker exec' to get in the container and change the files manually to test the patches, but atm https://review.openstack.org/#/c/497792/ doesn't work14:11
toskymandre: ack14:12
*** achadha has joined #tripleo14:14
lvdombrkrremix_tj: any comments?14:16
remix_tjlvdombrkr: sorry i've been in a meeting14:17
*** jeblair_ is now known as jeblair14:17
lvdombrkrremix_tj: no worries14:17
openstackgerritKarthik S proposed openstack/tripleo-heat-templates master: Provide DPDK nic configs and add multiqueue config  https://review.openstack.org/47453314:18
*** achadha has quit IRC14:18
openstackgerritMerged openstack/tripleo-common master: Add error message if no bare metal nodes available  https://review.openstack.org/45970114:20
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Use Python to compute release notes version  https://review.openstack.org/49912314:20
*** aditya_r has joined #tripleo14:20
*** ffiore has quit IRC14:22
*** gcerami|lunch has joined #tripleo14:24
*** dpawar has quit IRC14:27
*** dougbtv_laptop has joined #tripleo14:27
*** sshnaidm_ has joined #tripleo14:29
*** gcerami|lunch is now known as gcerami14:30
*** sshnaidm has quit IRC14:30
abishopsshnaidm_: I updated https://review.openstack.org/474981 and https://review.openstack.org/486175 with pastebin links that demonstrate how the patches fix each bug14:33
*** kjw3 has joined #tripleo14:39
*** ykarel has quit IRC14:40
*** artom has joined #tripleo14:40
*** mdnadeem has quit IRC14:42
*** ffiore has joined #tripleo14:45
openstackgerritBen Nemec proposed openstack/tripleo-validations master: Update envlist to match what is supported  https://review.openstack.org/49917714:46
openstackgerritJanki Chhatbar proposed openstack/tripleo-common master: Add ODL container images to TripleO-common.  https://review.openstack.org/49838314:49
*** aufi has quit IRC14:50
*** aufi has joined #tripleo14:50
*** pdeore__ has quit IRC14:51
remix_tjlvdombrkr: imho seems ok, but i think you'll need to do the same also for computing, which you're still keeping commented out14:54
jtomasekakrivoka: is it in theory possible that certain plan won't have plan-environment.yaml?14:56
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: Update URIs linked in TripleO-CI documentation  https://review.openstack.org/48963614:56
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Disable properly services api_cfn and api_cloudwatch.  https://review.openstack.org/49918214:56
*** shreshtha has joined #tripleo14:57
*** atoth has joined #tripleo14:57
jankimandre, thanks :)14:58
akrivokajtomasek: no, we are making sure that it's there when creating a plan https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/plan.py#L7214:58
*** shreshtha has quit IRC14:58
lvdombrkrremix_tj: thanks for feedback, i will also do that for compute...14:58
*** shreshtha has joined #tripleo14:59
lvdombrkrremix_tj: do jo have just test lab? or production?14:59
mandrenice work janki14:59
remix_tjlvdombrkr: pre-production env with baremetal machines where some people is running their dev envs14:59
jtomasekakrivoka: is it possible to create plan with different name in plan-environment.yaml then we're actually creating? I think it is possible, right?14:59
remix_tjlvdombrkr: the lab where we test openstack is a tripleo-quickstart setup15:00
*** ykarel has joined #tripleo15:00
*** shreshtha has quit IRC15:01
lvdombrkrremix_tj: ohhh.. ho many nodes do you have ?15:01
*** shreshtha has joined #tripleo15:01
openstackgerritMerged openstack/tripleo-heat-templates master: Persist containerized services httpd logs  https://review.openstack.org/48995515:01
mandrenumans: now we can add the patches for ovn on top of https://review.openstack.org/#/c/498383/ and https://review.openstack.org/#/c/498743/15:02
remix_tjlvdombrkr: 6 (3 ctrl + 3 compute) plus an external ceph cluster with 6 nodes15:02
*** shreshtha has quit IRC15:02
numansmandre, ack. i started on with the tripleo-client patch :).15:02
mandrenumans: cool, thx15:03
openstackgerritMerged openstack-infra/tripleo-ci master: Use release specific repos during containers build  https://review.openstack.org/49868815:03
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49762815:03
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci master: In-tree ovs_vxlan_bridge function from devstack-gate  https://review.openstack.org/49898515:04
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike  https://review.openstack.org/49762915:04
openstackgerritMerged openstack/tripleo-image-elements stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49763115:04
akrivokajtomasek: I think these lines are supposed to make sure that doesn't happen https://github.com/openstack/tripleo-common/blob/master/tripleo_common/utils/plan.py#L46-L4715:04
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Heat]  https://review.openstack.org/49139915:04
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Aodh]  https://review.openstack.org/49141115:04
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mistral]  https://review.openstack.org/49347115:04
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Nova]  https://review.openstack.org/49910815:04
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Gnocchi]  https://review.openstack.org/49143315:04
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mixed-1]  https://review.openstack.org/49519515:04
akrivokajtomasek: in fact that might be missing a call to put_env... I'll have to test it to say for sure15:05
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Remove hard-coded image reference  https://review.openstack.org/49495115:05
jtomasekakrivoka: ok, I've added a comment about it in the review. I think it would be good to take that use case into account and handle that in GUI, just in case...15:06
akrivokajtomasek: right, thanks that's a good point, I'll test around a bit15:06
*** jcoufal has quit IRC15:06
jtomasekakrivoka: cool15:07
*** janki has quit IRC15:07
*** rcernin has quit IRC15:09
*** dparkes has quit IRC15:09
openstackgerritMerged openstack/tripleo-puppet-elements stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49763315:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291015:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171400515:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)15:10
openstackLaunchpad bug 1714005 in tripleo "CI. periodic master job fails because "ERROR: Error in 77 output role_data: No function "#operator_+" matches supplied arguments"" [Critical,Triaged]15:10
jtomasekakrivoka: it would be great to wrap this logic and standardize it in mistral tripleo.plan.list action rather than doing multiple api calls in GUI (as mentioned in TODO note)15:10
jtomasekakrivoka: also please remove the 'title' in catch statement as part of the patch:)15:10
akrivokajtomasek: ack, agreed15:11
*** ebarrera has quit IRC15:12
*** sai is now known as sai-mtg15:13
*** sri_ has joined #tripleo15:14
*** jcoufal has joined #tripleo15:15
*** stendulker has quit IRC15:15
*** stendulker has joined #tripleo15:16
EmilienMbug 1712910 - do we need this one as an alert? what's the status weshay ?15:16
openstackbug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] https://launchpad.net/bugs/1712910 - Assigned to wes hayutin (weshayutin)15:16
*** weshay is now known as weshay_interview15:17
weshay_interviewEmilienM, get w/ you in bit15:17
*** limao has joined #tripleo15:19
*** yprokule has quit IRC15:21
*** limao has quit IRC15:25
*** udesale__ has quit IRC15:26
*** mwhahaha changes topic to "CI Status: GREENish | TripleO | https://docs.openstack.org/tripleo-docs/latest/ | http://tripleo.org"15:27
*** pradk has joined #tripleo15:30
EmilienMmwhahaha: thx15:31
openstackgerritMerged openstack/puppet-tripleo master: Add manifests to install and configure stunnel  https://review.openstack.org/49724015:31
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add support for Dell EMC Isilon Manila  backend  https://review.openstack.org/49919515:32
*** aufi has quit IRC15:32
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add support for Dell EMC VMAX Manila Backend  https://review.openstack.org/49919915:34
openstackgerrityolanda.robla proposed openstack/tripleo-image-elements master: WIP: Update ironic-agent-multipath element  https://review.openstack.org/49908215:37
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add support for Dell EMC VNX Manila Backend  https://review.openstack.org/49920415:39
trozetEmilienM: looks like the failure is due to an ODL bug in OOO CI.  We dont see this in OPNFV CI.  Looking at this deployment things are slightly different for the network configuration15:40
trozetEmilienM: is this deployment all in one or something? I only see that one subnode and dont see other compute nodes or anything?15:40
EmilienMtrozet: not a good time, sorry15:42
trozettrown, michapma: maybe you can answer ^^?15:43
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Drop step_config as top level docker requirement  https://review.openstack.org/44271615:44
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: docker: Add unit tests on service_name  https://review.openstack.org/44275515:44
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Add docker templates to configure Ironic inspector  https://review.openstack.org/45782215:44
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/pike: Support for Dell EMC Isilon Manila Driver  https://review.openstack.org/49829415:45
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/pike: Support for Dell EMC Unity Manila Driver  https://review.openstack.org/49830715:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add support for Dell EMC Unity Manila Backend  https://review.openstack.org/49858215:47
*** itlinux has joined #tripleo15:47
*** itlinux has quit IRC15:48
bogdandofolks this is the way I'm used to deploy my dev envs https://review.openstack.org/#/c/499144/ , just sorted oder of the services. Does this matter?.. It suddenly failed overcloud deploy with that a little change, it says there is no messaging-websocket endpoint registered. But zaqar container is running...15:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add support for Dell EMC VNX Manila Backend  https://review.openstack.org/49920415:50
pabelangerEmilienM: it looks like we still got 2 hits on http://status.openstack.org/elastic-recheck/#1713832 this morning15:51
*** sid2 has joined #tripleo15:51
*** yamahata has joined #tripleo15:51
pabelangerneed to check logs to see if the revert had merged by then15:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add support for Dell EMC VMAX ISCSI Backend  https://review.openstack.org/49913915:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add support for Dell EMC VMAX Manila Backend  https://review.openstack.org/49919915:52
EmilienMpabelanger: the revert isn't merged AFIK15:53
EmilienMpabelanger: in stable/pike I mean15:53
EmilienMsorry15:53
EmilienMpabelanger: I approved it15:53
EmilienMoh wait it merged15:53
*** sid1 has quit IRC15:53
EmilienMpabelanger: it should be good now.15:54
pabelangerya, http://logs.openstack.org/93/489393/10/gate/gate-tripleo-ci-centos-7-scenario002-multinode-oooq/a4707b1/logs/undercloud/var/log/extra/logstash.txt is a failure on master15:54
*** pcaruana has joined #tripleo15:54
pabelangerfrom this morning15:54
pabelangerI think that was after the revert merged15:54
pabelangerso, possible the revert isn't the fix15:54
pabelangerlets keep an eye on elastic-recheck15:54
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add support for Dell EMC Isilon Manila  backend  https://review.openstack.org/49919515:55
openstackgerritRicardo Noriega proposed openstack/tripleo-puppet-elements master: Adding Bagpipe driver to controller and compute elements  https://review.openstack.org/45467015:55
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/pike: Certmonger: Only attempt to reload haproxy is it's active  https://review.openstack.org/49829515:56
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/pike: HAProxy: Make certmonger bundle the cert and key on renewal  https://review.openstack.org/49830815:56
EmilienMpabelanger: on which branch?15:57
pabelangerEmilienM: master15:58
EmilienMshit15:58
mariospabelanger: EmilienM o/ folks... yeah i saw it hit twice today15:58
EmilienMmarios: FWIW, I'm happy to revert revert once things get stable and even backport again your stuff, no worries15:58
pabelangermarios: which review?15:58
mariosi spent some time looking at logs (I think therve was too but haven't heard back)15:58
EmilienMmarios: right now we're trying to see what's happenning15:58
mariosEmilienM: yeah thanks that is fine man. no need to apologise you have to cut the release.15:59
mariosEmilienM: but lets see that recheck tomorrow too15:59
mariosEmilienM: /me getting ready to go for today15:59
*** aditya_r has quit IRC15:59
pabelangerwe can recheck the revert like 10 times15:59
EmilienMmarios: ok np, we'll keep loiking15:59
pabelangercollect some data15:59
pabelangerif still fail, then revert wasn't the issue :)15:59
EmilienMbut yeah we need to stop 'recheck' and collect data from now15:59
mariospabelanger: this one https://review.openstack.org/#/c/499116/16:00
mariospabelanger: well, the thing it reverts :) is what EmilienM landed and after that landed, we saw the issue in the logstash twice today16:00
*** ffiore has quit IRC16:00
pabelangerYa, I think rechecking 499116 is good, just to see if we hit http://status.openstack.org/elastic-recheck/#1713832 again, then look at data, and decide to approve or not16:00
pabelangerother patches, ya, we shouldn't recheck just yet16:01
pabelangerwe need to audit those failures16:01
pabelangerBut, at the moment, the gate is looking really good again16:01
EmilienMpabelanger: what version of instack-undercloud did we have in the 2 failures this morning?16:01
EmilienMdid we have the revert,16:01
EmilienM?16:01
pabelangerI am not sure16:01
EmilienMyou can see it in rpm-qa logs16:01
pabelangerI can look now16:01
mariosbai folks ttyl have a good day16:02
*** marios has quit IRC16:02
mwhahahaoh he left16:02
pabelangerinstack-undercloud-7.3.1-0.20170830043725.6c3ca0c.el7.centos.noarch16:02
mwhahahai was going to say it might not have been the cause but it might have been making a racecondition worse16:02
EmilienMdamn16:02
EmilienMit has the revert16:02
EmilienMis the error still the same?16:03
pabelangermwhahaha: ya, possible16:03
*** sshnaidm_ is now known as sshnaidm16:03
pabelangerEmilienM: ya16:03
pabelangerelastic-recheck hit on it16:03
EmilienMshow me logs16:03
mwhahahaso i think there's an underlyin issue with mistral/zaqar16:03
*** lucasagomes is now known as lucas-afk16:03
*** weshay_interview is now known as weshay16:03
EmilienMwait, I want to see if it's the same workflow that fails16:03
pabelangerhttp://logs.openstack.org/93/489393/10/gate/gate-tripleo-ci-centos-7-scenario002-multinode-oooq/a4707b1/logs/undercloud/var/log/extra/logstash.txt#_2017-08-30_09_22_2116:03
EmilienMpabelanger: any url handy?16:03
EmilienMok16:03
pabelanger^16:03
EmilienMhttp://logs.openstack.org/93/489393/10/gate/gate-tripleo-ci-centos-7-scenario002-multinode-oooq/a4707b1/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-08-30_09_22_2116:04
EmilienMStarted Mistral Workflow tripleo.validations.v1.check_pre_deployment_validations16:04
openstackgerritAna Krivokapic proposed openstack/tripleo-ui master: Handle issues with Ironic Inspector more gracefully  https://review.openstack.org/49921616:04
EmilienMwith instack-undercloud-7.3.1-0.20170830043725.6c3ca0c.el7.centos.noarch16:05
EmilienMso yeah, the revert didn't help much16:05
EmilienMthrash, rbrady: need your help guys16:05
rbradyEmilienM: ack16:06
EmilienMrbrady: https://launchpad.net/bugs/171383216:07
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Marios Andreou (marios-b)16:07
*** atoth has quit IRC16:07
*** gcerami has quit IRC16:07
d0ugalEmilienM: is zaqar running?16:08
mwhahahayea it's running16:08
EmilienMmwhahahan, pabelanger: I tried to git history on recent patches related to this code and I don't see recent changes16:08
pabelangerEmilienM: mwhahaha: it is possible it has been there for a while too, we only have 10 day window for logstash data16:09
d0ugalEmilienM, mwhahaha: http://logs.openstack.org/93/489393/10/gate/gate-tripleo-ci-centos-7-scenario002-multinode-oooq/a4707b1/logs/undercloud/var/log/zaqar/zaqar-server.log.txt.gz16:09
mwhahahad0ugal: yea so the it seems that the container doesn't get created until later or something16:09
mwhahahad0ugal: but i have no idea how any of that works16:10
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171400516:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1714005 in tripleo "CI. periodic master job fails because "ERROR: Error in 77 output role_data: No function "#operator_+" matches supplied arguments"" [Critical,Triaged] - Assigned to Thomas Herve (therve)16:10
mwhahahad0ugal: if you look in messages, you see a put for the container that comes after that error16:10
d0ugalmwhahaha: right, but it is zaqar that is failing to create the container?16:10
mwhahahad0ugal: seems like it16:10
d0ugalI didn't even know zaqar used swift :)16:10
d0ugalWe probably need help from somebody familiar with zaqar16:11
*** japestinho has quit IRC16:11
mwhahahahttp://logs.openstack.org/93/489393/10/gate/gate-tripleo-ci-centos-7-scenario002-multinode-oooq/a4707b1/logs/undercloud/var/log/messages.txt.gz#_Aug_30_09_22_3916:12
mwhahahathe create happens after that error from zaqar-server16:12
mwhahahait's all black magic to me16:12
d0ugalhmm, yeah, it doesn't make much sense to me either.16:14
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Support for Dell EMC VNX Manila Driver  https://review.openstack.org/49064216:14
*** suuuper has quit IRC16:14
rbradyd0ugal: https://github.com/openstack/zaqar/blob/c03bde76e00afa1c19fd797fa0555db73ab4dd3e/releasenotes/notes/add-swift-backend-4eb9b43913f39d18.yaml16:14
*** cylopez has quit IRC16:15
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Add a lightweight UC template/role data for deployed-servers  https://review.openstack.org/49914416:17
*** stendulker has quit IRC16:19
*** jfrancoa has quit IRC16:22
*** sid2 has quit IRC16:23
openstackgerritLee Yarwood proposed openstack/tripleo-heat-templates master: WIP - Introduce skip level upgrade tasks and playbooks  https://review.openstack.org/49922116:23
openstackgerritRicardo Noriega proposed openstack/tripleo-puppet-elements master: Adding Bagpipe driver to controller and compute elements  https://review.openstack.org/45467016:24
*** hewbrocca is now known as hewbrocca_afk16:25
*** sshnaidm has quit IRC16:26
*** sid1 has joined #tripleo16:26
*** sid1 has quit IRC16:26
*** dtantsur is now known as dtantsur|afk16:28
openstackgerritJustin Kilpatrick proposed openstack/tripleo-quickstart-extras master: WIP: Disruption detection and some stack update roles  https://review.openstack.org/49795016:29
*** itlinux has joined #tripleo16:31
*** tesseract has quit IRC16:33
*** trown is now known as trown|lunch16:33
itlinuxhello Team! I see that a tempest file is gen what's the best way to use it.. is there. a doc I can look which describes it..16:34
*** ramishra has quit IRC16:35
*** oidgar has quit IRC16:35
*** mcornea has quit IRC16:36
*** cdearborn has quit IRC16:38
*** mhenkel_ has joined #tripleo16:40
mhenkel_Hi community. Any idea on how to set a kernel arg on a per role basis in tripleo stable/newton (I know how it works in ocata or later but there is no pre-network in stable/newton)16:41
*** fzdarsky has quit IRC16:43
*** fzdarsky has joined #tripleo16:43
*** snecklifter has quit IRC16:43
*** egonzalez has quit IRC16:45
*** pdeore__ has joined #tripleo16:47
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci master: In-tree ovs_vxlan_bridge function from devstack-gate  https://review.openstack.org/49898516:50
*** mhenkel__ has joined #tripleo16:51
*** mhenkel_ has quit IRC16:51
*** fzdarsky is now known as fzdarsky|afk16:51
*** fzdarsky|afk has quit IRC16:56
*** gkadam_ has joined #tripleo16:57
*** bogdando has quit IRC16:59
*** Vijayendra has quit IRC17:03
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/pike: Add manifests to install and configure stunnel  https://review.openstack.org/49923417:06
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Persist containerized services httpd logs  https://review.openstack.org/49923517:06
openstackgerritEmilien Macchi proposed openstack/tripleo-common stable/pike: Add error message if no bare metal nodes available  https://review.openstack.org/49923617:06
EmilienMmwhahaha: 3 more backports ^17:06
pabelangerweshay: cool http://logs.openstack.org/21/496921/3/check/gate-tripleo-ci-centos-7-containers-multinode/284aac8/logs/undercloud/etc/docker/daemon.json.txt.gz17:07
pabelangercan we make that debug true?17:08
mwhahahapabelanger: https://review.openstack.org/#/c/496851/17:08
mwhahahaneeded first17:08
weshaypabelanger, we'd have to add something to instack-undercloud17:08
mwhahahaweshay: -^17:08
pabelangerokay, cool17:08
*** achadha has joined #tripleo17:08
pabelangerthat log 404 from docker.io for some reason too17:08
mwhahahaerr no17:08
mwhahahawrong patch17:08
pabelangerso, helpful :)17:08
mwhahahaweshay: it honors debug flag to undercloud17:08
*** yamahata has quit IRC17:09
mwhahahaweshay: so as long as the undercloud is installed with debug = true it should flip it for docker17:09
weshayoh so debug will be added /etc/docker/daemon.json if undercloud debug is set?17:09
*** achadha has quit IRC17:09
mwhahahaweshay: yes17:09
* mwhahaha finds review17:09
weshayok.. thanks for letting me know17:09
*** achadha has joined #tripleo17:10
mwhahahaweshay: pabelanger EmilienM: https://review.openstack.org/#/c/497477/ that's the change17:10
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171400517:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1714005 in tripleo "CI. periodic master job fails because "ERROR: Error in 77 output role_data: No function "#operator_+" matches supplied arguments"" [Critical,Triaged] - Assigned to Thomas Herve (therve)17:10
pabelangermwhahaha: cool, true http://logs.openstack.org/77/497477/1/check/gate-tripleo-ci-centos-7-containers-multinode/c33c40a/logs/undercloud/etc/docker/daemon.json.txt.gz17:10
pabelangerlet me see if logs are collected17:10
*** achadha has quit IRC17:10
pabelangernice17:11
pabelangerhttp://logs.openstack.org/77/497477/1/check/gate-tripleo-ci-centos-7-containers-multinode/c33c40a/logs/undercloud/home/jenkins/docker_journalctl.log.txt.gz#_Aug_29_17_20_4817:11
*** achadha has joined #tripleo17:11
pabelangerokay, so hopefully in the future that will say why we get 404 back from docker.io17:12
mwhahahaunlikely17:12
mwhahaha:D17:12
*** pdeore__ has quit IRC17:12
*** dprince has quit IRC17:13
*** jpich has quit IRC17:13
*** dmarlin has joined #tripleo17:14
*** dprince has joined #tripleo17:15
*** achadha_ has joined #tripleo17:15
*** achadha has quit IRC17:15
*** sshnaidm has joined #tripleo17:18
*** achadha has joined #tripleo17:18
*** milan has quit IRC17:19
*** achadha_ has quit IRC17:19
*** Vijayendra has joined #tripleo17:20
*** dsariel has quit IRC17:20
*** atoth has joined #tripleo17:24
*** atoth has quit IRC17:24
jristworkflow +A whenever someone gets a chance https://review.openstack.org/#/c/469608/17:24
*** cschwede has quit IRC17:25
*** atoth has joined #tripleo17:27
*** dougbtv_laptop has quit IRC17:31
mwhahahabnemec: https://review.openstack.org/#/c/497477/ when you get a sec17:31
*** achadha has quit IRC17:33
pabelangernext 90mins going to be a good test for the gate17:33
*** Vijayendra has quit IRC17:33
*** achadha has joined #tripleo17:33
bnemecjrist: Have you looked into the ha job failure at all?17:34
weshayneed wf on tht patch https://review.openstack.org/#/c/496800/17:35
jristbnemec: unfortunately it's not a priority. it has passed before17:35
jristbnemec: on this patch in particular17:36
jristbnemec: :(17:37
bnemecjrist: Not in a week though.17:37
jristfair17:37
bnemecAnd several patch sets.17:37
bnemecI'm okay accepting combined runs if they're relatively close together and all on the same patch set.17:38
bnemecI mean, I don't _think_ it's related to the change, but I wouldn't have guessed that the undercloud validations patch would trigger a zaqar bug either.17:38
bnemecI see nothing in the logs from around that time either. :-/17:41
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Add --wsrep-provider=none to the mysql_bootstrap container  https://review.openstack.org/49924217:45
EmilienMweshay: I need some help, all upgrade jobs fail on http://logs.openstack.org/35/499135/1/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/f093c5d/console.html#_2017-08-30_13_16_25_38511517:45
EmilienMI can't handle it right now17:45
weshayk17:45
*** jpena is now known as jpena|away17:46
*** trown|lunch is now known as trown17:46
*** yamahata has joined #tripleo17:46
EmilienMcan someone approve https://review.openstack.org/#/c/498569/ please?17:46
weshaytrown, sshnaidm need reviews on https://review.openstack.org/#/c/498057/17:49
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Run gnocchi db_sync at step 3  https://review.openstack.org/49813517:52
*** rcernin has joined #tripleo17:52
sshnaidmtrown, there is redundant current-tripleo part17:54
sshnaidmweshay, ^^17:54
*** dsariel has joined #tripleo17:54
weshaysshnaidm, I think it is for upgrade17:54
sshnaidmweshay, we use "current" for master only17:54
weshayoh?17:55
sshnaidmweshay, for branches it's consistent and deps17:55
weshaysshnaidm, we should never use current, we should always use consistent I thought17:55
weshayI think the current_rdo_mirror points to consistent, at least I hope it does17:56
sshnaidmweshay, nope, for master we use the newest packages from /current, for branches we use always consistent17:56
weshayinteresting.. I'll ask the rdo guys if that's right, maybe I'm misunderstanding something17:56
sshnaidmweshay, I think trown should know too17:56
sshnaidmweshay, for pike it should be like this: https://github.com/openstack/tripleo-quickstart/blob/98653ea092592be2afaa88e7f6fc2850f7d1ae51/config/release/tripleo-ci/pike.yml#L4117:57
trownweshay: we have to use current for tripleo packages17:58
trownweshay: if current != consistent then we would have depends-on issues17:59
openstackgerritPradeep Kilambi proposed openstack/tripleo-quickstart master: DNM: TESTING TELEMETRY IN OVB HA  https://review.openstack.org/47666618:00
*** gkadam_ has quit IRC18:01
*** anshul has quit IRC18:02
weshaytrown, hrm k18:02
trownweshay: but for you patch it is ocata->pike... so it should just be copy of newton->ocata config with releases switched18:03
weshayah ya18:04
weshaythanks guys18:04
weshayduh18:04
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171400518:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1714005 in tripleo "CI. periodic master job fails because "ERROR: Error in 77 output role_data: No function "#operator_+" matches supplied arguments"" [Critical,Triaged] - Assigned to Thomas Herve (therve)18:10
weshaytrown, I don't think we have a newton->ocata config for upstream18:10
trownweshay: hmm just ocata->master18:12
weshayI think we want two things, ocata->pike and pike->master18:13
weshayI think check experimental will trigger upgrade tests18:13
weshaywill have to look18:13
weshayI'll ask matbu to review18:13
*** dprince has quit IRC18:14
trownweshay: would probably just be https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/pike.yml with overcloud_release and overcloud image urls pointing to ocata18:14
*** pdeore__ has joined #tripleo18:17
*** akrivoka has quit IRC18:18
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: add upgrade release files for the latest deployments  https://review.openstack.org/49805718:20
weshaymatbu, need your review on https://review.openstack.org/#/c/498057/18:21
*** bfournie has quit IRC18:22
*** gbarros has joined #tripleo18:22
*** pkovar has quit IRC18:24
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Use integers for rabbitmq ports  https://review.openstack.org/49912518:28
*** ebarrera has joined #tripleo18:29
*** gbarros has quit IRC18:31
pabelangerEmilienM: mwhahaha: puppet failure: http://logs.openstack.org/34/499134/1/gate/gate-puppet-tripleo-puppet-unit-4.8-centos-7/9da434d/console.html#_2017-08-30_18_17_25_359053 expected since it is using github.com. I think in coming days, after your release, I'd like to try and see if we could pull them from puppet forge, shouldn't be an issue adding that to reverse proxy cache.18:31
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: add upgrade release files for the latest deployments  https://review.openstack.org/49805718:31
EmilienMpabelanger: then we would have to mirror the puppetlabs forge18:32
EmilienMis puppetlabs forge more reliable than github?18:32
mwhahahapabelanger: so the problem is that we track versions that may not be on puppet forge as well18:32
pabelangerEmilienM: not sure, we'd need to collect data. But we'd cache there requires18:32
pabelangermwhahaha: right, that is the downside. We'd have to audit18:33
EmilienMmwhahaha: well, for some modules yes18:33
EmilienMmwhahaha: but most of times it's tags18:33
*** mhenkel__ has quit IRC18:37
*** jprovazn has quit IRC18:47
openstackgerritMerged openstack/instack-undercloud stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49761918:49
pabelangergate is going to reset18:51
pabelangertelnet://15.184.70.201:1988518:51
pabelangerhung fetching from github.com18:51
pabelangerpretty sure it hung18:51
mwhahahabooo18:51
pabelangerso, we'll need rdo to package that into pip package18:51
pabelangerand either release to pypi18:52
pabelangeror expose on trunk.rdoproject.org so we can cache it18:52
mwhahahai thought we switched it to pip18:52
mwhahahaoh rdo info18:53
*** ykarel has quit IRC18:54
pabelangerya, rdoinfo18:55
pabelangerstill a git clone18:55
pabelangerso, need a better way to get that18:56
pabelangerdmsimard: ^18:56
pabelangerrdoinfo failing to git clone from github.com18:56
pabelangerso, http://status.openstack.org/zuul/ is the reason not to depend on github.com, we're about to lose 13 merges to it :( Which means, longer gate pipeline18:59
*** tvignaud has quit IRC19:00
*** artom has quit IRC19:03
*** pdeore__ has quit IRC19:06
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171400519:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1714005 in tripleo "CI. periodic master job fails because "ERROR: Error in 77 output role_data: No function "#operator_+" matches supplied arguments"" [Critical,Triaged] - Assigned to Thomas Herve (therve)19:10
*** mhenkel_ has joined #tripleo19:15
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Fix port health check false negatives  https://review.openstack.org/49779219:16
*** bfournie has joined #tripleo19:20
*** mhenkel_ has quit IRC19:20
*** bfournie has quit IRC19:23
*** bfournie has joined #tripleo19:23
*** iranzo has quit IRC19:27
trozettrown: let me know when you have a couple minutes to discuss OOOQS job19:27
*** ebarrera has quit IRC19:27
*** catintheroof has quit IRC19:28
*** leitan has quit IRC19:32
*** leitan has joined #tripleo19:33
therveDang how that thing got assigned to me19:33
*** gbarros has joined #tripleo19:33
*** leitan has quit IRC19:33
therveOh right19:33
*** leitan has joined #tripleo19:33
*** leitan has quit IRC19:34
therveEmilienM, I doubt my patch fixes the issue19:34
therveI just noticed that code while looking at it19:34
*** dparkes has joined #tripleo19:37
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Fix port health check false negatives  https://review.openstack.org/49779219:38
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Retry if the pacemaker_resource commands failed  https://review.openstack.org/49849919:38
*** mhenkel_ has joined #tripleo19:41
*** gbarros has quit IRC19:42
*** mhenkel_ has quit IRC19:45
*** achadha_ has joined #tripleo19:46
*** jmelvin has quit IRC19:46
*** liverpooler has quit IRC19:48
*** achadha has quit IRC19:48
*** achadha has joined #tripleo19:50
*** achadha_ has quit IRC19:50
*** pchavva has quit IRC19:50
*** gbarros has joined #tripleo19:52
therveSomeone saw "Execution of '/usr/bin/yum -d 0 -e 0 -y install collectd' returned 1: Error: Nothing to do"19:52
*** verdurin has joined #tripleo19:53
openstackgerritBen Nemec proposed openstack/instack-undercloud master: Enable convergence engine on the undercloud  https://review.openstack.org/49928319:53
*** jkilpatr has quit IRC19:58
*** ebarrera has joined #tripleo19:58
*** weshay is now known as weshay_PTO19:58
*** tongl has joined #tripleo20:00
*** mhenkel_ has joined #tripleo20:03
*** sid1 has joined #tripleo20:07
EmilienMtherve: which one?20:07
*** mhenkel_ has quit IRC20:07
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171400520:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1714005 in tripleo "CI. periodic master job fails because "ERROR: Error in 77 output role_data: No function "#operator_+" matches supplied arguments"" [Critical,Triaged]20:10
*** sid1 has quit IRC20:10
*** jmelvin has joined #tripleo20:12
*** sid1 has joined #tripleo20:13
*** jkilpatr has joined #tripleo20:14
*** ebarrera has quit IRC20:15
*** dsariel has quit IRC20:16
*** lblanchard has quit IRC20:17
*** marrusl has quit IRC20:21
*** ebarrera has joined #tripleo20:24
*** florianf has quit IRC20:28
*** catintheroof has joined #tripleo20:29
EmilienMmwhahaha: we need to work on https://review.openstack.org/#/c/498057/20:30
EmilienMseems like weshay_PTO is gone20:30
EmilienMtrown: can you help maybe?20:30
EmilienMall upgrade jobs are failing now, iiuc20:30
mwhahahahrm20:30
EmilienMI think it only affect stable/pike jobs20:32
EmilienMyeah I confirm20:33
EmilienMI'll look at that later but if anyone can help, thanks20:33
*** apetrich has quit IRC20:35
*** marrusl has joined #tripleo20:36
*** apetrich has joined #tripleo20:37
*** pcaruana has quit IRC20:40
stevebakermorning20:40
*** atoth has quit IRC20:40
*** trown is now known as trown|outtypewww20:41
*** mhenkel_ has joined #tripleo20:42
*** ansmith has quit IRC20:45
*** mhenkel_ has quit IRC20:47
openstackgerritEmilien Macchi proposed openstack/puppet-pacemaker master: Use Python to compute release notes version  https://review.openstack.org/49932520:47
EmilienMstevebaker: o/ hola sir20:47
stevebakerEmilienM: good morning20:48
*** Goneri has quit IRC20:48
EmilienMstevebaker: CI is better now, and we managed to merge a good number of things; we need to continue20:48
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Use Python to compute release notes version  https://review.openstack.org/49933320:49
* EmilienM brb lunch20:49
stevebakerEmilienM: should I look again at this? https://review.openstack.org/#/c/498575/20:49
EmilienMstevebaker: It's on my list, I'll disable the 2 services in THT and use Depends-on20:52
EmilienMstevebaker: we want to disable the 2 neutron services in THT/ci/scenario004-container20:52
EmilienMthe services are not containerized20:52
stevebakerEmilienM: yep20:53
*** ecerquei has quit IRC21:00
*** sid1 has quit IRC21:00
*** jpena|away is now known as jpena21:04
*** mhenkel_ has joined #tripleo21:05
*** jmelvin has quit IRC21:05
*** jmelvin has joined #tripleo21:07
*** mhenkel_ has quit IRC21:09
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171400521:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1714005 in tripleo "CI. periodic master job fails because "ERROR: Error in 77 output role_data: No function "#operator_+" matches supplied arguments"" [Critical,Triaged]21:10
*** jpena is now known as jpena|away21:13
*** jcoufal has quit IRC21:13
*** abishop has quit IRC21:14
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Remove bgp-vpn from scenario004-multinode-containers  https://review.openstack.org/49934321:19
EmilienMstevebaker: ^ done21:19
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: enable pingtest on fs019  https://review.openstack.org/49857521:20
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: enable pingtest on fs019  https://review.openstack.org/49857521:20
EmilienMrebased and Depends-On updated as well21:20
*** tvignaud has joined #tripleo21:24
pabelangerEmilienM: mwhahaha: window aliging again for 20 merge attempt21:24
*** jmelvin has quit IRC21:25
pabelanger2017-08-30 21:14:10.385739 | changed: [undercloud] => {"changed": true, "cmd": "set -o pipefail && /home/jenkins/overcloud-prep-containers.sh 2>&1 | awk '{ print strftime(\"%Y-%m-%d %H:%M:%S |\"), $0; fflush(); }' > overcloud_prep_containers.log", "delta": "0:30:48.603604", "end": "2017-08-30 21:14:10.330961", "rc": 0, "start": "2017-08-30 20:43:21.727357", "stderr": "", "stdout": "", "stdout_lines": [],21:25
*** jmelvin has joined #tripleo21:25
pabelanger"warnings": []}21:25
EmilienMpabelanger: let's kick this out21:26
pabelangerthat is from vexxhost21:26
pabelangerI think we are getting network limits to mirror server21:26
EmilienMoops21:26
pabelangerthat usually takes about 15mins in other regions21:26
*** jmelvin has quit IRC21:26
EmilienMpabelanger: have you pinged mnaser?21:26
EmilienMpabelanger: he's very available usually21:26
pabelangerYa, waiting on reply21:26
EmilienMk21:26
pabelangermirror and nodes are in 2 different projects so it is possible21:27
pabelangerso, 3 merging for sure21:27
pabelangerthen chance for 17 merging21:27
*** jmelvin has joined #tripleo21:28
EmilienMthat would be really awesome21:28
pabelangerso far github.com has been the issue21:28
*** noslzzp has quit IRC21:29
*** jmelvin_ has joined #tripleo21:31
EmilienMprobably because they don't run tripleo21:31
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: Use Python to compute release notes version  https://review.openstack.org/49934621:31
*** mhenkel_ has joined #tripleo21:31
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Use Python to compute release notes version  https://review.openstack.org/49934721:31
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Use Python to compute release notes version  https://review.openstack.org/49934821:31
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: Use Python to compute release notes version  https://review.openstack.org/49934621:32
openstackgerritEmilien Macchi proposed openstack/tripleo-image-elements master: Use Python to compute release notes version  https://review.openstack.org/49934921:32
openstackgerritEmilien Macchi proposed openstack/tripleo-puppet-elements master: Use Python to compute release notes version  https://review.openstack.org/49935021:32
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Use Python to compute release notes version  https://review.openstack.org/49934821:32
openstackgerritEmilien Macchi proposed openstack/tripleo-ui master: Use Python to compute release notes version  https://review.openstack.org/49935121:32
*** jmelvin has quit IRC21:32
openstackgerritEmilien Macchi proposed openstack/tripleo-validations master: Use Python to compute release notes version  https://review.openstack.org/49935221:32
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Use Python to compute release notes version  https://review.openstack.org/49935321:33
openstackgerritMerged openstack/instack-undercloud stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike  https://review.openstack.org/49762021:33
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Use Python to compute release notes version  https://review.openstack.org/49935421:33
openstackgerritEmilien Macchi proposed openstack/tripleo-validations master: Use Python to compute release notes version  https://review.openstack.org/49935221:33
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Use Python to compute release notes version  https://review.openstack.org/49935521:33
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: container ovs-agent, ensure br-ex exists  https://review.openstack.org/49913721:33
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Use Python to compute release notes version  https://review.openstack.org/49935521:33
EmilienMstevebaker, mwhahaha, bnemec: when you have some time, please look https://review.openstack.org/#/q/topic:tripleo/reno-versionless - thanks21:34
EmilienMwhen it's merged, I'll backport it and release a new ocata21:34
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Set docker-puppet --health-cmd = /bin/true  https://review.openstack.org/49881221:34
*** mhenkel_ has quit IRC21:35
pabelangertelnet://162.253.55.139:19885 is going to be close, it might time out21:35
pabelangerovercloud_prep_containers.log", "delta": "0:30:48.603604", that is all networking21:36
EmilienMpabelanger: so you're saying we need to reduce some step in the prep_container tasks to avoid timeouts?21:37
pabelangerEmilienM: so, lets say what vexxhost says, because that is traffic to mirror21:37
pabelangerEmilienM: but, smaller containers, will means less things to xfer too21:38
EmilienMok21:38
EmilienMyeah21:38
EmilienMthe thing stevebaker did should also help21:38
pabelangerI think you are pushing a few GB now for containers right?21:38
EmilienMI don't know if we're using it yet21:38
EmilienMbut he's doing a stuff where we pull containers that we only need21:38
EmilienMnot all21:38
EmilienMstevebaker: can you give a status on that?21:38
EmilienMpabelanger: GB? garbage?21:39
*** ecerquei has joined #tripleo21:39
EmilienM(lol sorry I'm tired)21:39
EmilienMpabelanger: I don't know how many GB, I thought it was less.21:39
pabelangerEmilienM: gigabytes :)21:39
pabelangerhttp://logs.openstack.org/24/499124/1/gate/gate-tripleo-ci-centos-7-containers-multinode/bd16342/logs/undercloud/var/log/extra/docker/docker_allinfo.log.txt.gz21:39
pabelangerthat is the size of your registry21:39
pabelangerso, that needs to be xfered every container job21:40
pabelangermaybe 15GB of data?21:40
EmilienMwow21:40
EmilienMwhat a mess21:40
pabelangerSo ya, they are some fat containers :)21:40
bnemecContainers are so lightweight.21:40
bnemecOr so I'm told. ;-)21:40
EmilienMlol21:40
pabelangerindeed21:40
EmilienMyeah I was about to troll21:40
EmilienMsince we moved to container so far we only had problems21:40
EmilienMBUT this is not friday.21:41
pabelangerso, the first thing you could do, is does all the jobs need all those containers? Or can they be limited based on the scenario21:42
EmilienMpabelanger: that's what I'm saying21:42
EmilienMpabelanger: stevebaker did some work on that area21:42
pabelangerthen, deduping of containers, but that is more work21:42
pabelangerEmilienM: ah, cool21:42
EmilienMbut I've lost track on where we are21:42
EmilienMlet me find out21:42
sai-mtgpabelanger: for getting tripleo master images which option should i choose from https://images.rdoproject.org/master/delorean/21:43
*** sai-mtg is now known as sai21:43
EmilienMit was reverted: https://review.openstack.org/#/c/496445/21:43
EmilienMstevebaker, mwhahaha: can you remind us context please?21:43
mwhahahait broke the jobs21:43
mwhahahano container jobs on oooq-extras21:43
EmilienMoh and it's re-added here https://review.openstack.org/#/c/496950/21:43
tonglEmilienM: Saw the error during deploy overcloud "Could not find class ::neutron::plugins::nsx_v3 for overcloud-controller-0". Does that mean it tries to look for file under puppet-neutron/manifests/plugins/nsx_v3.pp?21:44
EmilienMthere is one now: https://review.openstack.org/#/c/496950/21:44
rwsurbrady: is scaling controller nodes supposed to be supported in this way -> https://docs.openstack.org/tripleo-docs/latest/install/post_deployment/scale_roles.html21:44
EmilienMtongl: yes21:44
tonglEmilienM: So it requires the class definition be the same as the .pp file name?21:44
EmilienMstevebaker: I think it needs a little bit more work on https://review.openstack.org/#/c/496950/21:44
EmilienMpabelanger: you want to follow https://review.openstack.org/#/c/496950/21:45
pabelangerEmilienM: mwhahaha: Oh, speaking of 496950. I think we need to add all scenerios to quickstart-extra, I think I seen a failure in the gate the other day21:45
EmilienMpabelanger: we have one now, it's ok I guess21:45
EmilienMtongl: yes21:45
tonglI see. That explains the error. Thanks!21:46
pabelangerEmilienM: 1 sec, let me find log21:47
pabelangerhttp://logs.openstack.org/08/494008/11/gate/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container/def8ce1/logs/undercloud/home/jenkins/failed_deployment_list.log.txt.gz21:47
pabelangerresources.ServiceChain: Property error: resources[39].properties: Property DockerBarbicanApiImage not assigne21:47
pabelangerI think that was the same issue we seen last time reverted21:48
pabelangerbut not 100% sure21:48
*** kjw3 has quit IRC21:48
pabelangerEmilienM: ^21:48
pabelangerAlso, I think the gate is going to reset becuase of vexxhost timeout :(21:49
pabelangergetting pretty long to be still deploying overcloud21:49
pabelangerover 1 hour21:49
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Preparing TripleO CI to test upgrades to Queens  https://review.openstack.org/49935921:50
EmilienMpabelanger: I don't know about that21:50
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: add upgrade release files for the latest deployments  https://review.openstack.org/49805721:51
pabelangerEmilienM: ya, hard to tell, because the patch doesn't run scenerio00221:51
pabelangerdoes 003 have barbicanAPIImage?21:51
EmilienMpabelanger: since we pull all containers, yes?21:51
stevebakerEmilienM: back, I was in a meeting21:51
mwhahahahrm hailing something fierce at my house21:52
EmilienMstevebaker: no prob21:53
openstackgerritMerged openstack/tripleo-validations master: Use Python to compute release notes version  https://review.openstack.org/49935221:53
stevebakerEmilienM, pabelanger: I'll look into failing https://review.openstack.org/#/c/496950/ , I bet there is missing service entries in container-images/overcloud_containers.yaml.j2 after recent merges21:56
EmilienMstevebaker: thanks for looking, this is high prio21:58
*** tvignaud has quit IRC21:59
*** jmelvin_ has quit IRC22:00
pabelangerdamn, gate reset incoming22:04
pabelangerGoing to focus on vexxhost issue now22:05
pabelangersee what we can do to fix it22:05
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: add upgrade release files for the latest deployments  https://review.openstack.org/49805722:06
EmilienMok22:06
EmilienMmwhahaha: trying to bring back upgrade jobs on stable/pike, https://review.openstack.org/498057 and https://review.openstack.org/499359 should help22:06
EmilienMsince pike is released, does it mean i'm not ptl anymore? :P22:07
mwhahahanot until tripleo pike gets released :D22:07
mwhahahaYOU CAN NEVER LEAVE22:07
EmilienMdamn22:07
EmilienMmwhahaha: https://media.giphy.com/media/4pMX5rJ4PYAEM/giphy.gif22:08
mwhahaha:D22:09
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Use Python to compute release notes version  https://review.openstack.org/49937122:09
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171400522:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1714005 in tripleo "CI. periodic master job fails because "ERROR: Error in 77 output role_data: No function "#operator_+" matches supplied arguments"" [Critical,Triaged]22:10
*** mhenkel_ has joined #tripleo22:11
*** ebarrera has quit IRC22:15
*** mhenkel_ has quit IRC22:16
EmilienMbug for upgrades: https://bugs.launchpad.net/tripleo/+bug/171410522:16
openstackLaunchpad bug 1714105 in tripleo "Upgrade jobs don't work on stable/pike" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)22:16
*** gbarros has quit IRC22:18
*** gbarros has joined #tripleo22:20
EmilienMstevebaker: are you going to Sidney I guess?22:21
stevebakerEmilienM: not signed off yet, but 90% yes22:21
EmilienMstevebaker: do you mind if I add you as co-speaker for the tripleo project update talk?22:22
EmilienMstevebaker: I'm not 100% sure I'll go either but just in case22:22
stevebakerEmilienM: sure, all my talks were rejected so I'm up for anything22:23
EmilienMI'll contact foundation if I can't go and you'll be main speaker probably22:23
EmilienMstevebaker: cool.22:23
stevebakersounds good22:23
EmilienMstevebaker: you speak english? I don't22:23
*** itlinux has quit IRC22:23
stevebakerI speak noo zild, they won't understand me22:23
*** morazi has quit IRC22:23
EmilienMlol22:23
stevebakerEmilienM: btw what is the story with backporting rc1/rc2 things to stable/pike? Are we all responsable for backporting our own changes or is there going to be a systematic bulk backport?22:24
*** mhenkel_ has joined #tripleo22:25
EmilienMstevebaker: I'm keeping track of patches that merge in master and backport what I think we should backport but anyone is free to propose22:27
EmilienMstevebaker: you need a launchpad unless it concerns upgrades22:27
*** rcernin has quit IRC22:28
*** achadha_ has joined #tripleo22:28
stevebakerEmilienM: ok22:28
EmilienMstevebaker: I use https://goo.gl/UpsQ2j22:29
EmilienMit's old school but it works for me22:29
EmilienMso I know what merges22:29
rbradyrwsu: yes22:29
EmilienMstevebaker: and 2/3 times a day I check what merged and see it was cherry-picked. If not I do it if necessary... but any help is welcome22:29
*** mhenkel_ has quit IRC22:30
stevebakerEmilienM: ok, I'll take a look22:30
EmilienMstevebaker: afict, everything merged in master has been or is being backported at this time22:30
EmilienMstevebaker: I spent time to check *all* patches since we've cut the branch22:30
*** achadha has quit IRC22:32
*** achadha_ has quit IRC22:33
*** achadha has joined #tripleo22:35
rwsurbrady: it fails for me with -> https://paste.fedoraproject.org/paste/2eKNXqZqvPd6RUWygsRc7Q22:39
*** kbyrne has quit IRC22:40
*** kbyrne has joined #tripleo22:41
EmilienMstevebaker: I'm out, I'm back later22:52
*** pradk has quit IRC22:52
stevebakerEmilienM: ok \o22:52
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch scenario004 to run Tempest  https://review.openstack.org/49111322:57
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch scenario003 to run Tempest  https://review.openstack.org/49429022:57
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch scenario007 to run Tempest  https://review.openstack.org/49429322:57
*** dmarlin has quit IRC22:59
*** artom has joined #tripleo23:05
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Remove ipv6 specific network templates  https://review.openstack.org/49938523:06
*** mhenkel_ has joined #tripleo23:07
*** gbarros has quit IRC23:08
*** achadha has quit IRC23:10
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171400523:10
openstackLaunchpad bug 1714005 in tripleo "CI. periodic master job fails because "ERROR: Error in 77 output role_data: No function "#operator_+" matches supplied arguments"" [Critical,Triaged]23:10
*** ooolpbot has quit IRC23:10
*** achadha has joined #tripleo23:10
*** thrash is now known as thrash|g0ne23:11
*** mhenkel_ has quit IRC23:11
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: WIP: set nova my_ip and my_block_storage_ip options  https://review.openstack.org/49938723:14
openstackgerritOpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements  https://review.openstack.org/49276823:21
*** itlinux has joined #tripleo23:22
*** tosky has quit IRC23:23
openstackgerritSteve Baker proposed openstack/tripleo-common master: Add missing OVN container service entries  https://review.openstack.org/49938823:23
*** achadha has quit IRC23:28
*** bugzy_ has quit IRC23:28
*** stee_3_ has quit IRC23:28
*** jpena|away is now known as jpena|off23:29
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/48814823:33
*** achadha has joined #tripleo23:33
*** stee_3 has joined #tripleo23:36
*** bugzy has joined #tripleo23:36
*** achadha has quit IRC23:38
*** dsneddon has joined #tripleo23:41
dsneddonThis is the last patch needed to enable fully composable networks, and to start producing all network templates via jinja2. Reviews very much appreciated: https://review.openstack.org/#/c/49938523:42
*** rhallisey has quit IRC23:42
dsneddonEmilienM, FYI ^^^23:42
*** achadha has joined #tripleo23:43
*** achadha has quit IRC23:45
*** achadha has joined #tripleo23:45
*** achadha has quit IRC23:46
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Remove ipv6 specific network templates  https://review.openstack.org/49938523:46
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Add missing Docker service  https://review.openstack.org/49912423:46
*** achadha has joined #tripleo23:46
*** mhenkel_ has joined #tripleo23:47
*** dsneddon has quit IRC23:47
openstackgerritMerged openstack/instack-undercloud stable/ocata: Remove isolated-build element  https://review.openstack.org/49630023:47
*** achadha has quit IRC23:47
*** achadha has joined #tripleo23:48
*** achadha has quit IRC23:49
*** achadha has joined #tripleo23:50
*** tzumainn has quit IRC23:50
*** kbyrne has quit IRC23:51
*** achadha has quit IRC23:51
*** mhenkel_ has quit IRC23:51
*** achadha has joined #tripleo23:51
*** rlandy has quit IRC23:53
*** kbyrne has joined #tripleo23:54
*** achadha has quit IRC23:56
openstackgerritTong Liu proposed openstack/tripleo-heat-templates master: Add DhcpAgentNotification param to neutron base  https://review.openstack.org/49939523:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!