Thursday, 2018-02-22

*** dougbtv__ has joined #tripleo00:04
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: DNM: test P->M Upgrade in experimental.  https://review.openstack.org/54547700:06
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Revert part of the support to queens regarding to upgrade.  https://review.openstack.org/54681800:06
*** dougbtv_ has quit IRC00:07
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087400:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]00:10
*** ooolpbot has quit IRC00:10
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: Fix haproxy and keepalived env paths  https://review.openstack.org/54516000:11
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: Populate ContainerImagePrepare variable  https://review.openstack.org/54516100:11
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: Do container image prepare during undercloud deploy  https://review.openstack.org/54602400:11
*** dougbtv_ has joined #tripleo00:13
*** dougbtv__ has quit IRC00:15
*** mcornea has quit IRC00:16
*** mcornea has joined #tripleo00:17
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Restrict SNMP to internal network  https://review.openstack.org/54605800:20
*** tosky has quit IRC00:21
*** noslzzp has quit IRC00:24
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Store ansible playbooks output to log files for FFU  https://review.openstack.org/54460400:30
*** moshele has quit IRC00:32
*** dmellado has joined #tripleo00:33
*** mcornea has quit IRC00:35
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Provide a way to change docker registry path during mixed upgrade.  https://review.openstack.org/54047300:38
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing.  https://review.openstack.org/52568600:44
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: DNM: testing ffu.  https://review.openstack.org/54667000:44
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Do not use the 3rd argument of yaql groupBy  https://review.openstack.org/54611300:45
openstackgerritSteve Baker proposed openstack/tripleo-common master: Include a default for tag_from_label  https://review.openstack.org/54519600:46
*** d0ugal has quit IRC00:47
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: Set tripleo-upgrade vars in featureset.  https://review.openstack.org/53991000:50
*** d0ugal has joined #tripleo00:58
*** daidv has joined #tripleo00:58
*** stevebaker has joined #tripleo01:03
tbarronAnyone having problems getting ceph-daemon container from docker-io ? From /var/log/mistral/ceph-install-workflow.log:01:07
tbarronhttps://paste.fedoraproject.org/paste/OqO1ltyRBU3uVSn4xSLj7A01:07
*** moshele has joined #tripleo01:07
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087401:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]01:10
*** ooolpbot has quit IRC01:10
*** moshele has quit IRC01:10
*** psahoo has joined #tripleo01:10
*** dougbtv_ has quit IRC01:12
*** noslzzp has joined #tripleo01:15
*** dougbtv_ has joined #tripleo01:15
*** lblanchard has quit IRC01:25
*** dhill__ has quit IRC01:34
*** jlabarre has quit IRC01:47
*** ykarel|afk has joined #tripleo01:52
*** owalsh has quit IRC01:56
*** owalsh has joined #tripleo01:56
*** moshele has joined #tripleo02:00
*** owalsh has quit IRC02:01
*** gvrangan_ has joined #tripleo02:03
*** owalsh has joined #tripleo02:06
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087402:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]02:10
*** gvrangan_ has quit IRC02:14
*** gvrangan has joined #tripleo02:15
*** dhill__ has joined #tripleo02:16
*** itlinux has joined #tripleo02:18
*** gvrangan has quit IRC02:21
*** gvrangan has joined #tripleo02:28
*** moshele has quit IRC02:29
*** gvrangan has quit IRC02:30
*** gvrangan has joined #tripleo02:31
*** ykarel|afk has quit IRC02:31
*** gvrangan has quit IRC02:32
*** gvrangan has joined #tripleo02:33
*** yamahata has quit IRC02:34
*** gvrangan has quit IRC02:37
*** dhill__ has quit IRC02:40
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart-extras master: Add opendaylight to collect-logs  https://review.openstack.org/49404302:49
*** moshele has joined #tripleo02:50
*** moshele has quit IRC02:52
*** khyr0n has joined #tripleo02:55
*** wolverineav has quit IRC03:00
*** rlandy|rover|bbl is now known as rlandy|rover03:03
*** itlinux has quit IRC03:10
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087403:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]03:10
*** ooolpbot has quit IRC03:10
*** ramishra has joined #tripleo03:19
*** gvrangan has joined #tripleo03:19
*** gvrangan has quit IRC03:22
*** sai___ has quit IRC03:25
*** thrash is now known as thrash|g0ne03:28
*** gvrangan has joined #tripleo03:28
*** gvrangan has quit IRC03:32
*** fragatina has quit IRC03:32
*** wolverineav has joined #tripleo03:33
*** itlinux has joined #tripleo03:37
*** wolverineav has quit IRC03:37
*** wolverineav has joined #tripleo03:40
*** ramishra has quit IRC03:41
*** ramishra has joined #tripleo03:43
*** wolverineav has quit IRC03:44
*** khyr0n has quit IRC03:45
*** jaganathan has joined #tripleo03:48
*** rlandy|rover has quit IRC03:50
*** wolverineav has joined #tripleo03:51
*** gvrangan has joined #tripleo03:53
*** gvrangan has quit IRC03:54
*** gvrangan has joined #tripleo03:55
*** wolverineav has quit IRC03:57
*** gvrangan has quit IRC03:58
*** gvrangan has joined #tripleo03:59
*** rlandy has joined #tripleo03:59
*** rlandy is now known as rlandy|rover03:59
*** d0ugal has quit IRC04:00
*** gkadam has quit IRC04:01
*** rlandy|rover has quit IRC04:01
*** gkadam has joined #tripleo04:02
*** gvrangan has quit IRC04:02
*** udesale has joined #tripleo04:04
*** ykarel|afk has joined #tripleo04:04
*** udesale_ has joined #tripleo04:07
*** dmacpher_ has quit IRC04:14
*** anilvenkata has quit IRC04:14
*** dmacpher has joined #tripleo04:15
*** wolverineav has joined #tripleo04:17
*** wolverineav has quit IRC04:22
*** shreshtha has joined #tripleo04:27
*** d0ugal has joined #tripleo04:27
*** links has joined #tripleo04:30
*** udesale_ has quit IRC04:31
*** udesale_ has joined #tripleo04:31
*** udesale has quit IRC04:32
*** psachin has joined #tripleo04:35
*** gkadam has quit IRC04:41
*** gkadam has joined #tripleo04:51
*** pgadiya has joined #tripleo04:53
*** ykarel|afk is now known as ykarel04:54
*** fragatin_ has joined #tripleo04:56
*** pdeore has joined #tripleo05:03
*** masco has joined #tripleo05:04
*** skramaja has joined #tripleo05:06
*** gvrangan has joined #tripleo05:07
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087405:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]05:10
*** ratailor has joined #tripleo05:10
*** gvrangan has quit IRC05:12
*** wolverineav has joined #tripleo05:21
*** ihrachys_ has joined #tripleo05:25
*** ihrachys has quit IRC05:26
*** wolverineav has quit IRC05:27
*** janki has joined #tripleo05:27
*** jfrancoa has joined #tripleo05:30
*** akane has joined #tripleo05:31
*** oidgar has joined #tripleo05:32
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Configure qemu group setting as hugetlbfs for ovs-dpdk  https://review.openstack.org/53132205:34
Tenguhello there :)05:45
*** oidgar has quit IRC05:51
*** karthiks has quit IRC05:53
Tengumatbu: I'll switch my overcloud to containers now, doing a full upgrade. In the end, there's no need to upgrade the packages first, as they should be dropped at some point :).05:57
* Tengu takes a deep breath and run the upgrade commands05:58
*** akane has quit IRC05:59
*** karthiks has joined #tripleo06:04
*** mdnadeem has joined #tripleo06:08
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087406:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]06:10
*** ooolpbot has quit IRC06:10
*** tdasilva has quit IRC06:10
*** dpawar has joined #tripleo06:16
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/54687606:22
*** tdasilva has joined #tripleo06:25
*** mdnadeem_ has joined #tripleo06:31
*** dbecker has quit IRC06:31
*** hanish has quit IRC06:31
*** hanish has joined #tripleo06:32
*** mdnadeem has quit IRC06:33
*** karthiks has quit IRC06:42
*** dbecker has joined #tripleo06:44
*** jtomasek has joined #tripleo06:47
*** marios has joined #tripleo06:48
*** mdnadeem_ has quit IRC06:52
*** moshele has joined #tripleo06:56
*** jtomasek has joined #tripleo06:56
*** karthiks has joined #tripleo06:56
*** waleedm has joined #tripleo06:57
*** itlinux has quit IRC06:58
*** aufi has joined #tripleo06:58
openstackgerritwaleed mousa proposed openstack/os-net-config master: Adding the class and mac approach as dpdk-devargs in mellanox ConnectX-3  https://review.openstack.org/53915506:59
*** mdnadeem has joined #tripleo07:01
*** akane_ has joined #tripleo07:03
*** yprokule has joined #tripleo07:04
*** ledo_ has joined #tripleo07:04
*** waleedm has quit IRC07:06
*** ledo__ has joined #tripleo07:08
*** holser has joined #tripleo07:09
*** hanish has quit IRC07:09
*** juriarte has joined #tripleo07:10
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087407:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]07:10
*** ooolpbot has quit IRC07:10
*** ledo_ has quit IRC07:11
*** agopi has quit IRC07:11
*** dparkes has joined #tripleo07:12
*** juriarte has quit IRC07:15
*** rcernin has quit IRC07:20
*** karthiks has quit IRC07:22
*** ledo__ has quit IRC07:24
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing.  https://review.openstack.org/52568607:26
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: DNM: testing ffu.  https://review.openstack.org/54667007:26
*** waleedm has joined #tripleo07:30
*** juriarte has joined #tripleo07:30
*** holser has quit IRC07:31
*** etingof has joined #tripleo07:31
*** karthiks has joined #tripleo07:34
*** ykarel is now known as ykarel|lunch07:34
*** pcaruana has joined #tripleo07:37
*** fragatin_ has quit IRC07:46
openstackgerrityolanda.robla proposed openstack/tripleo-upgrade master: Ignore ffu patch errors  https://review.openstack.org/54665707:55
*** lvdombrkr has joined #tripleo07:59
*** lvdombrkr has quit IRC07:59
*** bogdando has joined #tripleo07:59
*** lvdombrkr has joined #tripleo07:59
*** ebarrera has joined #tripleo08:00
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: Use tripleo-upgrade role for p->q job.  https://review.openstack.org/54007208:01
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: DNM: testing p->m on experimental queue.  https://review.openstack.org/54576208:01
*** ebarrera has quit IRC08:03
openstackgerritNguyen Hung Phuong proposed openstack/puppet-pacemaker master: Do not use "-y" for package install  https://review.openstack.org/54690708:04
*** ebarrera has joined #tripleo08:04
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Add a ComputeInstanceHA role  https://review.openstack.org/54576108:04
openstackgerritDerek Higgins proposed openstack/tripleo-quickstart-extras master: Setup Ironic in Overcloud  https://review.openstack.org/50972808:08
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087408:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]08:10
openstackgerritNguyen Hung Phuong proposed openstack/puppet-pacemaker master: Add .tox/ to .gitignore  https://review.openstack.org/54690908:11
*** threestrands_ has joined #tripleo08:15
*** tesseract has joined #tripleo08:18
*** threestrands has quit IRC08:18
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/newton: WIP: FFU upgrade to Queens OVS during Newton minor update  https://review.openstack.org/54044308:20
*** ledo_ has joined #tripleo08:23
*** waleedm has quit IRC08:25
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Use net-config-simple-bridge.yaml from THT  https://review.openstack.org/54672508:27
*** ykarel|lunch is now known as ykarel08:28
*** yprokule_ has joined #tripleo08:28
*** yprokule has quit IRC08:31
*** yprokule_ is now known as yprokule08:31
*** ccamacho has joined #tripleo08:34
*** kopecmartin has joined #tripleo08:34
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/newton: WIP: FFU upgrade to Queens OVS during Newton minor update  https://review.openstack.org/54044308:35
*** gfidente has joined #tripleo08:36
*** florianf has joined #tripleo08:41
*** pblaho has joined #tripleo08:44
*** jpena|off is now known as jpena08:50
openstackgerritHarald Jensås proposed openstack/tripleo-docs master: Documentation - TripleO routed-spine-and-leaf  https://review.openstack.org/53993908:52
Tenguerff… apparently, it's not possible to upgrade Pike BM -> Pike Containers :'(.08:56
TenguI'm doomed.08:56
shardyTengu: that should be possible, but ocata BM->Pike containers is more well tested at this point, what is the error?08:57
shardyTengu: although note almost all "upgrade" testing is N -> N+1 not an N->N which is normally an update, and that does not support changing from BM to containers08:57
Tengushardy: digging in the stack. apparently, it's failing for the Compute: overcloud-Compute-yvulldhktxwg-2-fxrryhrke3yd08:57
Tengushardy: yup, I know - but… well. We deployed Pike as BM because it was still in RC, and we weren't that confident with containers :]08:58
Tenguand we thought we'd be able to switch to containers with the next release.08:58
Tengubut apparently, this won't be supported either08:58
shardyTengu: It is supported, it's just not the most well tested path at this point08:59
shardyso perhaps you found a bug08:59
Tengushardy: ah ? pike bm -> queens containers should work ? that's better then. The only "issue" now is the `openstack overcloud update' subcommand seems to be container-only :(09:00
Tenguhmmm. apparently, the issue is network related. A route is missing on one compute (not on the other one though…09:00
shardyTengu: yes I believe so, marios and chem can perhaps explain what's most tested, but since we've not formally deprecated BM support upstream you should be able to upgrade to containers for either pike or queens09:01
TenguI think... yes. I drop the lab once more, fully deploy it in the same state I have the production, and ensure all is OK with the network.09:01
Tengushardy: that was part of the discussion I was in last Friday.09:01
shardythe reality is some combinations are more well tested than other though, due to the smaller number of downstream combinations that are supported09:01
Tenguapparently, the idea was more to migrate pike->pike… but it's hard :)09:01
*** jpich has joined #tripleo09:02
shardymarios, chem: perhaps you'd like to weigh in on this https://review.openstack.org/#/c/546192 series where I'm trying to deprecate baremetal support, partly for the reasons Tengu outlines above ^^09:02
shardydprince is against it, so we need to reach consensus to make progress09:02
Tengu:]09:02
chemshardy: hi, looking09:03
mariosshardy: Tengu well, i'm getting mixed signals about that to be honest. I was going on 'we should support P..Q for baremetal to containers' and we did it for the pacemaker tasks e.g. at https://github.com/openstack/tripleo-heat-templates/blob/c96b58c02847d7ed54652285095840f6e54aef86/docker/services/pacemaker/haproxy.yaml#L261-L26609:03
mariosshardy: Tengu but, since then I am told we will likely dedicate all qe/testing efforts to containerized Pike going to containerized Queens09:03
shardymarios: yes I think we should support P..Q Baremetal to containers and containers to containers09:03
*** oidgar has joined #tripleo09:04
Tengumarios: that was what I understood last Friday, yes09:04
shardysince an "upgrade" is generally defined as N -> N+1 and we didn't deprecate BM support yet09:04
shardymarios: we have to split the discussion about what is tested downstream and what is in theory supported upstream09:04
* Tengu feels he will be slapped next week at Dublin with "why didn't you deploy pike on containers?" :D09:05
mariosshardy: Tengu so in terms of most tested i think most/all of us have container envs (p) at this point, if that is the question /me reads back09:05
shardymarios: we know there will be more effort going into certain upgrade paths, but we should make a best effort on the others, even if it's only to make the upgrade path for Tengu possible ;)09:05
mariosTengu: hehe no slapping :D ! but it might be we need some extra tasks to make it work that way09:05
shardymarios: Tengu has a BM pike environment, and he needs to upgrade to Queens as I understand it09:05
*** moshele has quit IRC09:05
Tengumarios: I'm more than ready to test anything in order to get my baremetal P on either container P or container Q :).09:05
mariosshardy: ack (yeah i mean where possible... as i said we could do it reasonably easily for the pcmk tasks, we can try and continue with that consideration for any others we land)09:06
Tengushardy: right09:06
Tengumarios: fact is, I have a lab at hand with HA controllers, 2 compute and ceph-storage - I can test migration for those 3 components at least.09:06
*** athomas has joined #tripleo09:06
Tengumarios: so if you think we can run those out of the CI first in order to validate patches and nor overload the CI with fail'n'tries, that's fine for me.09:07
Tengu*not overload09:07
Tengubut right now, I'll re-deploy the lab, there's an issue with the network.09:08
*** cylopez has joined #tripleo09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087409:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]09:10
mariosTengu: if you wanted to start trying the upgrade there are some notes here https://review.openstack.org/#/c/535859/5/doc/source/install/post_deployment/upgrade.rst which we're keeping farely upto date... the cli is still in flux for the upgrade part though (I will update that bit today, we are curently testing with09:10
marioshttps://review.openstack.org/#/q/status:open+project:openstack/python-tripleoclient+branch:master+topic:major-upgrade and then jistr patches with topmost (of 6) at https://review.openstack.org/#/c/546242/ ... fwiw (they will end up in those docs by today fyi)09:10
Tengumarios: basically those notes are for upgrading to Q right? what's its status? RC1 I think? any ETA for "release" ?09:12
TenguI'd rather avoid doing the same mistake I made with Pike, taking it a bit too early09:12
mariosTengu: no, the upgrades/updates always trail the release (at least for as long as i can remember).. so we will end up landing the final bits into the stable/queens branch of the given repos09:12
mariosTengu: though we should be mostly there by next week ;)09:13
mariosTengu: not ffu afaics but that is also moving -> that way as fast as possible09:13
Tengumarios: hmm ok. so I'll wait for the week after PTG to put that on tracks.09:13
*** amoralej|off is now known as amoralej09:13
*** daidv has quit IRC09:14
*** daidv has joined #tripleo09:14
Tenguthat said… I should prepare the queens repositories in satellite.09:16
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing.  https://review.openstack.org/52568609:16
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: DNM: testing ffu.  https://review.openstack.org/54667009:16
Tenguand allow to provide a new activation key so that the only command to do on the nodes to upgrade will be a subscription-manager register --force with the new key, and that should push the queens repositories :).09:16
mariosTengu: ack, yeah and you might consider setting up a quickstart/vm env for testing and/or trying the workflow09:16
*** dtantsur|afk is now known as dtantsur09:17
Tengumarios: the lab has a BM undercloud mounted with ocata and updated to pike (don't ask -.-').09:17
Tengumarios: it's the very same setup we have on the production09:17
Tenguthat way, we're able to validate each steps, and avoid bad surprises :).09:17
*** hamzy_ has quit IRC09:20
*** hamzy_ has joined #tripleo09:20
*** agurenko has joined #tripleo09:22
*** suuuper has joined #tripleo09:23
*** holser has joined #tripleo09:24
*** juriarte has quit IRC09:27
*** karthiks has quit IRC09:27
*** yprokule_ has joined #tripleo09:30
*** ukalifon has joined #tripleo09:33
*** yprokule has quit IRC09:33
*** yprokule_ is now known as yprokule09:33
openstackgerritSergii Golovatiuk proposed openstack-infra/tripleo-ci master: Write only defined variables  https://review.openstack.org/54406809:34
*** moshele has joined #tripleo09:35
openstackgerritSergii Golovatiuk proposed openstack/tripleo-quickstart-extras master: Update kernel for image  https://review.openstack.org/54662309:37
EmilienMslagle: I agree with you but for now it doesn't work, using fs010 would be a first step in gating09:37
EmilienMgood morning from Europe!09:37
openstackgerritHarald Jensås proposed openstack/tripleo-common master: Install python2-networking-baremetal in neutron-server  https://review.openstack.org/54545209:37
*** threestrands_ has quit IRC09:37
holserGood morning @EmilienM09:38
*** jaosorior has joined #tripleo09:39
openstackgerritMerged openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/54687609:41
*** stendulker has joined #tripleo09:42
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: roles: rename overcloud-prep-containers to prep-containers  https://review.openstack.org/54301409:42
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Add support for libvirt VNC TLS  https://review.openstack.org/53646909:42
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: prep-containers: include containerized undercloud bits  https://review.openstack.org/54302409:42
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: undercloud: add missing TLS environments when preparing containers  https://review.openstack.org/54544409:43
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Remove adjust-interface-mtus script  https://review.openstack.org/54621609:43
*** gkadam_ has joined #tripleo09:43
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: DO NOT REVIEW - Workarounds for containerized undercloud  https://review.openstack.org/54562809:43
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: DO NOT REVIEW - workaround for keepalived  https://review.openstack.org/54601409:44
*** gkadam has quit IRC09:44
*** gkadam_ has quit IRC09:44
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Pass stack's name to overcloud update commands.  https://review.openstack.org/54692709:44
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Run ovb-ha (fs001) with a containerized undercloud  https://review.openstack.org/54255609:44
*** gkadam_ has joined #tripleo09:44
*** juriarte has joined #tripleo09:45
EmilienMbogdando: thx for the fixup on the .yaml typo09:45
dtantsurmorning EmilienM! are you already in Dublin?09:45
*** moshele has quit IRC09:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Import net-config-simple-bridge.yaml from tropleo-ci repo  https://review.openstack.org/54672309:45
*** moshele has joined #tripleo09:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Import net-config-simple-bridge.yaml from tropleo-ci repo  https://review.openstack.org/54672309:45
EmilienMdtantsur: almost. In Paris now09:46
*** karthiks has joined #tripleo09:46
*** stendulker has quit IRC09:46
dtantsursweet :) I miss Paris a bit09:46
*** stendulker has joined #tripleo09:46
EmilienMdtantsur: not me :D09:47
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Use net-config-simple-bridge.yaml from THT  https://review.openstack.org/54672509:47
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Run ovb-ha (fs001) with a containerized undercloud  https://review.openstack.org/54255609:47
dtantsurEmilienM: hah, you spent much more time there than me, that might be the reason ;)09:48
openstackgerritMerged openstack/tripleo-heat-templates master: Improve the minor update of the docker service  https://review.openstack.org/54182709:48
EmilienMdtantsur: I'm a small town guy :D09:48
dtantsurI see. Not my case - this is one of the reasons I left Brno09:49
EmilienMjaosorior: can you please review https://review.openstack.org/#/c/541849/ ?09:49
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: DNM - Deploy container-multinode (fs010) with a containerized undercloud  https://review.openstack.org/54290609:50
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: DNM - Deploy container-multinode (fs010) with a containerized undercloud  https://review.openstack.org/54290609:50
jaosoriorEmilienM: ack09:51
EmilienMdtantsur: thanks for all the help on containerized undercloud09:51
EmilienMit's super useful, really09:51
dtantsurEmilienM: no problem, lemme know how else I can help (given my limited knowledge of Kolla)09:51
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: [FFU] Hook to allow user to pass a custom script for repo switching.  https://review.openstack.org/53950309:52
*** ratailor_ has joined #tripleo09:52
*** anilvenkata has joined #tripleo09:53
*** ratailor has quit IRC09:55
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Overcloud update CI with tripleo-upgrade role  https://review.openstack.org/54220109:55
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Make debug option working for UC heat installer  https://review.openstack.org/54692910:02
*** jpich_ has joined #tripleo10:03
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Add flavor fetching via Nova API  https://review.openstack.org/54290810:04
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Retrieve os-extra_specs for Nova flavors  https://review.openstack.org/54359010:04
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Use Nova profiles in node tagging form  https://review.openstack.org/54509810:04
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Properly calculate taggedCounts in nodesAssignment  https://review.openstack.org/54658610:04
jtomasekflorianf: hi, could you please check https://review.openstack.org/#/c/544001/ it is just a cleanup following already merged https://review.openstack.org/#/c/544000/10:06
jtomasekhonza: ^10:06
*** psahoo has quit IRC10:06
dtantsurjtomasek, honza, I feel a bit uneasy on some changes there ^^^10:07
*** jpich has quit IRC10:07
dtantsuryou're hardcoding some nova-related logic that may change with time.. why not do it in tripleo-common?10:07
*** salmankhan has joined #tripleo10:07
dtantsurI'm pretty sure I'll miss tripleo-ui if I ever have to update it (e.g. on switch from capabilities to traits planned for R or S)10:07
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart-extras master: Include flavor option in reproducer-quickstart.sh.  https://review.openstack.org/54693210:08
jtomasekdtantsur: regarding listing flavor profiles in GUI?10:08
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Fix invalid Ceph and BlockStorage role template  https://review.openstack.org/54664210:08
jtomasekdtantsur: so you suggest creating tripleo-common action to retrieve flavor profiles?10:09
dtantsurjtomasek: yep10:09
dtantsuroverall, I'd prefer we have as little logic in UI/CLI as possible10:09
dtantsurupdating it is much harder otherwise10:09
*** links has quit IRC10:09
*** moguimar has joined #tripleo10:09
*** juriarte has quit IRC10:09
dtantsurand I cannot even meaningfully review ironic and nova related things in the UI, since I have problems with the syntax10:09
*** links has joined #tripleo10:10
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087410:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]10:10
*** ooolpbot has quit IRC10:10
jtomasekdtantsur: I understand, but this is just a simple read of flavors. I am aware that we'll need to change the property when the profile is saved elsewhere. Problem is that there is no such capability in tripleo-common currently and this is fixing a bug for queens10:11
dtantsurah, okay10:11
dtantsurO dpm10:11
dtantsurdamn10:11
dtantsurI don't insist on immediate actions, mostly raising an awareness :)10:11
jtomasekdtantsur: there are several pieces of information we're gathering in GUI (node profiles, flavor profiles...) It would be much better if we could introduce logic for tripleo-common which would shield using flavors from the user altogether and just provide means to assign nodes to roles10:12
jtomasekdtantsur: thanks for keeping an eye!10:12
dtantsur++10:12
jtomasekdtantsur: that approach is quite problematic currently due to default flavor parameter vaule (batemetal), non working conventions in role/flavor/profiles naming10:13
jtomasek+ custom roles behavior10:13
openstackgerritwaleed mousa proposed openstack/os-net-config master: Adding the class and mac approach as dpdk-devargs in mellanox ConnectX-3  https://review.openstack.org/53915510:14
openstackgerritwaleed mousa proposed openstack/os-net-config master: Adding the class and mac approach as dpdk-devargs in mellanox ConnectX-3  https://review.openstack.org/53915510:14
*** jpich_ is now known as jpich10:15
jtomasekif there was convention that with custom role, the relevant flavor is also created and assigned in roles_data.yaml, which has name and profile set to string which can be easily derived from role name, then we could make it much smoother10:15
jtomasekdtantsur: ^10:15
dtantsurjtomasek: I'm not sure such convention exists, to be honest10:15
jtomasekdtantsur: exceptions everywhere hehe10:16
*** hanish has joined #tripleo10:17
jtomasekdtantsur: I can try to put together an email with list of steps to achieve simple node -> roles assignment10:17
dtantsurjtomasek: good idea10:17
TenguEmilienM: do you ever slepp? :)10:18
*** juriarte has joined #tripleo10:18
Tengu*sleep10:18
Tengu-.-' I should maybe sleep a bit more…10:18
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates stable/ocata: Add NodeTLSData to generic role.role.j2.yaml  https://review.openstack.org/54693510:20
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP Fail more gracefully when passed an empty ip  https://review.openstack.org/54678010:21
*** tosky has joined #tripleo10:22
florianfjtomasek: yep10:25
*** SlickNik has quit IRC10:28
*** salmankhan has quit IRC10:28
openstackgerritMerged openstack/ansible-role-redhat-subscription master: Update README, variables, and rhsm.conf.j2  https://review.openstack.org/54631610:29
*** yamahata has joined #tripleo10:32
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Run multinode with config-debug.  https://review.openstack.org/53633110:33
*** zoli is now known as zoli|lunch10:33
*** zoli|lunch is now known as zoli10:33
*** dciabrin_ has quit IRC10:33
*** dciabrin_ has joined #tripleo10:34
hanish@shardy can you please review and start workflow vote for  https://review.openstack.org/#/c/545837/10:35
*** ledo_ has quit IRC10:37
*** SlickNik has joined #tripleo10:37
*** salmankhan has joined #tripleo10:40
*** shreshtha has quit IRC10:42
*** panda|off is now known as panda|sick10:44
*** trozet_ has joined #tripleo10:49
*** trozet has quit IRC10:49
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Update quickstart base centos image.  https://review.openstack.org/51939110:50
jaosoriorEmilienM: there were some bugfixes done for tripleo-ipsec, mind if I update the hash in the relases repo? or should it be 8.0.2 ?10:51
*** gkadam__ has joined #tripleo10:54
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Use md5sum -b on images  https://review.openstack.org/42788310:55
*** tcw1 has joined #tripleo10:55
*** mhenkel_ has quit IRC10:55
*** noslzzp_ has joined #tripleo10:56
*** leseb_ has joined #tripleo10:56
*** gkadam_ has quit IRC10:57
*** panda has joined #tripleo10:57
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Revert "fs030: disable tempest"  https://review.openstack.org/53089010:57
*** ubijtsa has joined #tripleo10:58
*** paramite has joined #tripleo10:59
*** tcw has quit IRC10:59
*** leseb has quit IRC10:59
*** assassin has quit IRC10:59
*** ericyoung has quit IRC10:59
*** panda|sick has quit IRC10:59
*** EmilienM has quit IRC10:59
*** links has quit IRC10:59
*** noslzzp has quit IRC10:59
*** mcarden has quit IRC10:59
*** links has joined #tripleo10:59
*** ericyoung has joined #tripleo10:59
*** mcarden has joined #tripleo11:00
*** yamahata has quit IRC11:00
*** EmilienM has joined #tripleo11:00
*** ChanServ sets mode: +v EmilienM11:00
*** juriarte has quit IRC11:01
jaosoriorEmilienM: there were some bugfixes done for tripleo-ipsec, mind if I update the hash in the relases repo? or should it be 8.0.2 ?11:01
*** kambiz has quit IRC11:01
*** PagliaccisCloud has quit IRC11:02
*** mhenkel has joined #tripleo11:02
*** juriarte has joined #tripleo11:03
*** kambiz has joined #tripleo11:04
*** PagliaccisCloud has joined #tripleo11:04
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287511:04
paramitegreetings guys, can somebody please check the patches, which are adding healthcheck scripts? Those are harmless patches doing nothing yet. Scripts will be used when they will be linked, which will be a followup patch: https://review.openstack.org/#/q/project:openstack/tripleo-common+status:open+owner:%22Martin+M%25C3%25A1gr+%253Cmmagr%2540redhat.com%253E%2211:06
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Add output dir and cleanup vars for UC use_heat  https://review.openstack.org/54694811:06
*** pcaruana has quit IRC11:07
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Add feature set to test public bond network isolation  https://review.openstack.org/54015211:07
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087411:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]11:10
*** ratailor_ has quit IRC11:12
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/newton: WIP: FFU upgrade to Queens OVS during Newton minor update  https://review.openstack.org/54044311:13
*** ratailor has joined #tripleo11:13
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates stable/ocata: Add NodeTLSData to generic role.role.j2.yaml  https://review.openstack.org/54693511:14
openstackgerritMerged openstack/tripleo-heat-templates master: Add cisco VTS ML2 template for a dockerized service and default environment settings  https://review.openstack.org/53335111:17
*** panda is now known as panda|sick11:17
*** stendulker has quit IRC11:17
*** noslzzp has joined #tripleo11:21
*** akrivoka has joined #tripleo11:23
*** tbarron_ has joined #tripleo11:23
*** noslzzp_ has quit IRC11:24
*** tbarron has quit IRC11:24
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287511:25
*** jfrancoa1 has joined #tripleo11:28
*** ipsecguy has joined #tripleo11:30
*** cschwede_ has joined #tripleo11:31
*** noslzzp has quit IRC11:34
*** ipsecguy_ has quit IRC11:34
*** cschwede has quit IRC11:34
*** jfrancoa has quit IRC11:34
*** rwsu has quit IRC11:34
hanish@skramaja: can you please review https://review.openstack.org/#/c/545837/ https://review.openstack.org/#/c/54612511:34
*** rwsu has joined #tripleo11:34
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Clarify minor update CLI and split minor and major classes  https://review.openstack.org/54502611:35
*** noslzzp has joined #tripleo11:35
skramajahanish: i did already. i can only +1 in tripleo-common and tht is waiting on ci. can you ensure both of them have +1 from CI?11:35
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287511:37
hanish@skramaja: both of them have +1 from CI,  i could not get RDO to run.11:38
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing.  https://review.openstack.org/52568611:41
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: DNM: testing ffu.  https://review.openstack.org/54667011:41
*** shardy has quit IRC11:42
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Clarify minor update CLI and split minor and major classes  https://review.openstack.org/54502611:44
*** jaosorior has quit IRC11:45
*** jaosorior has joined #tripleo11:45
*** noslzzp has quit IRC11:46
*** noslzzp has joined #tripleo11:47
*** udesale_ has quit IRC11:50
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Clarify minor update CLI and split minor and major classes  https://review.openstack.org/54502611:50
openstackgerritMerged openstack/tripleo-heat-templates master: Add OVN Hardware Offloading environment files  https://review.openstack.org/54063411:50
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Do not use the 3rd argument of yaql groupBy  https://review.openstack.org/54611811:50
*** holser has quit IRC11:51
skramajahanish: RDO also should pass..11:51
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/newton: WIP: FFU upgrade to Queens OVS during Newton minor update  https://review.openstack.org/54044311:53
*** akane_ has quit IRC11:54
hanish@skramaja: how can i get rdo get started11:54
skramajarecheck should re-trigger it11:55
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: Return old ranges to network_data.yaml  https://review.openstack.org/54666511:55
*** jpena is now known as jpena|lunch11:57
*** anilvenkata has quit IRC11:57
*** noslzzp has quit IRC11:58
*** jschlueter is now known as jschlueter|afk11:59
*** BryanS68 has joined #tripleo12:02
*** jaganathan has quit IRC12:07
*** pcaruana has joined #tripleo12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087412:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]12:10
*** ooolpbot has quit IRC12:10
*** raildo has joined #tripleo12:10
*** thrash|g0ne is now known as thrash12:10
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Minor update steps for ODL  https://review.openstack.org/53690712:12
*** dciabrin_ has quit IRC12:13
*** pchavva has joined #tripleo12:14
openstackgerritMerged openstack/puppet-tripleo master: Remove neutron-managed firewall rules from /etc/sysconfig/iptables  https://review.openstack.org/54184912:14
openstackgerritMerged openstack/tripleo-quickstart master: Correct link address in doc  https://review.openstack.org/53518712:15
*** athomas has quit IRC12:16
*** athomas has joined #tripleo12:19
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: DNM Testing O->P with tripleo-upgarde  https://review.openstack.org/54390712:20
*** pkovar has joined #tripleo12:21
*** ratailor has quit IRC12:27
*** janki has quit IRC12:27
*** skramaja has quit IRC12:28
jaosoriormwhahaha: around?12:28
*** links has quit IRC12:29
*** dciabrin has joined #tripleo12:29
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: WIP: Migrate Ceph deployment to external_deploy_task  https://review.openstack.org/54696612:31
gfidenteslagle ^^ we're not even close but I thought it could be useful to have before the call12:31
slagleyou just earned yourself a beer!12:32
gfidenteslagle I think the inventory part is right though12:33
*** abishop has joined #tripleo12:34
gfidenteslagle I think I have to move all configs from the various Ceph* services into ceph-base12:38
*** pkovar has quit IRC12:38
gfidenteand then add the infamous command which runs ansible-playbook12:38
gfidenteit's not so far from reality in the end12:38
gfidente(well and remove the call to workflow_task obviously)12:38
fultonjgfidente++ cool, i'll this ths out12:39
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/newton: WIP: FFU upgrade to Queens OVS during Newton minor update  https://review.openstack.org/54044312:39
openstackgerritHonza Pokorny proposed openstack/tripleo-specs master: Add ui automation spec  https://review.openstack.org/54681712:39
gfidentefultonj morning there12:40
*** links has joined #tripleo12:41
fultonjgood afternoon there ;)12:41
gfidentefultonj the NodeDataLookup gets even more complicated ;(12:41
fultonji can only imagine12:41
gfidentebut I wonder if we can't make that into a generic mechanism12:41
gfidenteprobably good topic after the call12:42
fultonji'll have to see what inventory i get first from your patch to have a better idea12:44
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add version and git sha to debug modal  https://review.openstack.org/51983512:50
*** zul has quit IRC12:51
*** cylopez has quit IRC12:51
*** tbarron_ is now known as tbarron12:52
*** hrybacki has quit IRC12:53
*** hrybacki has joined #tripleo12:55
*** zul has joined #tripleo12:55
*** rbowen has joined #tripleo12:59
*** mcornea has joined #tripleo13:00
*** jlabarre has joined #tripleo13:01
*** morazi has joined #tripleo13:01
*** pdeore has quit IRC13:03
Tenguhello guys! small quesiton: what happens if, for some reasons, the undercloud is dead, and there are no backup? (not my current situation, just wondering)13:03
*** cylopez has joined #tripleo13:03
*** aputtur_ has joined #tripleo13:05
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Properly calculate taggedCounts in nodesAssignment  https://review.openstack.org/54658613:08
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart master: Set tripleo-upgrade vars in featureset.  https://review.openstack.org/53991013:08
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087413:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]13:10
*** jcoufal has joined #tripleo13:12
*** amoralej is now known as amoralej|lunch13:13
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Adds Overcloud Upgrade class and entry points for major upgrade  https://review.openstack.org/54536513:15
*** dprince has joined #tripleo13:16
*** hamzy_ is now known as hamzy13:16
*** morazi has quit IRC13:17
*** morazi has joined #tripleo13:17
*** pdeore has joined #tripleo13:19
*** karthiks has quit IRC13:20
*** jpena|lunch is now known as jpena13:27
*** tzumainn has quit IRC13:27
*** tzumainn has joined #tripleo13:28
*** liverpooler has joined #tripleo13:31
openstackgerritMerged openstack/tripleo-quickstart master: Set -q option to ssh in ProxyCommand  https://review.openstack.org/45225813:31
*** udesale has joined #tripleo13:32
*** ykarel is now known as ykarel|away13:35
*** rlandy has joined #tripleo13:36
*** rlandy is now known as rlandy|ruck13:36
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras master: Add Null Reproduced generator  https://review.openstack.org/54587513:36
*** karthiks has joined #tripleo13:37
*** sshnaidm|afk is now known as sshnaidm13:37
*** fragatina has joined #tripleo13:41
*** karthiks has quit IRC13:43
mwhahahajaosorior: sup?13:45
*** pkovar has joined #tripleo13:46
jaosoriormwhahaha: hey, I did some bugfixes in tripleo-ipsec, so a new release would be nice to have, I proposed one here https://review.openstack.org/#/c/546976/ is that ok? or should it be still 8.0.1 ?13:46
*** shardy has joined #tripleo13:48
mariosmatbu: jistr wdyt https://review.openstack.org/#/c/545026/8/tripleoclient/v1/overcloud_update.py@113 (answer on review if you like thanks :) )13:49
jistrack13:49
*** pgadiya has quit IRC13:49
*** zshi has quit IRC13:49
*** zshi has joined #tripleo13:50
jistrmarios: answered (didn't do a full review of the rest yet)13:50
mariosjistr: ack thanks.. yeah so i'll add as special value. agree on not making it default. but we could make --nodes _required_ like a positional argument. though as i just noted there apparently its bad form ... )13:52
mariosjistr: so if it is required they then _have_ to do --nodes all13:52
mariosjistr: vs the --playbooks where we assume 'all'13:52
mariossee what i mean?13:52
weshayrlandy|ruck, arxcruz|ruck https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset001.yml#L9213:53
jistrmarios: yea i would make it required13:53
jistrmarios: if 'all' isn't the default, then there's no other sensible default anyway, so it kinda has to be required :)13:53
*** arxcruz|ruck is now known as arxcruz|rover13:53
mariosjistr: agree13:53
mariosthanks13:53
*** mwhahaha has quit IRC13:54
weshaymwhahaha, probably need your eyes later today on config download error ssh'ing to from the undercloud to the overcloud13:54
*** oidgar has quit IRC13:55
*** mwhahaha has joined #tripleo13:56
*** ChanServ sets mode: +v mwhahaha13:56
*** BryanS68_ has joined #tripleo13:57
*** amoralej|lunch is now known as amoralej13:58
openstackgerritMerged openstack/tripleo-common master: Add healthchecks for barbican containers  https://review.openstack.org/54523813:58
mwhahahajaosorior: yea that's fine13:59
jaosoriormwhahaha: thanks13:59
*** BryanS68 has quit IRC13:59
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add version and git sha to debug modal  https://review.openstack.org/51983513:59
openstackgerritMerged openstack/tripleo-common master: Add healthcheck script for Tacker  https://review.openstack.org/53636013:59
openstackgerritMerged openstack/tripleo-common master: Add healthcheck script for Collectd  https://review.openstack.org/53827413:59
*** holser has joined #tripleo14:00
*** lblanchard has joined #tripleo14:02
slagledeep dive starting now on config-download / ansible14:03
slaglehttps://bluejeans.com/7754237859/14:03
jristwoo!14:05
*** ihrachys_ has quit IRC14:05
*** ihrachys has joined #tripleo14:06
*** Goneri has joined #tripleo14:06
ihrachys#startmeeting neutron_upgrades14:06
openstackMeeting started Thu Feb 22 14:06:33 2018 UTC and is due to finish in 60 minutes.  The chair is ihrachys. Information about MeetBot at http://wiki.debian.org/MeetBot.14:06
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:06
*** openstack changes topic to " (Meeting topic: neutron_upgrades)"14:06
openstackThe meeting name has been set to 'neutron_upgrades'14:06
ihrachyseh sorry for being late14:06
ihrachysare people still up to a meeting?14:07
*** jmelvin has joined #tripleo14:07
ihrachysdoesn't seem like it14:09
weshayrlandy|ruck, please re-review https://review.openstack.org/#/c/545104/14:09
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add version and git sha to debug modal  https://review.openstack.org/51983514:09
weshayrlandy|ruck, happy to answer questions14:09
ihrachys#endmeeting14:09
*** openstack changes topic to "Queens RC1 deadline: March 1st - CI status: check/gate GREEN - https://bugs.launchpad.net/tripleo/+bug/1750004 | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/"14:09
openstackMeeting ended Thu Feb 22 14:09:40 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:09
openstackMinutes:        http://eavesdrop.openstack.org/meetings/neutron_upgrades/2018/neutron_upgrades.2018-02-22-14.06.html14:09
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/neutron_upgrades/2018/neutron_upgrades.2018-02-22-14.06.txt14:09
openstackLog:            http://eavesdrop.openstack.org/meetings/neutron_upgrades/2018/neutron_upgrades.2018-02-22-14.06.log.html14:09
ihrachyseh sorry guys, my irc client messes with me14:09
jristrlandy|ruck: +1, we really need it!14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087414:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]14:10
*** ooolpbot has quit IRC14:10
rlandy|ruckweshay: jrist: my only concern is the dependence on default tags. I will remove my -1 from that particular change14:10
jristthat particular default tag is needed for UI to work14:11
*** oidgar has joined #tripleo14:11
rlandy|ruckweshay: jrist: ok - I +2'ed - you need one more core14:11
jristthanks rlandy|ruck !14:12
mwhahahais rdo cloud happy today14:13
rlandy|ruckso far14:14
jristwho took that over? ci team?14:14
*** derekh has joined #tripleo14:15
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo stable/ocata: WIP Give horizon's stanza in haproxy a per-server cookie  https://review.openstack.org/54699514:15
weshaysshnaidm, adarazs https://review.openstack.org/#/c/545104/14:16
*** toure|gone is now known as toure14:16
openstackgerritAlex Schultz proposed openstack/puppet-tripleo stable/pike: Remove neutron-managed firewall rules from /etc/sysconfig/iptables  https://review.openstack.org/54699714:17
openstackgerritAlex Schultz proposed openstack/puppet-tripleo stable/ocata: Remove neutron-managed firewall rules from /etc/sysconfig/iptables  https://review.openstack.org/54699814:18
*** trozet_ is now known as trozet14:19
*** lblanchard has quit IRC14:22
*** myoung|afk is now known as myoung14:23
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287514:24
openstackgerritMerged openstack/tripleo-common master: Add healthcheck script for Aodh API  https://review.openstack.org/54284914:24
openstackgerritMerged openstack/tripleo-common master: Add healthcheck script for multipathd  https://review.openstack.org/53918514:24
openstackgerritMerged openstack/tripleo-heat-templates master: Enable multipathd health check  https://review.openstack.org/53918814:24
openstackgerritMerged openstack/tripleo-common master: Add healthcheck script for gnocchi-metricd  https://review.openstack.org/53822814:24
openstackgerritMerged openstack/tripleo-common master: Add healthcheck script for gnocchi-statsd  https://review.openstack.org/53825314:24
openstackgerritMerged openstack/tripleo-common master: Add healthcheck script for Cinder API  https://review.openstack.org/54289514:24
*** kopecmartin has quit IRC14:26
openstackgerritMerged openstack/tripleo-common master: Add healthcheck script for Gnocchi API  https://review.openstack.org/53824614:26
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287514:26
*** agopi has joined #tripleo14:27
rlandy|ruckbandini: hi ... https://bugs.launchpad.net/tripleo/+bug/1750880 just reproduced on fs035 in the latest queens promotion run.14:27
openstackLaunchpad bug 1750880 in tripleo "[queens promotion] fs035 is failing to deploy the overcloud - pacemaker is not starting" [Critical,Triaged]14:27
rlandy|ruckwe can run https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens/d3c4623/reproducer-quickstart.sh to recreate it on a personal tenant14:28
socialdsneddon_pto: just headsup when you are back https://review.openstack.org/#/c/546665/14:29
*** dhill__ has joined #tripleo14:29
*** pblaho has quit IRC14:30
bandinirlandy|ruck: hi. let me try that14:30
*** kopecmartin has joined #tripleo14:31
*** jschlueter|afk is now known as jschlueter14:33
weshayapetrich, howdy14:33
rlandy|ruckbandini:sure - pls see options listed at the top of the file14:34
*** ykarel|away has quit IRC14:35
*** nyechiel has joined #tripleo14:35
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287514:36
apetrichweshay, sorry. very under the weather. I've called in sick14:37
*** dtantsur is now known as dtantsur|brb14:38
*** agurenko has quit IRC14:38
*** noslzzp has joined #tripleo14:38
weshayapetrich, aye.. feel better14:38
*** nyechiel_ has quit IRC14:39
apetrichweshay, cheers. I kind of need to. tomorrow I drive to dublin :)14:39
*** shreshtha has joined #tripleo14:40
*** shreshtha has quit IRC14:40
*** shreshtha has joined #tripleo14:41
*** masco has quit IRC14:41
bandinirlandy|ruck: ok, it's running. let's cross fingers14:42
*** leanderthal has joined #tripleo14:42
rlandy|ruckbandini: k - great ... let me know14:43
bandiniaye14:43
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Clarify minor update CLI and split minor and major classes  https://review.openstack.org/54502614:44
jristthanks adarazs14:46
*** psachin has quit IRC14:49
*** kopecmartin has quit IRC14:49
bandinirlandy|ruck: I got this stack failure http://paste.openstack.org/show/682031/. Do I just retry or anything else comes to mind?14:51
sshnaidmweshay, adarazs I'd like to see libvirt gates pass on that: https://review.openstack.org/#/c/545104/14:52
adarazssshnaidm: me too.14:52
rlandy|ruckbandini: hmmm .. do you have other stacks deployed on your tenant atm? I will try reproduce on my tenant14:52
adarazssshnaidm: that's why I did a recheck14:52
sshnaidmadarazs, cool14:52
bandinirlandy|ruck: I had one (but no vms). let me delete all of them and retry14:53
*** gkadam__ has quit IRC14:53
weshaysshnaidm, adarazs agree.. they look good https://ci.centos.org/view/rdo/view/tripleo-gate/job/tripleo-quickstart-gate-master-delorean-quick-basic/4877/14:53
rlandy|ruckbandini: also ... you will likely need this review https://review.openstack.org/#/c/546072/ - it hasn't merged yet14:54
rlandy|ruckbandini: I'll try the reproducer on my tenant and give you access to the instances14:54
honzajtomasek: anything sizeable you want me to accomplish while you're at the ptg?14:54
bandinirlandy|ruck: that'd be grand, thanks!14:54
weshaysshnaidm, https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-gate-master-delorean-quick-basic-4877/console.txt.gz14:55
openstackgerritMerged openstack/tripleo-heat-templates master: Remove tags from upgrade tasks for ptp.yaml.  https://review.openstack.org/54618714:55
* jtomasek thinks14:55
weshaymwhahaha, can I reserve a few minutes of your time later today, re: fs001 / config download and the issue w/ ssh'ing from the undercloud to the overcloud nodes?14:56
*** anilvenkata has joined #tripleo14:56
*** rbrady has quit IRC14:56
mwhahahaweshay: sure14:57
paramitegreetings guys, can somebody please check the patches, which are adding healthcheck scripts? Those are harmless patches doing nothing yet. Scripts will be used when they will be linked, which will be a followup patch: https://review.openstack.org/#/q/project:openstack/tripleo-common+status:open+owner:%22Martin+M%25C3%25A1gr+%253Cmmagr%2540redhat.com%253E%2214:57
mwhahahaweshay: i'm free in ~3014:57
weshaymwhahaha, k.. I had a recreate up last night.. however some interesting things happened to it after rdo cloud went down14:57
weshayso I'm bringing up a freshy14:57
mwhahahaweshay: k let me know14:57
*** akane_ has joined #tripleo14:59
*** ykarel|away has joined #tripleo14:59
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient master: Change List Plans to call workflow  https://review.openstack.org/54630515:00
*** fragatina has quit IRC15:00
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287515:00
jtomasekhonza: we'll need to start working on network config, I am currently putting together initial work on network configuration dialog, do you think you could put together actions/selectors/reducer for networks? There are several pending patches in tripleo-common to support it15:00
*** akane_ has quit IRC15:00
honzajtomasek: yes, that sounds like a nice isolated chunk15:01
*** wolverineav has joined #tripleo15:01
jtomasekhonza: it is going to be very similar to roles actions/selectors/reducers15:02
jtomasekhonza: at the same time you could review that the patches do what they should15:02
*** pdeore has quit IRC15:02
jtomasekhonza: https://blueprints.launchpad.net/tripleo/+spec/networks-management15:02
*** kopecmartin has joined #tripleo15:03
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287515:05
*** wolverineav has quit IRC15:05
openstackgerritDerek Higgins proposed openstack/tripleo-heat-templates master: Add scenario011 to install ironic in the overcloud  https://review.openstack.org/48526115:06
openstackgerritDerek Higgins proposed openstack/tripleo-quickstart master: Add featureset044 for Ironic in the Overcloud  https://review.openstack.org/50982915:06
openstackgerritDerek Higgins proposed openstack/tripleo-quickstart-extras master: Setup Ironic in Overcloud  https://review.openstack.org/50972815:06
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087415:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]15:10
*** dpawar has quit IRC15:12
beaglesslagle, what did you use to create your sequence diagram for config download?15:12
bandinirlandy|ruck: no luck here even with the patch you mentioned15:13
rlandy|ruckbandini: I am also getting the "no enough hosts" issue. I see someone else reported it on #rhos-ops. I am asking there15:13
openstackgerritMerged openstack/tripleo-quickstart master: Set docker and image value to the right value in mixed version.  https://review.openstack.org/53992915:14
openstackgerritMerged openstack/tripleo-upgrade master: Pass stack's name to overcloud update commands.  https://review.openstack.org/54692715:14
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP Fail more gracefully when passed an empty ip  https://review.openstack.org/54678015:14
bandinirlandy|ruck: ah ok15:14
bandinithanks15:14
*** rbrady has joined #tripleo15:14
*** moshele has quit IRC15:15
rlandy|ruckbandini: bad news - the general rdocloud is at capacity. - none of us can get  instances deployed15:15
rlandy|ruckI will keep trying15:15
bandinirlandy|ruck: ah got it. I'll start going through the pcsd code to see what can possible screw us over15:16
*** lblanchard has joined #tripleo15:17
paramitejaosorior, thank a lot!15:17
*** lblanchard has quit IRC15:18
jaosoriorparamite: no biggie15:19
*** udesale has quit IRC15:19
*** mdnadeem has quit IRC15:19
*** links has quit IRC15:20
*** kopecmartin has quit IRC15:21
openstackgerritArx Cruz proposed openstack/tripleo-specs master: Updating ci team structure  https://review.openstack.org/53988515:21
weshayarxcruz|rover, one change https://review.openstack.org/#/c/539885/315:23
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Share process_multiple_environments in utils lib  https://review.openstack.org/54702415:23
d0ugalIs CI working okay for stable/queens?15:24
arxcruz|roverweshay: done15:24
openstackgerritArx Cruz proposed openstack/tripleo-specs master: Updating ci team structure  https://review.openstack.org/53988515:24
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: [DNM] Testing O->P with tripleo-upgrade role.  https://review.openstack.org/54702515:25
d0ugalI am trying to figure out why this stable/queens patch is consistently failing: https://review.openstack.org/54431815:26
*** karthiks has joined #tripleo15:26
*** dtantsur|brb is now known as dtantsur15:26
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart-extras master: Add opendaylight to collect-logs  https://review.openstack.org/49404315:28
openstackgerritRabi Mishra proposed openstack/tripleo-heat-templates master: Remove cloudwatch packages during upgrade  https://review.openstack.org/54702715:29
sshnaidmd0ugal, ci doesn't work for queens currently15:30
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Add output dir and cleanup vars for UC use_heat  https://review.openstack.org/54694815:30
d0ugalsshnaidm: aha, that'll explain it.15:30
sshnaidmd0ugal, we don't have queens branches afaik15:30
d0ugalsshnaidm: kinda sucks that it is blocking mistral tho :(15:30
d0ugalbut it is fine - if there is an urgent backport we can disable it15:30
sshnaidmd0ugal, EmilienM seems like we are not in sync..15:31
*** jfrancoa1 has quit IRC15:34
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart-extras master: Add opendaylight to collect-logs  https://review.openstack.org/49404315:34
*** karthiks has quit IRC15:36
*** jfrancoa has joined #tripleo15:39
*** yamahata has joined #tripleo15:40
openstackgerritArx Cruz proposed openstack/tripleo-specs master: Updating ci team structure  https://review.openstack.org/53988515:42
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Add support for libvirt VNC TLS  https://review.openstack.org/53646915:47
*** karthiks has joined #tripleo15:49
*** akrivoka has quit IRC15:49
jistrrlandy|ruck, arxcruz|rover: hi, can i somewhere see RDO jobs queue? Some equivalent for http://zuul.openstack.org/ ?15:49
*** akrivoka has joined #tripleo15:50
jistri mean the upstream jobs that run on RDO cloud15:50
arxcruz|roverjistr: https://review.rdoproject.org/zuul/15:50
jistrarxcruz|rover: thanks15:50
*** egallen has joined #tripleo15:51
shardyjaosorior: Hey, can you see any other missing pieces we need to get the tls config into haproxy.cfg on ocata ref https://review.openstack.org/#/c/546935/ ?15:51
*** salmankhan has quit IRC15:51
shardyjaosorior: egallen is testing and has some issues, the patch I backported means the cert is now written, but the haproxy config is not updated15:51
shardyI'm about to jump on a call so wondered if you could maybe take a look?15:51
openstackgerritDan Prince proposed openstack/tripleo-docs master: WIP: prototype of what all-in-one might look like  https://review.openstack.org/54703815:52
egallenshardy: jaosorior: Yes I’ve applied the patch https://review.openstack.org/#/c/546935/15:52
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart-extras master: Add opendaylight to collect-logs  https://review.openstack.org/49404315:52
egallenovercloud_enpoint.pem is generated in /etc/pki/tls/private but the certificate is not called in /etc/haproxy/haproxy.cfg15:52
openstackgerritSergii Golovatiuk proposed openstack-infra/tripleo-ci master: Fix deprecation warnings  https://review.openstack.org/54654415:57
*** anilvenkata is now known as anilvenkata|AFK15:57
*** lblanchard has joined #tripleo15:58
*** BryanS68_ has quit IRC15:59
*** salmankhan has joined #tripleo15:59
*** BryanS68 has joined #tripleo15:59
*** mrch has joined #tripleo15:59
openstackgerritSergii Golovatiuk proposed openstack-infra/tripleo-ci master: Fix deprecation warnings for te-broker  https://review.openstack.org/54704515:59
chemweshay: should I spend some time debugging rdo cloud failure or is it already taken care of and just do a chek-rdo ?16:01
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras master: Add Null Reproduced generator  https://review.openstack.org/54587516:01
sshnaidmchem, should work now16:01
sshnaidmchem, just "check-rdo"16:01
chemsshnaidm: ack, thanks16:02
*** itlinux has joined #tripleo16:03
*** lvdombrkr has quit IRC16:03
chemjistr: by the way when you have time to look again at https://review.openstack.org/#/c/526000/ as you're already familiar with it (waiting on rdo test to be green before w+1 though)16:03
jistrchem: see https://review.openstack.org/#/c/526000/35/scripts/oooq_common_functions.sh16:06
jistrchem: oh it's not in your patch, i looked at the changes since PS3116:08
chemjistr: yeah, replied.  sad story I've done that https://review.openstack.org/#/c/546818/ to be able to move forward16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087416:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]16:10
chemsshnaidm: hey by the way the cut to the queens branch is breaking upgrade p->q upgrade, I've done that to be able to continue the testing https://review.openstack.org/#/c/546818/ but, I'm not sure what is the best way forward16:10
gfidenteslagle you remember what NodeDataLookup does?16:10
jistrchem: ack +2'd :)16:10
gfidenteslagle I should say, what it is for?16:11
chemsshnaidm: bottom line being that until the branch exist we have to keep that part for the upgrade or else they completly fails :)16:11
sshnaidmchem, well, let's document it at least I think..16:11
*** ramishra has quit IRC16:11
sshnaidmchem, sorry, need to run today, maybe weshay, adarazs, panda|sick can help16:12
chemsshnaidm: ack, thanks :)16:12
*** sshnaidm is now known as sshnaidm|off16:12
bandinirlandy|ruck: see my last comment on https://bugs.launchpad.net/tripleo/+bug/1750880. Does that make sense?16:13
openstackLaunchpad bug 1750880 in tripleo "[queens promotion] fs035 is failing to deploy the overcloud - pcsd times out while starting" [Critical,Triaged]16:13
chemadarazs: so, that https://github.com/openstack-infra/tripleo-ci/commit/5bf07a20c2824d36a0b24e7c3411f62de7db4b41, breaks any chance of p->q(master) upgrade16:14
chemadarazs: the bit we need are that https://review.openstack.org/#/c/546818/16:15
weshaymwhahaha, ok.. I have a recreate on fs001 w/ the ssh issue16:15
chemadarazs: the review is just there to foster discussion and enable us to continue testing the upgrade16:15
slaglegfidente: i only see how it's defined in puppet/extraconfig/pre_deploy/per_node.yaml16:15
adarazschem: afaik these parts are only used for upgrades, so if it break upgrades then we can revert that part. /o\16:15
slaglegfidente: i'm not familiar with it. haven't had to use it before16:15
gfidenteslagle nice16:16
gfidenteslagle ceph people uses it a lot I think16:16
chemadarazs: yeah basically while the branch doesn't exit we can't have that, I'll add you to the list of reviewers... not urgent16:16
gfidenteslagle it basically allows passing hieradata into specific nodes basing on the machine uuid (which is fixed)16:16
chemadarazs: thanks16:16
adarazschem: I add my comment there as well16:16
chemack16:17
*** sshnaidm|off has quit IRC16:17
weshayhrm.. 22 is open on the overcloud nodes16:17
weshay nc -v 192.168.24.18 2216:17
weshayNcat: Version 6.40 ( http://nmap.org/ncat )16:17
weshayNcat: Connected to 192.168.24.18:22.16:17
weshaySSH-2.0-OpenSSH_7.416:17
gfidenteslagle now my point is, for ansible it should paste specific variables into the inventory, under a specific node, matching the given machine uuid16:17
gfidenteslagle I was wondering if we can make it a generic feature in DF16:18
gfidenteslagle which I'd be fine starting to work on16:18
gfidenteslagle currently for ceph-ansible we do it in the workflow16:18
itlinuxhello all. I just deployed pike in BM, and notice that all services stopped.. all 3 controllers.. and I had to restart the network and then PCS came back with services... THIS IS a huge problem can someone point me what could be the problem?16:18
gfidenteslagle but we'll need to get rid of that16:18
adarazschem: btw I'd recommend making it -workflow instead of -1 code review -- people tend to ignore stuff with a -1 code review :)16:18
mwhahahaweshay: ok i'm here16:18
gfidenteslagle maybe we can chat at ptg?16:18
mwhahahaweshay: you want my pubkey16:18
mwhahahaweshay: https://launchpad.net/~alex-schultz/+sshkeys16:18
slaglegfidente: don't forget your passport!16:19
gfidenteslagle wtf16:19
gfidenteI'll consider that a yes16:20
gfidenteand stand behind marios16:20
slaglei'm sure we can chat16:20
adarazsmwhahaha: that's neat. I only knew about https://github.com/<username>.keys16:20
openstackgerritMerged openstack/tripleo-ui master: Parameters cleanup  https://review.openstack.org/54400116:23
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Adds Overcloud Upgrade class and entry points for major upgrade  https://review.openstack.org/54536516:23
openstackgerritMerged openstack/tripleo-quickstart-extras master: Update openstack-virtual-baremetal  https://review.openstack.org/54607216:24
rlandy|ruckbandini: yes  - looking where we set up the rules - also  note fs035 deploys with IPV616:28
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Add multinode-overcloud-update playbook to run list  https://review.openstack.org/54705816:28
*** dparkes has quit IRC16:28
rlandy|ruckhttps://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset035.yml16:28
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient master: Don't print the start of a workflow, log it  https://review.openstack.org/54706016:28
chemadarazs: hum ... I had the feeling that W-1 was ignored too :)16:29
*** agopi has quit IRC16:29
*** yolanda has quit IRC16:30
bandinirlandy|ruck: yeah saw it is ipv6. the problem is iptables on the undercloud I think. let me check16:30
*** yolanda has joined #tripleo16:30
*** tosky has quit IRC16:31
*** jfrancoa has quit IRC16:31
*** leanderthal has quit IRC16:32
*** tcw1 is now known as tcw16:33
*** jmelvin has quit IRC16:34
*** oidgar has quit IRC16:35
openstackgerritMerged openstack/tripleo-specs master: Updating ci team structure  https://review.openstack.org/53988516:35
*** d0ugal has quit IRC16:35
*** ccamacho has quit IRC16:40
itlinuxhello I need some help to find out why the crmd crashes in PIKE here is the log http://paste.openstack.org/show/682209/16:41
*** d0ugal has joined #tripleo16:41
itlinuxthis looks like has happen a few times now..16:41
*** moshele has joined #tripleo16:41
weshaymwhahaha, https://review.rdoproject.org/r/#/c/12534/ ? for docker16:43
bandiniitlinux: crmd is not crashing. you have no quorum in the cluster and no fencing configured so it stopped resources16:43
mwhahahaweshay: that'd be a problem for queens16:44
mwhahahaweshay: cause we haven't merged it yet16:44
weshaymwhahaha, wait.. can you dumb that down a bit doc16:45
weshaywhat reviews are in play?16:45
* weshay looking16:45
openstackgerritMichele Baldessari proposed openstack/instack-undercloud master: Add UDP per subnet network cidr nat rules  https://review.openstack.org/54706616:45
*** gvrangan has joined #tripleo16:45
bandinirlandy|ruck: ^16:45
*** gvrangan has quit IRC16:45
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Fix overcloud image upload for containerized UC  https://review.openstack.org/54706716:45
mwhahahaweshay: https://review.openstack.org/#/q/topic:bug/1750194-stable/pike+(status:open+OR+status:merged)16:46
*** gvrangan has joined #tripleo16:46
itlinuxbandini: how is that possible..16:46
itlinuxwhat needs to be address?16:46
mwhahahaweshay: oh wait that's pike16:46
*** gvrangan has quit IRC16:46
itlinuxwhen I just restarted the network on all 3 controllers and everything is good?16:46
mwhahahaweshay: so that's a problem since we don't get that code run at this point16:46
itlinuxhttp://paste.openstack.org/show/682229/16:47
bandiniitlinux: pcs status needs to show all nodes online. If it does not there is usually a network issue between the controllers16:47
mwhahahaweshay: so it looks like docker is breaking config-download because we don't get to the point where we can revert the DROP and it was only for the undercloud16:47
weshayhttps://review.openstack.org/#/c/545710/16:47
*** moshele has quit IRC16:47
mwhahahaweshay: ok let me look at this a bit more16:48
itlinuxbandini: i had ocata running for 2 months on here an no issues so I just fresh deploy PIKE .. same config.. what changes?16:48
weshayk.. thanks mwhahaha16:48
bandiniitlinux: hard to say, I don't have enough info and am about to disconnect now16:48
itlinuxok bandini: are you in EUROPE? I can catch up with you later tonigh..16:49
weshaymwhahaha, shall I hold the env?16:49
itlinuxthanks!16:49
mwhahahaweshay: yea16:49
rlandy|ruckbandini: thanks for that review - let's see what it does - and if we ever get resources we can test it with the promotion.16:49
rlandy|ruckinteresting instack-undercloud does not have a queens branch16:49
mwhahahaweshay: or can you just give me the repro info and i'll do it in my tenant16:49
bandinirlandy|ruck: ah wow16:49
*** oidgar has joined #tripleo16:50
rlandy|ruckbandini: I was going to ask you to backport that to queens but I realize there is no queens branch16:50
weshaymwhahaha, I can hold it for now but fyi https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens/4a63131/reproducer-quickstart.sh16:50
*** pblaho has joined #tripleo16:51
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo stable/ocata: Give horizon's stanza in haproxy a per-server cookie  https://review.openstack.org/54699516:51
openstackgerritMerged openstack/tripleo-heat-templates master: FFU: repo section string manipulation error.  https://review.openstack.org/54656816:51
slagleshardy: where do you think config-download is leaking temporary directories?16:52
*** gvrangan has joined #tripleo16:52
shardyslagle: Maybe I phrased that incorrectly, there's currently no way to prevent it making a new directory, so you end up having to do manual cleanup16:53
mwhahahaweshay: what bug is this for again?16:53
weshaymwhahaha, https://bugs.launchpad.net/tripleo/+bug/175087416:54
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]16:54
shardythe undercloud/overcloud deploy case is worse because it'll silently create directories under /tmp - maybe if we want to persist the rendered files they should go under $HOME/_tripleoclient_tmp/ or something instead?16:54
slagleshardy: i see, well that can be fixed separately.16:54
slagleshardy: yes, using /tmp is not good imo16:55
shardyslagle: yes I think flaper87 was planning to take a look, my point was it'd be cool if we either didn't write temporary data by default, or make it obvious and easy to clean up16:55
*** wolverineav has joined #tripleo16:55
*** wolverineav has quit IRC16:55
*** wolverineav has joined #tripleo16:55
shardyI personally like the idea of the all-in-one mode being 100% compatible with overcloud deploy, but honestly I don't have a really strong opinion on the --cleanup vs --no-cleanup thing16:55
*** ihrachys has quit IRC16:56
*** ihrachys has joined #tripleo16:56
shardyI was thinking that every undercloud deploy re-renders so it's not like the tmpdir can be directly reused16:56
*** ukalifon has quit IRC16:56
shardyit's only really useful for debugging16:56
slagleshardy: what do you mean 100% compatible?16:56
shardyslagle: I mean overcloud deploy has a --no-cleanup option16:56
slaglebut we have the templates though, that's the huge difference16:57
*** shreshtha has quit IRC16:57
slaglei mean...just save the templates by default with uc deploy. that's all i'm saying16:57
shardyslagle: well we don't have the heat stack or anything else in the undercloud case, unless you specify --keep-running16:58
shardyslagle: sure, I'm not blocking on it16:58
*** juriarte has quit IRC16:59
slagleok. i guess i'm just concerned about all the use cases this is being proposed for, and having an audit trail, and a way to reproduce16:59
slagleseems like we'd save what we could, since we're just talking a few hundred KB's probably17:00
shardydprince: Hey could you revisit https://review.openstack.org/#/c/546192/ and https://review.openstack.org/#/c/546181/ when you get a moment, I'm considering abandoning them as I'm not clear on the way forward17:00
mwhahahaweshay: well it seems i rdo doesn't have the capacity17:01
mwhahahaweshay: worst cloud ever17:01
weshayheh..17:01
weshaymwhahaha, ya.. use mine17:02
rlandy|ruckbandini: ok - so the error is not just showing up in promotions, it's in the gates as well ... https://logs.rdoproject.org/14/546214/1/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/Zc9ecee2ff0bd49b7b5c8eb44227dbf92/undercloud/home/jenkins/failed_deployment_list.log.txt.gz - which  means that gates that run on your change will be a good check17:02
*** BryanS68 has quit IRC17:03
mwhahahaweshay: so the problem is i need to get on that other host to see what's up.17:03
*** BryanS68 has joined #tripleo17:03
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: Removing test_telemetry_integration tests from fs017  https://review.openstack.org/54707017:03
*** links has joined #tripleo17:04
*** jpich has quit IRC17:04
shardyslagle: My rendered t-h-t is 7.3M without .git, but agreed it's not a huge overhead17:04
slagleheh, yea, i checked after made my claim and noticed it's larger than I thought17:05
shardyhehe all those yaml files add up :)17:05
openstackgerritMarios Andreou proposed openstack/tripleo-docs master: WIP: Add docs for Q upgrade workflow  https://review.openstack.org/53585917:05
*** fragatina has joined #tripleo17:08
openstackgerritMerged openstack/python-tripleoclient master: Add generic method for preserving plan files, use for user-environment.yaml  https://review.openstack.org/54390317:09
openstackgerritMerged openstack/python-tripleoclient master: Keep original behavior of `overcloud deploy`  https://review.openstack.org/54616817:09
openstackgerritMerged openstack/tripleo-heat-templates master: Add extra yaml validations in upgrade tasks.  https://review.openstack.org/53534317:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087417:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175088017:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]17:10
openstackLaunchpad bug 1750880 in tripleo "[queens promotion] fs035 is failing to deploy the overcloud - pcsd times out while starting" [Critical,In progress] - Assigned to Michele Baldessari (michele)17:10
*** zoli is now known as zoli|gone17:11
*** zoli|gone is now known as zoli17:11
*** pchavva has quit IRC17:13
*** agopi has joined #tripleo17:16
*** cylopez has quit IRC17:16
*** agopi_ has joined #tripleo17:18
*** yprokule has quit IRC17:18
*** pchavva has joined #tripleo17:20
*** agopi has quit IRC17:20
*** pchavva has quit IRC17:20
*** agopi_ has quit IRC17:22
*** dprince has quit IRC17:28
openstackgerritMerged openstack/tripleo-heat-templates master: Fix invalid Ceph and BlockStorage role template  https://review.openstack.org/54664217:29
openstackgerritMerged openstack/tripleo-ui master: Add flavor fetching via Nova API  https://review.openstack.org/54290817:29
openstackgerritMerged openstack/tripleo-common master: upgrade-non-controller.sh script does not support alternative plan names  https://review.openstack.org/54577117:29
openstackgerritMerged openstack/tripleo-quickstart-extras master: Fix conflicting cut/paste licence  https://review.openstack.org/54393917:29
openstackgerritMerged openstack/tripleo-upgrade stable/pike: Don't hardcode overcloud stack name.  https://review.openstack.org/54651317:29
*** marios has quit IRC17:34
*** salmankhan has quit IRC17:38
*** pchavva has joined #tripleo17:38
*** mrch has quit IRC17:43
*** agopi has joined #tripleo17:44
*** aditya_r has joined #tripleo17:45
*** aufi has quit IRC17:45
*** bogdando has quit IRC17:49
*** aditya_r has quit IRC17:50
*** jpena is now known as jpena|off17:52
*** salmankhan has joined #tripleo17:52
*** dprince has joined #tripleo17:55
*** dparkes has joined #tripleo17:57
*** derekh has quit IRC18:00
*** dsneddon_pto has quit IRC18:00
*** dsneddon has joined #tripleo18:00
*** moshele has joined #tripleo18:04
*** khyr0n has joined #tripleo18:06
*** anilvenkata|AFK has quit IRC18:08
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087418:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175088018:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]18:10
openstackLaunchpad bug 1750880 in tripleo "[queens promotion] fs035 is failing to deploy the overcloud - pcsd times out while starting" [Critical,In progress] - Assigned to Michele Baldessari (michele)18:10
chemjistr: still around, just wondering, if something prevented that one https://review.openstack.org/#/c/546665/ to be merged ?18:14
*** oidgar has quit IRC18:14
*** jmelvin has joined #tripleo18:15
*** salmankhan has quit IRC18:15
*** gfidente has quit IRC18:16
*** ykarel|away has quit IRC18:16
chembeagles: hi, is there anything that prevent https://review.openstack.org/#/c/546665/ to be merged (maybe I missed some mail related to queens cut ?)18:17
beagleschem, not afaict - I would've liked dsneddon to have a look before merging but if he's not available...18:18
chembeagles: oki, np, just wondering. Thanks.18:18
itlinuxshardy: I sent you a PM let me know when you have a min to get back to me. Thanks!18:18
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: DNM: testing ffu.  https://review.openstack.org/54667018:20
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing.  https://review.openstack.org/52568618:20
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: DNM: testing ffu.  https://review.openstack.org/54667018:20
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Store ansible playbooks output to log files for FFU  https://review.openstack.org/54460418:21
*** yamahata has quit IRC18:22
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Store ansible playbooks output to log files for FFU  https://review.openstack.org/54460418:22
chemmcornea: you can W-1 instead of being rude with yourself with those -2 :)18:23
*** holser has quit IRC18:25
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: DNM: testing ffu.  https://review.openstack.org/54667018:25
mcorneachem: :) thanks just wanted to make sure that it doesn't land broken18:25
chemmcornea: I'm going to try to give it a ride there https://review.openstack.org/#/c/546670/18:26
chemmay be too late though ...18:27
*** tesseract has quit IRC18:28
mcorneachem: I think I want to adjust it a bit more to add some name to the tasks18:28
chemmcornea: go for it, I'll run the test later anyway18:28
*** gfidente has joined #tripleo18:29
*** moshele has quit IRC18:29
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Store ansible playbooks output to log files for FFU  https://review.openstack.org/54460418:30
*** gbarros has joined #tripleo18:32
*** openstackgerrit has quit IRC18:33
*** ebarrera has quit IRC18:36
*** moshele has joined #tripleo18:48
itlinuxhello guys is it normal that PCSD Status: shows two online and one offline? Thanks18:50
*** dtantsur is now known as dtantsur|afk18:52
*** suuuper has quit IRC18:54
*** BryanS68 has quit IRC19:00
*** BryanS68 has joined #tripleo19:00
*** gvrangan has quit IRC19:04
*** bkopilov has quit IRC19:05
*** moshele has quit IRC19:09
*** gfidente has quit IRC19:09
*** openstackgerrit has joined #tripleo19:09
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Use Nova profiles in node tagging form  https://review.openstack.org/54509819:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087419:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175088019:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]19:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1750880 in tripleo "[queens promotion] fs035 is failing to deploy the overcloud - pcsd times out while starting" [Critical,In progress] - Assigned to Michele Baldessari (michele)19:10
*** links has quit IRC19:11
*** moshele has joined #tripleo19:11
*** amoralej is now known as amoralej|off19:12
*** wolverineav has quit IRC19:12
rajinirCan I get some reviews on https://review.openstack.org/#/c/544087/ please?19:13
*** wolverineav has joined #tripleo19:13
*** wolverineav has quit IRC19:13
*** wolverineav has joined #tripleo19:14
openstackgerritMichele Baldessari proposed openstack/instack-undercloud master: Add UDP per subnet network cidr nat rules  https://review.openstack.org/54706619:15
*** wolverineav has quit IRC19:16
*** wolverineav has joined #tripleo19:17
*** moshele has quit IRC19:18
*** liverpooler has quit IRC19:18
openstackgerritMerged openstack/tripleo-common master: Fix health check for ovn-metadata  https://review.openstack.org/54038419:28
dsneddonbeagles, chem: We need to start using supernets for routed spine-and-leaf. That is, all Internal Api networks need to be under one larger network, and all Storage networks need to be under one network, etc. So the change in IP addresses needs to happen at some point.19:31
dsneddonbeagles, chem: What was breaking?19:31
*** moshele has joined #tripleo19:32
dsneddonbeagles, chem: A little more detail. With routing in between racks, we need a way to direct traffic to exit the Internal API network in one rack, and for the return traffic to use the local Internal API network in a different rack, with routing in between. The supernets allow us to direct all traffic to, say, 172.16.0.0/16 to use the local Internal API network in each rack.19:32
*** gbarros has quit IRC19:35
openstackgerritMerged openstack/tripleo-common master: Add healthcheck script for iSCSId  https://review.openstack.org/54345019:36
*** moshele has quit IRC19:39
*** egallen has quit IRC19:40
*** egallen has joined #tripleo19:41
beaglesdsneddon, I figured that had something to do with it, maybe touch base with Lukas?19:41
*** agopi has quit IRC19:45
*** BryanS68 has quit IRC19:53
dsneddonbeagles, I updated the review with a comment. I didn't expect that changing the default networks would matter, since I thought every CI environment used it's own custom network-environment.yaml with the network subnets specified there. We shouldn't be relying on the defaults, which might change between releases.19:54
beaglesdsneddon, k thanks for checking on this!19:55
beaglesdsneddon, fwiw, I agree that some of the "defaults" have unintentionally become problematic. I'm in the process of documenting DVR config and removing default values for things pertaining to the node network config19:59
*** dparkes has quit IRC19:59
beaglesdsneddon, because there in real-world there is no meaningful default and putting anything there is misleading19:59
beaglesmaybe "example" is a more appropriate term than "default" here, but the gist is the same20:00
*** yamahata has joined #tripleo20:03
*** BryanS68 has joined #tripleo20:03
*** raildo has quit IRC20:04
openstackgerritMerged openstack/tripleo-common master: Add healthcheck script for memcached  https://review.openstack.org/54400620:05
openstackgerritMerged openstack/tripleo-quickstart master: Replace Chinese single quotation marks to English single quotes  https://review.openstack.org/54079420:05
*** egallen_ has joined #tripleo20:06
*** egallen_ has quit IRC20:06
*** egallen_ has joined #tripleo20:07
*** egallen has quit IRC20:07
*** egallen_ is now known as egallen20:07
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087420:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175088020:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]20:10
openstackLaunchpad bug 1750880 in tripleo "[queens promotion] fs035 is failing to deploy the overcloud - pcsd times out while starting" [Critical,In progress] - Assigned to Michele Baldessari (michele)20:10
*** BryanS68 has quit IRC20:10
*** gbarros has joined #tripleo20:10
dsneddonEmilienM, I'd like to merge https://review.openstack.org/#/c/539155/12 but there is no bug, and it seems late in the cycle. WDYT?20:11
*** BryanS68 has joined #tripleo20:11
jristhonza: looks like needsa  rebase https://review.openstack.org/#/c/54509820:11
*** gbarros has quit IRC20:12
*** fragatina has quit IRC20:12
*** ffiore has joined #tripleo20:15
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: Removing test_telemetry_integration tests from fs017  https://review.openstack.org/54707020:20
*** egallen has quit IRC20:24
trozetdoes anyone know in the TripleO CI if there is a way to indicate that tempest should not clean up after a failure?  I'm seeing a ping failure to a floating IP and I need the instance to stick around for when logs are collected20:27
*** dprince has quit IRC20:27
*** ffiore_ has joined #tripleo20:27
*** ffiore has quit IRC20:27
*** khyr0n has quit IRC20:28
*** khyr0n has joined #tripleo20:29
mwhahahatrozet: we don't collect logs in the instances running in the overcloud. Or are you wanting to collect some nova metadata or something20:32
trozetmwhahaha: i need to get the OVS outputs with the instance still there20:33
trozetmwhahaha: so i see the OVS flows and the OVS ports for the instance20:33
mwhahahatrozet: you'd probably have to hack out the cleanup in tempest itself and maybe do a depends-on20:33
mwhahahabut you could always try the reproducer script20:33
*** khyr0n has quit IRC20:33
trozetmwhahaha: i saw some reproduce thing in the log, how does that work i just download that script and oooqs and run it and it works?20:34
mwhahahayea except i think it assumes rdo cloud20:34
mwhahahabut i think you maybe able ot hack it to do libvirt20:34
trozetmwhahaha: ok yeah i'll look at that20:34
*** ffiore has joined #tripleo20:39
*** ffiore_ has quit IRC20:39
trozetmwhahaha: so just to confirm, with these scenarios in tripleo-ci everythign is run on subnode-2 for overcloud right?  The reason I ask is I do not see dhcp agent log in: http://logs.openstack.org/05/486905/28/experimental/tripleo-ci-centos-7-scenario008-multinode-oooq/b2ee7df/logs/subnode-2/var/log/neutron/20:46
mwhahahatrozet: correct, it would be in /var/log/containers/neutron i think20:46
mwhahahaoh wait is that not containerized?20:47
trozetmwhahaha: oh, but neutron server is not in container?20:47
mwhahahai guess it depends on your scenario20:47
mwhahahai don't see any containers folder20:47
mwhahahaso that scenario doesn't look containerized20:47
trozetmwhahaha: yeah this was supposed to an attempt without any containers, so ODL wasnt containerized, just to keep things simple to debug this tempest failure20:48
mwhahahatrozet: do you know which featureset scenario008 is?20:48
* mwhahaha goes to find the roseta stone20:48
mwhahahalooks like 3120:49
trozetmwhahaha: yeah i see now containerized_overcloud: false20:50
trozetmwhahaha: ok I'll try to reproduce this locally, without those logs I can't tell where packets are going20:51
mwhahahatrozet: heh i was looking for scenario008 not realizing you're working on the change to add it20:53
mwhahahatrozet: you don't have the dhcp agent defined20:54
mwhahahatrozet: which would be why it's missing20:54
trozetmwhahaha: LOL what?20:54
mwhahahahttps://review.openstack.org/#/c/486905/28/ci/environments/scenario008-multinode.yaml20:54
trozetmwhahaha: omg20:55
mwhahahaoh wait20:55
mwhahahawe set it to none everywhere20:55
mwhahahabut it is missing20:55
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Pass nodes file to baremetal deploy script.  https://review.openstack.org/54713720:55
mwhahahaso you'd need to actually include it in the role20:55
trozetmwhahaha: yeah it should be enabled by default in the resource registry, but it is missing from the role20:55
mwhahahatrozet: so try that :D20:55
trozetmwhahaha: how did neutron not error when a network was created with dhcp enabled...20:55
mwhahahapffft who needs dhcp20:56
trozetmwhahaha: 2018-02-22 18:13:32.457 74605 WARNING neutron.scheduler.dhcp_agent_scheduler [req-39bca562-cfb0-4645-adb5-ff7a7468b049 e62764f541b74b8f8191eed456d7a2b3 dd63a07aa2684c3f98de34da19d2285c - default default] No more DHCP agents20:57
trozetmwhahaha: just a little warning is all20:57
mwhahahajust a flesh wound20:57
trozetmwhahaha: thanks for finding that, saved me a bunch of time20:57
openstackgerritMichele Baldessari proposed openstack/instack-undercloud master: Add UDP per subnet network cidr nat rules  https://review.openstack.org/54706620:58
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates master: Add OPNFV scenario environment  https://review.openstack.org/48690521:03
*** nyechiel has quit IRC21:04
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP Fail more gracefully when passed an empty ip  https://review.openstack.org/54678021:05
*** lblanchard has quit IRC21:05
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087421:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175088021:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1750880 in tripleo "[queens promotion] fs035 is failing to deploy the overcloud - pcsd times out while starting" [Critical,In progress] - Assigned to Michele Baldessari (michele)21:10
*** gbarros has joined #tripleo21:13
*** dprince has joined #tripleo21:18
honzajrist: excellent :(21:19
*** jtomasek has quit IRC21:27
*** deadnull has quit IRC21:30
*** morazi has quit IRC21:30
*** paramite has quit IRC21:33
*** alop has quit IRC21:36
*** pcaruana has quit IRC21:37
*** rbowen has quit IRC21:45
*** dhill__ has quit IRC21:56
*** pkovar has quit IRC22:03
*** jcoufal has quit IRC22:09
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Check that overcloud_nodes is defined before assigning hostnames  https://review.openstack.org/54715322:10
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087422:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175088022:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1750880 in tripleo "[queens promotion] fs035 is failing to deploy the overcloud - pcsd times out while starting" [Critical,In progress] - Assigned to Michele Baldessari (michele)22:10
*** dhill_ has joined #tripleo22:10
*** pchavva has quit IRC22:11
*** abishop has quit IRC22:16
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Gracefully handle OS_TENANT_NAME  https://review.openstack.org/54715522:17
*** agopi has joined #tripleo22:18
*** thrash is now known as thrash|g0ne22:19
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Gracefully handle OS_TENANT_NAME  https://review.openstack.org/54715522:20
*** rlandy|ruck is now known as rlandy|biab22:21
*** chem has quit IRC22:29
*** chem has joined #tripleo22:29
*** itlinux has quit IRC22:30
*** dprince has quit IRC22:33
*** tonyb has quit IRC22:35
*** tonyb has joined #tripleo22:36
*** rcernin has joined #tripleo22:38
*** sshnaidm has joined #tripleo22:40
*** sshnaidm is now known as sshnaidm|off22:40
*** tosky has joined #tripleo22:41
*** fragatina has joined #tripleo22:42
*** BryanS68 has quit IRC22:44
*** Goneri has quit IRC22:49
*** ffiore has quit IRC22:49
weshaymwhahaha, ok.. will have fs001 w/ access to the overcloud nodes up shortly22:55
mwhahahaweshay: A LIKELY STORY22:55
weshayI'm on the overcloud nodes now :)22:56
weshaymwhahaha, hrm.. well you are kind of right.. the compute came up but not the controller22:58
weshaymwhahaha, not much there on the compute node22:59
weshaymwhahaha, do you want to poke or should I retry the overcloud deployment?22:59
weshay2018-02-22 22:55:48 | 2018-02-22 22:55:45Z Starting workflow to create ssh admin on deployed servers.22:59
weshay2018-02-22 22:55:48 | SSH user: heat-admin22:59
weshay2018-02-22 22:55:48 | SSH key file: /home/stack/.ssh/id_rsa22:59
weshay2018-02-22 22:55:48 | Hosts: 192.168.24.11 192.168.24.722:59
weshay2018-02-22 22:55:48 |22:59
weshay2018-02-22 22:55:48 | Inserting TripleO short term key for 192.168.24.1122:59
weshay2018-02-22 22:56:22 | ssh: connect to host 192.168.24.11 port 22: No route to host22:59
weshay2018-02-22 22:56:22 | /usr/share/openstack-tripleo-heat-templates/deployed-server/scripts/enable-ssh-admin.sh failed.22:59
mwhahahaweshay: yea probably best to retry23:00
*** jmelvin has quit IRC23:02
tbarronwith a fresh deploy, all new today including undercloud, docker pull from overcloud fails b/c name resolution fails - is this known?23:03
tbarron /etc/resolv.conf on overcloud nodes is the same as it used to be, the IP on br-ex on the virthost23:04
tbarronbut that IP is not reachable from overcloud nodes23:05
tbarronhttps://paste.fedoraproject.org/paste/QrLGKkDbG51kgyjFewseBw23:05
openstackgerritIan Wienand proposed openstack/diskimage-builder master: GPT partitioning support  https://review.openstack.org/53349023:05
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Fail if two elements provide the same thing  https://review.openstack.org/53940123:05
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add block-device defaults  https://review.openstack.org/53937523:05
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Choose appropriate bootloader for block-device  https://review.openstack.org/53973123:05
openstackgerritIan Wienand proposed openstack/diskimage-builder master: arm64: use HWE kernel and fix console  https://review.openstack.org/54716123:05
tbarronDocker version 1.13.1, build 3f45913-unsupported so I looked at https://trello.com/c/guEuKJaU/462-cixbz1543580osp-13-rhel-75-newer-versions-of-docker-switch-forward-chain-to-drop-by-default but it looks like the workaround patches there all merged before my deploy attempt23:07
*** khyr0n has joined #tripleo23:08
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087423:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175088023:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Triaged]23:10
openstackLaunchpad bug 1750880 in tripleo "[queens promotion] fs035 is failing to deploy the overcloud - pcsd times out while starting" [Critical,In progress] - Assigned to Michele Baldessari (michele)23:10
*** salmankhan has joined #tripleo23:13
weshaymwhahaha, ok..23:14
*** rlandy|biab is now known as rlandy|ruck23:14
weshaymwhahaha, red eye23:15
mwhahahatbarron: you might be battling the same thing we're trying ot figure out23:15
tbarronmwhahaha: ah, I'll watch and learn then, thx23:16
tbarronmwhahaha: weshay: if it's useful to access my deployment let me know, o/w I'll just stay out of the way23:17
*** salmankhan has quit IRC23:17
weshaytbarron, you hit the same ssh auth error?23:17
weshaymwhahaha, so.. here's where we're at23:18
weshay2018-02-22 23:14:39Z [overcloud.AllNodesDeploySteps.ControllerPostConfig]: CREATE_IN_PRStarting workflow to create ssh admin on deployed servers.23:18
weshaySSH user: heat-admin23:18
weshaySSH key file: /home/stack/.ssh/id_rsa23:18
weshayHosts: 192.168.24.13 192.168.24.623:18
weshayInserting TripleO short term key for 192.168.24.1323:18
weshayWarning: Permanently added '192.168.24.13' (ECDSA) to the list of known hosts.23:18
tbarronweshay: no, I get dns lookup failures from overcloud nodes with a resolv.conf there that used to work23:18
weshaytbarron, hrm.. ok..  is this rdo-cloud, libvirt  what?23:19
mwhahahaweshay: ok so can we get on the console of one of the nodes while we try and ssh to it?23:19
tbarronweshay: the lookup failures cause 'docker pull' to fail, it's a classic virthost setup23:19
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: add the ability to set the root passwd on the overcloud-full image  https://review.openstack.org/54716323:20
*** dbecker has quit IRC23:20
weshaymwhahaha, ya23:20
weshaytbarron, hrm.. k23:23
*** apetrich has quit IRC23:25
*** itlinux has joined #tripleo23:29
*** tosky has quit IRC23:39
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Store ansible playbooks output to log files for FFU  https://review.openstack.org/54460423:46
*** rlandy|ruck is now known as rlandy|bbl23:51
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260723:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!