Monday, 2017-02-13

« Sunday, 2017-02-12 Index Tuesday, 2017-02-14 »
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/43211900:07
*** ooolpbot has joined #tripleo00:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318700:11
*** ooolpbot has quit IRC00:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,Triaged]00:11
*** ansiwen has quit IRC00:29
*** ansiwen has joined #tripleo00:30
*** fragatina has joined #tripleo00:35
*** jkilpatr has quit IRC00:45
*** noslzzp has quit IRC00:54
*** ooolpbot has joined #tripleo01:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318701:11
*** ooolpbot has quit IRC01:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,Triaged]01:11
*** tobias_fiberdata has quit IRC01:14
*** tobias_fiberdata has joined #tripleo01:15
*** dmarlin_ has quit IRC01:19
*** amoralej|off has quit IRC01:19
*** dmarlin_ has joined #tripleo01:20
*** toure|gone has quit IRC01:20
*** zaneb has quit IRC01:21
*** toure has joined #tripleo01:21
*** zaneb has joined #tripleo01:22
*** amoralej has joined #tripleo01:22
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: placement: switch public endpoint on NovaPlacementInternal  https://review.openstack.org/43276101:47
*** pmannidi has quit IRC01:50
openstackgerritMerged openstack/os-apply-config master: Updated from global requirements  https://review.openstack.org/43205401:52
*** pmannidi has joined #tripleo01:59
*** ooolpbot has joined #tripleo02:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318702:11
*** ooolpbot has quit IRC02:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)02:11
*** sdake has joined #tripleo02:35
*** sdake_ has joined #tripleo02:40
*** sdake has quit IRC02:43
*** gkadam has joined #tripleo02:46
*** akrzos-pto is now known as akrzos02:49
*** akrzos is now known as akrzos-pto02:49
gkadamhi, i am facing this error on executing openstack undercloud install :   https://paste.fedoraproject.org/556691/95404414/ could someone please help?02:51
*** stendulker has joined #tripleo02:58
*** gkadam has quit IRC03:00
*** ooolpbot has joined #tripleo03:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318703:11
*** ooolpbot has quit IRC03:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)03:11
*** sdake has joined #tripleo03:17
*** sdake_ has quit IRC03:18
*** rhallisey has quit IRC03:21
openstackgerritMatthew Flusche proposed openstack/instack-undercloud master: Purge /var/lib/os-collect-config  https://review.openstack.org/43283003:35
*** psahoo has joined #tripleo03:44
*** sudipto has joined #tripleo03:47
*** sudipto_ has joined #tripleo03:47
*** sdake has quit IRC03:49
openstackgerritzhongshengping proposed openstack/puppet-pacemaker master: Switch puppet-openstack_spec_helper to run syntax check  https://review.openstack.org/43283703:59
*** ooolpbot has joined #tripleo04:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318704:11
*** ooolpbot has quit IRC04:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)04:11
openstackgerritzhongshengping proposed openstack/puppet-pacemaker master: Disable the deprecation warnings as errors for puppet-syntax  https://review.openstack.org/43283704:28
*** sudipto has quit IRC04:28
*** sudipto_ has quit IRC04:28
*** openstackgerrit has quit IRC04:32
*** skramaja has joined #tripleo04:51
*** sudipto has joined #tripleo04:54
*** sudipto_ has joined #tripleo04:54
*** prateek has joined #tripleo04:58
*** udesale has joined #tripleo05:01
*** prateek_ has joined #tripleo05:02
*** prateek has quit IRC05:03
*** prateek__ has joined #tripleo05:03
*** openstackgerrit has joined #tripleo05:04
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart master: Add support for virtual port types  https://review.openstack.org/40734705:04
*** prateek__ has quit IRC05:05
*** prateek has joined #tripleo05:05
*** prateek_ has quit IRC05:07
openstackgerritMatthew Flusche proposed openstack/instack-undercloud master: Purge /var/lib/os-collect-config  https://review.openstack.org/43283005:07
*** ooolpbot has joined #tripleo05:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318705:11
*** ooolpbot has quit IRC05:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)05:11
*** jaosorior has joined #tripleo05:28
*** Vijayendra has joined #tripleo05:30
*** agurenko has joined #tripleo05:32
*** twi99y_ has joined #tripleo05:56
*** twi99y__ has joined #tripleo05:58
*** saibarspeis has joined #tripleo05:58
*** nyechiel_ has joined #tripleo05:58
*** bkopilov_ has quit IRC05:58
*** bkopilov_ has joined #tripleo05:59
*** twi99y has quit IRC05:59
*** saibarspeis has quit IRC05:59
*** twi99y_ has quit IRC06:01
*** saneax-_-|AFK is now known as saneax06:02
*** agurenko has quit IRC06:02
*** bkopilov_ has quit IRC06:04
*** bkopilov_ has joined #tripleo06:04
*** jrist has joined #tripleo06:04
*** agurenko has joined #tripleo06:04
*** pgadiya has joined #tripleo06:07
*** ooolpbot has joined #tripleo06:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318706:11
*** ooolpbot has quit IRC06:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)06:11
*** yprokule has joined #tripleo06:13
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Configure the placement API's interface to use the internal endpoint  https://review.openstack.org/43286406:21
*** jaganathan has joined #tripleo06:25
*** dsariel has joined #tripleo06:27
*** dsariel_ has joined #tripleo06:41
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Configure the placement API's interface to use the internal endpoint  https://review.openstack.org/43286406:45
jaosoriordsneddon_afk: thanks for the feedback. fixed ^^06:46
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job with RabbitMQ  https://review.openstack.org/42630706:50
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job  https://review.openstack.org/42686306:51
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job with RabbitMQ  https://review.openstack.org/42630706:55
*** fragatina has quit IRC06:58
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Enable TLS in the internal network for RabbitMQ  https://review.openstack.org/32748206:58
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Pass hieradata for internal TLS for RabbitMQ  https://review.openstack.org/40914306:59
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job with RabbitMQ  https://review.openstack.org/42630706:59
*** nmathew has joined #tripleo07:02
nmathewhi all07:03
nmathewhow to remove the plan files from swift07:03
jaosoriornmathew: doing this: openstack overcloud plan delete overcloud07:04
jaosoriorshould have done the trick07:04
*** iranzo has joined #tripleo07:04
*** iranzo has joined #tripleo07:04
*** leanderthal|afk is now known as leanderthal07:10
*** ooolpbot has joined #tripleo07:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318707:11
*** ooolpbot has quit IRC07:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)07:11
*** rasca has joined #tripleo07:11
*** rcernin has joined #tripleo07:15
*** tremble has joined #tripleo07:18
*** cylopez has joined #tripleo07:26
*** tesseract has joined #tripleo07:28
*** tesseract is now known as tesseract-RH07:29
*** newmember has quit IRC07:30
*** newmember has joined #tripleo07:31
*** bvandenh has quit IRC07:37
*** ealcaniz has joined #tripleo07:37
*** cmyster_ has joined #tripleo07:39
*** cmyster has quit IRC07:40
*** fragatina has joined #tripleo07:40
*** cmyster_ has quit IRC07:41
*** cmyster has joined #tripleo07:41
*** cmyster has quit IRC07:41
*** cmyster has joined #tripleo07:41
*** pmannidi has quit IRC07:47
*** fragatina has quit IRC07:48
*** pcaruana has joined #tripleo07:49
nmathewjaosorior, Thanks08:08
*** social has joined #tripleo08:10
*** ooolpbot has joined #tripleo08:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318708:11
*** ooolpbot has quit IRC08:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)08:11
*** hjensas has joined #tripleo08:12
*** hjensas has joined #tripleo08:12
*** jlinkes has joined #tripleo08:20
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/43258108:21
*** mcornea has joined #tripleo08:24
*** cmyster has quit IRC08:28
*** abregman has joined #tripleo08:34
*** paramite has joined #tripleo08:37
*** jpena|away is now known as jpena08:39
*** suuuper has joined #tripleo08:42
*** jpich has joined #tripleo08:45
*** fzdarsky|afk has joined #tripleo08:48
*** aufi has joined #tripleo08:49
openstackgerritMerged openstack/tripleo-quickstart-extras master: Install pip  https://review.openstack.org/43034408:50
*** jpena is now known as jpena|away08:52
*** zoli|gone is now known as zoli08:55
*** zoli is now known as zoliXXL08:55
*** abregman has quit IRC08:56
*** radeks has joined #tripleo08:59
*** radeksmg has joined #tripleo08:59
*** jpena|away is now known as jpena08:59
*** zzzeek has quit IRC09:00
*** zzzeek has joined #tripleo09:00
jaosoriorccamacho: que tal?09:00
*** shardy has joined #tripleo09:00
*** bogdando has joined #tripleo09:01
*** sshnaidm|off is now known as sshnaidm09:02
*** radeks has quit IRC09:05
*** radeksmg has quit IRC09:05
*** radeks has joined #tripleo09:05
*** radeks has quit IRC09:05
*** nyechiel_ has quit IRC09:10
*** ooolpbot has joined #tripleo09:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318709:11
*** ooolpbot has quit IRC09:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)09:11
*** dtantsur|afk is now known as dtantsur09:15
*** kashyap has joined #tripleo09:22
*** shardy has quit IRC09:24
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Uncomment internal TLS options for placement API  https://review.openstack.org/43293809:25
*** udesale__ has joined #tripleo09:26
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job (placement fix)  https://review.openstack.org/43293909:27
*** udesale has quit IRC09:29
openstackgerritDmitry Tantsur proposed openstack/tripleo-common master: Bump OS_BAREMETAL_API_VERSION to 1.29  https://review.openstack.org/43145509:31
*** derekh has joined #tripleo09:32
*** bvandenh has joined #tripleo09:34
*** lucas-afk is now known as lucasagomes09:36
openstackgerritMerged openstack/tripleo-ui master: Make quotes consistent in the sample config  https://review.openstack.org/43240109:39
*** athomas has joined #tripleo09:40
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Remove the ansible neutron-api db sync as for other services  https://review.openstack.org/43294509:42
*** panda|off is now known as panda09:44
jaosoriorsshnaidm, bandini hey guys, could I get a review for this https://review.openstack.org/#/c/427505/ ? need it for CI09:46
*** tosky has joined #tripleo09:49
jaosoriormarios: thanks dude09:49
mariosjaosorior: o/ quid pro qo09:49
mariosjaosorior: (thanks for looking at   https://review.openstack.org/432945 )09:50
*** gfidente has joined #tripleo09:56
*** gfidente has quit IRC09:56
*** gfidente has joined #tripleo09:56
jaosoriormarios: no worries, let me know if you need reviews for anything else09:56
mariosjaosorior: thanks same09:57
*** salmankhan has joined #tripleo09:57
matbumarios: o/ this the (atlanta) PTG week ?09:58
mariosmatbu: ermm next week i think09:59
mariosmatbu: o/09:59
matbumarios: k, are you going there ?09:59
mariosmatbu: no in the end going to skip this one. i'll be around but will be away on the friday of next week.10:00
*** bogdando has quit IRC10:00
mariosmatbu: i think sofer and shardy are going but between you/mcornea/ccamacho/me we should make good progress to finish up this stuff10:01
mariosmatbu: yeah is next week https://www.openstack.org/ptg/10:02
ccamachojaosorior con 40.2 de fiebre :(10:02
ccamachoIm like a zombie right now10:02
jaosoriorccamacho: no mames :/ ojalá te mejores pronto10:02
mcorneamarios: hey, re neutron db sync there are currently 2 open issues with bigswitch and odl: https://bugs.launchpad.net/tripleo/+bug/1663217 and https://bugs.launchpad.net/tripleo/+bug/166321910:03
openstackLaunchpad bug 1663217 in tripleo "Newton->Ocata upgrade fails during neutron-db-manage upgrade head (caused by python-networking-bigswitch)" [Critical,Triaged] - Assigned to Brent Eagles (beagles)10:03
openstackLaunchpad bug 1663219 in tripleo "Newton->Ocata upgrade fails during neutron-db-manage upgrade head (caused by python-networking-odl)" [Critical,Triaged] - Assigned to Brent Eagles (beagles)10:03
mariosmcornea: cool oops forgot to add you to the review, sec10:03
mariosmcornea: so, i saw those10:04
matbumarios: k, i'll be on pto next week10:04
mariosmcornea: i mean i saw them in the meeting logs from last week10:04
matbumarios: but not far from kb10:04
mariosmatbu: nice :D well i guess we will still try to make progress (really though we need this done before next week... )10:04
mariosmatbu: otherwise EmilienM may well have a heart attack10:04
mariosmcornea: so, i was wondering if they are for vendor specific envs?10:05
matbulolyep10:05
mariosmcornea: i mean howwhen did you hit those?10:05
matbui think it should be fine, if we dont hit weird issues10:05
mariosmatbu: "if we dont hit weird issues" :/10:06
marios:/ :/ :/10:06
mcorneamarios: I think all the environments will hit these, a quick workaround is to remove the corresponding python-networking packages10:07
*** cmyster has joined #tripleo10:08
*** cmyster has quit IRC10:08
*** cmyster has joined #tripleo10:08
mariosmcornea: i see ... looking at the bugs some more now10:09
mariosmcornea: so you mean the package update does the db sync?10:09
bandinijaosorior: done10:09
mariosmcornea: oh or rather the db sync which will happen later with puppet will fail because of these packages perhaps...10:10
mcorneamarios: yeah, the dbsync will fail because of these packages no matter if it's run by ansible or puppet10:10
mariosmcornea: i didn't get that far (posted that neutron review as it was failing on the ansible step but we said we woudn't run those dbsyncs there because we do it in puppet)10:10
*** ealcaniz has quit IRC10:10
*** ooolpbot has joined #tripleo10:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318710:11
*** ooolpbot has quit IRC10:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)10:11
mcorneamarios: I think the failure you're seeing is caused by the bigswitch plugin: /usr/lib/python2.7/site-packages/bsnstacklib/plugins/bigswitch/db/migration/alembic_migrations/env.py10:11
mariosmcornea: ok right so assuming it gets that far it is likely to fail on my env too when puppet runs and that dbsync happens.... well removing the package is ok assuming you don't need/use those plugins... for dev then yeah lets just add removing those in the UpgradeInit or something for now (i mean locally in our envs)10:12
mariosmcornea: ok thanks lets see how far this run gets and i'll remove the packages before going again (for now at least)10:12
*** ealcaniz has joined #tripleo10:13
mcorneamarios: yeah, we need to fix them but I think for the time being, to see a complete upgrade workflow we can workaround by removing them10:15
mariosmcornea: yeah i see beagles posted links to fixes on both bugs so it may just be a case of waiting for package update10:15
mcorneamarios: yep10:16
*** salmankhan has quit IRC10:16
*** sdake has joined #tripleo10:18
*** salmankhan has joined #tripleo10:19
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Add logging agents deployment to CI  https://review.openstack.org/41021010:20
*** percevalbot has joined #tripleo10:22
*** udesale has joined #tripleo10:22
jaosoriorbandini: thanks dude10:23
*** chem has joined #tripleo10:23
*** udesale__ has quit IRC10:23
*** owalsh-afk has joined #tripleo10:26
*** owalsh-afk is now known as owalsh10:26
*** karthiks_afk has quit IRC10:27
*** karthiks has joined #tripleo10:27
*** owalsh_ has joined #tripleo10:28
*** zoliXXL is now known as zoli|FBCI10:29
*** chem has quit IRC10:30
*** chem has joined #tripleo10:30
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Make connected components update on lang. switch  https://review.openstack.org/43236510:31
*** owalsh__ has joined #tripleo10:31
*** owalsh has quit IRC10:32
*** owalsh_ has quit IRC10:34
*** owalsh_ has joined #tripleo10:35
paramiteGreetings, can somebody point me to a way how can I run gate-tripleo-ci-centos-7-scenario001-multinode locally in my lab?10:36
*** salmankhan has quit IRC10:36
*** owalsh__ has quit IRC10:36
*** owalsh__ has joined #tripleo10:37
jaosoriorparamite: you need to add these two environments to your overcloud deploy: ci/common/net-config-multinode.yaml & ci/environments/scenario001-multinode.yaml10:39
*** udesale has quit IRC10:39
*** karimb has joined #tripleo10:39
paramitejaosorior, that's it?10:39
openstackgerritJulie Pichon proposed openstack/tripleo-ui master: Add i18n to node driver fields  https://review.openstack.org/43297910:39
*** owalsh__ is now known as owalsh10:39
jaosoriorparamite: wait up10:40
*** owalsh_ has quit IRC10:40
jaosoriorparamite: you also need to take into account that that environment deploys an all-in-one node, so you need --compute-scale 010:40
jaosoriorparamite: these are the parameters that we pass on CI https://github.com/openstack-infra/tripleo-ci/blob/master/toci_gate_test.sh#L26510:41
jaosorioryou probably don't need /usr/share/openstack-tripleo-heat-templates/environments/deployed-server-environment.yaml since you're probably not gonna deploy over a pre-existing server (right?)10:42
jaosoriorparamite: anyway, for a very basic deployment, I guess those three considerations (the two env files and the compute scale) are enough10:42
paramitejaosorior, right, not on predeployed server ... thanks a lot!10:43
openstackgerritGabriele Cerami proposed openstack/puppet-tripleo master: nova placement: include nova::api class  https://review.openstack.org/43298210:45
*** zoli|FBCI is now known as zoli10:51
pandajaosorior: I've made a mistake, this should have gone to ocata branch. Will that change be backported ?10:52
jaosoriorpanda: it could; let me try to do that10:53
jaosoriorpanda: lets see how it goes https://review.openstack.org/#/c/432985/10:54
pandajaosorior: putting the change for ocata then, you can -1 that too10:54
*** nyechiel_ has joined #tripleo10:55
*** owalsh_ has joined #tripleo10:55
*** hewbrocca_afk is now known as hewbrocca10:55
pandajaosorior: oh, puppet-tripleo is branchless :(10:55
jaosoriorpanda: so we do need that puppet-nova change to land in ocata.10:56
jaosoriorpanda: Anyway, I proposed the backport already.10:56
*** salmankhan has joined #tripleo10:56
jaosoriorpanda: lots of changes are failing due to the puppet jobs. I see this for instance http://logs.openstack.org/38/432938/1/check/gate-puppet-tripleo-puppet-syntax-3-centos-7/9a8426b/console.html#_2017-02-13_09_25_45_767245 any idea what's up10:57
jaosorior?10:57
*** owalsh has quit IRC10:58
*** ccamacho has quit IRC10:59
*** sudipto has quit IRC11:01
*** sudipto_ has quit IRC11:01
*** ccamacho has joined #tripleo11:02
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Send mail tool  https://review.openstack.org/42334011:02
pandajaosorior: looking11:03
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Add host info collection to collect-logs  https://review.openstack.org/41322411:05
pandajaosorior: looks like infra problem, not sure we can do anything about it. investigating more.11:06
jaosoriorpanda: thanks11:06
*** zoli is now known as zoli|lunch11:09
*** ooolpbot has joined #tripleo11:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318711:11
*** ooolpbot has quit IRC11:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)11:11
*** owalsh has joined #tripleo11:12
sshnaidmpanda, you don't need any repo, just download packages and install them: https://paste.fedoraproject.org/556796/84525148/11:15
*** shardy has joined #tripleo11:16
*** owalsh_ has quit IRC11:16
*** owalsh_ has joined #tripleo11:16
*** stendulker has quit IRC11:17
*** owalsh__ has joined #tripleo11:17
d0ugaljpich: nice work on the UI translation btw!11:18
openstackgerritMerged openstack/tripleo-heat-templates master: FreeIPA: don't preprovision service principals if novajoin is enabled  https://review.openstack.org/42750511:18
*** openstackgerrit has quit IRC11:18
jpichd0ugal: florianf did the lion's share of the work :) I agree it is super nice! We're getting external contributions for translations too which is super exciting \o/ \o/11:19
d0ugalnice!11:19
*** owalsh has quit IRC11:19
*** openstackgerrit has joined #tripleo11:21
openstackgerritSaravanan KR proposed openstack/tripleo-quickstart master: WIP: Added DPDK config to create networks to host tenant as DPDK  https://review.openstack.org/43299711:21
*** owalsh_ has quit IRC11:21
*** owalsh has joined #tripleo11:21
*** akrivoka has joined #tripleo11:22
*** owalsh__ has quit IRC11:22
*** akrivoka has quit IRC11:22
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: WIP: DPDK Network config and env files for running DPDK in CI  https://review.openstack.org/43299911:25
*** akrivoka has joined #tripleo11:27
*** pgadiya has quit IRC11:31
*** owalsh_ has joined #tripleo11:31
*** owalsh__ has joined #tripleo11:33
*** owalsh has quit IRC11:34
*** owalsh_ has quit IRC11:36
*** yprokule has quit IRC11:37
*** hewbrocca is now known as hewbrocca_afk11:38
*** sudipto has joined #tripleo11:38
*** sudipto_ has joined #tripleo11:38
*** nmathew has quit IRC11:40
*** owalsh__ is now known as owalsh11:41
*** jkilpatr has joined #tripleo11:51
*** nyechiel_ has quit IRC11:54
*** thrash|g0ne is now known as thrash11:56
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Remove [heat,glance,ironic,cinder,keystone] db sync from ansible  https://review.openstack.org/43302111:57
matbumarios: hey i just saw your review: https://review.openstack.org/#/c/43302111:58
mariosmatbu: mcornea shardy we want to remove all of these right?  https://review.openstack.org/#/c/433021/111:59
mariosmatbu: hey, was there some reason we needed any of these?11:59
mariosmatbu: if so we should guard for the bootstrap node like for nova11:59
shardymarios: hey, yeah thanks for that, it was on my todo list before PTO :)11:59
matbumarios: yep probably11:59
shardymarios: the reason they were added to ansible tasks is previously we didn't run puppet before the converge11:59
mariosshardy: o/ welcome back. didn't want to harrass you too early today :)11:59
mariosshardy: right12:00
matbushardy: but i was wondering if we should keep it but just make a dedicated tags with it12:00
mariosshardy: i mean , yeah we removed already a bunch of those last week12:00
shardynow we do, I agree they can be removed, provided the puppet apply is confirmed as doing the right thing12:00
matbushardy: hey welcome back12:00
shardymatbu: thanks!12:00
shardyI'd say remove them, then we can add them back if needed for specific cases in future?12:00
mcorneamarios: when run by puppet do we know if they are run on a single node?12:00
shardyseems best to handle the db stuff in one place if possible12:01
mcorneashardy: welcome back :)12:01
mariosshardy: right, am trying to get to the puppet run :) keeps failing on these things last one was nova conductor so removed this one https://review.openstack.org/#/c/405241/36/puppet/services/nova-conductor.yaml@97 (actually both of them)12:01
shardymcornea: yes we look at the bootstrap node name12:01
shardyso that's another reason to remove them12:01
matbumarios: you are dpeloying with 3 controllers ?12:01
mariosmcornea: yeah exactly as shardy said... we should only run them here if we ned to loke for nova-api12:01
mariosmatbu: yeah12:01
mcorneacool, then I think we're ok. With ansible they were run on all 3 controller in parallel which didn't work12:02
shardyyeah, not having the bootstrap check in the ansible task was a mistake I made in the initial PoC12:02
*** ccamacho has quit IRC12:02
matbumarios: the puppet run was a bit unstable upstream last week, so you might hit some issues already fix upstream12:02
mariosshardy: and earlier it failed on the neutron db sync so posted https://review.openstack.org/#/c/432945/12:02
shardyso we can remove the tasks and I think puppet should do the right thing12:02
*** ccamacho has joined #tripleo12:03
openstackgerritNuman Siddique proposed openstack/tripleo-heat-templates master: ovn: Set force_config_drive nova param to true  https://review.openstack.org/43302512:04
*** psahoo has quit IRC12:05
EmilienMhello12:06
shardyhey EmilienM12:06
jaosoriorEmilienM: hey dude12:06
*** pkovar has joined #tripleo12:07
jaosoriorEmilienM: submitted this to address the nova-placement issue https://review.openstack.org/#/c/432864/12:07
EmilienMjaosorior: I saw, excellent. I vote for your solution, much cleaner12:08
EmilienMjaosorior: i'll abandon my patch12:08
*** ooolpbot has joined #tripleo12:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318712:11
*** ooolpbot has quit IRC12:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)12:11
jaosoriorEmilienM: by the way, puppet-tripleo patches seem to be failing with this http://logs.openstack.org/38/432938/1/check/gate-puppet-tripleo-puppet-syntax-3-centos-7/ab3a1e9/console.html#_2017-02-13_10_59_04_19815512:11
EmilienMjaosorior: it's an infra issue12:13
EmilienMthere is nothing we can do but report it on #openstack-infra12:13
*** milan has joined #tripleo12:13
jaosoriorEmilienM: by the way, I incorrectly commented the placement API's TLS options in haproxy when we stopped deploying nova-api over wsgi; could you check this out https://review.openstack.org/#/c/432938/ ?12:16
*** ansmith has joined #tripleo12:17
EmilienMjaosorior: done12:17
*** zoli|lunch is now known as zoli12:18
openstackgerritJulie Pichon proposed openstack/tripleo-ui master: Add i18n to Notifications  https://review.openstack.org/41946912:19
EmilienMcan someone review some patches we need in Ocata? https://review.openstack.org/#/c/432756/ https://review.openstack.org/#/c/432507/ https://review.openstack.org/#/c/432759/ https://review.openstack.org/#/c/432788/ https://review.openstack.org/#/c/432789/12:19
gfidentemarios about https://review.openstack.org/#/c/43302112:20
gfidentewasn't that running even before the packages were upraded anyway?12:20
mariosgfidente: no it was in step 5 packages are updated in step3 but anyway we don't want to run the dbsyncs here unless there is some reason/workaround12:23
mariosUPDATE_FAILED  Engine went down during stack12:23
marioserr.... wwai12:23
*** fultonj has joined #tripleo12:26
*** owalsh has quit IRC12:27
openstackgerritMarius Cornea proposed openstack/tripleo-docs master: Stop httpd before undercloud upgrade  https://review.openstack.org/43303212:27
mariosEmilienM: ack had a pass looks like jaosorior did too so they should be ready for rechecks/+A12:28
mariosEmilienM: well some of them anyway12:29
EmilienMmarios: thanks!12:32
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart master: Allow permissive access to non_root_user files  https://review.openstack.org/41819812:32
*** anton has quit IRC12:32
EmilienMmarios: shardy already added composable upgrades; you want more details?12:32
*** adarazs is now known as adarazs_lunch12:32
mariosEmilienM: yeah maybe i missed it cool np12:33
EmilienMmarios: https://review.openstack.org/#/c/432759/ also, please12:33
mariosdone EmilienM12:34
*** dougbtv has joined #tripleo12:35
EmilienMthx12:35
mariosshardy: is 'heat engine went down during stack update' always about memory/load? I mean assuming i've done nothing to my undercloud compared to earlier when i didn't hit this (i.e. was already upgraded etc)12:35
*** anton has joined #tripleo12:35
shardymarios: IME It normally means you ran out of memory12:35
marios15054:Feb 13 07:22:00 instack.localdomain kernel: Out of memory: Kill process 4552 (heat-engine) score 52 or sacrifice child12:35
shardyso yeah12:36
mariosshardy: yeah just confirmed it12:36
*** sdake_ has joined #tripleo12:36
mariosshardy: thanks sorry for noise... hmmm maybe i should make more swap then :/12:36
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Deploy Manila with CephMDS in scenario004  https://review.openstack.org/42338612:36
shardymarios: np, yeah maybe add some swap, and ensure things you don't need like the telemetry services are disabled in undercloud.conf12:37
shardymarios: how much ram has your undercloud vm got?12:37
mariosshardy: 8 ram and i have ... ah thats why12:38
mariosshardy: my swap got wiped when i rebooted earlier... :/12:38
shardyaha :)12:38
mariosthanks shardy :)12:39
*** sdake has quit IRC12:39
*** owalsh has joined #tripleo12:39
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Use Keystone internal endpoint instead of admin for nova-ironic  https://review.openstack.org/43303812:42
*** ChatSharp has joined #tripleo12:43
*** ChatSharp has left #tripleo12:46
jaosoriorgfidente: nice! I'm just investigating if there's any issue with how ironicclient uses the auth_url12:46
*** sdake_ is now known as sdake12:48
gfidentejaosorior you mean https://github.com/openstack/puppet-nova/blob/master/manifests/ironic/common.pp#L97 vs https://github.com/openstack/puppet-nova/blob/master/manifests/ironic/common.pp#L108 ?12:48
jaosoriorgfidente: no, I meant the keystone bits12:49
*** rbowen has quit IRC12:50
*** rhallisey has joined #tripleo12:51
jaosoriorgfidente: but it seems they do use keystoneauth and the loader; so it should be fine.12:52
*** lucasagomes is now known as lucas-hungry12:53
*** michapma_alt has joined #tripleo12:55
*** crabbytravvy has joined #tripleo12:55
*** karimb has quit IRC12:56
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Ansible role for built packages install  https://review.openstack.org/42686912:57
crabbytravvyI'm trying to install the undercloud on a baremetal machine and I'm getting an error.  Error: Copy stackrc failed.12:58
paramiteccamacho, Hey, so regarding ugrade tasks, I will remove updating packages. I have one question: Do I need to start service in step6 or this is done somewhere else too?12:59
*** bfournie has joined #tripleo13:00
shardyparamite: In most cases you shouldn't need to start the service as we run a puppet apply after the ansible steps, which starts all the services13:00
paramiteshardy, ack, thanks13:00
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Add host info collection to collect-logs  https://review.openstack.org/41322413:01
*** limao has joined #tripleo13:02
paramiteshardy, I saw in some service implementation that services are started, so I rather asked13:02
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Add upgrade tasks for opstools services  https://review.openstack.org/43151313:03
ccamachohey paramite the services are starting using puppet, here is the steps description https://github.com/openstack/tripleo-heat-templates/blob/b64f7fa512b4209e781d7159fe7d93bc3d37a99e/puppet/services/README.rst sorry for the delayed answer im a little bit feverish13:03
*** jayg|g0n3 is now known as jayg13:03
paramiteccamacho, sure, np. I read that, just wanted to be sure13:03
shardyparamite: yes previously we started services in step 6, but now only a few (DB, rabbit) are started in step413:03
ccamachoparamite cool :)13:03
paramiteshardy, ccamacho: I've updated the review https://review.openstack.org/43151313:04
*** dsariel has quit IRC13:04
shardyparamite: the problem is some services require reconfiguring after the package update so we have to start most services via puppet instead of directly13:04
*** dsariel_ has quit IRC13:04
paramiteah-hah13:04
*** rbowen has joined #tripleo13:05
crabbytravvyI'm trying to install the undercloud on a baremetal machine and I'm getting an error.  Error: Copy stackrc failed. The install of the undercloud works when I do it in the instack-virt-setup. Should I just deploy the undercloud in a VM?  Is this the right place to ask these questions?13:05
shardycrabbytravvy: yes we can try to help, but probably need more info, can you run the undercloud install with --debug and paste the detailed error somewhere?13:06
shardysounds like it could be a permissions or disk space issue on the baremetal machine?13:06
crabbytravvyshardy: I'm on a different network so I cannot paste anything.  Let me run that and see what outputs.13:07
mariosmatbu: i think there might be a problem with the bootstrap node check - i added a comment at https://review.openstack.org/#/c/405241/36/puppet/services/nova-api.yaml@19213:07
*** athomas has quit IRC13:07
openstackgerritMerged openstack/tripleo-heat-templates master: Remove the ansible neutron-api db sync as for other services  https://review.openstack.org/43294513:09
shardycrabbytravvy: the error is happening when it's trying to copy /root/stackrc to wherever you'r running the undercloud install (in ~/stack or somewhere else?)13:09
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Use Keystone internal endpoint instead of admin for nova-ironic  https://review.openstack.org/43303813:09
matbumarios: ack i'll look in a few13:09
shardycrabbytravvy: so I'd perhaps try copying the file manually and see if it fails13:09
matbui'm testing atm13:09
*** athomas has joined #tripleo13:09
*** shardy is now known as shardy_lunch13:10
*** ooolpbot has joined #tripleo13:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318713:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)13:11
*** ooolpbot has quit IRC13:11
*** nmathew has joined #tripleo13:12
crabbytravvyshardy: the file does not exist in /root. It appears to be failing to copy it from the template and then errors out on the copy from /root/ to /home/stack.  Then traceback error to the chown /home/stack/stackrc13:12
EmilienMjaosorior: https://review.openstack.org/#/c/432864/13:14
EmilienMjaosorior: I wonder why it fails13:14
*** nmathew- has joined #tripleo13:14
EmilienMjaosorior: I see the os_interface=internal13:14
mariosmatbu: cool, just a thought/not sure if it is right https://review.openstack.org/#/c/405241/36/puppet/services/nova-api.yaml@22513:15
jaosoriorEmilienM: well, the nova change merged today. I guess we need that to be packaged in RDO for it to be taken there, right?13:15
*** dprince has joined #tripleo13:15
EmilienMjaosorior: oh I see13:15
*** rlandy has joined #tripleo13:15
EmilienMjaosorior: we need a promotion, let me fix that13:15
*** dsariel has joined #tripleo13:16
*** trown|outtypewww is now known as trown13:16
EmilienMjaosorior: I hope the backport will make it on time13:16
*** nmathew has quit IRC13:18
*** dsariel_ has joined #tripleo13:18
*** rbowen has quit IRC13:18
*** rbowen has joined #tripleo13:21
*** kashyap has left #tripleo13:21
EmilienMsshnaidm: could you please review https://review.openstack.org/#/c/426370/ ?13:21
d0ugalEmilienM: Hey13:22
openstackgerritFlavio Percoco proposed openstack/python-tripleoclient master: Add `--keep-running` flag to undercloud deploy  https://review.openstack.org/41449013:23
EmilienMd0ugal: o/13:24
openstackgerritAlejandro Andreu proposed openstack/tripleo-docs master: Adds image building command when on stable branch  https://review.openstack.org/42627613:24
owalshmarios: yea... maybe add an allsteps tag?13:24
d0ugalEmilienM: I think there was an issue with Mistral last week (I was on PTO). What happened?13:25
owalshmarios: or move this up a level and always run it13:25
*** prateek_ has joined #tripleo13:26
mariosowalsh: yeah for now i'm testing the theory by duplicating it and going to rerun momentarily (i.e. also adding a step5 set_is_bootstrap_node etc13:27
EmilienMd0ugal: which one?13:28
d0ugalEmilienM: oh, there was multiple? :)13:28
EmilienMd0ugal: https://bugs.launchpad.net/mistral/+bug/166336813:28
openstackLaunchpad bug 1663368 in Mistral "mistral-api in WSGI fails with "cannot register CLI option" error" [Medium,Confirmed]13:28
EmilienMd0ugal: but it doesn't affect tripleo13:28
owalshmarios: ok, almost certainly the issue. I'll take another look after lunch13:28
EmilienMd0ugal: "only" puppet openstack CI13:29
d0ugalEmilienM: ah13:29
*** owalsh is now known as owalsh-afk13:29
mariosowalsh-afk: sounds good13:29
d0ugalEmilienM: I just seen your name and Mistral and assumed :)13:29
*** timothyb89_ has joined #tripleo13:29
matbumarios: so should we get the bootstrap_node for each step ?13:29
matbumarios: or there is another way, have a sort of "common" tag to avoid code duplication13:30
d0ugalEmilienM: thanks for handling it!13:30
mariosowalsh-afk: matbu: right we need to find some way that will survive across the steps. perhaps set a hiera fact on step 0 ?13:31
jaosoriorEmilienM: why doesn't it affect tripleo? how do we deploy mistral?13:31
*** owalsh has joined #tripleo13:31
mariosmatbu: yeah for now i am duplicating just to try and proceed (and confirm the theory ) but we should find a better way13:32
*** dr_gogeta86 has quit IRC13:32
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add optional Sphinx build verification  https://review.openstack.org/42586813:32
*** timothyb89 has quit IRC13:32
*** prateek has quit IRC13:32
*** dr_gogeta86_ has joined #tripleo13:32
*** owalsh_ has joined #tripleo13:32
*** lblanchard has joined #tripleo13:33
matbumarios: ack i will try something13:33
*** owalsh-afk has quit IRC13:34
openstackgerritMerged openstack/tripleo-docs master: Stop httpd before undercloud upgrade  https://review.openstack.org/43303213:34
*** dsariel has quit IRC13:34
*** dsariel_ has quit IRC13:35
sshnaidmEmilienM, done13:36
*** prateek has joined #tripleo13:36
*** owalsh has quit IRC13:36
*** adarazs_lunch is now known as adarazs13:36
*** prateek_ has quit IRC13:36
*** owalsh has joined #tripleo13:37
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates master: Add nova service support for composable upgrades  https://review.openstack.org/40524113:37
*** owalsh_ has quit IRC13:37
*** rbowen has quit IRC13:37
jaosoriorEmilienM: know anybody at infra that can help with the mirror issues? tried pinging there with no avail13:37
matbumarios: check the last  update of the patch13:37
mariosmatbu: ack looking13:37
matbumarios: if you are able to test this way13:38
mariosmatbu: yeah will do but on the next run13:38
*** prateek has quit IRC13:38
matbuim upgrade in progress so i was able to test it13:38
matbumarios: ack no pb13:38
*** owalsh_ has joined #tripleo13:38
*** dr_gogeta86_ is now known as dr_gogeta8613:38
*** dr_gogeta86 has joined #tripleo13:38
EmilienMjaosorior: pabelanger13:38
*** prateek has joined #tripleo13:38
*** rbowen has joined #tripleo13:38
mariosmatbu: hmm cool it makes sense ('common' tag)13:39
*** owalsh__ has joined #tripleo13:39
matbumarios: so in theory, the common tag will be used for each stepX13:39
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Adding skip_file in the list of collected logs  https://review.openstack.org/43306013:40
matbuim testing the removal of the nova-api restart by using the --transport-url directly in the nova-manage command13:41
*** yprokule has joined #tripleo13:41
*** owalsh has quit IRC13:42
*** ccamacho is now known as ccamacho|lunch13:42
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: nova-placement: support upgrade  https://review.openstack.org/43278813:42
jaosoriorbeekneemech: around yet?13:42
*** dprince has quit IRC13:42
*** dcritch has joined #tripleo13:42
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Support exclude list for logs collecting  https://review.openstack.org/42539513:43
*** owalsh_ has quit IRC13:43
skramajai am facing an issue when executing this command in quickstart setup - mistral execution-create tripleo.plan_management.v1.get_passwords '{"container":"overcloud"}'13:43
skramajaFailed to run action [action_ex_id=f5d036ec-7f1c-46bb-b604-944cf2ef5ba6, action_cls='<class 'mistral.actions.action_factory.MistralAction'>', attributes='{'client_method_name': 'environments.get'}', params='{'name': 'overcloud'}']13:43
skramajaMistralAction.environments.get failed: <class 'requests.exceptions.ConnectionError'>: HTTPConnectionPool(host='localhost', port=8989): Max retries exceeded with url: /v2/environments/overcloud (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x6d7d350>: Failed to establish a new connection: [Errno 111] ECONNREFUSED',))13:43
skramajabasically mistral.environment_get is failing13:43
skramajaany known issue?13:43
*** owalsh__ has quit IRC13:44
d0ugalskramaja: this is a bad error from Mistral - it means that the credentials are wrong or missing13:44
d0ugalskramaja: i.e. I get it when I forget to source stackrc first.13:44
d0ugalskramaja: IIRC there is a Mistral bug, I'll try and find it...13:44
jaosoriorpanda, sshnaidm: I need to update some package (as a workaround) for the overcloud images in CI. Any idea where I could do that?13:45
skramajad0ugal: i have source stackrc because my deployment is succesful - related to https://review.openstack.org/#/c/427044/13:45
skramajad0ugal: by just removing https://github.com/openstack/tripleo-common/blob/master/workbooks/plan_management.yaml#L257 it is working fine.13:46
sshnaidmjaosorior, inside the image?13:46
d0ugalskramaja: that is strange.13:46
*** akrzos-pto is now known as akrzos13:48
d0ugalskramaja: the traceback is here: http://logs.openstack.org/44/427044/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/c344990/logs/undercloud/var/log/mistral/executor.txt.gz#_2017-02-13_07_15_04_77813:48
d0ugalskramaja: I don't really understand why, but I guess it is something related to auth given that is when I see the same error13:49
skramajaok.. thanks d0ugal13:49
mcorneamarios: matbu shardy_lunch how can I disable puppet run on compute nodes during upgrade? I'm failing during upgrade because puppet modules were not updated: Error: Could not find class ::tripleo::profile::base::time::ntp for overcloud-novacompute-0.localdomain on node overcloud-novacompute-0.localdomain13:50
weshayarxcruz, what was the fix for stackwiz on centos?  EmilienM may be interested in hearing13:50
*** jpena is now known as jpena|lunch13:50
d0ugalskramaja: I am still looking :)13:50
jaosoriorsshnaidm: right, so I need to update the cloud-init for the images.13:50
*** morazi has joined #tripleo13:50
skramajad0ugal: ok..13:51
arxcruzweshay: install pip, it was merged, I'll trow a run soon to double check13:51
jaosoriorsshnaidm: was thinking of using this http://download.eng.bos.redhat.com/brewroot/packages/cloud-init/0.7.6/9.el7/x86_64/cloud-init-0.7.6-9.el7.x86_64.rpm13:51
arxcruzweshay: https://review.openstack.org/#/c/430344/13:51
mariosshardy_lunch: mcornea: this from matbu should do that i think see https://review.openstack.org/#/c/431398/1/environments/major-upgrade-composable-steps.yaml13:52
mariosmcornea: but yeah we shouldn't be running puppet on those nodes (the ones that are operator driven upgrade with the disable_upgrade_deployment set to true)13:53
*** karimb has joined #tripleo13:53
mcorneamarios: thanks, I'll try it13:53
pandajaosorior: internal link. We are doing something similar for undercloud here https://review.openstack.org/430688, but in addition, you'll have to force image rebuild13:53
*** tzumainn has joined #tripleo13:53
numanshello core reviewers, it would be super nice if you can look into these OVN patches - https://review.openstack.org/#/c/397674/, https://review.openstack.org/#/c/402293/ and https://review.openstack.org/#/c/397687/13:53
sshnaidmjaosorior, you can do it here: https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/common_functions.sh#L10713:54
*** bvandenh has quit IRC13:54
sshnaidmjaosorior, after "yum update" there13:54
*** suuuper has quit IRC13:54
jaosoriorsshnaidm: awesome! but; is that run even if an image build is not going on? (when using cached images)13:55
EmilienMarxcruz, weshay: good news13:55
sshnaidmjaosorior, yeah, always13:55
EmilienMarxcruz: can you show me the fix please? I also want to apply it to Puppet CI13:55
arxcruzEmilienM: https://review.openstack.org/#/c/430344/13:55
openstackgerritMerged openstack/tripleo-quickstart-extras master: Update introspection command to introspect only manageable nodes  https://review.openstack.org/42816013:56
EmilienMarxcruz: well, that doesn't fix openstack infra nodes13:56
EmilienMarxcruz: stackviz is already deployed on the nodepool images13:56
EmilienMarxcruz: but well...13:57
*** morazi has quit IRC13:57
*** yprokule has quit IRC13:57
pandajaosorior: that is run especially when image is not built13:57
arxcruzEmilienM: so I might understood wrongly, stackviz was failing on centos ci only, all jobs upstream are working as far as I can tell13:57
arxcruztoday I got stackviz results for some runs that I've checked13:57
jaosoriorpanda: that's fine in my case.13:58
EmilienMarxcruz: because upstream are using ubuntu nodes13:58
EmilienMarxcruz: I haven't seen an centos7 upstream job with stackviz13:58
*** sasha2 has joined #tripleo13:58
arxcruzEmilienM: can you point me one centos7 job that it's failing with stackviz ?13:58
EmilienMsure, a sec13:59
EmilienMarxcruz: http://logs.openstack.org/15/424915/20/check/gate-puppet-openstack-integration-4-scenario001-tempest-centos-7/535986f/console.html#_2017-02-12_20_25_12_02809814:01
EmilienMarxcruz: https://github.com/openstack/puppet-openstack-integration/blob/master/copy_logs.sh#L23414:01
EmilienMwhich means stackviz wasn't built14:01
*** Goneri has joined #tripleo14:01
*** noslzzp has joined #tripleo14:01
EmilienMnow let me show you image build failure14:01
EmilienMwait, where are images now? i was on nodepool.openstack.org before14:02
radezEmilienM: do the upgrade steps look ok then for tacker?14:03
EmilienMshardy_lunch, marios: can you review https://review.openstack.org/#/c/432417/ please? I'm not sure about the step5 thing14:04
*** shardy_lunch is now known as shardy14:04
*** beagles is now known as beagles-mtg14:05
shardyEmilienM: Yeah we agreed earlier to remove all the DB syncs and let puppet handle it14:05
shardyso the step 5 can probably be removed14:05
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: Installs openssh packages that try to workaround sshd start problem  https://review.openstack.org/43068814:05
openstackgerritMerged openstack/tripleo-heat-templates master: Fix Neutron region in nova.conf  https://review.openstack.org/43275614:05
*** suuuper has joined #tripleo14:06
EmilienMshardy: thanks for feedback cc radez ^14:06
mariosEmilienM: ack added comment there as shardy said14:06
EmilienM++14:06
radezcool, thx guys14:07
*** noslzzp has quit IRC14:07
honzajtomasek: jpich: this patch is high priority https://review.openstack.org/#/c/425979/14:08
*** noslzzp has joined #tripleo14:08
openstackgerritDan Radez proposed openstack/tripleo-heat-templates master: Adding upgrade_tasks to tacker  https://review.openstack.org/43241714:08
honzajpich: given that the patch has a bunch of python/infra code, and florianf is out, i thought you could vote on this :)14:09
openstackgerritMerged openstack/python-tripleoclient stable/ocata: Fix stack delete client  https://review.openstack.org/43250714:09
openstackgerritMerged openstack/tripleo-heat-templates master: Add missing release notes for Ocata  https://review.openstack.org/43278914:09
jpichhonza: Looking now!14:09
openstackgerritFlavio Percoco proposed openstack/tripleo-quickstart-extras master: WIP: Use openstack deploy to install the undercloud  https://review.openstack.org/41904014:09
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy novajoin in the TLS-everywhere job  https://review.openstack.org/42748114:09
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job (novajoin)  https://review.openstack.org/42748214:09
*** rbrady has joined #tripleo14:09
*** rbrady has quit IRC14:09
*** rbrady has joined #tripleo14:09
*** lucas-hungry is now known as lucasagomes14:10
*** dprince has joined #tripleo14:10
*** morazi has joined #tripleo14:10
jpichhonza: Btw you said you'd made too many changes to vote on it yourself, but I think it's fine, you only modified a couple of lines right?14:11
*** ooolpbot has joined #tripleo14:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318714:11
*** ooolpbot has quit IRC14:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)14:11
honzajpich: *shrug*14:11
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras master: Fix overcloud-scale failure msg and regression  https://review.openstack.org/42535214:11
*** amoralej is now known as amoralej|lunch14:11
jpichhonza: Did you get to the bottom of the version thing you were looking into on Friday?14:14
honzajpich: yes! pbr indeed14:14
honzajpich: outlined here http://docs.openstack.org/developer/pbr/#version14:14
*** jmelvin has joined #tripleo14:14
*** salmankhan1 has joined #tripleo14:14
*** pradk has joined #tripleo14:15
jpichhonza: Cool!14:16
*** cdearborn has joined #tripleo14:16
*** salmankhan has quit IRC14:17
*** salmankhan1 is now known as salmankhan14:17
openstackgerritAna Krivokapic proposed openstack/tripleo-heat-templates master: Add plan-environment.yaml  https://review.openstack.org/41738514:17
*** nyechiel_ has joined #tripleo14:20
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Switch to net-config-multinode  https://review.openstack.org/42637214:22
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Ensure gate jobs verify sphinx output  https://review.openstack.org/42593614:22
openstackgerritDan Radez proposed openstack/tripleo-heat-templates master: Adding upgrade steps to congress service  https://review.openstack.org/43308014:23
*** ccamacho|lunch is now known as ccamacho14:23
jaosorior EmilienM commented14:25
EmilienMjaosorior: thx14:25
crabbytravvyshardy:  One thing that I'm noticing is when the instack command runs profiling for extra-data.d and install.d is nothing on the baremetal and on the vm side there are entries.14:27
*** agurenko has quit IRC14:28
*** rhefner has joined #tripleo14:28
*** salmankhan has quit IRC14:28
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: Add last missing release notes before Ocata release  https://review.openstack.org/43278514:30
openstackgerritAna Krivokapic proposed openstack/tripleo-heat-templates master: Add plan-environment.yaml  https://review.openstack.org/41738514:30
*** ealcaniz has quit IRC14:30
dtantsurfolks, is gate-tripleo-ci-centos-7-ovb-updates working now? failed for me several times in row, I wonder who is to blame14:30
*** beagles-mtg has quit IRC14:30
*** nmathew- has quit IRC14:31
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Use Keystone internal endpoint instead of admin for nova-ironic  https://review.openstack.org/43303814:31
EmilienMdtantsur: not yet14:31
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Add build-images role  https://review.openstack.org/41433614:31
dtantsurack, thanks14:32
EmilienMdtantsur: it will with https://review.openstack.org/#/c/432864/ and a CI promotion14:32
EmilienMdtantsur: so in ~4 hours i think14:32
dtantsurcool14:32
*** jmelvin has quit IRC14:32
*** twi99y__ has quit IRC14:33
*** twi99y has joined #tripleo14:34
arxcruzEmilienM: ?14:34
openstackgerritAna Krivokapic proposed openstack/tripleo-common master: Enhance plan creation and update with plan-environment  https://review.openstack.org/41416914:35
EmilienMarxcruz: something is wrong with stackviz in the nodepool image and I haven't figured why14:35
EmilienMarxcruz: what you did in oooq is an acceptable workaround14:35
arxcruzEmilienM: do you have the logs from nodepool ?14:36
EmilienMno14:36
EmilienMthey used to be on nodepool.openstack.org14:36
EmilienMbut not anymore it seems14:36
EmilienMand i'm in a mtg now14:36
arxcruzEmilienM: okay, we can talk later :)14:36
*** amoralej|lunch is now known as amoralej14:37
*** jmelvin has joined #tripleo14:37
*** dsariel has joined #tripleo14:39
*** Guest69121 has joined #tripleo14:39
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy novajoin in the TLS-everywhere job  https://review.openstack.org/42748114:39
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job (novajoin)  https://review.openstack.org/42748214:39
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add scenario005 scenario  https://review.openstack.org/41809914:40
*** cylopez has left #tripleo14:41
*** abregman has joined #tripleo14:41
*** jmelvin has quit IRC14:42
*** aufi has quit IRC14:42
*** salmankhan has joined #tripleo14:44
*** karimb_ has joined #tripleo14:44
*** bfournie1 has joined #tripleo14:45
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Send mail tool  https://review.openstack.org/42334014:45
*** bfournie has quit IRC14:45
*** karimb has quit IRC14:48
*** nyechiel_ has quit IRC14:48
*** pcaruana has quit IRC14:50
openstackgerritMerged openstack/tripleo-quickstart-extras master: Adding skip_file in the list of collected logs  https://review.openstack.org/43306014:50
*** nyechiel has joined #tripleo14:51
*** skramaja is now known as skramaja_afk14:51
*** jpena|lunch is now known as jpena14:52
d0ugalEmilienM: when do we branch tripleo-common?14:54
EmilienMd0ugal: in the same time as other projects14:54
EmilienMd0ugal: when we'll release RC114:54
EmilienMd0ugal: I sent an email about RC1, it should happen this week if we don't have another blocker in the pipe14:54
*** jmelvin has joined #tripleo14:55
d0ugalEmilienM: cool, thanks :)14:55
* d0ugal is still digging through emails14:55
EmilienMd0ugal: I hope before Friday14:55
*** ealcaniz has joined #tripleo14:55
*** pcaruana has joined #tripleo14:55
*** jcoufal has joined #tripleo14:56
*** myoung|pto is now known as myoung14:56
*** aufi has joined #tripleo14:56
*** nyechiel has quit IRC14:57
*** egafford has joined #tripleo14:57
*** nyechiel has joined #tripleo14:57
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Skipping tests requiring cinder-backup  https://review.openstack.org/43309914:58
*** limao has quit IRC14:59
*** limao has joined #tripleo15:00
*** udesale has joined #tripleo15:03
mcorneamarios: matbu shardy nova-placement-api is not installed during upgrade so puppet fails with Error: /Stage[main]/Nova::Wsgi::Apache_placement/Openstacklib::Wsgi::Apache[placement_wsgi]/File[placement_wsgi]: Could not evaluate: Could not retrieve information from environment production source(s) file:/usr/bin/nova-placement-api15:03
*** nyechiel has quit IRC15:03
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Skipping tests requiring cinder-backup  https://review.openstack.org/43309915:05
jtomasekjrist, honza, jpich: who's in to update releasenotes patch with latest review comments? I think it should be fixed before merging15:05
jtomasekI can do it too if nobody wants to15:05
*** dmarlin has joined #tripleo15:06
jpichjtomasek: .placeholder seems to have become the convention for the reno patches, fwiw15:06
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Use kwargs to pass in 'error' to a Mistral Result  https://review.openstack.org/43310615:06
jristjtomasek: which latest?15:06
jtomasekjpich: argh:)15:06
jtomasekbeth, me and jpich commented15:06
jtomasekjrist: ^15:06
jristah15:07
jristI stop staring at it for 5 minutes15:07
jristjtomasek: yeah .placeholder is the convention15:07
jristsorry15:07
honzai can make changes15:07
jtomasekok, fair, a wrong one but fine, haha15:08
*** beekneemech is now known as bnemec15:08
jristhonza: why don't you since you have latest15:08
honzaok15:08
jristhonza: that way I dont' need to yell at gerrit about the ctrl-c issue it has15:08
jristYOU CAN'T15:08
honzawhat changes though?  only whitespace?15:08
jristjust that one little nit ya15:09
honzak15:09
jristor don't worry about it15:09
jristhaha15:09
*** hafe has joined #tripleo15:09
jristbtw, honza I think you can still vote15:09
openstackgerritDan Prince proposed openstack/puppet-tripleo master: Configure authtoken in Nova Placement  https://review.openstack.org/43310915:09
jristsince you only contributed the removal of code :)15:09
honzajrist: i pointed that one out myself but didn't want to waste time :)15:09
jristhonza: then I wouldn't bother15:10
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add release notes for Ocata 3.0.0  https://review.openstack.org/42597915:10
jristhaha too late15:10
honzabahaha15:10
jtomasekhonza, jrist: I think also tox.ini should point to the tools/ script as jpich noted15:10
jristhonza: ^15:10
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Configure authtoken in nova-placement api service  https://review.openstack.org/43311115:10
*** ooolpbot has joined #tripleo15:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318715:11
*** ooolpbot has quit IRC15:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)15:11
hafelocal_gb in the inspection data, how is it determined?15:11
hafemy server has 3 disks and it seems to pick the smallest15:11
*** Guest69121 is now known as beagles15:11
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add release notes for Ocata 3.0.0  https://review.openstack.org/42597915:12
mariosmcornea: hmmi thought that stuff was landed already (there is puppet and tht side for it)15:12
hafeshould perhaps ask in ironic, sorry15:12
*** jcoufal_ has joined #tripleo15:12
*** owalsh_ has joined #tripleo15:12
bnemechafe: The device is selected based on this: http://docs.openstack.org/developer/tripleo-docs/advanced_deployment/root_device.html#setting-root-device-hints-automatically15:12
*** rbowen has quit IRC15:12
honzajrist: jtomasek: jpich: done15:13
*** rbowen has joined #tripleo15:13
*** owalsh_ is now known as owalsh15:13
jristthanks honza15:13
jpichhonza: Thanks! It'll give a better error message for some issues (e.g. generating notes without having committed then first)15:13
jtomasekhonza: thanks15:14
honzagoing once, going twice...15:14
*** jcoufal has quit IRC15:15
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add missing TripleO services to ci/multinode  https://review.openstack.org/43312615:17
*** athomas has quit IRC15:18
*** prateek has quit IRC15:18
*** athomas has joined #tripleo15:18
mcorneamarios: is there a review for it? it's only the package which doesn't get installed15:18
openstackgerritOpenStack Proposal Bot proposed openstack/os-cloud-config master: Updated from global requirements  https://review.openstack.org/42327615:19
*** saneax is now known as saneax-_-|AFK15:21
jristhonza: can you +2 that patch and let's go15:21
honzajrist: i did :)15:21
honzajrist: we need workflow and jenkins15:22
jristjtomasek: ^15:22
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: nova: move placement credentials config at step 3  https://review.openstack.org/43251515:22
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/43211815:22
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/43211915:23
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient stable/ocata: stable/ocata CI run - do not merge  https://review.openstack.org/42623115:23
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-validations master: Updated from global requirements  https://review.openstack.org/42462815:23
mariosmcornea: i can't quickly find it from the git log... but, if it is a case of a missing package then perhaps that is something we need to handle with the upgrade init/in an earlier step15:24
mcorneamarios: yeah, I think so. or maybe part of the nova api upgrade?15:27
EmilienMhonza: http://logs.openstack.org/79/425979/24/check/gate-tripleo-ui-releasenotes/812225f/console.html#_2017-02-13_15_17_39_91745615:28
honzaEmilienM: checking15:28
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add release notes for Ocata 3.0.0  https://review.openstack.org/42597915:29
hafebnemec: thx, I have now set a root_device and am re-running introspection15:29
EmilienMhonza: should be better :D15:30
jristhonza: what now? :)15:30
honzaEmilienM: TIL how to view the results of a check/gate thing before the others finish and the overall result is published to the patch15:30
EmilienMhonza: :D15:31
jristwhoa how15:31
honzajrist: had to chmod +x the script15:31
jristcray15:31
honzajrist: computers15:32
jristsrs15:32
jristhttp://www.internetslang.com/CRAY-meaning-definition.asp15:32
*** rajinir_ has joined #tripleo15:34
*** charliejllewelly has joined #tripleo15:36
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates master: Add nova service support for composable upgrades  https://review.openstack.org/40524115:38
openstackgerritMerged openstack/tripleo-quickstart master: Ensure gate jobs verify sphinx output  https://review.openstack.org/42593615:38
*** jaganathan has quit IRC15:39
honzajrist: passed this time, so yay15:39
jristbeep beep!15:39
*** owalsh_ has joined #tripleo15:41
mcorneamarios: Stack overcloud UPDATE_COMPLETE , I told you I was feeling lucky today :)15:41
matbumcornea: with puppet run ?15:41
shardymcornea: \o/ :)15:41
mcorneamatbu: well, with major-upgrade-composable-steps.yaml passed, I think puppet also run15:42
matbucool then :)15:43
EmilienMwoot woot15:44
*** owalsh has quit IRC15:44
openstackgerritMerged openstack/tripleo-heat-templates master: Remove [heat,glance,ironic,cinder,keystone] db sync from ansible  https://review.openstack.org/43302115:44
*** timothyb89_ is now known as timothyb8915:45
mariosmcornea: \o/15:45
mariosmcornea: great stuff :)15:45
mcorneamoving to computes15:46
mariosmcornea: on monday the 13th no less15:46
*** aufi has quit IRC15:49
*** rbowen has quit IRC15:50
-openstackstatus- NOTICE: We are currently investigating an issue with our AFS mirrors which is causing some projects jobs to fail. We are working to correct the issue.15:51
*** owalsh_ is now known as owalsh15:51
EmilienMparamite: is there a better way to check service status on https://review.openstack.org/#/c/431513 ?15:54
openstackgerritMerged openstack/tripleo-heat-templates master: placement: switch service to use NovaPlacementNetwork  https://review.openstack.org/43275915:54
paramiteEmilienM, I've used the suggested method15:55
EmilienMparamite: suggested from where?15:55
paramiteEmilienM, check review comments15:55
paramiteEmilienM, suggested by ccamacho15:55
*** milan has quit IRC15:56
*** milan has joined #tripleo15:56
chemparamite: EmilienM yeah that's what is used for check step0.  The problem here is that there is no proper way to check service status in ansible "by design"15:57
hafebnemec: root device hint using wwn worked before introspection15:57
EmilienMchem, paramite: works for me ! TIL15:57
*** yamahata has joined #tripleo15:59
paramiteEmilienM, thx15:59
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK  https://review.openstack.org/43027716:00
*** abregman has quit IRC16:00
*** dsneddon_afk is now known as dsneddon16:02
mcorneagfidente: shardy ceph osd nodes should be upgraded one by one, right? they shouldn't run the upgrade tasks in parallel?16:02
mariosmcornea: they use a heat native batch mode gfidente added it16:03
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates master: Add nova service support for composable upgrades  https://review.openstack.org/40524116:03
shardyyeah they should be upgraded one by one16:03
shardybecause we use upgrade_batch_tasks vs upgrade_tasks16:03
mcorneagreat16:04
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/ceph-osd.yaml#L4816:04
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/ceph-mon.yaml16:04
shardyyou should see a rolling upgrade of all the nodes running the mon service, then a rolling upgrade of all the OSDs16:05
shardythen after that the normal openstack service upgrades16:05
honzajtomasek: EmilienM: tripleo-ui release notes passes CI, please +2 and +1 workflow https://review.openstack.org/#/c/425979/2516:05
*** jcoufal_ has quit IRC16:05
*** jcoufal has joined #tripleo16:06
*** rbowen has joined #tripleo16:06
jtomasekhonza: on it16:06
EmilienMboom16:06
mcorneashardy: I wonder if we could do this for other services such as neutron l3 agent so we don't interrupt network connectivity16:07
*** dtantsur is now known as dtantsur|mtg16:08
openstackgerritMerged openstack-infra/tripleo-ci master: toci_gate_test: allow to run upgrade jobs for scenarios  https://review.openstack.org/42637016:09
EmilienMmcornea: yes16:09
EmilienMmcornea: all stateful services I would say16:10
mcorneaEmilienM: yes, I need to see which are these16:11
*** ooolpbot has joined #tripleo16:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318716:11
*** ooolpbot has quit IRC16:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)16:11
shardymcornea: yeah agreed - if we can identify other services which can safely be upgraded in batches it's pretty easy to change them16:11
shardyI just wasn't sure on the subset of services we could upgrade like this yet16:11
mcorneashardy: ok, I'll try to track them, the l3 agent is what came first to mind16:13
*** abregman has joined #tripleo16:13
EmilienMjaosorior: https://review.openstack.org/#/c/432420/116:14
EmilienMisn't it risky to do it at this stage?16:15
EmilienMwell, I see upgrade job is passing16:15
jaosoriorEmilienM: we can wait till pike16:15
openstackgerritMerged openstack/tripleo-heat-templates master: nova-placement: support upgrade  https://review.openstack.org/43278816:15
openstackgerritMerged openstack/tripleo-heat-templates master: Added further security functionality in release notes.  https://review.openstack.org/42866616:15
*** tremble has quit IRC16:15
*** ealcaniz has quit IRC16:16
EmilienMshardy: any thoughts on https://review.openstack.org/#/c/432420 ?16:16
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Remove duplicated release notes  https://review.openstack.org/43315916:18
EmilienMjaosorior: the upgrade seems to work. But at this stage, maybe wait is the safest option.16:18
*** rcernin has quit IRC16:19
EmilienMjaosorior: let's merge it once we release ocata16:19
*** ramishra has quit IRC16:19
EmilienMshardy, sshnaidm: when you have time this week, I would need your eyes on https://review.openstack.org/#/c/42637516:20
EmilienMshardy, sshnaidm: for cleanup and also it helps to move forward16:20
*** pcaruana has quit IRC16:20
*** shardy has quit IRC16:21
*** shardy has joined #tripleo16:22
EmilienMtherve: about https://review.openstack.org/#/c/433091 - is swift going to become a reference to deploy zaqar? or still mongodb?16:25
EmilienMtherve: i'm asking to know if 1. we need to change the default in tripleo 2. we need to change the default in puppet-openstack-integration to test correct use cases16:26
*** jcoufal_ has joined #tripleo16:28
jtomasekhonza: would you please mind looking at this one, I'd like to get it in before rc1 https://review.openstack.org/43151516:29
*** jcoufal has quit IRC16:30
*** zoli is now known as zoli|gone16:32
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Installs openssh packages that try to workaround sshd start problem  https://review.openstack.org/43068816:32
bnemecEmilienM: jaosorior: I commented on https://bugs.launchpad.net/tripleo/+bug/1663187  I think we're going to need a change to use the new nova option on the tripleo side before we'll get a promotion.16:33
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)16:33
*** rbowen has quit IRC16:33
*** pcaruana has joined #tripleo16:34
*** jcoufal has joined #tripleo16:34
EmilienMbnemec: why that?16:34
EmilienMbnemec: we've got promotion 1/2h ago16:35
bnemecEmilienM: Because nova didn't change the default.  We still need to override it.16:35
EmilienMbnemec: default works for ovb except updates job16:35
bnemecEmilienM: Is the updates job not voting on promotions?16:35
EmilienMI did recheck on jaosorior's patch16:35
EmilienMbnemec: yes it is16:35
bnemecThen how did we promote if it's not passing?16:35
EmilienMotherwise we would have not had promotion16:35
EmilienMbnemec: yes it is sorry I mean yes it's not voting16:36
EmilienMwe only use ovb-ha and non-ha16:36
openstackgerritJulie Pichon proposed openstack/tripleo-ui master: Add i18n to nodes page and buttons  https://review.openstack.org/43317216:36
EmilienM(sorry for confusion)16:36
bnemecUgh, that's terrible.16:36
EmilienMbnemec: we plan to improve that after ocata release, by adding scenarios16:36
EmilienMsshnaidm: ^ we could also add ovb-updates16:37
bnemecYeah, updates should be voting anyway.16:37
*** jcoufal_ has quit IRC16:37
bnemecIt's testing things that the scenarios don't cover.16:37
EmilienMbnemec: I agree, Ipv6 mostly16:37
*** abregman is now known as abregman|afk16:38
bnemecEmilienM: Okay, so https://review.openstack.org/#/c/432419/ should fix this?16:40
*** iranzo has quit IRC16:40
EmilienMshardyr, jaosorior, bnemec: could you review https://review.openstack.org/#/c/426372/ please? it would help me to make progress on upgrade ci jobs for scenarios16:40
EmilienMbnemec: not this one16:40
crabbytravvyshardy: I figured it out the /tmp dir had noexec on it16:40
EmilienMoh wait16:40
EmilienMbnemec: yes this one16:41
EmilienMbut jaosorior changed it for all services16:41
EmilienMjaosorior: https://review.openstack.org/#/c/432419/ - is it safe to do it for all services at this stage of cyclce?16:41
EmilienMjaosorior: I think it's good16:42
sshnaidmEmilienM, do you have 4nodes job running anywhere?16:42
EmilienMsshnaidm: https://review.openstack.org/#/c/418099/16:42
EmilienMsshnaidm: experimental pipeline16:43
sshnaidmEmilienM, ack16:43
shardycrabbytravvy: aha, good to hear you figured it out :)16:43
openstackgerritJulie Pichon proposed openstack/tripleo-ui master: Add i18n to Nodes table  https://review.openstack.org/43317916:43
bnemecEmilienM: I think we at least need a release note if we make that change.16:43
EmilienMbnemec: I agree, i'll propose it on top of this patch, so we can have ovb-updates back on stage16:44
bnemecEmilienM: +116:44
crabbytravvyshardy: thank you for the help earlier.16:44
charliejllewellyHey anyone able to give me any pointers to create a random parameter in heat to force updates? randomstring doesn't recreate on an update without a change top salt which kinda misses what I want16:45
*** rbowen has joined #tripleo16:46
*** udesale has quit IRC16:47
ccamachohey paramite around?16:48
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add release note for services endpoint change  https://review.openstack.org/43318116:48
paramiteccamacho, yup16:48
EmilienMjaosorior, bnemec ^16:48
ccamachoparamite we dont have https://review.openstack.org/#/c/431513/4/puppet/services/metrics/collectd.yaml in newton, so how can we upgrade it to ocata ??16:49
mcorneashardy: for compute nodes I see yum update completed fine but it exits with: Error: Evaluation Error: Error while evaluating a Function Call, Could not find data item step in any Hiera data file and no default supplied at /etc/puppet/modules/tripleo/manifests/profile/base/ceph/client.pp:27:11 on node overcloud-novacompute-0.localdomain16:49
mcorneashardy: I ran upgrade-non-controller.sh --upgrade overcloud-novacompute-016:50
*** dsariel has quit IRC16:50
ccamachoparamite, right?16:51
paramiteccamacho, right16:51
ccamachocool, mind to remove that service?? Ill remove the -2 once the other 2 services are fine :)16:52
*** saneax-_-|AFK is now known as saneax16:52
paramiteccamacho, ack, gimme a sec16:52
ccamachoparamite I just realized because I was locally testing it and I wasn't able to get the service, thanks man :)16:53
*** jcoufal_ has joined #tripleo16:53
*** hewbrocca_afk is now known as hewbrocca16:54
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Add upgrade tasks for opstools services  https://review.openstack.org/43151316:54
paramiteccamacho, no problem. Thank you16:54
openstackgerritBen Nemec proposed openstack/instack-undercloud master: Bump required undercloud memory to 8 GB  https://review.openstack.org/43239516:54
*** sdake_ has joined #tripleo16:55
*** tesseract-RH has quit IRC16:55
*** jcoufal has quit IRC16:56
*** sdake__ has joined #tripleo16:58
*** dtantsur|mtg is now known as dtantsur16:58
*** pcaruana has quit IRC16:58
jaosoriorsshnaidm: hey dude, so tried installing the package via that function, but I get this http://logs.openstack.org/82/427482/16/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/ddd56c6/console.html#_2017-02-13_16_07_23_287324 . In this commit https://review.openstack.org/#/c/427481/16:58
*** pcaruana has joined #tripleo16:59
*** sdake has quit IRC16:59
jaosoriorsshnaidm: any idea where I messed it up?16:59
*** leanderthal is now known as leanderthal|afk16:59
jristEmilienM: anything else you need for the release from us?16:59
jristtripleo-ui that is16:59
*** sdake_ has quit IRC17:00
sshnaidmjaosorior, you need to use chroot to install on image: sudo chroot $MOUNTDIR /bin/yum install -y $TRIPLEO_ROOT/tripleo-ci/packages/cloud-init-0.7.6-9.el7.x86_64.rpm17:00
sshnaidmjaosorior, like in line above17:01
EmilienMjrist: https://github.com/openstack/tripleo-ui/blob/master/package.json is good?17:01
jristhonza: ^17:01
jristEmilienM: I think it needs to be bumped to 3.0.0 for Ocata RC1?17:02
EmilienMI think we need 2.0.217:02
jaosoriorsshnaidm: thanks dude17:02
jristrelease notes are 3.0.017:02
sshnaidmjaosorior, do you update the package? if not, you may use "yum downgrade -y ..."17:02
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy novajoin in the TLS-everywhere job  https://review.openstack.org/42748117:02
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job (novajoin)  https://review.openstack.org/42748217:02
jaosoriorsshnaidm: it's an update.17:02
EmilienMjrist: well, no. ocata-1 was 2.0.0, ocata-2 was 2.0.1 so I think ocata-rc1 will be 2.0.217:02
*** toure is now known as toure|food17:02
sshnaidmjaosorior, ok, should work then17:02
EmilienMjrist: if reno is 3.0.0, we need to change it to be 2.0.2 imho17:03
jristEmilienM: and final is 3.0.0?17:03
jristok17:03
EmilienMjrist: mhh, it sounds weird to me to bump to 3.0.017:03
EmilienMit's confusing I mean17:03
jristI thought we talked about it17:03
jristwhich is why the reno patch is 3.0.017:03
*** nyechiel has joined #tripleo17:04
EmilienMjrist: please check with Doug on #openstack-release17:05
EmilienMjrist: if he says yes, and UI folks wants 3.0.0, then I'm ok17:05
jaosoriorEmilienM: promotion happened already, right?17:06
EmilienMjaosorior: it should have yes17:06
EmilienMjaosorior: I did recheck on your patch17:06
*** athomas has quit IRC17:06
openstackgerritAna Krivokapic proposed openstack/tripleo-common master: Add plan export action  https://review.openstack.org/42278917:09
*** jcoufal__ has joined #tripleo17:10
*** ooolpbot has joined #tripleo17:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318717:11
*** ooolpbot has quit IRC17:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)17:11
*** jcoufal_ has quit IRC17:11
*** abregman|afk has quit IRC17:13
*** aufi has joined #tripleo17:17
*** rasca has quit IRC17:19
*** bnemec has quit IRC17:20
-openstackstatus- NOTICE: AFS replication issue has been addressed. Mirrors are currently re-syncing and coming back online.17:20
openstackgerritJulie Pichon proposed openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/43258117:21
openstackgerritJulie Pichon proposed openstack/tripleo-ui master: Add support for German language  https://review.openstack.org/43320017:21
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci master: Removing multinode_major_upgrade.yaml  https://review.openstack.org/43320117:21
*** trown is now known as trown|lunch17:21
*** panda is now known as panda|bbl17:23
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Collect only logs we need  https://review.openstack.org/42545917:23
openstackgerritMerged openstack/tripleo-ui master: Add release notes for Ocata 3.0.0  https://review.openstack.org/42597917:24
*** bnemec has joined #tripleo17:24
*** b00tcat has quit IRC17:25
*** tosky has quit IRC17:25
openstackgerritDavid Moreau Simard proposed openstack-infra/tripleo-ci master: Replace "ara generate" by "ara generate html"  https://review.openstack.org/43320617:28
ccamachoHey paramite, after applying the last changes to my env I'm getting several weird issues with my overcloud upgrade, there are several services stopping to work as Im running out of memory, I think they are not related to upgrading the fluentd and sensu client but can you add17:29
ccamacho    - OS::TripleO::Services::SensuClient17:29
ccamacho    - OS::TripleO::Services::FluentdClient17:29
ccamachoTo https://github.com/openstack-infra/tripleo-ci/blob/master/test-environments/multinode_major_upgrade.yaml17:29
ccamachoIll add this as a comment to the review17:29
openstackgerritDavid Moreau Simard proposed openstack/tripleo-quickstart master: Replace "ara generate" by "ara generate html"  https://review.openstack.org/43320817:30
ccamachoparamite, sorry this file https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/multinode_major_upgrade.yaml17:31
*** karimb_ has quit IRC17:32
*** jpich has quit IRC17:33
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: upgrades: switch 'newton' to $UPGRADE_RELEASE  https://review.openstack.org/43320917:33
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Add host info collection to collect-logs  https://review.openstack.org/41322417:35
*** mcornea has quit IRC17:37
*** jlinkes has quit IRC17:40
EmilienMjaosorior: https://review.openstack.org/#/c/433159/17:43
*** owalsh has quit IRC17:44
EmilienMshardy: do I need to backport https://review.openstack.org/#/c/433126/ to test scenario upgrades? or having it in master is enough to test newton to ocata?17:44
*** pcaruana has quit IRC17:44
*** yamahata has quit IRC17:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/newton: Add missing TripleO services to ci/multinode  https://review.openstack.org/43321517:46
shardyEmilienM: we probably should backport it for consistency, but having it in master should be enough I think (assuming the master version of these environments is included when we trigger the upgrade)17:48
shardywe'll add the two extra services during the stack update performing the upgrade, before any upgrade steps happen17:48
*** dprince has quit IRC17:49
*** dcritch has quit IRC17:50
*** derekh has quit IRC17:52
shardyEmilienM: it's not actually clear if we do update the env after the initial deploy17:53
shardyhttps://github.com/openstack-infra/tripleo-ci/blob/master/toci_gate_test.sh#L12117:53
shardyhttps://github.com/openstack-infra/tripleo-ci/blob/master/scripts/deploy.sh#L41017:54
shardyAFAICS we only include the stable multinode env, not the master one17:54
shardyin which case you will require the backport17:54
shardymaybe that is OK though, as otherwise we'll potentially add services during the upgrade17:55
*** dcritch has joined #tripleo17:56
openstackgerritMerged openstack/tripleo-heat-templates master: Enables support for configuring Cinder with Dell EMC ScaleIO storage backend.  https://review.openstack.org/42223818:00
*** fragatina has joined #tripleo18:01
*** fragatina has quit IRC18:01
*** lucasagomes is now known as lucas-afk18:01
*** fragatina has joined #tripleo18:01
*** hafe has quit IRC18:02
*** dtantsur is now known as dtantsur|afk18:02
*** aufi has quit IRC18:02
therveEmilienM, I don't know if swift will become the ref for Zaqar. I don't think so for the general case.18:03
EmilienMshardy: ok got it18:03
therveEmilienM, But I'd like it to be used in the undercloud, if we can get rid of mongo18:03
EmilienMtherve: makes sense18:03
EmilienMtherve: then I would +1 the idea of switching puppet-openstack-integration to use swift instead of mongo18:03
therveEmilienM, I thought changing puppet-zaqar was a good first step.18:03
EmilienMtherve: so we can also get rid of mongo in scenario00218:03
EmilienMtherve: yes, it is, thanks!18:03
therveEmilienM, Cool, I'll have a look18:04
therveEmilienM, The next step is instack-undercloud, I presume?18:04
EmilienMtherve: yes18:04
therveNever remember all the bricks :)18:04
EmilienMtherve: and we're lucky: https://github.com/openstack/puppet-openstack-integration scenario002 has both switch & zaqar already18:04
EmilienMso we can make the switch when you are ready (use depends-on)18:04
EmilienMI'm afk for lunch now18:04
therveCool18:04
paramiteccamacho, Hey, you're here?18:05
*** jlinkes has joined #tripleo18:06
*** hrybacki has quit IRC18:06
*** david-lyle_ has joined #tripleo18:08
openstackgerritBen Nemec proposed openstack/python-tripleoclient master: Mock os.path.isfile correctly  https://review.openstack.org/43322218:08
*** jaosorior has quit IRC18:08
jristEmilienM: no response from Doug yet, still waiting18:09
jristEmilienM: I'm going to go to the gym for a bit18:09
jristso hopefully he responds18:10
*** morazi_ has joined #tripleo18:11
*** ooolpbot has joined #tripleo18:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318718:11
*** ooolpbot has quit IRC18:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)18:11
*** morazi has quit IRC18:11
*** david-lyle_ is now known as david-lyle18:12
*** toure|food is now known as toure18:17
*** milan has quit IRC18:17
*** yamahata has joined #tripleo18:25
*** newmember has quit IRC18:25
*** newmember has joined #tripleo18:26
*** gatuus has joined #tripleo18:32
EmilienMjrist: ok enjoy gym18:32
EmilienMtherve: I'll take care of the switch in p-o-i18:32
EmilienMtherve: and I'll let you switch in instack-undercloud18:32
*** sudipto_ has quit IRC18:35
*** sudipto has quit IRC18:35
*** paramite has quit IRC18:38
*** jpena is now known as jpena|away18:40
openstackgerritAlex Schultz proposed openstack/puppet-pacemaker master: Disable the deprecation warning for puppet-syntax  https://review.openstack.org/43322818:41
*** jlinkes has quit IRC18:42
*** sdake has joined #tripleo18:42
openstackgerritAlex Schultz proposed openstack/puppet-pacemaker master: Add rspec tests for stonith fences  https://review.openstack.org/42133818:42
*** sdake__ has quit IRC18:43
*** Goneri has quit IRC18:43
*** rmcadams has joined #tripleo18:44
*** hrybacki has joined #tripleo18:45
*** sdake has quit IRC18:45
*** sdake has joined #tripleo18:46
*** trown|lunch is now known as trown18:47
*** sdake has quit IRC18:47
*** fultonj has quit IRC18:51
*** jcoufal has joined #tripleo18:53
*** saneax is now known as saneax-_-|AFK18:54
*** crabbytravvy has quit IRC18:54
openstackgerritMerged openstack/puppet-pacemaker master: Disable the deprecation warnings as errors for puppet-syntax  https://review.openstack.org/43283718:55
*** jcoufal__ has quit IRC18:56
*** fragatina has quit IRC18:59
*** shardy has quit IRC19:00
*** gfidente is now known as gfidente|afk19:01
*** charliejllewelly has quit IRC19:03
*** suuuper has quit IRC19:03
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Installs openssh packages that try to workaround sshd start problem  https://review.openstack.org/43068819:03
*** newmember has quit IRC19:08
*** ooolpbot has joined #tripleo19:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318719:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)19:11
*** ooolpbot has quit IRC19:11
*** toure is now known as toure|biab19:12
*** morazi_ has quit IRC19:14
*** salmankhan has quit IRC19:20
*** bvandenh has joined #tripleo19:21
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: update promotion scripts for ocata  https://review.openstack.org/42738519:24
trown sshnaidm can you take a look at ^19:24
openstackgerritBen Nemec proposed openstack/instack-undercloud master: Disallow CIDR changes on undercloud update  https://review.openstack.org/43238819:25
openstackgerritBen Nemec proposed openstack/instack-undercloud master: Fix _stackrc_exists check and _member_role_exists logic  https://review.openstack.org/43243519:25
*** dprince has joined #tripleo19:26
sshnaidmtrown, looking19:27
*** morazi_ has joined #tripleo19:28
*** jlinkes has joined #tripleo19:29
sshnaidmtrown, btw, I have something related: https://review.openstack.org/#/c/429782/19:37
*** amoralej is now known as amoralej|off19:37
sshnaidmbnemec, could you look at it too please? ^^19:38
sshnaidmtrown, maybe to separate dirs before starting promote branches?19:38
*** jcoufal_ has joined #tripleo19:39
*** jcoufal has quit IRC19:39
*** twi99y_ has joined #tripleo19:40
*** twi99y has quit IRC19:40
*** iranzo has joined #tripleo19:41
*** iranzo has joined #tripleo19:41
trownsshnaidm: dont you need to update promote.sh in your patch?19:42
trownsshnaidm: since metadata.txt gets put with the images19:42
sshnaidmtrown, no, I don't promote branches in my patch still19:43
trownsshnaidm: it doesnt matter... you change where master's metadata.txt is19:43
sshnaidmtrown, and builds-master is link to builds, so for master it should be transparent19:43
trownsshnaidm: oh... didnt notice that19:43
sshnaidmtrown, just for backward compatibility19:44
*** panda|bbl is now known as panda19:45
*** dsneddon is now known as dsneddon_afk19:45
sshnaidmtrown, before promote-ocata patch is merged we need to create fake current-tripleo-ocata/metadata.txt on the mirror-server19:46
*** dsariel has joined #tripleo19:47
openstackgerritMichael Glaser proposed openstack/puppet-tripleo master: Make quotes consistent to match the sample config  https://review.openstack.org/43240619:49
*** owalsh has joined #tripleo19:50
*** owalsh is now known as owalsh-afk19:50
*** gk-1wm-su has joined #tripleo19:51
EmilienMbnemec: damn, ovb-updates doesn't pass on https://review.openstack.org/#/c/432419/19:52
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Update ci-script to enable TripleO gate dependencies  https://review.openstack.org/43176419:52
EmilienMI think I know why19:53
EmilienMwe need https://review.openstack.org/#/c/432864/ first19:53
*** gk-1wm-su has quit IRC19:54
*** jcoufal_ has quit IRC19:54
*** suuuper has joined #tripleo19:55
*** pkovar has quit IRC19:56
*** dsneddon has joined #tripleo19:58
*** pkovar has joined #tripleo20:03
*** jlinkes has quit IRC20:03
jristEmilienM: so looks like that packages.json needs to bump to 320:05
jristEmilienM: want me to do it?20:05
EmilienMjrist: should I?20:05
openstackgerritMerged openstack/tripleo-heat-templates master: Add missing TripleO services to ci/multinode  https://review.openstack.org/43312620:06
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Add host info collection to collect-logs  https://review.openstack.org/41322420:07
jristEmilienM: haha, I'm not sure20:07
jristgenuinely20:07
openstackgerritMerged openstack/tripleo-heat-templates master: Remove duplicated release notes  https://review.openstack.org/43315920:07
*** jcoufal has joined #tripleo20:07
openstackgerritMerged openstack/puppet-tripleo master: Uncomment internal TLS options for placement API  https://review.openstack.org/43293820:07
EmilienMjrist: I'll let you doing it.20:08
jristEmilienM: so just that file?20:08
jristor is there other places?20:08
EmilienMjrist: yes, like we do at every release20:08
EmilienMjrist: pick the same number as releasenotes20:08
jristgot it20:08
openstackgerritJason E. Rist proposed openstack/tripleo-ui master: Bump TripleO-UI to 3.0.0 for Ocata  https://review.openstack.org/43324820:09
jristEmilienM: ^20:09
*** ooolpbot has joined #tripleo20:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318720:11
*** ooolpbot has quit IRC20:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)20:11
*** amoralej|off is now known as amoralej20:11
EmilienMjrist: last word?20:12
EmilienMjrist: to me it's still weird to see both 2.x and 3.x in the same cycle but well, you're the boxx20:13
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh  https://review.openstack.org/43102920:13
EmilienMboss*20:13
jristEmilienM: lol I am not the boss20:13
*** owalsh has joined #tripleo20:13
*** dsariel has quit IRC20:15
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Installs openssh packages that try to workaround sshd start problem  https://review.openstack.org/43068820:16
*** owalsh-afk has quit IRC20:16
EmilienMpanda, sshnaidm: do we still hit the ssh thing lately?20:16
sshnaidmEmilienM, yeah, we do20:17
*** bfournie1 has quit IRC20:17
EmilienMit seems like at least once a day20:17
*** fragatina has joined #tripleo20:17
EmilienM42 hits in 1 week20:18
EmilienMsounds reasonable to workaround at this stage20:18
EmilienMsshnaidm: what is the status on the real fix?20:18
sshnaidmEmilienM, about 5 times today20:18
sshnaidmEmilienM, I think panda knows more, this patch should test specific version of openssh20:19
pandaEmilienM: I counted 60 last week20:20
pandaEmilienM: that patch that tests the test version of ssh has not been merged yet.20:21
openstackgerritMerged openstack/puppet-tripleo master: nova: move placement credentials config at step 3  https://review.openstack.org/43251520:22
EmilienMsshnaidm: can you look https://review.openstack.org/#/c/433209/ please?20:22
sshnaidmpanda, if this version won't work, let's return back to commit rpms and merge it, I've messed this enough20:22
EmilienMsshnaidm: with https://review.openstack.org/#/c/42637520:23
sshnaidmEmilienM, looking20:23
pandasshnaidm: agreed, no reason to  work on it for more for a patch that will last 1 week20:23
pandatoo many fors there.20:24
*** jcoufal has quit IRC20:24
*** bfournie has joined #tripleo20:26
*** suuuper has quit IRC20:26
*** Goneri has joined #tripleo20:26
*** dsariel has joined #tripleo20:28
*** salmankhan has joined #tripleo20:28
pandaEmilienM: can you explain why overcloud images do not contain repos configuration ?20:28
*** jcoufal has joined #tripleo20:29
trownEmilienM: I thought it was just because we use DIB_YUM_REPO_CONF for image building, not any intentional reason the repos are absent20:31
openstackgerritMerged openstack/instack-undercloud master: Add last missing release notes before Ocata release  https://review.openstack.org/43278520:31
*** pkovar has quit IRC20:31
*** salmankhan has quit IRC20:32
bnemecYeah, DIB_YUM_REPO_CONF removes the repos again after the build is complete.20:39
bnemecI suspect because it was added for RHEL image building where you don't want to leave repos in the image.20:40
*** sdake has joined #tripleo20:41
slagleyea, that was basically it20:41
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh  https://review.openstack.org/43102920:41
slaglesubscription-manager is horible to use during image building20:41
*** ianychoi has quit IRC20:43
*** salmankhan has joined #tripleo20:43
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Clone tripleo-quickstart dependant change to tripleo-quickstart-gate-repo  https://review.openstack.org/43176020:47
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Update ci-script to enable TripleO gate dependencies  https://review.openstack.org/43176420:47
pandaslagle: bnemec so we don't actually need the overcloud image to be without repo configuration and unable to access any repo20:51
bnemecpanda: Well, I guess it was kind of intentional too.  There aren't supposed to be any package installs going on at deploy time.20:52
bnemecpanda: What do you need repos for?20:53
pandabnemec: I see that the update_image function in toci removes again all the repos after updating.20:53
bnemecpanda: Yeah, the cached images should be identical (or as close as possible) to what would be built.20:53
pandabnemec: we are replicating image building functionality in quickstart and we're trying to understand if we can leave the repos there or not.20:53
dsneddonslagle: Can you please review my comments on this review? I've been trying to land this series ASAP, and you are currently -1. https://review.openstack.org/#/c/409920/20:53
*** suuuper has joined #tripleo20:54
*** jcoufal has quit IRC20:54
*** iranzo has quit IRC20:54
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: GATE CHECK  https://review.openstack.org/43027720:54
dsneddonslagle: It is a little confusing as-is, so I was thinking of adding code comments to help explain the mechanism. I'm not sure if this is the best approach, though.20:56
*** jcoufal has joined #tripleo20:56
*** salmankhan has quit IRC20:57
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Update ci-script to enable TripleO gate dependencies  https://review.openstack.org/43176420:59
*** nyechiel has quit IRC20:59
*** gatuus has quit IRC20:59
*** fultonj has joined #tripleo21:02
*** fultonj has quit IRC21:02
slagledsneddon: if "networks" in the jinja template comes from networks_data.yaml, then aren't the patches in the wrong order?21:02
slagledsneddon: see my 2nd comment on PS521:03
slagledsneddon: if we land this as-is, it looks to me like it completely breaks network isolation21:03
dsneddonslagle: Ah, OK, I'll take a closer look and discuss with Steven Hardy if need be. Thanks.21:03
slagledsneddon: run process_templates.py with just the first patch pulled down21:04
slagleyou end up with a rendered network-isolation.yaml that has no networks21:04
slagledsneddon: also process_templates.py doesn't actually get used by any code in tripleo21:05
slagleso the 2nd patch, https://review.openstack.org/#/c/409921/, needs to also be done against the template code in tripleo-common21:05
slagleeven steve said as much on the patch21:05
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Update ci-script to enable TripleO gate dependencies  https://review.openstack.org/43176421:07
dsneddonslagle: OK, I ran process_templates.py and I see what you mean.21:09
*** ooolpbot has joined #tripleo21:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318721:11
*** ooolpbot has quit IRC21:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)21:11
EmilienMbnemec: I just saw that:21:17
EmilienM2017-02-13 21:15:47Z [overcloud.Compute.0.NovaCompute]: CREATE_FAILED  ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: Insufficient compute resources: Free disk 1.00 GB < requested 40 GB., Code: 500"21:17
*** fzdarsky|afk has quit IRC21:17
bnemecEmilienM: Sounds like it tried to double-schedule to a node.21:19
bnemecI believe each overcloud node has 41 GB, and the flavor is 40, so you end up with 1 GB left over.21:19
*** akrivoka has quit IRC21:23
*** amoralej is now known as amoralej|off21:23
*** jayg is now known as jayg|g0n321:23
*** jcoufal has quit IRC21:24
*** jcoufal has joined #tripleo21:27
EmilienMbeagles: any progress so far on https://bugs.launchpad.net/tripleo/+bug/1663219 ?21:27
openstackLaunchpad bug 1663219 in tripleo "Newton->Ocata upgrade fails during neutron-db-manage upgrade head (caused by python-networking-odl)" [Critical,Triaged] - Assigned to Brent Eagles (beagles)21:27
*** jlinkes has joined #tripleo21:29
*** percevalbot has quit IRC21:30
*** fzdarsky|afk has joined #tripleo21:32
*** jkilpatr has quit IRC21:32
openstackgerritMerged openstack/instack-undercloud master: Reduce memcached memory usage  https://review.openstack.org/43104221:33
beaglesEmilienM: the package versions in that particular situation are completely messed. I've reached out to the package maintainer for an assist21:33
openstackgerritMerged openstack-infra/tripleo-ci master: Save images according to their branch  https://review.openstack.org/42978221:33
*** dprince has quit IRC21:34
beaglesEmilienM: I'm testing the similar bigswitch packages at the moment trying to reproduce...21:34
*** fultonj has joined #tripleo21:35
beaglesEmilienM: just saw your comment on that bz :)21:36
beagles(the bigswitch one)21:37
beaglesI think if he goes from fresh packages, he should be okay21:38
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: break out general_config into config and topology  https://review.openstack.org/42545121:40
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Add missing TripleO services to ci/multinode  https://review.openstack.org/43321521:40
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Use modify-image role and custom dir in repo-setup  https://review.openstack.org/43328721:41
*** hewbrocca is now known as hewbrocca_afk21:46
*** sshnaidm is now known as sshnaidm|off21:51
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates master: Adds 'trunk' to ODL env service plugins  https://review.openstack.org/43329521:52
*** jcoufal_ has joined #tripleo21:54
*** jcoufal has quit IRC21:55
*** jcoufal_ has quit IRC21:56
beagleshey trozet, have you had anything to do with ODL related packaging? ;)21:57
trozethi beagles21:57
trozetbeagles: um dfarrell07 is the one that has done most of that, why?21:58
beaglestrozet: got this cute littley problem where the newton branch has python-networking-odl-3.2.0 and ocata is python-networking-odl-3.1.1 so if someone installs newton, then upgrades, the package won't be updated21:59
*** gatuus has joined #tripleo21:59
trozetbeagles: oh dfarrell07 is ODL packaging, not networking-odl21:59
beaglestrozet: right.. I think mkolensi is the guy taking care of the python package22:00
trozetbeagles: that odd the versions going backwards...22:00
trozetbeagles: yeah, let me check rdoinfo22:00
trozetoh wait thats only for puppet...22:01
trozetsec22:01
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Stop mirroring centos images  https://review.openstack.org/43037222:02
bkeroHi there. Any tripleo-ci cores feel like reviewing this patch to enable scenario testing? https://review.openstack.org/#/c/427468/22:03
openstackgerritAndy Smith proposed openstack/puppet-tripleo master: WIP Use rpc and notify transport_url for oslo_messaging backends  https://review.openstack.org/42548422:03
trozetbeagles: https://review.rdoproject.org/r/gitweb?p=openstack/networking-odl-distgit.git;a=blob;f=python-networking-odl.spec;h=250fb086e6f4ea0617969d97ca4566d7f3bb0dca;hb=refs/heads/newton-rdo22:04
trozetbeagles: https://review.rdoproject.org/r/gitweb?p=openstack/networking-odl-distgit.git;a=blob;f=python-networking-odl.spec;h=de8ebd81b8691d094a5317939cf733107c67e712;hb=refs/heads/rpm-master22:04
trozetbeagles: that spec for newton shows 3.1.0 version22:05
bkeroactually since that tripleo-ci change of mine depends on a quickstart change, that'll need to be merged first22:05
trozetbeagles: but i also see on my newton setup, python-networking-odl-3.2.122:06
beaglestrozet: yeah there is a newton "current" repo that has the other version22:07
beaglestrozet: (ie. 3.2.0)22:07
openstackgerritMerged openstack/tripleo-common master: Re-enable tee behavior for image builds  https://review.openstack.org/43107522:08
*** ooolpbot has joined #tripleo22:11
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh  https://review.openstack.org/43102922:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318722:11
*** ooolpbot has quit IRC22:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)22:11
*** jkilpatr has joined #tripleo22:13
*** jlinkes has quit IRC22:14
*** trown is now known as trown|outtypewww22:15
openstackgerritMerged openstack/python-tripleoclient stable/ocata: Updated from global requirements  https://review.openstack.org/43169322:18
*** suuuper has quit IRC22:20
*** rajinir_ has quit IRC22:20
*** Goneri has quit IRC22:25
openstackgerritDan Prince proposed openstack/python-tripleoclient master: Deploy the undercloud with Heat  https://review.openstack.org/35135122:25
*** salmankhan has joined #tripleo22:26
*** fultonj has quit IRC22:27
*** pmannidi has joined #tripleo22:38
openstackgerritMerged openstack/tripleo-common master: Force DIB_PYTHON_VERSION to be 2  https://review.openstack.org/43240422:43
*** ansmith has quit IRC22:45
*** ansmith has joined #tripleo22:46
*** panda is now known as panda|zZ22:47
*** jmelvin has quit IRC22:52
EmilienMbeagles: ok thx; please update the bug22:53
*** cdearborn has quit IRC22:54
*** saneax-_-|AFK is now known as saneax23:02
bnemecEmilienM: Ouch.  I think the ha job on https://review.openstack.org/#/c/432864/ timed out because we're actually taking around 1:20 to deploy an ha overcloud now.23:03
bnemecThat one fell just on the wrong side of the timeout line.23:03
EmilienMbnemec: :(23:03
*** lblanchard has quit IRC23:04
EmilienMbnemec: can you review https://review.openstack.org/#/c/426372/ please?23:04
EmilienMbnemec: I'll investigate the timeout later23:05
EmilienMbnemec: why it takes more time :/23:05
*** gk--1wm- has joined #tripleo23:05
EmilienMbnemec: nothing changed lately afik23:05
*** gk--1wm- has left #tripleo23:05
EmilienMbnemec: or maybe it's performance issue with heat or something23:05
bnemecEmilienM: I actually suspect it has to do with the change in when we run keystone and nova.  I noticed step 3 is now taking an excessively long time, and 4 and 5 are still as slow as always.23:06
*** dsariel has quit IRC23:07
EmilienMbnemec: :(23:08
EmilienMI need to leave now, I'll look later23:08
bnemecEmilienM: Have a good night.23:08
EmilienMyou too !23:09
bnemecTo complete my previous comment, here's an example of the step runtimes from a recent job: http://paste.openstack.org/show/598715/23:09
bnemecThey've actually inverted.  The runtimes used to be 3 < 4 < 5, now it's 5 < 4 < 3, and they're all stupidly long.23:10
bnemecThat's 50 minutes to run 3 steps of the deploy.23:10
bnemecNot counting stuff like baremetal provisioning and the first two steps.23:10
bnemec(and step 2 takes 10 minutes itself!)23:11
*** ooolpbot has joined #tripleo23:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166318723:11
*** ooolpbot has quit IRC23:11
openstackLaunchpad bug 1663187 in tripleo "Nova Placement API on IPv6 unreachable from compute nodes" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)23:11
*** limao has quit IRC23:13
*** gfidente|afk has quit IRC23:27
*** jtomasek has quit IRC23:31
*** ansmith has quit IRC23:32
*** rwsu has quit IRC23:33
*** jtomasek has joined #tripleo23:35
*** leanderthal|afk has quit IRC23:35
*** leanderthal|afk has joined #tripleo23:36
*** twi99y has joined #tripleo23:37
*** twi99y_ has quit IRC23:37
*** twi99y_ has joined #tripleo23:38
*** twi99y has quit IRC23:38
*** fultonj has joined #tripleo23:41
*** fzdarsky|afk has quit IRC23:42
*** dmarlin has quit IRC23:45
*** dougbtv_ has joined #tripleo23:48
*** dougbtv has quit IRC23:49
*** thrash is now known as thrash|g0ne23:51
*** fultonj has quit IRC23:52
*** salmankhan has quit IRC23:52
« Sunday, 2017-02-12 Index Tuesday, 2017-02-14 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!