Thursday, 2017-02-02

*** rbrady-afk has quit IRC00:01
*** karimb has quit IRC00:06
jaosoriorbnemec: how acquainted are you with os-net-config?00:10
dsneddonjaosorior, What do you want to know about os-net-config?00:11
jaosoriordsneddon: is there a way to set the domain for the interface? currently I see that we can set the DNS nameservers, and those end up in resolv.conf, however, I would like to set the domain or the search entries there; and I'm not sure if I can do that by setting up some value in os-net-config; at least not that I can see00:13
dsneddonjaosorior, No, os-net-config doesn't set domain name.00:13
jaosoriordsneddon: could it? :D00:13
openstackgerritIan Main proposed openstack/tripleo-heat-templates: WIP: Containerized Swift Services.  https://review.openstack.org/42543400:13
dsneddonjaosorior, Is that something that can be done via ifcfg files?00:13
*** bfournie has joined #tripleo00:14
jaosoriordsneddon: I think that adding DOMAIN=<some domain> would work there00:14
dsneddonjaosorior, Yeah, you're right. That would be an easy patch.00:14
*** karimb has joined #tripleo00:18
*** jaosorior has quit IRC00:27
*** jkilpatr has joined #tripleo00:31
*** yamahata has quit IRC00:35
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Add option for scenarios jobs promotion  https://review.openstack.org/42581900:36
*** owalsh-afk has quit IRC00:37
*** bfournie has quit IRC00:44
*** openstackgerrit has quit IRC01:02
*** dmacpher-afk has joined #tripleo01:26
*** karimb has quit IRC01:30
*** Goneri has quit IRC01:40
*** ansmith has quit IRC02:02
*** cwolferh has quit IRC02:16
*** bfournie has joined #tripleo02:17
*** eck` is now known as jeckersb_gone02:24
*** mburned is now known as mburned_out02:24
*** dmacpher-afk is now known as dmacpher02:27
*** fzdarsky_ has joined #tripleo02:29
*** fzdarsky|afk has quit IRC02:33
*** akuznetsov has joined #tripleo02:51
*** akuznetsov has quit IRC02:56
*** cwolferh has joined #tripleo03:00
*** bkopilov has quit IRC03:02
*** sdake has quit IRC03:04
*** gmann has joined #tripleo03:04
*** dmarlin has quit IRC03:05
*** dmarlin has joined #tripleo03:06
*** cdearborn has quit IRC03:07
*** jschlueter has quit IRC03:08
*** jschlueter has joined #tripleo03:09
*** jmelvin has quit IRC03:27
*** dmacpher_ has joined #tripleo03:37
*** dmacpher has quit IRC03:38
*** cwolferh has quit IRC03:49
*** nyechiel has joined #tripleo03:50
*** gkadam has joined #tripleo04:13
*** psahoo has joined #tripleo04:14
*** saneax-_-|AFK is now known as saneax04:16
*** openstackgerrit has joined #tripleo04:17
openstackgerritMerged openstack/puppet-tripleo master: set innodb_file_per_table to ON for MySQL / Galera  https://review.openstack.org/42731004:17
openstackgerritDan Trainor proposed openstack/puppet-tripleo master: Proxy API endpoints that UI uses  https://review.openstack.org/42490904:17
*** bkopilov has joined #tripleo04:19
openstackgerritDan Trainor proposed openstack/instack-undercloud master: Add additional proxy and config endpoints for UI  https://review.openstack.org/42490304:33
*** udesale has joined #tripleo04:36
*** saneax is now known as saneax-_-|AFK04:40
*** cwolferh has joined #tripleo04:56
*** skramaja has joined #tripleo05:01
openstackgerritMerged openstack-infra/tripleo-ci master: Use http delorean urls instead of https  https://review.openstack.org/42751705:01
*** nyechiel has quit IRC05:09
*** prateek has joined #tripleo05:12
*** gkadam is now known as gkadam|afk05:22
*** bkopilov_ has joined #tripleo05:25
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Remove unused SR-IOV parameter NeutronSupportedPCIVendorDevs  https://review.openstack.org/42762005:48
*** jaganathan has joined #tripleo06:01
*** artom_ has joined #tripleo06:09
*** rnoriega has quit IRC06:11
*** dhill_ has quit IRC06:12
*** artom has quit IRC06:12
*** cschwede has quit IRC06:12
*** mnaser has quit IRC06:12
*** dhill_ has joined #tripleo06:13
*** yolanda has quit IRC06:13
*** axisys has quit IRC06:13
*** remix_tj has quit IRC06:13
*** rhefner has quit IRC06:13
*** axisys has joined #tripleo06:15
*** remix_tj has joined #tripleo06:16
*** gkadam|afk is now known as gkadam06:18
*** rnoriega has joined #tripleo06:18
*** nyechiel has joined #tripleo06:21
*** cschwede has joined #tripleo06:21
*** yolanda has joined #tripleo06:25
*** nmathew has joined #tripleo06:26
*** pgadiya has joined #tripleo06:30
*** agurenko has joined #tripleo06:38
*** sudipto_ has joined #tripleo06:38
*** sudipto has joined #tripleo06:38
*** mnaser has joined #tripleo06:39
*** abregman has joined #tripleo06:41
*** jbadiapa has quit IRC06:43
*** yolanda has quit IRC06:46
*** twiggy_ has joined #tripleo06:55
*** twiggy has quit IRC06:57
*** saneax-_-|AFK is now known as saneax07:05
*** rcernin has joined #tripleo07:06
*** ealcaniz has joined #tripleo07:07
*** florianf has joined #tripleo07:07
bandinimorning07:07
*** iranzo has joined #tripleo07:08
*** iranzo has joined #tripleo07:08
*** tremble has joined #tripleo07:11
*** aufi has joined #tripleo07:14
*** tesseract has joined #tripleo07:16
*** jprovazn has joined #tripleo07:25
*** rlandy has quit IRC07:26
*** aufi has quit IRC07:31
*** ebarrera has joined #tripleo07:33
*** abehl has joined #tripleo07:36
*** rasca has joined #tripleo07:36
*** pcaruana has joined #tripleo07:39
*** yprokule has joined #tripleo07:40
*** pcaruana has quit IRC07:42
*** pcaruana has joined #tripleo07:43
*** yamahata has joined #tripleo07:47
*** karimb has joined #tripleo07:56
*** mcornea has joined #tripleo07:57
*** hjensas has joined #tripleo07:58
*** hjensas has quit IRC07:58
*** hjensas has joined #tripleo07:58
*** cylopez has joined #tripleo08:04
*** pmannidi has quit IRC08:07
*** flepied has quit IRC08:09
*** AJaeger has joined #tripleo08:11
*** AJaeger has left #tripleo08:11
*** yolanda has joined #tripleo08:12
*** shardy has joined #tripleo08:13
*** athomas has joined #tripleo08:13
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Delivers upgrade scripts where upgrade steps are disabled  https://review.openstack.org/41988608:14
*** karthiks has quit IRC08:16
*** jlinkes has joined #tripleo08:22
*** jbadiapa has joined #tripleo08:28
*** rcernin has quit IRC08:28
*** abehl has quit IRC08:32
*** amoralej|off is now known as amoralej08:34
*** karthiks has joined #tripleo08:35
*** suuuper has joined #tripleo08:37
openstackgerritMartin André proposed openstack/tripleo-quickstart-extras master: Remove unnecessary heat configuration update  https://review.openstack.org/42275208:41
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: toci_gate_test: allow to run upgrade jobs for scenarios  https://review.openstack.org/42637008:42
*** b00tcat has joined #tripleo08:44
*** b00tcat has joined #tripleo08:44
openstackgerritSagi Shnaidman proposed openstack/tripleo-heat-templates master: DNM - test scnario001-upgrade experimental job  https://review.openstack.org/42637208:44
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci master: Fix floating IP tenant stack template path  https://review.openstack.org/42772508:46
*** ccamacho has joined #tripleo08:47
*** abehl has joined #tripleo08:48
*** rcernin has joined #tripleo08:52
*** yolanda has quit IRC08:52
*** flepied has joined #tripleo08:53
*** karimb has quit IRC08:53
*** jpich has joined #tripleo08:56
*** zzzeek has quit IRC09:00
*** skramaja has quit IRC09:01
*** sshnaidm|off is now known as sshnaidm09:01
*** zzzeek has joined #tripleo09:01
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: DB connection: prevent src address from binding to a VIP  https://review.openstack.org/41746709:02
*** yolanda has joined #tripleo09:03
*** psahoo has quit IRC09:05
*** yolanda has quit IRC09:10
*** gfidente has joined #tripleo09:11
*** gfidente has quit IRC09:11
*** gfidente has joined #tripleo09:11
*** fzdarsky_ is now known as fzdarsky09:12
*** karimb has joined #tripleo09:13
*** karthiks has quit IRC09:13
*** remix_tj has quit IRC09:13
*** dtantsur|afk is now known as dtantsur09:15
*** remix_tj has joined #tripleo09:16
matbushardy: marios quick question, did you ever try the skip-tags ?09:19
matbui looks broken to me09:19
matbus/i/it/09:20
mariosmatbu: no haven't  but i think shardy mentioned something about that yesterday (there may be a problem with the skip tags but didn't get round to asking him about it) - looking at a case atm will try the latest puppet skip patch later hopefully09:21
mariosmatbu: and can try that too ^09:21
*** psahoo has joined #tripleo09:22
bandinivirt-/go 2609:23
bandiniops09:23
shardymatbu: It's broken because my heat-agents-ansible patch isn't built in RDO yet09:24
shardyit works if you apply the patch locally, but there's a packaging issue which number80 was looking into09:24
shardysec, let me see if it's fixed09:24
shardybasically the dlrn builds were coming from openstack/heat-templates not openstack/heat-agents (the new repo)09:24
*** lucas-afk is now known as lucasagomes09:25
*** salmankhan has joined #tripleo09:25
matbushardy: ack, ok thanks, no worries09:25
shardyhttp://paste.fedoraproject.org/542740/60275341/09:25
matbushardy: im asking just in case if i have to debug and fix it09:25
shardymatbu: that's my workaround, see the curl from heat-agents09:25
shardymatbu: Yeah AFAIK no debugging needed, we just need the package updated09:26
matbushardy: yep great i'll use the workaround09:26
matbu(instead of doing sed :))09:26
shardyhehe :)09:27
*** karthiks has joined #tripleo09:27
matbushardy: btw do you have idea why the CI failed on nova aptch : http://logs.openstack.org/41/405241/20/check/gate-tripleo-ci-centos-7-multinode-upgrades-nv/27c4a68/console.html#_2017-02-01_08_58_25_34609009:28
shardyHey marios can we land https://review.openstack.org/#/c/427629/ please?09:28
shardyfixes an issue when ceilometer is enabled09:28
shardymarios: thanks for the comments on the disable puppet patch, working on a revision now09:28
matbushardy: im about to try to reproduce the failure, (my env is currently not like what we are deploying in CI)09:28
*** paramite has joined #tripleo09:29
*** salmankhan has quit IRC09:30
mariosshardy: np, also rebased my https://review.openstack.org/#/c/419886/ too can you have a look if you get a chance later (the version you rebased/commented on was an earlier one)09:32
karimbping dtantsur09:32
shardymarios: Oh sorry I thought I grabbed the latest, will do09:32
karimbany idea why the same director images fail to do introspection on one install and the other no ?09:33
shardykarimb: where does it fail, booting the ramdisk or during introspection?09:33
mariosshardy: np... also jenkins really disliked both of those patches :/09:33
shardymarios: yeah, tested locally but will check why too09:33
shardysoo much red! :)09:34
karimbusing multiple vms on two different hypervisors. one is centos and the other rhel. the introspection just keeps waiting for the nodes. they panic09:34
dtantsurkarimb, without any details, anything can be the cause09:34
mariosshardy: well my one is untested i hope to do that today finally :)09:34
karimbi ve tried latest ipxerom-qemu package but same issue09:34
dtantsurkarimb, make sure you have enough memory. the last time I checked, the ramdisk required at least 2Gi09:34
shardykarimb: well a kernel panic booting the ramdisk sounds pretty serious09:34
karimbram on the hypervisor, you mean ?09:35
shardykarimb: can you capture the actual error so we can see it?09:35
dtantsurkarimb, no, memory allocated to your virtual nodes, their virtual RAM09:35
karimbdtantsur well i use those settings https://github.com/karmab/kcli/blob/master/plans/openstack/tripleo/tripleoadvancedceph.yml09:36
shardymatbu: that error is from the previous version of https://review.openstack.org/#/c/424905/ not the nova patch09:36
karimb2Gb for ceph nodes, might be that actually09:36
karimblet me check09:36
karimbdtantsur shardy thanks09:37
shardymatbu: I fixed the error in the CI run yesterday but just working on another revision due to comments from marios09:37
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates master: Add nova service support for composable upgrades  https://review.openstack.org/40524109:37
matbushardy: ack09:37
shardykarimb: ah, yeah I'd suggest 4G minimum ideally more09:37
dtantsurkarimb, yeah, try bumping it a bit further09:38
*** yolanda has joined #tripleo09:41
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates master: Provide a default value for Ironic's cleaning_network  https://review.openstack.org/42805209:42
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates master: DO NOT MERGE: testing ironic  https://review.openstack.org/42805309:42
*** jpw has joined #tripleo09:44
*** panda|off is now known as panda09:47
*** abehl has quit IRC09:47
*** yamahata has quit IRC09:48
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Moving the validation for using the template alias version for all templates  https://review.openstack.org/42806209:51
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Moving the validation for using the template alias version for all templates  https://review.openstack.org/42806209:52
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Moving the validation for using the template alias version for all templates  https://review.openstack.org/42806209:53
*** akrivoka has joined #tripleo09:54
*** adarazs is now known as adarazs_afk09:54
openstackgerritDmitry Tantsur proposed openstack/tripleo-docs master: Update bare metal cleaning documentation with latest changes  https://review.openstack.org/42806609:57
*** flepied has quit IRC10:01
*** salmankhan has joined #tripleo10:02
*** abehl has joined #tripleo10:04
*** salmankhan has quit IRC10:05
*** salmankhan has joined #tripleo10:05
*** owalsh-afk has joined #tripleo10:05
*** owalsh-afk is now known as owalsh10:05
*** nijaba has quit IRC10:06
*** nijaba has joined #tripleo10:07
*** nijaba has quit IRC10:07
*** nijaba has joined #tripleo10:07
*** jaganathan has quit IRC10:07
*** milan has joined #tripleo10:15
*** flepied has joined #tripleo10:17
*** udesale has quit IRC10:24
openstackgerritMerged openstack/tripleo-heat-templates master: Don't run ceilometer-upgrade via upgrade_tasks  https://review.openstack.org/42762910:34
*** owalsh is now known as owalsh-brb10:34
*** jbadiapa has quit IRC10:36
dtantsurbnemec, mind checking https://review.openstack.org/#/c/427307/ again please?10:37
*** tosky has joined #tripleo10:40
*** owalsh-brb is now known as owalsh10:41
*** salmankhan has quit IRC10:42
d0ugalAnyone else seen this? or am I doing something wrong? http://paste.openstack.org/show/597327/10:44
d0ugaldtantsur: ^ I suspect that might make sense to you :)10:44
d0ugalI just switched to quickstart, so I have probalby forotten to do something.10:45
*** katkapilatova has joined #tripleo10:46
*** salmankhan has joined #tripleo10:46
*** bogdando has joined #tripleo10:46
dtantsurd0ugal, I haven't tried this exact command, but I suspect there is an ordering bug there10:47
jpichI opened https://bugs.launchpad.net/tripleo/+bug/1661206 about the issues with the CLI gate, if there is already something open about it please mark as a duplicate??10:48
openstackLaunchpad bug 1661206 in tripleo "CLI gate job 'buildimage-overcloud-full' failing on delorean.repo" [Critical,Triaged]10:48
d0ugaldtantsur: oh, the nodes are already available, so --provide isn't needed maybe10:48
d0ugalI guess we should maybe make it noop in that case10:48
dtantsurd0ugal, actually we do need provide. they should not become available until the very end, and only if --provide is supplied10:49
*** yprokule has quit IRC10:49
jpichMaybe the nodes get registered by quickstart in advance already?10:50
d0ugaljpich: I was just wondering that.10:50
d0ugalYeah, so I just deleted them and it seems to be working now10:50
openstackgerritRicardo Noriega proposed openstack/tripleo-heat-templates stable/newton: Add BGPVPN composable service  https://review.openstack.org/42808110:50
d0ugalI'll run it again after and see if I get the same result - I guess a bug to provide better output on it being ran twice might be needed.10:51
*** derekh has joined #tripleo10:52
dtantsurd0ugal, right, so we need to "manage" existing nodes before introspection10:55
d0ugaldtantsur, jpich: yeah, so confirmed - that error happens if you run it twice. I'm silly. Opening a bug to improve it anyway10:55
dtantsurthanks!10:55
jtomasekd0ugal: is there currently a way to update roles_data.yaml in plan through mistral action?10:57
jtomasekd0ugal: only by plan update, right?10:57
*** akuznetsov has joined #tripleo10:58
*** adarazs_afk is now known as adarazs10:59
openstackgerritMerged openstack-infra/tripleo-ci master: Fix image size metric retrieval  https://review.openstack.org/42748711:03
*** psahoo has quit IRC11:04
*** flepied has quit IRC11:06
*** sdake has joined #tripleo11:07
d0ugaljtomasek: no way that I know of11:08
jtomasekd0ugal: ok11:08
openstackgerritRicardo Noriega proposed openstack/tripleo-heat-templates master: Add BGPVPN composable service  https://review.openstack.org/42808911:09
*** sdake_ has joined #tripleo11:09
*** sdake_ has quit IRC11:11
*** sdake_ has joined #tripleo11:12
openstackgerritavnish proposed openstack/tripleo-incubator master: Remove link to modindex  https://review.openstack.org/42809011:12
*** sdake has quit IRC11:12
*** bogdando has quit IRC11:16
*** psahoo has joined #tripleo11:16
*** rasca__ has joined #tripleo11:17
*** bogdando has joined #tripleo11:17
*** rasca has quit IRC11:17
*** bogdando has quit IRC11:18
*** sudipto_ has quit IRC11:19
*** sudipto has quit IRC11:19
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration.  https://review.openstack.org/42809311:21
*** flepied has joined #tripleo11:21
*** akuznetsov has quit IRC11:22
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates master: DO NOT MERGE: testing ironic  https://review.openstack.org/42805311:23
*** ramishra has quit IRC11:24
shardyjtomasek: in theory it's possible to update roles_data.yaml directly via swift, then re-run the tripleo.templates.process action11:25
shardyjtomasek: probably best to use the normal plan create/update workflow though11:25
jtomasekshardy: yeah, I am starting ML thread on the topic, would be great to get feedback11:26
jtomasekshardy: (sending in a minute)11:26
*** ramishra has joined #tripleo11:26
pandaany nova expert around ? https://bugs.launchpad.net/tripleo/+bug/166119311:26
openstackLaunchpad bug 1661193 in tripleo "CI pingtest fails to create test instance" [Critical,Triaged]11:26
*** fzdarsky is now known as fzdarsky|afk11:28
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration.  https://review.openstack.org/42809311:30
*** dsariel has quit IRC11:31
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration.  https://review.openstack.org/42809311:31
*** ccamacho has quit IRC11:34
*** bogdando has joined #tripleo11:36
*** bogdando has quit IRC11:38
*** suuuper has quit IRC11:38
*** bogdando has joined #tripleo11:38
*** nmathew has quit IRC11:38
*** suuuper has joined #tripleo11:40
*** bogdando has quit IRC11:42
*** bogdando has joined #tripleo11:42
*** gkadam_ has joined #tripleo11:42
*** dsariel has joined #tripleo11:44
*** jkilpatr has quit IRC11:44
*** bogdando has quit IRC11:44
*** gkadam has quit IRC11:45
*** gkadam_ is now known as gkadam11:45
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Send mail tool  https://review.openstack.org/42334011:48
*** ccamacho has joined #tripleo11:50
openstackgerritRicardo Noriega proposed openstack/tripleo-heat-templates master: Add BGPVPN composable service  https://review.openstack.org/42808911:52
ansiwenmarios: could you restore the +2? https://review.openstack.org/#/c/42532311:52
openstackgerritMartin André proposed openstack/tripleo-quickstart master: Fix initialization of novaclient  https://review.openstack.org/42810511:53
*** bkopilov_ has quit IRC11:57
*** bkopilov has quit IRC11:58
*** jkilpatr has joined #tripleo11:59
*** mburned_out is now known as mburned12:00
*** prateek has quit IRC12:00
*** openstackgerrit has quit IRC12:03
*** athomas has quit IRC12:04
*** jkilpatr has quit IRC12:07
*** jpena is now known as jpena|lunch12:10
*** karimb has quit IRC12:10
*** athomas has joined #tripleo12:12
*** pgadiya has quit IRC12:17
*** panda is now known as panda|lch12:18
*** jkilpatr has joined #tripleo12:21
EmilienMhello12:22
shardyHi EmilienM12:23
*** openstackgerrit has joined #tripleo12:24
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Disable puppet on upgrade for roles not upgrading  https://review.openstack.org/42490512:24
EmilienMowalsh: hey! have you seen: https://bugs.launchpad.net/tripleo/+bug/1661193 ?12:26
openstackLaunchpad bug 1661193 in tripleo "CI pingtest fails to create test instance" [Critical,Triaged]12:26
*** athomas has quit IRC12:27
*** athomas has joined #tripleo12:27
owalshEmilienM: looking...12:28
*** pgadiya has joined #tripleo12:29
*** morazi has quit IRC12:29
gfidentejprovazn any clue why the manila scenario is failing about the endpoint missing in the overcloud?12:31
jprovazngfidente: nope, missing endpoint is quite surprising - looks like the service is not deployed12:32
*** nmathew has joined #tripleo12:32
gfidentejprovazn so it could be something with the scenario env file12:32
gfidenteI'm trying that locally now12:33
jprovazngfidente: I would expect it fails because of unmerged https://review.openstack.org/42406112:33
gfidenteright it is indeed the heat stack failing12:33
gfidentebut that isn't the exception we should get12:34
EmilienMowalsh: I think you want to see https://trello.com/c/HsqWS90p/52-tripleo-master-ping-test-fails-to-create-test-instance and https://trello.com/c/byffPsUO/53-puppet-ocata-impossible-to-boot-a-vm-with-nova - the 2 are relating to nova and blocks promotion on both Puppet & TripleO CI.12:39
*** skramaja has joined #tripleo12:41
*** pkovar has joined #tripleo12:42
openstackgerritFlorian Fuchs proposed openstack/tripleo-ui master: Adds language selector to NavBar  https://review.openstack.org/42467612:43
*** cdearborn has joined #tripleo12:44
*** yprokule has joined #tripleo12:46
*** jpena|lunch is now known as jpena12:50
*** nmathew- has joined #tripleo12:51
*** assassin has quit IRC12:52
*** ubijtsa has joined #tripleo12:52
*** ubijtsa has joined #tripleo12:52
*** nmathew has quit IRC12:54
*** ubijtsa is now known as assassin12:55
*** panda|lch is now known as panda12:57
pandaEmilienM: since all the previous blockers where related to neutron (even if client side), I wouldn't exclude an involvement12:57
EmilienMpanda: yeah. I haven't checked on RDO side, if we have all UC up-to-date12:58
*** bfournie has quit IRC12:59
*** rbrady-afk has joined #tripleo13:00
*** trown|outtypewww is now known as trown13:00
*** dprince has joined #tripleo13:02
gfidentesshnaidm I think we have this https://review.openstack.org/#/c/338088/ waiting on a change in the ovb networking13:03
gfidentedoes that answer the question you posted on gerrit?13:03
sshnaidmgfidente, I wonder if we need to do it during the feature freeze of in the next cycle13:04
sshnaidmgfidente, considering http://lists.openstack.org/pipermail/openstack-dev/2017-January/111312.html13:05
openstackgerritAna Krivokapic proposed openstack/python-tripleoclient master: Add plan export command  https://review.openstack.org/42585813:05
gfidentesshnaidm ack though that change is just adding an env file to the deploy line13:07
*** rbrady-afk is now known as rbrady13:07
gfidenteI'd prefer to push it in oooq instead of missing that13:07
*** ramishra has quit IRC13:07
openstackgerritFlorian Fuchs proposed openstack/tripleo-ui master: [WIP] Add i18n to Notifications  https://review.openstack.org/41946913:07
EmilienMshardy: the upgrade job is failing on: http://logs.openstack.org/70/426370/10/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/ee3c3d3/logs/var/log/undercloud_upgrade.txt.gz#_2017-02-02_09_31_32_00013:08
EmilienMwhich has been fixed in instack-undercloud13:08
gfidentesshnaidm wdyt?13:08
*** mburned is now known as mburned_out13:08
EmilienMshardy: I'll check with rdo folks if this patch has been built in ocata builder13:08
sshnaidmgfidente, I'm fine if other are too. panda ?13:09
shardyEmilienM: yeah we seem to be hitting a few issues recently where rdo-trunk-master actually isn't trunk13:09
*** mburned_out is now known as mburned13:10
*** karimb has joined #tripleo13:10
*** ramishra has joined #tripleo13:11
EmilienMshardy: well, it's weird. In the logs, I see instack-undercloud-6.0.0-0.20170201191346.0b02f14.el7.centos.noarch is deployed, which contains the novaclient fix13:11
pandasshnaidm: in a meeting, checking later13:11
*** egafford has quit IRC13:12
*** ccamacho is now known as ccamacho|lunch13:12
EmilienMshardy: I'm creating a bug in launchpad13:12
gfidentepanda sshnaidm I'll comment on the gerrit submission so we can discuss async13:14
*** akuznetsov has joined #tripleo13:15
*** pgadiya has quit IRC13:16
gfidente sshnaidm in which repo are the oooq/ci scenarios ?13:16
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: TripleO CI status: add gate-tripleo-ci-centos-7-undercloud-upgrades-nv  https://review.openstack.org/42813213:18
sshnaidmgfidente, if we talk about templates, it's usually in https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-deploy/tasks/pre-deploy.yml13:18
*** ramishra has quit IRC13:19
sshnaidmderekh, hi13:20
derekhsshnaidm: hi ya13:21
*** fultonj has joined #tripleo13:21
*** jprovazn has quit IRC13:21
*** ramishra has joined #tripleo13:21
EmilienMshardy: I'm investigating the undercloud upgrade issue, I found a job passing last evening, I think it's a packaging thing13:22
shardyEmilienM: Ok, thanks for looking into it13:22
sshnaidmderekh, maybe you know, I see last image in dev envs on rh1 is from Tue Jan 10 11:53:46. Could it be that they're not updated anymore..?13:23
*** jprovazn has joined #tripleo13:23
EmilienMshardy: ok I found it13:24
EmilienMshardy: we didn't unpin novaclient on stable/ocata, only on trunk13:24
EmilienMshardy: I'll fix it (if I find how)13:24
EmilienMjpena: can you help on this one please? ^13:24
derekhsshnaidm: interesting, maybe infra is hitting errors when trying to upload it, it would be worth asking them to see if they are seeing errors13:24
EmilienMjpena: let me go on #rdo13:25
sshnaidmderekh, ok, will ask13:25
jpenaEmilienM: the ocata worker uses the same pings as master for now, let me check it13:25
*** morazi has joined #tripleo13:26
gfidentesshnaidm is it possible I don't see any scenario using ceph in there?13:26
sshnaidmderekh, I'll check if it's only for dev env tenant..13:26
sshnaidmgfidente, oh, we have configs too: https://github.com/openstack/tripleo-quickstart/tree/master/config/general_config13:27
derekhsshnaidm: ahh, that could be it, there was a cron job that made the images that infra uploaded public13:27
sshnaidmgfidente, but it's gonna change and be simpler and cleaner..13:27
derekhsshnaidm: [stack@undercloud ~]$ crontab -l13:28
derekh36 * * * * /usr/local/bin/make-infra-images-public13:28
sshnaidmderekh, yeah, it's the same images, from Dec and 10 Jan13:30
derekhsshnaidm: hmm, looks like the openstack-nodepool user doesn't have any new images either13:30
sshnaidmderekh, wasn't it something with those 7.3 problems related..?13:30
*** jayg|g0n3 is now known as jayg13:30
openstackgerritDan Radez proposed openstack/tripleo-puppet-elements master: Adding congress package to overcloud  https://review.openstack.org/42814213:31
openstackgerritMerged openstack/instack-undercloud master: Remove ramdisk rebuild from overcloud-full element  https://review.openstack.org/42747513:31
openstackgerritMerged openstack/instack-undercloud master: Add a pre-upgrade online_data_migration step for undercloud  https://review.openstack.org/42532313:31
derekhsshnaidm: oohhh, yes, I seem to remember something being disabled in infra so they wouldn't update to a bad image13:31
openstackgerritMerged openstack/tripleo-heat-templates master: Use common directory in CI scenario for net-config  https://review.openstack.org/42705213:31
openstackgerritMerged openstack/instack-undercloud master: Add a release note regarding inspector switch to mysql from sqlite  https://review.openstack.org/42760413:32
openstackgerritMerged openstack/tripleo-heat-templates master: Temporary UCSM mapping files should be opened with write mode  https://review.openstack.org/39059113:32
openstackgerritMerged openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/42462713:32
bandinihttps://review.openstack.org/#/c/426113/ a fairly simple review, if anyone has the time13:33
openstackgerritMerged openstack/instack master: Updated from global requirements  https://review.openstack.org/42210013:33
*** morazi has quit IRC13:34
*** rlandy has joined #tripleo13:34
openstackgerritDan Prince proposed openstack/python-tripleoclient master: Deploy the undercloud with Heat  https://review.openstack.org/35135113:35
openstackgerritDan Prince proposed openstack/python-tripleoclient master: Add heat_launcher module to help launch heat-all  https://review.openstack.org/42753013:35
openstackgerritDan Prince proposed openstack/python-tripleoclient master: Add fake_keystone class  https://review.openstack.org/42753113:35
*** ansmith has joined #tripleo13:35
openstackgerritMerged openstack/tripleo-heat-templates master: Don't run yum_update.sh inside docker  https://review.openstack.org/41151113:36
*** dprince has quit IRC13:36
derekhsshnaidm: looks like that problem was Dec 16th http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-12-16.log.html13:37
derekhsshnaidm: so probably not related (if we're thinking of the same problem)13:37
*** dprince has joined #tripleo13:38
sshnaidmderekh, about https://bugs.launchpad.net/tripleo/+bug/1650503 ?13:38
openstackLaunchpad bug 1650503 in tripleo "nodepool slaves failing to boot" [Critical,Fix released]13:38
sshnaidmderekh, have you reopened port since then?13:39
sshnaidmderekh, actually if we have image from Jan 10, then yes..13:40
pandagfidente: I think you should rebase that change, liberty references were already remove everywhere13:41
derekhsshnaidm: ya, it must be something else,  the glance api.log is full of 404's , I'd start there I think13:42
*** pradk has joined #tripleo13:42
sshnaidmderekh, hmm.. look http://paste.openstack.org/show/597356/13:42
*** gkadam has quit IRC13:43
sshnaidmderekh, we have new centos-7 images, not template-centos-713:43
derekhsshnaidm: although those might be normal, it probable worth asking #infra if they are seeing errors in nodpool13:43
sshnaidmderekh, and these centos-7 are really new, from yesterday..13:44
pandagfidente: and for quickstart, you may just open a bug, I'll see if I can create a tag "transitions" just linking it to this review. There's nothing in quickstart itself that can accept this change, we'll have to take it into consideration in the transition scripts.13:44
derekhsshnaidm: so they have just renamed them13:44
sshnaidmderekh, yeah13:44
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Disable puppet on upgrade for roles not upgrading  https://review.openstack.org/42490513:44
sshnaidminteresting why13:44
derekhsshnaidm: I've updated the script to make them public again, the dev user should be able to use them now13:46
*** psahoo has quit IRC13:46
sshnaidmderekh, thanks.. didn't it affect our upstream jobs?13:46
* derekh doesn't know why13:46
*** bfournie has joined #tripleo13:47
*** morazi has joined #tripleo13:48
derekhsshnaidm: no, that  image is only used by nodepool to start its slaves, I assume nodepool would just use the new naming scheme13:48
derekhsshnaidm: yup $ nova show tripleo-centos-7-tripleo-test-cloud-rh1-7077392 | grep "image "13:48
derekh| image                                | centos-7-1485958803 (cf792e17-3037-48c5-9f57-a5430e5e0017)13:48
derekhsshnaidm: so alls good I think13:48
sshnaidmderekh, great, thanks13:48
*** jmelvin has joined #tripleo13:50
*** owalsh is now known as owalsh-brb13:51
gfidentepanda ok will do, thanks13:56
openstackgerritJulie Pichon proposed openstack/tripleo-image-elements master: Follow HTTP/HTTPS redirects  https://review.openstack.org/42814613:59
*** akuznetsov has quit IRC14:03
*** owalsh-brb is now known as owalsh14:03
*** dsariel has quit IRC14:04
*** amoralej is now known as amoralej|lunch14:05
*** jmelvin_ has joined #tripleo14:05
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add copy-webpack-plugin dependency  https://review.openstack.org/42814914:06
*** ooolpbot has joined #tripleo14:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124114:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124214:11
*** ooolpbot has quit IRC14:11
openstackLaunchpad bug 1661241 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]14:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]14:11
*** pradk has quit IRC14:12
karimbdtantsur shardy putting more ram surely did good for the introspection.... my bad :)14:12
*** ccamacho|lunch is now known as ccamacho14:13
dtantsuryep, I've checked as well - 2G is not enough14:13
dtantsurwhich is WOW >_<14:13
shardyyeah it's surprising we can't even do introspection with 2G but you'll need more than that for the overcloud services anyway14:13
*** Goneri has joined #tripleo14:14
*** salmankhan has quit IRC14:14
*** rhallisey has joined #tripleo14:14
*** yolanda has quit IRC14:15
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Remove dist/ directory  https://review.openstack.org/42815614:15
openstackgerritLars Kellogg-Stedman proposed openstack-infra/tripleo-ci master: allow centos-opstools repo to be enabled for multinode jobs  https://review.openstack.org/42780214:15
*** yolanda has joined #tripleo14:15
larskstrown: ^^^ per your suggestion.14:15
*** agurenko has quit IRC14:16
*** bkopilov_ has joined #tripleo14:19
*** bkopilov has joined #tripleo14:19
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci master: Use HCI Ceph in HA job  https://review.openstack.org/33808814:19
*** nmathew has joined #tripleo14:20
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: toci_gate_test: allow to run upgrade jobs for scenarios  https://review.openstack.org/42637014:21
*** tzumainn has joined #tripleo14:21
karimbshardy got a point14:21
karimb:)14:21
*** nmathew- has quit IRC14:21
*** jprovazn has quit IRC14:21
*** jcoufal has joined #tripleo14:22
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add copy-webpack-plugin dependency  https://review.openstack.org/42814914:24
honzajpich: the new dependency for tripleo-ui is for this bug https://bugs.launchpad.net/tripleo/+bug/166126114:24
openstackLaunchpad bug 1661261 in tripleo "Python jobs for tripleo-ui fail in CI" [High,In progress] - Assigned to Honza Pokorny (hpokorny)14:24
*** jeckersb_gone is now known as eck`14:24
honzajpich: given that it's a blocker for ocata release notes, should we target it to ocata-rc1?14:25
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Deploy Manila with CephMDS in scenario004  https://review.openstack.org/42338614:25
jpichhonza: Cool. Explanations in commit messages to help reviewers to understand context are good too :)14:25
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Remove dist/ directory  https://review.openstack.org/42815614:25
honzajpich: ugh, sorry, sloppy of me :(14:26
jpichhonza: Normally it should be too late for adding new requirements at this stage but since the tripleo-ui lives a bit outside of the main requirements we probably can wriggle something out as long as the RDO folks are ok with it...14:27
*** amoralej|lunch is now known as amoralej14:27
gfidentemarios about https://review.openstack.org/#/c/426919/2/extraconfig/tasks/major_upgrade_ceph_storage.sh14:27
jpichhonza: I am worried about renaming 'dist' though, especially this late in the cycle. Won't it affect deployments as well? We have a dist directory under /var/www/etc14:27
gfidentemarios should I remove the cat >> or the script entirely>14:28
jpichhonza: aka do things need to change in puppet-tripleo, are there additional tests to be run to make sure upgrades will be smooth...14:28
jpichhonza: No problems re:commit message. I made a 2nd comment about it with an example, I think it'd be good to list the licence in the commit message too, for easier reviewing from the packaging's perspective14:29
*** jbadiapa has joined #tripleo14:29
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Update introspection command to introspect only manageable nodes  https://review.openstack.org/42816014:29
*** udesale has joined #tripleo14:29
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add copy-webpack-plugin dependency  https://review.openstack.org/42814914:29
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration.  https://review.openstack.org/42809314:29
*** liverpooler has joined #tripleo14:30
*** nmathew- has joined #tripleo14:30
honzajpich: we're still keeping the dist dir, just removing files from git --- the dir will be populated on build14:30
*** egafford has joined #tripleo14:30
*** liverpooler has quit IRC14:30
*** lblanchard has joined #tripleo14:30
*** liverpooler has joined #tripleo14:30
*** prateek has joined #tripleo14:32
*** salmankhan has joined #tripleo14:32
*** gbarros has joined #tripleo14:32
jpichhonza: Oh, magic...14:32
jpichhonza: I see this is also Partial-Bug, what's left for this?14:33
honzajpich: see patch in the same gerrit topic14:33
*** jprovazn has joined #tripleo14:33
*** jprovazn is now known as jprovazn_14:33
jpichhonza: They both seem to be Partial-Bug?14:33
ansiwenowalsh, marios, matbu, mwhahaha, shardy: I created an etherpad to track all the different steps to really fix the online_data_migration issue, because it's getting a bit confusing. could you add the relevant changes, so we can see what is still missing? https://etherpad.openstack.org/p/tripleo-nova-online-data-migration14:33
*** jprovazn_ is now known as jprovazn14:33
honzajpich: yes?14:33
*** nmathew has quit IRC14:34
jpichhonza: The last patch needed to fix a problem should have Closes-Bug on it, so that the Launchpad status is correctly updated when it merges14:34
honzajpich: ok14:34
jpichhonza: ...and so that confused reviewers understand there are no more patches needed after that to fix the problem :-)14:34
* jpich <-14:34
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Remove dist/ directory  https://review.openstack.org/42815614:35
*** jprovazn has quit IRC14:36
jpichhonza: Sad so much engineering is needed because of this :( This is not reno-specific, but because of the way Python builds things, is that correct?14:37
honzajpich: yes14:37
* jpich wishes we could add a "--dir=python_dist/" somewhere and be done with it rather than rework the whole thing14:37
jpichok14:37
honzajpich: I think the end result makes for more semantic solution14:37
jpichhonza: I'm not sure what that means but if you can live with it ok++ :-)14:39
*** zzzeek has quit IRC14:40
honzajpich: e.g. the index.html is a source file, not a dist artifact14:40
*** zzzeek has joined #tripleo14:40
jpichhonza: Ok!14:42
*** jmelvin_ has quit IRC14:42
jristhonza: why remove the sample?14:43
jristnevermind14:44
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Implement check boot images as a custom action  https://review.openstack.org/42817714:45
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Implement check flavors as a custom action  https://review.openstack.org/42817814:45
*** gbarros has quit IRC14:45
jristalso the index could be generated by webpack14:45
jristhonza: why does jenkins hate this? heh14:45
honzajrist: missed dependency14:45
jristah14:45
honzajrist: in another patch14:45
jristso we do the one patch, then the other patch should work?14:45
jristDepends-On?14:45
honzajrist: i looked into the webpack generating the index file idea but it made me sad14:46
jristlol14:46
jrist+114:46
jristI have it in a patch locally14:46
*** nmathew- has quit IRC14:46
jristbut I don't like it14:46
*** gbarros has joined #tripleo14:46
honzaand this dep could be used for other things14:46
jristbecause the output isn't formatted14:46
*** nmathew has joined #tripleo14:46
*** nmathew has quit IRC14:52
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Implement check flavors as a custom action  https://review.openstack.org/42817814:53
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates master: Add pacemaker composable upgrade steps  https://review.openstack.org/40339714:54
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: List nova instances after overcloud deploy  https://review.openstack.org/42818714:55
*** fzdarsky|afk is now known as fzdarsky|lunch14:57
*** fzdarsky|lunch is now known as fzdarsky14:57
*** udesale has quit IRC15:00
jtomasekhonza: tripleo_ui_config is created separately during undercloud install, right?15:01
honzajtomasek: yes, via puppet15:01
jtomasekok15:01
*** prateek has quit IRC15:02
*** sudipto_ has joined #tripleo15:03
*** sudipto has joined #tripleo15:03
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Update build nodes task to use the cloud config  https://review.openstack.org/42819315:04
*** nmathew has joined #tripleo15:04
*** jprovazn has joined #tripleo15:04
*** karts has joined #tripleo15:06
adarazsCI Squad meeting in half an hour - https://etherpad.openstack.org/p/tripleo-ci-squad-meeting - plz add agenda items (EmilienM, rbrady, trown, sshnaidm, weshay, hrybacki, panda, rlandy, bkero) :)15:06
*** karthiks has quit IRC15:07
*** numans_ has joined #tripleo15:07
*** jkilpatr has quit IRC15:07
*** numans- has joined #tripleo15:08
shardymcornea: Hey, so you can skip the validation if you have https://review.openstack.org/#/c/424072/15:08
shardymcornea: however yesterday the related heat-agents patch wasn't available in RDO trunk builds, so I worked around it like this15:09
*** numans has quit IRC15:09
shardyhttp://paste.fedoraproject.org/543055/04816814/ (line 18)15:09
shardymcornea: you'd also have an environment which sets SkipUpgradeConfigTags: validation15:10
*** karts has quit IRC15:10
shardyhttp://paste.fedoraproject.org/543056/4860482015:10
mcorneashardy: thank you, I'll try it15:10
*** ooolpbot has joined #tripleo15:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124115:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124215:11
*** ooolpbot has quit IRC15:11
openstackLaunchpad bug 1661241 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]15:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]15:11
*** numans_ has quit IRC15:11
nmathewhi all15:13
nmathewI need a help on extra_specs15:13
nmathewfor flavor creation, code is here https://paste.fedoraproject.org/543061/15:14
nmathewcan anybody tell whether sysntax for mem_page_size is correct15:14
openstackgerritMerged openstack/tripleo-heat-templates master: Allow the override of pacemaker::corosync::settle_tries  https://review.openstack.org/42611315:16
*** dbecker has quit IRC15:16
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Update build nodes task to use the cloud config  https://review.openstack.org/42819315:18
*** abregman has quit IRC15:20
*** dbecker has joined #tripleo15:20
*** flepied has quit IRC15:20
*** numans has joined #tripleo15:21
*** jkilpatr has joined #tripleo15:22
*** karts has joined #tripleo15:22
openstackgerritMerged openstack/tripleo-puppet-elements master: Adding tacker package to overcloud  https://review.openstack.org/42794915:23
*** rasca__ is now known as rasca15:23
*** numans- has quit IRC15:24
nmathewexample is here https://github.com/openstack/tacker/blob/master/tacker/tests/unit/vm/infra_drivers/openstack/data/hot_tosca_flavor_all_numa_count.yaml15:24
*** cylopez has quit IRC15:24
*** saneax is now known as saneax-_-|AFK15:26
*** ealcaniz has quit IRC15:27
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: toci_gate_test: allow to run upgrade jobs for scenarios  https://review.openstack.org/42637015:27
sshnaidmEmilienM, ^^ let's try it15:28
EmilienMsshnaidm: thanks15:28
EmilienMsshnaidm: on other patch, we need to run "check experimental" to test it15:28
sshnaidmEmilienM, ok15:28
openstackgerritSagi Shnaidman proposed openstack/tripleo-heat-templates master: DNM - test scnario001-upgrade experimental job  https://review.openstack.org/42637215:29
sshnaidmEmilienM, why don't we run on the same patch?15:29
EmilienMsshnaidm: because the CI job is run only when you patch THT for now15:29
sshnaidmEmilienM, oh, I see,15:30
*** prateek has joined #tripleo15:30
*** prateek has quit IRC15:30
*** rajinir has joined #tripleo15:30
*** pradk has joined #tripleo15:32
bnemecnmathew: That's not valid yaml, but you probably want to ask in the tacker channel.15:32
*** artom_ has quit IRC15:32
*** artom_ has joined #tripleo15:32
openstackgerritRicardo Noriega proposed openstack/tripleo-heat-templates master: Add BGPVPN composable service  https://review.openstack.org/42808915:33
nmathewbnemec, thanks, i will ask in tacker15:33
*** prateek has joined #tripleo15:33
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: TEST - try to fix undercloud-upgrade  https://review.openstack.org/42820515:34
*** jaosorior has joined #tripleo15:37
bnemecEmilienM: What is the reasoning behind ^15:38
*** idlemind has joined #tripleo15:38
openstackgerritJulie Pichon proposed openstack/tripleo-ui master: Fix up string punctuation  https://review.openstack.org/42820815:39
EmilienMbnemec: I'm trying to see why we have http://logs.openstack.org/70/426370/10/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/ee3c3d3/logs/var/log/undercloud_upgrade.txt.gz#_2017-02-02_09_31_32_000 with the novaclient 7.1.0 (while we should have this TRACE)15:39
EmilienMbnemec: i'm trying to see if instack-undercloud use the right method to auth against nova15:39
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Add repo configuration to release configs  https://review.openstack.org/42421215:40
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Move libvirt_uri to common role  https://review.openstack.org/42431915:40
EmilienMbnemec: https://bugs.launchpad.net/tripleo/+bug/166124215:40
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]15:40
*** nmathew has quit IRC15:45
EmilienMbnemec: if you have any thoughts on this one, any help is welcome15:46
*** sanagikoki has joined #tripleo15:47
*** prateek has quit IRC15:48
*** abehl has quit IRC15:48
openstackgerritBen Kero proposed openstack-infra/tripleo-ci master: WIP: Add scenario testing for multinode-oooq jobs  https://review.openstack.org/42746815:51
gfidenteEmilienM saw your comment on https://review.openstack.org/#/c/338088/15:51
gfidentethe problem with that is we didn't get ovb to use storagemgmt network on the compute nodes yet15:52
gfidentehttps://review.openstack.org/#/c/41904915:52
openstackgerritJulie Pichon proposed openstack/tripleo-ui master: Fix up string punctuation  https://review.openstack.org/42820815:52
gfidenteit's not really a big change on the CI tools, it's more of an infra issue15:53
gfidenteEmilienM, panda suggested opening a bug for oooq to track it during the migration, which is what we did earlier today https://bugs.launchpad.net/tripleo-quickstart/+bug/166125715:53
openstackLaunchpad bug 1661257 in tripleo "Use specific env files (eg. Ceph/HCI) based on target CI job" [High,Triaged]15:53
*** numans has quit IRC15:55
bnemecgfidente: I am incredibly confused by the failures on that last patch set.15:55
bnemecSetting the mtu properly seems to have broken the compute node deployments. :-(15:55
bnemecWhich makes no sense.15:55
*** jbadiapa has quit IRC15:56
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Implement check flavors as a custom action  https://review.openstack.org/42817815:57
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Implement check ironic boot configuration as a custom action  https://review.openstack.org/42822515:57
gfidentebnemec yeah np I was trying to keep the hci scenario going15:57
gfidenteif we have to deal with infra/config issues, I think that is part of the scope for the hci scenario15:57
*** twiggy_ has quit IRC15:57
*** twiggy has joined #tripleo15:58
gfidentebnemec, panda thinking more about it; how is oooq dealing with the storagemgmt enablement for ovb? is that planned already?15:58
gfidentesshnaidm trown ^^ for the hci scenario bnemec was also trying to enable the storagemgmt network for some jobs15:59
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy novajoin in the TLS-everywhere job  https://review.openstack.org/42748116:00
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job (novajoin)  https://review.openstack.org/42748216:00
gfidentesshnaidm trown specifically https://review.openstack.org/#/c/419049/ and https://review.openstack.org/#/c/422297/16:00
openstackgerritNuman Siddique proposed openstack/tripleo-heat-templates master: OVN plugin configuration fixes  https://review.openstack.org/39767416:00
gfidenteis this a "planned" feature for the migration to oooq?16:01
*** tremble has quit IRC16:02
ansiwenmarios: I wanna do this pre-upgrade online_data_migration also for the overcloud https://review.openstack.org/#/c/425323/16:03
ansiwenmarios: what's the best way to do it?16:03
ansiwenshardy: I'm sure you could also tell me ^^^ ;-)16:04
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Implement check ironic boot configuration as a custom action  https://review.openstack.org/42822516:04
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Implement check flavors as a custom action  https://review.openstack.org/42817816:04
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Implement check boot images as a custom action  https://review.openstack.org/42817716:04
*** dsariel has joined #tripleo16:04
*** dprince has quit IRC16:05
*** numans has joined #tripleo16:06
*** twiggy_ has joined #tripleo16:06
mcorneashardy: hi again. re https://review.openstack.org/#/c/424905/ : i'm trying to test it but I get this error:16:07
*** twiggy has quit IRC16:07
mcornea u'message': u'Failed to run action [action_ex_id=77ed76ea-1dfe-4fda-be27-3934a9d41911, action_cls=\'<class \'mistral.actions.action_factory.DeployStackAction\'>\', attributes=\'{}\', params=\'{u\'container\': u\'overcloud\', u\'timeout\': 240}\']\n ERROR: Failed to validate: : resources.AllNodesDeploySteps: : Failed to validate: resources.AllNodesPostUpgradeSteps: "" is not a map',16:07
*** twiggy has joined #tripleo16:08
mcorneashardy: this is what it looks like in the rendered version: http://paste.openstack.org/show/597386/16:08
mcorneashardy: I only have controller, computes and ceph nodes on this deployment16:08
*** dprince has joined #tripleo16:09
*** twiggy_ has quit IRC16:11
*** ooolpbot has joined #tripleo16:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124216:11
*** ooolpbot has quit IRC16:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]16:11
shardymcornea: Hmm, thanks - let me try to reproduce, I've only been testing on a single node, perhaps we need a map_merge16:11
*** iranzo has quit IRC16:13
*** flepied has joined #tripleo16:15
*** [1]cdearborn has joined #tripleo16:15
dtantsurbnemec, may I please chase you again to review https://review.openstack.org/#/c/427307/ ? :)16:18
*** milan has quit IRC16:22
EmilienMbnemec: same error: http://logs.openstack.org/05/428205/1/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/0845f6e/logs/var/log/undercloud_upgrade.txt.gz#_2017-02-02_16_16_19_00016:22
*** katkapilatova has left #tripleo16:22
openstackgerritMichael  Henkel proposed openstack/tripleo-heat-templates master: Re-organizes Contrail services to the correct roles  https://review.openstack.org/42571716:24
bnemecEmilienM: :-(, but not surprising.  I'm not sure that patch could have passed in the first place if the logic had been wrong.16:24
*** kberger has joined #tripleo16:25
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration.  https://review.openstack.org/42809316:25
EmilienMbnemec: any idea why it fails otherwise?16:26
*** rcernin has quit IRC16:29
shardymcornea: Hmm, I currently can't reproduce, can you capture the output of this command please?16:29
shardyopenstack stack show $(openstack stack resource show overcloud AllNodesDeploySteps -c physical_resource_id -f value)16:29
*** paramite has quit IRC16:29
*** gbarros has quit IRC16:30
mcorneashardy: http://paste.openstack.org/show/597393/16:30
*** cdearborn has quit IRC16:31
*** jkilpatr has quit IRC16:34
*** akuznetsov has joined #tripleo16:35
*** jkilpatr has joined #tripleo16:37
*** abregman has joined #tripleo16:38
*** tesseract has quit IRC16:41
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker_puppet_tasks initialization on primary node  https://review.openstack.org/42656516:41
abregmantrozet: hi o/. I tried to deploy OpenDaylight with Director, but when running networking tests, some of them fail. same deployment without OpenDaylight, everything pass. Can I ask you to take a look on the files I'm using to deploy OpenDaylight? perhaps I'm not doing it right16:41
*** anshul has joined #tripleo16:41
shardymcornea: Ok thanks, that's incomplete but I can see you're using the default roles_data?16:42
mcorneashardy: yes, it's the default16:42
shardymcornea: OK let me try that locally16:42
shardymcornea: I think this shows we should use the default roles_data in CI instead of a special one16:43
shardyI'll look into changing that16:43
openstackgerritFlorian Fuchs proposed openstack/tripleo-ui master: [WIP] Add i18n to Notifications  https://review.openstack.org/41946916:44
mcorneashardy: yeah, I think it's still a common usecase to use the default roles_data16:45
shardymcornea: yup, agreed - thanks for the quick test feedback on this :)16:45
mcorneashardy: np, I feel I'm getting close to getting an upgrade complete so I'm excited about it :)16:46
*** akuznetsov has quit IRC16:46
*** ebarrera has quit IRC16:47
*** artom_ is now known as artom16:47
*** cdearborn has joined #tripleo16:51
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates master: Composable services support for Cinder Dell EMC PS Series  https://review.openstack.org/42586116:54
*** jlinkes has quit IRC16:54
jaosoriorbnemec: is it normal that dhcp-interface@ovs-system.service  is down?16:55
bnemecjaosorior: Yeah, that's dhcp-all-interfaces trying to DHCP something it can't.16:55
jaosoriorbnemec: ok, so that should be fine?16:56
EmilienMcan someone approve this easy one? https://review.openstack.org/#/c/428132/16:57
bnemecjaosorior: Yeah, shouldn't cause any problems.16:57
bnemecOne of these days we're going to run out of space on the cistatus page.16:58
*** thrash is now known as thrash|biab16:59
*** gbarros has joined #tripleo17:00
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates master: Composable service support for Cinder Dell EMC Storage Center  https://review.openstack.org/42586617:00
*** athomas has quit IRC17:00
*** rsevilla has joined #tripleo17:01
*** dsneddon is now known as dsneddon_afk17:01
openstackgerritRicardo Noriega proposed openstack/tripleo-heat-templates master: Add BGPVPN composable service  https://review.openstack.org/42808917:01
*** liverpooler has quit IRC17:02
*** liverpooler has joined #tripleo17:03
*** [1]cdearborn has quit IRC17:04
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: toci_gate_test: allow to run upgrade jobs for scenarios  https://review.openstack.org/42637017:04
*** sdake has joined #tripleo17:06
openstackgerritJulie Pichon proposed openstack/python-tripleoclient master: Testing - Do Not Merge  https://review.openstack.org/42826617:07
*** sdake_ has quit IRC17:07
*** ooolpbot has joined #tripleo17:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124217:11
*** ooolpbot has quit IRC17:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]17:11
*** suuuper has quit IRC17:11
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci master: Fix floating IP tenant stack template path  https://review.openstack.org/42772517:11
*** abregman is now known as abregman|afk17:13
shardymcornea: Ok I reproduced it now, looking into a fix17:13
mcorneashardy: great,please let me know when it's ready so I can test it17:14
*** gbarros has quit IRC17:15
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add scenario005 scenario  https://review.openstack.org/41809917:20
*** jpich has quit IRC17:22
openstackgerritMerged openstack/instack-undercloud master: Move handling keys for hieradata template completely to instack_undercloud module  https://review.openstack.org/42730717:23
*** dsariel has quit IRC17:24
*** flepied has quit IRC17:24
*** panda is now known as panda|bbl17:26
*** dtantsur is now known as dtantsur|afk17:26
*** sdake_ has joined #tripleo17:27
*** sdake has quit IRC17:28
*** thrash|biab is now known as thrash17:29
*** sshnaidm is now known as sshnaidm|afk17:31
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates master: Enables support for configuring Cinder with Dell EMC ScaleIO storage backend.  https://review.openstack.org/42223817:35
*** ramishra has quit IRC17:38
*** chlong has joined #tripleo17:39
*** karimb has quit IRC17:41
*** rsevilla has quit IRC17:41
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy novajoin in the TLS-everywhere job  https://review.openstack.org/42748117:42
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job (novajoin)  https://review.openstack.org/42748217:42
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Delete legacy Ceph upgrade scripts  https://review.openstack.org/42691917:44
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: docker: new hybrid deployment architecture and configuration  https://review.openstack.org/41642117:47
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker_puppet_tasks initialization on primary node  https://review.openstack.org/42656517:47
*** jbadiapa has joined #tripleo17:48
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Remove special handling for OVS upgrade  https://review.openstack.org/42828817:48
*** rhallisey has quit IRC17:50
*** lucasagomes is now known as lucas-afk17:51
*** dcritch has quit IRC17:51
*** dcritch has joined #tripleo17:52
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker keystone service  https://review.openstack.org/41660517:52
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates master: Switch item notation to jinja format  https://review.openstack.org/42829317:52
*** rhallisey has joined #tripleo17:52
*** sudipto_ has quit IRC17:53
*** sudipto has quit IRC17:53
dtrainorCan someone guide me to information on how I can verify or lint reno notes?  'reno report' generates the notes I made in the format i requested in a terminal, including my list, but the list is not generated the same way in the gate-puppet-tripleo-releasenotes gate (even though the gate still passes).  I'm looking for information about what process is used to generate the html-ized version and coming up short.17:54
mcorneagfidente: shardy could you please check this quick one: https://review.openstack.org/428293 ?17:54
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker mysql service  https://review.openstack.org/41460117:54
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Containerized MongoDB  https://review.openstack.org/42334717:57
*** abregman|afk has quit IRC17:57
*** owalsh is now known as owalsh-afk17:57
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Enable docker services in the registry  https://review.openstack.org/42156718:00
dtrainori want to see what the formatted html text looks like myself instead of waiting for a gate to show me that it's wrong18:02
gfidentemcornea++ thanks18:02
*** owalsh-afk has quit IRC18:03
*** derekh has quit IRC18:03
*** mburned is now known as mburned_out18:03
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Disable puppet on upgrade for roles not upgrading  https://review.openstack.org/42490518:08
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Simplify/fix config enabled conditions for upgrades  https://review.openstack.org/42830918:08
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Reduce number of steps for upgrades  https://review.openstack.org/42831018:08
*** nyechiel has quit IRC18:08
shardymcornea: ^^18:08
shardymcornea: you don't necessarily need the extra two patches but https://review.openstack.org/424905 should work now I think18:08
mcorneashardy: cool, I'll try it18:09
shardymcornea: note that I spotted another issue - batched upgrades aren't disabled by the roles_data flag18:10
shardyfixing that now18:10
*** ooolpbot has joined #tripleo18:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124218:11
*** ooolpbot has quit IRC18:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]18:11
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart master: Ensure gate jobs verify sphinx output  https://review.openstack.org/42593618:12
*** trown is now known as trown|lunch18:16
openstackgerritMerged openstack/tripleo-quickstart master: update openstack-tripleo-doc, when using master-tripleo-ci release  https://review.openstack.org/42779018:18
openstackgerritMerged openstack/tripleo-ui master: Fix up string punctuation  https://review.openstack.org/42820818:19
*** rasca has quit IRC18:20
openstackgerritPetr Kovar proposed openstack/tripleo-docs master: Fix a TBD, broken links and markup  https://review.openstack.org/42833318:20
*** rhallisey has quit IRC18:21
*** jkilpatr_ has joined #tripleo18:21
*** fzdarsky is now known as fzdarsky|afk18:22
EmilienMshardy, sshnaidm|afk: quick update, scenario001-upgrade is now running but not passing yet18:23
EmilienMhttp://logs.openstack.org/72/426372/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-upgrades-nv/d2d98b3/console.html#_2017-02-02_17_56_40_37355418:23
*** jkilpatr has quit IRC18:23
EmilienM2017-02-02 17:56:40.413240 | Command: openstack image create sanity_test FAILED18:23
EmilienMsounds like glance is down after upgrade, I'll investigate18:24
*** dcritch has quit IRC18:25
*** nyechiel has joined #tripleo18:25
*** yamahata has joined #tripleo18:27
openstackgerritDan Trainor proposed openstack/puppet-tripleo master: Proxy API endpoints that UI uses  https://review.openstack.org/42490918:29
*** tosky has quit IRC18:30
EmilienMshardy: I found this thing when we upgrade Glance with RBD backend http://logs.openstack.org/72/426372/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-upgrades-nv/d2d98b3/logs/subnode-2/var/log/glance/api.txt.gz#_2017-02-02_17_56_40_26118:34
*** dcritch has joined #tripleo18:38
dtrainorre: reno, i was able to generate the html-formatted releasenotes and confirm what was going on using a browser (seems that 'reno report' generates text that's different than what one would see in the formatted html)18:38
*** gfidente is now known as gfidente|afk18:38
*** dsneddon_afk is now known as dsneddon18:40
EmilienMshardy: well, it sounds like it failed before the upgrade process18:41
EmilienMshardy: so it's probably in the env that was loaded to deploy the overcloud18:41
shardyEmilienM: yeah looks like something was broken but not related to the upgrade18:43
openstackgerritMichael Glaser proposed openstack/tripleo-incubator master: tox -e docs fail, need to Pin docutils version  https://review.openstack.org/42834718:43
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Disable batch upgrade deployments for disabled roles  https://review.openstack.org/42834818:44
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add batch upgrade configs to output & clarify disabled configs  https://review.openstack.org/42834918:44
EmilienMshardy: I'll investigate18:45
*** shardy has quit IRC18:45
*** mburned_out is now known as mburned18:50
*** karimb has joined #tripleo18:52
*** dcritch has quit IRC18:53
*** dcritch has joined #tripleo18:53
*** pkovar has quit IRC18:54
openstackgerritMichael Glaser proposed openstack/tripleo-incubator master: tox -e docs fail, need to Pin docutils version  https://review.openstack.org/42834718:55
EmilienMit's impossible to run tripleo CI with daily promotion within a single week in a cycle18:55
*** Goneri has quit IRC18:55
bnemecEmilienM: You mean stuff breaks too often to promote daily?18:56
EmilienMyes18:56
EmilienMnova breaks every day18:56
openstackgerritBen Kero proposed openstack-infra/tripleo-ci master: WIP: Add scenario testing for multinode-oooq jobs  https://review.openstack.org/42746818:56
bnemecCan't argue with that.19:00
bnemecIt's a cause for celebration if we get through even one day without _something_ breaking us.19:00
EmilienMhttps://bugs.launchpad.net/nova/+bug/1661360 now19:01
openstackLaunchpad bug 1661360 in tripleo "tempest test fails with "Instance not found" error" [Critical,Triaged]19:01
*** fzdarsky|afk is now known as fzdarsky19:01
bkeroCue the push to nixos-ify openstack19:01
bnemecI guess it is feature freeze.  Tis the season to break things as major changes get merged last-minute.19:06
bnemecHappens pretty much every cycle.19:06
bnemec(and TripleO's got no room to throw stones on that)19:07
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: add quickstart release files for ocata  https://review.openstack.org/42836219:07
*** gbarros has joined #tripleo19:09
*** yprokule has quit IRC19:09
*** mcornea has quit IRC19:10
*** ooolpbot has joined #tripleo19:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124219:11
*** ooolpbot has quit IRC19:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]19:11
bnemecEmilienM: Still no leads on the undercloud upgrade bug?19:15
EmilienMno19:16
EmilienMand I'm currently investigating another nova thing19:16
EmilienMthat blocks promotion19:16
*** karimb has quit IRC19:16
bnemecEmilienM: Okay, I'll set up a local env and see what I can find.19:17
*** karimb has joined #tripleo19:17
EmilienMbnemec: thanks19:18
*** ipsecguy has quit IRC19:18
*** ipsecguy has joined #tripleo19:19
*** salmankhan has quit IRC19:20
*** trown|lunch is now known as trown19:20
*** thrash is now known as thrash|biab19:20
*** rhallisey has joined #tripleo19:22
*** fzdarsky is now known as fzdarsky|afk19:25
openstackgerritBen Kero proposed openstack-infra/tripleo-ci master: WIP: Add scenario testing for multinode-oooq jobs  https://review.openstack.org/42746819:26
bnemecHmm, four simultaneous tripleo environments.  That might be a new record for me. :-)19:29
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: add quickstart release files for ocata  https://review.openstack.org/42836219:29
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: toci_gate_test: allow to run upgrade jobs for scenarios  https://review.openstack.org/42637019:37
EmilienMbnemec: note the bug is only when you try to upgrade your undercloud19:38
bnemecEmilienM: Yeah, I have a newton undercloud installing.19:38
bnemecAlso found a pretty serious breakage in Horizon: https://bugs.launchpad.net/tripleo/+bug/166136719:39
openstackLaunchpad bug 1661367 in tripleo "Images pages blank in Horizon" [High,Triaged]19:39
*** nrado has joined #tripleo19:40
nradoHi all, can someone tell me where and how I can change the "auth_url" in the [heat] section of os-collect-config.conf?19:41
EmilienMbnemec: you might want to jump on #openstack-horizon for this one19:41
*** salmankhan has joined #tripleo19:41
bnemecIck, I can't launch an instance through horizon either.19:44
bnemecIt's amazing how broken things get when nobody uses them.19:45
nradoI've the problem that the VM (image built with diskimage-builder) I deployed within my Heat stack can't access the URL from the heat section19:45
nradois it possible to overwrite the auth_url or where does it come from?19:46
*** iranzo has joined #tripleo19:46
bnemecnrado: That sounds like a question for #openstack-heat.19:47
bnemecI should probably know, but I don't.19:47
*** dcritch has quit IRC19:48
*** rhallisey_ has joined #tripleo19:48
*** abregman|afk has joined #tripleo19:48
*** rhallisey_ has quit IRC19:48
*** rhallisey_ has joined #tripleo19:48
*** thrash|biab is now known as thrash19:49
*** rhallisey has quit IRC19:52
*** dcritch has joined #tripleo19:52
*** jkilpatr has joined #tripleo19:52
*** jkilpatr_ has quit IRC19:54
*** abregman|afk has quit IRC19:55
jkilpatrwhat sort of consensus algorithm do the HA controllers in TripleO use? Or perhaps more generally how does HA and failover work?19:55
honzaMy GUI deployment just succeeded but there are no nova instances or any ironic nodes running?  is that supposed to happen?19:56
*** abregman has joined #tripleo19:56
*** nyechiel has quit IRC19:57
*** gfidente|afk is now known as gfidente19:58
*** rhallisey_ is now known as rhallisey19:58
*** salmankhan has quit IRC19:58
EmilienMjkilpatr: it use Pacemaker and VRRP protocol afik20:00
EmilienMhonza: can you be more specific in what / how you deployed?20:01
*** fzdarsky|afk is now known as fzdarsky20:01
*** panda|bbl is now known as panda20:02
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy novajoin in the TLS-everywhere job  https://review.openstack.org/42748120:02
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job (novajoin)  https://review.openstack.org/42748220:02
*** salmankhan has joined #tripleo20:02
*** salmankhan has quit IRC20:05
*** salmankhan has joined #tripleo20:05
*** gbarros has quit IRC20:06
*** egafford has quit IRC20:10
*** ooolpbot has joined #tripleo20:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124220:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]20:11
*** ooolpbot has quit IRC20:11
*** Goneri has joined #tripleo20:13
openstackgerritBen Kero proposed openstack-infra/tripleo-ci master: WIP: Add scenario testing for multinode-oooq jobs  https://review.openstack.org/42746820:15
*** fzdarsky is now known as fzdarsky|afk20:16
*** fzdarsky|afk has quit IRC20:17
*** rbrady is now known as rbrady-afk20:17
*** mburned is now known as mburned_out20:18
*** salmankhan has quit IRC20:19
*** salmankhan has joined #tripleo20:20
*** florianf has quit IRC20:20
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Prepare 6.2.0 release  https://review.openstack.org/42840620:22
*** egafford has joined #tripleo20:24
openstackgerritFeng Pan proposed openstack/os-net-config master: Add support for VPP interface  https://review.openstack.org/42442620:24
*** salmankhan has quit IRC20:27
openstackgerritIan Main proposed openstack/tripleo-heat-templates master: Containerized Swift Services.  https://review.openstack.org/42543420:29
*** salmankhan has joined #tripleo20:30
*** jprovazn has quit IRC20:32
*** gbarros has joined #tripleo20:33
*** rhallisey has quit IRC20:37
*** rhallisey has joined #tripleo20:37
*** thrash is now known as thrash|bbl20:38
*** amoralej is now known as amoralej|off20:38
*** rhallisey has quit IRC20:39
*** rhallisey has joined #tripleo20:39
*** rhallisey has joined #tripleo20:40
*** salmankhan has quit IRC20:41
openstackgerritBen Kero proposed openstack-infra/tripleo-ci master: WIP: Add scenario testing for multinode-oooq jobs  https://review.openstack.org/42746820:42
karimbwhen running openstack overcloud install, nodes fail to start, the command just keeps waiting and the nodes show as scheduling in nova list.... any idea what can cause that. introspection went ok20:42
*** sshnaidm|afk is now known as sshnaidm|off20:42
*** flepied has joined #tripleo20:44
*** rhallisey has quit IRC20:44
*** iranzo has quit IRC20:50
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Remove old host param  https://review.openstack.org/42842020:53
*** lblanchard has quit IRC20:57
*** rhallisey has joined #tripleo20:58
openstackgerritMerged openstack-infra/tripleo-ci master: TripleO CI status: add gate-tripleo-ci-centos-7-undercloud-upgrades-nv  https://review.openstack.org/42813220:59
gfidentejkilpatr though it's not really pcmk running single instances of the services21:00
gfidenteit's just setting up the galera / rabbit / redis clustering21:00
gfidenteso the mechanisms which regulate failover are in charge to the various clustering mechanisms which the services use21:00
gfidentefor the APIs, it's HAproxy with some more-or-less-interesting backend checks21:01
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Deploy Manila with CephMDS in scenario004  https://review.openstack.org/42338621:03
*** liverpooler has quit IRC21:06
*** karimb has quit IRC21:09
jidarOh, that reminds me, is there today any way to hook into the pre-config steps of a tripleO deploy to say, add something like another exported resource to haproxy? As it stands (and in Kilo as well) the way I worked around this was by deploying the entire haproxy config into hiera and then enforcing that in post-config21:10
*** karimb has joined #tripleo21:10
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: CI: enable debug on multinode and upgrade job  https://review.openstack.org/42842621:10
jidarmy specific use case was I needed to change some of the ports being used for the public endpoints21:11
*** ooolpbot has joined #tripleo21:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124221:11
*** ooolpbot has quit IRC21:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]21:11
EmilienMcores, please review https://review.openstack.org/42842621:11
gfidentejidar the ports being used for the public endpoints I think can be customized today from the endpoint ma21:12
gfidentebut we don't have generic mechanism to override the settings we use to configure haproxy that I can think of21:13
jidarfor this specific use case, I think that would be fine. let me look into this21:13
openstackgerritMerged openstack/puppet-tripleo master: Prepare 6.2.0 release  https://review.openstack.org/42840621:15
*** jayg is now known as jayg|g0n321:15
*** jmelvin has quit IRC21:19
jidaractually, I don't see the port called out in anything but the firewall rules21:19
*** akrivoka has quit IRC21:19
jidarand those are static21:20
*** egafford has quit IRC21:21
jidarhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/horizon.yaml#L6721:21
jidarfor instance21:21
openstackgerritAlex Schultz proposed openstack/instack-undercloud master: Revert "mysqld config: set innodb_file_per_table to ON"  https://review.openstack.org/42843421:24
slaglemwhahaha: i think it was actually the puppet-tripleo patch affecting the undercloud21:26
slagleb/c all we do in the undercloud now is "include ::tripleo::profile::base::database::mysql"21:27
mwhahahayea21:27
slagleso this patch is what you would want to revert: https://review.openstack.org/#/c/427310/21:27
mwhahahai thought it was that one but it isn't21:27
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Revert "set innodb_file_per_table to ON for MySQL / Galera"  https://review.openstack.org/42843521:29
*** dprince has quit IRC21:32
*** dprince has joined #tripleo21:33
*** eck` is now known as jeckersb_gone21:35
*** morazi has quit IRC21:35
ccamachohey guys mind to check https://review.openstack.org/#/c/428062/ when having some time? Its about to move a validation to check that all templates are using the relase name alias21:37
* ccamacho going to sleep21:37
*** gfidente has quit IRC21:38
EmilienMccamacho: good night!21:38
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Revert "set innodb_file_per_table to ON for MySQL / Galera"  https://review.openstack.org/42843521:39
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates master: Add nova service support for composable upgrades  https://review.openstack.org/40524121:40
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Revert "set innodb_file_per_table to ON for MySQL / Galera"  https://review.openstack.org/42843521:43
EmilienMslagle: I'm not sure but I think I found an issue in the multinode-upgrade job, it seems like if your env is using net-config-multinode in newton and net-config-multinode-os-net-config in ocata, the upgrade fails like this: http://logs.openstack.org/72/426372/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-upgrades-nv/0203b17/console.html#_2017-02-02_20_37_23_40359221:44
EmilienMslagle: can you confirm? if yes, what do you suggest?21:44
*** karimb has quit IRC21:46
*** cdearborn has quit IRC21:48
*** jkilpatr has quit IRC21:48
*** ansmith has quit IRC21:49
*** thrash|bbl is now known as thrash21:50
slagleEmilienM: how does the NetworkDeployment fail?21:52
EmilienMslagle: i'm searching in logs21:54
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates master: Add nova service support for composable upgrades  https://review.openstack.org/40524121:57
EmilienMslagle: in which logs should I look? /me kind of lost22:02
*** karimb has joined #tripleo22:03
EmilienMslagle: I see it in heat logs22:04
EmilienMslagle: http://logs.openstack.org/72/426372/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-upgrades-nv/0203b17/logs/var/log/heat/heat-engine.txt.gz#_2017-02-02_20_37_20_99022:05
*** trown is now known as trown|outtypewww22:06
*** jmelvin has joined #tripleo22:06
slagleEmilienM: i would start by looking at the logs of the system that was executing the config associated with NetworkDeployment22:06
slaglealso have a look at the NetworkDeploymentActions parameter. NetworkDeployment shouldn't be firing at all on stack updates aiui22:07
slaglebut maybe something isn't wired up right22:07
slagleunless that was changed for upgrades22:07
*** thrash is now known as thrash|g0ne22:09
slaglei would honestly start there22:10
EmilienMslagle: in theory, can we upgrade from ttps://review.openstack.org/#/c/428424/ to net-config-multinode-os-net-config ?22:10
EmilienMdamn22:10
EmilienMwrong copy pasta22:10
EmilienMfrom net-config-multinode to net-config-multinode-os-net-config22:10
slagleif NetworkDeployment is running on stack-updates, we are screwed22:11
EmilienMslagle: yes I've searched in logs with the resource ID and haven't found much22:11
slagleEmilienM: no22:11
slaglethat's what i'm saying22:11
*** ooolpbot has joined #tripleo22:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124222:11
*** ooolpbot has quit IRC22:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]22:11
slaglein theory, you can't restart networking on overcloud nodes during a stack-update22:11
slagleNetworkDeployment is not supposed to run on stack-update22:11
slaglewould have to check with heat folks if for some reason it fires anyway on update if the config has changed22:12
EmilienM[overcloud-Controller-dm3ymqn23lrw-0-zbavmwygwiyz.NetworkDeployment]: UPDATE_IN_PROGRESS  state changed22:12
EmilienMit looks like it does22:12
*** fultonj has quit IRC22:12
slaglewell, that doesnt mean anything22:12
slagleto me anyway22:12
slagleit means the resource got upgraded, but not if the deployment was triggered22:13
slagleEmilienM: the upgrades job was never using the net-config-os-net-config template anyway22:15
slagleso you're kind of in new water trying to make it work on scenarios22:15
EmilienMslagle: cool, I'm happy if a found a corner case22:15
EmilienMslagle: to make progress on testing scenario upgrades, I'll use net-config-multinode again but I want to file a bug before. Where do you think it's best? heat or tripleo?22:16
slaglei would start with a tripleo bug, but then get a Heat person to look at why NetworkDeployment is even executing given that NetworkDeploymentActions is set to ["CREATE"] only22:18
slagleand then that Heat person can decide if they need to file a Heat bug :)22:18
EmilienMslagle: ok thanks22:18
slagleor if it's working as expected, in which case it'd be working as no one in TripleO expects22:18
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: Fix initialization of novaclient  https://review.openstack.org/42810522:18
slagleas the whole point of NetworkDeploymentActions was to not execute NetworkDeployment on stack-update22:18
*** jkilpatr has joined #tripleo22:19
slagleEmilienM: search for ERROR from bottom up here: http://logs.openstack.org/72/426372/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-upgrades-nv/0203b17/logs/subnode-2/var/log/messages22:21
slagleand you will see the error is rtnetlink: file exists22:21
slaglethat clues you into to a few things22:22
slagleit must be trying to run the "ip" command again22:22
slaglewhich means it's not even using the os-net-config version of the template22:22
slagleyou could potentially fix the template to make the "ip addr add .." command only run if the ip is not already added to the interface22:23
slaglebut...again, the question is why NetworkDeployment is executing at all to begin with22:23
EmilienMI filed the bug: https://bugs.launchpad.net/tripleo/+bug/166141222:24
openstackLaunchpad bug 1661412 in tripleo "NetworkDeployment is executed even if NetworkDeploymentActions is set to ["CREATE"] only" [High,Triaged]22:24
*** morazi has joined #tripleo22:24
*** sdake_ has quit IRC22:34
*** dprince has quit IRC22:34
bkeroEmilienM: have you ever seen something like this before? It came out of the first attempt to run scenario001 with multinode-oooq. http://logs.openstack.org/68/427468/6/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-nv/570ec3b/logs/postci.txt.gz#_2017-02-02_21_33_06_00022:34
*** sdake has joined #tripleo22:37
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Switch to net-config-multinode  https://review.openstack.org/42637222:38
EmilienMbkero: looking22:38
*** salmankhan has joined #tripleo22:40
*** nrado has quit IRC22:40
*** nrado has joined #tripleo22:40
bnemecIs there something I have to do to make puppet run on a compute node on a stack update?22:42
*** apetrich has quit IRC22:42
bnemecI thought we always ran puppet, but my changes don't seem to have been applied.22:42
bnemechttp://paste.openstack.org/show/597451/22:42
*** apetrich has joined #tripleo22:43
bnemecOh, maybe that hieradata is just ineffective.22:43
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: Fix initialization of novaclient  https://review.openstack.org/42810522:44
bnemecNo, that's not it either.  I was just looking at the wrong ci results. :-/22:45
jaosoriorbnemec: hey dude, is it a local deployment?22:46
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Enable Debug: True on OVB jobs  https://review.openstack.org/42847622:46
EmilienMjaosorior, bnemec : thoughts on ^ ?22:46
bnemecjaosorior: Mine is, yes.  I'm trying to test the vncserver listen change.22:46
jaosoriorwell, on CI the config value did change :/22:47
jaosoriorhow did you update the puppet manifest?22:47
bnemecI applied the puppet change on the compute node and the template change on the undercloud and it didn't change the value in nova.conf.22:47
jaosoriorEmilienM: looking22:47
jaosoriordaaaaamn gerrit is slow22:47
bnemecYeah, I've had a few 502 errors from it too.22:47
EmilienMthey talk about it on infra22:48
jaosoriorEmilienM: I'm fine with that change adding hte Debug = True22:48
EmilienMcool22:48
jaosoriorsounds like something useful22:49
EmilienMI've heard many times tripleo CI didn't provide enough OpenStack logs22:49
EmilienMso let's increase the verbosity22:49
* bnemec shakes his fist at gerrit22:49
*** pmannidi has joined #tripleo22:50
EmilienMthey are restarting Gerrit22:50
jaosoriorbnemec: did you use the right paths in t-h-t? something it happens that I missed changing a /usr/share/openstack-trpileo-heat-templates path from somewhere and it's using the packaged one instead of the ones I'm trying to use from the home dir22:50
bnemecjaosorior: I just made the change in the packaged files directly.22:51
bnemecjaosorior: I see the change showing up in the hieradata, but it never got applied to nova.conf: http://paste.openstack.org/show/597451/22:51
jaosoriorbnemec: what about the puppet change? is that present in the compute?22:52
-openstackstatus- NOTICE: Restarting gerrit due to performance problems22:53
bnemecjaosorior: Gah, it got undone. :-(22:53
jaosoriorbnemec: you could apply the puppet change via a swift artifact22:54
jaosoriorbnemec: http://hardysteven.blogspot.mx/2016/08/tripleo-deploy-artifacts-and-puppet.html   example 2 has the relevant bits22:55
bnemecjaosorior: Oh, dammit.  I made the change on the controller instead of the compute.22:55
bnemecIs it Friday yet?22:55
jaosoriorlol22:55
jaosoriorI've done that too many times myself22:55
jaosoriorbnemec: haha in Finland it is :D22:55
*** salmankhan has quit IRC22:56
* bnemec proposes a meetup in Finland22:57
EmilienMyeah22:58
EmilienMwait, is it colder than Quebec?22:58
bkero-2c in Portland right now. Colder?22:58
jaosoriorEmilienM, bkero -1 C in Helsinki at the moment22:59
jaosoriorapparently22:59
bkeroColder Than Finland (TM)22:59
* jaosorior currently is still in Guadalajara though22:59
jaosoriorI'll get back to Finland in about a week22:59
EmilienM-11°C now (12°F) in QC22:59
* bkero hides22:59
jaosoriorEmilienM: definitely colder than in Helsinki, probably warmer than northern finland though22:59
jaosoriornevermind23:00
jaosoriornorthern Finland is warmer than that at the moment23:00
jaosorior-6 C23:00
EmilienMI googled Guadalajara and it seems to have a very nice church23:00
*** panda is now known as panda|zZ23:00
bnemecEmilienM: I'm not seeing any undercloud-upgrade results on http://tripleo.org/cistatus.html23:00
dtrainoryou guys want some of those 23C i got today?23:00
jaosoriorEmilienM: Guadalajara, suprisingly, has a very nice everything23:00
*** pradk has quit IRC23:00
EmilienMbnemec: oops23:01
jaosoriorand we're currently at 26 C23:01
bnemecIt was 17 F here last time I looked.23:01
jaosoriorloved this city, I recommend it to anyone23:01
jaosoriorquite safe, great food, lots of stuff to do23:01
bnemecBut I'm okay with that because I have a fat bike now and cold weather means the snow will stay around.23:01
jaosoriortequila is dirt cheap as well23:01
dtrainorheh23:01
bnemecDid everyone else hear jaosorior say he was bringing tequila to the PTG? ;-)23:02
EmilienMbnemec: I don't know why gate-tripleo-ci-centos-7-undercloud-upgrades-nv doesn't appear23:02
jaosoriorbnemec: I'm not going to the PTG :(23:02
jaosoriorelse I would bring tequila23:02
bnemec:-(23:03
*** jcoufal has quit IRC23:03
bnemecEmilienM: I didn't end up getting a chance to look at https://bugs.launchpad.net/tripleo/+bug/1661242  I forgot I had an appointment this afternoon that pulled me away for a while.23:06
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]23:06
bnemecI'll leave the env up and get to it tomorrow if it's still broken.23:06
EmilienMbnemec: ok thx23:06
bnemecEmilienM: Weird, I don't see any reason for it to not show up either.  Maybe it's related to the gerrit issues and will fix itself the next time it updates.23:09
EmilienMyeah23:10
bnemecAh, and I refresh and suddenly there are results. :-)23:10
bnemecI love problems that solve themselves.23:10
*** ooolpbot has joined #tripleo23:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124223:11
*** ooolpbot has quit IRC23:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]23:11
*** jmelvin has quit IRC23:11
*** Goneri has quit IRC23:12
EmilienMbnemec: https://bugs.launchpad.net/tripleo/+bug/1661367 could you check with Horizon folks please?23:14
openstackLaunchpad bug 1661367 in tripleo "Images pages blank in Horizon" [High,Triaged]23:14
EmilienMjaosorior: https://review.openstack.org/#/c/428435/23:15
EmilienMbnemec: in which file would you do https://review.openstack.org/#/c/428476/ ?23:22
EmilienMbnemec: a new one?23:22
*** owalsh-afk has joined #tripleo23:24
jaosoriorEmilienM: maybe a new one would be appropriate and more explicit23:24
jaosorioror, if we're doing that already for the multinode jobs, a common one?23:25
jaosoriortest-options.yaml ? or something like that23:25
EmilienMyeah23:26
EmilienMI'll do it23:26
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Enable Debug: True on OVB jobs  https://review.openstack.org/42847623:28
*** nrado has quit IRC23:28
*** rhallisey has quit IRC23:29
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: toci_gate_test: allow to run upgrade jobs for scenarios  https://review.openstack.org/42637023:32
*** owalsh-afk is now known as owalsh23:34
*** owalsh is now known as owalsh-afk23:38
*** abregman has quit IRC23:40
*** sdake has quit IRC23:44
openstackgerritMerged openstack/tripleo-heat-templates master: CI: enable debug on multinode and upgrade job  https://review.openstack.org/42842623:47
*** karimb has quit IRC23:53

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!