Wednesday, 2016-02-10

*** eil397 has quit IRC00:00
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/154381000:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1543810 in tripleo "Jenkins errors killing many CI jobs" [Critical,Triaged]00:10
*** Marga__ has joined #tripleo00:15
*** Marga_ has quit IRC00:17
openstackgerritayoung proposed openstack/tripleo-heat-templates: puppet: run keystone in wsgi  https://review.openstack.org/21317500:21
*** trown is now known as trown|outtypewww00:23
openstackgerritJohn Trowbridge proposed openstack/instack-undercloud: Update nova-neutron configuration  https://review.openstack.org/27813700:30
*** xarses has quit IRC00:35
*** eil397 has joined #tripleo00:45
*** lblanchard has joined #tripleo00:53
*** xarses has joined #tripleo00:56
openstackgerritgreghaynes proposed openstack/diskimage-builder: Fail functests if refusing to run tests  https://review.openstack.org/17700201:00
*** penick has joined #tripleo01:02
*** eil397 has quit IRC01:06
*** Marga__ has quit IRC01:06
*** Marga_ has joined #tripleo01:07
*** ron___ has joined #tripleo01:08
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/154381001:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1543810 in tripleo "Jenkins errors killing many CI jobs" [Critical,Triaged]01:10
*** weshay_xchat has quit IRC01:10
*** weshay_xchat has joined #tripleo01:16
*** jayg is now known as jayg|g0n301:17
*** dmacpher-afk has quit IRC01:19
*** xarses has quit IRC01:19
openstackgerritGraeme Gillies proposed openstack/instack-undercloud: Added a new element to configure ansible inventory from nova  https://review.openstack.org/27768801:31
*** shakamunyi has quit IRC01:40
*** xarses has joined #tripleo01:44
*** tiswanso has joined #tripleo01:50
*** tiswanso has quit IRC01:50
*** tiswanso has joined #tripleo01:51
*** bswartz has joined #tripleo01:51
*** weshay_xchat has quit IRC01:58
*** dmacpher has joined #tripleo02:03
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/154381002:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1543810 in tripleo "Jenkins errors killing many CI jobs" [Critical,Triaged]02:10
*** shivrao has quit IRC02:11
*** yamahata has quit IRC02:19
*** links has joined #tripleo03:00
openstackgerritIan Wienand proposed openstack/diskimage-builder: Fix startup race with growroot/systemd  https://review.openstack.org/27818703:04
openstackgerritIan Wienand proposed openstack/diskimage-builder: Refactor growroot for debuggabilty  https://review.openstack.org/27818803:04
*** Marga_ has quit IRC03:05
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/154381003:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1543810 in tripleo "Jenkins errors killing many CI jobs" [Critical,Triaged]03:10
*** shivrao has joined #tripleo03:19
*** ron___ has quit IRC03:19
*** shivrao has quit IRC03:29
openstackgerritMatthew Thode proposed openstack/diskimage-builder: Remove eclean-dist as it's not available by default  https://review.openstack.org/27658104:01
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/154381004:10
openstackLaunchpad bug 1543810 in tripleo "Jenkins errors killing many CI jobs" [Critical,Triaged]04:10
*** ooolpbot has quit IRC04:10
*** tiswanso has quit IRC04:20
*** bhunter has quit IRC04:33
*** michchap_ has joined #tripleo04:33
*** bhunter has joined #tripleo04:34
*** michchap has quit IRC04:35
*** rbrady has quit IRC04:44
openstackgerritgreghaynes proposed openstack/diskimage-builder: Install docker for tests  https://review.openstack.org/27802104:45
openstackgerritgreghaynes proposed openstack/diskimage-builder: Fail functests if refusing to run tests  https://review.openstack.org/17700204:47
*** shivrao has joined #tripleo04:48
*** lblanchard has quit IRC04:57
*** stendulker has joined #tripleo04:57
*** rlandy has quit IRC05:07
*** anande has joined #tripleo05:07
*** anande has quit IRC05:08
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/154381005:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1543810 in tripleo "Jenkins errors killing many CI jobs" [Critical,Triaged]05:10
*** shivrao_ has joined #tripleo05:10
*** shivrao has quit IRC05:10
*** shivrao_ is now known as shivrao05:10
*** masco has joined #tripleo05:39
openstackgerritMatthew Thode proposed openstack/diskimage-builder: Reorder the package-uninstall action  https://review.openstack.org/27821105:43
openstackgerritMatthew Thode proposed openstack/diskimage-builder: Remove eclean-dist as it's not available by default  https://review.openstack.org/27658105:44
*** michchap_ has quit IRC05:45
*** michchap has joined #tripleo05:46
*** Marga_ has joined #tripleo05:50
*** Marga_ has quit IRC05:55
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/154381006:10
openstackLaunchpad bug 1543810 in tripleo "Jenkins errors killing many CI jobs" [Critical,Triaged]06:10
*** ooolpbot has quit IRC06:10
*** dsneddon_brno has joined #tripleo06:12
*** Marga_ has joined #tripleo06:50
*** Marga_ has quit IRC06:50
*** Marga_ has joined #tripleo06:51
*** aufi has joined #tripleo06:55
*** shivrao has quit IRC07:03
*** tzumainn has quit IRC07:05
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/154381007:10
openstackLaunchpad bug 1543810 in tripleo "Jenkins errors killing many CI jobs" [Critical,Triaged]07:10
*** ooolpbot has quit IRC07:10
*** jprovazn has joined #tripleo07:12
*** rcernin has joined #tripleo07:13
*** ukalifon1 has joined #tripleo07:16
*** Marga_ has quit IRC07:33
*** panda has quit IRC07:37
*** panda has joined #tripleo07:37
*** dsneddon_brno has quit IRC07:41
*** mkovacik has quit IRC07:41
*** openstackgerrit has quit IRC07:47
*** openstackgerrit has joined #tripleo07:47
*** jtomasek_ has joined #tripleo07:50
*** dmacpher has quit IRC07:51
*** rcernin has quit IRC07:52
*** gfidente has joined #tripleo07:55
*** gfidente has quit IRC07:55
*** gfidente has joined #tripleo07:55
*** fgimenez has joined #tripleo08:08
*** fgimenez has quit IRC08:08
*** fgimenez has joined #tripleo08:08
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/154381008:10
openstackLaunchpad bug 1543810 in tripleo "Jenkins errors killing many CI jobs" [Critical,Triaged]08:10
*** ooolpbot has quit IRC08:10
*** oshvartz has joined #tripleo08:13
*** rcernin has joined #tripleo08:14
*** d0ugal has joined #tripleo08:17
*** liverpooler has joined #tripleo08:19
*** devvesa has joined #tripleo08:20
*** jistr|doc has joined #tripleo08:22
*** hjensas has joined #tripleo08:30
*** hjensas has joined #tripleo08:30
*** athomas has joined #tripleo08:32
openstackgerritMerged openstack/diskimage-builder: Only match #!/bin/bash in scripts  https://review.openstack.org/27387908:35
*** jaosorior has joined #tripleo08:48
jaosoriorshardy: any clue why the HA gate is failing now? For some reason I no longer see the mongodb error, so it seems my patch is no longer relevant08:53
openstackgerritMoshe Levi proposed openstack/diskimage-builder: Adding InfiniBand Support  https://review.openstack.org/27478108:54
*** morazi has joined #tripleo08:59
*** ifarkas has joined #tripleo09:02
*** jcoufal has joined #tripleo09:03
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/154381009:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1543810 in tripleo "Jenkins errors killing many CI jobs" [Critical,Triaged]09:10
*** shardy has joined #tripleo09:11
jaosoriorshardy: Hey dude, how's it going? any clue why the HA gate is failing now? For some reason I no longer see the mongodb error, so it seems my patch is no longer relevant09:13
*** lucas-dinner is now known as lucasagomes09:19
shardyjaosorior: not sure, sorry - not yet had time to look into it09:21
*** mbound has joined #tripleo09:21
shardymarios: re https://review.openstack.org/#/c/260413/ - it's passed all CI on the current revision in different runs, and the latest ceph failure appears to be a job timeout and not anything linked to the patch09:22
shardyI'm tempted to just approve it, wdyt?09:22
mariosshardy: heh, am watching the console at https://jenkins04.openstack.org/job/gate-tripleo-ci-f22-ha/373/console09:23
openstackgerritJuan Antonio Osorio Robles proposed openstack/os-cloud-config: Enable ssl for ceilometer  https://review.openstack.org/26766009:23
mariosshardy: (for the ha job anyway, if it fails on the pingtest again or some other issue, i may have an actual fit)09:24
mariosshardy: shall we see what happens on this last run? but yeah i'd be in favor of it, though would be nice to see a green run since we've come this far09:25
shardymarios: maybe I need more coffee - it looked like the ha and nonha jobs both passed on the last run?09:25
mariosshardy: revisit later?09:25
shardymarios: ack, sure09:25
mariosshardy: yeah it did, as you say it was the ceph job that failed09:25
mariosshardy: i rechecked to see that (and wanted a green run)09:25
shardyOk, cool, lets see what it does this time - would be another datapoint re the failures anyway I guess09:26
mariosthanks shardy09:27
*** dtantsur|afk is now known as dtantsur09:28
*** mkovacik has joined #tripleo09:29
*** nico_auv has joined #tripleo09:30
*** Marga_ has joined #tripleo09:33
gfidenteshardy, marios can't we just do that from hiera?09:34
gfidenteoh yes but no for the pcmk scenario :(09:35
mariosgfidente: o/ don't follow09:35
gfidentehttps://review.openstack.org/#/c/260413/09:35
mariosgfidente: oh yeah is also a cherrypick09:35
gfidentebut we can still drop the templating part though09:35
gfidenteoh right09:35
gfidenteI saw it too late :(09:35
shardygfidente: Hey, have you seen https://review.openstack.org/#/c/275437 ?09:36
shardyit reworks the endpoint map to avoid DoSing heat, which IIRC was an issue you were encountering09:36
mariosshardy: i had a look at that this morning09:36
gfidenteshardy, yeah that's what we I was talking about the other day09:36
gfidenteyou hadn't drink yet as I remember09:36
mariosshardy: gfidente: th eimplication is that operator would have to change the endpoint_data.yaml and rerun the script before deploy for any changes there right09:37
*** akrivoka has joined #tripleo09:37
shardyI'm wondering if that will help us with our CI performance issues09:37
*** Marga_ has quit IRC09:38
shardygiven that we create the endpoint map for all tests, and it's clearly overloading heat and using a lot of memory09:38
mariosshardy: gfidente: it essentially replaces the need for the Endpoint resource itself with the input file and the python script09:38
mariosshardy: gfidente which is nice. i just hate that it is another script :/ and it goes back to template munging09:38
shardymarios: well yes, but it's more a developer thing - until we have support for out-of-tree pluggable services09:38
shardyatm it'd be adding a new entry to the template consumed by the generator script whenever you integrate a new service into t-h-t09:39
shardywe can potentially automate running that via a check job, and enforce updating the input data09:39
shardybut as a first step it'll be manual09:39
mariosshardy: yes this is a good point. you'd have to check in the edit with your change09:39
marios(anyway/currently)(09:39
shardymarios: yup, that's discussed in the review, it seems OK until we can wire in the automation (which probably won't be that hard)09:40
mariosshardy: no i meant, right now, you have to add your entry anyway (like I have to add to endpointmap right now, when say i want to add zookeeper or whatever service endpoints)09:40
shardymarios: ah, yeah, but now you have to add them and run a script09:41
shardyI agree it's not ideal, long term we need a better abstraction for these indirect mappings09:41
shardypersonally I've never been keen on all the data-only templates munging parameters into outputs with no resources09:42
*** electrofelix has joined #tripleo09:42
shardybut the fact we're needing to do it probably indicates we're lacking a mapping feature in heat09:42
mariosshardy: so getting over that ^^^ part.. my other possibly oconern was implications around updates... the resource itself has changed (Endpoint is gone).09:44
shardymarios: I think that doesn't matter in this case, because there are no resources inside the Endpoint abstraction09:44
mariosshardy: i didn't vote cos i wasn't sure about these two things (gfidente actually mentioned this change to me last week, i hadn't realised what a heroic feat zaneb had pulled off so quickly)09:44
shardyit's just data manipulation09:44
gfidentemarios, eroic09:45
shardye.g provided the before/after data output is the same, all should be OK09:45
shardyAFAICS anyway09:45
mariosshardy: right yes that makes sense (the no resource inside endpoint - just params and outputs)09:46
jaosorioronly con for that is usability, I guess, since there will be one extra step for doing the overcloud deployment, IIUC09:46
*** jistr|doc has quit IRC09:46
shardyjaosorior: true, but in most cases (outside of super-advanced usage and third-party integrators) won't the stock endpoints be enough?09:47
mariosshardy: wih that concern addressed too, it should make things MUCH faster based on zane's commit msg09:47
jaosoriorshardy: I wouldn't call ssl super-advanced09:48
shardywell, interestingly the HA job passed there in 1hr30, so I'm wondering if it's related to the frequent timeouts we're seeing09:48
jaosoriorwow09:48
jaosoriorhow does the non-ha look like then, did the time decrease there too?09:48
shardyall the jobs passed in 1hr30 approximately (range from 1hr24 to 1hr34)09:49
jaosoriorif the performance inpact is that big then I guess it makes sense to address usability later, after this is merged09:49
gfidenteyeah ha is not slower, false mith09:49
gfidentemaybe nonha could be made slightly faster by removing a step09:50
*** derekh has joined #tripleo09:50
jaosoriorgfidente: Well, the endpoint map shouldn't realy vary that much between non-ha and ha09:50
gfidentebut that's the most of it09:50
jaosorior*really09:50
gfidentejaosorior, yeah endpoint is not a factor09:50
*** dtantsur is now known as dtantsur|brb09:51
shardyjaosorior: AFAICT it won't impact the SSL use-case at all:09:53
shardyhttps://review.openstack.org/#/c/275437/1/network/endpoints/endpoint_map.yaml09:53
shardyYou can still pass in a different EndpointMap just like before09:54
shardyit only becomes a little bit less convenient if you want to add a new endpoint09:54
shardySee line 1715 - it's a bit confusing because the parameters are after the outputs09:54
jaosoriorshardy: Actually I got quite confused because of that10:02
jaosoriorok, now it makes more sense10:03
*** mgould has joined #tripleo10:08
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/154381010:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1543810 in tripleo "Jenkins errors killing many CI jobs" [Critical,Triaged]10:10
*** mcornea has joined #tripleo10:16
*** r-mibu has quit IRC10:20
*** r-mibu has joined #tripleo10:21
*** jaosorior has quit IRC10:21
*** shardy has quit IRC10:25
*** shardy has joined #tripleo10:25
*** dtantsur|brb is now known as dtantsur10:42
mariosshardy: hmm looking like that ceph job is going to timeout again https://jenkins05.openstack.org/job/gate-tripleo-ci-f22-ceph/395/console for /#/c/260413/10:42
openstackgerritMerged openstack-infra/tripleo-ci: Add support for periodic jobs  https://review.openstack.org/27137010:42
mariosha job passed again though so that's good10:42
openstackgerritMerged openstack-infra/tripleo-ci: Add support for command line job names  https://review.openstack.org/23542110:42
shardymarios: Hmm, it's a bit hard to see where it's stuck10:47
shardywe should add a dump of all IN_PROGRESS resources to CI (or tripleoclient) sorted by the amount of time they've been running10:48
*** Marga_ has joined #tripleo10:52
*** Marga_ has quit IRC10:56
*** fgimenez has quit IRC11:02
*** fgimenez has joined #tripleo11:03
*** stendulker_ has joined #tripleo11:04
*** stendulker_ has quit IRC11:07
*** stendulker has quit IRC11:08
cmystershardy: I suggested at one time to just dump heat schema, it should be pretty empty in CI machines11:29
*** Marga_ has joined #tripleo11:31
*** panda has quit IRC11:37
*** panda has joined #tripleo11:38
*** Marga_ has quit IRC11:46
*** Marga_ has joined #tripleo11:46
derekhmarios shardy that stuck HA job ye were talking about, could possibley be fixed by this https://review.openstack.org/#/c/275149/11:51
*** links has quit IRC11:56
openstackgerritMerged openstack/python-tripleoclient: Simplify checking for stack complete  https://review.openstack.org/27514911:57
dtantsurEmilienM, hi! could you please take a look at https://review.openstack.org/#/c/277780/ ? this is part of profile matching work that people constantly ping me about :)11:58
shardyderekh: thanks, looks like that's ready to land to stable/liberty too now11:59
derekhshardy: yup, +2'd12:00
shardyhehe, snap ;)12:00
derekhlol12:00
*** olaph has joined #tripleo12:04
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Split the deploy script into its own file  https://review.openstack.org/27566812:04
mariosderekh: thanks looking12:05
mariosderekh: prophet slagle at https://review.openstack.org/#/c/274593/2/tripleoclient/utils.py12:07
derekhmarios: ya, that patch was the first attempt to fix the problem,12:09
mariosderekh: you know i really amo not familiar with this utils stuff in the client/haven't looked for long time12:09
* marios fires up vim12:10
derekhmarios: its merged now anyways ;-), nor was I until I tried to track down the cause of the problem12:10
mariosderekh: yeah am trying to understand what was going on with the wait_for_stack_ready to cause the loop in the first place12:11
mariosderekh: thanks, will try a recheck on those reviews in a sec then12:11
mariosderekh: good to see ci otherwise running OK this morning, at least for tht afaics (except the ceph jobs which might be this)12:12
derekhmarios: when I reproduced the probem, the heat stack was actually CREATE_COMPLETE but the tripleoclient was waiting for more events12:12
shardybasically we were waiting on an event for definitive flag of stack status, which can be racy because we're also using an incrementing marker12:12
derekhmarios: the preoblem appears to be that the event is generated and checked by the client befor the status was updated12:12
shardyheat already provides a definitive stack status, so it's much better to just use that12:13
*** masco has quit IRC12:13
mariosderekh: i wonder what is special about the ceph job (if it does run green with this fix in place) to reliably repro/hit that12:13
derekhmarios: donno, if its still happening after this I'll try and reproduce it again, for the one I did reproduce I think we have the right fix12:14
mariosderekh: are we pulling from master for the tripleoclient?12:15
marios(in ci)12:15
mariosderekh: really i am asking if i should recheck straight away or not12:16
derekhmarios: yes, but make sure to wait for it to appear in the delorean /current12:16
derekhmarios: http://trunk.rdoproject.org/centos7/report.html  when you see it appear here, recheck12:16
mariosderekh: thanks !12:16
derekhfinally http://tripleo.org/tripleo-periodic-jobs.html12:21
shardywoot!12:24
shardythere's even some green on it ;)12:24
*** thrash|g0ne is now known as thrash12:25
derekhshardy: crazy world we live in12:26
shardysimple docs patch if someone has a moment: https://review.openstack.org/#/c/273459/12:27
trown|outtypewwwderekh: nice one!12:29
*** trown|outtypewww is now known as trown12:29
*** fgimenez has quit IRC12:31
*** fgimenez has joined #tripleo12:32
*** tremble has quit IRC12:33
*** tremble has joined #tripleo12:33
d0ugalthrash: When you get a moment, can you take a look at https://review.openstack.org/#/c/275661/12:34
openstackgerritMerged openstack/tripleo-docs: Fix NODE_MEM/UNDERCLOUD_NODE_MEM error  https://review.openstack.org/27345912:34
*** saneax has joined #tripleo12:34
*** links has joined #tripleo12:35
openstackgerritMerged openstack/tripleo-heat-templates: Makes the iSCSI initiator name unique for compute nodes  https://review.openstack.org/27589012:39
*** Goneri has quit IRC12:40
shardytripleoclient patch fixing nasty bug mentioned in yesterdays meeting:12:45
shardyhttps://review.openstack.org/#/c/275661/12:46
shardypassing CI, needs a +2A12:46
thrashd0ugal: sure12:51
*** weshay_xchat has joined #tripleo12:52
d0ugalthrash: Thanks!12:53
*** lucasagomes is now known as lucas-hungry12:56
*** rlandy has joined #tripleo13:02
openstackgerritMerged openstack/python-tripleoclient: Don't regenerate the overcloud passwords if the Heat stack exists  https://review.openstack.org/27566113:02
*** saneax is now known as saneax_AFK13:03
*** rbrady has joined #tripleo13:04
*** jcoufal has quit IRC13:07
*** dprince has joined #tripleo13:09
*** egafford has joined #tripleo13:11
*** olaph is now known as loaf13:13
*** jayg|g0n3 is now known as jayg13:17
trownderekh: I think we will have to unpin puppet-nova for https://review.openstack.org/278137 to pass, but there is also a similar patch needed for the overcloud13:19
trownderekh: I am curious though if those patches are strictly needed to make current pass if we keep the puppet-nova pin13:20
derekh  trown I gues if we keep the pin we could move current without them but preferably we would remove the pin ASAP13:22
derekhtrown: iirc we can remove the pin once this merges https://review.openstack.org/#/c/275607/13:22
derekhtrown: actaully maybe I'm getting mixed up now13:22
trownderekh: ya I am also having a bit of trouble keeping this all straight13:23
derekhwe can't move onto the new nova package until that merges13:23
trownsince I am testing current without the nova pin13:23
trownI guess we can see if we get https://review.openstack.org/#/c/275607/ and https://review.openstack.org/#/c/276790/ merged if the nightly periodic job passes13:25
trownderekh: that periodic job still uses the puppet pins from the gates?13:26
derekhtrown: yum it does13:26
derekh*yup13:26
trowncool, the THT patch above needs some work, but dmsimard should be around soon13:27
openstackgerritDerek Higgins proposed openstack/instack-undercloud: Send a refresh event to all db sync commands  https://review.openstack.org/24413613:27
derekhtrown: ack13:28
*** dcain1 has joined #tripleo13:28
*** dcain1 has left #tripleo13:28
*** bvandenh_ has joined #tripleo13:29
*** Marga_ has quit IRC13:29
openstackgerritJames Slagle proposed openstack/os-cloud-config: Add []'s around ipv6 address when creating keystone clients  https://review.openstack.org/27811113:31
openstackgerritJames Slagle proposed openstack/os-cloud-config: Add []'s around ipv6 address when creating keystone clients  https://review.openstack.org/27811113:32
marios  OS::TripleO::CephStorage::Ports::StoragePort: /usr/share/openstack-tripleo-heat-templates/network/ports/noop.yaml13:34
marios  OS::TripleO::CephStorage::Ports::StorageMgmtPort: /usr/share/openstack-tripleo-heat-templates/network/ports/noop.yaml13:34
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Source undercloud environment variable from a file  https://review.openstack.org/27566713:37
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Split the deploy script into its own file  https://review.openstack.org/27566813:37
openstackgerritMerged openstack/python-tripleoclient: Wrap around list of events  https://review.openstack.org/27526113:40
openstackgerritMerged openstack/python-tripleoclient: Simplify checking for stack complete  https://review.openstack.org/27526313:41
*** bvandenh_ has quit IRC13:43
*** mcornea has quit IRC13:50
*** mcornea has joined #tripleo13:51
*** lucas-hungry is now known as lucasagomes13:53
*** bvandenh_ has joined #tripleo13:54
*** dcain has joined #tripleo13:58
*** rhallisey has joined #tripleo14:00
derekhdprince: I updated your generate site script to add the report fopr the periodic job http://tripleo.org/tripleo-periodic-jobs.html14:00
derekhdprince: will figure out how to add it to the main site later14:01
*** Goneri has joined #tripleo14:01
dprincederekh: want me to add it?14:02
dprincederekh: I still need to actually push that code somewhere?14:02
derekhfire ahead if its not a PITA14:02
dprincederekh: Yeah, I think it should be fairly easy14:02
derekhdprince: ya, wouldn't do any hard to have it somewhere14:02
derekhdprince: bbiab14:02
gfidentederekh, regarding the upgrade job14:03
gfidenteI replied on gerrit but maybe both your comments are worth discussing here for more audience14:04
gfidentefor the upgrade job I think we can run the pcmk scenario with a single controller14:04
gfidentebut at the same time I'd like to have ceph there to make sure we don't break things14:04
gfidenteon the other hand, we're not actually testing computes or ceph nodes upgrade14:06
gfidenteso they aren't of great use14:06
*** weshay_xchat is now known as weshay14:07
*** fgimenez has quit IRC14:08
*** fgimenez has joined #tripleo14:10
tremblegfidente: however testing the upgrade would provide very basic validation of the type that keeps customers from thinking "does anyone even try upgrading this" and is better than nothing...14:10
gfidentetremble, oh indeed I was for keeping the nodes14:11
gfidentehttps://review.openstack.org/#/c/26046614:11
gfidentebut I am not sure how much that impacts CI, which is also a factor14:11
*** Matt4 has quit IRC14:13
trembleYeah unit testing the install/upgrade pieces is if anything harder than unit testing individual components.14:13
tremblepersonally I'd rather see a more complex case tested as well, but that may be better suited to a periodic task than a gate task14:15
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Generate a unique DeployIdentifier on updates  https://review.openstack.org/26812614:15
*** julim has joined #tripleo14:15
*** tzumainn has joined #tripleo14:16
d0ugalshardy: I seem to remember that you had a bash script to find the error in Heat, I can't seem to find it now. Am I remembering correctly?14:17
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Install mongodb client package  https://review.openstack.org/27839414:22
shardyd0ugal: I had a script in a blog post, but it's easy enough, just do heat resource-list -n5 overcloud | grep FAILED | grep "Deployment "14:24
shardynote the space after Deployment14:24
*** tiswanso has joined #tripleo14:24
d0ugalshardy: Yeah, that is the script I was looking for :)14:24
shardythen do heat deployment-show <id of deployment resource>14:24
shardyd0ugal: it only really helps with software configuration errors, but we should probably wire that in so it always runs on a failed deployment14:24
*** apetrich has quit IRC14:25
*** apetrich has joined #tripleo14:25
d0ugalshardy: right, thanks.14:27
*** links has quit IRC14:27
*** masco has joined #tripleo14:28
*** lblanchard has joined #tripleo14:28
dmsimardI'm around14:29
dmsimardtremble: I'll submit a fix14:30
dmsimarder, sorry tremble14:30
dmsimardtrown: ^14:30
trowndmsimard: sweet thanks14:32
*** jcoufal has joined #tripleo14:33
*** dmacpher has joined #tripleo14:33
*** rpothier has joined #tripleo14:35
openstackgerritDavid Moreau Simard proposed openstack/tripleo-heat-templates: Nova now requires an api database to be created  https://review.openstack.org/27679014:37
dmsimardtrown: ^ good find14:37
* dmsimard starts hacking on that nova-neutron patch14:37
*** lblanchard has quit IRC14:39
*** w_ has joined #tripleo14:40
*** loaf has quit IRC14:43
dmsimardtrown: meanwhile crisis averted with heat changes that broke mitaka14:43
dmsimardEmilienM and I yelled loud enough :)14:43
EmilienM:)14:44
trownnice one14:44
dmsimardstill need a tempest revert merged but the necessary fix is merged in heat (should be picked up by delorean shortly)14:44
trownthat is the most stressful thing about chasing trunk for all of openstack, finding all oustanding issues and getting patches up, then having something else break before they get merged14:45
shardydmsimard: what's the heat patch/bug out of interest?14:45
dmsimardshardy: so there was this revert that we needed in tempest: https://review.openstack.org/#/c/278068/ and https://review.openstack.org/#/c/278081/ in heat (see related bug in reviews for details)14:47
dmsimardshardy: fyi, back to a comment bnemec pointed out yesterday14:47
dmsimardnova-neutron configuration does need a versioned endpoint (as in /v3), unversioned does not work :)14:47
shardydmsimard: thanks for the links14:48
shardythat sounds like something wrong with their auth plugin integration14:48
dmsimardI'm not the guy that's going to dig into that14:48
dmsimardBut maybe, yeah :)14:48
shardyAFAIK if you use the keystoneclient plugin stuff and sessions correctly versions are detected automagically14:49
shardybut yeah, someone can hopefully look into that in due course ;)14:49
shardyI removed all the v2.0 stuff from the default heat config recently, and it mostly "just works" once you get the right mixture of values into the keystoneclient code14:50
dmsimardautomagically -> some wizard isn't doing his job :P14:50
*** jpeeler has joined #tripleo14:50
EmilienMshardy: it basically broke backward compatibility14:51
dmsimardyeah, I mean, not only is /v3 mandatory now but the previous config doesn't work at all14:53
dmsimardbut hey, it worked in devstack14:53
EmilienMdmsimard: still not friday14:53
trownEmilienM: I like to say "its almost friday"14:54
trownmore glass half full14:54
trown(nevermind that it is not)14:55
*** w_ has quit IRC14:55
shardywell that's one disadvantage to devstack moving everything to v3 I guess14:55
*** pradk has joined #tripleo14:55
shardyFWIW I reported the lack of member role thing against keystone a long time ago:14:56
shardyhttps://bugs.launchpad.net/keystone/+bug/136613314:56
openstackLaunchpad bug 1366133 in OpenStack Identity (keystone) "User create via v3 API doesn't add _member_ role in default project" [Undecided,Won't fix]14:56
shardythat was wonfixed thus one aspect of the breakage14:56
shardyat least we got a fix for the heat part of the problem posted pretty fast14:56
*** xarses has quit IRC14:56
*** w_ has joined #tripleo14:57
dmsimardEmilienM: is that restricted to fridays ?14:57
EmilienMdmsimard: yes14:57
dmsimard:(14:57
dmsimardAt least I'm not posting it on TWITTER on non-fridays14:57
* dmsimard pouts14:58
EmilienMtwitter is a nice place to report bugs :-)14:59
trownlol14:59
*** masco has quit IRC15:01
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Show os-net-config applied via script, not oac  https://review.openstack.org/27145015:04
derekhgfidente: I'm not sure about running the upgrade on a single node, there is coordination between the controllers that we will want to exercise15:06
gfidenteyeah I read that15:07
gfidentebut it's heat taking care of that15:07
gfidenteI mean, it's not like we can desync the nodes in the same resource group?15:08
gfidentemaybe shardy knows better15:08
*** deva_ has joined #tripleo15:08
*** NobodyCa1 has joined #tripleo15:09
*** NobodyCa1 has quit IRC15:14
*** deva_ has quit IRC15:14
*** nico_auv has quit IRC15:18
*** nico_auv has joined #tripleo15:19
*** rbrady has quit IRC15:19
*** rbrady has joined #tripleo15:20
*** dustins has joined #tripleo15:21
*** lblanchard has joined #tripleo15:22
*** xarses has joined #tripleo15:22
*** fgimenez has quit IRC15:22
*** jaosorior has joined #tripleo15:24
*** fgimenez has joined #tripleo15:25
*** w__ has joined #tripleo15:26
jaosoriorbnemec: ping15:27
*** w_ has quit IRC15:28
*** rcernin has quit IRC15:33
bnemecjaosorior: pong15:33
*** saneax_AFK is now known as saneax15:34
jaosoriorbnemec: Hey dude, I hadn't noticed you had already backported the enabling of the ssl port for ceilometer in os-cloud-config15:35
jaosoriorjust a heads up that I accidentally uploaded it again15:35
*** oshvartz has quit IRC15:36
jaosoriorbenemec: https://review.openstack.org/#/c/267660/ And it seems to pass HA too :D15:36
*** jaosorior has quit IRC15:36
*** panda has quit IRC15:37
*** panda has joined #tripleo15:38
openstackgerritJames Slagle proposed openstack/tripleo-puppet-elements: Add puppet-kmod into image  https://review.openstack.org/27845615:40
*** jaosorior has joined #tripleo15:42
*** liverpooler has quit IRC15:46
*** rcernin has joined #tripleo16:00
*** dmacpher is now known as dmacpher-afk16:02
*** NobodyCa1 has joined #tripleo16:05
*** deva_ has joined #tripleo16:06
*** jaosorior_ has joined #tripleo16:09
*** deva_ has quit IRC16:11
*** NobodyCa1 has quit IRC16:11
openstackgerritDustin Schoenbrun proposed openstack/tripleo-heat-templates: Enable Manila integration  https://review.openstack.org/18813716:13
jaosorior_can someone check this commit out? https://review.openstack.org/#/c/267660/ it's a one liner :D16:16
*** NobodyCa1 has joined #tripleo16:19
openstackgerritDavid Moreau Simard proposed openstack/tripleo-heat-templates: Nova Neutron configuration now uses keystone v3 endpoint  https://review.openstack.org/27849016:19
dmsimardtrown: ^16:19
dmsimardbnemec, shardy: ^ :)16:20
trowndmsimard: oh nice, I just kicked a deploy with everything in the etherpad, and removing the puppet-nova from source since it looks like that change made it to OPM16:20
dmsimardThis could or could not make sense, feel free to comment16:21
dmsimardI *think* it should be good16:21
trowndmsimard: I will test your change above next... maybe that even gets us a functioning overcloud :)16:21
*** weshay has quit IRC16:21
dmsimardoh wait, there's something I missed I think.16:21
*** weshay_xchat has joined #tripleo16:21
trownoh cool even generated with the new generator16:22
jaosorior_dmismard: So there will be both v2.0 and v3 endpoints?16:22
trownhopefully we can get that endpoint map generator patch merged16:23
jaosorior_wasn't the recommendation to have versionless endpoints for keystone?16:23
*** weshay_xchat has quit IRC16:23
*** weshay has joined #tripleo16:23
jaosorior_ayoung ^^16:23
dmsimardjaosorior_: it doesn't work for nova-neutron, see https://bugs.launchpad.net/puppet-nova/+bug/154248616:23
openstackLaunchpad bug 1542486 in puppet-nova "nova-compute stack traces with BadRequest: Specifying 'tenant_id' other than authenticated tenant in request requires admin privileges" [Critical,New] - Assigned to Emilien Macchi (emilienm)16:23
ayoungjaosorior_, keystone v3!?!1One!16:23
*** NobodyCa1 has quit IRC16:23
*** rcernin has quit IRC16:24
jaosorior_ayoung: Yes, hopefully we get there soon. I just had the question regarding if we should be using versionless endpoints to use v316:24
dmsimardjaosorior_: we should, but for this particular case it does not work16:24
jaosorior_dmsimard: But yeah, thanks for pointing me to that bug. bummer it doesn't work :/16:24
ayoungjaosorior_, dead on, thanks for notifying me, -1 and comment already posted16:25
openstackgerritDerek Higgins proposed openstack/tripleo-heat-templates: Makes the iSCSI initiator name unique for compute nodes  https://review.openstack.org/27849616:26
ayoungdmsimard, let me look at that, and maybe I can help figure out why16:26
dmsimardayoung: nova-neutron *does not work* with unversioned endpoint, please see the bug16:26
dmsimardayoung: even devstack has a versioned endpoint16:26
ayoungbut let's not add an additional layer of paint to the floor outside our corner16:26
ayoungif devstack was jumping off a bridge, I would not follow it16:26
ayoungeven with the XKCD rule about that in effect16:26
dmsimardayoung: feel free to work this out but in the meantime trunk is broken and I don't want it to stay broken for weeks16:26
ayounghttps://xkcd.com/1170/16:26
ayoungdmsimard, yuck16:27
jaosorior_ayoung: Seems that the patch that fixes the bug report is explicitly using v3password as auth_plugin https://review.openstack.org/#/c/276932/5/manifests/network/neutron.pp So that would explain why v3 is needed16:27
ayoungdmsimard, so, this only has to be true for Keystone today16:27
jaosorior_or why it needs to be set in the endpoint16:27
ayoungso don;'t use that plugin16:27
ayoungthere is a versionless plugin16:27
jaosorior_yep16:27
jaosorior_simply called 'password'16:27
ayoungthis is the problem with jamielennox being in Australia16:28
ayounghe's asleep now, but this is his bailywick16:28
*** saneax is now known as saneax_AFK16:28
trownayoung: we can not block tripleo moving forward because of breakages in other projects16:29
ayoung trown give me a moment to grok what is going on, but explicit v3 is a bad pattern16:29
trownk16:30
dmsimardayoung: I don't think anyone disagrees with that statement16:30
jaosorior_ayoung: Seems to me the solution is to patch puppet-nova (again) to get it to use the versionless plugin as a default. And then we need to change tripleo-heat-templates again16:30
dmsimardWe're just doing what needs to be done for things to work16:30
dmsimardjaosorior_: the versionless plugin does not work16:30
dmsimardjaosorior_: that is why we changed it16:30
dmsimardin the first place16:30
ayoungAh...so puppet is the real culprit here....16:30
ayoungdmsimard, it does work.16:30
ayoungIf it does not work there, the qweschunis why16:31
dmsimardayoung: it worked before16:31
*** tiswanso has quit IRC16:31
dmsimardWe didn't change it for fun16:31
dmsimardSomething happened in nova or somewhere else that prompted us to align the configuration to be similar to devstack16:31
ayoungdmsimard, did you ask any of the keystone folks why it would be broken?16:31
dmsimardWe asked #openstack-nova16:31
dmsimardTheir answer was "Well, it works in devstack"16:32
ayoungCargo cult is why we are stuck with brain dead keystone decisions from 4 + years ago16:32
trownwell tripleo is not the place to fix that16:32
trownnova is the place to fix that16:32
gfidentederekh, https://review.openstack.org/#/c/277517/16:32
ayoungtrown, I have been working on Tripleo using Keystone HTTPD.16:32
ayoungThat is pure cargo cult at this point16:32
ayoungwe had it fixed in Puppet even16:32
ayoungSo, getting the the root of problems is esssential to me not going more insane than I already \am16:33
trownuntil nova has a gate job for tripleo, we have to take devstack as their recommended configuration16:33
ayoungAAAAH too late!@16:33
ayoungHeh16:33
trownif that recommended configuration is wrong... that is on nova16:33
derekhgfidente: is that related to the initiator thing ?16:34
*** tiswanso has joined #tripleo16:34
dmsimardayoung: http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2016-02-05.log.html#t2016-02-05T21:06:3216:35
ayoungdmsimard, you can't trust devstack16:35
ayoungthey have other demands16:35
*** mgould has quit IRC16:35
ayounglike not breaking gate16:35
*** tiswanso has quit IRC16:35
dmsimardayoung: no kidding16:35
ayoungthat keeps it from effectively being the reference16:35
derekhmarios: I got lost in a bunch of browser tabs, which jenkins job was I going to look at ?16:35
ayoungwe are working with sdague on that16:35
*** tiswanso has joined #tripleo16:35
trownthe crux of the issue is that we (tripleo) have to treat delorean/current being broken as if CI itself is broken or we have no chance of keeping up16:35
trownand it has been broken for 2 weeks16:36
ayoungdmsimard, are you telling me I need to beat up dims?16:36
ayoungDamhnit, I like dims.16:36
ayoungtrown, fair enough.  So long as this is temporary16:36
ayoungI will remove the -1 if you open a bug on it16:37
dmsimardayoung: do what you gotta do, I asked for more details on what could have cause the previous configuration to suddenly stop working but was mostly ignored16:37
trownand in order to deploy with current nova, we need explicit v316:37
trownthere is a bug already16:37
ayoungIs there a bug for that?16:37
ayoungcuz explicit v3 is a bug16:37
dmsimardThere is/was one for puppet-nova, I haven't filed anything specifically against nova16:37
dmsimard(personally)16:37
ayoungdmsimard, how about add an "also effects" on the puppet bug then...link?16:38
ayounghttps://bugs.launchpad.net/puppet-nova/+bug/154248616:38
openstackLaunchpad bug 1542486 in puppet-nova "nova-compute stack traces with BadRequest: Specifying 'tenant_id' other than authenticated tenant in request requires admin privileges" [Critical,New] - Assigned to Emilien Macchi (emilienm)16:38
dmsimardayoung:  https://bugs.launchpad.net/puppet-nova/+bug/154248616:38
gfidentederekh, no no, just pulling votes :P16:38
dtantsurtrown, hey! do tripleoci runs save their images somewhere?16:38
mariosderekh: https://jenkins07.openstack.org/job/gate-tripleo-ci-f22-ceph/342/console but looks like it is at pingtest now so may be ok16:38
mariosderekh: for https://review.openstack.org/#/c/260413/916:39
derekhmarios: ack16:39
trowndtantsur: nope :(16:39
dtantsursign..16:39
trowndtantsur: one of the things that could be solved by https://review.openstack.org/#/c/27681016:39
ayoungdmsimard, OK16:40
ayoungI've updated the bug16:40
ayoungI'll remiove the -1 and comment16:40
trownthanks16:40
dmsimardayoung: thanks.16:40
openstackgerritayoung proposed openstack/tripleo-heat-templates: Nova Neutron configuration now uses keystone v3 endpoint  https://review.openstack.org/27849016:42
dmsimardtrown: let me know if there's anything broken in my patches that you notice -- note that the t-h-t update is based on the endpoint rework16:42
ayoungdmsimard,  added comments in yaml16:42
*** jtomasek_ has quit IRC16:42
dmsimardayoung: sure16:42
dmsimardayoung: hum actually don't put a comment there16:43
dmsimardthat's a generated file (the patch is based on the endpoint map rework)16:43
ayoungdmsimard, feel free to move it, but I don't know where to.16:43
dmsimardbut the generated file is versioned16:43
dmsimardok16:43
mariosderekh: well, it is going to fail... pingtest 2016-02-10 16:42:07.934 | ERROR: Failed to stop stack (tenant-stack) on other engine (a3cae6bb-e9cc-46c9-a2fd-b4b588b0bd6c)16:43
mariosderekh: https://jenkins07.openstack.org/job/gate-tripleo-ci-f22-ceph/342/console16:43
trowndmsimard: might be a good idea to comment on your patch that it is based on the endpoint generator patch with link... I would not have known about that had I not seen it come up here last night16:44
trownin which case you patch looks pretty weird16:44
*** ukalifon1 has quit IRC16:44
mariosderekh: not to worry, i will look again tomorrow morning it is getting on in the day for you too (thi may be another memory issue affecting overcloud heat in this case. doesn't seem related to the tripleoclient timeouts anyway)16:45
mariosthanks16:45
devvesamarios: let me know if you need something from me16:45
derekhmarios: ya, this is different, I'll try and take a look also16:46
dmsimardtrown: well, it's rebased on top of the generator patch - I would hope gerrit had a better way of pointing that out16:46
devvesaI was looking at the same patch the ceph job: https://jenkins04.openstack.org/job/gate-tripleo-ci-f22-ha/381/console16:46
dmsimardtrown: but you can kind of see it in the dependencies16:46
dmsimardor related changes rather16:46
devvesaand it fails in the pingtest too, but for another reason: http://fpaste.org/320828/51223181/16:46
dmsimardotherwise git log will show that it's on top of that tree16:46
mariosdevvesa: o/ jaume16:46
openstackgerritDavid Moreau Simard proposed openstack/tripleo-heat-templates: Nova Neutron configuration now uses keystone v3 endpoint  https://review.openstack.org/27849016:46
dmsimardayoung: are you cool with this https://review.openstack.org/#/c/278490/3/network/endpoints/endpoint_data.yaml16:47
ayoungdmsimard, ++16:47
dmsimardcool.16:47
trowndmsimard: ya, it is unfortunately non-obvious to me from gerrit webui, but maybe it is a non issue16:48
dmsimardtrown: it was better at showing commit was the parent before the gerrit upgrade16:49
trownyep16:49
*** mgould has joined #tripleo16:49
*** marcusvrn_ has joined #tripleo16:53
*** jaosorior_ has quit IRC16:58
*** jaosorior_ has joined #tripleo17:00
*** hjensas has quit IRC17:09
*** morazi has quit IRC17:09
*** jcoufal has quit IRC17:13
*** devvesa has quit IRC17:20
*** jcoufal has joined #tripleo17:20
*** aufi has quit IRC17:20
*** jcoufal has quit IRC17:23
*** eggmaster has quit IRC17:24
*** mbound has quit IRC17:27
*** ifarkas has quit IRC17:27
*** dtantsur is now known as dtantsur|afk17:28
*** jaosorior_ has quit IRC17:28
*** trown is now known as trown|meeting17:29
derekhLooks like the slaves loosing communication with jenkins were because of the hosts going OOM and killing them, its was particularly bad yesterday because we had a lot of jobs start at the same time, If added 15G of RAM to each compute node to see if the situation improves17:32
derekhdprince: ^17:32
dprincederekh: possibly related to us overcommitting?17:33
derekhdprince: yup17:34
*** penick has quit IRC17:36
*** tiswanso has quit IRC17:36
*** trown|meeting is now known as trown17:48
*** jtomasek has joined #tripleo17:48
*** dustins has quit IRC17:49
trownwoot woot tripleo.sh -- Overcloud pingtest, SUCCESS17:49
trowndmsimard: ^ with your latest tht patch17:50
trownnice work17:50
dmsimardtrown: wahoo17:50
dmsimardtrown: there are ci failures on the review though17:50
dmsimardtrown: well, on this one https://review.openstack.org/#/c/278134/17:50
trownderekh: dprince, that means we have all the patches we need to get current working... minus I guess one to unpin puppet-nova17:50
trownmaybe we can create that patch with a dependency on the 4 others17:51
trowndmsimard: ya, we have puppet-nova pinned so I would not expect these later ones to patch until we unpin it17:51
*** fgimenez has quit IRC17:51
dmsimardok17:52
*** rcernin has joined #tripleo17:52
trowndmsimard: I will create a tripleo-ci patch to tie all the pieces together so we can test current and puppet-nova master with them all17:53
bnemecSo, it looks to me like the puppet-nova change is the problem here.17:53
derekhtrown: ack, worth trying them all together17:53
bnemecI can run the pingest successfully against a current trunk overcloud as long as I leave the puppet-nova change out.17:53
trownhmm, I had not tried that bit17:53
trownwhat does current mean then though17:54
bnemecI'm pointed at http://trunk.rdoproject.org/centos7-liberty/eb/5a/eb5a1b841df1130a8f4691406a0f60b7d107bb7d_457a6559/17:54
bnemecShit17:54
trownbnemec: liberty :)17:54
* bnemec notices that's liberty17:54
trownwhich is working great :)17:54
bnemecWTF does our documentation use liberty as current trunk?17:55
* bnemec can't read17:56
* bnemec needs a vacation17:56
trowngood call17:56
* trown calls it a year, see you all next year17:57
*** morazi has joined #tripleo17:58
*** tiswanso has joined #tripleo18:00
trownhmm... we really need to move tripleo.sh to tripleo-ci repo... just realized I need 2 patches to tie all of this together18:01
*** derekh has quit IRC18:01
*** dustins has joined #tripleo18:01
*** w__ has quit IRC18:02
*** akrivoka has quit IRC18:02
trownerr... actually nope, both changes go in tripleo.sh nevermind18:03
*** tiswanso has quit IRC18:05
*** tiswanso has joined #tripleo18:05
*** jaosorior has quit IRC18:09
shardytrown: I proposed https://review.openstack.org/#/c/272210/ to move it, but we really need to pause landing things to tripleo-common or I'll just keep rebase racing those patches18:11
openstackgerritJohn Trowbridge proposed openstack/tripleo-common: DO NOT MERGE testing current with master puppet-nova  https://review.openstack.org/27855318:12
shardyramishra: ^^18:12
shardytrown: will that also pick up latest trunk heat?18:12
shardyramishra has been looking to test a recent change which has been reported to cause issues w/magnum18:12
shardywe're interested to prove if TripleO is OK, and I've not yet pulled and locally tested18:13
shardyhttps://github.com/openstack/heat/commit/0388da504765f9975aeadc509672c0a47bbcc24418:13
trownshardy: ya it just moves the delorean pin from current-tripleo to current18:13
shardythat's the commit under discussion FYI18:13
trownso whatever is on current for heat will get pulled in18:13
shardyOk, thanks18:13
*** w__ has joined #tripleo18:14
trownshardy: I just tested with http://trunk.rdoproject.org/centos7/57/a1/57a16b4571af82276a813d7f07f9dd47bc48f677_9d3dd879 with all of the depends on patches in that review above and it passed... and there is not a newer heat build in delorean18:15
shardytrown: ack, thanks, may be an issue specific to magnum then18:15
shardyramishra: ^^18:16
ramishrashardy: thanks18:16
trownI did not test HA, but I dont see that heat commit being an HA specific break18:17
shardyYeah, although we may need to test w/network-isolation to be sure all is OK18:17
trownyep, I did not test that path either18:18
*** Marga_ has joined #tripleo18:21
*** rhallisey has quit IRC18:21
*** electrofelix has quit IRC18:22
openstackgerritRabi Mishra proposed openstack/tripleo-heat-templates: [DNM] Test with heat patch  https://review.openstack.org/27855618:23
*** lucasagomes is now known as lucas-afk18:25
*** mgould has quit IRC18:36
*** nico_auv has quit IRC18:40
*** morazi has quit IRC18:45
*** liverpooler has joined #tripleo18:47
*** athomas has quit IRC18:47
*** mkovacik has quit IRC18:47
*** shivrao has joined #tripleo18:47
*** penick has joined #tripleo18:57
*** w_ has joined #tripleo19:01
*** w__ has quit IRC19:03
*** mcornea has quit IRC19:05
*** trown is now known as trown|lunch19:05
openstackgerritDustin Schoenbrun proposed openstack/tripleo-heat-templates: Enable Manila integration  https://review.openstack.org/18813719:08
*** w_ has quit IRC19:14
*** w_ has joined #tripleo19:14
*** w_ has quit IRC19:15
*** jprovazn has quit IRC19:20
*** Marga_ has quit IRC19:21
*** electrofelix has joined #tripleo19:30
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates: Make External Load Balancer templates work with IPv6  https://review.openstack.org/27070019:36
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: puppet: update mistral deployment  https://review.openstack.org/27740419:37
*** panda has quit IRC19:37
*** panda has joined #tripleo19:38
*** electrofelix has quit IRC19:50
*** trown|lunch is now known as trown19:52
*** Goneri has quit IRC20:06
*** Goneri has joined #tripleo20:09
*** jtomasek has quit IRC20:10
*** Marga_ has joined #tripleo20:23
*** yamahata has joined #tripleo20:37
openstackgerritColleen Murphy proposed openstack/diskimage-builder: Fix dpkg element for Ubuntu Xenial  https://review.openstack.org/27861720:40
trowndmsimard: found an issue with https://review.openstack.org/#/c/276790/6 which causes HA job to fail20:40
trownceph job looks like spurious failure to me20:41
dmsimardcheckling20:41
dmsimardchecking, to20:41
dmsimardsigh20:41
* dmsimard needs to get used to new keyboard20:41
trownslagle: bnemec, any chance you want to approve https://review.openstack.org/#/c/275607/20:41
dmsimardtrown: you're right20:42
trownI didnt catch it because I didnt test HA20:42
slaglei want to approve many things20:43
trownthanks bnemec20:44
*** jpeeler has quit IRC20:44
openstackgerritDavid Moreau Simard proposed openstack/tripleo-heat-templates: Nova now requires an api database to be created  https://review.openstack.org/27679020:44
slagleoh man, bnemec stole my thanks20:44
dmsimardtrown: ^20:44
bnemecslagle: Ninja'd :-P20:45
trownslagle: thanks for wanting to approve it :)20:45
dmsimardDang, https://review.openstack.org/#/c/275607/ was double approved20:45
dmsimardthat makes it double awesome20:45
trownworkflow +220:45
* bnemec needed a break from trying to figure out how the client validations aren't breaking the world anyway20:46
*** eil397 has joined #tripleo20:47
openstackgerritMerged openstack/instack-undercloud: Update puppet nova to sync new Nova API database  https://review.openstack.org/27560720:50
trown1 down 3 to go20:56
openstackgerritBen Nemec proposed openstack/python-tripleoclient: Don't warn about missing profiles when they're not used  https://review.openstack.org/27668820:58
*** bvandenh_ has quit IRC21:02
*** egafford has quit IRC21:03
*** yamahata has quit IRC21:06
dustinsHey all! Now that I've got the gate checks working, could I get some eyes on https://review.openstack.org/#/c/188137?21:10
dustinsThe Manila Integration patch21:10
*** Marga_ has quit IRC21:16
*** tiswanso has quit IRC21:24
openstackgerritJohn Trowbridge proposed openstack/tripleo-common: DO NOT MERGE testing current with master puppet-nova  https://review.openstack.org/27855321:24
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates: Add sysctl settings to disable IPv6 on unconfigured interfaces  https://review.openstack.org/27718221:25
openstackgerritBen Swartzlander proposed openstack/tripleo-heat-templates: Add integration with NetApp Manila driver  https://review.openstack.org/18813821:28
*** dustins_ has joined #tripleo21:29
*** dustins has quit IRC21:32
*** dustins_ is now known as dustins21:33
*** jayg is now known as jayg|g0n321:37
*** tremble has quit IRC21:37
*** pradk_ has joined #tripleo21:38
*** dprince has quit IRC21:40
*** mburned` has joined #tripleo21:41
*** crinkle_ has joined #tripleo21:41
openstackgerritMerged openstack/tripleo-heat-templates: Fix endpoint names  https://review.openstack.org/27543621:42
*** CaptTofu__ has joined #tripleo21:45
*** crinkle has quit IRC21:47
*** HenryG_ has joined #tripleo21:47
*** crinkle_ is now known as crinkle21:47
openstackgerritMerged openstack/tripleo-common: Output some debug info when pingtest fails  https://review.openstack.org/27436721:47
*** pradk has quit IRC21:48
*** gfidente has quit IRC21:48
*** jrist has quit IRC21:48
*** mburned has quit IRC21:48
*** HenryG has quit IRC21:48
*** dhellmann has quit IRC21:48
*** CaptTofu_ has quit IRC21:48
*** ramishra has quit IRC21:48
*** larsks has quit IRC21:48
*** HenryG_ is now known as HenryG21:48
*** larsks has joined #tripleo21:49
*** dhellmann has joined #tripleo21:49
openstackgerritMerged openstack/python-tripleoclient: Revert "Pass environment variables of proxy to tox"  https://review.openstack.org/26774321:50
openstackgerritMerged openstack/diskimage-builder: Fix growroot for Gentoo's openrc  https://review.openstack.org/27657821:50
*** tiswanso has joined #tripleo21:52
*** HenryG has quit IRC21:52
*** jrist has joined #tripleo21:54
*** jrist has joined #tripleo21:54
*** xinwu has joined #tripleo21:55
*** HenryG has joined #tripleo21:56
*** ramishra has joined #tripleo21:56
*** lblanchard has quit IRC22:05
*** rcernin has quit IRC22:07
*** dustins has quit IRC22:10
*** trown is now known as trown|outtypewww22:13
*** shardy has quit IRC22:14
*** julim has quit IRC22:16
*** Marga_ has joined #tripleo22:16
*** Goneri has quit IRC22:17
*** julim has joined #tripleo22:17
*** julim has quit IRC22:17
*** sthillma has joined #tripleo22:20
*** dustins has joined #tripleo22:20
*** dcain1 has joined #tripleo22:20
*** chlong_ has joined #tripleo22:22
*** dhellmann has quit IRC22:22
*** chlong has quit IRC22:22
*** dcain has quit IRC22:22
*** dhellmann has joined #tripleo22:23
*** bvandenh_ has joined #tripleo22:23
*** tiswanso has quit IRC22:25
openstackgerritMerged openstack/python-tripleoclient: Remove tripleoclient.baremetal wrapper  https://review.openstack.org/26533622:32
openstackgerritMerged openstack/tripleo-puppet-elements: Add puppet-kmod into image  https://review.openstack.org/27624922:36
*** bvandenh_ has quit IRC22:37
openstackgerritMerged openstack/tripleo-heat-templates: Remove not needed completion-signal  https://review.openstack.org/25592722:39
*** penick has quit IRC22:39
openstackgerritMerged openstack/diskimage-builder: Mark ironic-discoverd-ramdisk as deprecated in favor of ironic-agent  https://review.openstack.org/27026722:48
openstackgerritMerged openstack/tripleo-heat-templates: Set 'host' globally in Cinder instead of per-backend basis  https://review.openstack.org/27751722:48
openstackgerritMerged openstack/tripleo-heat-templates: Pass -q option to yum  https://review.openstack.org/27732522:49
openstackgerritMerged openstack-infra/tripleo-ci: scp/ssh do not check for know host keys  https://review.openstack.org/26966022:51
*** rpothier has quit IRC22:56
*** saneax_AFK is now known as saneax22:57
*** eil397 has quit IRC22:58
*** eil397 has joined #tripleo23:01
openstackgerritMerged openstack/tripleo-docs: Add a note about rerunning the installer  https://review.openstack.org/22230223:02
*** rwsu has quit IRC23:06
*** egafford has joined #tripleo23:12
*** yamahata has joined #tripleo23:14
*** dustins has quit IRC23:18
*** penick has joined #tripleo23:23
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Source undercloud environment variable from a file  https://review.openstack.org/27566723:26
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Split the deploy script into its own file  https://review.openstack.org/27566823:26
ayoungmarios, can you take another look at https://review.openstack.org/#/c/213175/ and make sure I got it looking right. The fact  that the previous version passed CI has me concerned that I could miss something and then break someone down the road23:31
ayoung"puppet: run keystone in wsgi"  https://review.openstack.org/#/c/213175/  EmilienM you, too, please.  If it meets your standards, +1.23:34
*** egafford has quit IRC23:36
openstackgerritMerged openstack/diskimage-builder: py26 is no longer supported by Infra's CI  https://review.openstack.org/26165623:36
*** egafford has joined #tripleo23:37
*** panda has quit IRC23:37
*** panda has joined #tripleo23:38
*** chlong_ has quit IRC23:46
*** weshay has quit IRC23:49
*** egafford has quit IRC23:51
*** egafford has joined #tripleo23:52

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!