| *** dtrainor has joined #tripleo | 00:00 | |
| ayoung | rcrit, what is the hack to get an overcloud redeploy to work? Aside from deleting the overcloud stack, we had to do something else? | 00:04 |
|---|---|---|
| ayoung | openstack stack delete overcloud --yes | 00:04 |
| ayoung | swift delete overcloud | 00:04 |
| ayoung | mistral environment-delete overcloud | 00:04 |
| ayoung | there it is | 00:04 |
| *** sshnaidm has quit IRC | 00:19 | |
| *** r2bit has quit IRC | 00:29 | |
| *** limao has joined #tripleo | 00:29 | |
| *** limao has quit IRC | 00:29 | |
| *** limao has joined #tripleo | 00:29 | |
| *** r2bit has joined #tripleo | 00:30 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/372814 | 00:32 |
| openstackgerrit | Merged openstack/tripleo-common: Fix upload-swift-artifacts work new OSclient https://review.openstack.org/362915 | 00:35 |
| *** dmacpher has quit IRC | 00:48 | |
| openstackgerrit | Merged openstack/diskimage-builder: yum-minimal: Disable excludes when installing pkg manager https://review.openstack.org/372808 | 00:57 |
| *** rbrady_ has joined #tripleo | 01:02 | |
| *** rbrady has quit IRC | 01:02 | |
| *** saneax is now known as saneax-_-|AFK | 01:15 | |
| *** bana_k has quit IRC | 01:28 | |
| *** sshnaidm has joined #tripleo | 01:33 | |
| *** dmacpher has joined #tripleo | 01:37 | |
| *** mburned` is now known as mburned_out | 01:37 | |
| *** thrash is now known as thrash|g0ne | 01:55 | |
| *** tzumainn has quit IRC | 02:05 | |
| openstackgerrit | Brad P. Crochet proposed openstack/puppet-tripleo: Add zaqar profiles https://review.openstack.org/331681 | 02:10 |
| *** limao has quit IRC | 02:49 | |
| *** limao has joined #tripleo | 02:49 | |
| *** david-lyle has quit IRC | 03:03 | |
| *** limao_ has joined #tripleo | 03:08 | |
| *** limao has quit IRC | 03:11 | |
| *** coolsvap has joined #tripleo | 03:22 | |
| *** dtrainor has quit IRC | 03:35 | |
| *** rbrady_ has quit IRC | 03:40 | |
| *** jcoufal has quit IRC | 04:12 | |
| *** yamahata has joined #tripleo | 04:21 | |
| *** masco has joined #tripleo | 04:25 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Terminate Zaqar websocket endpoint in HAProxy https://review.openstack.org/360329 | 04:52 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud: Enable TLS for Zaqar's websocket endpoint https://review.openstack.org/360350 | 04:52 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud: Make HAProxy terminate OpenStack internal/admin endpoints https://review.openstack.org/360366 | 04:53 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud: Always deploy HAProxy https://review.openstack.org/360368 | 04:53 |
| *** pgadiya has joined #tripleo | 04:54 | |
| *** jaosorior has joined #tripleo | 04:55 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-docs: Move undercloud SSL admonition to SSL file https://review.openstack.org/372508 | 05:07 |
| *** jroll has quit IRC | 05:09 | |
| *** jroll has joined #tripleo | 05:09 | |
| *** jroll has quit IRC | 05:09 | |
| *** jroll has joined #tripleo | 05:09 | |
| *** jaosorior has quit IRC | 05:09 | |
| *** jaosorior has joined #tripleo | 05:10 | |
| *** akshai has joined #tripleo | 05:11 | |
| openstackgerrit | Merged openstack/python-tripleoclient: Pass the timeout to the deploy workflow https://review.openstack.org/370186 | 05:14 |
| *** akshai has quit IRC | 05:19 | |
| *** saneax-_-|AFK is now known as saneax | 05:19 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: DO NOT MERGE - TESTING BARBICAN https://review.openstack.org/353262 | 05:21 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add Barbican to the overcloud - WIP https://review.openstack.org/352458 | 05:21 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-validations: Port the network environment validation https://review.openstack.org/341586 | 05:26 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-validations: Add jsonschema validation for os-net-config data https://review.openstack.org/351345 | 05:26 |
| *** bnemec has joined #tripleo | 05:27 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates: GATE TEST, please ignore https://review.openstack.org/361173 | 05:30 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates: GATE TEST, please ignore https://review.openstack.org/365449 | 05:30 |
| *** limao_ has quit IRC | 05:33 | |
| *** limao has joined #tripleo | 05:33 | |
| jaosorior | d0ugal: ping | 05:33 |
| *** yolanda has joined #tripleo | 05:34 | |
| *** florianf has quit IRC | 05:41 | |
| *** florianf has joined #tripleo | 05:41 | |
| openstackgerrit | Merged openstack/tripleo-ui: Migrate Deploy action to Mistral https://review.openstack.org/357125 | 05:51 |
| *** oshvartz has joined #tripleo | 05:56 | |
| openstackgerrit | Saravanan KR proposed openstack/os-net-config: Fixed nic numbering issue of DPDK nics after the nic has bound https://review.openstack.org/364354 | 06:00 |
| openstackgerrit | Saravanan KR proposed openstack/os-net-config: Add mac address to the DPDK mapping file https://review.openstack.org/370012 | 06:00 |
| openstackgerrit | avnish proposed openstack/os-cloud-config: Update home page link in cfg file https://review.openstack.org/372904 | 06:04 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud: Work around deletion of _member_ role assignments on upgrade https://review.openstack.org/307352 | 06:07 |
| *** fzdarsky has joined #tripleo | 06:07 | |
| *** ccamacho has quit IRC | 06:07 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud: Work around deletion of _member_ role assignments on upgrade https://review.openstack.org/307352 | 06:08 |
| *** rasca has joined #tripleo | 06:11 | |
| *** shardy has joined #tripleo | 06:12 | |
| jaosorior | shardy: hey dude, have you been looking into the bug where mistral can't execute the action plan_deploy due tripleo-common being unable to retrieve a local file? | 06:19 |
| *** dmacpher has quit IRC | 06:20 | |
| openstackgerrit | Merged openstack/diskimage-builder: Add libselinux-python to yum-minimal https://review.openstack.org/371834 | 06:23 |
| *** ccamacho has joined #tripleo | 06:24 | |
| shardy | jaosorior: Yes, I tried to reproduce it yesterday but so far have failed to do so, create of a stack works fine for me, including with optional and locally defined extra environments & templates | 06:26 |
| shardy | There are two bugs: | 06:26 |
| shardy | https://bugs.launchpad.net/tripleo/+bug/1623552 | 06:26 |
| openstack | Launchpad bug 1623552 in tripleo "heatclient resolves paths for types and get_file calls that then don't make sense in swift" [Critical,Triaged] | 06:26 |
| shardy | and | 06:26 |
| ccamacho | morning all! | 06:26 |
| shardy | https://bugs.launchpad.net/tripleo/+bug/1624727 | 06:26 |
| openstack | Launchpad bug 1624727 in tripleo "Could not fetch contents for file:///home/stack/tripleo-heat-templates/puppet/post.yaml" [Critical,Triaged] | 06:26 |
| shardy | jaosorior: I suspect they are both the same issue, and that the problem is we have some brokenness in the plan update workflow which isn't yet fixed | 06:27 |
| *** mcornea has joined #tripleo | 06:27 | |
| shardy | try doing a openstack plan delete overcloud | 06:27 |
| jaosorior | shardy: you gotta do a re-deploy | 06:27 |
| shardy | then do a clean deploy | 06:27 |
| jaosorior | that's how I got that issue | 06:27 |
| ccamacho | jaosorior, there is another issue in liberty but this time when creating overcloud images https://bugs.launchpad.net/tripleo/+bug/1625463 | 06:27 |
| openstack | Launchpad bug 1625463 in tripleo "Package dependency issue in liberty deployments" [Undecided,New] | 06:27 |
| jaosorior | doing a deploy works, but re-deploying breaks with that | 06:27 |
| shardy | jaosorior: You mean do overcloud deploy, then another overcloud deploy without deleting? | 06:28 |
| shardy | or clean install of the undercloud? | 06:28 |
| jaosorior | shardy: first option | 06:28 |
| openstackgerrit | avnish proposed openstack/tripleo-validations: modify the home-page info with the developer documentation https://review.openstack.org/372930 | 06:28 |
| shardy | jaosorior: Yeah, that's what I'm saying | 06:28 |
| jaosorior | shardy: so as a workaround for the existing issues with the workflows | 06:28 |
| jaosorior | I delete the plan | 06:28 |
| jaosorior | then delete the swift container | 06:28 |
| shardy | we know that is broken, d0ugal has patches up but they've not yet landed | 06:28 |
| jaosorior | then try to deploy again | 06:28 |
| *** jprovazn has joined #tripleo | 06:29 | |
| jaosorior | and that's how I get that "could not fetch contents for file://..." error | 06:29 |
| shardy | jaosorior: ack, pls can you comment on https://bugs.launchpad.net/tripleo/+bug/1623552 if that works | 06:29 |
| openstack | Launchpad bug 1623552 in tripleo "heatclient resolves paths for types and get_file calls that then don't make sense in swift" [Critical,Triaged] | 06:29 |
| jaosorior | shardy: yes; I'm aware there are fixes... I was just telling you how I had stumbled upon that | 06:29 |
| ccamacho | jaosorior, I confirm that issue from yesterday (second deployment fails "delete the plan" and then the post.yaml error) | 06:29 |
| jaosorior | ccamacho: exactly | 06:30 |
| openstackgerrit | avnish proposed openstack/tripleo-incubator: Update home page link in cfg file https://review.openstack.org/372933 | 06:30 |
| ccamacho | jaosorior** but, like 2 days ago didnt hit the post.yaml issue only the plan one | 06:30 |
| shardy | I'm confused then | 06:30 |
| shardy | I did repeated redeploys all afternoon yesterday | 06:30 |
| shardy | and it works fine, provided you do a stack-delete && plan delete | 06:30 |
| jaosorior | shardy: I did a fresh deploy yesterday evening. And it doesn't work for me | 06:30 |
| jaosorior | shardy: stack delete? | 06:31 |
| jaosorior | no no | 06:31 |
| shardy | Yes, my sequence is openstack overcloud deploy --templates -e $stuff | 06:31 |
| jaosorior | I'm deleting the swift container and the plan | 06:31 |
| *** yolanda has quit IRC | 06:31 | |
| shardy | then heat stack-delete overcloud | 06:31 |
| ccamacho | I think there was a revert somewhere which introduced that :P | 06:31 |
| shardy | then openstack overcloud plan delete overcloud | 06:31 |
| shardy | I can do that cycle as many times as I want, no errors | 06:32 |
| ccamacho | as as shady said I wasnt having that issue also, only since a fresh install from yesterday | 06:32 |
| jaosorior | shardy: yeah, I think that works | 06:32 |
| shardy | you shouldn't delete the swift container manually | 06:32 |
| shardy | you have to use plan delete overcloud | 06:32 |
| jaosorior | shardy: I tried getting deploying to work | 06:32 |
| shardy | or the mistral environment remains which messes things up | 06:32 |
| shardy | I raised a bug about that already | 06:32 |
| jaosorior | shardy: alright, so here the thing is that I was told that to be able to do an update (or overcloud deploy, again) I needed to delete the container, and the mistral environment | 06:33 |
| jaosorior | and then I should just do an overcloud deploy (with the stack still existing) | 06:33 |
| jaosorior | and now I'm stumbling upon that bug | 06:33 |
| shardy | jaosorior: Yeah, or do plan delete, which is the same thing | 06:33 |
| shardy | No, you should delete the stack too | 06:33 |
| jaosorior | shardy: plan delete requires that the stack be deleted | 06:33 |
| shardy | exactly | 06:33 |
| jaosorior | so then we're talking about different things | 06:33 |
| jaosorior | I don't want to do a complete redeploy every single time | 06:34 |
| shardy | all the update stuff is busted until the fixes from d0ugal lands | 06:34 |
| jaosorior | ok | 06:34 |
| shardy | because we don't render the j2 templates | 06:34 |
| shardy | that's while post.yaml is missing | 06:34 |
| jaosorior | ok, that makes sense. Then I had wrong information | 06:34 |
| jaosorior | thanks for clarifying | 06:34 |
| shardy | jaosorior: You have two choices, either do a full overcloud redeploy, or pull the fixes listed in https://bugs.launchpad.net/tripleo/+bug/1624727 | 06:35 |
| openstack | Launchpad bug 1624727 in tripleo "Could not fetch contents for file:///home/stack/tripleo-heat-templates/puppet/post.yaml" [Critical,Triaged] | 06:35 |
| shardy | either way, feedback on the bugs would be good | 06:35 |
| shardy | hopefully d0ugal can confirm how we unblock those fixes today | 06:35 |
| jaosorior | shardy: I can pull the fixes. Got a list? | 06:35 |
| *** bana_k has joined #tripleo | 06:35 | |
| shardy | in the bug I just linked | 06:35 |
| jaosorior | ok, will pull those in | 06:36 |
| ccamacho | *** Currently both deployments Mitaka and Liberty are broken... https://bugs.launchpad.net/tripleo/+bug/1625463 https://bugs.launchpad.net/tripleo/+bug/1625315 | 06:37 |
| openstack | Launchpad bug 1625463 in tripleo "Package dependency issue in liberty deployments" [Undecided,New] | 06:37 |
| openstack | Launchpad bug 1625315 in tripleo "Can't deploy Mitaka overcloud on CentOS" [Undecided,New] | 06:37 |
| ccamacho | just reported in RDO | 06:37 |
| ccamacho | there is some dep issue when building the overcloud iamges | 06:37 |
| ccamacho | going for some coffee http://cdn77.sadanduseless.com/wp-content/uploads/2014/05/bird-with-arms16.jpg | 06:39 |
| jaosorior | shardy: by the way, do you know more or less how often the tripleo changes get pulled in RDO? | 06:41 |
| *** jbadiapa has joined #tripleo | 06:43 | |
| *** dciabrin|away is now known as dciabrin | 06:46 | |
| jaosorior | shardy, d0ugal also, this patch https://review.openstack.org/#/c/371347/ which is listed in the fixes has a depends-on on an abandoned patch on tripleoclient, what's up? | 06:46 |
| d0ugal | jaosorior: pong | 06:48 |
| * d0ugal reads up | 06:48 | |
| jaosorior | d0ugal: I can test out the fixes, but I'm a bit confused on which to pull | 06:50 |
| *** pcaruana has joined #tripleo | 06:50 | |
| d0ugal | jaosorior: Right, which problem are you hitting? | 06:51 |
| d0ugal | A bunch landed yesterday. | 06:51 |
| jaosorior | d0ugal: ok, I'm re-running undercloud install just to make sure I have everything | 06:52 |
| jaosorior | d0ugal: but yeah, I was still having issues with doing an update to a running overcloud | 06:55 |
| shardy | d0ugal: we're trying to figure out the needed fixes for the broken plan update stuff | 06:55 |
| shardy | as I think that's the main cause of the file::/// bugs | 06:55 |
| d0ugal | shardy: Right, I don't think there is a complete fix yet | 06:56 |
| *** zoli_gone-proxy is now known as zoliXXL | 06:56 | |
| d0ugal | shardy: I am thinking about just deleting the plan and re-creating. | 06:56 |
| d0ugal | shardy: because I have no idea what is going on. | 06:56 |
| shardy | d0ugal: can we at least land the workflow fix to run ProcessTemplates on plan update? | 06:56 |
| d0ugal | We really screwed up by not planning the update workflow | 06:56 |
| d0ugal | shardy: I think so, yes. | 06:56 |
| shardy | https://bugs.launchpad.net/tripleo/+bug/1624727 will be fixed by that AFAICS | 06:56 |
| openstack | Launchpad bug 1624727 in tripleo "Could not fetch contents for file:///home/stack/tripleo-heat-templates/puppet/post.yaml" [Critical,Triaged] | 06:56 |
| d0ugal | shardy, jaosorior: https://review.openstack.org/#/c/371027/ | 06:56 |
| shardy | the post.yaml is just missing because we delete all the files, then fail to run j2 afterwards | 06:57 |
| jaosorior | d0ugal: already had my +2 :P | 06:57 |
| d0ugal | jaosorior: oops :) | 06:57 |
| *** tremble has joined #tripleo | 06:57 | |
| d0ugal | ah, I need to move that change out of the chain | 06:57 |
| d0ugal | 1 min | 06:57 |
| shardy | d0ugal: yeah, that was my next question ;) | 06:57 |
| shardy | I commented on https://review.openstack.org/#/c/371347/ (head of the chain) yesterday, and I'm still not exactly clear why that depends on the mistral fix | 06:58 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Add template processing to the update plan workflow. https://review.openstack.org/371027 | 06:58 |
| shardy | is it because we're returning a gigantic data blob from the action? | 06:58 |
| d0ugal | shardy, jaosorior: https://review.openstack.org/#/c/371027/ now doesn't depend on anything | 06:59 |
| *** skramaja has joined #tripleo | 06:59 | |
| d0ugal | shardy: when the default plan creation works we hit the mistral bug. | 06:59 |
| d0ugal | shardy: at the moment it is broken so the workflow ends quickly | 06:59 |
| jaosorior | ok, pulled the latest stuff and now I can't do an overcloud deploy (not even a starting one) | 06:59 |
| jaosorior | u'message': u"No connection adapters were found for 'file:///home/stack/tripleo-heat-templates/puppet/manifests/overcloud_controller_pacemaker.pp'", | 06:59 |
| *** skramaja has quit IRC | 06:59 | |
| d0ugal | shardy: otherwise it is still running when some of the CLI commands are called, that causes the error. | 06:59 |
| d0ugal | jaosorior: huh, you found the error shardy was looking for :) | 06:59 |
| shardy | d0ugal: Ok, thanks for confirming | 07:00 |
| d0ugal | shardy: so because I fixed the default plan at the same time as adding templating processing (I was rushing) both got reverted to fix the CI issues. | 07:00 |
| shardy | jaosorior: Ok, so that's the bug reported in https://bugs.launchpad.net/tripleo/+bug/1623552 and I cannot reproduce it | 07:00 |
| openstack | Launchpad bug 1623552 in tripleo "heatclient resolves paths for types and get_file calls that then don't make sense in swift" [Critical,Triaged] | 07:00 |
| d0ugal | jaosorior: Which environments are you passing in? | 07:01 |
| jaosorior | shardy: have you tried using manifests from your home directory and not the ones that are packaged? | 07:01 |
| shardy | yeah, please update the bug with the tripleo-common, tripleoclient and heatclient version you have, and the exact CLI call you're making | 07:01 |
| shardy | jaosorior: Yes, I always deploy a local tree, not the packaged one | 07:02 |
| shardy | but I normally do it from /tmp/tripleo-heat-templates | 07:02 |
| jaosorior | d0ugal: passing in this openstack overcloud deploy \ | 07:02 |
| jaosorior | --templates tripleo-heat-templates \ | 07:02 |
| jaosorior | --libvirt-type qemu --control-flavor oooq_control --compute-flavor oooq_compute --ceph-storage-flavor oooq_ceph --timeout 90 -e tripleo-heat-templates/environments/network-isolation.yaml -e tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml -e $HOME/network-environment.yaml -e tripleo-heat-templates/environments/puppet-pacemaker.yaml --control-scale 3 --neutron-network-type vxlan | 07:02 |
| jaosorior | --neutron-tunnel-types vxlan --ntp-server pool.ntp.org | 07:02 |
| shardy | Ok, so relative paths are one difference here | 07:02 |
| d0ugal | shardy: do you ever deploy anything outside your t-h-t directory? i.e. --templates somewhere -e somewhere-else? | 07:02 |
| *** leanderthal|afk is now known as leanderthal | 07:02 | |
| shardy | mine are all absolute | 07:02 |
| shardy | d0ugal: yes, I tested that yesterday, and it works for me | 07:02 |
| shardy | I passed in a different firstboot script via an extra template & environment | 07:03 |
| d0ugal | perhaps we can make all the paths absolute first? | 07:03 |
| shardy | d0ugal: well, first lets figure out a reproducer | 07:03 |
| d0ugal | True :) | 07:03 |
| shardy | I was just pointing out I'm driving the CLI differently, it may be unrelated | 07:03 |
| jaosorior | shardy: well, to be fair I'm also passing a bunch of other environment files | 07:03 |
| d0ugal | Sure | 07:03 |
| jaosorior | passing in names and such | 07:04 |
| jaosorior | but, nothing related to the stuff that it spits out as an error. That one is included in the pacemaker one | 07:04 |
| *** bana_k has quit IRC | 07:04 | |
| shardy | jaosorior: Yeah, I just need some way to reproduce it - can you try again with absolute paths for everything? | 07:04 |
| shardy | particularly tripleo-heat-templates/environments/puppet-pacemaker.yaml | 07:04 |
| * d0ugal is waiting for his undercloud to finish installing | 07:05 | |
| * shardy is waiting for his coffee to kick in | 07:05 | |
| jaosorior | will do | 07:06 |
| *** radeks has joined #tripleo | 07:07 | |
| *** zoliXXL is now known as zoli_gone-proxy | 07:07 | |
| jaosorior | shardy: it worked | 07:09 |
| d0ugal | Nice! | 07:09 |
| d0ugal | So it turns out I am just bad at path munging :) | 07:10 |
| shardy | Ok | 07:11 |
| shardy | I've reproduced locally with relative paths | 07:11 |
| shardy | It blows up with heatclient trying to read local files inside the mistral action | 07:11 |
| shardy | d0ugal: do you want to take a look? I guess we must be missing the entries for relative paths from the files map | 07:12 |
| *** flepied1 is now known as flepied | 07:12 | |
| shardy | and/or we're doing heatclient stuff we shouldn't do in the mistral action | 07:12 |
| d0ugal | shardy: Yeah, I can try and have a look - but I'm not really sure how I've missed them. | 07:12 |
| d0ugal | shardy: I suspect we are doing something wrong :) | 07:13 |
| shardy | d0ugal: Ok, I have an appointment shortly, but if you've not cracked it by the time I return, I'll be happy to help | 07:13 |
| shardy | now it's reproducable we can iterate faster :) | 07:13 |
| shardy | I suspect we can probably simplify things in tripleoclient, with two calls to heatclient | 07:13 |
| shardy | one which grabs all the local files, and another which resolves the uploaded container | 07:14 |
| shardy | will give that a try later | 07:14 |
| *** zoli_gone-proxy is now known as zoliXXL | 07:14 | |
| d0ugal | shardy: Yeah, probably, that would be good. I'll see what I can learn while you are out. | 07:14 |
| *** chlong has quit IRC | 07:14 | |
| *** zoliXXL is now known as zoli|trng | 07:15 | |
| *** hjensas has joined #tripleo | 07:19 | |
| *** aufi has joined #tripleo | 07:19 | |
| *** shardy has quit IRC | 07:19 | |
| marios | jistr: hey morning... i took objection to 'stalled' :) https://etherpad.openstack.org/p/ocata-tripleo | 07:19 |
| *** rcernin has joined #tripleo | 07:19 | |
| marios | jistr: had to go looking for your reviews saw you abandoned them | 07:19 |
| jaosorior | therve: thought the error was transient. Had stopped already. | 07:23 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add an optional timeout when waiting for websocket messages https://review.openstack.org/364252 | 07:23 |
| therve | jaosorior, After 4 builds with the same error we should get a clue :p | 07:24 |
| jaosorior | Can someone check out these two commits? https://review.openstack.org/#/c/360329/ https://review.openstack.org/#/c/360350/ | 07:24 |
| jaosorior | therve: hadn't seen that it was 4 builds. | 07:24 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Return the result of create_plan in create_deployment_plan workflow https://review.openstack.org/371348 | 07:25 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fix the default plan creation https://review.openstack.org/371347 | 07:25 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fix the default plan creation https://review.openstack.org/371347 | 07:25 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Remove the unused service_host arg from node registration https://review.openstack.org/326036 | 07:27 |
| *** yamahata has quit IRC | 07:27 | |
| jtomasek | shardy, d0ugal, EmilienM: I've added proposal for GUI/CLI/Validations Summit session with a link to temporary etherpad https://etherpad.openstack.org/p/ocata-tripleo | 07:33 |
| *** dsariel has joined #tripleo | 07:33 | |
| jtomasek | shardy, d0ugal, EmilienM: I'll continue updating the etherpad and then move the information to ocata etherpad. Feel free to add stuff/comment | 07:33 |
| *** jpich has joined #tripleo | 07:33 | |
| *** ohamada has joined #tripleo | 07:34 | |
| jaosorior | marios: hey dude, can you check out these two CRs? https://review.openstack.org/#/c/360329/ https://review.openstack.org/#/c/360350/ they've been there for a while, but I was missing a configuration in tripleo-ci before that would work. | 07:35 |
| d0ugal | jtomasek: cool, sounds good :) Who is going from the Validations/CLI side of things? | 07:35 |
| marios | jaosorior: will do in a bit ... sorry yesterday the one you asked me to loko at merged by the time i got to it, but they are in the list ... | 07:36 |
| jaosorior | marios: no biggie, thanks dude | 07:36 |
| *** jpena|off is now known as jpena | 07:36 | |
| *** ebarrera has joined #tripleo | 07:37 | |
| jtomasek | d0ugal: looking at the list it is probably you for CLI | 07:37 |
| jtomasek | d0ugal: and shadower for validations | 07:38 |
| d0ugal | jtomasek: heh, well, I can be there to represent but don't sign me up for any work :) | 07:42 |
| *** jlinkes has joined #tripleo | 07:44 | |
| jtomasek | d0ugal: ack | 07:45 |
| d0ugal | oh, I almost forgot I need to run to the dentist. Back in a bit | 07:46 |
| * d0ugal -> dentist | 07:46 | |
| *** rdopiera has joined #tripleo | 07:48 | |
| rdopiera | I wonder if any of you, gentlepeople, could point me to where the overcloud horizon's configuration is defined? | 07:48 |
| rdopiera | (preferably in rhel downstream) | 07:49 |
| jaosorior | rdopiera: you mean this? https://github.com/openstack/puppet-horizon/blob/master/templates/local_settings.py.erb | 07:49 |
| bandini | rdopiera: look at tripleo-heat-templates/puppet/services/horizon.yaml (that is the entry point), then look at puppet-tripleo/manifests/profile/base/horizon.pp and then puppet-horizon | 07:50 |
| rdopiera | bandini, jaosorior: perfect, thank you | 07:53 |
| rdopiera | now just to find where it is packaged... | 07:54 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 07:55 |
| *** b00tcat has quit IRC | 07:57 | |
| *** milan has joined #tripleo | 07:58 | |
| jistr | marios: hi, yea i did. I only had the original approach that got -2'd. | 07:59 |
| *** athomas has joined #tripleo | 08:00 | |
| jaosorior | jistr: hey man, when you get time can you review these https://review.openstack.org/#/c/360329/ https://review.openstack.org/#/c/360350/ ? | 08:01 |
| *** hewbrocca-afk is now known as hewbrocca | 08:01 | |
| *** b00tcat has joined #tripleo | 08:02 | |
| jistr | jaosorior: should the bugs be targeted at rc2? otherwise we can't merge them | 08:03 |
| *** chem``` has joined #tripleo | 08:08 | |
| *** limao has quit IRC | 08:11 | |
| *** fzdarsky has quit IRC | 08:14 | |
| *** pmannidi has quit IRC | 08:15 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: RabbitMQ threads should be configured dynamically https://review.openstack.org/373027 | 08:17 |
| *** chem``` is now known as chem | 08:18 | |
| *** fzdarsky has joined #tripleo | 08:19 | |
| *** chem has quit IRC | 08:20 | |
| *** chem has joined #tripleo | 08:21 | |
| *** radeks has quit IRC | 08:23 | |
| *** gfidente has joined #tripleo | 08:24 | |
| *** yolanda has joined #tripleo | 08:24 | |
| *** cylopez has joined #tripleo | 08:26 | |
| *** abehl has joined #tripleo | 08:29 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: RabbitMQ threads should be configured dynamically https://review.openstack.org/373027 | 08:33 |
| *** derekh has joined #tripleo | 08:34 | |
| *** skramaja has joined #tripleo | 08:42 | |
| *** social has joined #tripleo | 08:42 | |
| *** pkovar has joined #tripleo | 08:47 | |
| *** electrofelix has joined #tripleo | 08:52 | |
| *** dsariel has quit IRC | 08:55 | |
| *** akrivoka has joined #tripleo | 08:58 | |
| jaosorior | jistr: yes | 08:59 |
| jaosorior | jistr: I tagged it for rc2 now, sorry about that | 09:01 |
| jistr | jaosorior: ok thanks. I thought it was important for rc2 by the sound of it but wanted to double check :) | 09:02 |
| tobias-fiberdata | jaosorior, have you experienced that your undercloud does not reboot correctly and mount the LVM volumes after installing mitaka undercloud? | 09:04 |
| jaosorior | tobias-fiberdata: I haven't :/ | 09:04 |
| tobias-fiberdata | cause this is weird. it doesnt mount up the LVM for home | 09:04 |
| tobias-fiberdata | root and swap is working fine | 09:05 |
| tobias-fiberdata | but perhaps it's a centOS and lvm problem. | 09:05 |
| hewbrocca | tobias-fiberdata: you're probably hitting the lvm automation bug | 09:05 |
| tobias-fiberdata | hewbrocca, we have gotten that twice | 09:05 |
| tobias-fiberdata | both times when installing mitaka undercloud | 09:05 |
| tobias-fiberdata | after* | 09:05 |
| hewbrocca | If you have more than two volumes on your undercloud host, it will bite you | 09:06 |
| tobias-fiberdata | physical volumes? | 09:06 |
| hewbrocca | LVs | 09:06 |
| tobias-fiberdata | got three | 09:07 |
| tobias-fiberdata | so basically | 09:07 |
| tobias-fiberdata | remove the swap will solve it | 09:07 |
| hewbrocca | The container guys put in an LVM conf hack to *not* automatically mount volumes, | 09:07 |
| hewbrocca | because it breaks Docker | 09:07 |
| hewbrocca | Turns out that is a problem :( | 09:07 |
| tobias-fiberdata | yea | 09:07 |
| tobias-fiberdata | it is for sure | 09:07 |
| hewbrocca | It's fixed in Newton, I believe, with a regex in lvm.conf | 09:07 |
| tobias-fiberdata | yea | 09:07 |
| tobias-fiberdata | it is fixed there | 09:07 |
| hewbrocca | you could grab the regex from Newton and add it to the undercloud lvm.conf, I guess | 09:08 |
| *** pkovar has quit IRC | 09:09 | |
| hewbrocca | or just change lvm.conf to behave normally, since you're presumably not using a containerized compute node | 09:09 |
| *** limao has joined #tripleo | 09:14 | |
| *** fzdarsky has quit IRC | 09:19 | |
| tobias-fiberdata | hewbrocca, we remove swap to solve it | 09:19 |
| jaosorior | marios: yep, it's being added to that list here https://review.openstack.org/#/c/360350/6/instack_undercloud/undercloud.py | 09:22 |
| jaosorior | had to be added in a different way since it's not using http/https, but a websocket-specific protocol | 09:23 |
| *** akrivoka has quit IRC | 09:23 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Port password generation from tripleoclient to tripleo-common https://review.openstack.org/368150 | 09:25 |
| marios | jaosorior: ack thanks missed it there (didn't scroll down enough :) | 09:26 |
| jaosorior | marios: haha it's cool. Thanks for checking it out dude | 09:28 |
| openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Add `openstack overcloud plan deploy` https://review.openstack.org/373089 | 09:29 |
| openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Pass the timeout to the deploy workflow https://review.openstack.org/373090 | 09:29 |
| *** skramaja_ has joined #tripleo | 09:30 | |
| *** skramaja has quit IRC | 09:30 | |
| *** skramaja_ is now known as skramaja | 09:30 | |
| *** dsariel has joined #tripleo | 09:32 | |
| jaosorior | Hey guys, can we merge this documentation patch? https://review.openstack.org/#/c/348038/ | 09:34 |
| *** akrivoka has joined #tripleo | 09:35 | |
| *** stendulker has joined #tripleo | 09:38 | |
| *** pkovar has joined #tripleo | 09:38 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Remove the interactive gate from full-deploy.sh https://review.openstack.org/373098 | 09:42 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Remove roles-deploy.sh and fix full-deploy.sh https://review.openstack.org/372367 | 09:45 |
| *** akrivoka has quit IRC | 09:46 | |
| *** chem has quit IRC | 09:50 | |
| *** shardy has joined #tripleo | 09:53 | |
| *** panda|Zz is now known as panda | 09:55 | |
| *** akrivoka has joined #tripleo | 09:58 | |
| *** tosky has joined #tripleo | 10:03 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart: add tempest back into the quickstart-extras workflow https://review.openstack.org/372748 | 10:04 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-quickstart: Customize undercloud and overcloud with virt-customize https://review.openstack.org/370114 | 10:06 |
| jaosorior | shardy: hey, It seems that we have an issue with the nova_metadata endpoint | 10:08 |
| jaosorior | shardy: the yaql function that generates the <service>_vip doesn't take it into account because it's not a service | 10:08 |
| jaosorior | it's part of nova-api | 10:09 |
| jaosorior | so haproxy is misconfiguring it, because it expects nova_metadata_vip to exist | 10:09 |
| *** limao has quit IRC | 10:09 | |
| jaosorior | the same issue is with nova_metadata_node_ips | 10:09 |
| jaosorior | shardy: so we have two options: 1) create a metadata role (which doesn't import any puppet stuff, just does hiera config) 2) add metadata manually like we do for keystone | 10:10 |
| jaosorior | shardy: what do you think? | 10:10 |
| shardy | jaosorior: Hmm, yeah I knew this was an issue when refactoring, because the nova_api service actually deploys two different things | 10:10 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-image-elements: Add stable release to image elements https://review.openstack.org/373131 | 10:11 |
| shardy | I'd probably prefer breaking out the nova metadata hiera into a new service template, even if we know it can't be deployed without nova_api | 10:11 |
| shardy | the problem, IIRC, was that the nova_api puppet module expects a list of enabled APIs in hiera | 10:11 |
| shardy | so we'd need to leave that hard-coded in nova_api referencing the n-api and the metadata api | 10:12 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-image-elements: Add stable release to image elements https://review.openstack.org/373131 | 10:12 |
| shardy | jaosorior: FWIW the special-casing around keystone is something I'd like to fix, so ideally it'd be good to avoid perpetuating that sort of special-casing | 10:13 |
| *** SlickNik has quit IRC | 10:13 | |
| *** chem has joined #tripleo | 10:14 | |
| shardy | https://github.com/openstack/puppet-nova/blob/master/manifests/api.pp#L37 | 10:15 |
| shardy | jaosorior: ^^ | 10:15 |
| shardy | that is the problem | 10:15 |
| shardy | I guess we could pass in two booleans for nova_api and nova_metadata_api to puppet-tripleo | 10:15 |
| shardy | and have the nova_api profile combine them to create the right list | 10:16 |
| shardy | Or, for now, accept that is hard-coded and that both service templates must be deployed together | 10:16 |
| *** SlickNik has joined #tripleo | 10:17 | |
| shardy | d0ugal: Hey, just about to dig into the file::// stuff, unless you've made some progress? | 10:18 |
| jaosorior | shardy: ok, I'll do the metadata template | 10:18 |
| d0ugal | shardy: not yet, I had a dentist appointment which I almost forgot about | 10:19 |
| d0ugal | shardy: so I am looking into it now also, but I've not made any solid progress. | 10:19 |
| shardy | d0ugal: ack, I'll dig into it and we can compare findings to decide the best fix | 10:19 |
| d0ugal | Sounds good | 10:20 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Merge remote-tracking branch 'origin/master' into merge-branch https://review.openstack.org/373134 | 10:22 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-quickstart: Customize undercloud and overcloud with virt-customize https://review.openstack.org/370114 | 10:22 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add nova-metadata template https://review.openstack.org/373141 | 10:27 |
| jaosorior | mcornea: lets see if I didn't mess it up ^^ | 10:27 |
| mcornea | jaosorior: checking | 10:27 |
| shardy | d0ugal: so, the problem definitely seems to be with _process_and_upload_environment - we need to remove the mangling of the resource_registry prefixes I think, and figure out a different way to push any missing files to the plan | 10:33 |
| *** radez has quit IRC | 10:34 | |
| shardy | d0ugal: file:///tmp/tripleo-heat-templates/puppet/services/pacemaker/rabbitmq.yaml gets mangled to user-files/b06f4f7c785fbf79c1207ab7897711fa-rabbitmq.yaml | 10:34 |
| shardy | which can't be right, because it's already in the plan | 10:34 |
| *** radez has joined #tripleo | 10:34 | |
| * shardy starts commenting out code | 10:34 | |
| *** adarazs is now known as adarazs_lunch | 10:35 | |
| *** rwsu has quit IRC | 10:35 | |
| openstackgerrit | Lucky samadhiya proposed openstack/tripleo-common: update homepage with developer documentation page https://review.openstack.org/373150 | 10:37 |
| *** jaosorior is now known as jaosorior_lunch | 10:37 | |
| *** mburned_out is now known as mburned | 10:38 | |
| d0ugal | shardy: Right, makes sense. | 10:39 |
| d0ugal | shardy: I was always suspicious of that code :) | 10:40 |
| shardy | d0ugal: I think we're moving the entire files map into moved_files, I'm hacking up a reworked version trying to simplify that a bit | 10:40 |
| shardy | lol | 10:40 |
| tobias-fiberdata | how do we configure normal interfaces aswell as the bonds with vlan? What type should it be? just "type: bond"? | 10:41 |
| *** rodrigods has quit IRC | 10:41 | |
| *** rodrigods has joined #tripleo | 10:41 | |
| tobias-fiberdata | to be short | 10:42 |
| shardy | tobias-fiberdata: https://github.com/openstack/os-net-config/blob/master/etc/os-net-config/samples/bond.yaml | 10:42 |
| tobias-fiberdata | we want one bond to connect to the bridge, aswell as one bond without attaching it | 10:42 |
| shardy | yup, you just configure the members type: interface inside the type: *bond | 10:42 |
| tobias-fiberdata | can someone review our controller.yaml and compute.yaml? I'll paste it in a sec | 10:44 |
| openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Use the hexdigest of the path to make the filename unique in swift https://review.openstack.org/373159 | 10:45 |
| tobias-fiberdata | this is just the resource part | 10:46 |
| tobias-fiberdata | http://paste.openstack.org/show/581929/ | 10:46 |
| tobias-fiberdata | our deployment fails when configuring the storageport | 10:46 |
| shardy | d0ugal: I don't think there's any way we can properly fix this without dowloading the plan contents, after the j2 rendering is done | 10:46 |
| *** rhallisey has joined #tripleo | 10:47 | |
| shardy | then running heatclient template_utils.get_template_contents again pointing at the local tree to pull in any missing files we didn't get by uploading the --templates | 10:47 |
| shardy | any other solution will break as soon as we reference another file inside a .j2.yaml template | 10:48 |
| shardy | On a positive note, that will remove almost all of the template mangling code from tripleoclient | 10:48 |
| shardy | I suppose the alternative is say referencing files outside of the plan in a j2 template is not allowed | 10:51 |
| shardy | (which would probably be better for the UI) | 10:51 |
| openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Print the execution ID when starting Mistral workflows https://review.openstack.org/373162 | 10:53 |
| d0ugal | shardy: It would be better to keep all the files in one directory | 10:57 |
| d0ugal | shardy: That is where all of these problems come from, the CLI is almost too flexible :) | 10:57 |
| *** fzdarsky has joined #tripleo | 10:58 | |
| openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Remove the environments from Mistral when removing from Swift https://review.openstack.org/373167 | 10:58 |
| *** pkovar has quit IRC | 11:00 | |
| *** jaosorior_lunch is now known as jaosorior | 11:03 | |
| jaosorior | mcornea: thanks for checking the patch out | 11:03 |
| mcornea | jaosorior: thank you, it looks good | 11:03 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fix the default plan creation https://review.openstack.org/371347 | 11:04 |
| openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Verify that the Deployment Plan creation was successful https://review.openstack.org/369247 | 11:04 |
| *** thrash|g0ne is now known as thrash | 11:05 | |
| jaosorior | Hey guys, any +A for these two? https://review.openstack.org/#/c/360329/ https://review.openstack.org/360350 ?? | 11:07 |
| openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Use a released version of tripleo-common https://review.openstack.org/373175 | 11:08 |
| d0ugal | jaosorior: I think you can +A if it has two other cores and was just waiting for CI | 11:08 |
| d0ugal | jaosorior: I do for my own patches, anyway +A'ed yours. | 11:08 |
| jaosorior | d0ugal: thanks dude | 11:09 |
| jpich | d0ugal, jaosorior: FWIW came across that doc that agrees with d0ugal on this -> http://specs.openstack.org/openstack/tripleo-specs/specs/policy/expedited-approvals.html#self-approval | 11:13 |
| jaosorior | shardy: is upload-puppet-modules still working for you? I think there's an issue in the underlying upload-swift-artifacts | 11:16 |
| jaosorior | jpich: I see :O | 11:16 |
| *** stendulker has quit IRC | 11:16 | |
| shardy | jaosorior: Yeah it's been working fine for me provided you have my fix that changed the default container name | 11:16 |
| jaosorior | I downloaded the latest tripleo-common today | 11:17 |
| jaosorior | and it's not working for me | 11:17 |
| jaosorior | but it seems to be related to how it gets the swift keystone endpoint | 11:17 |
| shardy | Ok, I've not tested it today, but it was working for me yesterday | 11:17 |
| jaosorior | shardy: same here, it was working yesterday | 11:17 |
| * shardy been too busy making tripleoclient explode in exciting ways | 11:17 | |
| *** dsariel has quit IRC | 11:20 | |
| *** karthiks has quit IRC | 11:28 | |
| *** osp has quit IRC | 11:30 | |
| tobias-fiberdata | jaosorior, shardy how long does a deployment take usually? | 11:31 |
| tobias-fiberdata | thing 3controller HA and 2 compute | 11:31 |
| tobias-fiberdata | think 3controller HA and 2 compute* | 11:31 |
| tobias-fiberdata | no SSD in the servers just SAS and the undercloud is even SATA XD | 11:32 |
| jaosorior | it can take a while. I'm only using virtual and it can take about an hour or so | 11:32 |
| *** skramaja has quit IRC | 11:32 | |
| tobias-fiberdata | alright | 11:32 |
| tobias-fiberdata | so far so good | 11:33 |
| tobias-fiberdata | we removed some conf | 11:33 |
| jaosorior | you're using baremetal, so it should be faster tahn my deployments | 11:33 |
| shardy | jaosorior: what's your hardware? | 11:33 |
| shardy | two node deployments on a desktop box with an SSD take about 20mins for me | 11:33 |
| tobias-fiberdata | if it's getting stuck ont hsi | 11:33 |
| tobias-fiberdata | UpdateDeployment | b21a72ad-687e-49b7-8ed6-76258618b188 | OS::Heat::SoftwareDeployment | CREATE_IN_PROGRESS | 11:33 |
| jaosorior | shardy: got no SSD, and I'm talking about 3 controllers and one compute | 11:33 |
| tobias-fiberdata | what should i look for? | 11:33 |
| shardy | jaosorior: ack, yeah I've not got enough ram for that setup atm | 11:34 |
| jaosorior | shardy: how much do you have? | 11:34 |
| tobias-fiberdata | i think our setup are enough :D 3x 32GB ram for controller and 256GB each for two computes | 11:34 |
| tobias-fiberdata | so far | 11:34 |
| shardy | tobias-fiberdata: that tries to do a yum update, I'd check the boxes can reach the repos | 11:34 |
| shardy | jaosorior: 32G | 11:35 |
| jaosorior | shardy: that's exactly what I have | 11:35 |
| shardy | I can run the undercloud and ~4nodes | 11:35 |
| jaosorior | I run the undercloud, 4 nodes and even FreeIPA on the host | 11:35 |
| shardy | jaosorior: How much memory allocated to the VMs? | 11:35 |
| shardy | I use 8G to avoid swapping or deployments take forever | 11:35 |
| jaosorior | well, it's swapping like there's no tomorrow | 11:36 |
| shardy | jaosorior: Yeah, that's why the deployment takes an hour ;) | 11:36 |
| jaosorior | I put 7 in the undercloud | 11:36 |
| *** adarazs_lunch is now known as adarazs | 11:36 | |
| *** masco has quit IRC | 11:36 | |
| jaosorior | shardy: well, gotta deploy FreeIPA anyway for the work I'm doing | 11:36 |
| jaosorior | so I have no choice | 11:36 |
| *** saneax is now known as saneax-_-|AFK | 11:38 | |
| jaosorior | mcornea: do you still have the environment set up where you tested the nova_metadata patch? | 11:40 |
| mcornea | jaosorior: I should have it soon, currently it's broken, I'm testing some network templates changes | 11:40 |
| jaosorior | mcornea: what are you testing out? | 11:40 |
| jaosorior | mcornea: can you check if the value nova_metadata_network is being set? | 11:41 |
| *** dprince has joined #tripleo | 11:41 | |
| panda | in HA deployment, which controller is usually the default location for the endpoint ? | 11:41 |
| EmilienM | hello tripleoers | 11:41 |
| EmilienM | d0ugal: ok cool | 11:42 |
| mcornea | jaosorior: doing a deployment separate network nodes and trying to build network templates for them and the deployment is currently stuck, I need to debug what went wrong there | 11:42 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: swift: normalize memcache servers IP addresses https://review.openstack.org/372734 | 11:42 |
| mcornea | jaosorior: I'll check it once I get the deployment going | 11:42 |
| jaosorior | panda: which endpoint? | 11:42 |
| jaosorior | EmilienM: hey dude, how's it going? | 11:43 |
| EmilienM | panda: FYI https://review.openstack.org/#/c/372903/ and https://review.openstack.org/#/c/372734/ | 11:43 |
| EmilienM | jaosorior: thanks, good | 11:43 |
| EmilienM | jaosorior: and you? | 11:44 |
| jaosorior | pretty good, dude. Work, work, work | 11:44 |
| *** lucas-afk is now known as lucasagomes | 11:44 | |
| *** jpena is now known as jpena|lunch | 11:44 | |
| *** pkovar has joined #tripleo | 11:44 | |
| jaosorior | the usual | 11:44 |
| tobias-fiberdata | shardy, now i lost connection to the machines. | 11:45 |
| tobias-fiberdata | i guess there's a timeout on several hours on this step? | 11:45 |
| panda | jaosorior: keystone | 11:45 |
| jaosorior | EmilienM: does this https://review.openstack.org/#/c/372734/2/manifests/profile/base/swift/proxy.pp mean that we can there only use IP addresses? wouldn't want to restrict to that. I'm hoping for Ocata to be able to use FQDNs there | 11:45 |
| EmilienM | jaosorior: no you can use hostnames | 11:46 |
| jaosorior | panda: that would be in the bootstrap node. I guess it would be usually controller-0? | 11:46 |
| EmilienM | jaosorior: the normalize function does nothing if the content is not an ipv6 | 11:46 |
| jaosorior | ah, I see now | 11:46 |
| jaosorior | uhm | 11:46 |
| jaosorior | wait up | 11:47 |
| jaosorior | but, wouldn't it fail? | 11:47 |
| jaosorior | EmilienM: IPAddr.new(ip) throws an error if it's not an IP | 11:47 |
| jaosorior | aaah | 11:47 |
| jaosorior | and then you ignore it | 11:47 |
| jaosorior | I see now | 11:47 |
| EmilienM | jaosorior: no it doesn't | 11:47 |
| EmilienM | chem wrote that code and we test that you can give an hostname | 11:47 |
| jaosorior | EmilienM: yeah dude, I saw now that the Argument error is catched and ignored | 11:48 |
| EmilienM | see the spec https://review.openstack.org/#/c/372903/2/spec/functions/normalize_ip_for_uri_spec.rb | 11:48 |
| panda | EmilienM: so the last run on my patch in ipv4 is failing because it needs the latesta patch sets from the ones you showed me ? | 11:48 |
| chem | EmilienM: hostname to normalize_ip_for_uri ? | 11:48 |
| EmilienM | panda: not sure why ipv4 failed tbh | 11:48 |
| panda | jaosorior: ok, thanks | 11:48 |
| jaosorior | EmilienM: so it's good | 11:48 |
| jaosorior | EmilienM: +1ed it | 11:48 |
| chem | EmilienM: that shouldn't be any issue | 11:48 |
| EmilienM | chem: yes | 11:48 |
| chem | EmilienM: if it can't get to ipv6, it just return the string | 11:49 |
| jaosorior | chem: yeah, that's what I just realized now that I gave another read to the code | 11:49 |
| jaosorior | it should be fine | 11:50 |
| *** bfournie has quit IRC | 11:51 | |
| *** trown|outtypewww is now known as trown | 11:52 | |
| shardy | tobias-fiberdata: if the network config is messed up and the machines are unresponsive, heat will sit there until the deployment timeout is hit | 11:52 |
| shardy | by default that's 4 hours | 11:52 |
| tobias-fiberdata | aye | 11:52 |
| shardy | sounds like you'll need console access to debug the network config? | 11:53 |
| *** rbrady has joined #tripleo | 11:54 | |
| *** coolsvap is now known as coolsvap_ | 11:55 | |
| *** coolsvap_ has quit IRC | 11:55 | |
| *** spredzy has quit IRC | 11:55 | |
| *** coolsvap_ has joined #tripleo | 11:55 | |
| *** bfournie has joined #tripleo | 11:55 | |
| *** bfournie has quit IRC | 11:55 | |
| *** limao has joined #tripleo | 11:55 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Terminate Zaqar websocket endpoint in HAProxy https://review.openstack.org/360329 | 11:55 |
| *** egafford has quit IRC | 11:56 | |
| tobias-fiberdata | shardy, how do i get inside the machines without networkaccess to them? because i assume there's no password | 11:57 |
| *** spredzy has joined #tripleo | 11:57 | |
| shardy | tobias-fiberdata: when I debug issues like this I modify the image with virt-customize (or one of the other libguestfs tools) to set a known root password or inject a backdoor user | 11:58 |
| tobias-fiberdata | we'll be updating or removing the stack | 11:59 |
| tobias-fiberdata | i guess | 11:59 |
| tobias-fiberdata | looks like the network part is messed up | 11:59 |
| shardy | yeah, it's hard to debug networking without either a dedicated nic you're not messing with or primary console access | 11:59 |
| shardy | http://docs.openstack.org/developer/tripleo-docs/advanced_deployment/extra_config.html#firstboot-extra-configuration | 12:00 |
| shardy | tobias-fiberdata: if you don't want to modify the images, you could also inject a user with cloud-init via a Firstboot script | 12:01 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 12:01 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Fetch internal certificates for HAProxy based on network https://review.openstack.org/366548 | 12:02 |
| *** rwsu has joined #tripleo | 12:03 | |
| *** ccamacho is now known as ccamacho|lunch | 12:04 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Fetch internal certificates for HAProxy based on network https://review.openstack.org/366548 | 12:04 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Fetch internal certificates for HAProxy based on network https://review.openstack.org/366548 | 12:05 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient: Always use absolute path for tht_root https://review.openstack.org/373220 | 12:05 |
| jaosorior | shardy: don't we have to apply the same logic for environments? | 12:06 |
| jaosorior | ^^ | 12:06 |
| shardy | d0ugal, gfidente: Hey that is the simplest initial fix for https://bugs.launchpad.net/tripleo/+bug/1623552 I can find | 12:06 |
| openstack | Launchpad bug 1623552 in tripleo "heatclient resolves paths for types and get_file calls that then don't make sense in swift" [Critical,In progress] - Assigned to Steven Hardy (shardy) | 12:06 |
| gfidente | shardy, ack looking into it | 12:07 |
| openstackgerrit | Merged openstack/tripleo-quickstart: Remove roles-deploy.sh and fix full-deploy.sh https://review.openstack.org/372367 | 12:07 |
| shardy | jaosorior: as mentioned in the commit message, this is probably the first of several fixes | 12:07 |
| shardy | but this solves the specific issue reported in the bug, which is due to this comparison: | 12:07 |
| *** skramaja has joined #tripleo | 12:07 | |
| shardy | https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_deploy.py#L312 | 12:07 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Fetch internal certificates for HAProxy based on network https://review.openstack.org/366548 | 12:07 |
| shardy | we're comparing an absolute path inside the files map with a relative tht_root | 12:08 |
| shardy | so this gets us past that problem at least | 12:08 |
| EmilienM | jaosorior: when you file a bug, please also set the importance | 12:08 |
| openstackgerrit | Marios Andreou proposed openstack/puppet-tripleo: Fixup manila-cephfs native backend defaults https://review.openstack.org/366760 | 12:08 |
| EmilienM | jaosorior: it helps release managers to prioritize triage etc | 12:08 |
| *** jeckersb is now known as jeckersb_gone | 12:08 | |
| shardy | I'm looking into the remainder of the fix, but I think this is valid regardless of any further rework | 12:08 |
| jaosorior | EmilienM: will do | 12:09 |
| EmilienM | shardy: I added summit topic to https://etherpad.openstack.org/p/tripleo-meeting-items | 12:09 |
| jaosorior | EmilienM: changed a bit your submission for the _member_ role fix. What do you think? | 12:13 |
| jaosorior | EmilienM: https://review.openstack.org/#/c/307352/ | 12:13 |
| EmilienM | jaosorior: I saw the launchpad email I have not looked at code yet, but thanks for your help | 12:13 |
| EmilienM | jaosorior: looking now | 12:13 |
| shardy | EmilienM: ack, thanks | 12:13 |
| shardy | EmilienM: would you like to chair the meeting today? | 12:13 |
| shardy | get into the new-PTL routine since the Newton release is nearly done ;) | 12:14 |
| EmilienM | shardy: heh ! newton is not out yet \o/ | 12:15 |
| EmilienM | but yeah, I'll do it | 12:15 |
| shardy | hehe, ack, thanks :) | 12:15 |
| EmilienM | jaosorior: the diff lgtm. Again thanks for your help | 12:15 |
| jaosorior | EmilienM: no biggie | 12:15 |
| jaosorior | glad to help | 12:15 |
| marios | shardy: EmilienM is "tripleo/rc2" the right topic... i ask cos i only see one patch at https://review.openstack.org/#/q/topic:tripleo/rc2 | 12:15 |
| EmilienM | jaosorior: let me know if I can also help | 12:15 |
| EmilienM | marios: if you use it I'll send you pancakes from Canada, using gerrit topic will really help us to track last blockers | 12:16 |
| marios | shardy: EmilienM i want to tag the puppet-tripleo side for https://review.openstack.org/#/c/358525/ (<-- is tagged with "tripleo/rc2", puppet-tripleo dependency isn't) | 12:16 |
| *** jlinkes_ has joined #tripleo | 12:16 | |
| EmilienM | shardy: can you review https://review.openstack.org/#/c/307352/ please? | 12:16 |
| EmilienM | marios: please do | 12:16 |
| marios | EmilienM: ack thanks (except now i cant stop thinking of pancakes) | 12:17 |
| EmilienM | marios: I can give you the recipe :P | 12:18 |
| *** jcoufal has joined #tripleo | 12:18 | |
| marios | EmilienM: i need pancake as a service | 12:18 |
| EmilienM | :) | 12:19 |
| shardy | EmilienM: lgtm, I've not approved though as I was a co-author | 12:19 |
| *** shardy is now known as shardy_lunch | 12:20 | |
| *** jlinkes has quit IRC | 12:20 | |
| EmilienM | jaosorior: I'm doing a recheck to try getting upgrade job working | 12:23 |
| EmilienM | I'm curious to see if upgrade actually works | 12:23 |
| jaosorior | EmilienM: I haven't seen it pass in a long time | 12:24 |
| EmilienM | but yeah it sounds like http://logs.openstack.org/52/307352/19/check/gate-tripleo-ci-centos-7-nonha-multinode-updates-nv/9840f79/console.html#_2016-09-20_07_27_49_871911 | 12:24 |
| EmilienM | the heat stack is created | 12:24 |
| EmilienM | damn wrong job | 12:24 |
| EmilienM | gate-tripleo-ci-centos-7-undercloud-upgrades-nv is actually green | 12:24 |
| EmilienM | so it works | 12:24 |
| *** mburned is now known as mburned_out | 12:24 | |
| jaosorior | whaaa | 12:24 |
| EmilienM | yeah | 12:25 |
| jaosorior | so which was red? | 12:25 |
| EmilienM | the overcloud update | 12:25 |
| EmilienM | but it's a transient issue | 12:25 |
| jaosorior | I see | 12:25 |
| *** jayg|g0n3 is now known as jayg | 12:25 | |
| *** bfournie has joined #tripleo | 12:27 | |
| *** bfournie has quit IRC | 12:27 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Add devmode.sh and document Third Party CI https://review.openstack.org/360007 | 12:28 |
| d0ugal | shardy_lunch: Just testing your patch | 12:29 |
| *** mburned_out is now known as mburned | 12:29 | |
| *** mburned is now known as mburns_mtg | 12:29 | |
| *** ayoung has quit IRC | 12:30 | |
| *** fultonj has joined #tripleo | 12:32 | |
| *** bfournie has joined #tripleo | 12:33 | |
| *** bfournie has quit IRC | 12:33 | |
| d0ugal | Does POST_FAILURE mean the job timed out? | 12:35 |
| d0ugal | Always seems to be about 2 hrs 50 mins | 12:35 |
| *** jprovazn has quit IRC | 12:36 | |
| EmilienM | yes | 12:36 |
| EmilienM | and that's a bug | 12:36 |
| EmilienM | because our jobs should timeout themselves in tripleo-ci | 12:36 |
| d0ugal | EmilienM: k, thanks. | 12:36 |
| EmilienM | d0ugal: which job? | 12:38 |
| d0ugal | EmilienM: Just on this patch: https://review.openstack.org/#/c/368150 | 12:39 |
| d0ugal | EmilienM: all of them :) So I think there is an issue with the patch | 12:39 |
| d0ugal | rbrady: You around? | 12:39 |
| rbrady | d0ugal: yep | 12:39 |
| d0ugal | rbrady: I'm trying to figure out if https://review.openstack.org/#/c/368150 has a valid failure or not | 12:40 |
| d0ugal | rbrady: Was going to try and run it manually, have you? | 12:40 |
| * rbrady reads comments | 12:40 | |
| EmilienM | d0ugal: i'll dig a bit | 12:40 |
| d0ugal | EmilienM: Thanks | 12:40 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 12:41 |
| rbrady | d0ugal: I did, but only to generate the passwords that matched what was done in the client before. I had another issue that wouldn't allow me to create a stack in my env | 12:41 |
| d0ugal | rbrady: ah, okay - so there might be a conflict between the CLI passwords and Mistral passwords I guess | 12:42 |
| mcornea | jaosorior: hiera nova_metadata_network | 12:43 |
| mcornea | internal_api | 12:43 |
| jaosorior | mcornea: awesome! so that patch works well then | 12:43 |
| rbrady | d0ugal: I'll rebuild my env and try it again. will paste both sets of params | 12:43 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: swift: normalize memcache servers IP addresses https://review.openstack.org/372734 | 12:43 |
| EmilienM | jaosorior, chem, panda: I added unit tests ^ | 12:44 |
| mcornea | jaosorior: yep, thanks for the fix | 12:44 |
| EmilienM | the won't pass because depends-on doesn't work for unit tests in puppet-tripleo, it's a long story but i'll fix it later | 12:44 |
| EmilienM | though it works for all other puppet openstack modules | 12:44 |
| *** rwsu has quit IRC | 12:44 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Add IPv6 network configuration for ipv6 job types https://review.openstack.org/363674 | 12:45 |
| *** jlinkes__ has joined #tripleo | 12:45 | |
| jaosorior | EmilienM: the unit tests look pretty good! Could you add one with FQDN just to have it there (and kinda document it informally) | 12:46 |
| EmilienM | jaosorior: yes sir | 12:46 |
| d0ugal | rbrady: k, thanks - I'll wait and try manually later if you can't. | 12:46 |
| EmilienM | jaosorior: will do in 5, pancakes now | 12:46 |
| *** jpena|lunch is now known as jpena | 12:46 | |
| *** jlinkes__ has quit IRC | 12:47 | |
| *** jlinkes__ has joined #tripleo | 12:47 | |
| jaosorior | duuuude pancakes | 12:49 |
| *** jlinkes_ has quit IRC | 12:49 | |
| jaosorior | EmilienM: pics or it didn't happen | 12:49 |
| rook | shardy_lunch: heya! are custom roles baked? | 12:50 |
| *** shardy_lunch is now known as shardy | 12:50 | |
| shardy | rook: pretty much, I've not yet had time to write docs/blog about how to use it tho | 12:50 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-heat-templates: Composable Zaqar services https://review.openstack.org/331682 | 12:50 |
| shardy | rook: I'm considering one final patch to make the user interfaces easier following some feedback from mcornea | 12:50 |
| shardy | rook: I'm planning said patch and docs/blog this week | 12:51 |
| b00tcat | is the Puppet version always 3.x on the images that are built for the overcloud? I always got a 3.x but wanted to make sure | 12:52 |
| mcornea | shardy: btw, I closed this one as not a bug: https://bugs.launchpad.net/tripleo/+bug/1625132 but it would be great if we could have the ResolveNetwork covered automatically as well | 12:53 |
| openstack | Launchpad bug 1625132 in tripleo "Invalid /etc/hosts files on nodes using custom roles with network isolation" [Undecided,Invalid] | 12:53 |
| *** Goneri has joined #tripleo | 12:53 | |
| *** jeckersb_gone is now known as jeckersb | 12:53 | |
| shardy | mcornea: ack, thanks | 12:53 |
| rook | shardy: ok - any rough txt file on how to play with it? | 12:54 |
| shardy | rook: No, sorry, been so busy I've not written anything, but like I said it's on the TODO list (near the top) | 12:54 |
| shardy | rook: mcornea may have some notes as he's been playing with it | 12:54 |
| shardy | there's some copying/sedding of files which ideally I'd like to remove before the final release | 12:55 |
| rook | no shardy | 12:55 |
| rook | thanks for the infomation | 12:56 |
| mcornea | rook: I can share what I'm using, I haven't done any notes yet | 12:56 |
| ccamacho|lunch | folks I'm getting issues deploying liberty/mitaka in my local env. mind to check this fix https://review.openstack.org/#/c/373131/ to close (https://bugs.launchpad.net/tripleo/+bug/1625463 and https://bugs.launchpad.net/tripleo/+bug/1625315) | 12:56 |
| openstack | Launchpad bug 1625463 in tripleo "Package dependency issue in liberty deployments" [Undecided,In progress] - Assigned to Carlos Camacho (ccamacho) | 12:56 |
| openstack | Launchpad bug 1625315 in tripleo "Can't deploy Mitaka overcloud on CentOS" [Undecided,In progress] - Assigned to Carlos Camacho (ccamacho) | 12:56 |
| rook | mcornea: cool thanks! | 12:56 |
| *** ccamacho|lunch is now known as ccamacho | 12:56 | |
| *** david-lyle has joined #tripleo | 12:56 | |
| mcornea | rook: https://gist.github.com/mcornea/72232edfccd9e3088373553d4c57d232 : i'm deploying 2 separate network nodes for running the neutron agents | 13:01 |
| *** rwsu has joined #tripleo | 13:03 | |
| *** jlinkes_ has joined #tripleo | 13:03 | |
| rook | sweet mcornea! | 13:03 |
| tobias-fiberdata | shardy, there's a bug in cloud-init, do you know what version of cloud-init it is in the images that boot? | 13:04 |
| tobias-fiberdata | shardy, atleast for injecting passwords | 13:04 |
| EmilienM | jaosorior: no pancakes this morning but doing my own bread :) https://www.flickr.com/gp/134083237@N03/19S3J7 | 13:05 |
| rbrady | shardy, dprince: need a discussion about state of parameter generation for newton | 13:05 |
| jaosorior | EmilienM: Hey! not bad! | 13:05 |
| EmilienM | jaosorior: that picture is from January, but I do this thing every week :) | 13:06 |
| dprince | rbrady: sure | 13:06 |
| *** jlinkes__ has quit IRC | 13:07 | |
| *** pgadiya has quit IRC | 13:07 | |
| *** cdearborn has joined #tripleo | 13:08 | |
| *** liverpooler has quit IRC | 13:08 | |
| rbrady | dprince: there's a single password retrieved from a file in the CLI in the ~/undercloud_passwords.conf file | 13:09 |
| *** liverpooler has joined #tripleo | 13:09 | |
| rbrady | dprince: undercloud_ceilometer_snmpd_password, and it's stored in SnmpdReadonlyUserPassword | 13:09 |
| *** jaosorior has quit IRC | 13:09 | |
| rbrady | dprince: this is generated in instack-undercloud I think | 13:09 |
| rbrady | dprince: the mistral action is never going to see the file | 13:10 |
| *** jaosorior has joined #tripleo | 13:10 | |
| dprince | rbrady: can we just generate it somewhere in our workflows? | 13:10 |
| dprince | rbrady: perhaps even a generic mechanism to do more parameters like this in the future if we need it | 13:10 |
| *** hjensas has quit IRC | 13:11 | |
| d0ugal | dprince: doesn't it need to match the value from instack? | 13:11 |
| dprince | d0ugal: it would, for those upgrading I suppose | 13:11 |
| shardy | If upgrading with an overcloud in place we could just read it from heat | 13:12 |
| shardy | the tricky one is upgrading an undercloud if the operator deleted the overcloud first I think | 13:12 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Make apache-based services use network-dependent servername https://review.openstack.org/365585 | 13:12 |
| d0ugal | shardy, dprince: How would you feel about mistral accessing hiera? (I'm not sure how I feel about that) | 13:13 |
| d0ugal | because it is there too | 13:13 |
| dprince | d0ugal: the "execution" workflow would give you this. Just a simple script... | 13:14 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Hook internal TLS flag to apache-based services https://review.openstack.org/366075 | 13:14 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add flag for internal TLS https://review.openstack.org/365942 | 13:14 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add HAProxy TLS handled by certmonger as composable service https://review.openstack.org/356430 | 13:14 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add option to specify Certmonger CA https://review.openstack.org/368643 | 13:14 |
| rbrady | dprince, shardy, d0ugal: here's where it is in instack-undercloud https://github.com/openstack/instack-undercloud/blob/e42b80e69da8d491aa3b98963b2da99733319763/elements/undercloud-install/os-apply-config/root/tripleo-undercloud-passwords#L5 | 13:14 |
| dprince | d0ugal: if that is all we've got I don't feel too bad about it | 13:14 |
| d0ugal | dprince: it would be the simplest solution :) | 13:14 |
| dprince | d0ugal: I actually feel fine about it | 13:14 |
| dprince | d0ugal: good even | 13:14 |
| d0ugal | haha | 13:14 |
| dprince | d0ugal: I'd rather grab it from an API, but if we can't then this works | 13:15 |
| d0ugal | rbrady: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/utils.py#L452-L462 | 13:15 |
| d0ugal | rbrady: so that could be a fallback | 13:15 |
| d0ugal | I assume the mistral action can access that, but I've not tested it | 13:15 |
| shardy | +1 it feels kind of hacky, but at this point I think we have to shoot for expediency over elegance ;) | 13:15 |
| d0ugal | shardy: Yeah, that is my thinking :( | 13:15 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart: Add settings to general config https://review.openstack.org/371144 | 13:15 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart: Remove settings from release configs https://review.openstack.org/371114 | 13:15 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/373315 | 13:16 |
| rbrady | d0ugal: I thought there was a std action in mistral to execute a script, but I'm not seeing it. | 13:16 |
| d0ugal | rbrady: std.ssh maybe? | 13:17 |
| shardy | it'd be pretty scary if they allowed arbitrary scripts to be run on the mistral server by default ;) | 13:17 |
| d0ugal | rbrady: that what you might be thinking of anyway | 13:17 |
| rbrady | d0ugal, shardy: I'll port the get_hiera_key function over for now | 13:17 |
| *** limao_ has joined #tripleo | 13:18 | |
| d0ugal | rbrady: Sounds good, and it might be a good idea to add an ocata bug for this. | 13:18 |
| d0ugal | I think we need to revisit the password storage stuff in general | 13:18 |
| d0ugal | since mistral envs are plain text in the database AFAIK | 13:19 |
| rbrady | d0ugal: like moving password storage to barbican for ocata? sounds good. | 13:19 |
| d0ugal | rbrady: If we are allowed to add Barbican, sure :) | 13:19 |
| shardy | tobias-fiberdata: it's 0.7.5 atm in my image, but you can check with yum install libguestfs-tools && virt-inspector -a overcloud-full.qcow2 | grep -A10 cloud-init | 13:19 |
| shardy | (or an xpath query to virt-inpsector instead of the grep) | 13:20 |
| *** limao has quit IRC | 13:21 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 13:21 |
| *** lblanchard has joined #tripleo | 13:21 | |
| tobias-fiberdata | does it look ok? http://paste.openstack.org/show/582243/ | 13:21 |
| *** dsariel has joined #tripleo | 13:22 | |
| tobias-fiberdata | then i have a environmentfile i start with | 13:22 |
| tobias-fiberdata | i'll guess we try | 13:22 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 13:22 |
| *** egafford has joined #tripleo | 13:24 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the get_hiera_key function https://review.openstack.org/367367 | 13:24 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart: Add settings to general config https://review.openstack.org/371114 | 13:28 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 13:31 |
| *** tzumainn has joined #tripleo | 13:31 | |
| *** cylopez has left #tripleo | 13:33 | |
| *** limao_ has quit IRC | 13:36 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: swift: normalize memcache servers IP addresses https://review.openstack.org/372734 | 13:36 |
| EmilienM | panda: I had to make sure we return an array ^ | 13:36 |
| *** limao has joined #tripleo | 13:36 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove unused code found by vulture https://review.openstack.org/373330 | 13:36 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Add IPv6 network configuration for ipv6 job types https://review.openstack.org/363674 | 13:36 |
| *** openstackstatus has joined #tripleo | 13:37 | |
| *** ChanServ sets mode: +v openstackstatus | 13:37 | |
| openstackgerrit | Merged openstack/tripleo-common: Add template processing to the update plan workflow. https://review.openstack.org/371027 | 13:39 |
| openstackgerrit | Merged openstack/instack-undercloud: Work around deletion of _member_ role assignments on upgrade https://review.openstack.org/307352 | 13:39 |
| EmilienM | jaosorior: what is prio of https://bugs.launchpad.net/bugs/1625448 ? | 13:40 |
| openstack | Launchpad bug 1625448 in tripleo "The undercloud's Zaqar Websocket endpoint always plaintext" [Undecided,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 13:40 |
| *** gfidente has quit IRC | 13:42 | |
| -openstackstatus- NOTICE: OpenStack Infra now has a Twitter bot, follow it at https://twitter.com/openstackinfra | 13:45 | |
| *** hrybacki is now known as hrybacki|mtg | 13:45 | |
| openstackgerrit | Saravanan KR proposed openstack/python-tripleoclient: Remove the reference to overcloud-without-mergepy file https://review.openstack.org/373336 | 13:49 |
| *** yamahata has joined #tripleo | 13:50 | |
| EmilienM | tripleo meeting in 10 min, please add off items on https://etherpad.openstack.org/p/tripleo-meeting-items | 13:50 |
| *** jprovazn has joined #tripleo | 13:50 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fix the default plan creation https://review.openstack.org/371347 | 13:51 |
| openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Verify that the Deployment Plan creation was successful https://review.openstack.org/369247 | 13:51 |
| *** dmacpher has joined #tripleo | 13:52 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart: Remove settings from release configs https://review.openstack.org/371114 | 13:53 |
| *** rajinir has joined #tripleo | 13:54 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Update the Mistral action names https://review.openstack.org/366519 | 13:55 |
| jaosorior | EmilienM: High. it's plaintext right now | 13:55 |
| EmilienM | jaosorior: lol | 13:55 |
| EmilienM | jaosorior: indeed :) | 13:55 |
| panda | EmilienM: shouldn't the return array have been resolved in 372903 ? | 13:55 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Remove the old, deprecated Mistral action names https://review.openstack.org/366529 | 13:56 |
| jaosorior | EmilienM: can you review the bug report for this? https://review.openstack.org/#/c/373141/ | 13:57 |
| *** limao has quit IRC | 13:57 | |
| *** limao has joined #tripleo | 13:58 | |
| EmilienM | panda: no because it can return a string if we pass a string when using the function | 13:58 |
| jaosorior | EmilienM: the whole problem is that it's included in nova-api. Since that's the case haproxy doesn't find nova_metadata_vip and nova_metadata_node_ips because they are not generated (since it's not a service) and then gets configured wrong | 13:58 |
| EmilienM | jaosorior: yes | 13:58 |
| jaosorior | EmilienM: talked about it with shardy, that there are two solutions | 13:58 |
| jaosorior | 1) add a new serviec profile | 13:58 |
| EmilienM | meeting in 2 min | 13:58 |
| EmilienM | ok I see, because of the service_name | 13:58 |
| jaosorior | 2) hardcode nova_metadata_vip, network and node IPs | 13:58 |
| jaosorior | EmilienM: yeah :/ | 13:59 |
| EmilienM | can't you use the same vip? | 13:59 |
| openstackgerrit | Brad P. Crochet proposed openstack/puppet-tripleo: Add zaqar profiles https://review.openstack.org/331681 | 13:59 |
| EmilienM | ok meeting | 13:59 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui: When deploy finishes, show overcloud info https://review.openstack.org/370765 | 13:59 |
| jaosorior | EmilienM: we can, but then conifiguring the service_ip_map won't work | 13:59 |
| jaosorior | shardy: mind checking this out? https://review.openstack.org/#/c/373141/ | 14:00 |
| *** jlinkes__ has joined #tripleo | 14:00 | |
| EmilienM | jaosorior: meeting now | 14:00 |
| openstackgerrit | Alejandro Andreu proposed openstack/tripleo-puppet-elements: Midonet element now complies with version 5.2 https://review.openstack.org/373352 | 14:01 |
| *** jlinkes_ has quit IRC | 14:04 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-specs: Single process Heat driven Undercloud installer https://review.openstack.org/352113 | 14:04 |
| *** abehl has quit IRC | 14:06 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Configure heat engine to use convergence https://review.openstack.org/333890 | 14:08 |
| *** oshvartz has quit IRC | 14:08 | |
| *** saneax-_-|AFK is now known as saneax | 14:15 | |
| *** ayoung has joined #tripleo | 14:15 | |
| *** hjensas has joined #tripleo | 14:18 | |
| *** hjensas has quit IRC | 14:18 | |
| *** hjensas has joined #tripleo | 14:18 | |
| *** limao_ has joined #tripleo | 14:18 | |
| *** bfournie has joined #tripleo | 14:20 | |
| *** limao__ has joined #tripleo | 14:20 | |
| *** limao has quit IRC | 14:22 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates: Fix nested list for enabled_services https://review.openstack.org/370069 | 14:23 |
| *** limao_ has quit IRC | 14:23 | |
| *** gfidente has joined #tripleo | 14:25 | |
| *** gfidente has quit IRC | 14:25 | |
| *** gfidente has joined #tripleo | 14:25 | |
| *** zoli|trng is now known as zoli | 14:26 | |
| *** tosky has quit IRC | 14:28 | |
| tobias-fiberdata | shardy, apperently it's turning off all interfaces? | 14:30 |
| tobias-fiberdata | shardy, managed to inject a user/password | 14:30 |
| tobias-fiberdata | and all my interfaces were down | 14:30 |
| *** tosky has joined #tripleo | 14:33 | |
| openstackgerrit | Merged openstack/tripleo-ui: Add Role Detail https://review.openstack.org/367993 | 14:35 |
| *** fultonj has quit IRC | 14:37 | |
| shardy | tobias-fiberdata: you can run os-net-config manually on the CLI mode (it also has a noop mode), which should show you why | 14:38 |
| tobias-fiberdata | shardy, alright | 14:39 |
| *** fultonj has joined #tripleo | 14:39 | |
| openstackgerrit | Merged openstack/instack-undercloud: Enable TLS for Zaqar's websocket endpoint https://review.openstack.org/360350 | 14:42 |
| hewbrocca | whoa, TLS for zaqar | 14:42 |
| *** limao__ has quit IRC | 14:42 | |
| hewbrocca | jaosorior: nice one dude | 14:42 |
| tobias-fiberdata | shardy, loads of questions, but how do i do the manually os-net-config? | 14:43 |
| tobias-fiberdata | seirously we have been having an openstack-plattform for 2years but i feel like a freaking noob when it comes to this | 14:43 |
| jaosorior | hewbrocca: thanks | 14:43 |
| *** limao has joined #tripleo | 14:44 | |
| jaosorior | tobias-fiberdata: I can relate; openstack feels that way always | 14:44 |
| jaosorior | tobias-fiberdata: by the way, the weekly meeting is on-going on #openstack-meeting-alt so people might be a bit busy. It's only 15 min left though | 14:45 |
| *** dtrainor has joined #tripleo | 14:45 | |
| tobias-fiberdata | that's okey | 14:45 |
| shardy | tobias-fiberdata: os-net-config -c /etc/os-net-config/config.json | 14:45 |
| tobias-fiberdata | shardy, thanks alot man | 14:45 |
| shardy | optionally add the --verbose and --noop flags | 14:46 |
| tobias-fiberdata | you are a diamond | 14:46 |
| tobias-fiberdata | this explains everything | 14:47 |
| tobias-fiberdata | you are really a diamond shardy taking your time helping out! ofc, everyone else should have credit aswell | 14:47 |
| sshnaidm | derekh, matbu I see upgrades job runs on "centos-7-2-node-internap-mtl01-4410463" and it doesn't seem like rh1 cloud | 14:48 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: TESTING - DO NOT MERGE https://review.openstack.org/373386 | 14:48 |
| sshnaidm | derekh, how do we move it to run on rh1? | 14:48 |
| jaosorior | hewbrocca: and I actually have TLS for all endpoints in haproxy working. But I have to wait for Ocata to merge that. | 14:50 |
| hewbrocca | Too bad | 14:51 |
| openstackgerrit | Merged openstack/python-tripleoclient: Use the hexdigest of the path to make the filename unique in swift https://review.openstack.org/373159 | 14:52 |
| jeckersb | any clue why this newton overcloud deployment just kinda silently fails? - https://paste.fedoraproject.org/431495/14743831/ | 14:57 |
| jeckersb | in the end there's just no stack | 14:57 |
| jeckersb | not sure why, don't see an error anywhere | 14:57 |
| jaosorior | jeckersb: does mistral execution-list print any error? | 14:57 |
| *** hrybacki|mtg is now known as hrybacki | 14:57 | |
| jaosorior | EmilienM: It seems that scenario001 is broken :/ | 14:58 |
| d0ugal | jeckersb: do you have a heat stack? $ openstack stack list | 14:58 |
| jeckersb | jaosorior: yep! | 14:59 |
| jeckersb | https://paste.fedoraproject.org/431500/47438356/ | 14:59 |
| jeckersb | d0ugal: nope no stack | 14:59 |
| jaosorior | jeckersb: can you do mistral execution-get <id> ? | 15:00 |
| * jeckersb is unfamiliar with the new mistral stuff so is totally lost | 15:00 | |
| jaosorior | that will give you more info | 15:00 |
| EmilienM | jaosorior: is it voting? | 15:00 |
| jaosorior | EmilienM: it's not | 15:00 |
| EmilienM | so :) | 15:00 |
| EmilienM | I know it's broken, something with gnocchi | 15:00 |
| jaosorior | aaah | 15:00 |
| jaosorior | I see | 15:00 |
| EmilienM | I never took the time to investigate since RC1 and 2 things | 15:00 |
| jaosorior | I wasn't aware it's a known issue. | 15:00 |
| EmilienM | it's on my list | 15:00 |
| * d0ugal needs to finish his debugging tripleo and mistral blog post | 15:01 | |
| *** limao has quit IRC | 15:01 | |
| d0ugal | jaosorior, jeckersb - that error can probably be ignored. | 15:01 |
| bnemec | jeckersb: It looks like this is a script and you're doing || true on the deploy command? | 15:01 |
| *** limao has joined #tripleo | 15:01 | |
| bnemec | There's probably a failure in stderr or something. | 15:02 |
| *** chem has quit IRC | 15:02 | |
| jeckersb | https://paste.fedoraproject.org/431502/47438369/ | 15:02 |
| d0ugal | jaosorior, jeckersb - if that is the only one, ignore it. Everyone will be getting that now as the default plan creation is broken. (see https://review.openstack.org/371347) | 15:02 |
| jeckersb | bnemec: yeah this is from quickstart, running the overcloud-deploy.sh | 15:02 |
| EmilienM | jaosorior: +2 on metadata, you win | 15:02 |
| *** limao has quit IRC | 15:02 | |
| jeckersb | YaqlEvaluationException: Can not evaluate YAQL expression: ... | 15:03 |
| *** limao has joined #tripleo | 15:03 | |
| jeckersb | looks like the root cause | 15:03 |
| jaosorior | EmilienM: well, for Ocata we could attempt to split nova-api and have a metadata-specific manifest | 15:03 |
| jaosorior | shardy: can you review https://review.openstack.org/#/c/373141/ ? | 15:04 |
| *** bandini has quit IRC | 15:04 | |
| EmilienM | jaosorior: ok | 15:04 |
| EmilienM | jaosorior: please file a bug and track it in ocata-1 - thx a ton | 15:05 |
| *** bandini has joined #tripleo | 15:05 | |
| shardy | Yeah, earlier we discussed it, and there is coupling in puppet-nova here: | 15:05 |
| derekh | sshnaidm: here is where the job is defined http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/projects.yaml#n13957 | 15:05 |
| shardy | https://github.com/openstack/puppet-nova/blob/master/manifests/api.pp#L37 | 15:05 |
| shardy | probably not high priority, but we might look at breaking that in ocata so the seperate templates work better with the underlying puppet abstractions | 15:05 |
| derekh | you switch to OVB, change the node from centos-7-2-node too tripleo-centos-7 | 15:05 |
| jaosorior | EmilienM: for puppet-nova? | 15:06 |
| EmilienM | jaosorior: probably | 15:06 |
| sshnaidm | derekh, yeah, and rename it maybe | 15:06 |
| EmilienM | shardy: right | 15:06 |
| *** yamahata has quit IRC | 15:07 | |
| derekh | sshnaidm: yup | 15:07 |
| EmilienM | jaosorior, shardy: also, we could deploy nova-api with medatata service only and have osapi in wsgi with apache | 15:07 |
| derekh | sshnaidm: and remove multinode from the type | 15:07 |
| sshnaidm | derekh, yeah, sure | 15:07 |
| shardy | Yeah, there's probably a few valid reasons for wanting these split up | 15:07 |
| shardy | I approved the patch, we can revisit in ocata | 15:08 |
| EmilienM | shardy: ++ | 15:08 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Make apache-based services use network-dependent servername https://review.openstack.org/365585 | 15:08 |
| mwhahaha | so what is the solution to the overcloud-without-mergepy.yaml thing, i just tried a fresh HA deploy and got a 404 on that. | 15:10 |
| shardy | mwhahaha: what version of tripleo-common are you running? | 15:11 |
| mwhahaha | openstack-tripleo-common-5.0.1-0.20160919174326.54c9a26.el7.centos.noarch | 15:11 |
| shardy | and did you do any overcloud deploy commands before seeing the 404? | 15:11 |
| mwhahaha | no | 15:11 |
| *** ebarrera has quit IRC | 15:13 | |
| shardy | mwhahaha: Ok, that should work, but you'll have to do an openstack stack delete overcloud && openstack overcloud plan delete overcloud between deploy (of overcloud) attempts until you get https://github.com/openstack/tripleo-common/commit/2d87e9640427f12eb5604f290fe38eae00f402ee | 15:13 |
| jaosorior | EmilienM: done https://bugs.launchpad.net/tripleo/+bug/1625679 | 15:13 |
| openstack | Launchpad bug 1625679 in tripleo "no manifest for deploying nova-metadata specific resources" [Low,New] | 15:13 |
| *** oshvartz has joined #tripleo | 15:13 | |
| sshnaidm | derekh, matbu https://review.openstack.org/#/c/373406/ | 15:13 |
| shardy | mwhahaha: what does swift download overcloud overcloud.yaml give you? | 15:13 |
| EmilienM | jaosorior: thx | 15:13 |
| mwhahaha | shardy: http://paste.openstack.org/show/582265/ | 15:14 |
| shardy | mwhahaha: also check /var/log/mistral/mistral-server.log for errors around the "jinja2 rendering overcloud.j2.yaml" logs | 15:14 |
| mwhahaha | shardy: no errors | 15:15 |
| shardy | mwhahaha: Ok, so the j2 rendering worked, the deploy should just use that, it shouldn't care about the overcloud-without-mergepy.yaml | 15:15 |
| shardy | (thats the old deprecated name we support for backwards compat and should probably remove) | 15:15 |
| *** lblanchard has quit IRC | 15:15 | |
| *** jlinkes__ has quit IRC | 15:16 | |
| *** lblanchard has joined #tripleo | 15:16 | |
| shardy | mwhahaha: I'd tail the mistral logs, then delete the heat stack (if there is one, probably there isn't), and do openstack overcloud plan delete overcloud | 15:16 |
| shardy | then do openstack overcloud deploy --templates while looking at the mistral logs for errors | 15:16 |
| mwhahaha | k | 15:17 |
| shardy | mwhahaha: also, you may need this patch if you're using relative paths: | 15:17 |
| mwhahaha | i saw some zaqar errors | 15:17 |
| shardy | https://review.openstack.org/#/c/373220/ | 15:17 |
| mwhahaha | i'm not, i litterally just followed the examples from the docs | 15:17 |
| shardy | but I'd expect it to fail on some file other than overcloud* if that's the problem | 15:17 |
| jaosorior | mwhahaha: actually, there is a zaqar bug. You need this patch which just merged today https://review.openstack.org/#/c/369285/ | 15:18 |
| shardy | mwhahaha: ack, just giving a list of the current known issues ;) | 15:18 |
| derekh | bnemec: slagle: btw, we don't even seem to be getting up to 50 simultanious jobs at the moment, we're in the mid 20's | 15:18 |
| mwhahaha | http://paste.openstack.org/show/582267/ | 15:18 |
| hewbrocca | derekh: I was asking dbecker earlier | 15:18 |
| *** sshnaidm is now known as sshnaidm|afk | 15:18 | |
| hewbrocca | is *all* our traffic going through the bastion host? | 15:18 |
| derekh | hewbrocca: yes | 15:19 |
| derekh | hewbrocca: no | 15:19 |
| shardy | derekh: top marks for clarity ;) | 15:19 |
| derekh | hewbrocca: all our *outside* traffic | 15:19 |
| derekh | shardy: thanks | 15:19 |
| *** lucasagomes is now known as lucas-hungry | 15:21 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: swift: normalize memcache servers IP addresses https://review.openstack.org/372734 | 15:21 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Add IPv6 network configuration for ipv6 job types https://review.openstack.org/363674 | 15:22 |
| hewbrocca | derekh: Is there any reason we're running public API traffic through the bastion host? | 15:23 |
| derekh | hewbrocca: when the rack was setup origionally (2+ years ago), that how it was setup and given to us, the public link is only connected to the bastion | 15:24 |
| hewbrocca | derekh: interesting | 15:25 |
| hewbrocca | Maybe we don't care, but it seems odd | 15:25 |
| *** leanderthal is now known as leanderthal|afk | 15:26 | |
| *** pkovar has quit IRC | 15:28 | |
| derekh | hewbrocca: I'm sure its caused problems over time, I'm not sure how hard it would be to change, pabelanger started a email about changing it last week | 15:29 |
| hewbrocca | oh really | 15:29 |
| hewbrocca | OK | 15:29 |
| *** yolanda has quit IRC | 15:29 | |
| derekh | hewbrocca: http://lists.openstack.org/pipermail/openstack-dev/2016-September/103344.html | 15:30 |
| *** zoli is now known as zoli|gone | 15:31 | |
| *** ramishra has quit IRC | 15:31 | |
| openstackgerrit | Saravanan KR proposed openstack/python-tripleoclient: Remove the reference to overcloud-without-mergepy file https://review.openstack.org/373336 | 15:31 |
| *** zoli|gone is now known as zoli_gone-proxy | 15:31 | |
| *** tremble has quit IRC | 15:32 | |
| *** fzdarsky has quit IRC | 15:33 | |
| *** akshai has joined #tripleo | 15:33 | |
| *** jbadiapa has quit IRC | 15:38 | |
| *** jaosorior has quit IRC | 15:40 | |
| *** dprince has quit IRC | 15:42 | |
| *** aufi has quit IRC | 15:43 | |
| slagle | EmilienM: since we have "include ::keystone::cron::token_flush | 15:43 |
| slagle | in the undercloud puppet manifest... | 15:43 |
| slagle | where should we see the cron job defined? | 15:43 |
| slagle | because I dont see it anywhere | 15:44 |
| EmilienM | what? | 15:44 |
| EmilienM | under the keystone user | 15:44 |
| EmilienM | you should see it | 15:44 |
| slagle | oh ok, let me check | 15:44 |
| slagle | i was checking root and stack | 15:44 |
| *** skramaja has quit IRC | 15:45 | |
| slagle | EmilienM: ok, i see it under the keystone user, thanks | 15:45 |
| EmilienM | slagle: https://github.com/openstack/puppet-keystone/blob/master/manifests/cron/token_flush.pp#L80 | 15:46 |
| EmilienM | we create the crontab under keystone user to make sure logs can be written correctly | 15:46 |
| EmilienM | otherwise root would override logs and keystone will crash | 15:47 |
| EmilienM | because logs need to be owned by keystone | 15:47 |
| d0ugal | How do I get to a point where two patches that depend on the other can land? CI fails with either on their own, but together it passes. https://review.openstack.org/#/c/369247/ and https://review.openstack.org/#/c/371347/ | 15:47 |
| EmilienM | d0ugal: damn | 15:47 |
| EmilienM | let me look | 15:47 |
| bnemec | Can I get +2a on https://review.openstack.org/#/c/365114/ ? | 15:48 |
| EmilienM | d0ugal: it means the patches are not backward compatible | 15:48 |
| EmilienM | bnemec: boom | 15:48 |
| d0ugal | EmilienM: in what way? | 15:49 |
| *** derekh has quit IRC | 15:49 | |
| EmilienM | bnemec: how can we say no to so much green :) | 15:49 |
| EmilienM | d0ugal: well, https://review.openstack.org/#/c/371347/ seems backward incompatible | 15:49 |
| bnemec | EmilienM: Thanks | 15:49 |
| d0ugal | EmilienM: it depends on https://review.openstack.org/#/c/369247/ (and vice versa) | 15:50 |
| d0ugal | I guess I could split it into a series of three patches... | 15:50 |
| EmilienM | d0ugal: but still backward non compatible | 15:50 |
| EmilienM | yes | 15:50 |
| EmilienM | we have the same problem sometimes in puppet/THT | 15:50 |
| EmilienM | we have to split in 3 patches | 15:50 |
| d0ugal | Fun | 15:50 |
| bnemec | d0ugal: I've had to do that in the past. | 15:50 |
| EmilienM | to have a transition period | 15:50 |
| openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Remove one last reference to openstackclient.tests https://review.openstack.org/373435 | 15:50 |
| bnemec | Dammit, has that still not merged? | 15:51 |
| bnemec | Oh, stable/newton | 15:51 |
| jpich | Cheers | 15:52 |
| EmilienM | jpich is our stable/newton guardian | 15:52 |
| EmilienM | rbrady, d0ugal, jpich, shardy: have you seen https://review.openstack.org/#/c/370423/ ? | 15:55 |
| *** ebarrera has joined #tripleo | 15:55 | |
| EmilienM | my goal is to prevent tripleo CI breakages when patching mistral | 15:55 |
| d0ugal | oh, nice | 15:56 |
| EmilienM | I'm not sure mistral PTL saw it :P | 15:56 |
| d0ugal | lol | 15:56 |
| d0ugal | Prob not | 15:56 |
| d0ugal | EmilienM: will it be voting? | 15:56 |
| EmilienM | d0ugal: yes (lol) | 15:56 |
| rbrady | EmilienM: that's great | 15:57 |
| *** dprince has joined #tripleo | 15:58 | |
| *** ramishra has joined #tripleo | 15:59 | |
| trown | slagle: do you know of any workaround for that password prompt issue in osc? | 16:00 |
| *** rasca has quit IRC | 16:01 | |
| slagle | trown: pressing Enter | 16:02 |
| trown | lol | 16:02 |
| trown | found that one :P | 16:02 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 16:03 |
| *** jcoufal_ has joined #tripleo | 16:04 | |
| trown | hmmm I suppose `printf '\n' | tripleo.sh` would also work | 16:04 |
| panda | EmilienM: we should add Closes-Bug: #1618491 to https://review.openstack.org/363674 | 16:05 |
| openstack | bug 1618491 in tripleo "Add IPv6 tests in CI for newton" [Wishlist,In progress] https://launchpad.net/bugs/1618491 - Assigned to Gabriele Cerami (gcerami) | 16:05 |
| EmilienM | panda: yes, please not now, jobs are running :) | 16:05 |
| panda | EmilienM: yep, that's why I said it, and not done it. | 16:06 |
| panda | bandini: *prod* | 16:06 |
| EmilienM | panda: thanks :) | 16:06 |
| *** jcoufal has quit IRC | 16:08 | |
| shardy | rbrady: Hey, did you start any patches that decouple process templates from the j2 rendering? | 16:11 |
| shardy | rbrady: I'd like to add a -r somecustom_roles_data.yaml to tripleoclient | 16:11 |
| openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Verify that the Deployment Plan creation was successful https://review.openstack.org/369247 | 16:11 |
| openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Ensure that the default plan was created successfully https://review.openstack.org/373446 | 16:11 |
| shardy | but that implies creating the plan, then updating it with a new roles_data, then rendering the plan | 16:11 |
| shardy | trying to figure out the least hacky way to do it | 16:11 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fix the default plan creation https://review.openstack.org/371347 | 16:12 |
| *** mah has joined #tripleo | 16:12 | |
| rbrady | shardy: I did, but thought this would be better suited for after the release in the start of Ocata, https://review.openstack.org/#/c/370868/ | 16:12 |
| mah | hi all, anybody tried before fake pxe in his deployment ? | 16:12 |
| shardy | rbrady: ack, yeah probably best to wait, I was looking for a quick way to add it | 16:13 |
| shardy | I guess we'll document cp -r in the docs for Newton ;) | 16:13 |
| rbrady | shardy: it's up to you. if you want to add this, I could rebase the patch and add a better commit message | 16:14 |
| shardy | mah: Yes, I've used it, you'll need to modify the undercloud ironic configuration but basically it works | 16:14 |
| mah | I am using OPNFV-Apex which is based on TripleO | 16:15 |
| rbrady | shardy: I was just worried that it's yet another patch that needs to land. while the current code is less efficient, it's not causing exceptions that I know of | 16:15 |
| mah | and adjusted it to use the fake pxe | 16:15 |
| mah | and it receive the pxe ips | 16:15 |
| shardy | rbrady: If you can rebase it and update the commit msg that would be good, then I'll base my testing on it for early ocata | 16:15 |
| openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Ensure that the default plan was created successfully https://review.openstack.org/373446 | 16:15 |
| openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Verify that the Deployment Plan creation was successful https://review.openstack.org/369247 | 16:15 |
| mah | and then after provisioning , the nodes are shutdown automatically | 16:15 |
| rbrady | shardy: ack | 16:15 |
| shardy | rbrady: The main issue is we document overridding packaged tripleo-heat-templates, which is going to be impossible with custom roles for newton | 16:16 |
| *** ohamada has quit IRC | 16:16 | |
| mah | and then I power them up but it gave me black screen with cursos flashing at the left corner | 16:16 |
| shardy | as you need to copy the tree somewhere, modify roles_data.yaml, then upload to the plan | 16:16 |
| shardy | rbrady: I guess this is advanced functionality so that will have to do for this release | 16:16 |
| *** dsariel has quit IRC | 16:17 | |
| shardy | mah: are these uefi boxes? | 16:17 |
| mah | yes | 16:17 |
| mah | by the way the configuration should be legacy first or UEFI first ? | 16:18 |
| shardy | Ok, I'd maybe chat with the ironic folks, as I know some fixes related to uefi landed quite recently | 16:18 |
| shardy | and I guess you're working on an older fork/branch of openstack? | 16:18 |
| d0ugal | hah, well, I think I confused Depends-On :/ | 16:18 |
| shardy | mah: when I last tested I couldn't get uefi boot to work, I had to set the box to boot in legacy mode in the bios | 16:18 |
| shardy | I think that is fixed now, but cannot personally confirm it | 16:19 |
| shardy | lucas-hungry may have some additional information | 16:19 |
| mah | ok I will adjust them to leagacy and see | 16:19 |
| mah | I have to enable CSM | 16:20 |
| openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Tripleoclient leaks temporary files https://review.openstack.org/373449 | 16:20 |
| *** lucas-hungry is now known as lucasagomes | 16:22 | |
| lucasagomes | shardy, mah hi there... Yes we recently landed some changes in instack-undercloud and also puppet-ironic to configure UEFI by default | 16:24 |
| lucasagomes | shardy, mah by default I mean, just to have it configured... if you wanna use UEFI for deployment you still have to set the capability "boot_mode:uefi" in Ironic and Nova flavor | 16:25 |
| *** florianf has quit IRC | 16:26 | |
| shardy | lucasagomes: thanks for the info! | 16:26 |
| shardy | mah: ^^ | 16:26 |
| mah | thanks for the info Lucas | 16:27 |
| mah | I would like to know why when it is powered off automatically, and I power them up again , it does not show me the login and shows black screen !! | 16:28 |
| *** saneax is now known as saneax-_-|AFK | 16:29 | |
| shardy | mah: probably because the bootloader isn't installed correctly | 16:29 |
| mah | bootloader which is configured at the jumphost ? | 16:30 |
| lucasagomes | mah, so the instance is marked as active ? And the node is powered off ? | 16:30 |
| mah | no | 16:30 |
| lucasagomes | so you power it on again and you don't see anything in the console ? | 16:30 |
| mah | I am using opnfv-apex | 16:30 |
| *** bana_k has joined #tripleo | 16:31 | |
| * lucasagomes googles | 16:31 | |
| mah | so at the overcloud deployment , I power on the nodes , then they receive the ips .. and get configured ... after some time .. I found all the nodes are powered off ,, I think that happen by the jumphost | 16:31 |
| mah | because usually in opnfv-apex after provisioning the overcloud nodes, the nodes should be restarted | 16:32 |
| mah | since we use fake pxe | 16:32 |
| mah | so they are powered off | 16:32 |
| mah | and I power them up again | 16:32 |
| mah | at this time it found the same ip it has assigned before and get for me a black screen | 16:33 |
| lucasagomes | mah, oh if you use fake_* driver ironic can't power control it, so it's unlikely that ironic is doing something here | 16:33 |
| lucasagomes | mah, for the console you may want to add console=ttyS0 to the kernel cmdline (in the bootloader) maybe ? | 16:34 |
| *** trown is now known as trown|lunch | 16:35 | |
| mah | so why it is powerd off | 16:35 |
| shardy | lucasagomes: FWIW I saw similar when I last tested a uefi box | 16:36 |
| shardy | the ramdisk shuts the node off after silently failing to fully install the bootloader | 16:36 |
| shardy | then you turn it on and no bootloader | 16:36 |
| shardy | flashing cursor | 16:36 |
| mah | hmmm | 16:37 |
| lucasagomes | shardy, oh right, and you were using the overcloud-full disk image ? | 16:37 |
| shardy | which is why I suspect mah may need the uefi fixes, or to enable legacy boot mode | 16:37 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-ui: Extract Mistral action and workflow names into constants https://review.openstack.org/366685 | 16:37 |
| shardy | lucasagomes: yeah | 16:37 |
| mah | I am now using leagcy mode | 16:37 |
| openstackgerrit | imain proposed openstack/tripleo-common: Create new docker command hook. https://review.openstack.org/312723 | 16:37 |
| lucasagomes | shardy, gotcha, yeah UEFI in Ironic is complicated cause we don't actually test it in the gate | 16:38 |
| mah | but at the first time before it power off | 16:38 |
| lucasagomes | shardy, mah just today I created this: https://bugs.launchpad.net/ironic/+bug/1625616 | 16:38 |
| openstack | Launchpad bug 1625616 in Ironic "[RFE] Support for UEFI deployment in DevStack / Gate tests for UEFI deployments" [Wishlist,New] - Assigned to Lucas Alvares Gomes (lucasagomes) | 16:38 |
| mah | it shows to me that I can log in | 16:38 |
| lucasagomes | which I'm hoping to improve soon | 16:38 |
| lucasagomes | shardy, but I will take a look at this problem then | 16:38 |
| shardy | lucasagomes: sounds good, thanks! | 16:38 |
| lucasagomes | mah, and what is the node provision state in Ironic ? | 16:39 |
| mah | I did not see it as the deployment was not finished yet there | 16:39 |
| lucasagomes | if the bootloader fails to install ironic should have detected it and failed the deployment as well | 16:39 |
| lucasagomes | mah, ironic node-show <node uuid> | 16:40 |
| lucasagomes | you can run it while it's deploying | 16:40 |
| mah | ok | 16:40 |
| mah | and how to get uuids | 16:40 |
| mah | ironic node-list | 16:40 |
| mah | ? | 16:40 |
| lucasagomes | yes | 16:42 |
| mah | ok will check | 16:43 |
| rook | mcornea: so looking through this gist you sent for custom roles... you still pass --control-scale 3 | 16:44 |
| mcornea | rook: yes, I had 3 controllers + 2 network nodes, for the network nodes I used NetworkerCount: 2 in network-environment.yaml | 16:45 |
| *** jpich has quit IRC | 16:48 | |
| marios | gfidente: please revisit your +2 https://review.openstack.org/#/c/366760/ when you have 1 minute thanks | 16:48 |
| mah | now it is showing the power state is on | 16:51 |
| mah | and provisioning state is deploying | 16:51 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-docs: Remove references to balance-tcp https://review.openstack.org/372590 | 16:52 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui: When deploy finishes, show overcloud info https://review.openstack.org/370765 | 16:53 |
| dprince | shardy: It would be good to get this in finally https://review.openstack.org/#/c/312723/ | 16:55 |
| openstackgerrit | Merged openstack/tripleo-specs: Simplify the TripleO Workflow https://review.openstack.org/238192 | 16:55 |
| *** rcernin has quit IRC | 16:55 | |
| Slower | dprince: thanks | 16:55 |
| shardy | dprince: it's still being proposed to the wrong repo? | 16:56 |
| dprince | shardy: I don't think steve baker wanted it in heat-templates | 16:57 |
| shardy | I commented on that back in july | 16:57 |
| Slower | shardy: It's going to transmute into something tripleo specific | 16:57 |
| dprince | shardy: which causes us some packaging issues | 16:57 |
| shardy | ugh | 16:57 |
| dprince | shardy: perhaps I misunderstood | 16:57 |
| dprince | shardy: I'd actually be happy for it to live in heat-templates FWIW | 16:57 |
| Slower | It's unclear to me what the best thing to do here is | 16:57 |
| dprince | shardy: it makes a nice subpackage then off of os-collect-config per stevebaker's latest work | 16:57 |
| Slower | It's going to become more and more tripleo specific | 16:57 |
| beagles | shardy: was there a bug around the nova metadata ip thing that jaosorior brought up earlier today... it might also be breaking DVR. Basically the metadata IP being used on the compute node is that of the compute node itself not the controller. | 16:57 |
| shardy | I just wanted us to use a generic heat hook that runs docker, vs a special snowflake tripleo thing | 16:57 |
| shardy | if we have to go with tripleo-common for now I guess that's fine | 16:58 |
| shardy | I just would have preferred a more generic approach | 16:58 |
| beagles | shardy: looking to see if it is something else bunging up the works though... it's kinda weird | 16:58 |
| shardy | beagles: Yeah, I think we landed the fix | 16:58 |
| beagles | shardy: oh sweet | 16:58 |
| beagles | shardy: I'll update and try again | 16:59 |
| * beagles hopes it wasn't the fix that broke it :) | 16:59 | |
| lucasagomes | mah, so this machines you are deploying, can you check what is the boot device order ? | 16:59 |
| shardy | dprince: stevebaker said "I'd really like to see hook-docker.py live in heat-templates" | 16:59 |
| shardy | so AFAICT he and I are agreeing | 16:59 |
| dprince | shardy: well then I agree with you all too :) | 17:00 |
| shardy | I don't want to stop progress on this either, but I gave this feedback a long time ago | 17:00 |
| mah | the device order is nic then the disk Centos | 17:00 |
| *** dsneddon has joined #tripleo | 17:00 | |
| lucasagomes | mah, I wonder if the fake_ driver can also change the boot device, therefore after the installation it may still want to PXE boot the node (and you are using local boot, which should go trough the disk instead) | 17:00 |
| dprince | Slower: can we move this over real quick? | 17:00 |
| Slower | we could yes | 17:00 |
| Slower | fwiw it makes building the container a pita | 17:00 |
| dprince | Slower: | 17:00 |
| Slower | so 6 of one.. | 17:00 |
| dprince | https://review.openstack.org/#/c/350553/ | 17:00 |
| dprince | Slower: actually, I think it'll be fine to build the container | 17:01 |
| dprince | Slower: because we'll have a proper package for this | 17:01 |
| dprince | Slower: step 1) Add it to heat-templates | 17:01 |
| dprince | Slower: step 2) create a subpackage like this https://review.rdoproject.org/r/#/c/2106/ | 17:01 |
| shardy | beagles: actually, it's still gating : https://review.openstack.org/#/c/373141/ | 17:01 |
| Slower | dprince: gotcha | 17:01 |
| dprince | Slower: step 3) update the tripleo containers to simply install that package. Done! | 17:01 |
| dprince | Slower: super clean I think | 17:02 |
| beagles | shardy: ah cool.. thanks | 17:02 |
| Slower | dprince, shardy: ok I'll move it over | 17:02 |
| *** mcornea has quit IRC | 17:02 | |
| shardy | dprince, Slower: thanks guys, sorry to push the issue | 17:02 |
| *** hewbrocca is now known as hewbrocca-afk | 17:02 | |
| Slower | no worries | 17:02 |
| shardy | hopefully it will be worth the effort to keep things clean in the long run | 17:02 |
| Slower | ya probly not ;-) | 17:03 |
| * Slower runs and hides | 17:03 | |
| lucasagomes | mah, so, check ironic node-show <node uuid>... in the "properties" field, do you see a key called "capabilities" ? If so, do you see a capability called "boot_option:local" ? | 17:03 |
| mah | I have it network as first place in boot order | 17:03 |
| shardy | Slower: You don't think it's worth using a common heat community maintained hook? | 17:03 |
| lucasagomes | mah, right, and after the deployment Ironic would be trying to set it to boot from the HD, but as you are using the fake driver none will happen | 17:04 |
| Slower | shardy: I don't think anyone else is going to use it honestly | 17:04 |
| lucasagomes | mah, so once you power the node on again it will try to PXE boot, that's why i think it's not booting for you | 17:04 |
| lucasagomes | mah, see if you have that boot_option:local capabilities set | 17:04 |
| Slower | but you never know | 17:04 |
| mah | mmmm | 17:04 |
| mah | boot_option where ? in the jumphost node or the other nodes ? | 17:05 |
| lucasagomes | mah, in the ironic nodes | 17:05 |
| shardy | Slower: tbh I think just getting the packaging sorted out for free is reason enough | 17:05 |
| lucasagomes | mah, "ironic node-show <node uuid>" | 17:05 |
| shardy | ref the comment from stevebaker | 17:05 |
| * shardy notes we may have to buy stevebaker beer | 17:05 | |
| Slower | shardy: true | 17:05 |
| *** panda is now known as panda|dinner | 17:06 | |
| *** jpena is now known as jpena|off | 17:06 | |
| openstackgerrit | Merged openstack/instack-undercloud: Add sysctl preflight install check https://review.openstack.org/372605 | 17:06 |
| mah | capabilities is boot_option:local | 17:06 |
| lucasagomes | mah, right... so I think that's the problem | 17:07 |
| lucasagomes | since you are using the fake_ driver ironic won't be able to set the boot mode of the node to boot from the HD | 17:08 |
| lucasagomes | it will be no-op | 17:08 |
| mah | so how to solve it ? | 17:08 |
| *** sai is now known as sai|mtg | 17:08 | |
| lucasagomes | mah, you have to options: 1. change the boot mode manually after the deployment 2. always boot from the network | 17:08 |
| lucasagomes | mah, if you awnna go with #2 (I think it will be better) you can do: | 17:08 |
| mah | I already using 2 | 17:09 |
| mah | to boot from the PXE | 17:09 |
| mah | even before the deployment | 17:09 |
| lucasagomes | mah, but ironic is not, ironic still thinks it can change the boot device | 17:09 |
| lucasagomes | but it's "fake" | 17:09 |
| lucasagomes | it's a mock up driver | 17:09 |
| mah | yes I know | 17:09 |
| lucasagomes | mah, so to tell ironic to always boot from network do: ironic node-update <node uuid> remove properties/capabilities | 17:09 |
| mah | now we have two options to boot from network or to boot from HD | 17:09 |
| mah | I do the sequence to be always from the network | 17:10 |
| mah | mmmm you mean to change it to the ironic | 17:10 |
| lucasagomes | mah, if you have that capabilitity set in ironic matching with the flavor ironic will assume you want to boot from the local disk | 17:10 |
| mah | not for the machines | 17:10 |
| lucasagomes | and not from the network | 17:10 |
| lucasagomes | mah, yes exactly | 17:11 |
| lucasagomes | mah, so use that ironic command and also remove the same capability from the nova flavor | 17:11 |
| mah | I think it is easier to change the node boot mode :) | 17:11 |
| mah | and let it from HD | 17:11 |
| lucasagomes | mah, yeah that's option #1 :-) | 17:12 |
| mah | yes will give it a try :) | 17:12 |
| lucasagomes | but it's less automated since you will have to change it every time you deploy | 17:12 |
| lucasagomes | and move it back boot from network for deploying | 17:12 |
| lucasagomes | that said, fake_ drivers are just testing drivers they are not meant for production | 17:12 |
| lucasagomes | because of ^ this things | 17:12 |
| mah | yes I know | 17:12 |
| mah | but I will not deploy million of times :D .. it is just one time every some monthes :) | 17:13 |
| dprince | Slower: the bad news is I can't +2 anything in the heat-templates repo | 17:13 |
| lucasagomes | mah, cool | 17:13 |
| dprince | Slower: and it does seem a bit slower to land things there sometimes. It happens | 17:14 |
| lucasagomes | mah, cool, ok so go ahead and change the boot mode and see if it works | 17:14 |
| dprince | Slower: so... press on | 17:14 |
| *** pcaruana has quit IRC | 17:14 | |
| *** milan has quit IRC | 17:17 | |
| mah | I think it works :) ...it opens for the login and continued configuration of the interfaces there :) | 17:17 |
| mah | thanks a lot Lucas | 17:17 |
| *** liverpooler has quit IRC | 17:20 | |
| *** akrivoka has quit IRC | 17:23 | |
| Slower | dprince: ok | 17:23 |
| *** liverpooler has joined #tripleo | 17:24 | |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Make puppet-stack-config.pp Puppet 4 compliant https://review.openstack.org/373477 | 17:24 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 17:25 |
| *** bana_k has quit IRC | 17:27 | |
| *** liverpooler has quit IRC | 17:27 | |
| lucasagomes | mah, cool no worries | 17:27 |
| lucasagomes | shardy, ^ | 17:27 |
| *** bkopilov has quit IRC | 17:28 | |
| shardy | thanks for the help lucasagomes! | 17:28 |
| lucasagomes | np | 17:28 |
| *** bkopilov has joined #tripleo | 17:30 | |
| *** yamahata has joined #tripleo | 17:31 | |
| dsneddon | lucasagomes, Are you there? I'm looking for the blueprints which cover multi-tenant bare metal. I looked on blueprints.launchpad.net with no results, not sure where to look next. | 17:32 |
| lucasagomes | dsneddon, hi there. Right, yeah Ironic does not use blueprints anymore | 17:33 |
| lucasagomes | we use only RFE's (wishlist bugs) and specs | 17:33 |
| lucasagomes | dsneddon, lemme dig the links for ya | 17:33 |
| dsneddon | lucasagomes, Thanks! | 17:33 |
| lucasagomes | dsneddon, https://trello.com/c/HWVHhxOj/1-multi-tenant-networking-network-isolation | 17:34 |
| dsneddon | lucasagomes, Perfect, thanks. I've been asked to provide some feedback for Nuage, so they can make sure their solution works with multi-tenant bare metal networking. | 17:35 |
| lucasagomes | dsneddon, gotcha, I replied to a BZ just today | 17:35 |
| lucasagomes | maybe that's why | 17:35 |
| lucasagomes | dsneddon, see https://bugzilla.redhat.com/show_bug.cgi?id=1286164 | 17:35 |
| openstack | lucasagomes: Error: Error getting bugzilla.redhat.com bug #1286164: NotPermitted | 17:36 |
| dsneddon | lucasagomes, Ah, thanks for the context. | 17:36 |
| lucasagomes | dsneddon, np, it's a guess but I think that was what triggered it (see comment 13) | 17:36 |
| openstackgerrit | Merged openstack/python-tripleoclient: Always use absolute path for tht_root https://review.openstack.org/373220 | 17:38 |
| *** bana_k has joined #tripleo | 17:40 | |
| EmilienM | shardy: can we backport https://review.openstack.org/#/c/373220/ ? | 17:41 |
| shardy | EmilienM: yes, I'll propose it now | 17:42 |
| *** saneax-_-|AFK is now known as saneax | 17:43 | |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient: Always use absolute path for tht_root https://review.openstack.org/373487 | 17:44 |
| *** akshai has quit IRC | 17:44 | |
| *** akshai has joined #tripleo | 17:44 | |
| EmilienM | shardy: thx | 17:44 |
| *** cwolferh has quit IRC | 17:44 | |
| EmilienM | shardy: I'll approve it if CI pass well | 17:44 |
| shardy | EmilienM: ack, thanks! | 17:45 |
| *** akshai has quit IRC | 17:45 | |
| *** rbowen has quit IRC | 17:45 | |
| *** mburns_mtg is now known as mburned_out | 17:46 | |
| *** rbowen has joined #tripleo | 17:46 | |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Make puppet-stack-config.pp Puppet 4 compliant https://review.openstack.org/373477 | 17:46 |
| *** mburned_out is now known as mburns_mtg | 17:47 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 17:47 |
| *** tosky has quit IRC | 17:47 | |
| openstackgerrit | John Eckersberg proposed openstack/tripleo-puppet-elements: Add puppet-qdr module https://review.openstack.org/373488 | 17:48 |
| openstackgerrit | John Eckersberg proposed openstack/tripleo-puppet-elements: Add qpid-dispatch-router to overcloud-controller element https://review.openstack.org/373489 | 17:48 |
| *** trown|lunch is now known as trown | 17:49 | |
| thrash | EmilienM: finally got scenario 2 to pass on https://review.openstack.org/#/c/331682/32 ! | 17:50 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Add nova-metadata template https://review.openstack.org/373141 | 17:50 |
| thrash | EmilienM: it's not done with jobs yet, but according to zuul it's passed | 17:50 |
| trown | does this trace look familiar to anyone? http://paste.openstack.org/show/582292/ | 17:51 |
| trown | trying to make a tripleo-ci/deploy.sh deploy work on a quickstart virt setup | 17:51 |
| EmilienM | thrash: oh nice :D | 17:52 |
| EmilienM | thrash: nice work | 17:52 |
| EmilienM | trown: ouch, sounds like some problem in heat.conf with authtoken params | 17:53 |
| trown | EmilienM: hmm... I wonder actually if it is something SSL related, I got tripleo.sh to work from the same setup, but now trying to go one step further and just plug deploy.sh directly | 17:55 |
| trown | so a developer could run EXACTLY what runs in CI, rather than needing to find all the relevant things to set that we do in deploy.sh | 17:56 |
| *** sai|mtg is now known as sai | 17:57 | |
| openstackgerrit | Merged openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/373315 | 17:57 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Don't send metrics to graphite in failed jobs https://review.openstack.org/365114 | 17:57 |
| *** akshai has joined #tripleo | 17:57 | |
| EmilienM | trown: nice | 17:57 |
| EmilienM | trown: can I see all heat logs and config? | 17:58 |
| trown | EmilienM: heat.conf http://chunk.io/f/afc1ca0a439e4660b20e3c28c7fa6cfd | 17:59 |
| trown | heat-engine.log http://chunk.io/f/b57a8b26572648d6ba698ee0ee0fe7b6 | 18:00 |
| EmilienM | [keystone_authtoken] looks good | 18:00 |
| EmilienM | oh and keystone logs | 18:00 |
| trown | keystone logs http://chunk.io/f/d5825c6d5a124e74a9d29f95c6544abc | 18:01 |
| EmilienM | and grep 22ba3ecc-21f5-4005-9af2-cbb7c2f68d9d | 18:01 |
| EmilienM | I don't see the request in keystone logs | 18:02 |
| EmilienM | a sec | 18:02 |
| trown | same | 18:02 |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud: Use correct password for keystone bootstrap https://review.openstack.org/372640 | 18:02 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates: Use correct password for keystone bootstrap https://review.openstack.org/372635 | 18:02 |
| EmilienM | trown: keystone is running? | 18:03 |
| EmilienM | I guess yes | 18:03 |
| EmilienM | I see lot of valid requests | 18:03 |
| EmilienM | GET http://192.0.2.1:35357/ | 18:03 |
| EmilienM | should not it be https? | 18:03 |
| EmilienM | oh but we're running ssl termination right | 18:03 |
| EmilienM | trown: it's undercloud right? | 18:04 |
| *** mburns_mtg is now known as mburned_out | 18:04 | |
| trown | EmilienM: ya... I think it must be SSL related, as I am starting with nonha config first and that is the main thing that is different in deploy.sh | 18:05 |
| trown | EmilienM: I can keep digging on it, dont want to waste your time on this | 18:05 |
| *** shardy has quit IRC | 18:05 | |
| EmilienM | i thought we gated on ssl in some jobs | 18:06 |
| trown | we do, the nonha job has SSL enabled | 18:06 |
| EmilienM | for undercloud also? | 18:06 |
| EmilienM | iirc yes | 18:06 |
| *** mburned_out is now known as mburns_mtg | 18:06 | |
| trown | EmilienM: ya | 18:07 |
| trown | https://github.com/openstack-infra/tripleo-ci/blob/master/toci_gate_test.sh#L147 | 18:08 |
| dsneddon | EmilienM, Just to confirm, if SSL is enabled on the undercloud, then the HTTPS listener for the Admin API will be "https://192.0.2.1:35357", right? | 18:09 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Make puppet-stack-config.pp Puppet 4 compliant https://review.openstack.org/373477 | 18:09 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 18:10 |
| EmilienM | dsneddon: it should be yes | 18:10 |
| *** athomas has quit IRC | 18:14 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 18:14 |
| *** Ryjedo has joined #tripleo | 18:21 | |
| mwhahaha | how do you use the j2.yaml templates | 18:27 |
| mwhahaha | like what's the correct way to invoke them | 18:28 |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Separate Template Processing From Create/Update Plan https://review.openstack.org/370868 | 18:29 |
| *** akuznetsov has joined #tripleo | 18:31 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Separate Template Processing From Create/Update Plan https://review.openstack.org/370868 | 18:32 |
| *** cwolferh has joined #tripleo | 18:35 | |
| openstackgerrit | Merged openstack/python-tripleoclient: Remove one last reference to openstackclient.tests https://review.openstack.org/373435 | 18:38 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/360004 | 18:40 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/360004 | 18:44 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-heat-templates: Composable Mistral services https://review.openstack.org/323436 | 18:45 |
| thrash | EmilienM: so now that it's passed on the zaqar, I should take off my -1 workflow, yah? | 18:48 |
| thrash | EmilienM: on the scenario002 patch | 18:48 |
| trown | EmilienM: btw figured it out... was SSL, need https://github.com/openstack-infra/tripleo-ci/blob/master/toci_instack.sh#L180-L182 | 18:48 |
| EmilienM | thrash: yes but we are in feature freeze now | 18:48 |
| thrash | EmilienM: no worries. | 18:48 |
| EmilienM | thrash: so we want land it until we cut stable/newton | 18:48 |
| EmilienM | trown: oops | 18:49 |
| thrash | EmilienM: word | 18:49 |
| trown | EmilienM: works fine in CI... just not when trying to use deploy.sh outside of CI | 18:49 |
| EmilienM | trown: right, that's bad, we need to fix that | 18:50 |
| *** yamahata has quit IRC | 18:50 | |
| EmilienM | bnemec: did we stopped to use extraconfig/all_nodes/swap-partition.yaml in CI? | 18:51 |
| *** gfidente has quit IRC | 18:55 | |
| EmilienM | dprince: do you know how the j2 templates can be used? It sounds like the swap template doesn't work | 18:57 |
| EmilienM | mwhahaha: do you have logs? | 18:57 |
| openstackgerrit | Merged openstack/python-tripleoclient: Add `openstack overcloud plan deploy` https://review.openstack.org/373089 | 18:57 |
| openstackgerrit | Merged openstack/python-tripleoclient: Pass the timeout to the deploy workflow https://review.openstack.org/373090 | 18:57 |
| bnemec | EmilienM: I'm not sure. I thought we stopped doing that, but I haven't looked recently. | 18:57 |
| dprince | EmilienM: is there a bug? | 18:58 |
| mwhahaha | EmilienM: http://paste.openstack.org/show/582306/ | 18:58 |
| mwhahaha | i don't know if it's a bug because i don't know how to use them | 18:58 |
| * dprince checks | 18:58 | |
| mwhahaha | it doesn't seem to be the same way as previous | 18:58 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Remove test-environments/swap-partition.yaml https://review.openstack.org/373500 | 18:58 |
| mwhahaha | it's one of those things where i don't know if it's me or the system :D | 18:59 |
| bnemec | EmilienM: I don't see anything about swap in http://logs.openstack.org/81/331681/15/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/b970470/console.html#_2016-09-20_16_13_27_914796 | 18:59 |
| *** akshai has quit IRC | 18:59 | |
| *** panda|dinner is now known as panda | 18:59 | |
| EmilienM | the log is really hard to read honestly | 18:59 |
| mwhahaha | what you don't like reading raw json dumps? | 19:00 |
| *** gfidente has joined #tripleo | 19:00 | |
| dprince | we added Swap partition in 94f580370d1104fb0f0d076cd3c3fd572cd961e8 | 19:01 |
| mwhahaha | http://paste.openstack.org/show/582307/ | 19:02 |
| mwhahaha | so swap-partition used to work | 19:02 |
| *** akshai has joined #tripleo | 19:02 | |
| mwhahaha | this is related to shardy's AllConfigs backwards compatibility break | 19:02 |
| mwhahaha | that change switched it to a j2.yaml from just a .yaml | 19:02 |
| dprince | and removed it w/ the j2 templates | 19:02 |
| dprince | mwhahaha: yes | 19:02 |
| mwhahaha | the change mentions docs to be written | 19:02 |
| mwhahaha | i assume they have not been written | 19:02 |
| mwhahaha | which is why i asked, is there something i missing or is it broken | 19:03 |
| dprince | mwhahaha: I think it now lives at extraconfig/all_nodes/swap-partition.yaml | 19:03 |
| *** jpeeler has quit IRC | 19:03 | |
| mwhahaha | like if i just call that file the j2 automagically gets converted into that? | 19:03 |
| mwhahaha | like i don't know how this stuff works | 19:03 |
| dprince | mwhahaha: it is now an extraconfig template | 19:04 |
| mwhahaha | i have no idea what that means | 19:04 |
| EmilienM | I agree this is not easy to understand when you haven't worked on this feature | 19:04 |
| *** lblanchard has quit IRC | 19:04 | |
| dprince | mwhahaha: http://docs.openstack.org/developer/tripleo-docs/advanced_deployment/extra_config.html | 19:05 |
| mwhahaha | yea i followed that | 19:05 |
| dprince | mwhahaha: before we had composable services this was an interface in heat we used to customized things | 19:05 |
| mwhahaha | so what's the way to do it with composable services? | 19:05 |
| mwhahaha | like fundamentally i understand now it's a j2 template that needs to have the role information populated | 19:06 |
| mwhahaha | but i have no idea how to do that now | 19:06 |
| *** kjw3 has quit IRC | 19:06 | |
| dprince | mwhahaha: the j2 template gets rendered into a swift container as a normal heat template | 19:06 |
| mwhahaha | by what | 19:06 |
| dprince | mwhahaha: so, swift list overcloud | 19:06 |
| mwhahaha | cause that doesn't seem to be working | 19:07 |
| dprince | mwhahaha: our workflow tooling does this | 19:07 |
| mwhahaha | how do j2 templates get rendered | 19:07 |
| dprince | mwhahaha: we now use Mistral to generate the plan, and drive the high level deployment | 19:07 |
| mwhahaha | but mistral is puking on the j2 formatting | 19:07 |
| dprince | mwhahaha: all of this enables the CLI and API to follow the same deployment paths | 19:07 |
| mwhahaha | so is that a bug or am i providing the wrong info | 19:07 |
| dprince | mwhahaha: it is working for me, so it could be environmental | 19:07 |
| dprince | mwhahaha: like perhaps something in your environment is old or outdated | 19:08 |
| dprince | mwhahaha: the workflow stuff just landed in the last week or so | 19:08 |
| dprince | mwhahaha: so it is quite new | 19:08 |
| mwhahaha | i installed yesterday | 19:08 |
| mwhahaha | using current | 19:08 |
| dprince | mwhahaha: I think we fixed some crucial bugs this morning (if you use current) | 19:09 |
| *** ebarrera has quit IRC | 19:09 | |
| dprince | mwhahaha: you might re-spin it or review the recently closed LP's | 19:09 |
| mwhahaha | k i can retry | 19:09 |
| dprince | mwhahaha: sorry, I'm not being super helpful | 19:09 |
| mwhahaha | so to confirm, lines 1-4 of http://paste.openstack.org/show/582306/ are correft right? | 19:09 |
| mwhahaha | 1-5 actually | 19:09 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Make puppet-stack-config.pp Puppet 4 compliant https://review.openstack.org/373477 | 19:09 |
| *** lblanchard has joined #tripleo | 19:10 | |
| dprince | mwhahaha: I think that should work | 19:10 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 19:10 |
| mwhahaha | k i'll respin and see | 19:10 |
| mwhahaha | that's what i wanted to confirm is that it should still work if i just s/.yaml/.j2.yaml | 19:11 |
| EmilienM | mwhahaha: it sounds like the old template not using j2 format won't work anymore | 19:11 |
| EmilienM | or at least the swap one | 19:11 |
| mwhahaha | right | 19:11 |
| mwhahaha | i'm trying to use the new way | 19:12 |
| mwhahaha | with the j2 file and mistral isn't having any of that | 19:12 |
| EmilienM | mwhahaha: I agree that's a poor user experience | 19:12 |
| dprince | mwhahaha: it still needs to say .yaml | 19:15 |
| dprince | mwhahaha: j2.yaml is the new one. correct | 19:15 |
| mwhahaha | what still needs to say .yaml | 19:15 |
| *** r-mibu has quit IRC | 19:17 | |
| *** r-mibu has joined #tripleo | 19:17 | |
| openstackgerrit | Merged openstack/python-tripleoclient: Use a released version of tripleo-common https://review.openstack.org/373175 | 19:17 |
| openstackgerrit | Merged openstack/python-tripleoclient: Print the execution ID when starting Mistral workflows https://review.openstack.org/373162 | 19:17 |
| mwhahaha | so looking in the mistral logs it says it rendered extraconfig/all_nodes/swap-partition.j2.yaml | 19:18 |
| mwhahaha | dprince: so i guess the question is how do i reference what it rendered? | 19:19 |
| dprince | mwhahaha: I think it is just this extraconfig/all_nodes/swap-partition.yaml | 19:20 |
| mwhahaha | let me try that | 19:20 |
| dprince | mwhahaha: that is what gets rendered into the swift container | 19:20 |
| dprince | mwhahaha: swift list overcloud | 19:20 |
| mwhahaha | so that's the difference is that it's no longer a local reference it must be the rendered reference | 19:20 |
| mwhahaha | that really should have been documented first | 19:20 |
| mwhahaha | no that gets assumed as a local path | 19:21 |
| mwhahaha | Could not fetch contents for file:///home/centos/extraconfig/all_nodes/swap-partition.yaml | 19:21 |
| dprince | mwhahaha: use the full path to the file | 19:22 |
| rcrit | I'm doing cloud-init on the overcloud install to do some pre-configuration and since CentOS ships cloud-init 0.7.5 it fails to run because the ConfigDriveNet doesn't work in that version | 19:22 |
| dprince | mwhahaha: with just .yaml as the suffix | 19:22 |
| rcrit | I have a bug opened but it has gotten no traction yet, https://bugs.centos.org/view.php?id=11462 | 19:22 |
| mwhahaha | dprince: so swift lists extraconfig/all_nodes/swap-partition.j2.yaml | 19:23 |
| rcrit | don't know if anyone else has run into this | 19:23 |
| mwhahaha | referencing the full path with just 'swap-partition.yaml' doesn't work either | 19:23 |
| dprince | mwhahaha: my swift also lists extraconfig/all_nodes/swap-partition.yaml | 19:23 |
| mwhahaha | that's the old file | 19:24 |
| openstackgerrit | Merged openstack/tripleo-quickstart: Remove settings from release configs https://review.openstack.org/371114 | 19:24 |
| dprince | mwhahaha: I think you've got enough to file a bug on this now | 19:24 |
| dprince | mwhahaha: I don't have an enviornment setup or I'd try it for you | 19:24 |
| mwhahaha | k i'll write something up | 19:24 |
| EmilienM | I'm tryin gto reproduce it too | 19:25 |
| openstackgerrit | Merged openstack/python-tripleoclient: Remove the environments from Mistral when removing from Swift https://review.openstack.org/373167 | 19:26 |
| openstackgerrit | Merged openstack/python-tripleoclient: Throw an error/exception when interactive overcloud update fails https://review.openstack.org/370742 | 19:26 |
| *** akshai has quit IRC | 19:28 | |
| *** jpeeler has joined #tripleo | 19:28 | |
| *** jpeeler has joined #tripleo | 19:28 | |
| *** electrofelix has quit IRC | 19:29 | |
| *** paramite has quit IRC | 19:32 | |
| *** akshai has joined #tripleo | 19:34 | |
| mwhahaha | EmilienM, dprince: https://bugs.launchpad.net/tripleo/+bug/1625783 | 19:36 |
| openstack | Launchpad bug 1625783 in tripleo "unable to leverage swap-partition extraconfig" [Undecided,New] | 19:36 |
| dprince | ack | 19:36 |
| EmilienM | mwhahaha: setting to critical | 19:36 |
| *** dbecker has quit IRC | 19:37 | |
| *** hjensas has quit IRC | 19:37 | |
| mwhahaha | trying with todays packages and we'll see | 19:37 |
| gfidente | mwhahaha, dprince I think that's fixed by | 19:37 |
| gfidente | https://review.openstack.org/#/c/373220/ | 19:37 |
| dprince | gfidente: ack, looks like it | 19:38 |
| mwhahaha | k | 19:38 |
| *** dbecker has joined #tripleo | 19:44 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: certmonger: improve orchestration for puppet4 https://review.openstack.org/373513 | 19:54 |
| *** andrey-mp has joined #tripleo | 19:55 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 19:55 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-puppet-elements: Install ceph-selinux in overcloud-{controller,cephstorage} images https://review.openstack.org/373514 | 19:55 |
| andrey-mp | Hi! I've trying to deploy undercloud from master. when I run 'openstack undercloud install' it asks me about some password? What password I should enter??? | 19:55 |
| *** akuznetsov has quit IRC | 20:00 | |
| andrey-mp | also, I've got an error right after undercloud installation - "Error: Must pass keystone_password to Class[Glance::Api]" what it means??? how to deploy undercloud from master??? | 20:04 |
| *** jcoufal_ has quit IRC | 20:09 | |
| EmilienM | the press enter bug is pretty interesting :) | 20:09 |
| EmilienM | andrey-mp: press enter | 20:09 |
| andrey-mp | EmilienM: yeah, I did it. but I faced with nex bug ) | 20:10 |
| trown | second one I have not seen | 20:11 |
| andrey-mp | i filed it - https://bugs.launchpad.net/tripleo/+bug/1625796 | 20:11 |
| openstack | Launchpad bug 1625796 in tripleo "Can't install undercloud on centos7 from master" [Undecided,New] | 20:11 |
| mwhahaha | sounds like old puppet modules | 20:12 |
| sshnaidm|afk | andrey-mp, there is bug about it | 20:12 |
| mwhahaha | cause keystone_password is not required anymore | 20:12 |
| andrey-mp | sshnaidm|afk - good news ) | 20:13 |
| mwhahaha | the requirement was moved to glance::keystone::authtoken | 20:13 |
| andrey-mp | mwhahaha: I do not control puppets, right? | 20:14 |
| mwhahaha | depends on how you installed it | 20:14 |
| andrey-mp | mwhahaha: i must enable latest repos and run undercloud install? | 20:14 |
| mwhahaha | yea | 20:14 |
| andrey-mp | mwhahaha: from this doc - http://docs.openstack.org/developer/tripleo-docs/installation/installation.html#installing-the-undercloud | 20:14 |
| mwhahaha | https://gist.github.com/mwhahaha/129f84aad007a5ea50000eb5a34fb0ca#file-ovb-undercloud-basics-sh-L3-L18 | 20:15 |
| *** lucasagomes is now known as lucas-afk | 20:15 | |
| openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Ensure that the default plan was created successfully https://review.openstack.org/373446 | 20:15 |
| openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Verify that the Deployment Plan creation was successful https://review.openstack.org/369247 | 20:15 |
| mwhahaha | in a condensed form -^ | 20:15 |
| *** jprovazn has quit IRC | 20:16 | |
| andrey-mp | mwhahaha: i have similar script but without enabling puppet source and ceph | 20:16 |
| mwhahaha | sure, adjust as necessary, but make sure you're repos are correct and you installed the priorities plugin | 20:17 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: certmonger: improve orchestration for puppet4 https://review.openstack.org/373513 | 20:17 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 20:18 |
| *** Goneri has quit IRC | 20:18 | |
| *** mah has quit IRC | 20:19 | |
| andrey-mp | mwhahaha: thanks, will try this | 20:19 |
| openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Ensure that the default plan was created successfully https://review.openstack.org/373446 | 20:20 |
| openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Verify that the Deployment Plan creation was successful https://review.openstack.org/369247 | 20:20 |
| EmilienM | dprince: I reproduced mwhahaha's bug | 20:21 |
| sshnaidm|afk | andrey-mp, https://bugs.launchpad.net/tripleo/+bug/1621524 | 20:22 |
| openstack | Launchpad bug 1619274 in tripleo "duplicate for #1621524 openstack complete triggers password prompt" [High,In progress] - Assigned to James Slagle (james-slagle) | 20:22 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fix the default plan creation https://review.openstack.org/371347 | 20:22 |
| andrey-mp | also I have another question - I've tried to install Mitaka version. undercloud installed ok. then I tried to install overcloud with three controllers - and all controllers failed. all had error from *-manage modules. for example cinder-manage couldn't create some table with error 'column already exists'. looks like that each controller tried to create DB for all services. when I'm wrong? | 20:22 |
| dprince | EmilienM: okay, using the latest python-tripleoclient? | 20:22 |
| EmilienM | let me check | 20:22 |
| dprince | EmilienM: with shardy's "Always use absolute path for tht_root" fix... | 20:23 |
| EmilienM | 5.1.1-0.20160920182455.7833303.el7.centos | 20:23 |
| EmilienM | let me see | 20:23 |
| EmilienM | let's see in code | 20:23 |
| *** Ryjedo has quit IRC | 20:24 | |
| trown | I dont see 7833303 as a short sha in tripleoclient repo | 20:24 |
| EmilienM | dprince: without | 20:24 |
| EmilienM | let me checkout | 20:24 |
| trown | oh because it is only on stable/newton | 20:25 |
| EmilienM | I'm using delorean-current | 20:25 |
| trown | so that tripleoclient is from stable/newton branch | 20:25 |
| EmilienM | his patch was backported or not yet | 20:25 |
| trown | https://github.com/openstack/python-tripleoclient/commit/783330304700e82e8e3ab4f48bc0cb0740b1e8ec | 20:25 |
| trown | right | 20:25 |
| *** Ryjedo has joined #tripleo | 20:26 | |
| trown | just saying the version you gave points to it being built from that commit ^ | 20:26 |
| EmilienM | https://review.openstack.org/#/c/373487/ | 20:26 |
| EmilienM | not yet | 20:26 |
| trown | which is a merge commit on stable/newton | 20:26 |
| EmilienM | right | 20:26 |
| EmilienM | so I approved the backport | 20:26 |
| EmilienM | and now testing it again on my box | 20:26 |
| EmilienM | trown: using quickstart this time fyi | 20:26 |
| EmilienM | works pretty well | 20:26 |
| trown | EmilienM: how did you run it? | 20:27 |
| EmilienM | trown: bash quickstart.sh --release master-tripleo-ci -T all $VIRTHOST | 20:27 |
| EmilienM | I'm a very simple guy | 20:27 |
| trown | nice, so using the master-tripleo-ci mode | 20:28 |
| EmilienM | yeah | 20:28 |
| trown | I think that is pretty key to reproducing tripleo-ci | 20:28 |
| EmilienM | now having another trace http://paste.openstack.org/show/582314/ | 20:28 |
| *** myoung is now known as myoung|bbl | 20:28 | |
| EmilienM | swift list overcloud doesn't show up the overcloud.yaml | 20:29 |
| EmilienM | dprince: ^ | 20:29 |
| EmilienM | maybe I need to destroy the plan before | 20:29 |
| trown | we probably need a `openstack overcloud delete` command now... there are more steps than just `openstack stack delete overcloud` | 20:30 |
| EmilienM | no, I had to run: | 20:30 |
| EmilienM | openstack overcloud plan delete overcloud | 20:30 |
| EmilienM | mhh I have the same error as initially with the wrong generation | 20:31 |
| EmilienM | should I remove something in the swift containers? | 20:34 |
| *** andrey-mp has left #tripleo | 20:36 | |
| slagle | try a swift delete overcloud | 20:41 |
| slagle | saw d0ugal mention yesterday that it might be required | 20:41 |
| *** jayg is now known as jayg|g0n3 | 20:43 | |
| bnemec | Merge please? https://review.openstack.org/#/c/371115 | 20:45 |
| dprince | bnemec: +A | 20:48 |
| slagle | you actually want to test image building with tripleoclient? :) | 20:48 |
| bnemec | dprince: | 20:48 |
| bnemec | dprince: Thanks | 20:49 |
| bnemec | Take it easy, enter key. | 20:49 |
| bnemec | slagle: Crazy, right? :-) | 20:49 |
| *** dprince has quit IRC | 20:49 | |
| *** egafford has quit IRC | 20:50 | |
| *** oneswig has joined #tripleo | 20:56 | |
| *** yolanda has joined #tripleo | 20:58 | |
| *** gfidente has quit IRC | 21:05 | |
| *** ccamacho has quit IRC | 21:06 | |
| *** dsariel has joined #tripleo | 21:06 | |
| EmilienM | slagle: thanks | 21:06 |
| EmilienM | let's try again | 21:07 |
| *** lblanchard has quit IRC | 21:08 | |
| EmilienM | I see HA jobs failing more often than the last 3 days | 21:08 |
| EmilienM | lot of timeouts on overcloud with heat engine consumming memory | 21:08 |
| EmilienM | have you noticed the same? | 21:08 |
| slagle | no | 21:13 |
| slagle | link? | 21:13 |
| *** mburns_mtg is now known as mburned_out | 21:14 | |
| *** jeckersb is now known as jeckersb_gone | 21:20 | |
| *** yamahata has joined #tripleo | 21:28 | |
| EmilienM | slagle: yes give me asec | 21:32 |
| EmilienM | slagle: http://logs.openstack.org/34/372734/5/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/93e9821/logs/postci.txt.gz#_2016-09-20_18_51_22_000 | 21:32 |
| EmilienM | Service[heat-engine]: Could not evaluate: Cannot allocate memory - fork | 21:32 |
| stevebaker | EmilienM, slagle: is there a bug for swiftclent logging its 404s at the start of overcloud deploy? | 21:33 |
| openstackgerrit | Merged openstack/python-tripleoclient: Always use absolute path for tht_root https://review.openstack.org/373487 | 21:34 |
| EmilienM | stevebaker: not afik | 21:34 |
| EmilienM | but I probably missed it | 21:34 |
| EmilienM | maybe in https://launchpad.net/tripleo/+milestone/newton-rc2 | 21:34 |
| EmilienM | stevebaker: good morning! | 21:34 |
| stevebaker | EmilienM: good afternoon! | 21:34 |
| *** panda is now known as panda|Zz | 21:35 | |
| *** cwolferh has quit IRC | 21:38 | |
| *** akshai has quit IRC | 21:39 | |
| slagle | i don't see one | 21:39 |
| stevebaker | I'll raise one, I fixed something similar in heat | 21:39 |
| bnemec | stevebaker: That was definitely a recent problem. I don't know if it's fixed in newer versions of the client. | 21:40 |
| bnemec | There was also an issue doing tripleoclient builds until lately, so even if we merged a fix it may not have gotten into the dlrn repos. | 21:40 |
| stevebaker | bnemec: this is what I did https://review.openstack.org/#/c/347111/ | 21:41 |
| *** dsariel has quit IRC | 21:44 | |
| *** dtrainor has quit IRC | 21:51 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Convert $step to an integer https://review.openstack.org/373541 | 21:54 |
| *** fultonj has quit IRC | 21:54 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 21:55 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Don't use cached images in tripleoclient changes https://review.openstack.org/371115 | 22:00 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Convert $step to an integer https://review.openstack.org/373541 | 22:03 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 22:03 |
| *** oneswig has quit IRC | 22:07 | |
| *** bfournie has quit IRC | 22:09 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Set Neutron's metadata_ip to the nova metadata VIP https://review.openstack.org/373544 | 22:13 |
| *** cwolferh has joined #tripleo | 22:17 | |
| *** cdearborn has quit IRC | 22:21 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: add tempest back into the quickstart-extras workflow https://review.openstack.org/372748 | 22:28 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: RabbitMQ threads should be configured dynamically https://review.openstack.org/373027 | 22:40 |
| openstackgerrit | Merged openstack/puppet-tripleo: Fixup manila-cephfs native backend defaults https://review.openstack.org/366760 | 22:42 |
| *** Guest38034 has quit IRC | 22:51 | |
| *** Guest38034 has joined #tripleo | 23:01 | |
| openstackgerrit | Merged openstack/python-tripleoclient: Update the Mistral action names https://review.openstack.org/366519 | 23:03 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Remove support for legacy rh1 https://review.openstack.org/347918 | 23:03 |
| openstackgerrit | Merged openstack/diskimage-builder: Document source glean installs in simple-init https://review.openstack.org/364568 | 23:05 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart: DONT MERGE: POC: new devmode https://review.openstack.org/362000 | 23:09 |
| *** limao has quit IRC | 23:09 | |
| *** pmannidi has joined #tripleo | 23:09 | |
| *** TSCHAK_ has joined #tripleo | 23:09 | |
| *** TSCHAK has quit IRC | 23:12 | |
| *** TSCHAK has joined #tripleo | 23:20 | |
| *** TSCHAK_ has quit IRC | 23:22 | |
| *** Goneri has joined #tripleo | 23:33 | |
| *** rdopiera has quit IRC | 23:35 | |
| openstackgerrit | Merged openstack/diskimage-builder: don't configure 'lo' for dhcp https://review.openstack.org/367527 | 23:37 |
| *** rdopiera has joined #tripleo | 23:37 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 23:41 |
| *** mburned_out is now known as mburns_mtg | 23:41 | |
| *** yamahata has quit IRC | 23:42 | |
| *** noslzzp has quit IRC | 23:43 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Add IPv6 network configuration for ipv6 job types https://review.openstack.org/363674 | 23:46 |
| *** Goneri has quit IRC | 23:52 | |
| *** rajinir has quit IRC | 23:55 | |
| *** dmacpher has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
