| *** pblaho has joined #tripleo | 00:06 | |
| *** dtantsur has joined #tripleo | 00:06 | |
| *** penick has quit IRC | 00:07 | |
| *** pcaruana has joined #tripleo | 00:08 | |
| *** rajinir has quit IRC | 00:15 | |
| *** pgadiya has quit IRC | 00:22 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Specify the Ceph packages to be installed https://review.openstack.org/382132 | 00:26 |
|---|---|---|
| *** dmacpher has quit IRC | 00:26 | |
| *** yamahata has quit IRC | 00:28 | |
| *** gfidente has quit IRC | 00:30 | |
| *** penick has joined #tripleo | 00:32 | |
| *** yamahata has joined #tripleo | 00:37 | |
| *** penick has quit IRC | 00:46 | |
| *** weshay is now known as weshay_audi_5k | 00:47 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 00:48 |
| openstackgerrit | Dan Sneddon proposed openstack/os-net-config: Add NIC Mapping Reporting Feature https://review.openstack.org/383516 | 01:00 |
| *** jcoufal has quit IRC | 01:09 | |
| *** jcoufal has joined #tripleo | 01:10 | |
| *** bfournie has joined #tripleo | 01:11 | |
| *** saneax is now known as saneax-_-|AFK | 01:14 | |
| *** jcoufal has quit IRC | 01:21 | |
| *** dmacpher has joined #tripleo | 01:22 | |
| *** akshai has joined #tripleo | 01:23 | |
| *** jcoufal has joined #tripleo | 01:25 | |
| *** akshai_ has joined #tripleo | 01:26 | |
| *** akshai has quit IRC | 01:29 | |
| *** tiswanso has joined #tripleo | 01:33 | |
| *** jcoufal has quit IRC | 01:33 | |
| *** jcoufal has joined #tripleo | 01:34 | |
| *** mbozhenko has joined #tripleo | 01:42 | |
| *** jcoufal has quit IRC | 01:46 | |
| *** mbozhenko has quit IRC | 01:47 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Add Select per-network hostnames for service_node_names to role.role.j2.yaml https://review.openstack.org/383521 | 01:47 |
| slagle | EmilienM: you can remove your -2 from this one now: https://review.openstack.org/#/c/382973/ | 01:50 |
| *** nyechiel_ has joined #tripleo | 01:50 | |
| *** ayoung has quit IRC | 01:52 | |
| *** bana_k has joined #tripleo | 01:53 | |
| *** ayoung has joined #tripleo | 01:55 | |
| *** jcoufal has joined #tripleo | 01:55 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 01:55 |
| *** jcoufal has quit IRC | 02:00 | |
| *** limao has joined #tripleo | 02:06 | |
| *** limao has quit IRC | 02:09 | |
| *** limao has joined #tripleo | 02:09 | |
| *** limao_ has quit IRC | 02:09 | |
| EmilienM | slagle: ok | 02:10 |
| EmilienM | slagle: +A | 02:10 |
| *** bana_k has quit IRC | 02:11 | |
| EmilienM | slagle: can you review https://review.openstack.org/#/c/382386/ please? | 02:12 |
| *** limao_ has joined #tripleo | 02:17 | |
| *** limao has quit IRC | 02:19 | |
| *** limao_ has quit IRC | 02:30 | |
| *** limao has joined #tripleo | 02:30 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: restore missing fluentd client functionality https://review.openstack.org/382930 | 02:33 |
| *** ramishra_ has quit IRC | 02:35 | |
| *** limao has quit IRC | 02:35 | |
| *** limao has joined #tripleo | 02:36 | |
| *** apetrich has quit IRC | 02:37 | |
| *** apetrich has joined #tripleo | 02:38 | |
| *** mbozhenko has joined #tripleo | 02:42 | |
| *** mbozhenko has quit IRC | 02:46 | |
| *** yamahata has quit IRC | 02:54 | |
| *** rlandy has quit IRC | 03:04 | |
| *** jeckersb is now known as jeckersb_gone | 03:11 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates: GATE TEST, please ignore https://review.openstack.org/365449 | 03:30 |
| *** kberger has quit IRC | 03:41 | |
| *** nyechiel_ has quit IRC | 03:41 | |
| openstackgerrit | Merged openstack/tripleo-common: Add the J2 exclude file exception (When file not found) https://review.openstack.org/382973 | 03:45 |
| openstackgerrit | Merged openstack/puppet-tripleo: Enable usage of "short names" for Ceph cluster https://review.openstack.org/382885 | 03:45 |
| *** ipsecguy_ has joined #tripleo | 03:51 | |
| *** ipsecguy has quit IRC | 03:52 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Add aodh profile rspec testing https://review.openstack.org/374402 | 04:04 |
| openstackgerrit | Merged openstack/diskimage-builder: Add bugs link to docs https://review.openstack.org/383488 | 04:06 |
| openstackgerrit | Merged openstack/diskimage-builder: Add low-hanging-fruit bug tag to docs https://review.openstack.org/383489 | 04:07 |
| *** akshai_ has quit IRC | 04:11 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Use globaltoc in docs for sidebar https://review.openstack.org/383457 | 04:13 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Remove copyright from docs / toc https://review.openstack.org/383459 | 04:13 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Fix developer guide TOC https://review.openstack.org/383454 | 04:13 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Rename devloper documentation to developer guide https://review.openstack.org/383461 | 04:15 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Use globaltoc in docs for sidebar https://review.openstack.org/383457 | 04:15 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Remove copyright from docs / toc https://review.openstack.org/383459 | 04:15 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Fix developer guide TOC https://review.openstack.org/383454 | 04:15 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Fix formatting for supported distros in docs https://review.openstack.org/383464 | 04:20 |
| *** tzumainn has quit IRC | 04:23 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Add ceilometer profile rspec testing https://review.openstack.org/380406 | 04:49 |
| openstackgerrit | Merged openstack/puppet-tripleo: Add ceph profile rspec testing https://review.openstack.org/382603 | 04:50 |
| openstackgerrit | Merged openstack/diskimage-builder: Fix formatting for supported distros in docs https://review.openstack.org/383464 | 05:00 |
| openstackgerrit | Merged openstack/diskimage-builder: Fix developer guide TOC https://review.openstack.org/383454 | 05:00 |
| openstackgerrit | Merged openstack/diskimage-builder: Use globaltoc in docs for sidebar https://review.openstack.org/383457 | 05:00 |
| *** limao_ has joined #tripleo | 05:01 | |
| openstackgerrit | Merged openstack/diskimage-builder: Remove copyright from docs / toc https://review.openstack.org/383459 | 05:01 |
| openstackgerrit | Merged openstack/diskimage-builder: Rename devloper documentation to developer guide https://review.openstack.org/383461 | 05:02 |
| *** limao has quit IRC | 05:04 | |
| *** nyechiel_ has joined #tripleo | 05:08 | |
| *** jaosorior has joined #tripleo | 05:13 | |
| *** limao has joined #tripleo | 05:22 | |
| *** limao_ has quit IRC | 05:24 | |
| *** nyechiel_ has quit IRC | 05:28 | |
| *** yamahata has joined #tripleo | 05:28 | |
| *** saneax-_-|AFK is now known as saneax | 05:28 | |
| *** mbozhenko has joined #tripleo | 05:38 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Select per-network hostnames for service_node_names https://review.openstack.org/382886 | 05:43 |
| *** numans has joined #tripleo | 05:44 | |
| *** limao_ has joined #tripleo | 05:44 | |
| *** limao has quit IRC | 05:45 | |
| *** coolsvap has joined #tripleo | 05:55 | |
| *** TSCHAK has quit IRC | 05:57 | |
| *** TSCHAK_ has quit IRC | 05:57 | |
| *** TSCHAK has joined #tripleo | 05:57 | |
| *** limao_ has quit IRC | 06:05 | |
| *** mbozhenko has quit IRC | 06:05 | |
| *** limao has joined #tripleo | 06:05 | |
| openstackgerrit | Dan Sneddon proposed openstack/os-net-config: Add NIC Mapping Reporting Feature https://review.openstack.org/383516 | 06:15 |
| *** rasca has joined #tripleo | 06:24 | |
| *** limao has quit IRC | 06:26 | |
| *** limao has joined #tripleo | 06:26 | |
| *** aufi has joined #tripleo | 06:28 | |
| *** paramite has joined #tripleo | 06:39 | |
| *** mcornea has joined #tripleo | 06:40 | |
| *** dmacpher has quit IRC | 06:42 | |
| *** limao has quit IRC | 06:46 | |
| *** limao has joined #tripleo | 06:46 | |
| jaosorior | easy review if anybody has time :D https://review.openstack.org/#/c/382769/ | 06:48 |
| *** mbozhenko has joined #tripleo | 06:48 | |
| matbu | jaosorior: /me looks (like easy review :)) | 06:50 |
| *** rcernin has joined #tripleo | 06:51 | |
| jaosorior | matbu: thanks for the review | 06:53 |
| *** cylopez has joined #tripleo | 06:54 | |
| *** limao_ has joined #tripleo | 06:56 | |
| *** tremble has joined #tripleo | 06:57 | |
| matbu | de nada | 06:58 |
| *** ebarrera has joined #tripleo | 06:59 | |
| *** limao has quit IRC | 07:00 | |
| *** limao_ has quit IRC | 07:01 | |
| *** limao has joined #tripleo | 07:01 | |
| *** tesseract- has joined #tripleo | 07:03 | |
| *** shardy has joined #tripleo | 07:04 | |
| *** ohamada has joined #tripleo | 07:05 | |
| matbu | shardy: i'll test your update (i'm redeploying right now) | 07:06 |
| shardy | matbu: Hey, it's not quite ready for testing tbh, I'm planning to take a final pass at it this morning | 07:07 |
| matbu | shardy: yep no worries; | 07:08 |
| shardy | I need to reinstate your logic for rewriting the environment path prefix to the tmpdir, but also implement some additional logic that rewrites the environment file *contents* so we fix bug #1625783 | 07:08 |
| openstack | bug 1625783 in tripleo "unable to leverage swap-partition extraconfig" [High,In progress] https://launchpad.net/bugs/1625783 - Assigned to Steven Hardy (shardy) | 07:08 |
| matbu | shardy: i saw you remove the catch execption into the validate_args, it was for catching the missing resource registry (which is a j2 not rendered) | 07:08 |
| shardy | matbu: It may be best to split it into two patches, I'll try to get the first one ready for testing in the next couple of hours | 07:08 |
| *** fzdarsky|afk has joined #tripleo | 07:09 | |
| shardy | matbu: Yeah I think I misunderstood your intent there, and thinking about it last night realized some of that logic needs to go back, apologies | 07:09 |
| matbu | shardy: no pb :) | 07:10 |
| shardy | I was somewhat focussed on the bug #1625783 problem, but subsequently realized that won't completely fix the rendered env file issue | 07:10 |
| openstack | bug 1625783 in tripleo "unable to leverage swap-partition extraconfig" [High,In progress] https://launchpad.net/bugs/1625783 - Assigned to Steven Hardy (shardy) | 07:10 |
| *** ccamacho has joined #tripleo | 07:10 | |
| *** fzdarsky|afk is now known as fzdarsky | 07:10 | |
| matbu | yep i think it would need some additional UT, i was (and i'm) a bit afraid of landing a such review | 07:10 |
| shardy | Yeah, I'm hoping we can get it working locally and in CI this morning, then we can follow up with patches adding more unit tests | 07:11 |
| shardy | I think we need a CI test which uses various combinations of environment files too | 07:12 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart: Stop using deprecated network range https://review.openstack.org/343443 | 07:12 |
| matbu | cause in our dev cases, it could just work fine, but in some paritcular customer cases it could bring some weird behaviors | 07:12 |
| *** pmannidi_ has quit IRC | 07:12 | |
| matbu | shardy: yep agree | 07:12 |
| shardy | Yeah we need a matrix defining all the corner cases I think, and there are a few I've been testing locally already | 07:12 |
| *** jprovazn has joined #tripleo | 07:13 | |
| shardy | a particularly bad one is when you have a single environment file with both relative and absolute paths, and the absolute path references something in the tmpdir (e.g a j2 rendered file) | 07:13 |
| matbu | yes | 07:13 |
| shardy | I think I know how to solve that now, but need another coffee before trying to code it ;) | 07:13 |
| matbu | lol | 07:13 |
| ccamacho | morning | 07:15 |
| jaosorior | ccamacho: sup dude | 07:15 |
| *** limao_ has joined #tripleo | 07:16 | |
| *** pgadiya has joined #tripleo | 07:16 | |
| *** yamahata has quit IRC | 07:18 | |
| *** limao has quit IRC | 07:19 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Add the KeystoneCredential0 and KeystoneCredential1 parameters https://review.openstack.org/383564 | 07:20 |
| *** limao_ has quit IRC | 07:20 | |
| *** jlinkes has joined #tripleo | 07:21 | |
| *** limao has joined #tripleo | 07:21 | |
| *** jpena|off is now known as jpena | 07:21 | |
| ccamacho | jaosorior its Friday man :) hey quick question, this backport didn't got merged before newton GA (https://review.openstack.org/#/c/383521/) "Add Select per-network hostnames for service_node_names to role.role.j2.yaml" :( Do we still have time to have it in Newton? | 07:21 |
| jaosorior | ccamacho: I have no clue. shardy ^^ ? | 07:21 |
| shardy | ccamacho, jaosorior: Yes I believe EmilienM is planning to propose the final tag later today | 07:22 |
| shardy | even if it doesn't land before then, it can be backported then we'll tag a stable release | 07:22 |
| *** panda|off is now known as panda | 07:22 | |
| ccamacho | yeeeeeei!!!! :) thats awesome then | 07:23 |
| *** fzdarsky is now known as fzdarsky|afk | 07:23 | |
| jaosorior | shardy: regarding this patch https://review.openstack.org/#/c/382769/ I wasn't really planning to have in in newton. It would be useful to have. But it doesn't really solve a bug or anything | 07:23 |
| jaosorior | well, maybe a usability bug | 07:24 |
| jaosorior | but that's it | 07:24 |
| ccamacho | shardy we got into newton all the patches for composable roles (pending that backport) :) | 07:24 |
| d0ugal | jaosorior: BUG: Cloud names is missing from hosts output | 07:24 |
| d0ugal | jaosorior: it is all about wording ;) | 07:24 |
| jaosorior | d0ugal: interesting... | 07:24 |
| jaosorior | eeeh, fuck it, I'll file a bug :P | 07:24 |
| ccamacho | BUG: <submission_title> | 07:24 |
| ccamacho | yeah! | 07:25 |
| d0ugal | ccamacho: lol | 07:25 |
| ccamacho | shardy applying the all the submissions from the bug https://paste.fedoraproject.org/444864/47576058/ | 07:27 |
| ccamacho | "Custom role requires manual environment/files" | 07:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add cloud names to hosts output https://review.openstack.org/382769 | 07:28 |
| jaosorior | panda: did bnemec still have the key for the CA? | 07:28 |
| *** Guest21331 has quit IRC | 07:28 | |
| *** Guest21331 has joined #tripleo | 07:28 | |
| *** Guest21331 is now known as assassin | 07:28 | |
| jaosorior | * CA cert | 07:29 |
| *** akuznetsov has joined #tripleo | 07:29 | |
| *** chem has joined #tripleo | 07:30 | |
| ccamacho | any expert here about android partitioning??, I bricked my phone yesterday playing with fdisk and f2fs ;( | 07:30 |
| jaosorior | ccamacho, d0ugal, shardy alright, submitted the patch with a bug link https://review.openstack.org/382769 | 07:30 |
| *** zoli_gone-proxy is now known as zoliXXL | 07:31 | |
| panda | jaosorior: didn't ask, still trying to make it work, I had to put a PublicVirtualFixedIP but apparently no networks are in the same range on the one I need and this happens http://logs.openstack.org/15/382515/5/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/9d0b469/console.html#_2016-10-06_17_20_49_360750 | 07:32 |
| jaosorior | panda: what's the patch? | 07:33 |
| d0ugal | shardy: if you have a moment, do you have any ideas about this? https://bugs.launchpad.net/tripleo/+bug/1631279 | 07:35 |
| openstack | Launchpad bug 1631279 in tripleo "SnmpdReadonlyUserPassword isn't set by the Mistral workflow" [High,Confirmed] | 07:35 |
| panda | jaosorior: https://review.openstack.org/382515 | 07:36 |
| openstackgerrit | Dan Sneddon proposed openstack/os-net-config: Add NIC Mapping Reporting Feature https://review.openstack.org/383516 | 07:36 |
| *** amoralej|off is now known as amoralej | 07:38 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add the workflow name to the starting workflow message https://review.openstack.org/375331 | 07:41 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Save the result of direct action calls in Mistral https://review.openstack.org/381739 | 07:42 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add the workflow name to the starting workflow message https://review.openstack.org/375331 | 07:42 |
| jaosorior | panda: that's weird. Lets try to only deploy netiso_v4 in nonha, and see how that turns out. | 07:43 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: testing netiso in nonha job https://review.openstack.org/383570 | 07:43 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Save the result of direct action calls in Mistral https://review.openstack.org/382775 | 07:43 |
| jaosorior | panda: it makes no sense that it fails though, since the default range is 10.0.0.0/24 | 07:44 |
| jaosorior | panda: unless we're overriding that default somewhere | 07:45 |
| jaosorior | crap, my commit won't work anyway | 07:47 |
| panda | jaosorior: without changing the PublicVirtualFixedIP, it assigns a variable ip on the 10.0.0.0/24 range | 07:47 |
| jaosorior | panda: yeah, that makes sense | 07:48 |
| *** jpich has joined #tripleo | 07:48 | |
| jaosorior | panda: https://review.openstack.org/#/c/382515/5/test-environments/network-templates/network-isolation.yaml | 07:50 |
| *** athomas has joined #tripleo | 07:51 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Re-enable ManageFirewall by default. https://review.openstack.org/383448 | 07:51 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Enable firewalling by default on compute nodes https://review.openstack.org/383477 | 07:51 |
| shardy | d0ugal: I think dprince pretty much covered it? Either we need to make the hieradata file readable via the mistral user (e.g using permissions or perhaps an ACL), or we need to write the same data to another config file which can be read by the mistral action. | 07:52 |
| panda | jaosorior: mh, I'll give it a try, but I would have expected a different error if the variable was in a incorrect format | 07:52 |
| d0ugal | shardy: okay, cool - just wanted a second opinion | 07:52 |
| d0ugal | shardy: I have no idea where or how to do any of that, so it will take some digging. Any idea where I should start? | 07:53 |
| jaosorior | panda: so that's one. And the other thing is that, ControlVirtualIP is meant for the control plane network as far as I can understand | 07:53 |
| jaosorior | panda: so you don't wanna set that one | 07:53 |
| jaosorior | panda: that's why it was giving that error that it's not in the range. It's a different network and not the one you want | 07:54 |
| d0ugal | shardy: looks like maybe I can do it all in instack_undercloud. | 07:54 |
| jaosorior | panda: It seems that the ControlFixedIPs was set for the nonha job since it is not using network isolation. So it relies on the IPs being the same. | 07:56 |
| panda | jaosorior: ah, makes sense | 07:56 |
| *** milan has joined #tripleo | 07:58 | |
| shardy | d0ugal: Here's one way to do it just using file permissions | 08:03 |
| shardy | http://paste.openstack.org/show/584774/ | 08:03 |
| shardy | I used the stack user for testing, but you can do the same for the mistral user | 08:03 |
| shardy | basically break out the hieradata into a file which you chmod/chown to allow access | 08:04 |
| shardy | then add that to the hierarchy (above the files the user can't access) | 08:04 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: [WIP] Add IPv6 coverage using existing jobs https://review.openstack.org/382515 | 08:04 |
| shardy | http://paste.openstack.org/show/584775/ | 08:04 |
| shardy | d0ugal: ^^ | 08:05 |
| * d0ugal attempts to grok this | 08:05 | |
| shardy | that shows the file access, I removed snmp* from puppet-stack-config.yaml and put it in another file | 08:05 |
| *** spredzy has quit IRC | 08:06 | |
| *** mkudlej has joined #tripleo | 08:06 | |
| *** mkudlej has left #tripleo | 08:06 | |
| d0ugal | shardy: I think you've lost me a bit, but still reading it | 08:06 |
| shardy | d0ugal: try it locally, then you'll get it | 08:07 |
| d0ugal | k | 08:07 |
| shardy | all I did was copy two lines from puppet-stack-config.yaml into snmp_data.yaml | 08:07 |
| shardy | added snmp_data to the hierarchy in hiera.yaml | 08:07 |
| shardy | then chown'd /etc/puppet/hieradata and /etc/puppet/hieradata/snmp_data.yaml | 08:08 |
| shardy | then chmod 640 /etc/puppet/hieradata/snmp_data.yaml | 08:08 |
| shardy | it's crude but I think it does what you need | 08:08 |
| *** ramishra has joined #tripleo | 08:10 | |
| d0ugal | shardy: Right, I think I getting there. | 08:10 |
| d0ugal | shardy: Where would you actually make this change tho'? | 08:11 |
| d0ugal | I guess this is managed in puppet? | 08:11 |
| *** akuznetsov has quit IRC | 08:11 | |
| shardy | d0ugal: instack-undercloud, so yeah have puppet configure things like this | 08:11 |
| shardy | and possibly modify the element that creates puppet-stack-config.yaml to create the extra file | 08:11 |
| d0ugal | shardy: k, thanks, I'll give this a go. | 08:12 |
| shardy | https://github.com/openstack/instack-undercloud/blob/master/elements/undercloud-install/os-refresh-config/post-configure.d/98-undercloud-setup | 08:12 |
| shardy | d0ugal: if you wanted a quick hacky place to try it, you could just add it into that script | 08:12 |
| shardy | But the proper way is probably to modify puppet-stack-config: | 08:13 |
| shardy | https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/install.d/02-puppet-stack-config | 08:13 |
| shardy | that creates the files and permissions | 08:14 |
| d0ugal | shardy: great, thanks! | 08:14 |
| *** gfidente has joined #tripleo | 08:19 | |
| *** gfidente has quit IRC | 08:19 | |
| *** gfidente has joined #tripleo | 08:19 | |
| *** b00tcat has joined #tripleo | 08:23 | |
| *** athomas has quit IRC | 08:31 | |
| marios | shardy: morning o/ I saw https://review.openstack.org/#/c/383188 thanks for doing that must have been late for you! | 08:33 |
| marios | shardy: i guess this is the first time we tried to get to the new hiera so early in the workflow | 08:33 |
| shardy | marios: np, yeah I think it's a race we've not encountered before | 08:33 |
| marios | shardy: should I file a bug for that, or do you think we can track as part of https://bugs.launchpad.net/tripleo/+bug/1631297 | 08:33 |
| openstack | Launchpad bug 1631297 in tripleo "Mitaka to Newton Ceilometer migration to apache wsgi" [High,In progress] - Assigned to Pradeep Kilambi (pkilambi) | 08:33 |
| shardy | marios: Yeah, I don't mind but if you can decide a suitable bug ref and update the commit message that would be great | 08:34 |
| marios | shardy: ack will do thanks | 08:34 |
| shardy | sounds like Partial-Bug: #1631297 will be fine | 08:34 |
| marios | shardy: yeah i think so too... at least it is tracked somewhere and the context of the discussion from the ceilometer migration review on that bug seems relevant/appropriate | 08:35 |
| marios | as that is where it came up | 08:35 |
| *** eglynn has joined #tripleo | 08:37 | |
| *** limao_ has joined #tripleo | 08:37 | |
| eglynn | shardy, EmilienM: quick process question ... to what extent does the tripleO project follow the specs process? | 08:38 |
| eglynn | (i.e. where's the rough threshold for complexity/intrusiveness that makes a thing require a specs review?) | 08:38 |
| eglynn | https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:merged feels a little light compared to other projects that follows the specs process more strictly | 08:39 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Serialize AllNodesDeployment and UpdateWorkflow https://review.openstack.org/383188 | 08:39 |
| eglynn | so I'm guessing it's somewhat optional, or decided on a case-by-case basis | 08:40 |
| shardy | eglynn: Yes, I'd say we've become somewhat lax on specs because a lot of more complex ones got constantly bogged down in implementation related discussion, vs defining the overall scope and direction | 08:40 |
| *** limao has quit IRC | 08:40 | |
| eglynn | shardy: cool, understood | 08:40 |
| shardy | so a lot of us just prototype things instead, then have a discussion to agree the direction | 08:40 |
| eglynn | (the specific piece(s) of work I've in mind is the libvirt-realtime enablement work that sven & owalsh will be working on for ocata) | 08:41 |
| shardy | eglynn: I'd say specs are still encouraged tho, particularly for interface impacting or complex stuff not well understood by the existing community (dpdk and sr-iov are good examples of this) | 08:41 |
| *** limao has joined #tripleo | 08:41 | |
| eglynn | i.e. exposing that pre-existing nova feature in TripleO so that hosts can be configure for RT out of the box in the deployment | 08:41 |
| shardy | eglynn: I'd say that's a good candidate for a spec as it's likely not familiar to a lot of folks who will end up reviewing the code | 08:42 |
| eglynn | yeah, the SR-IOV example makes me think the RT stuff is a good candidate for requiring a spec | 08:42 |
| eglynn | shardy: cool, thanks for the guidance on that! | 08:42 |
| shardy | so at least a simple spec framing the problem, and describing the nova pieces we have to wire in would be a good idea | 08:42 |
| eglynn | yep, agreed | 08:42 |
| *** ohamada has quit IRC | 08:44 | |
| *** nyechiel_ has joined #tripleo | 08:44 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/360004 | 08:44 |
| *** ohamada has joined #tripleo | 08:44 | |
| *** limao_ has quit IRC | 08:45 | |
| *** derekh has joined #tripleo | 08:45 | |
| ansiwen | shardy, eglynn: I think it's a good exercises anyway, given that me and presumably owelsh are not familiar with neither RT support nor tripleO yet. It might help to raise important questions earlier. | 08:48 |
| shardy | ansiwen: agreed, sounds like a good plan in this case | 08:48 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Save the result of direct action calls in Mistral https://review.openstack.org/381739 | 08:48 |
| *** mcornea has quit IRC | 08:49 | |
| *** mcornea has joined #tripleo | 08:49 | |
| *** nyechiel_ has quit IRC | 08:52 | |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 08:56 |
| shardy | matbu: ^^ That's working OK for me locally now for the bug #1624727 use-case | 08:58 |
| openstack | bug 1624727 in tripleo "Could not fetch contents for file:///home/stack/tripleo-heat-templates/puppet/post.yaml" [Critical,In progress] https://launchpad.net/bugs/1624727 - Assigned to Steven Hardy (shardy) | 08:58 |
| shardy | not fixed the unit tests yet, but would be good to get your view on that solution | 08:58 |
| matbu | shardy: ack | 08:58 |
| shardy | I left a FIXME for the bug #1625783 issue which I'll work on as a follow-up patch | 08:59 |
| openstack | bug 1625783 in tripleo "unable to leverage swap-partition extraconfig" [High,In progress] https://launchpad.net/bugs/1625783 - Assigned to Steven Hardy (shardy) | 08:59 |
| matbu | shardy: i failed to upgrade my undercloud :/ got a weird issue, duplicated nova-compute service | 08:59 |
| matbu | shardy: i can make a review for the other one with the registry | 08:59 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Add Select per-network hostnames for service_node_names to role.role.j2.yaml https://review.openstack.org/383521 | 09:04 |
| *** hewbrocca-afk is now known as hewbrocca | 09:10 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart: Add ability to deploy an overcloud with ssl https://review.openstack.org/382830 | 09:12 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 09:12 |
| shardy | pep8 fixes | 09:12 |
| *** fxpester has quit IRC | 09:15 | |
| *** ayoung has quit IRC | 09:17 | |
| *** mah has left #tripleo | 09:17 | |
| *** CaptTofu has quit IRC | 09:21 | |
| *** CaptTofu has joined #tripleo | 09:22 | |
| jaosorior | shardy, ccamacho can you guys check this out? https://review.openstack.org/#/c/382769/ | 09:27 |
| *** ayoung has joined #tripleo | 09:28 | |
| *** jlinkes_ has joined #tripleo | 09:28 | |
| *** jlinkes__ has joined #tripleo | 09:29 | |
| *** sshnaidm is now known as sshnaidm|away | 09:30 | |
| ccamacho | jaosorior sure, deploying it locally right now | 09:30 |
| *** tosky has joined #tripleo | 09:31 | |
| ccamacho | jaosorior, the patch is not rebased, I think it will fail CI as j2_excludes.yaml does not exist | 09:32 |
| ccamacho | "just to save some time" | 09:32 |
| *** jlinkes has quit IRC | 09:32 | |
| jaosorior | ccamacho: what do you mean? It just passed CI | 09:32 |
| *** kbyrne has quit IRC | 09:32 | |
| ccamacho | mmm | 09:32 |
| jaosorior | it's all green | 09:33 |
| ccamacho | ajajajaj :P no worries then | 09:33 |
| *** jlinkes_ has quit IRC | 09:33 | |
| *** jlinkes__ has quit IRC | 09:33 | |
| ccamacho | ill give you some feedback when my deployment is done | 09:33 |
| *** kbyrne has joined #tripleo | 09:34 | |
| shardy | jaosorior: can you please add more detail to the bug report - you're talking about adding an output in the bug, but the patch actually modifies the hosts files on the nodes? | 09:34 |
| *** jlinkes__ has joined #tripleo | 09:34 | |
| *** hjensas has joined #tripleo | 09:34 | |
| rook | Anhyone ever see a error like this? Oct 6 20:47:50 localhost os-collect-config: <ErrorResponse><Error><Message>The request processing has failed due to an internal error:Timed out waiting for a reply to message ID ed3a0334366348479a8fdcbf65b3a68e</Message><Code>InternalFailure</Code><Type>Server</Type></Error></ErrorResponse>+ rm /tmp/tmp.xZ5F0rDJNI | 09:35 |
| shardy | Also when you raise bugs, please target them to a milestone and set the importance | 09:35 |
| rook | anyone* | 09:35 |
| shardy | jaosorior: ^^ | 09:35 |
| *** jbadiapa has quit IRC | 09:36 | |
| shardy | rook: Yes, it can happen when a back end process (such as heat-engine) is overloaded and thus takes too long to repond to an RPC call | 09:36 |
| jaosorior | shardy: crap, that was the actual intent. | 09:36 |
| jaosorior | let me fix it then | 09:36 |
| shardy | rook: and/or the RPC timeout is set too low on a slow system | 09:36 |
| *** jaosorior has quit IRC | 09:37 | |
| shardy | I think we increased $all_the_timeouts a while back tho, so it's probably DoSing some service with a huge deploy? | 09:37 |
| *** jaosorior has joined #tripleo | 09:38 | |
| shardy | rook: can you share the os-collect-config.conf - or check it to see what collectors are enabled? | 09:39 |
| shardy | it looks like it failed either polling heat or swift (depending on how old the deployment is) | 09:40 |
| *** spredzy has joined #tripleo | 09:40 | |
| rook | shardy should be whatever newton is shipped with... | 09:41 |
| rook | i can try lowering the deploy count form 60 to 30 | 09:41 |
| jaosorior | ccamacho: nevermind dude. Gotta change the commit | 09:41 |
| jaosorior | I messed it up | 09:41 |
| jaosorior | :/ | 09:41 |
| jaosorior | ccamacho: did you try the stuff from the blog? | 09:41 |
| shardy | rook: Newton uses the "request" collector by default, which polls a swift tempurl | 09:42 |
| matbu | shardy: i got one issue, i comment the review | 09:42 |
| shardy | rook: so you can try to reproduce by copying the URL from /etc/os-collect-config.conf and using curl | 09:42 |
| ccamacho | jaosoriorm, yeahp I started yesterday but also in parallel testing the submissions that I have pushed, so I will finish that today :) | 09:42 |
| jaosorior | ccamacho: you will probably need the hosts entries | 09:43 |
| shardy | rook: it's possible we need to tune the swift config on the undercloud to cope with 60 nodes hitting the API at the same time? | 09:43 |
| ccamacho | jaosorior ack | 09:44 |
| jaosorior | ccamacho: you can workaround that by getting the hosts entries from the nodes though | 09:44 |
| *** jbadiapa has joined #tripleo | 09:44 | |
| shardy | matbu: ack, thanks, looking | 09:44 |
| rook | shardy: interesting did the swift change happen recently? | 09:44 |
| shardy | matbu: I pushed the pep8 fixes and working on fixing py27 tests now | 09:44 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add cloud names to hosts output https://review.openstack.org/382769 | 09:45 |
| rook | so the url is for the metadata | 09:45 |
| *** weshay_audi_5k is now known as weshay | 09:45 | |
| rook | 401 Unauthorized: Temp URL invalid | 09:45 |
| rook | maybe it goes away after it fails | 09:45 |
| rook | audi 5k? | 09:46 |
| shardy | rook: We switch to swift polling in Mitaka https://review.openstack.org/#/c/251157/ | 09:46 |
| shardy | rook: it works for me provided I enclose the URL in "" quotes | 09:46 |
| rook | interesting, I didn't remember bumping into this... however I don't think i ever tried 60 at a time... I typically keep with 20-30 | 09:46 |
| rook | ah, shardy that was the issue, needed "" | 09:47 |
| *** mbozhenko has quit IRC | 09:47 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Specify the Ceph packages to be installed https://review.openstack.org/383614 | 09:47 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 09:49 |
| shardy | matbu: ack, yeah you're right about the abspath issue, I've been testing with an absolute path locally, fixing | 09:49 |
| *** zoliXXL is now known as zoli|lunch | 09:50 | |
| matbu | shardy: yep, there is another stupidity that i was wondering about the path | 09:53 |
| matbu | shardy: if someone passed --templates tripleo-heat-templates -e /usr/share/openstack-tripleo-heat-templates/registry.yaml | 09:54 |
| shardy | we should start an etherpad with all the crazy corner cases related to environment passing, and use that as a basis for a CI test | 09:54 |
| matbu | shardy: yep right | 09:54 |
| shardy | matbu: Yeah, I'm not sure we can handle that case, perhaps we could validate against it tho | 09:54 |
| shardy | if anyone passes --templates foo, all environments should either be in foo/environments/ or some non tht path | 09:55 |
| matbu | shardy: yes , that make sense | 09:55 |
| shardy | so perhaps we should fail if we match the default tht when --templates overrides it | 09:55 |
| matbu | that's why i added the re.sub('*/') | 09:55 |
| matbu | but it's dangerous | 09:55 |
| shardy | yeah, I felt the exact startswith matching was safer, but open to using the regex if you prefer | 09:56 |
| jaosorior | ccamacho: if you have a deployment, can you test this one up? https://review.openstack.org/#/c/382769/3 | 10:03 |
| ccamacho | jaosorior, yeahp, the last one its about to finish | 10:04 |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-validations: Validate the instackenv format https://review.openstack.org/353956 | 10:04 |
| EmilienM | Good morning | 10:06 |
| jaosorior | EmilienM: sup dude, how's it going? | 10:07 |
| ccamacho | morning! | 10:07 |
| EmilienM | eglynn: sounds like shardy replied, let us know if we can help more | 10:08 |
| matbu | shardy: ha yep the comment from saravanan is nice, the missing of localenv break my env i guess :) | 10:08 |
| EmilienM | jaosorior: good | 10:08 |
| shardy | matbu: ack, yeah, fixing that and the abspath issue now | 10:09 |
| matbu | shardy: k cool thx | 10:09 |
| *** athomas has joined #tripleo | 10:11 | |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 10:13 |
| shardy | matbu: ^^ I think that fixes it | 10:13 |
| shardy | fixing the unit tests still WIP | 10:13 |
| *** mbozhenko has joined #tripleo | 10:13 | |
| matbu | shardy: ack, i'm going to lunch will make more tests after | 10:15 |
| jaosorior | panda: hey dude, the PublicFixedIPs variable you're defining in network-environment.yaml is not being passed to the stack | 10:20 |
| panda | jaosorior: something's not http://logs.openstack.org/15/382515/6/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/8462779/console.html#_2016-10-07_09_44_14_451727 :/ | 10:20 |
| jaosorior | that's why you got the 10.0.0.15 | 10:20 |
| panda | jaosorior: yep | 10:20 |
| jaosorior | panda: yeah, cause the public VIP is 10.0.0.15 and doesn't match the cert | 10:20 |
| jaosorior | panda: so, if you check the logs http://logs.openstack.org/15/382515/6/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/8462779/logs/postci.txt.gz#_2016-10-07_09_45_00_000 | 10:20 |
| jaosorior | panda: you'll see that that input is empty | 10:20 |
| panda | jaosorior: I think I know why. I heat templates, if two environment define parameter_defaults:, the two dicts are merged, or one just overwrites the other ? | 10:22 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: [WIP] Add IPv6 coverage using existing jobs https://review.openstack.org/382515 | 10:23 |
| jaosorior | panda: so, you can specify several environments with parameter defaults and they will be merged. | 10:23 |
| *** spredzy has quit IRC | 10:24 | |
| *** spredzy has joined #tripleo | 10:24 | |
| jaosorior | panda: I have the theory that the network-isolation.yaml that you modified is not the one that's actually being used by that job. So I submitted another CR with the PublicFixedIPs defined in the enable-tlsipv4netiso.yaml | 10:24 |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Set enabled_share_protocols based on enabled backends https://review.openstack.org/382386 | 10:30 |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Use Heat role *_enabled hiera to check Manila backends https://review.openstack.org/383632 | 10:30 |
| d0ugal | shardy: Could there be some sort of a limitation on the mistral user? because I can get this to work with the stack user (sudoless access to the password) but not with mistral for some reason | 10:33 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Remove unneeded *_enable_backend hiera from Manila backends https://review.openstack.org/383633 | 10:34 |
| *** pgadiya has quit IRC | 10:36 | |
| shardy | d0ugal: how are you trying to get the data, shelling out to hiera or reading the file directly? | 10:36 |
| d0ugal | shardy: shelling out | 10:37 |
| d0ugal | shardy: https://github.com/openstack/tripleo-common/blob/master/tripleo_common/utils/passwords.py#L67 | 10:37 |
| d0ugal | I could try reading the file. | 10:37 |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Set enabled_share_protocols based on enabled backends https://review.openstack.org/383634 | 10:37 |
| *** thrash|g0ne is now known as thrash | 10:38 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Serialize AllNodesDeployment and UpdateWorkflow https://review.openstack.org/383188 | 10:38 |
| shardy | d0ugal: how are you running the command? | 10:38 |
| shardy | service users are nologin by default, so you probably need to specify a shell | 10:38 |
| d0ugal | shardy: by triggering the workflow | 10:38 |
| d0ugal | shardy: openstack overcloud plan delete overcloud && openstack overcloud plan create overcloud && mistral environment-get overcloud | grep SnmpdReadonlyUserPassword | 10:39 |
| d0ugal | That is my one-line test | 10:39 |
| shardy | d0ugal: I mean the code which runs hiera probably needs to do /bin/bash hiera foo, not just hiera foo | 10:39 |
| d0ugal | shardy: oh, I see - I'll try that | 10:39 |
| d0ugal | shardy: it is code that is ripped from tripleoclient, but that obviously is a different user | 10:39 |
| shardy | yeah, users calling tripleoclient will have a default shell | 10:40 |
| d0ugal | shardy: You can probably tell this is getting lower in the stack than I am comfortable :-D | 10:41 |
| dtantsur | shardy, EmilienM, morning. I'd kindly request you to give this blueprint high priority, reasons in the description: https://blueprints.launchpad.net/tripleo/+spec/switch-to-virtualbmc | 10:43 |
| dtantsur | lucas-afk, FYI ^^^ | 10:43 |
| EmilienM | dtantsur: ok | 10:44 |
| EmilienM | dtantsur: done | 10:45 |
| dtantsur | thanks! | 10:45 |
| EmilienM | jaosorior: can you to auto triage please? https://bugs.launchpad.net/tripleo/+bug/1631277 | 10:51 |
| openstack | Launchpad bug 1631277 in tripleo "cloud names are missing from the heat stack's hostsEntry output" [Undecided,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 10:51 |
| EmilienM | like milestone, and importance of bug | 10:51 |
| EmilienM | d0ugal: same for you, please set milestones https://bugs.launchpad.net/tripleo/+bug/1631279 | 10:52 |
| openstack | Launchpad bug 1631279 in tripleo "SnmpdReadonlyUserPassword isn't set by the Mistral workflow" [High,Confirmed] - Assigned to Dougal Matthews (d0ugal) | 10:52 |
| d0ugal | EmilienM: oops | 10:52 |
| *** pgadiya has joined #tripleo | 10:52 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Serialize AllNodesDeployment and UpdateWorkflow https://review.openstack.org/383642 | 10:52 |
| EmilienM | shardy: can you approve this backport please? ^ | 10:52 |
| EmilienM | d0ugal: same for https://bugs.launchpad.net/tripleo/+bug/1631281 | 10:53 |
| openstack | Launchpad bug 1631281 in tripleo "The result of direct calls to Mistral actions should be saved" [Undecided,In progress] - Assigned to Dougal Matthews (d0ugal) | 10:53 |
| *** mcornea has quit IRC | 10:54 | |
| d0ugal | shardy: http://paste.openstack.org/show/584798/ - does that mean anything to you? | 10:54 |
| d0ugal | hang on | 10:56 |
| jaosorior | gfidente: hey dude could you check this out? https://review.openstack.org/#/c/382769/ | 10:56 |
| d0ugal | This is just what you said, maybe | 10:56 |
| *** mcornea has joined #tripleo | 10:56 | |
| gfidente | jaosorior I've lost touch a bit with the naming issue | 10:57 |
| gfidente | but that is setting the vips > hostnames in hosts | 10:57 |
| gfidente | right? | 10:57 |
| jaosorior | gfidente: well, that is already set. Only thing that's doing is putting it in the HostsEntry output | 10:58 |
| jaosorior | gfidente: so currently those are already set in /etc/hosts for all the nodes | 10:58 |
| jaosorior | that's done | 10:58 |
| jaosorior | what that commit does is give the deployer an easy way to fetch that | 10:58 |
| jaosorior | instead of having to ssh to the nodes | 10:59 |
| gfidente | ah right it's added to the outputs | 10:59 |
| gfidente | gerrit trimmed the parts before/after :P | 10:59 |
| *** ramishra has quit IRC | 10:59 | |
| d0ugal | shardy: Reading the file directly works, so I think I'll do that for now and try to figure this out after. | 11:03 |
| gfidente | jaosorior cool | 11:03 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add cloud names to hosts output https://review.openstack.org/382769 | 11:03 |
| openstackgerrit | Merged openstack/diskimage-builder: Disabling all previous repos registered in the system https://review.openstack.org/377331 | 11:05 |
| *** hewbrocca is now known as hewbrocca-afk | 11:14 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/360004 | 11:15 |
| *** mbozhenko has quit IRC | 11:16 | |
| EmilienM | i've seen some pingtests failing on HA job on master http://logs.openstack.org/04/360004/26/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/7be6988/console.html#_2016-10-07_10_22_41_201609 | 11:17 |
| EmilienM | sounds like transient though | 11:18 |
| panda | EmilienM: wasn't someone playing with glance API version yesterday ? | 11:21 |
| EmilienM | we reverted a patch from jaosorior | 11:21 |
| EmilienM | but that's unrelated | 11:22 |
| EmilienM | we don't use overcloud image upload in the pingtest | 11:22 |
| *** skramaja has quit IRC | 11:22 | |
| *** hjensas_ has joined #tripleo | 11:23 | |
| *** hjensas_ has quit IRC | 11:23 | |
| *** hjensas_ has joined #tripleo | 11:23 | |
| *** saneax is now known as saneax-_-|AFK | 11:25 | |
| *** fzdarsky|afk is now known as fzdarsky | 11:26 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/383671 | 11:26 |
| *** hjensas has quit IRC | 11:26 | |
| openstackgerrit | Merged openstack/tripleo-common: Add the KeystoneCredential0 and KeystoneCredential1 parameters https://review.openstack.org/383564 | 11:28 |
| *** rhallisey has joined #tripleo | 11:29 | |
| ccamacho | jaosorior, man you are faster than my deployments | 11:29 |
| EmilienM | d0ugal: https://bugs.launchpad.net/tripleo/+bug/1631279 | 11:29 |
| openstack | Launchpad bug 1631279 in tripleo "SnmpdReadonlyUserPassword isn't set by the Mistral workflow" [High,Confirmed] - Assigned to Dougal Matthews (d0ugal) | 11:29 |
| EmilienM | you really think we can fix and backport it today | 11:29 |
| EmilienM | ? | 11:29 |
| jaosorior | ccamacho: thanks for checking it out. | 11:29 |
| ccamacho | np | 11:30 |
| ccamacho | let me check the difference taking the data from the attributes | 11:30 |
| ccamacho | wait for me | 11:30 |
| EmilienM | apetrich: can we either move it to ocata1 or close it? https://bugs.launchpad.net/tripleo/+bug/1623673 | 11:31 |
| openstack | Launchpad bug 1623673 in tripleo "mixed deployment fails resources.ControllerServicesBaseDeployment_Step2 with status code: 6 " [High,Triaged] - Assigned to Adriano Petrich (apetrich) | 11:31 |
| *** hjensas_ has quit IRC | 11:31 | |
| *** pgadiya has quit IRC | 11:31 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Release 5.3.0 (RC3) https://review.openstack.org/383676 | 11:32 |
| *** spredzy has quit IRC | 11:32 | |
| apetrich | EmilienM, I'd say lets close it, if it reappears we open another and point to this one | 11:34 |
| EmilienM | apetrich: ok, please set it to Fix Released | 11:34 |
| EmilienM | or | 11:34 |
| EmilienM | no | 11:34 |
| EmilienM | apetrich: Invalid | 11:34 |
| apetrich | aye | 11:34 |
| EmilienM | apetrich: and drop a comment to explain | 11:34 |
| EmilienM | marios: can we Close https://bugs.launchpad.net/tripleo/+bug/1630247 ? | 11:34 |
| openstack | Launchpad bug 1630247 in tripleo "sahara services during mitaka to newton upgrade" [High,Triaged] - Assigned to Marios Andreou (marios-b) | 11:34 |
| *** spredzy has joined #tripleo | 11:35 | |
| marios | EmilienM: yeah i think if there are further issues related to the migration we can file new bugs for them | 11:36 |
| EmilienM | marios: if it's not finished, please set it to ocata-1 | 11:36 |
| EmilienM | marios: and add the backport potential tag | 11:36 |
| marios | EmilienM: i don't expect something more needed | 11:36 |
| marios | EmilienM: if there is it will be a bug, tosky agree? | 11:36 |
| marios | tosky: EmilienM is asking about closing https://bugs.launchpad.net/tripleo/+bug/1630247 (the review landed into newton too) | 11:37 |
| openstack | Launchpad bug 1630247 in tripleo "sahara services during mitaka to newton upgrade" [High,Triaged] - Assigned to Marios Andreou (marios-b) | 11:37 |
| marios | EmilienM: imo we should close it now | 11:37 |
| *** dciabrin has quit IRC | 11:38 | |
| EmilienM | marios: ok, please set it to Fix REleased | 11:38 |
| *** zoli|lunch is now known as zoli | 11:38 | |
| *** zoli is now known as zoliXXL | 11:39 | |
| d0ugal | EmilienM: I am close to getting a fix, but yeah, maybe not today | 11:39 |
| EmilienM | d0ugal: ok | 11:39 |
| d0ugal | EmilienM: is there a milestone for backporting but not today? | 11:39 |
| EmilienM | d0ugal: we can still backport it afterwards | 11:39 |
| EmilienM | d0ugal: for bugfixes, we can do it after | 11:39 |
| EmilienM | d0ugal: but no change in API | 11:39 |
| d0ugal | Yeah | 11:39 |
| *** pgadiya has joined #tripleo | 11:41 | |
| *** dprince has joined #tripleo | 11:41 | |
| *** dciabrin has joined #tripleo | 11:42 | |
| EmilienM | ccamacho, shardy: can we close https://bugs.launchpad.net/tripleo/+bug/1626976 or is there still some patch ongoing? | 11:43 |
| openstack | Launchpad bug 1626976 in tripleo "Custom role requires manual environment/files" [High,In progress] - Assigned to Carlos Camacho (ccamacho) | 11:43 |
| EmilienM | shardy: also, what is in-stable-newton bug tag in launchpad? we already had newton-backport-potential | 11:44 |
| marios | EmilienM: ack | 11:44 |
| *** pkovar has joined #tripleo | 11:45 | |
| shardy | EmilienM: I think it gets automatically applied when a patch lands to the newton branch | 11:46 |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-docs: Add openstack-tripleo-ui to list of included packages https://review.openstack.org/383684 | 11:46 |
| shardy | to differentiate between pending backports and those completed I guess | 11:46 |
| EmilienM | shardy: interesting | 11:46 |
| EmilienM | shardy: does it make sense to set https://bugs.launchpad.net/tripleo/+bug/1625783 as a duplicate of https://bugs.launchpad.net/tripleo/+bug/1624727 ? | 11:47 |
| openstack | Launchpad bug 1625783 in tripleo "unable to leverage swap-partition extraconfig" [High,In progress] - Assigned to Steven Hardy (shardy) | 11:47 |
| openstack | Launchpad bug 1624727 in tripleo "Could not fetch contents for file:///home/stack/tripleo-heat-templates/puppet/post.yaml" [Critical,In progress] - Assigned to Steven Hardy (shardy) | 11:47 |
| shardy | EmilienM: No, originally I thought they were the same, but it's two slightly different issues | 11:48 |
| EmilienM | ok | 11:48 |
| tosky | marios: sorry; so, if I understand it correctly, the review that landed fixes the upgrade part, and also the convergence, or is that part working out of the box depending whether you passed -e sahara.yml or not? | 11:48 |
| *** pgadiya_ has joined #tripleo | 11:50 | |
| *** jtomasek_ has joined #tripleo | 11:50 | |
| *** hewbrocca-afk is now known as hewbrocca | 11:50 | |
| *** pgadiya has quit IRC | 11:51 | |
| marios | tosky: so out of the box you would have sahara started after controller upgrade. on converge sahara would be OS::Heat::None so there would be no new/newton sahara config applied, unless you included the -e sahara.yaml env file | 11:51 |
| marios | tosky: the fix there was to make sure sahara runs after converge too out of the box ,and provide the mechanism for removing it alltogether both after controller upgrade and converge | 11:52 |
| tosky | marios: so no other work is needed for the converge part, becuase the relevant file (sahara.yaml) is already there; is it correct? | 11:52 |
| marios | tosky: well we dealt with in in fact as part of the converge... see https://review.openstack.org/#/c/382748/1/environments/major-upgrade-pacemaker-converge.yaml | 11:53 |
| marios | tosky: by doing this, it is as if they included the '-e sahara.yaml' as part of the converge | 11:53 |
| ccamacho | shardy EmilienM I think we can close https://bugs.launchpad.net/tripleo/+bug/1626976 as all the submissions for rc3 already landed in master and backported to newton | 11:53 |
| openstack | Launchpad bug 1626976 in tripleo "Custom role requires manual environment/files" [High,In progress] - Assigned to Carlos Camacho (ccamacho) | 11:53 |
| tosky | marios: ehm, so fine with me with closing the bug if you didn't do it, but now I'm confused; if "it is as if they", when do you need to include -e sahara.yaml? | 11:55 |
| *** ccamacho is now known as ccamacho|lunch | 11:55 | |
| *** mbozhenko has joined #tripleo | 11:55 | |
| marios | tosky: for any subsequent stack update... https://bugzilla.redhat.com/show_bug.cgi?id=1381628#c1 | 11:55 |
| openstack | bugzilla.redhat.com bug 1381628 in openstack-tripleo-heat-templates "sahara services during mitaka to newton upgrade go from default On to default Off" [Unspecified,New] - Assigned to mandreou | 11:55 |
| EmilienM | ccamacho|lunch: ok | 11:56 |
| *** pradk has joined #tripleo | 11:56 | |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-validations: Validate the instackenv format https://review.openstack.org/353956 | 11:56 |
| tosky | marios: thanks, I understand the idea; I need to better study the different phases of the upgrade | 11:57 |
| marios | tosky: ack once we get qe running this more we will also see if there are issues with the workflow and we can followup but i think for now we deal with it as we can... ther's been a few discussions around this and I think we came to a reasonable solution for now | 11:58 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Remove unneeded *_enable_backend hiera from Manila backends https://review.openstack.org/383633 | 11:59 |
| panda | jaosorior: the ip is right now, but I think I have not created the certificates correctly SSL exception connecting to https://10.0.0.18:13000/v2.0/tokens: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:765) | 11:59 |
| *** pgadiya_ has quit IRC | 11:59 | |
| marios | tosky: we default to 'what the user had' which we agree was sahara on ... we deal with the special case handling as part of the upgrade but can't solve the more general and pre-existing problem | 11:59 |
| marios | tosky: and we provide a mechanism for removing it alltogether if the user wants to make it explicit, as part of the ugprade. | 11:59 |
| gfidente | clean backport guys https://review.openstack.org/#/c/383614/ | 11:59 |
| gfidente | this guy too https://review.openstack.org/#/c/383634/ | 12:00 |
| *** shardy is now known as shardy_lunch | 12:00 | |
| panda | jaosorior: in fact, when the SSL connection failed for a CN mismatch, it gave a different error message | 12:00 |
| panda | jaosorior: I'll recreate them.. | 12:00 |
| jaosorior | sure | 12:00 |
| tosky | marios: yep, that's the clear part; I'm a bit ignorant on the pratical part (which commands should be invoked for the upgrade and convergence, in which order, with which parameters) :) | 12:01 |
| shadower | jaosorior: thanks for the validation reviews. I'll try to find some time later today for your stuff | 12:01 |
| EmilienM | gfidente: approved | 12:01 |
| *** trown|outtypewww is now known as trown | 12:01 | |
| gfidente | EmilienM thanks! | 12:01 |
| *** bfournie has quit IRC | 12:02 | |
| *** mbozhenko has quit IRC | 12:06 | |
| jaosorior | shadower: I'm still unsure if I can +2 in the validation repo | 12:06 |
| mandre | jaosorior: why not? | 12:07 |
| openstackgerrit | Merged openstack/puppet-tripleo: Set enabled_share_protocols based on enabled backends https://review.openstack.org/382386 | 12:07 |
| shadower | jaosorior: I'm thinking of writing a "how to review tripleo-validation patches" email that could boost everyone's confidence a little | 12:08 |
| *** limao_ has joined #tripleo | 12:08 | |
| shadower | totally understand not wanting to +2 something you're not terribly familiar with | 12:08 |
| *** maticue has joined #tripleo | 12:08 | |
| *** lucas-afk is now known as lucasagomes | 12:09 | |
| mandre | shadower: I'll try to spare an hour or two this afternoon to review the tripleo-validations queue | 12:09 |
| *** fultonj_ has joined #tripleo | 12:09 | |
| *** jayg|g0n3 is now known as jayg | 12:09 | |
| shadower | mandre: that would be awesome, thanks | 12:09 |
| EmilienM | shadower: sounds like a good idea | 12:09 |
| shadower | cheers | 12:10 |
| jaosorior | shadower: getting some docs and hints to test the stuff would be really useful | 12:10 |
| shadower | jaosorior: yeah. They exist but could be better & more visible | 12:10 |
| jaosorior | shadower: either on the validations documentation, or a blog or something of the sort. | 12:11 |
| *** limao has quit IRC | 12:11 | |
| shadower | yea | 12:11 |
| mandre | also, we don't have a proper CI that exercise the ansible validations | 12:12 |
| *** jtomasek_ has quit IRC | 12:14 | |
| *** mbozhenko has joined #tripleo | 12:15 | |
| shadower | mandre: do you know whether node registration goes through the CI? I'm writing a patch that integrates the instackenv.json validation into the registration workflotw | 12:16 |
| *** tzumainn has joined #tripleo | 12:16 | |
| EmilienM | jrist, jpich, jtomasek: are we good for tripleo-ui/newton? is there some patches missing? | 12:16 |
| jtomasek | EmilienM: yep, GUI should be ready | 12:17 |
| *** jlinkes__ has quit IRC | 12:17 | |
| EmilienM | jtomasek: ack. | 12:17 |
| jtomasek | jpich: anything missing on the puppet side? | 12:17 |
| *** jlinkes__ has joined #tripleo | 12:17 | |
| mandre | shadower: nope, no idea | 12:17 |
| shadower | I guess we'll see :-) | 12:18 |
| openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Make the snmpd_readonly_user_password available to Mistral https://review.openstack.org/383694 | 12:19 |
| shadower | mandre: I've a question. When the run_validation Mistral *action* is run directly, it either fails or succeeds. But when you run the *workflow*, it reports the failure/success but the entire workflow always succeeds | 12:19 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/383695 | 12:19 |
| shadower | mandre: is that the right behaviour? Because it means you can't insert the workflow somewhere and have on-success/on-error working. You have to use the action directly. | 12:20 |
| jtomasek | shadower: it is going to test the nodes_json workflow input, rather than instackenv.json file itself, is that so? | 12:20 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fetch the snmpd_readonly_user_password directly from the hiera file https://review.openstack.org/383696 | 12:20 |
| shadower | jtomasek: yeah. Or rather -- it does now. I just need to package it up into patches :-) | 12:20 |
| jtomasek | shadower: nice! | 12:20 |
| shadower | jtomasek: I'm working on this specifically so it's useful from everywhere. I think the UI doesn't even have to actually change a thing. | 12:21 |
| mandre | shadower: yeah, the result of the run_validation action doesn't impact the success of the workflow | 12:22 |
| shadower | mandre: right. But: is that something we could change or is there a deeper reason for this? | 12:22 |
| mandre | shadower: because we consider the workflow to be successful if it runs the validation and send the result | 12:22 |
| shadower | mandre: yeah, I figured it was probably that | 12:23 |
| jaosorior | gfidente: hey dude, can you re-visit https://review.openstack.org/#/c/382769/ ? | 12:23 |
| jtomasek | shadower: by putting running the validation in the task, you should be imho able to test the output of the validation and terminate the workflow in case of failed validation | 12:24 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add cloud names to hosts output https://review.openstack.org/383697 | 12:24 |
| shadower | jtomasek: ah, so checking for the result directly instead of relying on on-error? Yeah that could work | 12:24 |
| jtomasek | shadower: yep, because of what mandre described | 12:25 |
| mandre | shadower: either you retrieve the action return value or you subscribe to the message queue the workflow sends the result to | 12:26 |
| shadower | jtomasek, mandre: yeah. What I'm trying to understand is -- is there a reason for this behaviour? Or could we change the workflow so that it fails after sending the failure message. | 12:26 |
| jtomasek | shadower: it would be nice if we were able to generalize this somehow as the plan is to run validations in many places, also making it optional would be nice too. Although I am not knowlegeable about mistral yaml options/extensibility | 12:26 |
| jtomasek | shadower: yep, we've tried it several times, failing workflow does not pass output etc. | 12:26 |
| jtomasek | shadower: so failed workflow is useless | 12:27 |
| shadower | jtomasek: I mean, in the task that sends the message with the output -- can we set that to failed afterwards? | 12:27 |
| shadower | Right now it succeeds (because it sent the message) | 12:27 |
| shadower | could it send the message and fail the workflow instead? | 12:28 |
| mandre | shadower: that would be wrong conceptually to fail a workflow that contains a failing validation... because the workflow is still successful, it was able to run the validation and tell you if it failed or not | 12:28 |
| *** jaosorior has quit IRC | 12:28 | |
| shadower | hm, okay | 12:28 |
| *** limao_ has quit IRC | 12:28 | |
| d0ugal | jtomasek, shadower, mandre: https://github.com/openstack/mistral-specs/blob/master/specs/ocata/approved/publish-on-failure.rst | 12:28 |
| d0ugal | That might be useful, in Ocata :) | 12:29 |
| *** limao has joined #tripleo | 12:29 | |
| jtomasek | d0ugal: nice | 12:29 |
| shadower | sweet | 12:29 |
| *** dprince has quit IRC | 12:30 | |
| mandre | d0ugal: cool | 12:30 |
| *** akuznetsov has joined #tripleo | 12:30 | |
| *** dprince has joined #tripleo | 12:31 | |
| jpich | EmilienM, jtomasek: Sorry for the delay, I think we're good for puppet-tripleo as well. There's more bug fixes I want to get in that we can bring in as backports later on after the release :) | 12:32 |
| *** rcernin has quit IRC | 12:33 | |
| *** akuznets_ has joined #tripleo | 12:33 | |
| EmilienM | jpich: excellent, please make sure to tag them in launchpad | 12:33 |
| jpich | EmilienM: Yup! Thank you | 12:33 |
| *** flepied1 is now known as flepied | 12:34 | |
| *** akuznetsov has quit IRC | 12:34 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common: Make UpdateManager use a passed-in stack setup https://review.openstack.org/383708 | 12:37 |
| *** akuznets_ has quit IRC | 12:37 | |
| openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient: Downloads templates from swift before processing update https://review.openstack.org/381899 | 12:38 |
| *** jlinkes_ has joined #tripleo | 12:39 | |
| *** mbozhenko has quit IRC | 12:41 | |
| *** jpena is now known as jpena|lunch | 12:42 | |
| *** karthiks has quit IRC | 12:42 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Release 5.3.0 (RC3) https://review.openstack.org/383711 | 12:42 |
| *** jlinkes__ has quit IRC | 12:42 | |
| *** shardy_lunch is now known as shardy | 12:43 | |
| *** mbozhenko has joined #tripleo | 12:43 | |
| *** bfournie has joined #tripleo | 12:44 | |
| *** jlinkes__ has joined #tripleo | 12:44 | |
| *** amoralej is now known as amoralej|lunch | 12:45 | |
| *** tzumainn has quit IRC | 12:46 | |
| *** jlinkes_ has quit IRC | 12:47 | |
| *** tiswanso has quit IRC | 12:48 | |
| *** rcernin has joined #tripleo | 12:48 | |
| *** tiswanso has joined #tripleo | 12:49 | |
| *** cdearborn has joined #tripleo | 12:50 | |
| *** limao has quit IRC | 12:50 | |
| *** rlandy has joined #tripleo | 12:51 | |
| *** limao has joined #tripleo | 12:54 | |
| *** tzumainn has joined #tripleo | 12:55 | |
| *** links has quit IRC | 12:55 | |
| *** rcernin_ has joined #tripleo | 12:56 | |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Include ::swift::config in Swift API and Storage roles https://review.openstack.org/383721 | 12:58 |
| *** lblanchard has joined #tripleo | 13:00 | |
| *** akuznetsov has joined #tripleo | 13:00 | |
| *** rcernin has quit IRC | 13:01 | |
| *** ccamacho|lunch is now known as ccamacho | 13:01 | |
| *** dmacpher has joined #tripleo | 13:03 | |
| *** jcoufal has joined #tripleo | 13:05 | |
| EmilienM | dtantsur: can you help me to investigate an ironic issue in tripleo CI? | 13:06 |
| dtantsur | (answered in #rdo) | 13:06 |
| *** morazi has joined #tripleo | 13:06 | |
| EmilienM | ok | 13:07 |
| *** cylopez has quit IRC | 13:08 | |
| *** tiswanso has quit IRC | 13:08 | |
| jtomasek | shadower: I've tested https://review.openstack.org/#/c/375477/3 | 13:08 |
| jtomasek | shadower: http://imgur.com/a/R4Hoe | 13:09 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: [WIP] Add IPv6 coverage using existing jobs https://review.openstack.org/382515 | 13:10 |
| *** bkreitch has quit IRC | 13:10 | |
| *** panda is now known as panda|afk | 13:10 | |
| openstackgerrit | Ryan Brady proposed openstack/python-tripleoclient: Use workflow for overcloud node delete https://review.openstack.org/383731 | 13:11 |
| *** bkreitch has joined #tripleo | 13:11 | |
| *** limao has quit IRC | 13:11 | |
| *** limao has joined #tripleo | 13:12 | |
| thrash | rbrady: see if these make sense now... https://review.openstack.org/#/c/381899/ and https://review.openstack.org/#/c/383708/ | 13:12 |
| thrash | rbrady: I'm about to do a for-reals test. | 13:12 |
| thrash | rbrady: and already failed lol | 13:13 |
| dtantsur | EmilienM, do you have an idea when it started? | 13:14 |
| thrash | rbrady: doh. I see what I did. :P | 13:14 |
| EmilienM | dtantsur: I'm deploying with a new version of Puppet | 13:14 |
| EmilienM | so it might be an orchestration issue | 13:15 |
| EmilienM | and not a bug in ironic | 13:15 |
| *** morazi has quit IRC | 13:15 | |
| dtantsur | EmilienM, I was surprised by keystone V3 reference in ironic.conf, I thought we don't use it yet for ironic. No other ideas yet, looking into it. | 13:15 |
| EmilienM | dtantsur: oh wait | 13:17 |
| EmilienM | I see it in logstash | 13:17 |
| EmilienM | it's also in Ironic | 13:17 |
| dtantsur | mmmm? | 13:17 |
| EmilienM | dtantsur: go in logstash and look for: | 13:18 |
| EmilienM | message: "EmptyCatalog: The service catalog is empty." | 13:18 |
| EmilienM | http://logstash.openstack.org/#/dashboard/file/logstash.json | 13:18 |
| *** akshai has joined #tripleo | 13:18 | |
| dtantsur | EmilienM, I don't see non-tripleo jobs there though | 13:19 |
| EmilienM | right | 13:19 |
| EmilienM | but it's not puppet3 or 4 | 13:19 |
| EmilienM | it's something else | 13:19 |
| EmilienM | maybe a transient problem | 13:19 |
| dtantsur | most of the hits are in experimental-tripleo on ironic, interesting | 13:20 |
| dtantsur | and most of them are in inspector btw | 13:20 |
| EmilienM | dtantsur: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%20%5C%22EmptyCatalog%3A%20The%20service%20catalog%20is%20empty.%5C%22 | 13:20 |
| openstackgerrit | Merged openstack/puppet-tripleo: Set enabled_share_protocols based on enabled backends https://review.openstack.org/383634 | 13:21 |
| EmilienM | yeah but not all are in inspector | 13:21 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Specify the Ceph packages to be installed https://review.openstack.org/383614 | 13:21 |
| openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient: Downloads templates from swift before processing update https://review.openstack.org/381899 | 13:21 |
| EmilienM | i'm wondering if it could be https://github.com/openstack/puppet-ironic/commit/ac03904702ebf183330490f9926d18c4317b6d75 | 13:21 |
| dtantsur | EmilienM, everything is possible, but I can hardly imagine how.. | 13:22 |
| EmilienM | yeah me neither | 13:22 |
| dtantsur | even less, how it affects ironic itself | 13:22 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/383733 | 13:22 |
| EmilienM | I'm rechecking another time | 13:22 |
| EmilienM | making sure it's persistent | 13:22 |
| dtantsur | yep | 13:23 |
| EmilienM | dtantsur: the actual error is here: http://logs.openstack.org/95/383695/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/3c8cf57/console.html#_2016-10-07_12_56_03_874261 | 13:23 |
| rbrady | thrash: looking | 13:24 |
| thrash | rbrady: hold. still not working. | 13:25 |
| thrash | rbrady: well, you can look at the tripleo-common stuff. :) | 13:25 |
| dtantsur | I don't see any hits before today roughly an hour ago | 13:25 |
| dtantsur | well, no, there is something similar yesterday too | 13:26 |
| *** jeckersb_gone is now known as jeckersb | 13:28 | |
| *** ohamada has quit IRC | 13:28 | |
| *** ohamada has joined #tripleo | 13:28 | |
| EmilienM | I'm making surgery in logstash to find out when it actually started | 13:28 |
| dtantsur | EmilienM, also some builds with this error have status SUCCESS | 13:28 |
| openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient: Downloads templates from swift before processing update https://review.openstack.org/381899 | 13:28 |
| openstackgerrit | Merged openstack/puppet-tripleo: Release 5.3.0 (RC3) https://review.openstack.org/383676 | 13:28 |
| thrash | rbrady: ok.. :) | 13:28 |
| EmilienM | ok the error started at 2016-10-06T13:24:24.000-04:00 | 13:29 |
| EmilienM | well, the jobs started to fail at this time ^ | 13:30 |
| EmilienM | this is my query: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%20%5C%22IronicAction.node.set_provision_state%20failed%5C%22%20AND%20build_status%3A%20FAILURE%20AND%20message%3A%20%5C%22Failed%20to%20run%20action%5C%22 | 13:30 |
| EmilienM | let's see if we had it before but without failure | 13:30 |
| openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Make the snmpd_readonly_user_password available to Mistral https://review.openstack.org/383694 | 13:31 |
| EmilienM | dtantsur: I don't see anything but FAILURES | 13:31 |
| *** akshai has quit IRC | 13:32 | |
| EmilienM | dtantsur: we bumped to Ocata yesterday | 13:32 |
| EmilienM | that's probably related | 13:32 |
| pradk | marios, Hi, thx for merging ceilo wsgi patches | 13:33 |
| pradk | marios, and opening bug for it :) | 13:33 |
| *** akshai has joined #tripleo | 13:34 | |
| EmilienM | dtantsur: it sounds like a keystone authtoken thing | 13:35 |
| *** limao has quit IRC | 13:36 | |
| *** limao has joined #tripleo | 13:37 | |
| marios | pradk: thanks for the updates prad i was just anxious to get it in for rc3 | 13:37 |
| *** panda|afk is now known as panda | 13:38 | |
| *** akshai has quit IRC | 13:38 | |
| marios | pradk: discovered why it was hanging in my test yesterday (and also today when i had more time to debug)... downstream code didn't have the {get_param: [servers, Controller] (i.e. the [] you were hitting this you were telling me in brno :/ ) | 13:39 |
| EmilienM | dtantsur: first occurence 2016-09-28T09:11:52.000-04:00 | 13:39 |
| marios | pradk: so we will update our readme but hopefully by start of next week we get it fully in package too so we dn't need to manually apply it downstream | 13:39 |
| EmilienM | http://logs.openstack.org/09/371209/26/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/2cc3ada/console.html#_2016-09-28_13_12_02_192201 | 13:40 |
| EmilienM | dtantsur: so something broke in ironic at this date | 13:40 |
| *** rodrigods has quit IRC | 13:40 | |
| *** rodrigods has joined #tripleo | 13:40 | |
| dtantsur | interesting | 13:41 |
| EmilienM | yea | 13:41 |
| EmilienM | kibana sees something in syslog, let me look also this file | 13:41 |
| *** dmsimard has quit IRC | 13:41 | |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 13:42 |
| thrash | rbrady: I think I'm being a bit naive about it. | 13:42 |
| pradk | marios, yep i'm pretty confident its in good shape now | 13:42 |
| EmilienM | ouch, I see different ironic issues | 13:42 |
| EmilienM | dtantsur: http://logs.openstack.org/95/383695/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/3c8cf57/logs/syslog.txt.gz | 13:42 |
| *** dmsimard has joined #tripleo | 13:42 | |
| EmilienM | sorry | 13:43 |
| EmilienM | http://logs.openstack.org/95/383695/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/3c8cf57/logs/syslog.txt.gz#_Oct_07_12_54_23 | 13:43 |
| thrash | rbrady: I'm getting an error about the call to stacks.update... Says I have the wrong number of params, which is weird. | 13:43 |
| *** ohamada_ has joined #tripleo | 13:43 | |
| dprince | EmilienM: got a weird conversion error with regards to 'step' this morning. Have there been any core puppet changes of late: http://paste.openstack.org/show/584828/ | 13:44 |
| *** Goneri has joined #tripleo | 13:44 | |
| EmilienM | dtantsur: I think I found it | 13:44 |
| *** amoralej|lunch is now known as amoralej | 13:44 | |
| EmilienM | dtantsur: in ironic inspector logs, I see 401 errors | 13:45 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 13:45 |
| EmilienM | dtantsur: wget http://logs.openstack.org/95/383695/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/3c8cf57/logs/undercloud.tar.xz | 13:45 |
| shardy | matbu: ^^ tests fixed, hopefully that will run through CI now | 13:45 |
| EmilienM | dprince: where | 13:45 |
| EmilienM | dprince: we updated puppet version in RDO | 13:45 |
| *** ohamada__ has joined #tripleo | 13:45 | |
| matbu | shardy: cool | 13:46 |
| dprince | EmilienM: ouch, I think this is a bug then because step isn't an integer for us | 13:46 |
| dtantsur | EmilienM, so, whatever it is, it 1. affects both ironic and ironic-inspector, 2. happened before Sep 29, 3. is transient. right? | 13:46 |
| dprince | EmilienM: I will file it and look into it... | 13:46 |
| EmilienM | dtantsur: yes | 13:46 |
| dtantsur | I don't see any suspicious commits in ironic around that date | 13:46 |
| EmilienM | dprince: can you tell me where in the manifest it fail? | 13:46 |
| EmilienM | dprince: we should have fixed this problem, have you updated puppet modules? | 13:46 |
| EmilienM | specially puppet-tripleo and THT | 13:46 |
| shardy | dprince: https://review.openstack.org/#/c/374171/ changed it to a number type in the SoftwareConfig schema | 13:46 |
| shardy | possibly related? | 13:47 |
| dtantsur | EmilienM, can this be related in any way? https://github.com/openstack/puppet-ironic/commit/da589acf11fc73a9f7174a42ffb2ab85371b630c | 13:47 |
| *** ohamada has quit IRC | 13:47 | |
| EmilienM | dtantsur: for sure | 13:47 |
| dprince | shardy: oh, right | 13:47 |
| dtantsur | EmilienM, can it maybe break https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.pp#L71-L77 ? | 13:47 |
| * dtantsur just guesses randomly, as he was surprised by this code some time ago | 13:48 | |
| rook | shardy: hey, trying to debug a deployment going on right now. seems like a compute node is stuck updating, got a second? | 13:48 |
| EmilienM | it's possible, thx, let me dig now to see if keystone was ready before ironic | 13:48 |
| shardy | rook: sure | 13:49 |
| *** ramishra has joined #tripleo | 13:49 | |
| weshay | I'm looking to enable debug on the overcloud services as part of the deployment, I thought -e /usr/share/openstack-tripleo-heat-templates/environments/config-debug.yaml may do the trick but didn't afaict. Any pointers? | 13:49 |
| rook | shardy: so compute node 10 is sitting here ComputeAllNodesDeployment ; status is : UPDATE_IN_PROGRESS | 13:49 |
| rook | however it has been sitting there for ~ 30 minutes shardy | 13:49 |
| *** ohamada_ has quit IRC | 13:49 | |
| dprince | shardy: for some reason that isn't working for me locally. I've got it... | 13:50 |
| rook | i am logged into the compute node, nothing is really going on with that host. | 13:50 |
| EmilienM | dtantsur: indeed ! | 13:50 |
| EmilienM | dtantsur: let me try something | 13:50 |
| *** ramishra_ has joined #tripleo | 13:50 | |
| dtantsur | good, that was my last and only idea :) | 13:50 |
| rook | shardy: i could try to reboot the host to see if whatever is wedged becomes unwedged. | 13:50 |
| shardy | weshay: it's the same as that but with "Debug" instead of "ConfigDebug" | 13:50 |
| shardy | the one you reference just turns on puppet debugging | 13:51 |
| rook | I have tried restarting os-collect-conifg, that didn't prove helpful | 13:51 |
| *** jpena|lunch is now known as jpena | 13:52 | |
| weshay | shardy, ah.. thank you :) is there a template already created in tht for that, if not I can add one if you think it's a good idea | 13:53 |
| shardy | weshay: I don't think there is, feel free to propose one :) | 13:54 |
| weshay | thanks | 13:54 |
| *** limao has quit IRC | 13:54 | |
| shardy | rook: Ok, so ps ax | grep heat doesn't show any heat hook running, and/or it's not running os-*config applying hieradata? | 13:54 |
| *** limao has joined #tripleo | 13:54 | |
| shardy | rook: does it have network connectivity to talk to heat OK? | 13:55 |
| rook | shardy the network seemed fine and the metadata route was there. | 13:55 |
| rook | shardy: i kicked the host, ill let you know if that revived the deployment | 13:55 |
| shardy | rook: you could run os-refresh-config manually and look for any errors | 13:55 |
| rook | ah | 13:55 |
| *** dtantsur is now known as dtantsur|mtg | 13:56 | |
| *** fultonj_ has quit IRC | 13:56 | |
| shardy | rook: note the transport used for polling metadata and signalling isn't the same, so it's possible to collect metadata (from swift) and not be able to signal (to heat) | 13:56 |
| shardy | unlikely, but possible :) | 13:56 |
| rook | shardy here is the PITA, this node was _already deployed_, this is me running a scale deployment... so something with the update. | 13:57 |
| rook | really frustrating. | 13:57 |
| EmilienM | dtantsur|mtg: patch coming | 13:57 |
| shardy | rook: the AllNodesDeployment writes some hieradata, no chance it's out of disk space? | 13:57 |
| rook | on the UC? | 13:57 |
| shardy | no the compute node that got stuck | 13:57 |
| rook | ill look | 13:58 |
| shadower | jtomasek: awesome, thanks | 13:58 |
| EmilienM | dtantsur|mtg: did you file a bug? | 13:58 |
| rook | nope shardy | 13:58 |
| rook | shardy: running os-refresh-config manually. | 13:59 |
| rook | no errors | 13:59 |
| rook | [2016-10-07 13:59:06,190] (os-refresh-config) [INFO] Completed phase migration | 13:59 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: start ironic-(api|inspector) after Keystone_endpoint https://review.openstack.org/383746 | 13:59 |
| EmilienM | dtantsur|mtg: ^ | 13:59 |
| *** fultonj has quit IRC | 14:00 | |
| *** trown is now known as trown|brb | 14:01 | |
| *** fultonj has joined #tripleo | 14:01 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: WIP: Containerized Services for Composable Roles https://review.openstack.org/330659 | 14:02 |
| *** jprovazn has quit IRC | 14:03 | |
| rook | shardy: still wedged. https://gist.github.com/jtaleric/6ba53957cff37976b991ce5ef0b57760 | 14:03 |
| *** ramishra has quit IRC | 14:04 | |
| *** ramishra_ has quit IRC | 14:04 | |
| EmilienM | dprince: have you seen it in CI too? also, where in manifest you see this error? | 14:04 |
| shardy | rook: can you run /usr/libexec/os-refresh-config/post-configure.d/99-refresh-completed and tee the output to be pasted somewhere? | 14:05 |
| rook | on the oc? | 14:05 |
| shardy | yeah, that's the script that should signal back to heat after the AllNodesDeployment stuff is done | 14:05 |
| *** b00tcat has quit IRC | 14:06 | |
| rook | https://gist.github.com/jtaleric/3b5639d5e6a3b3fcc9f8913b492d91fa | 14:06 |
| rook | shardy: ^ | 14:06 |
| dprince | EmilienM: just locally so far | 14:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/383671 | 14:06 |
| EmilienM | dprince: ok | 14:06 |
| *** ramishra has joined #tripleo | 14:06 | |
| shardy | rook: Ok that looks wrong, it's not getting any data from oac | 14:07 |
| *** mbozhenko has quit IRC | 14:07 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates: add a built in template to enable debug on the overcloud openstack services https://review.openstack.org/383753 | 14:07 |
| shardy | rook: does os-apply-config --key deployments --type raw --key-default '' give you a list of deployments? | 14:07 |
| rook | https://gist.githubusercontent.com/jtaleric/3304992721d512d65d034fd344f4d9f3/raw/b708041069e8597f6dd39fa0c0d18d2a72b7f58c/gistfile1.txt | 14:09 |
| rook | yeah shardy | 14:09 |
| rook | seems to be valid json | 14:09 |
| *** jeckersb is now known as jeckersb_gone | 14:11 | |
| *** lazy_prince has quit IRC | 14:12 | |
| *** anshul has joined #tripleo | 14:13 | |
| EmilienM | weshay: I haven't -1 but could you please write good commit messages ? https://review.openstack.org/#/c/383753/ | 14:14 |
| weshay | EmilienM, you are a clone for sure.. happy to update it | 14:14 |
| weshay | thanks | 14:15 |
| EmilienM | weshay: but otherwise +2, good to have this env | 14:15 |
| *** jeckersb_gone is now known as jeckersb | 14:15 | |
| *** limao has quit IRC | 14:15 | |
| *** dtantsur|mtg is now known as dtantsur | 14:15 | |
| *** lazy_prince has joined #tripleo | 14:16 | |
| *** trown|brb is now known as trown | 14:16 | |
| *** limao has joined #tripleo | 14:16 | |
| dtantsur | EmilienM, looks reasonable. I wonder why only ironic services hit that.. | 14:16 |
| dtantsur | EmilienM, and no, I haven't filed a bug | 14:17 |
| *** ramishra_ has joined #tripleo | 14:17 | |
| rook | shardy: any other thoughts? | 14:17 |
| EmilienM | dtantsur: ack | 14:17 |
| larsks | I'm trying to test out recent backports to stable/newton. When I run the overcloud deploy, it fails quickly with "'NoneType' object does not support item assignment", and no other errors. This is coming from a call to deep_update (in /usr/lib/python2.7/site-packages/heatclient/common/template_utils.py) with old == None... | 14:17 |
| larsks | Just starting to look into it; posting here in case someone says, "hey, I know where you should look..." | 14:18 |
| larsks | (in this case, 'new' contains the contents of a parameter file passed on the command line with -e ) | 14:20 |
| *** yamahata has joined #tripleo | 14:20 | |
| openstackgerrit | Martin André proposed openstack/tripleo-common: Add keystone config files and utilities to heat-agents https://review.openstack.org/346087 | 14:21 |
| openstackgerrit | Martin André proposed openstack/tripleo-common: Create new docker command hook. https://review.openstack.org/312723 | 14:21 |
| openstackgerrit | Martin André proposed openstack/tripleo-common: Install configuration files for all downloaded packages https://review.openstack.org/347412 | 14:21 |
| *** leifmadsen has quit IRC | 14:22 | |
| *** ansiwen has quit IRC | 14:22 | |
| *** trown has quit IRC | 14:22 | |
| *** StevenK has quit IRC | 14:22 | |
| *** NachoDuck has quit IRC | 14:22 | |
| *** afazekas has quit IRC | 14:22 | |
| *** afazekas has joined #tripleo | 14:22 | |
| shardy | rook: what files does /var/lib/os-apply-config-deployments/deployed/ have in it? | 14:22 |
| *** StevenK has joined #tripleo | 14:22 | |
| shardy | rook: that will tell us if the deployment signalling happened | 14:22 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates: Add new environment for debug https://review.openstack.org/383753 | 14:22 |
| *** leifmadsen has joined #tripleo | 14:22 | |
| rook | shardy: 3 files all zero bits | 14:23 |
| *** trown has joined #tripleo | 14:23 | |
| shardy | rook: does one of them match the UUID of the stalled Deployment? | 14:23 |
| *** ansiwen has joined #tripleo | 14:23 | |
| weshay | EmilienM, are you interested in puppet/config and this setting running in tripleo-ci? maybe it's too much logging? | 14:24 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common: Make UpdateManager use a passed-in stack setup https://review.openstack.org/383708 | 14:24 |
| EmilienM | weshay: what is puppet/config? | 14:25 |
| EmilienM | weshay: you mean enable this env by default in ooo-ci? | 14:25 |
| shardy | larsks: not seen that exact issue, but FYI we're fixing a bunch of related stuff in https://review.openstack.org/#/c/379547/ | 14:25 |
| weshay | EmilienM, and / or /environments/config-debug.yaml | 14:25 |
| *** NachoDuck has joined #tripleo | 14:25 | |
| shardy | larsks: you shouldn't hit that unless you're passing either a j2 rendered environment file or something which references a j2 rendered file tho | 14:25 |
| rook | shardy: heat stack-list uuid? | 14:25 |
| *** absubram has joined #tripleo | 14:25 | |
| EmilienM | weshay: sorry, I don't understand your question | 14:26 |
| shardy | rook: ea656a19-71e7-4008-80d2-bfba03afd4e6 from your resource-list output | 14:26 |
| weshay | EmilienM, ya.. enable it by default in ooo-ci | 14:26 |
| shardy | that's the ID we use to create the file | 14:26 |
| EmilienM | weshay: yes, it's a good idea IMHO | 14:26 |
| weshay | ok.. I'll propose a patch then | 14:26 |
| EmilienM | cool | 14:27 |
| d0ugal | So, is introspection broken at the moment? | 14:27 |
| shardy | rook: if you want to signal again, you can remove it and re-run 99-refresh-completed | 14:27 |
| EmilienM | d0ugal: right now all ovb jobs are broken | 14:27 |
| EmilienM | d0ugal: what is your trace? | 14:27 |
| d0ugal | EmilienM: fun | 14:27 |
| EmilienM | d0ugal: that? http://logs.openstack.org/95/383695/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/3c8cf57/console.html#_2016-10-07_12_56_03_874261 | 14:27 |
| d0ugal | EmilienM: I'm getting errors in my local env. One sec | 14:27 |
| d0ugal | EmilienM: ... yeah, it is the same as that | 14:27 |
| EmilienM | d0ugal: can you tell me what version of puppet you're running? | 14:28 |
| rook | nope | 14:28 |
| rook | shardy: ^ | 14:28 |
| d0ugal | EmilienM: puppet itself? | 14:28 |
| EmilienM | d0ugal: yes | 14:29 |
| EmilienM | d0ugal: 3.8 or 4.6? | 14:29 |
| d0ugal | EmilienM: puppet-4.6.2-2.el7.noarch | 14:29 |
| EmilienM | ok that might be the problem, we reverted puppet in RDO, we tried to update it this morning #fail | 14:29 |
| shardy | rook: Ok so does os-apply-config --key deployments --type raw --key-default '' actually contain the stalled deployment ID? | 14:29 |
| EmilienM | d0ugal: my attempt to fix it https://review.openstack.org/#/c/383746/1 | 14:30 |
| d0ugal | EmilienM: cool, I'll check it out | 14:30 |
| EmilienM | d0ugal: try to restart ironic services | 14:30 |
| EmilienM | d0ugal: and run your overcloud deploy again | 14:30 |
| *** noslzzp has joined #tripleo | 14:30 | |
| d0ugal | EmilienM: will do | 14:30 |
| *** larstobi has quit IRC | 14:31 | |
| rook | shardy: nope that id is not in there | 14:31 |
| rook | how can i regenerate this? | 14:31 |
| rook | deployment hasn't timed outjust yet | 14:32 |
| rook | lol | 14:32 |
| *** absubram has quit IRC | 14:32 | |
| EmilienM | gfidente: again manila??? it never ends dude | 14:33 |
| rook | shardy do i remove stuff from here ?/var/lib/os-apply-config-deployments/deployed/ | 14:33 |
| EmilienM | https://review.openstack.org/#/c/383632/ | 14:33 |
| EmilienM | tbarron, gfidente, marios: not sure they'll make it for RC3 to be honest | 14:33 |
| shardy | rook: you can, but it won't help because the deployment isn't in the oac data | 14:33 |
| rook | :/ | 14:33 |
| rook | shardy: so this is a lost cause/ | 14:33 |
| *** akuznetsov has quit IRC | 14:33 | |
| shardy | rook: the way it works is we iterate over the json blob (collected by os-collect-config), then signal each deployment that's not got one of those deployed files | 14:33 |
| rook | shardy any thoughts on how something like this could occur? this compute node successfully deployed when i deployed the inital 30.. but wen i scaled to 60 it is now hung up | 14:34 |
| shardy | rook: well, we need to know why the data isn't there | 14:34 |
| EmilienM | gfidente: or it's not for rc3? | 14:34 |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-common: Make validation inputs configurable via Mistral https://review.openstack.org/383763 | 14:34 |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-common: Validate the nodes_json input during registration https://review.openstack.org/383764 | 14:34 |
| *** noslzzp has quit IRC | 14:34 | |
| larsks | shardy, fwiw, the problem crops up because https://github.com/openstack/python-heatclient/blob/master/heatclient/common/template_utils.py#L255 is getting hit with merged_env={}, while env= {'parameter_defaults': ...}. So this ultimately fails in deep_update because merged_env doesn't have corresponding keys... | 14:34 |
| *** noslzzp has joined #tripleo | 14:35 | |
| shardy | larsks: interesting, OK that's a different issue then | 14:35 |
| *** absubram has joined #tripleo | 14:36 | |
| *** limao has quit IRC | 14:36 | |
| tbarron | EmilienM: gfidente marios those manila_backends topic changes as I understand it are some ocata cleanup not essential for backport to newton or rc3 from my POV | 14:37 |
| *** limao has joined #tripleo | 14:37 | |
| EmilienM | tbarron: ack good | 14:38 |
| tbarron | s/manila_backends/manila_backends_logic/ | 14:38 |
| *** larstobi has joined #tripleo | 14:39 | |
| shardy | rook: http://paste.openstack.org/show/584850/ shows how you can check the heat metadata, independent of anything happning on the node | 14:42 |
| shardy | rook: the stalled Deployment ID should be in the deployment list there | 14:42 |
| shardy | rook: if it's a large deployment you may want to avoid resource-list -n5 and just find the stack name via e.g heat stack-list -n | 14:43 |
| rook | shardy :) | 14:43 |
| dprince | shardy: still getting it. I must be missing something: http://paste.openstack.org/show/584848/ | 14:45 |
| rook | shardy: ill wait for the timeout and try again... debugging this is like a blackhole sometimes. | 14:48 |
| *** pcaruana has quit IRC | 14:49 | |
| EmilienM | dprince: the step thing? | 14:52 |
| EmilienM | dprince: did you update tht I guess? | 14:52 |
| larsks | shardy, figured it out. There is an environment file with an empty parameter_defaults: section, which means that at some point old.get('parameter_defaults', {}) is None, which in turn calls deep_update(None, {...}) | 14:53 |
| *** larsks has left #tripleo | 14:53 | |
| *** larsks has joined #tripleo | 14:53 | |
| shardy | larsks: aha! | 14:53 |
| shardy | larsks: that sounds like something we should tolerate in the client, care to raise a bug and/or post a patch? :) | 14:53 |
| dprince | EmilienM: yep | 14:54 |
| EmilienM | :( | 14:54 |
| EmilienM | dtantsur: my patch works ! | 14:54 |
| larsks | Sure. There is a bug that was fixed in master that corrects the environment files (https://bugs.launchpad.net/tripleo/+bug/1629315), but I agree the client should probably handle this better. | 14:54 |
| openstack | Launchpad bug 1629315 in tripleo "Can't use logging-environment.yaml on overcloud deployment" [High,Fix released] - Assigned to Juan Badia Payno (jbadiapa) | 14:54 |
| EmilienM | dprince, shardy: can you guys review this critical patch please https://review.openstack.org/#/c/383746/ | 14:54 |
| larsks | But we should also backport the fix. | 14:55 |
| EmilienM | dprince, shardy: it's a race condition on undercloud | 14:55 |
| dtantsur | EmilienM, \o/ | 14:55 |
| EmilienM | dtantsur: with puppet 4.6 | 14:55 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: Fixed NoneType issue when logging-environment.yaml is used https://review.openstack.org/383776 | 14:55 |
| larsks | Which is that ^^^^ | 14:55 |
| EmilienM | dtantsur: thanks for your help to tracking it | 14:55 |
| dtantsur | you're welcome :) | 14:56 |
| EmilienM | dtantsur: wait, let's not claim victory | 14:56 |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-common: Validate the nodes_json input during registration https://review.openstack.org/383764 | 14:56 |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-common: Make validation inputs configurable via Mistral https://review.openstack.org/383763 | 14:56 |
| EmilienM | dtantsur: i'm still waiting to confirm my fix it actually making runs consistent | 14:57 |
| dprince | EmilienM: wouldn't this impact the overcloud too now? | 14:57 |
| EmilienM | dtantsur: but I ran 2 OVB jobs and they passed | 14:57 |
| EmilienM | dprince: yes problably | 14:57 |
| *** limao has quit IRC | 14:58 | |
| *** jlinkes__ has quit IRC | 14:58 | |
| *** limao has joined #tripleo | 14:58 | |
| dprince | EmilienM: I commented | 14:58 |
| dprince | on the patch | 14:59 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 14:59 |
| EmilienM | dprince: there is no step on undercloud | 14:59 |
| thrash | d0ugal: i seriously doubt that this update has worked for a LONG time. | 14:59 |
| EmilienM | dprince: I made it one step | 14:59 |
| d0ugal | thrash: lol | 14:59 |
| d0ugal | thrash: since Mitaka? | 14:59 |
| dprince | EmilienM: why? To save time? | 14:59 |
| thrash | d0ugal: maybe. | 15:00 |
| EmilienM | dprince: yes. | 15:00 |
| *** davidlenwell has quit IRC | 15:00 | |
| EmilienM | we saved 10 min | 15:00 |
| EmilienM | dprince: I did that in Mitaka I think | 15:00 |
| thrash | d0ugal: UpdateIdentifier isn't being set. I think it needs to be passed as a parameter_default | 15:00 |
| thrash | but it's being passed in parameters, and that's just not working. | 15:00 |
| d0ugal | thrash: dang | 15:01 |
| d0ugal | thrash: so, is it working now? | 15:01 |
| thrash | d0ugal: I'm working on fixing that. | 15:01 |
| shardy | thrash: everything needs to be passed via parameter_defaults | 15:01 |
| shardy | especially UpdateIdentifier as it's consumed in nested templates | 15:01 |
| thrash | shardy: thank you for confirming that. :) | 15:01 |
| *** davidlenwell has joined #tripleo | 15:02 | |
| *** ChanServ sets mode: +v davidlenwell | 15:02 | |
| thrash | shardy: Like I said, I don't think the package update command has worked for quite some time. (Which means that, obviously, no one is *actually* using it) | 15:02 |
| d0ugal | thrash: lol :( | 15:02 |
| larsks | shardy, filed https://bugs.launchpad.net/python-heatclient/+bug/1631408 | 15:02 |
| openstack | Launchpad bug 1631408 in python-heatclient "An empty parameter_defaults section in an environment breaks deployment" [Undecided,New] | 15:02 |
| d0ugal | thrash: so we should delete it rather than fixing it then... | 15:02 |
| EmilienM | dprince: all ovb are currently failing | 15:03 |
| dprince | EmilienM: well I think that landed in July so fair enough, I'm just ware of chains sometimes | 15:03 |
| rbrady | shardy: what about parameter_defaults and passwords saved in the plan (mistral env)? | 15:03 |
| dprince | EmilienM: they cause cryptic issues on occasion | 15:03 |
| thrash | d0ugal: well.... | 15:03 |
| thrash | d0ugal: I'm ok with fixing. | 15:03 |
| shardy | rbrady: yup, everything, definitely passwords etc | 15:03 |
| thrash | hell, I almost insist on it given the amount of time I've spent. :D | 15:03 |
| shardy | we shouldn't be passing anything at all via parameters, everything should be parameter_defaults | 15:04 |
| ccamacho | slagle I think EmilienM was just joining | 15:04 |
| EmilienM | ccamacho: no worries | 15:05 |
| slagle | well he didnt join in time | 15:05 |
| EmilienM | I have nothing to say specific | 15:05 |
| EmilienM | slagle: right, my bad. | 15:05 |
| *** dmanchad has quit IRC | 15:05 | |
| ccamacho | EmilienM well how was at the end the deadline for Newton GA? All the submissions have landed? | 15:06 |
| EmilienM | ccamacho: https://review.openstack.org/#/q/status:open+topic:tripleo/rc3 | 15:06 |
| shardy | ccamacho: No, there's still a couple of critical tripleoclient bugs | 15:06 |
| *** jlinkes has joined #tripleo | 15:07 | |
| EmilienM | everyone: OVB will fail until we got https://review.openstack.org/#/c/383746/ merged FYI (waiting for CI result to approve it) | 15:07 |
| ccamacho | anything I might help with reviews/testing? Ill check the submission from that list | 15:08 |
| *** dmanchad has joined #tripleo | 15:08 | |
| *** rajinir has joined #tripleo | 15:08 | |
| *** ebarrera has quit IRC | 15:09 | |
| *** r-mibu has quit IRC | 15:09 | |
| *** limao has quit IRC | 15:09 | |
| *** r-mibu has joined #tripleo | 15:09 | |
| rbrady | shardy: maybe the code for merging local files and updating a plan should be a common function | 15:09 |
| shardy | ccamacho: https://review.openstack.org/#/c/379547/ fixes one of the remaining bugs and would benefit from some reviews (not yet passed CI tho) | 15:10 |
| shardy | rbrady: Yeah, agreed | 15:10 |
| shardy | In https://review.openstack.org/#/c/379547/ I started refactoring things into functions which should help with that I think | 15:10 |
| shardy | we can move them into a common location in some future patch | 15:11 |
| ccamacho | ack | 15:11 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common: Make UpdateManager use a passed-in stack setup https://review.openstack.org/383708 | 15:11 |
| *** ohamada__ has quit IRC | 15:11 | |
| *** lucasagomes is now known as lucas-hungry | 15:13 | |
| *** dmanchad has quit IRC | 15:14 | |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo: Only run ceilometer::db::sync on bootstrap node https://review.openstack.org/380414 | 15:17 |
| *** panbalag has joined #tripleo | 15:19 | |
| *** panbalag has left #tripleo | 15:20 | |
| *** dmanchad has joined #tripleo | 15:20 | |
| *** aufi has quit IRC | 15:21 | |
| EmilienM | dprince: so I reproduce your step problem | 15:21 |
| EmilienM | http://logs.openstack.org/46/383746/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/fc618ff/logs/postci.txt.gz#_2016-10-07_15_11_21_000 | 15:21 |
| *** panbalag has joined #tripleo | 15:22 | |
| *** cwolferh has quit IRC | 15:22 | |
| EmilienM | dprince: the problem should be fixed now, puppet4 was reverted in RDO | 15:23 |
| EmilienM | we now have puppet3 again | 15:23 |
| dprince | EmilienM: so, I only saw it on the controller though | 15:24 |
| dprince | EmilienM: it was like it was more related to heat hooks than hiera | 15:24 |
| *** panda is now known as panda|bbl | 15:24 | |
| EmilienM | dprince: me too at step 2 | 15:24 |
| EmilienM | err step 1 sorry | 15:24 |
| dprince | EmilienM: is there a bug on this? It happened at step 1 for me and only on the controller | 15:24 |
| EmilienM | dprince: no bug | 15:25 |
| mwhahaha | didn't we fix that string to int conversion that was happening in heat? | 15:25 |
| dprince | EmilienM: I'd like to understand more because it doesn't make sense yet | 15:25 |
| EmilienM | dprince: it's probably a puppet4 thing | 15:25 |
| EmilienM | that I missed to catch when I worked on it | 15:25 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 15:25 |
| dprince | EmilienM: I saw this in the hiera file directly. Nothing to do with puppet 4 other than it actually made me notice it | 15:25 |
| EmilienM | dprince: I'm re-enabling ^ to work again on it | 15:25 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 15:26 |
| *** tremble has quit IRC | 15:26 | |
| dprince | EmilienM: what I'm saying, is this is likely still broken. Puppet 3 won't care though I think | 15:26 |
| EmilienM | dprince: what did you see in hiera file? | 15:26 |
| dprince | "step": "1" | 15:26 |
| dprince | only on the controller | 15:26 |
| dprince | and "step": 1 | 15:26 |
| dprince | on all other nodes | 15:26 |
| EmilienM | oh weird | 15:26 |
| EmilienM | it's not a puppet thing | 15:27 |
| dprince | EmilienM: exactly, so I'd just as soon not revert puppet4 yet FWIW | 15:27 |
| mwhahaha | EmilienM, dprince: I thought we had to add a type: number to a parameter in tht for that | 15:27 |
| dprince | mwhahaha: we do, it is an integer there now | 15:27 |
| mwhahaha | in all places? | 15:27 |
| *** rlandy is now known as rlandy|hw | 15:27 | |
| dprince | mwhahaha: and it seems to work on all the nodes except my controller. Which made me think I did something locally | 15:27 |
| mwhahaha | if its just the controller it seems like we missed a spot | 15:27 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/config.role.j2.yaml#L31 | 15:28 |
| shardy | mwhahaha: we use a common file for all roles now | 15:28 |
| dprince | mwhahaha: we'll. It could be an evil caching issue | 15:28 |
| shardy | so unless someone has some custom controller-config.yaml file it should, in theory, all be the same | 15:28 |
| dprince | mwhahaha: because I updated my templates... but I was still using the same undercloud, etc | 15:28 |
| dprince | shardy: right, I think this may be a caching but related to all the recent t-h-t changes | 15:28 |
| *** davidlenwell has quit IRC | 15:29 | |
| mwhahaha | ah ok | 15:29 |
| dprince | shardy: all I did was 'git pull' and then redeploy using new t-h-t templates. And then I got this | 15:29 |
| shardy | dprince: Yeah - did you pass -e overcloud-resource-registry.yaml to pull in the new controller-config.yaml? | 15:29 |
| shardy | dprince: updating an existing overcloud deployment? | 15:29 |
| dprince | shardy: I tried both actually, updates, and a fresh create | 15:30 |
| *** kjw3 has quit IRC | 15:30 | |
| dprince | shardy: I just now slicked my entire undercloud to see if it helps | 15:30 |
| *** eglynn has quit IRC | 15:30 | |
| shardy | dprince: Hmm, weird - the fresh deploy should definitely use all the new stuff | 15:30 |
| dprince | shardy: trying again now. I'll know in a couple minutes | 15:31 |
| dprince | EmilienM: I personally would've kept puppet4 in RDO. At least until we know more about this | 15:31 |
| EmilienM | dprince: no, it broke packstack they are not ready | 15:31 |
| EmilienM | dprince: so it blocks promotions | 15:32 |
| EmilienM | dprince: we're re-enabling it next week after the fire | 15:32 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Remove the duplication of Workbook in the description. https://review.openstack.org/383797 | 15:32 |
| dprince | EmilienM: okay, if there was other fallout fair enough | 15:32 |
| EmilienM | yeah | 15:32 |
| dprince | EmilienM: your message implied this was the primary reason for the revert. And I don't know enough about it yet to answer that | 15:32 |
| derekh | pradk am I right in saying your the ceilometer guy? | 15:33 |
| EmilienM | dprince: my bad, I didn't give all context | 15:33 |
| EmilienM | derekh: he's our Telemetry guy! :) | 15:33 |
| derekh | pradk: I'm wondering how best to deal this all this data on out undercloud 24G /var/lib/mysql/ceilometer/sample.ibd | 15:33 |
| *** athomas has quit IRC | 15:33 | |
| pradk | derekh, sure | 15:34 |
| pradk | derekh, hmm dont we disable ceilo on undercloud today? | 15:34 |
| pradk | by default | 15:34 |
| derekh | pradk: maybe, the undercloud in question is mitaka, so maybe it wasn't disabled back then? | 15:35 |
| pradk | derekh, ah yep | 15:35 |
| pradk | derekh, so whats your question? you want to know what this data is? | 15:36 |
| *** panbalag has quit IRC | 15:36 | |
| *** fzdarsky is now known as fzdarsky|afk | 15:37 | |
| *** numans has quit IRC | 15:37 | |
| pradk | derekh, by default ceilo gathers all meters and events it can get via msg bus and api polling .. | 15:37 |
| derekh | pradk: the question is, if I disable all the ceilometer and Aodh services, and purge that table, will everything be ok? | 15:37 |
| derekh | pradk: essentially out disk is full ;-) | 15:38 |
| derekh | *our | 15:38 |
| pradk | derekh, you can tweak the pipeline to not collect everything | 15:38 |
| pradk | derekh, so yea if you want to just shut it down.. you can | 15:38 |
| pradk | derekh, assuming you dont care about that data | 15:38 |
| tbarron | shardy: I've been using https://review.openstack.org/#/c/379547/ to address https://bugs.launchpad.net/tripleo/+bug/1624727 but | 15:38 |
| openstack | Launchpad bug 1624727 in tripleo "Could not fetch contents for file:///home/stack/tripleo-heat-templates/puppet/post.yaml" [Critical,In progress] - Assigned to Steven Hardy (shardy) | 15:38 |
| tbarron | shardy: am now getting "Exception updating plan: Error rendering template puppet/config.role.j2.yaml : 'role' is undefined" | 15:38 |
| tbarron | shardy: http://paste.fedoraproject.org/445636/14758542/ has more details | 15:38 |
| tbarron | shardy: if this is expected or I'm deploying wrong just move on ahead, this isn't critical for me atm, I'm mentioning it just in case it is relevant to your work. | 15:38 |
| shardy | tbarron: sounds like you're using a recent t-h-t with an older tripleo-common | 15:39 |
| derekh | pradk: I recall on the overcloud when they shut down ceilometer some rabbit queues got huge, do I need to prevent that some where? | 15:39 |
| tbarron | shardy: k, let me update tripleo-common, sorry for the noise | 15:39 |
| pradk | derekh, so if you shut down ceilo entirely.. make sure the services are not publishing notification data | 15:39 |
| shardy | tbarron: np, you'll need to run mistral-db populate and restart the mistral services after you update | 15:40 |
| shardy | (or re-run openstack undercloud install) | 15:40 |
| pradk | derekh, otherwise rabbit queu will fill up without any consumers to grab | 15:40 |
| derekh | pradk: ack, ok will give it a go, thanks | 15:40 |
| pradk | derekh, cool | 15:41 |
| tbarron | shardy: ack | 15:41 |
| *** jlinkes has quit IRC | 15:43 | |
| *** davidlenwell has joined #tripleo | 15:48 | |
| *** ChanServ sets mode: +v davidlenwell | 15:48 | |
| *** chem has quit IRC | 15:51 | |
| *** chem has joined #tripleo | 15:52 | |
| *** chem has quit IRC | 15:52 | |
| *** chem has joined #tripleo | 15:52 | |
| *** panbalag_ has joined #tripleo | 15:55 | |
| openstackgerrit | Merged openstack/puppet-pacemaker: Pin beaker to < 3.0.0 https://review.openstack.org/383184 | 15:55 |
| *** bana_k has joined #tripleo | 15:55 | |
| *** penick has joined #tripleo | 16:00 | |
| *** tesseract- has quit IRC | 16:00 | |
| thrash | d0ugal: it's working! \o/ | 16:00 |
| thrash | hit a second breakpoint! | 16:00 |
| d0ugal | Nice one! | 16:00 |
| jrist | !!! | 16:00 |
| openstack | jrist: Error: "!!" is not a valid command. | 16:00 |
| d0ugal | lol | 16:00 |
| *** rcernin_ has quit IRC | 16:01 | |
| d0ugal | thrash: ship it! | 16:02 |
| thrash | bahaha | 16:03 |
| thrash | d0ugal: rbrady https://review.openstack.org/#/c/383708/ https://review.openstack.org/#/c/381899/ should be working now. | 16:03 |
| *** akuznetsov has joined #tripleo | 16:04 | |
| thrash | I still need to document though that at least for now, the --templates and --environment-file args are ignored. | 16:04 |
| thrash | d0ugal: IMHO I think the only command that should create/update plans is overcloud deploy | 16:05 |
| thrash | d0ugal: any other commands that deal with a plan should use it as is | 16:05 |
| d0ugal | thrash: and plan create :) | 16:05 |
| d0ugal | thrash: agreed | 16:05 |
| thrash | d0ugal: well, yes. | 16:05 |
| thrash | d0ugal: :P | 16:05 |
| thrash | I think you understand though what I'm getting at. :) | 16:05 |
| d0ugal | thrash: Indeed. | 16:06 |
| d0ugal | thrash: Why are they ignored? | 16:06 |
| thrash | d0ugal: for backcompoat | 16:06 |
| thrash | compat | 16:06 |
| d0ugal | thrash: that makes no sense, but I'll take your word for it lol | 16:06 |
| d0ugal | thrash: They were always ignored? | 16:06 |
| thrash | no | 16:06 |
| thrash | but if someone wrote a script that used them, that script w0uld now fail without a proper deprecation period. | 16:07 |
| thrash | But, I think we need to get consensus before actually deprecating them. | 16:07 |
| thrash | I plan to write an email to the ML | 16:07 |
| d0ugal | right | 16:07 |
| d0ugal | thrash: but they are not needed now because the info is in the plan? | 16:08 |
| thrash | I think it simplifies the whole system. | 16:08 |
| thrash | d0ugal: correct | 16:08 |
| d0ugal | okay, now I understand. That is much better IMO | 16:08 |
| thrash | I think so too... | 16:08 |
| *** cwolferh has joined #tripleo | 16:08 | |
| thrash | rbrady is doing the same thing with node delete (I think) | 16:08 |
| thrash | ok... time for some lunch. | 16:08 |
| *** thrash is now known as thrash|f00dz | 16:09 | |
| *** derekh has quit IRC | 16:13 | |
| trozet | EmilienM, beagles: do you mind reviewing https://review.openstack.org/#/c/381160/ ? | 16:14 |
| EmilienM | trozet: done | 16:16 |
| trozet | EmilienM: ty | 16:16 |
| *** mcornea has quit IRC | 16:16 | |
| openstackgerrit | Merged openstack/puppet-pacemaker: Changed the home-page to point Openstack Puppet Homepage https://review.openstack.org/381582 | 16:16 |
| *** abregman has joined #tripleo | 16:17 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: start cloud-init-local in the boot runlevel https://review.openstack.org/383811 | 16:17 |
| *** abregman has quit IRC | 16:17 | |
| *** kjw3 has joined #tripleo | 16:19 | |
| trozet | EmilienM, beagles: also this cherry pick if you don't mind ( https://review.openstack.org/#/c/382541/) | 16:19 |
| *** lucas-hungry is now known as lucasagomes | 16:19 | |
| EmilienM | done | 16:20 |
| trozet | thanks | 16:20 |
| *** jpich has quit IRC | 16:21 | |
| *** zoliXXL is now known as zoli|gone | 16:23 | |
| *** dtantsur is now known as dtantsur|afk | 16:23 | |
| zoli|gone | have a good weekend | 16:25 |
| *** zoli|gone is now known as zoli_gone-proxy | 16:26 | |
| *** bana_k has quit IRC | 16:27 | |
| gfidente | have good we tripleo | 16:28 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient: WIP fix for get_file on external files https://review.openstack.org/383813 | 16:31 |
| *** coolsvap has quit IRC | 16:36 | |
| *** absubram has quit IRC | 16:37 | |
| *** hewbrocca is now known as hewbrocca-afk | 16:41 | |
| *** mburned is now known as mburned_out | 16:42 | |
| *** thrash|f00dz is now known as thrash | 16:42 | |
| *** spredzy has quit IRC | 16:43 | |
| *** akuznetsov has quit IRC | 16:43 | |
| *** spredzy has joined #tripleo | 16:44 | |
| *** gfidente has quit IRC | 16:45 | |
| openstackgerrit | Merged openstack/instack-undercloud: start ironic-(api|inspector) after Keystone_endpoint https://review.openstack.org/383746 | 16:46 |
| *** tosky has quit IRC | 16:49 | |
| panda|bbl | EmilienM: did you ever see this ? http://logs.openstack.org/15/382515/8/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/921e1ec/console.html#_2016-10-07_13_47_31_067578 | 16:50 |
| EmilienM | yes | 16:51 |
| EmilienM | panda|bbl: it's fixed now in master | 16:51 |
| EmilienM | panda|bbl: https://review.openstack.org/383746 | 16:51 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: start ironic-(api|inspector) after Keystone_endpoint https://review.openstack.org/383821 | 16:51 |
| EmilienM | the backport ^ | 16:51 |
| panda|bbl | EmilienM: ok, I'll recheck. Also, did you read bnemec comment and mine ? Do we continue to proceed with this attempt ? | 16:52 |
| EmilienM | panda|bbl: where? | 16:52 |
| panda|bbl | EmilienM: comments on patchset 4 https://review.openstack.org/382515 | 16:54 |
| *** panda|bbl is now known as panda|bbl|buther | 16:55 | |
| *** panda|bbl|buther is now known as panda|bbl|here | 16:55 | |
| *** david-lyle_ has joined #tripleo | 16:55 | |
| EmilienM | panda|bbl|here: I see | 16:55 |
| EmilienM | shardy: how do you feel to merge https://review.openstack.org/#/c/379547/ ? | 16:57 |
| *** david-lyle_ has quit IRC | 16:57 | |
| EmilienM | shardy: OVB jobs is broken until puppet gets downgraded in http://buildlogs.centos.org/centos/7/cloud/x86_64/openstack-ocata/?C=M;O=D but it takes forever | 16:57 |
| *** trown is now known as trown|lunch | 16:58 | |
| shardy | EmilienM: I'd feel happier if the ovb jobs had passed, but if folks can perhaps try it manually then I'd say we can land it | 16:59 |
| shardy | I've tested it quite a lot locally and it works well for me | 16:59 |
| EmilienM | shardy: it passed multinode job, and in this case I think it's enough | 17:00 |
| shardy | EmilienM: ack, yeah I guess so - I think matbu tested locally too and found it works OK | 17:01 |
| shardy | I've nearly finished the next part which fixes bug #1625783 | 17:01 |
| openstack | bug 1625783 in tripleo "unable to leverage swap-partition extraconfig" [High,In progress] https://launchpad.net/bugs/1625783 - Assigned to Steven Hardy (shardy) | 17:01 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Serialize AllNodesDeployment and UpdateWorkflow https://review.openstack.org/383642 | 17:01 |
| shardy | I'll post it before I finish for today, but I'm probably going to run out of time to write the unit tests | 17:01 |
| * shardy is testing it manually right now | 17:02 | |
| EmilienM | I'll let reviewers to vote: https://review.openstack.org/#/c/379547/ - urgent | 17:02 |
| EmilienM | shardy: I'm submitting the backport and see if CI works | 17:03 |
| EmilienM | shardy: the CI is good in stable/newton | 17:03 |
| shardy | EmilienM: ack, good plan, thanks | 17:03 |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/383825 | 17:03 |
| *** amoralej is now known as amoralej|off | 17:04 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Renames OpenDaylight to OpenDaylightApi and splits out OVS configuration https://review.openstack.org/381160 | 17:04 |
| weshay | hrm.. lots of node regsitration failures | 17:06 |
| *** david-lyle_ has joined #tripleo | 17:06 | |
| EmilienM | weshay: yes it's fixed | 17:07 |
| *** david-lyle_ has quit IRC | 17:07 | |
| EmilienM | weshay: https://review.openstack.org/383746 | 17:07 |
| *** david-lyle_ has joined #tripleo | 17:08 | |
| *** rasca has quit IRC | 17:08 | |
| weshay | cool.. thanks EmilienM | 17:08 |
| *** david-lyle_ is now known as david-lyle | 17:09 | |
| *** abregman has joined #tripleo | 17:10 | |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient: Allow referencing rendered yaml files in resource_registry https://review.openstack.org/383829 | 17:10 |
| shardy | EmilienM, mwhahaha: ^^ that fixes bug #1625783 I believe | 17:11 |
| openstack | bug 1625783 in tripleo "unable to leverage swap-partition extraconfig" [High,In progress] https://launchpad.net/bugs/1625783 - Assigned to Steven Hardy (shardy) | 17:11 |
| shardy | I've not got time to write unit tests today, but I can post a follow-up next week which adds coverage | 17:11 |
| shardy | will comment on the bug to that effect | 17:11 |
| EmilienM | shardy: maybe we can send it first and write unit tests afterwards and backport it | 17:12 |
| *** jpena is now known as jpena|off | 17:12 | |
| EmilienM | not optimal but we don't have choice here | 17:12 |
| shardy | EmilienM: Yeah, agreed - if folks are OK with the fix I'd say we send it and I'll add/backport tests next week | 17:14 |
| EmilienM | ok | 17:14 |
| *** anshul has quit IRC | 17:17 | |
| *** pblaho has quit IRC | 17:19 | |
| *** yamahata has quit IRC | 17:23 | |
| *** panda|bbl|here is now known as panda|bbl | 17:24 | |
| *** pkovar has quit IRC | 17:25 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates: Add new environment for debug https://review.openstack.org/383753 | 17:27 |
| *** shardy has quit IRC | 17:27 | |
| openstackgerrit | Merged openstack/diskimage-builder: Add pkg-map for gentoo to runtime-ssh-host-keys https://review.openstack.org/383126 | 17:28 |
| *** bana_k has joined #tripleo | 17:32 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/383838 | 17:35 |
| *** absubram has joined #tripleo | 17:38 | |
| *** rbrady is now known as rbrady-brb | 17:45 | |
| *** rwsu_ has quit IRC | 17:56 | |
| *** rwsu has joined #tripleo | 17:56 | |
| *** trown|lunch is now known as trown | 18:01 | |
| *** bana_k has quit IRC | 18:02 | |
| *** yamahata has joined #tripleo | 18:02 | |
| *** bana_k has joined #tripleo | 18:13 | |
| *** yamahata has quit IRC | 18:14 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common: Make UpdateManager use a passed-in stack setup https://review.openstack.org/383708 | 18:18 |
| EmilienM | slagle: any chance to review https://review.openstack.org/#/c/383821/ ? | 18:18 |
| *** rlandy|hw is now known as rlandy | 18:20 | |
| *** jeckersb is now known as jeckersb_gone | 18:25 | |
| *** akrivoka has quit IRC | 18:27 | |
| *** paramite has quit IRC | 18:30 | |
| EmilienM | seeing this error in mitaka CI | 18:31 |
| EmilienM | http://logs.openstack.org/09/371209/30/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-mitaka/4bd5574/console.html#_2016-10-07_16_15_49_062457 | 18:31 |
| *** abregman has quit IRC | 18:36 | |
| EmilienM | any core around to help in reviews? | 18:38 |
| thrash | EmilienM: o/ | 18:38 |
| EmilienM | https://review.openstack.org/#/q/status:open+topic:tripleo/rc3 | 18:38 |
| EmilienM | i'm about to request RC3 in a few hours | 18:38 |
| EmilienM | in 1h to be precise | 18:38 |
| trown | looking | 18:45 |
| *** yamahata has joined #tripleo | 18:45 | |
| EmilienM | ok nevermind, I won't release this afternoon | 18:46 |
| EmilienM | we have blockers in gate, rushing won't help us | 18:47 |
| *** kjw3 has quit IRC | 18:47 | |
| EmilienM | I'll propose the release this week end or Monday | 18:47 |
| trown | k, not familiar enough to review the tripleo-common mistral stuff | 18:50 |
| *** openstackgerrit has quit IRC | 18:50 | |
| trown | at least not quickly | 18:50 |
| EmilienM | trown: no problem | 18:50 |
| *** openstackgerrit has joined #tripleo | 18:50 | |
| trown | everything else looks like it is +W | 18:50 |
| *** milan has quit IRC | 18:54 | |
| *** absubram has quit IRC | 18:56 | |
| *** david-lyle has quit IRC | 18:56 | |
| *** panbalag_ has quit IRC | 18:56 | |
| *** r-mibu has quit IRC | 18:56 | |
| *** noslzzp has quit IRC | 18:56 | |
| *** afazekas has quit IRC | 18:56 | |
| *** Goneri has quit IRC | 18:56 | |
| *** cdearborn has quit IRC | 18:56 | |
| *** TSCHAK has quit IRC | 18:56 | |
| *** ipsecguy_ has quit IRC | 18:56 | |
| *** d0ugal has quit IRC | 18:56 | |
| *** kaslcrof has quit IRC | 18:57 | |
| *** akrzos has quit IRC | 18:57 | |
| *** cschwede has quit IRC | 18:57 | |
| *** panda|bbl has quit IRC | 18:57 | |
| *** amoralej|off has quit IRC | 18:57 | |
| *** jistr has quit IRC | 18:57 | |
| *** timothyb89 has quit IRC | 18:57 | |
| *** lhinds|away has quit IRC | 18:57 | |
| *** mburned_out has quit IRC | 18:57 | |
| *** bswartz has quit IRC | 18:57 | |
| *** shadower has quit IRC | 18:57 | |
| *** rcarrillocruz has quit IRC | 18:57 | |
| *** jayg has quit IRC | 18:57 | |
| *** thrash has quit IRC | 18:57 | |
| *** pabelanger has quit IRC | 18:57 | |
| *** zoli_gone-proxy has quit IRC | 18:57 | |
| *** afazekas has joined #tripleo | 18:57 | |
| *** ipsecguy has joined #tripleo | 18:57 | |
| *** cschwede has joined #tripleo | 18:57 | |
| *** jayg has joined #tripleo | 18:57 | |
| *** mburned_out has joined #tripleo | 18:57 | |
| *** r-mibu has joined #tripleo | 18:57 | |
| *** Goneri has joined #tripleo | 18:57 | |
| *** cschwede has quit IRC | 18:57 | |
| *** cschwede has joined #tripleo | 18:57 | |
| *** jayg has quit IRC | 18:57 | |
| *** jayg has joined #tripleo | 18:57 | |
| *** jistr has joined #tripleo | 18:57 | |
| *** mburned_out has quit IRC | 18:57 | |
| *** mburned_out has joined #tripleo | 18:57 | |
| *** shadower has joined #tripleo | 18:57 | |
| *** zoli_gone-proxy has joined #tripleo | 18:57 | |
| *** kaslcrof has joined #tripleo | 18:57 | |
| *** panda|bbl has joined #tripleo | 18:57 | |
| *** absubram has joined #tripleo | 18:57 | |
| *** panbalag_ has joined #tripleo | 18:57 | |
| *** akrzos has joined #tripleo | 18:57 | |
| *** akrzos has quit IRC | 18:57 | |
| *** akrzos has joined #tripleo | 18:57 | |
| *** david-lyle has joined #tripleo | 18:57 | |
| *** pabelanger has joined #tripleo | 18:57 | |
| *** cdearborn has joined #tripleo | 18:57 | |
| *** rcarrillocruz has joined #tripleo | 18:57 | |
| *** d0ugal has joined #tripleo | 18:58 | |
| *** TSCHAK has joined #tripleo | 18:58 | |
| *** amoralej has joined #tripleo | 18:58 | |
| *** timothyb89 has joined #tripleo | 18:58 | |
| *** lhinds has joined #tripleo | 18:58 | |
| *** thrash has joined #tripleo | 18:59 | |
| *** thrash has joined #tripleo | 18:59 | |
| *** noslzzp has joined #tripleo | 19:00 | |
| *** jefrite has quit IRC | 19:01 | |
| panbalag_ | Trying to create an environment file like (https://github.com/openstack/tripleo-heat-templates/blob/master/environments/neutron-sriov.yaml) but specific to nova configurations. Can't find any docs on how to translate configs to a .yml environment file (say configs found in /etc/nova/nova.conf to a .yml). any pointers on this one? | 19:01 |
| *** mbozhenko has joined #tripleo | 19:03 | |
| EmilienM | panbalag_: are you familiar with how tripleo works? we use puppet for configuration management | 19:06 |
| *** dsneddon_ has joined #tripleo | 19:07 | |
| panbalag_ | EmilienM: nope. This is the first time I'm using it, so any pointers would be helpful. | 19:07 |
| *** mbozhenko has quit IRC | 19:08 | |
| *** cwolferh has quit IRC | 19:08 | |
| *** dprince has quit IRC | 19:08 | |
| *** jbadiapa has quit IRC | 19:08 | |
| *** mwhahaha has quit IRC | 19:08 | |
| *** dhill_ has quit IRC | 19:08 | |
| *** sshnaidm|away has quit IRC | 19:08 | |
| *** oshvartz has quit IRC | 19:08 | |
| *** Ng has quit IRC | 19:08 | |
| *** eggmaster has quit IRC | 19:08 | |
| *** jpena|off has quit IRC | 19:08 | |
| *** stevebaker has quit IRC | 19:08 | |
| *** null_ref has quit IRC | 19:09 | |
| *** jroll has quit IRC | 19:09 | |
| *** slagle has quit IRC | 19:09 | |
| *** bvandenh has quit IRC | 19:09 | |
| *** dprince has joined #tripleo | 19:09 | |
| *** slagle has joined #tripleo | 19:09 | |
| *** cwolferh has joined #tripleo | 19:09 | |
| *** slagle has quit IRC | 19:09 | |
| *** slagle has joined #tripleo | 19:09 | |
| *** stevebaker has joined #tripleo | 19:09 | |
| *** dhill_ has joined #tripleo | 19:09 | |
| *** null_ref has joined #tripleo | 19:09 | |
| *** eggmaster has joined #tripleo | 19:09 | |
| *** jbadiapa has joined #tripleo | 19:09 | |
| *** bvandenh has joined #tripleo | 19:09 | |
| *** oshvartz has joined #tripleo | 19:09 | |
| *** sshnaidm|away has joined #tripleo | 19:09 | |
| *** jpena|off has joined #tripleo | 19:09 | |
| *** dsneddon is now known as dsneddon_1 | 19:09 | |
| *** jroll has joined #tripleo | 19:10 | |
| *** dsneddon_ is now known as dsneddon | 19:10 | |
| beagles | you know... I just noticed we have lines like 'assert message['status'] == "SUCCESS", pprint.pformat(message)'. I'm puzzling over whether that's what we really wanted there or not ... | 19:11 |
| beagles | i.e. is it actually debug code, or did we intend some kind of error handling | 19:11 |
| beagles | former would be okay, the latter would be bad | 19:11 |
| *** jefrite has joined #tripleo | 19:12 | |
| beagles | EmilienM: thoughts ^^^? Are there any workflow task gurus around? | 19:12 |
| *** jeckersb_gone is now known as jeckersb | 19:13 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Make step an integer on the pacemaker controller https://review.openstack.org/383884 | 19:14 |
| dprince | EmilienM: victory ^^ | 19:14 |
| EmilienM | dude, nice one | 19:14 |
| *** rbrady-brb is now known as rbrady | 19:17 | |
| *** mwhahaha has joined #tripleo | 19:17 | |
| *** Ng has joined #tripleo | 19:18 | |
| *** ChanServ sets mode: +v Ng | 19:18 | |
| *** openstackgerrit has quit IRC | 19:18 | |
| *** yamahata has quit IRC | 19:18 | |
| *** dmanchad has quit IRC | 19:18 | |
| *** trown has quit IRC | 19:18 | |
| *** ramishra_ has quit IRC | 19:18 | |
| *** fultonj has quit IRC | 19:18 | |
| *** lblanchard has quit IRC | 19:19 | |
| *** apetrich has quit IRC | 19:19 | |
| *** patrickeast has quit IRC | 19:19 | |
| *** yolanda has quit IRC | 19:19 | |
| *** jrist has quit IRC | 19:19 | |
| *** onovy has quit IRC | 19:19 | |
| *** igorbelikov has quit IRC | 19:19 | |
| *** greghaynes has quit IRC | 19:19 | |
| *** onovy has joined #tripleo | 19:19 | |
| *** fultonj has joined #tripleo | 19:19 | |
| *** jrist has joined #tripleo | 19:19 | |
| *** ramishra_ has joined #tripleo | 19:19 | |
| *** jrist has quit IRC | 19:19 | |
| *** jrist has joined #tripleo | 19:19 | |
| *** yolanda has joined #tripleo | 19:19 | |
| *** lblanchard has joined #tripleo | 19:19 | |
| *** apetrich has joined #tripleo | 19:19 | |
| *** yamahata has joined #tripleo | 19:19 | |
| *** greghaynes has joined #tripleo | 19:19 | |
| rbrady | beagles: ping re: asserts | 19:19 |
| beagles | rbrady: hey | 19:19 |
| *** openstackgerrit has joined #tripleo | 19:19 | |
| *** trown has joined #tripleo | 19:20 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 19:20 |
| *** dmanchad has joined #tripleo | 19:20 | |
| EmilienM | slagle, thrash: can you look https://review.openstack.org/#/c/379547/ please? | 19:21 |
| beagles | rbrady: yeah.. just wondering if they were meant to be "debug" code or if the intent was to throw an exception whenever an error happens. I'm a little iffy on the workflow task protocol with mistral, so I don't know either way. | 19:21 |
| beagles | rbrady: tbh.. I don't recall ever using assert in python myself either :) | 19:22 |
| rbrady | beagles: I think in the cases we're using this, it's when the client is calling a workflow and if it fails, there's really nothing we can do | 19:22 |
| beagles | rbrady: ah okay | 19:22 |
| rbrady | the assert works unless we run the code with python -o | 19:22 |
| beagles | yup | 19:22 |
| rbrady | I've not head of anyone doing the -o with openstack code | 19:23 |
| rbrady | mistral itself uses these asserts | 19:23 |
| beagles | rbrady: interesting. Okay I guess I can see this being useful for workflow debugging now that I think of it. | 19:26 |
| *** igorbelikov has joined #tripleo | 19:26 | |
| rbrady | beagles: cool | 19:26 |
| *** patrickeast has joined #tripleo | 19:29 | |
| *** gchamoul is now known as gchamoul|afk | 19:29 | |
| *** tzumainn has quit IRC | 19:31 | |
| *** pabelanger has quit IRC | 19:32 | |
| *** dciabrin has quit IRC | 19:32 | |
| *** pabelanger has joined #tripleo | 19:32 | |
| *** davidlenwell has quit IRC | 19:33 | |
| *** larstobi has quit IRC | 19:33 | |
| *** ansiwen has quit IRC | 19:33 | |
| *** dmsimard has quit IRC | 19:33 | |
| *** bfournie has quit IRC | 19:33 | |
| *** rhallisey has quit IRC | 19:33 | |
| *** kbyrne has quit IRC | 19:33 | |
| *** hrybacki has quit IRC | 19:33 | |
| *** weshay has quit IRC | 19:33 | |
| *** hogepodge has quit IRC | 19:33 | |
| *** social has quit IRC | 19:33 | |
| *** HenryG has quit IRC | 19:33 | |
| *** rbrady has quit IRC | 19:33 | |
| *** zigo has quit IRC | 19:33 | |
| *** trozet has quit IRC | 19:33 | |
| *** tdasilva has quit IRC | 19:33 | |
| *** zaneb has quit IRC | 19:33 | |
| *** NobodyCam has quit IRC | 19:33 | |
| *** vkmc has quit IRC | 19:33 | |
| *** tbarron has quit IRC | 19:33 | |
| *** zigo has joined #tripleo | 19:33 | |
| *** tbarron has joined #tripleo | 19:33 | |
| *** tdasilva has joined #tripleo | 19:33 | |
| *** tdasilva has quit IRC | 19:33 | |
| *** tdasilva has joined #tripleo | 19:33 | |
| *** trozet has joined #tripleo | 19:33 | |
| *** rbrady has joined #tripleo | 19:33 | |
| *** zaneb has joined #tripleo | 19:33 | |
| *** zigo is now known as Guest10079 | 19:33 | |
| *** dmsimard has joined #tripleo | 19:34 | |
| *** vkmc has joined #tripleo | 19:34 | |
| *** weshay has joined #tripleo | 19:34 | |
| *** social has joined #tripleo | 19:34 | |
| *** rhallisey has joined #tripleo | 19:34 | |
| *** bfournie has joined #tripleo | 19:34 | |
| *** HenryG has joined #tripleo | 19:34 | |
| *** davidlenwell has joined #tripleo | 19:34 | |
| *** ChanServ sets mode: +v davidlenwell | 19:34 | |
| *** ansiwen has joined #tripleo | 19:34 | |
| *** rajinir has quit IRC | 19:38 | |
| *** hogepodge has joined #tripleo | 19:38 | |
| *** larstobi has joined #tripleo | 19:38 | |
| *** kbyrne has joined #tripleo | 19:40 | |
| *** jcoufal has quit IRC | 19:41 | |
| *** rbrady has quit IRC | 19:41 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Include ceilometer in swift proxy pipeline https://review.openstack.org/371950 | 19:43 |
| *** NobodyCam has joined #tripleo | 19:43 | |
| *** hrybacki has joined #tripleo | 19:43 | |
| pradk | dmsimard, ^^ lets see how this goes | 19:43 |
| *** bana_k has quit IRC | 19:47 | |
| *** chem has quit IRC | 19:47 | |
| *** ramishra has quit IRC | 19:47 | |
| *** bkreitch has quit IRC | 19:47 | |
| *** dmacpher has quit IRC | 19:47 | |
| *** rlandy has quit IRC | 19:47 | |
| *** pradk has quit IRC | 19:47 | |
| *** ccamacho has quit IRC | 19:47 | |
| *** flepied has quit IRC | 19:47 | |
| *** dtrainor has quit IRC | 19:47 | |
| *** dsavineau has quit IRC | 19:47 | |
| *** dbecker has quit IRC | 19:47 | |
| *** gchamoul|afk has quit IRC | 19:47 | |
| *** flaper87 has quit IRC | 19:47 | |
| *** jtomasek has quit IRC | 19:47 | |
| *** dsneddon_1 has quit IRC | 19:47 | |
| *** Slower has quit IRC | 19:47 | |
| *** lifeless has quit IRC | 19:47 | |
| *** cmyster has quit IRC | 19:47 | |
| *** rook has quit IRC | 19:47 | |
| *** markmc has quit IRC | 19:47 | |
| *** hewbrocca-afk has quit IRC | 19:47 | |
| *** mandre has quit IRC | 19:47 | |
| *** bandini has quit IRC | 19:47 | |
| *** gregwork has quit IRC | 19:48 | |
| *** myoung has quit IRC | 19:48 | |
| *** Hazelesque has quit IRC | 19:48 | |
| *** toure has quit IRC | 19:48 | |
| *** lucasagomes has quit IRC | 19:48 | |
| *** SpamapS has quit IRC | 19:48 | |
| *** Jokke_ has quit IRC | 19:48 | |
| *** dobson has quit IRC | 19:48 | |
| *** EmilienM has quit IRC | 19:48 | |
| *** toure has joined #tripleo | 19:48 | |
| *** gchamoul has joined #tripleo | 19:48 | |
| *** chem has joined #tripleo | 19:48 | |
| *** ramishra has joined #tripleo | 19:48 | |
| *** cmyster has joined #tripleo | 19:48 | |
| *** jtomasek has joined #tripleo | 19:48 | |
| *** markmc has joined #tripleo | 19:48 | |
| *** hewbrocca-afk has joined #tripleo | 19:48 | |
| *** cmyster has quit IRC | 19:48 | |
| *** cmyster has joined #tripleo | 19:48 | |
| *** Hazelesque has joined #tripleo | 19:48 | |
| *** mandre has joined #tripleo | 19:48 | |
| *** rlandy has joined #tripleo | 19:48 | |
| *** lucasagomes has joined #tripleo | 19:48 | |
| *** ccamacho has joined #tripleo | 19:48 | |
| *** dbecker has joined #tripleo | 19:48 | |
| *** dtrainor has joined #tripleo | 19:48 | |
| *** gchamoul has quit IRC | 19:48 | |
| *** gchamoul has joined #tripleo | 19:48 | |
| *** hewbrocca-afk has quit IRC | 19:48 | |
| *** hewbrocca-afk has joined #tripleo | 19:48 | |
| *** toure has quit IRC | 19:48 | |
| *** toure has joined #tripleo | 19:48 | |
| *** Slower has joined #tripleo | 19:48 | |
| *** pradk has joined #tripleo | 19:48 | |
| *** markmc has quit IRC | 19:48 | |
| *** markmc has joined #tripleo | 19:48 | |
| *** flepied has joined #tripleo | 19:48 | |
| *** dsavineau has joined #tripleo | 19:48 | |
| *** lifeless has joined #tripleo | 19:48 | |
| *** Jokke_ has joined #tripleo | 19:48 | |
| *** bana_k has joined #tripleo | 19:48 | |
| *** bandini has joined #tripleo | 19:48 | |
| *** cmyster has quit IRC | 19:48 | |
| *** cmyster has joined #tripleo | 19:48 | |
| *** bkreitch has joined #tripleo | 19:48 | |
| *** lucasagomes has quit IRC | 19:48 | |
| *** lucasagomes has joined #tripleo | 19:48 | |
| *** cmyster has quit IRC | 19:48 | |
| *** cmyster has joined #tripleo | 19:48 | |
| *** rook has joined #tripleo | 19:48 | |
| *** bandini has quit IRC | 19:48 | |
| *** bandini has joined #tripleo | 19:48 | |
| *** Slower has quit IRC | 19:48 | |
| *** Slower has joined #tripleo | 19:48 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Fixed NoneType issue when logging-environment.yaml is used https://review.openstack.org/383776 | 19:48 |
| *** dobson has joined #tripleo | 19:48 | |
| *** SpamapS has joined #tripleo | 19:48 | |
| *** rook has quit IRC | 19:48 | |
| *** rook has joined #tripleo | 19:48 | |
| *** morazi has joined #tripleo | 19:48 | |
| *** rook is now known as Guest2483 | 19:48 | |
| *** EmilienM has joined #tripleo | 19:48 | |
| *** myoung has joined #tripleo | 19:49 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Release 5.3.0 (RC3) https://review.openstack.org/383711 | 19:49 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Add cloud names to hosts output https://review.openstack.org/382769 | 19:49 |
| *** dsneddon_1 has joined #tripleo | 19:50 | |
| *** Lokesh_Jain has quit IRC | 19:50 | |
| *** igorbelikov has quit IRC | 19:50 | |
| *** CaptTofu has quit IRC | 19:50 | |
| * beagles goes to feed wee-beasties, will be back much later and on and off on weekend | 19:51 | |
| *** lucasagomes is now known as lucas-afk | 19:52 | |
| *** rbrady has joined #tripleo | 19:54 | |
| *** panda|bbl is now known as panda | 19:56 | |
| *** leanderthal|afk has quit IRC | 19:56 | |
| *** mrunge has quit IRC | 19:56 | |
| *** jeckersb has quit IRC | 19:56 | |
| *** sai has quit IRC | 19:56 | |
| *** SlickNik has quit IRC | 19:56 | |
| *** ianw has quit IRC | 19:56 | |
| *** jmiu has quit IRC | 19:56 | |
| *** etp has quit IRC | 19:56 | |
| *** rdopiera has quit IRC | 19:56 | |
| *** jschlueter has quit IRC | 19:56 | |
| *** matbu has quit IRC | 19:56 | |
| *** jeckersb has joined #tripleo | 19:56 | |
| *** mrunge has joined #tripleo | 19:56 | |
| *** matbu has joined #tripleo | 19:56 | |
| *** etp has joined #tripleo | 19:56 | |
| *** panda is now known as Guest12976 | 19:56 | |
| *** SlickNik has joined #tripleo | 19:56 | |
| *** ianw has joined #tripleo | 19:56 | |
| *** sai has joined #tripleo | 19:56 | |
| *** rdopiera has joined #tripleo | 19:57 | |
| *** Guest12976 is now known as panda | 19:57 | |
| *** jmiu has joined #tripleo | 19:57 | |
| *** jschlueter has joined #tripleo | 19:57 | |
| *** tbarron has quit IRC | 19:58 | |
| *** rain has joined #tripleo | 19:58 | |
| *** rain is now known as Guest35658 | 19:58 | |
| openstackgerrit | Merged openstack/instack-undercloud: start ironic-(api|inspector) after Keystone_endpoint https://review.openstack.org/383821 | 19:59 |
| *** onovy has quit IRC | 19:59 | |
| dmsimard | pradk: ok yeah, same error in messages that includes the previous patch | 20:02 |
| dmsimard | pradk: let's see if my approach works better | 20:02 |
| pradk | dmsimard, your patch fails with lint issues.. can you check | 20:02 |
| *** gregwork has joined #tripleo | 20:02 | |
| openstackgerrit | Ryan Brady proposed openstack/instack-undercloud: Make the snmpd_readonly_user_password available to Mistral https://review.openstack.org/383694 | 20:02 |
| *** onovy has joined #tripleo | 20:02 | |
| dmsimard | pradk: damn, ok, try again. There was an invisible breaking whitespace. That happens to me sometimes :( damn keyboard layout | 20:03 |
| pradk | np | 20:04 |
| *** dmacpher has joined #tripleo | 20:04 | |
| *** jcoufal has joined #tripleo | 20:05 | |
| *** tbarron has joined #tripleo | 20:05 | |
| openstackgerrit | Ryan Brady proposed openstack/python-tripleoclient: Use Password Generation in the Mistral workflows https://review.openstack.org/375544 | 20:05 |
| *** akrzos is now known as brofessor | 20:05 | |
| *** CaptTofu has joined #tripleo | 20:06 | |
| *** zaneb has quit IRC | 20:06 | |
| *** zaneb has joined #tripleo | 20:06 | |
| *** openstack has joined #tripleo | 20:20 | |
| *** Lokesh_Jain has joined #tripleo | 20:20 | |
| *** honza_ has joined #tripleo | 20:21 | |
| *** adam_g` has joined #tripleo | 20:21 | |
| *** mgagne_ has joined #tripleo | 20:22 | |
| *** adam_g has quit IRC | 20:22 | |
| *** cinerama has quit IRC | 20:22 | |
| *** bkero has quit IRC | 20:22 | |
| *** mgagne has quit IRC | 20:22 | |
| *** honza has quit IRC | 20:22 | |
| *** fungi has quit IRC | 20:22 | |
| *** cinerama has joined #tripleo | 20:22 | |
| dmsimard | pradk: following telnet://66.187.229.85:19885 for ovb-ha | 20:22 |
| *** fungi has joined #tripleo | 20:23 | |
| *** bkero has joined #tripleo | 20:23 | |
| *** cmyster has quit IRC | 20:30 | |
| *** cmyster has joined #tripleo | 20:30 | |
| *** jeckersb has quit IRC | 20:30 | |
| *** jeckersb has joined #tripleo | 20:30 | |
| *** sai has quit IRC | 20:30 | |
| *** sai has joined #tripleo | 20:30 | |
| *** rdopiera has quit IRC | 20:30 | |
| *** rdopiera has joined #tripleo | 20:30 | |
| *** jmiu has quit IRC | 20:30 | |
| *** jmiu has joined #tripleo | 20:30 | |
| *** jschlueter has quit IRC | 20:30 | |
| *** jschlueter has joined #tripleo | 20:30 | |
| *** adarazs has quit IRC | 20:31 | |
| *** adarazs has joined #tripleo | 20:31 | |
| *** radez has quit IRC | 20:31 | |
| *** radez has joined #tripleo | 20:31 | |
| *** marios has quit IRC | 20:31 | |
| *** marios has joined #tripleo | 20:31 | |
| *** CaptTofu has quit IRC | 20:31 | |
| *** CaptTofu has joined #tripleo | 20:31 | |
| *** psanchez has quit IRC | 20:31 | |
| *** psanchez has joined #tripleo | 20:31 | |
| *** gregwork has quit IRC | 20:31 | |
| *** gregwork has joined #tripleo | 20:31 | |
| *** Lokesh_Jain has quit IRC | 20:31 | |
| *** Lokesh_Jain has joined #tripleo | 20:31 | |
| *** noslzzp has quit IRC | 20:33 | |
| *** nijaba has quit IRC | 20:33 | |
| *** colonwq has quit IRC | 20:33 | |
| *** marios has quit IRC | 20:33 | |
| *** rickflare has quit IRC | 20:33 | |
| *** r2bit has quit IRC | 20:33 | |
| *** SlickNik has quit IRC | 20:33 | |
| *** ianw has quit IRC | 20:33 | |
| *** bandini has quit IRC | 20:33 | |
| *** flepied has quit IRC | 20:33 | |
| *** rlandy has quit IRC | 20:33 | |
| *** hewbrocca-afk has quit IRC | 20:33 | |
| *** gchamoul has quit IRC | 20:33 | |
| *** trozet has quit IRC | 20:33 | |
| *** dmsimard has quit IRC | 20:33 | |
| *** ramishra_ has quit IRC | 20:33 | |
| *** sshnaidm|away has quit IRC | 20:33 | |
| *** stevebaker has quit IRC | 20:33 | |
| *** cwolferh has quit IRC | 20:33 | |
| *** shadower has quit IRC | 20:33 | |
| *** jistr has quit IRC | 20:33 | |
| *** lazy_prince has quit IRC | 20:33 | |
| *** tbarron has quit IRC | 20:33 | |
| *** jmiu has quit IRC | 20:33 | |
| *** rdopiera has quit IRC | 20:33 | |
| *** sai has quit IRC | 20:33 | |
| *** morazi has quit IRC | 20:33 | |
| *** lifeless has quit IRC | 20:33 | |
| *** mandre has quit IRC | 20:33 | |
| *** jtomasek has quit IRC | 20:33 | |
| *** hogepodge has quit IRC | 20:33 | |
| *** larstobi has quit IRC | 20:33 | |
| *** davidlenwell has quit IRC | 20:33 | |
| *** bfournie has quit IRC | 20:33 | |
| *** vkmc has quit IRC | 20:33 | |
| *** Guest10079 has quit IRC | 20:33 | |
| *** mwhahaha has quit IRC | 20:33 | |
| *** jefrite has quit IRC | 20:33 | |
| *** oshvartz has quit IRC | 20:33 | |
| *** jbadiapa has quit IRC | 20:33 | |
| *** null_ref has quit IRC | 20:33 | |
| *** slagle has quit IRC | 20:33 | |
| *** eggmaster has quit IRC | 20:33 | |
| *** dsneddon has quit IRC | 20:33 | |
| *** lhinds has quit IRC | 20:33 | |
| *** cdearborn has quit IRC | 20:33 | |
| *** rcarrillocruz has quit IRC | 20:33 | |
| *** brofessor has quit IRC | 20:33 | |
| *** panbalag_ has quit IRC | 20:33 | |
| *** d0ugal has quit IRC | 20:33 | |
| *** mburned_out has quit IRC | 20:33 | |
| *** fpan has quit IRC | 20:33 | |
| *** crinkle has quit IRC | 20:33 | |
| *** adarazs has quit IRC | 20:33 | |
| *** etp has quit IRC | 20:33 | |
| *** matbu has quit IRC | 20:33 | |
| *** myoung has quit IRC | 20:33 | |
| *** bana_k has quit IRC | 20:33 | |
| *** dsavineau has quit IRC | 20:33 | |
| *** dtrainor has quit IRC | 20:33 | |
| *** markmc has quit IRC | 20:33 | |
| *** bkreitch has quit IRC | 20:33 | |
| *** toure has quit IRC | 20:33 | |
| *** HenryG has quit IRC | 20:33 | |
| *** pabelanger has quit IRC | 20:33 | |
| *** yolanda has quit IRC | 20:33 | |
| *** jrist has quit IRC | 20:33 | |
| *** fultonj has quit IRC | 20:33 | |
| *** absubram has quit IRC | 20:33 | |
| *** r-mibu has quit IRC | 20:33 | |
| *** Goneri has quit IRC | 20:33 | |
| *** cschwede has quit IRC | 20:33 | |
| *** george_goh has quit IRC | 20:33 | |
| *** radez has quit IRC | 20:33 | |
| *** jeckersb has quit IRC | 20:33 | |
| *** Guest2483 has quit IRC | 20:33 | |
| *** dbecker has quit IRC | 20:33 | |
| *** lucas-afk has quit IRC | 20:33 | |
| *** ramishra has quit IRC | 20:33 | |
| *** cmyster has quit IRC | 20:33 | |
| *** Hazelesque has quit IRC | 20:33 | |
| *** chem has quit IRC | 20:33 | |
| *** ansiwen has quit IRC | 20:33 | |
| *** trown has quit IRC | 20:33 | |
| *** thrash has quit IRC | 20:33 | |
| *** TSCHAK has quit IRC | 20:33 | |
| *** jayg has quit IRC | 20:33 | |
| *** jcoufal has quit IRC | 20:33 | |
| *** dmsimard has joined #tripleo | 20:34 | |
| *** jcoufal has joined #tripleo | 20:34 | |
| *** gregwork has quit IRC | 20:37 | |
| *** NachoDuck has quit IRC | 20:37 | |
| *** hrybacki has quit IRC | 20:37 | |
| *** crinkle has joined #tripleo | 20:38 | |
| *** fpan has joined #tripleo | 20:38 | |
| *** adarazs has joined #tripleo | 20:38 | |
| *** etp has joined #tripleo | 20:38 | |
| *** matbu has joined #tripleo | 20:38 | |
| *** myoung has joined #tripleo | 20:38 | |
| *** bkreitch has joined #tripleo | 20:38 | |
| *** bana_k has joined #tripleo | 20:38 | |
| *** dsavineau has joined #tripleo | 20:38 | |
| *** dtrainor has joined #tripleo | 20:38 | |
| *** markmc has joined #tripleo | 20:38 | |
| *** toure has joined #tripleo | 20:38 | |
| *** HenryG has joined #tripleo | 20:38 | |
| *** pabelanger has joined #tripleo | 20:38 | |
| *** yolanda has joined #tripleo | 20:38 | |
| *** jrist has joined #tripleo | 20:38 | |
| *** fultonj has joined #tripleo | 20:38 | |
| *** absubram has joined #tripleo | 20:38 | |
| *** Goneri has joined #tripleo | 20:38 | |
| *** r-mibu has joined #tripleo | 20:38 | |
| *** cschwede has joined #tripleo | 20:38 | |
| *** noslzzp has joined #tripleo | 20:39 | |
| *** tbarron has joined #tripleo | 20:39 | |
| *** jmiu has joined #tripleo | 20:39 | |
| *** rdopiera has joined #tripleo | 20:39 | |
| *** sai has joined #tripleo | 20:39 | |
| *** morazi has joined #tripleo | 20:39 | |
| *** lifeless has joined #tripleo | 20:39 | |
| *** mandre has joined #tripleo | 20:39 | |
| *** jtomasek has joined #tripleo | 20:39 | |
| *** larstobi has joined #tripleo | 20:39 | |
| *** hogepodge has joined #tripleo | 20:39 | |
| *** davidlenwell has joined #tripleo | 20:39 | |
| *** bfournie has joined #tripleo | 20:39 | |
| *** vkmc has joined #tripleo | 20:39 | |
| *** Guest10079 has joined #tripleo | 20:39 | |
| *** jefrite has joined #tripleo | 20:39 | |
| *** oshvartz has joined #tripleo | 20:39 | |
| *** jbadiapa has joined #tripleo | 20:39 | |
| *** eggmaster has joined #tripleo | 20:39 | |
| *** null_ref has joined #tripleo | 20:39 | |
| *** slagle has joined #tripleo | 20:39 | |
| *** dsneddon has joined #tripleo | 20:39 | |
| *** lhinds has joined #tripleo | 20:39 | |
| *** d0ugal has joined #tripleo | 20:39 | |
| *** rcarrillocruz has joined #tripleo | 20:39 | |
| *** cdearborn has joined #tripleo | 20:39 | |
| *** brofessor has joined #tripleo | 20:39 | |
| *** panbalag_ has joined #tripleo | 20:39 | |
| *** mburned_out has joined #tripleo | 20:39 | |
| *** orwell.freenode.net sets mode: +v davidlenwell | 20:39 | |
| *** nijaba has joined #tripleo | 20:39 | |
| *** colonwq has joined #tripleo | 20:39 | |
| *** marios has joined #tripleo | 20:39 | |
| *** r2bit has joined #tripleo | 20:39 | |
| *** rickflare has joined #tripleo | 20:39 | |
| *** ianw has joined #tripleo | 20:39 | |
| *** SlickNik has joined #tripleo | 20:39 | |
| *** bandini has joined #tripleo | 20:39 | |
| *** flepied has joined #tripleo | 20:39 | |
| *** rlandy has joined #tripleo | 20:39 | |
| *** hewbrocca-afk has joined #tripleo | 20:39 | |
| *** gchamoul has joined #tripleo | 20:39 | |
| *** trozet has joined #tripleo | 20:39 | |
| *** ramishra_ has joined #tripleo | 20:39 | |
| *** sshnaidm|away has joined #tripleo | 20:39 | |
| *** stevebaker has joined #tripleo | 20:39 | |
| *** cwolferh has joined #tripleo | 20:39 | |
| *** shadower has joined #tripleo | 20:39 | |
| *** jistr has joined #tripleo | 20:39 | |
| *** lazy_prince has joined #tripleo | 20:39 | |
| *** george_goh has joined #tripleo | 20:39 | |
| *** radez has joined #tripleo | 20:39 | |
| *** jeckersb has joined #tripleo | 20:39 | |
| *** Guest2483 has joined #tripleo | 20:39 | |
| *** dbecker has joined #tripleo | 20:39 | |
| *** lucas-afk has joined #tripleo | 20:39 | |
| *** Hazelesque has joined #tripleo | 20:39 | |
| *** cmyster has joined #tripleo | 20:39 | |
| *** ramishra has joined #tripleo | 20:39 | |
| *** chem has joined #tripleo | 20:39 | |
| *** ansiwen has joined #tripleo | 20:39 | |
| *** trown has joined #tripleo | 20:39 | |
| *** thrash has joined #tripleo | 20:39 | |
| *** TSCHAK has joined #tripleo | 20:39 | |
| *** jayg has joined #tripleo | 20:39 | |
| *** jcoufal has quit IRC | 20:43 | |
| *** jcoufal has joined #tripleo | 20:43 | |
| *** liverpooler has quit IRC | 20:45 | |
| openstackgerrit | Merged openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 20:47 |
| *** gregwork has joined #tripleo | 20:47 | |
| *** NachoDuck has joined #tripleo | 20:48 | |
| *** jdennis has joined #tripleo | 20:48 | |
| *** hrybacki has joined #tripleo | 20:48 | |
| jdennis | I see the term "puppet element" used in various places, but an "element" is not something I recognize from puppet, what is an element? | 20:49 |
| *** mwhahaha has joined #tripleo | 20:50 | |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo: Fix eqlx chap password https://review.openstack.org/383934 | 20:50 |
| *** rbrady is now known as rbrady-afk | 20:55 | |
| *** rlandy has quit IRC | 20:55 | |
| *** jcoufal has quit IRC | 20:57 | |
| *** trown is now known as trown|outtypewww | 20:57 | |
| *** dsavineau has quit IRC | 20:58 | |
| *** mbozhenko has joined #tripleo | 21:03 | |
| *** mbozhenko has quit IRC | 21:08 | |
| *** david-lyle has quit IRC | 21:12 | |
| *** david-lyle has joined #tripleo | 21:12 | |
| larsks | jdennis, probably referring to disk-image-builder "elements" as in https://github.com/openstack/tripleo-puppet-elements | 21:12 |
| *** bfournie has quit IRC | 21:13 | |
| *** cdearborn has quit IRC | 21:13 | |
| *** Guest68394 has quit IRC | 21:15 | |
| *** Guest68394 has joined #tripleo | 21:15 | |
| *** Guest68394 is now known as assassin | 21:16 | |
| *** panda is now known as panda|off | 21:21 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-quickstart: Add fact gathering prior to deploying the overcloud https://review.openstack.org/383942 | 21:24 |
| *** lblanchard has quit IRC | 21:26 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: Remove usage of --control-scale from the HA docs https://review.openstack.org/381458 | 21:41 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: Remove usage of --compute-scale from the baremetal overcloud docs https://review.openstack.org/381454 | 21:41 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: Remove usage of --control-scale from the scale roles docs https://review.openstack.org/381187 | 21:41 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: Remove the replace controller docs https://review.openstack.org/381469 | 21:41 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Use kwargs to pass in data and error to Mistral Result https://review.openstack.org/375348 | 21:41 |
| *** maticue has quit IRC | 21:48 | |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo: Add cinder profile spec tests https://review.openstack.org/383950 | 21:49 |
| *** dciabrin has joined #tripleo | 21:52 | |
| *** Lokesh_Jain has quit IRC | 21:52 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 21:53 |
| *** kjw3 has joined #tripleo | 22:16 | |
| *** Lokesh_Jain has joined #tripleo | 22:22 | |
| *** absubram has quit IRC | 22:24 | |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo: Add cinder profile spec tests https://review.openstack.org/383950 | 22:25 |
| *** null_ref has quit IRC | 22:30 | |
| *** fultonj has quit IRC | 22:33 | |
| openstackgerrit | ayoung proposed openstack/tripleo-heat-templates: Configure Keystone Fernet Keys https://review.openstack.org/383956 | 22:41 |
| *** igorbelikov has joined #tripleo | 22:42 | |
| *** rhallisey has quit IRC | 22:53 | |
| *** Lokesh_Jain has quit IRC | 22:57 | |
| *** igorbelikov has quit IRC | 22:59 | |
| *** mbozhenko has joined #tripleo | 23:04 | |
| dtrainor | I'm seeing a failed deployment with the ControllerAllNodesValidationDeployment deployment. Drilling down, I see: Error: Error from DataBinding 'hiera' while looking up 'tripleo::trusted_cas::ca_map': (<unknown>): found character that cannot start any token while scanning for the next token at line 372 column 34 on node overcloud-controller-0.localdomain | 23:05 |
| dtrainor | there is in fact no value for the tripleo::trusted_cas::ca_map hiera key, not sure if that's exactly what's causing it though | 23:06 |
| mwhahaha | looks like the yaml is bad for the hiera? | 23:06 |
| dtrainor | yea, i checked it out, it's defined but empty in /etc/puppet/hieradata/service_configs.yaml | 23:06 |
| mwhahaha | so it's litterally just "^tripleo::trusted_cas::ca_map:$" | 23:07 |
| mwhahaha | ? | 23:07 |
| dtrainor | not sure why or what that means | 23:07 |
| dtrainor | no, it's: tripleo::trusted_cas::ca_map: {} | 23:07 |
| *** mbozhenko has quit IRC | 23:08 | |
| dtrainor | hrm.. maybe this is the result of not setting certificate_generation_ca = local on the undercloud | 23:09 |
| dtrainor | while still using generate_service_certificate = true | 23:09 |
| mwhahaha | possibly but that seems to indicate bad yaml | 23:10 |
| dtrainor | at a high level that's the only configurable option on the undercloud that i think may be related | 23:10 |
| mwhahaha | so either it doesn't like the {} or there's a bad character in there | 23:10 |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo: Add cinder profile spec tests https://review.openstack.org/383950 | 23:10 |
| dtrainor | i understand waht you're saying. there's no characters in there | 23:10 |
| dtrainor | does a deployment need to know anything special or be configured differently when the undercloud is SSL-enabled? | 23:11 |
| mwhahaha | is that on line 372? :D | 23:11 |
| dtrainor | hah no, 937 | 23:11 |
| mwhahaha | so what's on line 372? | 23:12 |
| dtrainor | hmm i see what you mean | 23:12 |
| mwhahaha | so i think it was trying to bind that value but when scanning the yaml found crud | 23:12 |
| dtrainor | yep | 23:12 |
| mwhahaha | you could try validating the hiera yaml first | 23:12 |
| dtrainor | keystone::wsgi::apache::workers: %{::processorcount} | 23:12 |
| mwhahaha | thought that was supposed to be interpreted | 23:13 |
| mwhahaha | hmm | 23:13 |
| mwhahaha | that's supposed to be quoted | 23:14 |
| mwhahaha | service_configs.yaml:keystone::wsgi::apache::workers: "%{::processorcount}" | 23:14 |
| mwhahaha | i thought that got fixed a long time ago | 23:14 |
| dtrainor | this was before my time, sorry. still digging. | 23:15 |
| mwhahaha | i guess the better question is what version are you deploying | 23:15 |
| mwhahaha | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/keystone.yaml#L86 | 23:17 |
| dtrainor | i think it's quoted properly, but processorcount doesn't seem to be resolving properly | 23:23 |
| *** Goneri has quit IRC | 23:23 | |
| mwhahaha | dtrainor: are there double quotes in the yaml? | 23:24 |
| dtrainor | in the template, yep: default: '"%{::processorcount}"' | 23:26 |
| mwhahaha | no i mean in the generated hiera yaml on the node | 23:26 |
| mwhahaha | should end up in service_configs.yaml (at least for newton) | 23:26 |
| dtrainor | no, there was not. i added them to test, and it resolved to nil | 23:27 |
| mwhahaha | ::processorcount is a puppet fact | 23:27 |
| mwhahaha | depending on how you tested that may be why it resolved to nil | 23:27 |
| mwhahaha | so the issue is that somehow it lost the quotes in your case | 23:27 |
| dtrainor | erg, yes ssorry you're right. hiera doesn't resolve it, facter does | 23:28 |
| *** noslzzp has quit IRC | 23:28 | |
| mwhahaha | would need more details on how you deployed to figure that one out | 23:28 |
| dtrainor | understood, i want to take a minute to better understand this, good learning opportunity | 23:28 |
| *** Lokesh_Jain has joined #tripleo | 23:28 | |
| mwhahaha | plenty of those around here :D | 23:28 |
| dtrainor | heh | 23:28 |
| *** davidlenwell has quit IRC | 23:29 | |
| dtrainor | thanks for the time | 23:33 |
| mwhahaha | sure | 23:33 |
| *** yamahata has quit IRC | 23:39 | |
| *** davidlenwell has joined #tripleo | 23:42 | |
| *** ChanServ sets mode: +v davidlenwell | 23:42 | |
| *** yamahata has joined #tripleo | 23:46 | |
| dtrainor | before i jump down the rabbit hole, i'm hard-coding a value to see how far it gets | 23:47 |
| *** bana_k has quit IRC | 23:49 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!