*** fragatina has quit IRC | 00:04 | |
pabelanger | any update on the hardware upgrade? I only ask because we disabled tripleo in nodepool for the moment | 00:07 |
---|---|---|
*** saneax is now known as saneax_AFK | 00:09 | |
*** fragatina has joined #tripleo | 00:09 | |
*** thrash is now known as thrash|g0ne | 00:11 | |
*** fragatina has quit IRC | 00:14 | |
*** penick has joined #tripleo | 00:20 | |
openstackgerrit | Merged openstack/diskimage-builder: Fix OpenSUSE support https://review.openstack.org/312325 | 00:36 |
*** lifeless has quit IRC | 00:46 | |
crinkle | is there another example of https://bugs.launchpad.net/tripleo/+bug/1580076 besides https://review.openstack.org/#/c/313650 ? i found https://review.openstack.org/#/c/312725/ but it doesn't seem to have overcloud logs | 00:46 |
openstack | Launchpad bug 1580076 in tripleo "Upgrades job failing pingtest with "Message: No valid host was found."" [Critical,Fix released] - Assigned to Dan Prince (dan-prince) | 00:46 |
*** lifeless has joined #tripleo | 00:47 | |
*** derekh has joined #tripleo | 00:47 | |
*** rcernin has quit IRC | 00:54 | |
*** [1]cdearborn has joined #tripleo | 00:57 | |
*** mbound has quit IRC | 00:59 | |
*** absubram has joined #tripleo | 01:01 | |
*** absubram_ has joined #tripleo | 01:02 | |
*** absubram has quit IRC | 01:05 | |
*** absubram_ is now known as absubram | 01:05 | |
*** derekh has quit IRC | 01:09 | |
*** trozet has quit IRC | 01:10 | |
*** shakamunyi has joined #tripleo | 01:23 | |
*** dmacpher-afk is now known as dmacpher | 01:23 | |
*** penick has quit IRC | 01:27 | |
openstackgerrit | Ben Swartzlander proposed openstack/tripleo-heat-templates: Enable Manila integration https://review.openstack.org/188137 | 01:36 |
*** Goneri has quit IRC | 01:41 | |
*** tzumainn has quit IRC | 01:42 | |
*** fpan has joined #tripleo | 01:47 | |
*** ebalduf has quit IRC | 01:48 | |
*** fpan has quit IRC | 01:52 | |
*** Goneri has joined #tripleo | 01:54 | |
*** [1]cdearborn has quit IRC | 01:57 | |
*** mbound has joined #tripleo | 02:00 | |
*** mbound has quit IRC | 02:04 | |
*** ccamacho has quit IRC | 02:14 | |
*** ccamacho has joined #tripleo | 02:15 | |
*** Goneri has quit IRC | 02:20 | |
*** zaneb has quit IRC | 02:28 | |
*** penick has joined #tripleo | 02:37 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements https://review.openstack.org/313721 | 02:55 |
*** gbraad has quit IRC | 03:16 | |
*** gbraad has joined #tripleo | 03:17 | |
*** zaneb has joined #tripleo | 03:19 | |
*** links has joined #tripleo | 03:34 | |
*** ebalduf has joined #tripleo | 03:36 | |
*** julim has joined #tripleo | 03:40 | |
*** panda has quit IRC | 03:42 | |
*** panda has joined #tripleo | 03:43 | |
*** fragatina has joined #tripleo | 03:43 | |
*** fragatina has quit IRC | 03:45 | |
*** fragatina has joined #tripleo | 03:46 | |
*** fragatina has quit IRC | 03:46 | |
*** fragatina has joined #tripleo | 03:47 | |
*** masco has joined #tripleo | 03:54 | |
*** fpan has joined #tripleo | 04:01 | |
*** shivrao has quit IRC | 04:04 | |
*** julim has quit IRC | 04:07 | |
*** fpan has quit IRC | 04:08 | |
*** pcaruana has joined #tripleo | 04:25 | |
*** pcaruana has quit IRC | 04:32 | |
*** coolsvap has joined #tripleo | 04:39 | |
openstackgerrit | Babu Shanmugam proposed openstack/puppet-tripleo: Add OVN support for neutron profile https://review.openstack.org/314875 | 04:47 |
*** coolsvap has quit IRC | 04:52 | |
*** penick has quit IRC | 05:00 | |
*** penick has joined #tripleo | 05:03 | |
*** coolsvap has joined #tripleo | 05:08 | |
*** shivrao has joined #tripleo | 05:17 | |
*** stendulker has joined #tripleo | 05:19 | |
*** apetrich has joined #tripleo | 05:37 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/300044 | 05:39 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements https://review.openstack.org/311357 | 05:39 |
*** apetrich has quit IRC | 05:40 | |
*** apetrich has joined #tripleo | 05:42 | |
*** shivrao_ has joined #tripleo | 05:51 | |
*** shivrao has quit IRC | 05:52 | |
*** shivrao_ has quit IRC | 05:52 | |
*** rcernin has joined #tripleo | 05:53 | |
*** shivrao has joined #tripleo | 05:54 | |
*** florianf has joined #tripleo | 05:55 | |
*** tremble has joined #tripleo | 06:05 | |
*** tremble has joined #tripleo | 06:05 | |
*** saneax_AFK is now known as saneax | 06:05 | |
*** cwolferh has quit IRC | 06:08 | |
*** shivrao has quit IRC | 06:10 | |
*** pcaruana has joined #tripleo | 06:12 | |
*** jcoufal has joined #tripleo | 06:26 | |
*** mcornea has joined #tripleo | 06:40 | |
*** jprovazn has joined #tripleo | 06:40 | |
*** shivrao has joined #tripleo | 06:41 | |
*** devvesa has joined #tripleo | 06:43 | |
*** paramite has joined #tripleo | 06:47 | |
*** shivrao has quit IRC | 06:54 | |
*** crinkle_ has joined #tripleo | 06:59 | |
*** dmacpher has quit IRC | 07:00 | |
*** crinkle has quit IRC | 07:00 | |
*** StevenK has quit IRC | 07:00 | |
*** crinkle_ is now known as crinkle | 07:00 | |
*** StevenK has joined #tripleo | 07:01 | |
*** jaosorior has joined #tripleo | 07:03 | |
*** tesseract has joined #tripleo | 07:05 | |
jaosorior | shardy hey dude | 07:05 |
*** bvandenh has joined #tripleo | 07:07 | |
*** tesseract has quit IRC | 07:09 | |
*** dmacpher has joined #tripleo | 07:12 | |
*** shardy has joined #tripleo | 07:13 | |
jaosorior | shardy: Hey dude | 07:16 |
jaosorior | regarding this commit https://review.openstack.org/#/c/304125/ | 07:16 |
jaosorior | I'm a little confused | 07:16 |
jaosorior | How would an endpoint-generation specific manifest help? | 07:16 |
shardy | jaosorior: it would allow you to configure keystone, then configure the endpoints at a different step | 07:18 |
shardy | I suppose we can do the same with a conditional in the profile | 07:18 |
jaosorior | shardy, but how, since there is no other step anymopre? | 07:18 |
jaosorior | step 6 was removed | 07:18 |
jaosorior | which is the reasont hat commit is now failing | 07:18 |
jaosorior | we have no way anymore to asure that keystone is up and running to be able to do that configuration | 07:18 |
jaosorior | which is why it fails in HA | 07:18 |
shardy | Ok, that is a problem | 07:19 |
jaosorior | shardy, which is what me and jistr were telling people before they erased that step | 07:19 |
jaosorior | I even -1ed and explained why | 07:19 |
shardy | jaosorior: the main things I'm looking to improve are: (1) don't create endpoints for services we're not actually enabling | 07:20 |
*** zoli_gone-proxy is now known as zoliXXL | 07:20 | |
jaosorior | shardy: I understand that issue | 07:20 |
shardy | (2) stop the increase in monolithic complexity related to the endpoint_map | 07:20 |
shardy | e.g define default per-service endpoints alongside the service definition (if possible) | 07:20 |
jaosorior | and when I we talked about it (I think you were in the chat too) I was explaining that first I was trying to get it to work then we could iterate on that | 07:20 |
jaosorior | when it finally worked | 07:20 |
jaosorior | then step 6 was deleted | 07:20 |
jaosorior | and now it's failing again | 07:20 |
shardy | jaosorior: Ok, we'll have to discuss the step problem as a separate issue, but do you buy the general problems I'm referring to? | 07:21 |
jaosorior | shardy: I never argued against them | 07:21 |
shardy | cool | 07:21 |
zoliXXL | good morning | 07:21 |
*** ebalduf has quit IRC | 07:21 | |
jaosorior | shardy: what I've been arguing for is solving problems step by step | 07:21 |
jaosorior | which is why I didn't do it in that commit | 07:21 |
shardy | jaosorior: sure - but we've also got a need to not have every single commit hit the CI job timeout, which is why optimizations have been sought | 07:22 |
shardy | I'm sure we can work out a compromise, but I've not got one to offer right this moment :) | 07:23 |
* shardy needs to finish his coffee first | 07:23 | |
jaosorior | shardy: one option I was thinking about is a sepparate step in puppet... but not like a step 6 | 07:24 |
shardy | lets chat with EmilienM later when he wakes up | 07:24 |
jaosorior | but a step that just runs those specific bits | 07:24 |
jaosorior | so basically the endpoint generation would be added in separate manifests for the services | 07:24 |
shardy | jaosorior: Yeah, or we could even go non-puppet and decouple the service initialization from the configuration | 07:24 |
jaosorior | and that manifest would be specifically sought for | 07:24 |
shardy | e.g not in os-cloud-config, we could have a mistral workflow which configures things | 07:24 |
shardy | Ah, so you mean have an independent puppet apply which doesn't build the catalog for all previous steps? | 07:25 |
jaosorior | shardy: that is an option... but I would prefer it to be in puppet or t-h-t (something we have now and can effectively use in OSP10) | 07:25 |
jaosorior | shardy: pretty much | 07:25 |
jaosorior | shardy: That would speed up that step a lot | 07:26 |
*** mikelk has joined #tripleo | 07:28 | |
*** yamahata has joined #tripleo | 07:31 | |
*** jpena|off is now known as jpena | 07:34 | |
*** aufi has joined #tripleo | 07:40 | |
*** dmk0202 has joined #tripleo | 07:40 | |
openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Fix apt-sources configuration for debian-minimal https://review.openstack.org/315265 | 07:41 |
*** panda has quit IRC | 07:42 | |
*** panda has joined #tripleo | 07:43 | |
*** ebarrera has joined #tripleo | 07:49 | |
*** fragatina has quit IRC | 07:56 | |
*** devvesa has quit IRC | 07:59 | |
*** devvesa has joined #tripleo | 08:00 | |
*** Guest42459 has joined #tripleo | 08:00 | |
*** veteran has joined #tripleo | 08:06 | |
*** ifarkas has joined #tripleo | 08:08 | |
*** chem has joined #tripleo | 08:09 | |
*** veteran has quit IRC | 08:11 | |
*** athomas has joined #tripleo | 08:15 | |
*** dtantsur|afk is now known as dtantsur | 08:17 | |
*** ohamada has joined #tripleo | 08:17 | |
*** lucas-dinner is now known as lucasagomes | 08:17 | |
*** florianf has quit IRC | 08:21 | |
jidar | does Ironic-python-agent fix the old' my network interface names are not ordered properly out of os-config-net or whatever was doing it in OSP7? | 08:27 |
jidar | https://bugzilla.redhat.com/show_bug.cgi?id=1296330 from this bug | 08:27 |
openstack | bugzilla.redhat.com bug 1296330 in rhel-osp-director "Unable to consistently deploy overcloud nodes with OSP 7.2: Failed to mount root partition" [High,Closed: errata] - Assigned to mburns | 08:27 |
jidar | or was this fixed in the overcloud-full image itself | 08:27 |
shardy | jidar: it looks like it was fixed via moving to the IPA ramdisk | 08:31 |
*** florianf has joined #tripleo | 08:31 | |
jidar | fantastic | 08:31 |
jidar | I've got a guy doing osp8 with some issues and wanted to make sure he wasn't running into anything with that | 08:32 |
*** penick has quit IRC | 08:33 | |
*** penick has joined #tripleo | 08:34 | |
*** jistr has joined #tripleo | 08:35 | |
*** ohamada has quit IRC | 08:38 | |
*** ohamada has joined #tripleo | 08:38 | |
*** yamahata has quit IRC | 08:38 | |
*** markmc has joined #tripleo | 08:42 | |
d0ugal | On PyPI mistral had two naming conventions :/ | 08:49 |
d0ugal | s/naming/version/ | 08:49 |
d0ugal | 2.0.0 is the latest released, but pip thinks 2015.1.0 is the latest version | 08:50 |
d0ugal | sigh | 08:50 |
d0ugal | marios: ^ if you wondered. | 08:50 |
*** electrofelix has joined #tripleo | 08:54 | |
openstackgerrit | sandhya proposed openstack/diskimage-builder: Add support for building images capable of UEFI https://review.openstack.org/287784 | 08:54 |
*** gfidente has joined #tripleo | 08:55 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: WIP: integrate PCS provider in the merge. https://review.openstack.org/310713 | 08:55 |
*** jayg|g0n3 has quit IRC | 08:55 | |
*** bvandenh has quit IRC | 09:00 | |
*** radez has quit IRC | 09:00 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: WIP: integrate PCS provider in the merge. https://review.openstack.org/310713 | 09:00 |
*** bvandenh has joined #tripleo | 09:00 | |
*** pcaruana is now known as pcaruana|afk| | 09:01 | |
*** jtomasek_ has joined #tripleo | 09:04 | |
*** openstackgerrit has quit IRC | 09:04 | |
*** openstackgerrit has joined #tripleo | 09:04 | |
marios | d0ugal: thanks. i scrolled down to see the version it was getting for msitral (i mean in the error output i linked on the review) | 09:14 |
marios | d0ugal: and saw that "2015.1.0" string but didn't give it any further thought | 09:14 |
* marios brb | 09:14 | |
shardy | Anyone have any idea why tripleo.sh --delorean-build openstack/heat has started trying to build puppet-heat? | 09:15 |
*** jtomasek has quit IRC | 09:22 | |
marios | d0ugal: nice one on the !=2015.1 ... the error message from the py27 tests is not very helpful then for this root cause :/ | 09:22 |
*** bvandenh has quit IRC | 09:23 | |
shardy | scripts/map-project-name no worky | 09:23 |
d0ugal | Yeah :/ good reason to not change how you version things. I just updated the review to hopefully get CI to pass. | 09:24 |
marios | d0ugal: yup thx revoted there too :) | 09:25 |
d0ugal | Thanks! | 09:25 |
*** florianf has quit IRC | 09:34 | |
*** jtomasek_ is now known as jtomasek | 09:35 | |
*** flfuchs has joined #tripleo | 09:35 | |
*** bvandenh has joined #tripleo | 09:37 | |
*** flfuchs has quit IRC | 09:41 | |
*** flfuchs has joined #tripleo | 09:41 | |
*** milan_ has quit IRC | 09:49 | |
*** mgould has joined #tripleo | 09:55 | |
*** zoliXXL is now known as zoli|brb | 09:57 | |
*** tosky has joined #tripleo | 09:57 | |
*** flfuchs has quit IRC | 10:00 | |
hewbrocca | Hello all | 10:05 |
shardy | hey hewbrocca | 10:05 |
hewbrocca | shardy: given the CI rack is down for maintenance indefinitely, we need to start working on an alternative strategy like ASAP | 10:06 |
*** florianf has joined #tripleo | 10:06 | |
*** tosky has quit IRC | 10:06 | |
*** tosky has joined #tripleo | 10:06 | |
hewbrocca | shardy: slagle was talking about running ironic-less jobs directly on infra... do we think that's possible? | 10:07 |
shardy | hewbrocca: derekh has been in discussions re running on rdocloud resources but last I heard there's not yet sufficient capacity | 10:07 |
shardy | hewbrocca: when you say "indefinitely", I was expecting some delay while we rebuild the bastion host, but do you have some more dire news? | 10:08 |
*** dciabrin has joined #tripleo | 10:08 | |
shardy | hewbrocca: it probably is possible, but it's not going to be a quick thing to set up | 10:08 |
hewbrocca | Nothing beyond that, no | 10:09 |
hewbrocca | It's just that I have no idea how long rebuilding the bastion host is going to take | 10:09 |
*** zoli|brb is now known as zoli | 10:09 | |
bandini | jistr, gfidente, marios: do we have some docs around about how updates are supposed to be invoked and how they work? ( dciabrin and I need to investigate the update part of a BZ and would love to not harass you guys too much ;) | 10:09 |
*** zoli is now known as zoliXXL | 10:09 | |
shardy | hewbrocca: my assumption was that we should be able to do that today, if that proves unrealistic you're right we'll need a plan-b | 10:09 |
bandini | note updates and not upgrades ;) | 10:09 |
shardy | it's unfortunate derekh isn't around right now, but I'm planning to sync with dprince, slagle and bnemec re our options when they come online | 10:10 |
hewbrocca | shardy: yeah... I'm not filled with confidence that that will happen | 10:10 |
hewbrocca | OK, good. Thanks. | 10:10 |
marios | bandini: sec i'll get the link i used yesterday | 10:10 |
bandini | marios: you are made of awesome sir. ANJ thanks you | 10:10 |
*** olap has quit IRC | 10:11 | |
marios | bandini: this iswhat i had in mind https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux_OpenStack_Platform/7/html/Director_Installation_and_Usage/sect-Updating_the_Overcloud.html | 10:13 |
bandini | marios: merci! | 10:14 |
marios | bandini: should cover version specific stuff, np man, for ANJ, anytime | 10:15 |
bandini | marios: lol ack. We'll start digging. We will probably have a question or two (this is about https://bugzilla.redhat.com/show_bug.cgi?id=1323305#c10) but let us read through it first ;) | 10:15 |
openstack | bugzilla.redhat.com bug 1323305 in rhel-osp-director "Password not required to login as root to MariaDB" [Medium,New] - Assigned to mbayer | 10:15 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Adds memcached as a composable service https://review.openstack.org/312899 | 10:16 |
*** chem has quit IRC | 10:16 | |
*** zaneb has quit IRC | 10:35 | |
*** zaneb has joined #tripleo | 10:35 | |
*** dciabrin is now known as dciabrin|lunch | 10:39 | |
*** zoliXXL is now known as zoli|lunch | 10:43 | |
openstackgerrit | Marios Andreou proposed openstack/puppet-tripleo: Adds the base and pacemaker profile for the memcached service https://review.openstack.org/312877 | 10:43 |
*** mburned_out is now known as mburned | 10:49 | |
*** bvandenh has quit IRC | 10:54 | |
*** dciabrin|lunch is now known as dciabrin | 11:01 | |
d0ugal | Is it just me, or is this file now used or imported anywhere? https://github.com/openstack/tripleo-common/blob/master/tripleo_common/filters/list.py | 11:04 |
d0ugal | bnemec: ^ :) | 11:04 |
*** olap has joined #tripleo | 11:08 | |
*** mgould has quit IRC | 11:12 | |
*** pkovar has joined #tripleo | 11:12 | |
*** tosky has quit IRC | 11:14 | |
*** ccamacho is now known as ccamacho|lunch | 11:15 | |
*** zoli|lunch is now known as zoli | 11:16 | |
*** hewbrocca is now known as hewbrocca-afk | 11:20 | |
*** julim has joined #tripleo | 11:22 | |
*** mgould has joined #tripleo | 11:22 | |
*** rain has joined #tripleo | 11:25 | |
*** rain is now known as leanderthal | 11:25 | |
*** jaosorior has quit IRC | 11:28 | |
*** jaosorior has joined #tripleo | 11:29 | |
*** stendulker has quit IRC | 11:30 | |
*** jayg|g0n3 has joined #tripleo | 11:31 | |
*** thrash|g0ne is now known as thrash | 11:31 | |
*** jayg|g0n3 is now known as jayg | 11:31 | |
*** jprovazn has quit IRC | 11:34 | |
*** milan_ has joined #tripleo | 11:38 | |
*** coolsvap has quit IRC | 11:38 | |
*** weshay has joined #tripleo | 11:43 | |
shardy | d0ugal: it is used https://github.com/openstack/instack-undercloud/commit/75660dbe5aceeaf1770f72772ec5d4d170f4b643 | 11:50 |
shardy | we need it for the predictable node placement via nova scheduler hints | 11:50 |
*** jprovazn has joined #tripleo | 11:54 | |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-heat-templates: composable heat services https://review.openstack.org/313577 | 11:56 |
thrash | shardy: should we be doing the endpoint creation in puppet-tripleo? I think that's where we are headed... | 11:56 |
*** absubram has quit IRC | 11:56 | |
thrash | shardy: based on this: https://review.openstack.org/#/c/244162/42 | 11:56 |
shardy | thrash: Yes, I didn't spot that that patch finally landed | 11:58 |
*** MaxPC has joined #tripleo | 11:59 | |
*** ohamada has quit IRC | 11:59 | |
shardy | I guess we can add the CFN endpoint to the EndpointMap and wire it in the same way | 11:59 |
*** dprince has joined #tripleo | 11:59 | |
*** ohamada has joined #tripleo | 11:59 | |
shardy | I was chatting with jaosorior earlier, and the next step will be figuring out how to wire in the endpoint creation data so we only create endpoints for services that are actually deployed | 11:59 |
thrash | shardy: I'm thinking that's why we do it in puppet-tripleo. In each services manifest. | 12:00 |
shardy | thrash: there's been discussion on that here: https://review.openstack.org/#/c/304125/ | 12:01 |
thrash | shardy: ahh. right. | 12:01 |
shardy | EmilienM said we can't do that, because we need the puppet stuff to happen where the keystone service is running | 12:01 |
thrash | oic | 12:01 |
*** fragatina has joined #tripleo | 12:01 | |
jaosorior | thrash, shardy: That patch only enables the data needed to create the endpoints | 12:03 |
jaosorior | it doesn't create them yet | 12:03 |
thrash | shardy: in the meantime, I've added the outputs for heat::keystone::auth_cfn | 12:03 |
*** zoli is now known as zoli|relocating | 12:03 | |
jaosorior | but yeah, thrash, as I was discussing with shardy earlier. Right now a problem is that since step 6 doesn't exist anymore. We can't asure that keystone is up and running | 12:04 |
jaosorior | and thus the creation of endpoints fails sporadically in step 5 | 12:04 |
shardy | jaosorior: right, so we can wire in the *url data via the per-service templaetes, but still need a suitable step to trigger creating the endpoints | 12:04 |
jaosorior | yep | 12:04 |
*** zoli|relocating is now known as zoli_gone-proxy | 12:06 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: add heat-api-cfn to endpoint map https://review.openstack.org/315504 | 12:08 |
shardy | thrash: for now I think you can rebase on top of that, and make heat-api-cfn.yaml reference the HeatCfn* from the EndpointMap | 12:08 |
thrash | shardy: excellent. | 12:09 |
shardy | heat should still start OK without those removed config values, but we'll need to wire in the cfn endpoint before certain things will be fully working | 12:09 |
thrash | I will work on that. | 12:09 |
shardy | thrash: cool - when you're happy that's working we'll have to figure out what to do re HeatAuthEncryptionKey | 12:10 |
thrash | shardy: ack | 12:10 |
*** rodrigods has quit IRC | 12:15 | |
openstackgerrit | Leif Madsen proposed openstack/tripleo-quickstart: Update contributing.md to match reality https://review.openstack.org/314127 | 12:15 |
*** rodrigods has joined #tripleo | 12:16 | |
*** fpan has joined #tripleo | 12:17 | |
*** pradk has joined #tripleo | 12:17 | |
jtomasek | rbrady: ping | 12:18 |
rbrady | jtomasek: yo | 12:18 |
jtomasek | rbrady: I am wondering what functionality I can count on in nodes registration. Is it going to be notifying via zaqar with every successful node registered? | 12:19 |
rbrady | jtomasek: I haven't gotten that far yet, so I guess you have a little bit of room to define what it is you want it to do | 12:20 |
*** michchap has joined #tripleo | 12:20 | |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-heat-templates: add heat-api-cfn to endpoint map https://review.openstack.org/315504 | 12:21 |
jtomasek | rbrady: I am going to send you an array of nodes as an input for the workflow. Then it would be nice if the workflow notified via zaqar that a certain node from the batch has been succesfully registered (or failed) | 12:22 |
rbrady | jtomasek: ack | 12:23 |
*** michchap_ has quit IRC | 12:23 | |
ansiwen | finally I've got my 64GB machine \o/ | 12:23 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-heat-templates: composable heat services https://review.openstack.org/313577 | 12:23 |
thrash | shardy: I rebased your patch, then rebased onto that. | 12:24 |
shardy | thrash: ack, thanks | 12:24 |
jtomasek | rbrady: thx! | 12:25 |
EmilienM | shardy: I finally found an alternative so we can run endpoint/services resources from another node | 12:27 |
EmilienM | shardy: it will require a class, from a module we didn't use yet, openstack_extras, we have a class that manage /root/openrc file, that is read by Puppet catalog when creating endpoints/services | 12:27 |
jaosorior | EmilienM: Can you ellaborate? | 12:28 |
*** julim has quit IRC | 12:28 | |
EmilienM | jaosorior: ok, let me explain | 12:28 |
mandre | rbrady: hi, will you have time to do a review of https://review.openstack.org/#/c/313632/ sometime soon? I'd appreciate your feedback. No rush, though | 12:28 |
rbrady | mandre: II read through it the other day and I did follow along with dprinces comments there. I'll try to look at it again today and see if there are any additional comments I can leave | 12:30 |
mandre | rbrady: yeah, I'm going to address those | 12:31 |
*** morazi has joined #tripleo | 12:32 | |
*** pblaho has quit IRC | 12:33 | |
jaosorior | EmilienM: One possibility would be to enable step 6 again... but basically it would only run manifests dedicated to setting up service users and endpoints | 12:33 |
EmilienM | so in Puppet OpenStack, we have some Ruby providers, that create some resource, like Keystone endpoints, Keystone services, Glance images, etc. They all use (or almost?) python-openstackclient, which means you need to auth against keystone first to get a token and then do your stuff. We have 2 methods of auth 1) read /etc/keystone/keystone.conf and get token value 2) create /root/openrc and read it. If you | 12:33 |
EmilienM | want to see this code, please look https://github.com/openstack/puppet-openstacklib/blob/master/lib/puppet/provider/openstack/auth.rb -- which means, if you wwant to use providers using 1) method, you need to run the classes where keystone server runs (keystone.conf). It's secure, because you don't need to store /root/openrc and everything is run from one node (most of our users in production do that). For | 12:33 |
EmilienM | 2), yes it's more flexible, because we have a class that can create /root/openrc for you, so Puppet catalog will be able to read the file and run the CLI. Yes it's flexible, so you can run the providers from anywhere (if you have openrc class), but less secure, because you distribute openrc on different nodes and expose it (even if it's in /root...) | 12:33 |
*** michchap_ has joined #tripleo | 12:33 | |
EmilienM | no: do not enable step 6 anymore. Stop thinking about more steps. We don't need that, we don't want that. Our deployments are already too long | 12:34 |
*** michchap has quit IRC | 12:34 | |
*** rhallisey has joined #tripleo | 12:35 | |
EmilienM | now, if you want my opinion, I would go 1). It's more secure, and that's how most of production deployments do. | 12:35 |
jaosorior | EmilienM: I'm not talking about running the whole catalog again. Just a manifest that does the keystone parts | 12:35 |
jaosorior | lets read | 12:36 |
EmilienM | nope, we need to stop "packstack", we run a single catalog with all resources inside | 12:36 |
EmilienM | that's how Puppet needs to be used | 12:36 |
EmilienM | stop thinking* I mean | 12:36 |
jaosorior | I didn't work with packstack dude, no idea how that works | 12:37 |
EmilienM | we don't run snippets of Puppet, because you expose the risk of missing dependency in catalog | 12:37 |
EmilienM | well, it works like this. and it's terrible | 12:37 |
jaosorior | So, alright, I see your option. So you're talking about doing that after the deployment is done? | 12:37 |
*** rlandy has quit IRC | 12:38 | |
*** pblaho has joined #tripleo | 12:38 | |
*** ccamacho|lunch is now known as ccamacho | 12:38 | |
jaosorior | where would it be called? | 12:38 |
EmilienM | doing what? | 12:38 |
*** rlandy has joined #tripleo | 12:38 | |
jaosorior | alright | 12:38 |
EmilienM | we have 5 steps now, and we won't have more | 12:38 |
jaosorior | so the issue is that we need to create the keystone endpoints somewhere else than in os-cloud-config (cause that's a hack) | 12:39 |
EmilienM | if you search a place where endpoint resources should live, it's in keystone role | 12:39 |
jaosorior | the proposal was to do that in puppet | 12:39 |
EmilienM | right | 12:39 |
jaosorior | step 5 doesn't asure us keystone being up | 12:39 |
EmilienM | right, we did that a very long time ago and it was reverted. | 12:39 |
jaosorior | so now it's failing | 12:39 |
EmilienM | maybe you need orchestration | 12:40 |
EmilienM | show me the patch | 12:40 |
jaosorior | EmilienM: https://review.openstack.org/#/c/304125/ | 12:40 |
jaosorior | I pointed to this patch when you were deleting step 6 | 12:40 |
jaosorior | just to be taken into account | 12:40 |
EmilienM | I've noticed a lot of patches sent in tripleo missed that Puppet is able to do some orchestration, and we ended up to 7 steps | 12:40 |
michchap_ | why isn't keystone assured of being up at the end of step 5? | 12:41 |
EmilienM | michchap_: right, we can have tags, resource ordering, etc | 12:41 |
jaosorior | well, you guys know puppet better than I do. I'm open to ideas | 12:41 |
EmilienM | michchap_: see https://review.openstack.org/#/c/304125/12/manifests/profile/base/keystone.pp | 12:41 |
jaosorior | if you say we can do it in step 5, sure. Maybe I'm missing something (hopefully), and we can make it work | 12:42 |
michchap_ | EmilienM: yep this is the same conversation as gfidente and I had about DBs :) | 12:42 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Remove some unused parameters from overcloud.yaml https://review.openstack.org/315523 | 12:42 |
jaosorior | but this is a blocker for TLS everywhere :/ so would sure like to fix this | 12:42 |
jaosorior | michchap_: Did you guys get to some conclusion regarding the DBs? Maybe a similar solution could work here | 12:43 |
michchap_ | EmilienM: yes, and shardy is right from a conceptual and extensibility standpoint | 12:44 |
michchap_ | jaosorior: ^ | 12:44 |
gfidente | michchap_, for the database we use different step | 12:44 |
*** mburned is now known as mburned_out | 12:44 | |
EmilienM | I'm replying in Gerrit and proposing something | 12:44 |
gfidente | sorry that was for jaosorior :) | 12:44 |
michchap_ | gfidente: right. the problem in this case is that keystone might restart on another node while we try to make endpoints. | 12:44 |
jaosorior | michchap_, gfidente: That was what I was proposing to EmilienM, but he was quite adamant that it's not the way to go. | 12:44 |
gfidente | so the comment shardy left in that submission | 12:45 |
gfidente | is the same I had in patchset 6 | 12:45 |
gfidente | to create the endpoints from the role | 12:45 |
gfidente | so first I'd move those within the role | 12:46 |
gfidente | then, I know EmilienM will hate me, but I think using an additional step is totally fine | 12:46 |
michchap_ | jaosorior: which is why it would need a dedicated step if we did it that way. I think what would be better is a class with a bool param for each endpoint that defaults to false, included on keystone role, and each other service can enable their own bool as needed. | 12:46 |
gfidente | I was indeed of the opinion that they would come back ... maybe not 7, but 6 at least | 12:46 |
gfidente | because steps are what give us some guarantee about the "global" state | 12:47 |
michchap_ | jaosorior: that way the implementation is centralised which is not great, but at least we know keystone won't go down during the request and also we don't need another step. | 12:47 |
gfidente | and that's what we need to create the endpoints IMHO | 12:47 |
michchap_ | gfidente: we don't even know that though - if keystone restarts during step N, you can't make any API calls to it from other services. | 12:47 |
jaosorior | exactly | 12:47 |
EmilienM | guys, while you're talking I'm proposing something | 12:47 |
gfidente | we point to a VIP | 12:48 |
*** mburned_out is now known as mburned | 12:48 | |
gfidente | not to the local keystone | 12:48 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-heat-templates: composable heat services https://review.openstack.org/313577 | 12:48 |
michchap_ | gfidente: but during the request it could go down, or the DB could go away, and we get a 500. | 12:48 |
*** jpena is now known as jpena|lunch | 12:48 | |
gfidente | so the DB won't go away because it was setup in previous step | 12:48 |
jaosorior | gfidente: But the service could go down (which is what kept happening after step 6 was removed) | 12:49 |
michchap_ | gfidente: if there are any keystone restarts due to config changes, it can 500 on a request | 12:49 |
gfidente | yeah I am for keeping step 6 | 12:49 |
EmilienM | no | 12:49 |
EmilienM | no more steps, I'm super serious | 12:50 |
jaosorior | EmilienM: michchap_ raises some good points up there ^^ | 12:50 |
EmilienM | I didn't read, I'm still in Gerrit, making a proposal | 12:50 |
*** athomas has quit IRC | 12:50 | |
jaosorior | ok | 12:50 |
EmilienM | but no more steps | 12:50 |
EmilienM | that is a bad usage of Puppet to do that | 12:50 |
michchap_ | EmilienM: we can do this without more steps, just make a profile class for endpoints and allow services to pass params to it. | 12:50 |
gfidente | EmilienM, no it's not bad usage | 12:50 |
EmilienM | can you guys let me write my proposal in Gerrit? | 12:50 |
gfidente | they buy us different features | 12:50 |
gfidente | EmilienM, requires can orchestrate the order in which operations happen on a single node | 12:51 |
gfidente | steps orchestrate across nodes | 12:51 |
*** dixiaoli has quit IRC | 12:51 | |
openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo: Add gnocchi profiles https://review.openstack.org/315527 | 12:51 |
gfidente | I don't think that trimming on one step just to make CI a little faster is worth the cost | 12:51 |
gfidente | seriously | 12:52 |
shardy | gfidente: have you seen the number of jobs hitting the CI global timeout lately?! | 12:52 |
michchap_ | steps can't orchestrate individual resources though, so if a service restarts from a config change during the same step as that service is used on another profile, there will be timing based failures. | 12:52 |
gfidente | shardy, but deploying on baremetal takes 20mins | 12:52 |
gfidente | not 2h | 12:52 |
gfidente | and I never measured how long it takes to create the undercloud | 12:52 |
gfidente | but it's not to do with the steps | 12:52 |
gfidente | the undercloud installation | 12:52 |
shardy | gfidente: about 10mins | 12:52 |
gfidente | so insisting on the steps, a single one in this case | 12:52 |
michchap_ | I think we're setting up for very bad times if we have to document every service restart in every step and be aware of that when making requests from other profiles. | 12:52 |
gfidente | also, to be honest, steps did the job until yesterday | 12:53 |
gfidente | we'd have to redo the same job | 12:53 |
*** ohamada has quit IRC | 12:53 | |
EmilienM | shardy, jaosorior, gfidente, michchap_, please read my comment on https://review.openstack.org/#/c/304125/12/manifests/profile/base/keystone.pp | 12:54 |
michchap_ | EmilienM: good point about the auth required for cross service requests. | 12:55 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Composable roles within services - NTP https://review.openstack.org/310421 | 12:55 |
jaosorior | EmilienM: I gave it a read and I fail to see where that falls on the deployment process | 12:56 |
EmilienM | gfidente: I'm not sure you realize all the CI failures because of timeouts we had lately. Deployments are just too long. We need to fix that another way than just adding more steps. | 12:56 |
EmilienM | we have the tools to make it | 12:56 |
gfidente | EmilienM, it's not steps which make it slow | 12:56 |
EmilienM | it is man | 12:57 |
gfidente | seriously | 12:57 |
EmilienM | it is | 12:57 |
*** julim has joined #tripleo | 12:57 | |
gfidente | that is not going to improve image building or undercloud deployment | 12:57 |
EmilienM | I dropped step7 that did NOTHING an we saved 14 min | 12:57 |
gfidente | it's just making overcloud faster | 12:57 |
gfidente | and overcloud takes 20mins on a real environment | 12:57 |
gfidente | with 7 steps | 12:57 |
EmilienM | and when I dropped step 6 we also save ~20 min | 12:57 |
gfidente | so I agree with you, 7 needs to go away because we don't need | 12:57 |
gfidente | but, insisting on 6 which actually turns useful | 12:57 |
*** athomas has joined #tripleo | 12:57 | |
gfidente | looks more an emergency measure | 12:58 |
michchap_ | I can write a patch now for the keystone profile that fixes this, as long as you're ok with doing it that way. | 12:58 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Configurable enabled plugins list for Sahara https://review.openstack.org/298430 | 12:58 |
gfidente | for example | 12:59 |
EmilienM | michchap_: fix what? | 12:59 |
gfidente | I think the endpoints should be created by the roles | 12:59 |
gfidente | so if to sacrifice step6 we need to use the booleans in the keystone class, like michchap_ suggested | 12:59 |
gfidente | I would rather not mess there, and use step6 | 13:00 |
gfidente | I totally understand that michchap_ is trying to find a solution | 13:00 |
*** [1]cdearborn has joined #tripleo | 13:00 | |
*** morazi has quit IRC | 13:00 | |
michchap_ | EmilienM: the patch you commented on just needs parameters to turn each endpoint on/off and then it's good. | 13:00 |
michchap_ | EmilienM: it's still composable and it will work with ordering because it's on the keystone profile. | 13:00 |
gfidente | so we'd have to understand based on the roles deployed | 13:00 |
gfidente | which of those booleans needs to be enabled | 13:01 |
gfidente | and heat can't help us doing that | 13:01 |
gfidente | *instead* | 13:01 |
*** pcaruana|afk| is now known as pcaruana | 13:01 | |
*** chem has joined #tripleo | 13:01 | |
jaosorior | michchap_: Actually that patch is failing with a 500 error while trying to setup an endpoint, because keystone restarted at some point | 13:01 |
michchap_ | gfidente: oh, it can't? | 13:01 |
gfidente | heat can do one more step to make sure each role can add its own endpoint after keystone gets ready | 13:01 |
gfidente | michchap_, no heat can't do conditionals | 13:01 |
gfidente | so to enable/disable a boolean we'd need to introspect the list of roles enabled | 13:01 |
gfidente | I mean | 13:01 |
gfidente | it looks to me totally not worth it | 13:02 |
*** [1]cdearborn has quit IRC | 13:02 | |
pabelanger | EmilienM: +1 for stop thinking about more steps | 13:02 |
michchap_ | jaosorior: oh, is that because it hits the VIP and the other controllers might be restarting keystone? | 13:02 |
jaosorior | I honestly don't have a strong opinion on how it should work. As long as we get this working. This is a pretty big blocker for me :/ | 13:02 |
shardy | gfidente: the whole point of composable services is to enable conditional inclusionn of service specific data | 13:02 |
jaosorior | michchap_ That's what I could gather from the logs | 13:02 |
shardy | surely we can output data from the per-service templates that is input to puppet in a way that it can be used for the conditionals? | 13:02 |
gfidente | shardy, yeah to enable or disable creation of a boolean in the keystone class, from the glance service | 13:03 |
*** morazi has joined #tripleo | 13:03 | |
michchap_ | shardy: will the data for eg. heat role get onto a node with the keystone role? | 13:03 |
michchap_ | shardy: it has to cross node boundaries if that makes sense | 13:03 |
shardy | gfidente, michchap_: right now it doesn't. but we may need to wire in an interface to enable it | 13:04 |
*** absubram has joined #tripleo | 13:04 | |
EmilienM | michchap_: I would try to follow my 2) proposal | 13:04 |
EmilienM | michchap_: using openrc and the right orchestration | 13:04 |
michchap_ | shardy: yeah, we might need a common dumping ground for cluster wide info. | 13:04 |
EmilienM | and figure why we have a 500 | 13:04 |
thrash | EmilienM: +1 | 13:05 |
*** masco has quit IRC | 13:05 | |
gfidente | ok looks like I am the only one who is not scared by steps :) | 13:05 |
michchap_ | EmilienM: You want to run against the localhost keystone? | 13:05 |
EmilienM | gfidente: I spent my whole week reading logs and catalogs | 13:05 |
EmilienM | we're basically wasting time | 13:05 |
gfidente | EmilienM, again it's buying us a feature | 13:06 |
gfidente | which is to sync across nodes | 13:06 |
jaosorior | EmilienM: I'm not opposed to your proposal. But I would like to know where in the deployment process does that fall, and what do you mean by "right orchestration" | 13:06 |
EmilienM | michchap_: 2) is about creating /root/openrc and feed it via hieradata, so you can use providers | 13:06 |
gfidente | and it's not going to speed up anything *but* the overcloud deployment | 13:06 |
gfidente | and overcloud deployment takes 20mins with 7 steps | 13:06 |
EmilienM | jaosorior: right, and we're going to help to figure | 13:06 |
michchap_ | EmilienM: right, and you'd point that at localhost keystone instead of the VIP? | 13:06 |
gfidente | so I understand in CI this makes an impact | 13:06 |
michchap_ | EmilienM: because that means the request can't go to a node that may be restarting keystone in this step? | 13:07 |
gfidente | but to me looks like not worth it as it only helps CI | 13:07 |
EmilienM | michchap_: it can't be localhost, because we're not sure heat-api will run on the same node as keystone | 13:07 |
gfidente | and makes our lives more difficult | 13:07 |
EmilienM | michchap_: we need to use the vip and find a way to determine if the vip is reachable | 13:07 |
EmilienM | michchap_: err, if keystone is reachable via the vip | 13:07 |
gfidente | and the code a bit less 'role-based' | 13:07 |
michchap_ | EmilienM: if it hits the VIP, we don't know if the underlying service might be restarting during this step, and if it does we can get an error | 13:07 |
EmilienM | michchap_: do you remember https://github.com/voxpupuli/puppet-healthcheck ? | 13:08 |
michchap_ | EmilienM: actually can we just retry? | 13:08 |
pabelanger | gfidente: as somebody who has tried for the past week to land a patch in tripleo-ci, it is super frustrating how long the CI jobs takes (and unstable because of timeouts). Anything that can be done to reduce the deployment time in the CI pipeline gets my vote, as I'll be a happier developer. | 13:09 |
michchap_ | EmilienM: yeah but if it passes the check and then restarts a second later when we're making the API call we still get an error. | 13:09 |
EmilienM | right | 13:09 |
shardy | pabelanger: you're not alone ;) | 13:10 |
michchap_ | EmilienM: so that's why I say do it in the keystone profile and do it against the localhost bind on pacemaker_master | 13:10 |
rdopiera | not a new idea, but how about keeping stats on which tests fail the most often, and running those tests first, so that it fails faster? | 13:10 |
shardy | we need to optimize everywhere, and improving the overcloud deployment time is really important from a CI, operator experience and developer productivity perspective | 13:11 |
shardy | If we shave 5 mins off the overcloud deployment time I probably save an hour a day in my local deployment workflow, as will all other developers | 13:11 |
michchap_ | I think a more general comment as well is that this is going to be a continual problem. I wrote a similar system using consul notifies and I had 44 steps. | 13:11 |
EmilienM | michchap_: and we could enable/disable services in service yaml | 13:11 |
michchap_ | So just saying that we add a step whenever we need to do things is probably not going to scale as the # of services keeps growing | 13:12 |
EmilienM | michchap_: for example, we could include all <project>::keystone::auth in keystone profile, with booleans (false by default) and set true in puppet/services/glance-api.yaml for example | 13:12 |
jaosorior | EmilienM, michchap_: Why not have the service enablement flags retrieved from hieradata? | 13:12 |
EmilienM | oh wait that does not work | 13:12 |
michchap_ | EmilienM: because the heat/glance/etc. service can't put data in the keystone profile? | 13:13 |
*** fultonj has joined #tripleo | 13:13 | |
gfidente | pabelanger, and you tried your submissions on your dev environment and they were faster after step6 was removed? | 13:13 |
EmilienM | jaosorior: we need something composable, and hieradata is pretty common across all nodes | 13:13 |
shardy | we could wire in an endpoint_data interface to all the service templates in addition to step_config perhaps | 13:13 |
shardy | and combine that (for all roles) to provide an input to the keystone configuration step? | 13:14 |
shardy | dprince: ^^ | 13:14 |
EmilienM | michchap_: if I feed glance-api profile data, no keystone role won't read it AFIK | 13:14 |
*** links has quit IRC | 13:14 | |
dprince | shardy: agree, I thought of the same | 13:15 |
dprince | shardy: gradually we'll refine this into a really slick interface for each service I think | 13:15 |
pabelanger | gfidente: I don't have a local dev environment, nor have tested the removal of step6. I'm simply trying to migrate the jenkins slave from fedora-22 to centos-7. But, if there are logs posted in the some place, I am happy to review them | 13:15 |
gfidente | pabelanger, the CI jobs are short | 13:16 |
shardy | dprince: +1 - it'd be nice to kill the endpoint_data.yaml in favor of defining the per-service endpoints in the service templates | 13:16 |
EmilienM | gfidente: define short? | 13:16 |
gfidente | sorry I meant shorte | 13:16 |
gfidente | *shorter | 13:16 |
gfidente | without the steps | 13:16 |
gfidente | and we all agreed on removing 7 | 13:17 |
gfidente | it's the tradeoff or removing 6 we were eventually discussing | 13:17 |
jistr | shardy, dprince: on a related note -- what about service manifest https://review.openstack.org/#/c/313543/ https://review.openstack.org/#/c/313544/ -- it can be used to solve the endpoint problem, and other problems too | 13:17 |
pabelanger | Ya, anything to make it faster / more stable gets my +1 | 13:17 |
pabelanger | even if it impacts CI | 13:17 |
jistr | shardy, dprince: basically a list of services that are deployed, that can be queried either from the node, or could be queried from hiera too | 13:18 |
jaosorior | jistr: Actually that could actually help in this case | 13:18 |
gfidente | pabelanger, sure, the problem is it impacts the way we need to do the endpoints as well | 13:18 |
*** lblanchard has joined #tripleo | 13:18 | |
*** chem has quit IRC | 13:19 | |
pabelanger | gfidente: Agreed, but it sounds like EmilienM and michchap_ have some thoughts about that. Not saying it is an easy fix, but something that should be considered | 13:20 |
shardy | jistr: that's interesting - we'd still have to figure out how that works when there are multiple roles (e.g multiple *ServiceChain resources) | 13:20 |
*** coolsvap has joined #tripleo | 13:21 | |
shardy | as the problem here is distributing data over potentially multiple roles (e.g how does "Controller" running keystone know heat-api is running on a custom "HeatController" role) | 13:21 |
*** chem has joined #tripleo | 13:21 | |
gfidente | pabelanger, yeah and I am certainly not going to -1 that | 13:21 |
michchap_ | jaosorior: I think one way to make your patch pass reliably is to make it run those commands against the local Keystone instead of the VIP using one of Emilien's auth methods, if you want to try for a quicker fix. | 13:22 |
jistr | shardy: right, i see, that's not solved by the service manifest currently. Perhaps we need a per-role service manifest ("what do i need to upgrade on this node?") as well as global service manifst ("what endpoints should i create?") | 13:22 |
shardy | jistr: Yeah, I'm basically proposing a global interface, which could be generic or specific to endpoints | 13:22 |
jaosorior | michchap_: Well, it is going to get -1ed to oblivion with the current proposal. So if people have ideas on how to make it more composable, they could work. Or would that be further patches? | 13:23 |
shardy | e.g we could just define an endpoint_data interface for all services | 13:23 |
shardy | and put the data right into the mapping defined for each service | 13:23 |
shardy | no puppet magic required ;) | 13:23 |
jaosorior | michchap_, shardy, EmilienM: It does sound to me like having flags that tell us which services are enabled could be done with hieradata though. Is that considered a dirty solution? Or what's the problem with that? | 13:24 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Write service manifest on the controllers https://review.openstack.org/313544 | 13:24 |
michchap_ | jaosorior: if puppet is going to be used to run the commands this issue won't go away regardless of composability. | 13:24 |
jaosorior | michchap_ I agree | 13:24 |
shardy | jaosorior: the problem is the hieradata won't necessarily end up on the right nodes | 13:24 |
michchap_ | jaosorior: no that's a fine solution, but service X can't give data to Service Y (Keystone) to tell it to make the endpoint. | 13:24 |
jistr | shardy, dprince, jaosorior: i'd lean towards a generic interface perhaps, where we could exchange more information between roles. I'd imagine it's not only about "what are the keystone endpoints (== haproxy binds)" but it would also about "what are the backend servers (== haproxy backends)" | 13:24 |
michchap_ | jaosorior: so the discussion is how to add that mechanism. | 13:25 |
shardy | e.g if there is a dedicated group of nodes running heat-api that hieradata won't end up on the node running keystone | 13:25 |
shardy | (just using heat-api as an example) | 13:25 |
shardy | jistr: sure - I'd personally prefer something with a defined structure tho vs a freeform interface | 13:26 |
shardy | we want to make it really easy for service template authors to plug in their data in a common way | 13:26 |
jaosorior | shardy: why not just pass all the endpoint related data to the keystone profile and that way we make sure it's on the right place? it's pretty much what michchap_ had proposed. Makes a lot of sense | 13:26 |
shardy | jaosorior: yeah, we just need to define a sane interface to enable that | 13:27 |
*** Goneri has joined #tripleo | 13:27 | |
michchap_ | shardy: just a random comment, but we're going to have the same convo about haproxy listen/backends | 13:28 |
jaosorior | true that | 13:28 |
michchap_ | and we dodged the DB case by using step3, which had nothing in it. | 13:28 |
shardy | michchap_: ack, we'll have to do as jistr suggest then and define a data blob flexible enough to support both requirements | 13:28 |
gfidente | michchap_, well no the DB was a different problem, it was about orchestrating the process ... distributing the list of enabled backends in haproxy can't be done with steps, it's about knowing which roles are deployed and where | 13:30 |
gfidente | for the DB we just needed to make sure it was stable before moving forward | 13:30 |
michchap_ | the db case is the same as the endpoint one, though. | 13:31 |
gfidente | same as endpoint yes | 13:31 |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Add a service manifest https://review.openstack.org/313543 | 13:31 |
gfidente | which goes back to step 6 ... | 13:31 |
*** tzumainn has joined #tripleo | 13:31 | |
gfidente | ... the problem of distributing non-role-pertinent in keystone | 13:31 |
gfidente | is because we decided to remove step 6 | 13:31 |
jistr | shardy, michchap_: we can always document some "well-known structure" of the data blob for the most usual cases (keystone endpoints, haproxy listens), and leave the rest for generic usage | 13:32 |
gfidente | but I don't want to start this conversation again, seriously :) | 13:32 |
*** fragatina has quit IRC | 13:32 | |
jaosorior | michchap_, EmilienM: Is openstack_extras already included in the overcloud images? | 13:34 |
jistr | shardy: only i wonder how do we make the merging happen sufficiently via map_merge, so that we can merge the sub-maps from the blob, rather than overwrite... we could use not just merging the whole blob, but perhaps something like deep-merge at least on one more level (think how merging environment files works wrt resource_registry) | 13:34 |
michchap_ | jaosorior: almost certainly | 13:34 |
EmilienM | yes it's in OPM | 13:35 |
*** ramishra has quit IRC | 13:35 | |
jaosorior | Checking how to use what | 13:36 |
shardy | jistr: Yeah, we'll have to give that some thought - I was thinking mostly of the endpoint data where the keys should not overlap | 13:38 |
*** ramishra has joined #tripleo | 13:38 | |
jistr | as a side note, i think gfidente has a point that we should be careful how far we optimize. Trading some time saving for increased complexity of the puppet manifest might not always be the best thing to do. | 13:40 |
jistr | in theory we can deploy everything in a single step. Astapor did that. | 13:40 |
*** fragatina has joined #tripleo | 13:41 | |
jistr | but see how the manifest looks like with arrows and anchor resources | 13:41 |
jistr | https://github.com/redhat-openstack/astapor/blob/master/puppet/modules/quickstack/manifests/pacemaker/galera.pp | 13:41 |
jistr | it's hard to comprehend all the order dependencies there without knowing what's written in other manifests | 13:41 |
*** dtantsur is now known as dtantsur|bbl | 13:42 | |
adarazs | larsks: hi, when you have some time, can you take a look at this change and see if it looks okay (for quickstart being able to inject gating rpms to images)? https://review.openstack.org/313570 | 13:42 |
gfidente | and also I think we couldn't do that unless we deploy all roles on same host | 13:42 |
gfidente | because we won't necessarily have the depending resources in the same manifest | 13:43 |
larsks | adarazs: absolutely. | 13:43 |
adarazs | larsks: awesome. thanks. :) | 13:43 |
jistr | gfidente: +1, good point. Puppet arrows only work on a single node. If we want to allow splitting the services to different nodes, and we need some ordering between those services, then steps are the only way to achieve that. Arrows won't help. | 13:44 |
EmilienM | dtantsur|bbl: thx for your review! | 13:45 |
jistr | EmilienM shardy ^^ | 13:45 |
larsks | adarazs: what calls the inject_gating_repo.sh script? | 13:45 |
EmilienM | I nkow arrows won't help on multi node | 13:45 |
EmilienM | but I'm sure there is a way to tell the keystone node to execute the endpoints that we want | 13:46 |
adarazs | larsks: https://review.openstack.org/#/c/313570/2/playbooks/roles/libvirt/setup/undercloud/tasks/inject_gating_repo.yml -- it's called on line 11 | 13:46 |
EmilienM | if 1) we manage to tell keystone profile which endpoints we want 2) keep managing endpoints at step5 on pacemaker_master, I think we're good | 13:47 |
EmilienM | jistr: we're not talking about a single step | 13:47 |
larsks | adarazs: oh, right, missed that the task was running a command in addition to install the tar.gz file. Thanks! | 13:47 |
EmilienM | jistr: but 5 steps is good enough | 13:47 |
*** tosky has joined #tripleo | 13:49 | |
openstackgerrit | Merged openstack/tripleo-quickstart: Add gating repo injecting for undercloud https://review.openstack.org/313570 | 13:50 |
adarazs | woot \o/ :) | 13:50 |
jaosorior | adarazs: Any way to get the delorean-current with the latest t-h-t and stuff with tripleo-quickstart? I think at the moment it's using stable/mitaka | 13:51 |
larsks | adarazs: i'm a little suspicious of this model, as noted in my review comment, but it sounds like you need this right now to Actual Things... | 13:51 |
bnemec | d0ugal: It isn't imported, it's returned from https://github.com/openstack/tripleo-common/blob/master/tripleo_common/filters/list.py | 13:52 |
bnemec | Which is configured for use in https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.yaml.template#L325 | 13:52 |
jaosorior | or larsks ^^ | 13:52 |
adarazs | larsks: happy to hear improvements on the idea, but yeah, I'm trying to whip up some gating using quickstart. | 13:53 |
larsks | jaosorior: you can certainly point the quickstart at an image from master, rather than using the mitaka or liberty undercloud images. | 13:53 |
larsks | jaosorior: this is what we run in CI: https://gist.github.com/larsks/f3733820bac3ff4739b9baf65691b621 | 13:53 |
dprince | jistr: yes. the service manifest idea could help us I think | 13:54 |
jaosorior | larsks: Thanks dude! | 13:55 |
adarazs | jaosorior: so, I made this: https://github.com/redhat-openstack/ansible-role-tripleo-gate -- if you'd pass master as refspec to it, I think it would build the latest THT and would inject it into whatever image you're pointing it to with tripleo-quickstart. | 13:55 |
jistr | dprince: cool | 13:55 |
EmilienM | jistr: I'm currently reading again your patches and see how we could use it | 13:55 |
adarazs | jaosorior: did this answer your question? :) | 13:55 |
*** zoli_gone-proxy is now known as zoliXXL | 13:55 | |
*** jpena|lunch is now known as jpena | 13:56 | |
adarazs | jaosorior: oh you mean if it's possible to do all this on master? I think the tripleo-quickstart promote job is now passing on master, so it should work, but I only tested on stable for now. | 13:56 |
*** egafford has joined #tripleo | 13:56 | |
EmilienM | jistr: with your work on "service manifest", I don't see how the keystone profile can know which endpoints need to be created | 13:57 |
jaosorior | adarazs: Lets see how it goes :O | 13:58 |
adarazs | I'm going to test it soon. | 13:59 |
*** fragatina has quit IRC | 13:59 | |
*** ebalduf has joined #tripleo | 13:59 | |
d0ugal | bnemec: aha, thanks :) | 14:00 |
jistr | EmilienM: it will not know the endpoints, it will only say which services are deployed, and based on that you can select from endpoint info, which would be defined elsewhere. There's a persisting problem though, as shardy mentioned, that this will only know about the services deployed on the same node as keystone. If we want to create a different node role in the future, where we also deploy APIs, we'll have to collect the service map | 14:00 |
jistr | globally, or make the "information exchange blob" we talked about earlier. | 14:00 |
*** penick has quit IRC | 14:00 | |
d0ugal | bnemec: I was just looking at the code coverage and list.py looked like a candidate for deletion - but it seems not! | 14:00 |
EmilienM | jistr: right | 14:01 |
bnemec | d0ugal: :-) | 14:02 |
jistr | EmilienM, dprince: we'll probably need the blob anyway to exchange other type of info than just endpoints, so i'd be +1 for that approach. We just didn't figure out how to make it happen in Heat yet i think, given that the tools we have are mostly list_join and map_merge, and we could use a map_deep_merge in fact... | 14:02 |
gfidente | jistr, yeah the haproxy/backends is one of those cases | 14:07 |
gfidente | I think michchap_ raised it earlier | 14:07 |
shardy | jistr: we could wire in an interface and prove it with just map_merge for endpoints, then address the deep_merge use-case afterwards | 14:09 |
jistr | shardy: yea that sounds fine | 14:11 |
*** d0ugal has quit IRC | 14:14 | |
*** d0ugal has joined #tripleo | 14:16 | |
*** d0ugal has quit IRC | 14:23 | |
*** bvandenh has joined #tripleo | 14:32 | |
*** saneax is now known as saneax_AFK | 14:34 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: WIP: integrate PCS provider in the merge. https://review.openstack.org/310713 | 14:35 |
*** links has joined #tripleo | 14:36 | |
jaosorior | michchap_ here's the log of the failure: http://logs.openstack.org/25/304125/12/check-tripleo/gate-tripleo-ci-f22-ha/02ef967/ from what I could gather it was failing with a 500 error when trying to access keystone | 14:37 |
*** mcornea has quit IRC | 14:38 | |
*** thrash is now known as thrash|afk | 14:40 | |
*** stendulker has joined #tripleo | 14:43 | |
*** Guest42459 is now known as abehl | 14:44 | |
*** abehl is now known as anshul | 14:45 | |
*** anshul is now known as Guest97478 | 14:46 | |
*** Guest97478 is now known as abehl | 14:46 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Nodes Registration https://review.openstack.org/315136 | 14:53 |
*** hewbrocca-afk is now known as hewbrocca | 14:55 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Replace NodeConfigIdentifiers with DeployIdentifier https://review.openstack.org/315616 | 14:58 |
*** cwolferh has joined #tripleo | 14:59 | |
*** coolsvap has quit IRC | 15:12 | |
*** r-mibu has quit IRC | 15:14 | |
*** r-mibu has joined #tripleo | 15:14 | |
*** yamahata has joined #tripleo | 15:16 | |
*** ohamada has joined #tripleo | 15:17 | |
openstackgerrit | Ethan Gafford proposed openstack/tripleo-heat-templates: Pass MysqlVirtualIP via EndpointMap https://review.openstack.org/305751 | 15:18 |
openstackgerrit | Ethan Gafford proposed openstack/tripleo-heat-templates: Trove Integration https://review.openstack.org/233240 | 15:18 |
*** d0ugal has joined #tripleo | 15:18 | |
*** shakamunyi has quit IRC | 15:19 | |
*** leanderthal is now known as leanderthal|afk | 15:22 | |
*** ebarrera has quit IRC | 15:22 | |
openstackgerrit | Merged openstack/tripleo-quickstart: Correct a typo in post install template https://review.openstack.org/314830 | 15:27 |
*** coolsvap has joined #tripleo | 15:29 | |
*** aufi has quit IRC | 15:31 | |
*** trozet has joined #tripleo | 15:31 | |
*** links has quit IRC | 15:32 | |
*** dmk0202 has quit IRC | 15:35 | |
*** dmk0202 has joined #tripleo | 15:36 | |
*** mikelk has quit IRC | 15:37 | |
*** tremble has quit IRC | 15:49 | |
ifarkas | lucasagomes, mgould, hi, I am trying to add ironic to the overcloud but I am hitting this error | 15:55 |
ifarkas | does it look familiar to you? | 15:55 |
ifarkas | http://paste.openstack.org/show/496937/ | 15:55 |
mgould | ifarkas, looking now | 15:55 |
mgould | ifarkas, I haven't seen that error before | 15:56 |
* mgould takes a look at the puppet-ironic source | 15:57 | |
mgould | ifarkas, you may have better luck asking in #puppet-openstack | 15:57 |
ifarkas | mgould, ok, thanks | 15:57 |
jaosorior | larsks: Well, that didn't work :/ with a recently built undercloud (with tripleo quickstart) I am not able to deploy an overcloud | 15:58 |
jaosorior | getting no valid host found errors | 15:59 |
larsks | jaosorior: I see that our ci jobs for https://ci.centos.org/view/rdo/view/promotion-pipeline/job/tripleo-quickstart-promote-master-delorean-minimal/ seem to have been failing since this morning. I'll take a look in a bit. | 15:59 |
mgould | ifarkas, it's complaining that /etc/ironic/ironic.conf isn't there | 16:00 |
*** jcoufal has quit IRC | 16:00 | |
mgould | I don't know where that file is expected to come from | 16:00 |
ifarkas | mgould, yeah, I would expect puppet to create it | 16:02 |
mgould | yep | 16:02 |
mgould | but OTOH, I wouldn't be surprised if some other tool puts it there and puppet just checks for its presence | 16:02 |
larsks | mgould: I think that's generally provided by the package, right? | 16:03 |
*** jtomasek has quit IRC | 16:03 | |
mgould | larsks, dunno | 16:03 |
* lucasagomes looks | 16:04 | |
larsks | mgould: let me rephrase; on my undercloud, that file is owned by the openstack-ironic-common package. | 16:04 |
mgould | larsks, I'm looking at https://github.com/openstack/puppet-ironic/blob/master/manifests/init.pp#L277 | 16:04 |
mgould | does that mean "ironic-common provides /etc/ironic/ironic.conf"? | 16:05 |
lucasagomes | ifarkas, odd, so ironic-dbsync is created when Ironic is installed (see setup.cfg) | 16:05 |
larsks | mgould: It means it's *expected* to, it looks like. | 16:06 |
mgould | OK, thanks | 16:06 |
mgould | and that package is defined on line 282? | 16:06 |
larsks | Assuming that $::ironic::params::common_package_name is correct, you should have openstack-ironic-common installed, and 'rpm -ql openstack-ironic-common' should show that file... | 16:06 |
*** jaosorior has quit IRC | 16:06 | |
larsks | Yeah. | 16:06 |
jrist | EmilienM: that was super helpful. thanks for letting me lurk! | 16:07 |
mgould | ifarkas, can you run that command on the machine you're deploying? | 16:07 |
ifarkas | lars, mgould, right, so it's not installed | 16:08 |
*** pkovar has quit IRC | 16:08 | |
mgould | oh, I see ironic-common is a deb or an rpm | 16:08 |
EmilienM | jrist: you're welcome | 16:08 |
ifarkas | I need to figure out how to add this dependency | 16:09 |
ifarkas | thanks larsks and mgould! | 16:09 |
mgould | ifarkas, looks like it's there already: https://github.com/openstack/puppet-ironic/blob/master/manifests/params.pp#L31 | 16:09 |
*** egafford has quit IRC | 16:10 | |
ifarkas | mgould, oh, that is interesting... | 16:10 |
lucasagomes | ifarkas, mgould I think this is https://github.com/openstack/tripleo-puppet-elements/blob/master/elements/overcloud-controller/install.d/package-installs-overcloud-controller | 16:11 |
lucasagomes | this element is responsible for installing all the software needed in the controller node | 16:11 |
mgould | ifarkas, https://docs.puppet.com/puppet/latest/reference/types/package.html looks relevant | 16:11 |
mgould | "Some package types (e.g., yum and apt) can retrieve their own package files, while others (e.g., rpm and sun) cannot." | 16:11 |
ifarkas | lucasagomes, right, I will give it a try | 16:11 |
* mgould thought yum packages were rpms, but what do I know... | 16:11 | |
*** egafford has joined #tripleo | 16:11 | |
lucasagomes | mgould, aren't they!? | 16:12 |
mgould | lucasagomes, the authors of the puppet docs don't think so :-) | 16:12 |
ifarkas | yum is a package manager using rpm, not? | 16:12 |
mgould | that's what I thought, yes | 16:12 |
larsks | ifarkas: yes, it is. | 16:12 |
lucasagomes | strange... maybe that's because of the types of rpm? | 16:13 |
mgould | maybe you can set provider => "yum" or provider => "rpm" in Puppet | 16:13 |
lucasagomes | e.g rpm5 is not used by red hat | 16:13 |
lucasagomes | its used on mandriva/mageia | 16:13 |
lucasagomes | red hat uses rpm4 | 16:13 |
mgould | and they're both using RPMs under the hood, but as far as Puppet's concerned only "yum" packages are fetchable | 16:13 |
lucasagomes | but not sure if that's what they meant there | 16:13 |
mgould | dunno | 16:14 |
larsks | lucasagomes: there are separate "rpm" and "yum" providers available. | 16:14 |
*** dmk0202 has quit IRC | 16:15 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Composable manila tht side WIP https://review.openstack.org/315658 | 16:16 |
*** oshvartz has joined #tripleo | 16:16 | |
lucasagomes | larsks, ok, is it a puppet thing? | 16:16 |
lucasagomes | whether install a package using rpm or yum (for depenedncy mgmt) | 16:17 |
larsks | Right. | 16:17 |
*** milan_ has quit IRC | 16:19 | |
lucasagomes | gotcha :-) | 16:20 |
lucasagomes | larsks, thanks | 16:20 |
*** devvesa has quit IRC | 16:20 | |
*** d0ugal has quit IRC | 16:20 | |
*** abehl has quit IRC | 16:22 | |
*** d0ugal has joined #tripleo | 16:22 | |
*** oshvartz has quit IRC | 16:25 | |
*** bvandenh has quit IRC | 16:25 | |
*** d0ugal has quit IRC | 16:27 | |
*** fragatina has joined #tripleo | 16:27 | |
*** d0ugal has joined #tripleo | 16:42 | |
*** michchap has joined #tripleo | 16:47 | |
*** michchap_ has quit IRC | 16:48 | |
openstackgerrit | Miles Gould proposed openstack/tripleo-common: Import initial_state logic from tripleoclient https://review.openstack.org/309521 | 16:50 |
*** stendulker has quit IRC | 16:50 | |
*** michchap_ has joined #tripleo | 16:51 | |
*** michchap has quit IRC | 16:52 | |
*** lucasagomes is now known as lucas-dinner | 16:54 | |
*** sambetts is now known as sambetts|afk | 16:55 | |
*** hewbrocca is now known as hewbrocca-afk | 16:58 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: WIP: integrate PCS provider in the merge. https://review.openstack.org/310713 | 17:00 |
*** michchap has joined #tripleo | 17:01 | |
*** michchap_ has quit IRC | 17:02 | |
*** thrash|afk is now known as thrash | 17:06 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: WIP prototyping fully composable/custom roles https://review.openstack.org/315679 | 17:07 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: WIP prototyping fully composable/custom roles https://review.openstack.org/315679 | 17:09 |
*** michchap has quit IRC | 17:09 | |
*** jpena is now known as jpena|off | 17:10 | |
*** michchap has joined #tripleo | 17:11 | |
*** mgould has quit IRC | 17:14 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: WIP prototyping fully composable/custom roles https://review.openstack.org/315679 | 17:14 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: WIP prototyping fully composable/custom roles https://review.openstack.org/315679 | 17:15 |
*** mburned is now known as mburned_out | 17:15 | |
dtrainor | nice shardy | 17:16 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: WIP prototyping fully composable/custom roles https://review.openstack.org/315679 | 17:17 |
shardy | gah, messed up pushing those fixes | 17:17 |
shardy | anyway, appreciate any feedback on the general approach before I commit a lot more time to it | 17:17 |
shardy | it's not functional yet | 17:17 |
dtrainor | hehe. doesnt make it any less exciting | 17:18 |
ayoung | larsks, I'm trying to debug some libvirt setup issue in the undercloud. I'm looking at the defaults which say the libvirt_uri: qemu:///session but does not way what user. I can't use virsh as the stack user: Cannot create user runtime directory '/run/user/1002/libvirt': Permission denied | 17:19 |
ayoung | but the calls seem to be going through from ansible. How are they being made, and how can I connect to see the state of the virsh subsystem? | 17:19 |
openstackgerrit | Ben Nemec proposed openstack/tripleo-docs: Recommend stopping all services before undercloud upgrade https://review.openstack.org/315683 | 17:19 |
*** michchap_ has joined #tripleo | 17:20 | |
larsks | ayoung: if became the stack user via 'su - stack', try ssh'ing in directly as that user (ssh -i id_rsa_virt_host stack@yourvirthost) and let me know if the behavior is different. | 17:21 |
*** michchap has quit IRC | 17:22 | |
larsks | The 'id_rsa_virt_host' file is in your local working directory, which defaults to ~/.quickstart. | 17:22 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: WIP prototyping fully composable/custom roles https://review.openstack.org/315679 | 17:23 |
*** dtantsur|bbl is now known as dtantsur | 17:24 | |
*** jistr has quit IRC | 17:24 | |
ayoung | larsks, OK, that works. Why? | 17:26 |
*** tosky has quit IRC | 17:26 | |
larsks | Because using 'su -' doesn't handle user sessions the same way as logins, although I'm not actually sure about the technical details. Is selinux enabled on your system? Does 'su - stack' work if you disable selinux? | 17:27 |
larsks | Possibly it's just a simple policy issue. | 17:27 |
ayoung | larsks, that would make sense. getenforce is Enforcing | 17:27 |
*** shardy has quit IRC | 17:27 | |
ayoung | anyway, this is enough for me to debug. Thanks | 17:27 |
larsks | Sure. | 17:28 |
larsks | Although if you can grab the audit messages that correspond to the failure when accessing stack via su, I would be curious... | 17:28 |
*** d0ugal has quit IRC | 17:34 | |
*** julim has quit IRC | 17:35 | |
*** rdo has quit IRC | 17:38 | |
*** mburned_out is now known as mburned | 17:44 | |
*** rdo has joined #tripleo | 17:46 | |
*** saneax_AFK is now known as saneax | 17:49 | |
*** shivrao has joined #tripleo | 17:50 | |
Erming_ | Hi, how to correctly add nodes into registration and/or re-register nodes? I added a few nodes into instackenv.json, re-imported, and then the introspection always timed out. Can I delete all of them and then re-register the nodes? | 17:51 |
Erming_ | I mean introspection always timed out on the new nodes. | 17:51 |
Erming_ | How to clean node info in the local-cache? I mean I want to start from scratch. | 17:52 |
*** d0ugal has joined #tripleo | 17:53 | |
*** coolsvap has quit IRC | 17:57 | |
*** pcaruana has quit IRC | 17:58 | |
*** ohamada has quit IRC | 18:01 | |
larsks | The RDO CI overcloud deployment is failing; nova-compute reports "OrphanedObjectError: Cannot call obj_load_attr on orphaned Instance object". Does that ring a bell with anybody? | 18:02 |
larsks | Oh, maybe this: https://bugs.launchpad.net/nova/+bug/1580987 | 18:02 |
openstack | Launchpad bug 1580987 in OpenStack Compute (nova) ""Cannot call obj_load_attr on orphaned Instance object" in baremetal_basic_ops" [High,In progress] - Assigned to Jim Rollenhagen (jim-rollenhagen) | 18:02 |
*** dciabrin is now known as dciabrin|away | 18:05 | |
*** dtantsur is now known as dtantsur|afk | 18:07 | |
*** d0ugal has quit IRC | 18:08 | |
*** electrofelix has quit IRC | 18:09 | |
*** rcernin has quit IRC | 18:09 | |
*** jistr has joined #tripleo | 18:15 | |
*** jistr is now known as jistr|afk | 18:15 | |
*** julim has joined #tripleo | 18:17 | |
*** openstackgerrit has quit IRC | 18:18 | |
*** openstackgerrit has joined #tripleo | 18:18 | |
*** jtomasek has joined #tripleo | 18:26 | |
*** saneax is now known as saneax_AFK | 18:27 | |
*** onovy has quit IRC | 18:28 | |
*** trozet has quit IRC | 18:28 | |
*** onovy has joined #tripleo | 18:28 | |
*** chem has quit IRC | 18:30 | |
*** trozet has joined #tripleo | 18:43 | |
*** dmk0202 has joined #tripleo | 18:47 | |
*** TSCHAK has quit IRC | 18:53 | |
*** shivrao has quit IRC | 18:58 | |
*** sambetts|afk has quit IRC | 18:59 | |
*** sambetts has joined #tripleo | 19:03 | |
*** d0ugal has joined #tripleo | 19:03 | |
*** shivrao has joined #tripleo | 19:05 | |
*** fragatina has quit IRC | 19:08 | |
*** trozet has quit IRC | 19:14 | |
jdob | egafford: ping | 19:24 |
egafford | jdob: pong | 19:24 |
egafford | jdob: What's up? | 19:24 |
jdob | egafford: hey, I'm trying to get a run of https://review.openstack.org/#/c/305751/ with a heat patch in CI, but you keep blowing away my Depends-On :) | 19:24 |
jdob | can you make sure you rebase before your next patch (I'm guessing it's a dep you are changing) | 19:25 |
*** trozet has joined #tripleo | 19:25 | |
egafford | jdob: Oh, sorry. :/ I'll make certain not to touch that in the future (I am actually rebasing with each patch; not certain how I'm stepping on you. Regardless, will cease to step on you.) | 19:26 |
jdob | to be honest, I'm not entirely sure how you're doing it either | 19:26 |
egafford | Really sorry about that; I know that's intensely frustrating. | 19:26 |
jdob | this is one of those weird ass git edge cases | 19:26 |
jdob | that you run into once a year | 19:26 |
egafford | Well, at least now I know that I am in fact doing it, and will cease to do it in the future. | 19:27 |
jdob | awesome, thanks :) | 19:27 |
openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-quickstart: work around ansible issue #15744 https://review.openstack.org/315734 | 19:28 |
*** athomas has quit IRC | 19:28 | |
thrash | egafford: make sure you 'git review -d xxxxxxx' on jdob's patch before you rebase. | 19:29 |
openstackgerrit | Jay Dobies proposed openstack/tripleo-heat-templates: [WIP] Pass MysqlVirtualIP via EndpointMap https://review.openstack.org/305751 | 19:30 |
egafford | thrash: Cool; makes sense. | 19:31 |
*** bswartz has quit IRC | 19:39 | |
openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-quickstart: Explicit Teardown https://review.openstack.org/313127 | 19:44 |
openstackgerrit | Merged openstack/tripleo-quickstart: work around ansible issue #15744 https://review.openstack.org/315734 | 19:45 |
*** fragatina has joined #tripleo | 19:46 | |
*** mbound has joined #tripleo | 19:49 | |
*** jistr|afk has quit IRC | 19:52 | |
*** yamahata has quit IRC | 19:52 | |
*** myoung|lunch has joined #tripleo | 19:57 | |
*** myoung|lunch has quit IRC | 19:57 | |
*** myoung|lunch has joined #tripleo | 19:57 | |
*** yamahata has joined #tripleo | 19:58 | |
openstackgerrit | ayoung proposed openstack/tripleo-quickstart: WIP Allow for multiple undercloud nodes https://review.openstack.org/315749 | 20:03 |
EmilienM | ayoung: see my latest thread on openstack-dev [tripleo] | 20:04 |
*** lblanchard has quit IRC | 20:05 | |
openstackgerrit | ayoung proposed openstack/tripleo-quickstart: WIP Allow for multiple undercloud nodes https://review.openstack.org/315749 | 20:05 |
ayoung | EmilienM, policy file changes, too | 20:07 |
EmilienM | oh yeah missed that one please add it | 20:07 |
*** ebalduf has quit IRC | 20:09 | |
*** yamahata has quit IRC | 20:09 | |
ayoung | EmilienM, and here is where I realize I've been reading mail while the vpn is down and none of the messages I read are tagged as read. | 20:10 |
*** bvandenh has joined #tripleo | 20:19 | |
*** ayoung has quit IRC | 20:20 | |
*** rcernin has joined #tripleo | 20:24 | |
*** yamahata has joined #tripleo | 20:33 | |
*** cwolferh has quit IRC | 20:35 | |
*** jprovazn has quit IRC | 20:37 | |
*** dbecker has quit IRC | 20:41 | |
*** Goneri has quit IRC | 20:50 | |
*** dprince has quit IRC | 20:54 | |
*** jayg is now known as jayg|g0n3 | 21:01 | |
*** gfidente has quit IRC | 21:01 | |
*** paramite has quit IRC | 21:06 | |
*** bvandenh has quit IRC | 21:13 | |
*** egafford has quit IRC | 21:15 | |
*** cwolferh has joined #tripleo | 21:21 | |
*** fpan has quit IRC | 21:24 | |
*** fpan has joined #tripleo | 21:28 | |
*** dtantsur|afk has quit IRC | 21:33 | |
*** fpan has quit IRC | 21:34 | |
*** pino|work has quit IRC | 21:34 | |
*** pino|work has joined #tripleo | 21:35 | |
*** dtantsur has joined #tripleo | 21:35 | |
*** dmacpher has quit IRC | 21:43 | |
*** bswartz has joined #tripleo | 21:47 | |
*** dprince has joined #tripleo | 21:49 | |
*** morazi has quit IRC | 21:53 | |
*** dmk0202 has quit IRC | 22:00 | |
*** ccamacho has quit IRC | 22:06 | |
*** ccamacho has joined #tripleo | 22:09 | |
*** MaxPC has quit IRC | 22:17 | |
*** fultonj has quit IRC | 22:24 | |
*** ayoung has joined #tripleo | 22:25 | |
*** absubram has quit IRC | 22:28 | |
*** apetrich has quit IRC | 22:29 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Remove Ceilometer Alarm from the overcloud https://review.openstack.org/288120 | 22:29 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Deploy Aodh services, replacing Ceilometer Alarm https://review.openstack.org/315796 | 22:29 |
*** weshay has quit IRC | 22:33 | |
*** cwolferh has quit IRC | 22:35 | |
*** TSCHAK has joined #tripleo | 22:45 | |
*** dprince has quit IRC | 22:57 | |
*** dprince has joined #tripleo | 22:57 | |
*** ayoung has quit IRC | 23:03 | |
*** saneax_AFK is now known as saneax | 23:08 | |
*** dmacpher has joined #tripleo | 23:10 | |
*** gbraad has quit IRC | 23:23 | |
*** r-mibu has quit IRC | 23:23 | |
*** gbraad has joined #tripleo | 23:27 | |
*** zoliXXL is now known as zoli|gone | 23:33 | |
*** zoli|gone is now known as zoli_gone-proxy | 23:34 | |
*** chlong has quit IRC | 23:35 | |
*** cwolferh has joined #tripleo | 23:35 | |
*** trozet has quit IRC | 23:40 | |
*** r-mibu has joined #tripleo | 23:45 | |
*** dmacpher has quit IRC | 23:56 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!