| *** lblanchard has joined #tripleo | 00:06 | |
| *** ayoung has quit IRC | 00:06 | |
| *** jeckersb_gone is now known as jeckersb | 00:08 | |
| *** padkrish has quit IRC | 00:26 | |
| *** yamahata has quit IRC | 00:33 | |
| *** saneax is now known as saneax_AFK | 00:38 | |
| *** limao has joined #tripleo | 00:39 | |
| *** yamahata has joined #tripleo | 00:48 | |
| *** dmacpher has joined #tripleo | 00:55 | |
| *** jerrygb has joined #tripleo | 00:57 | |
| *** padkrish has joined #tripleo | 00:59 | |
| *** jerrygb has quit IRC | 01:02 | |
| *** padkrish has quit IRC | 01:03 | |
| *** padkrish has joined #tripleo | 01:03 | |
| *** lblanchard has quit IRC | 01:07 | |
| *** derekjhyang has joined #tripleo | 01:24 | |
| *** akshai has joined #tripleo | 01:31 | |
| *** akshai has quit IRC | 01:31 | |
| openstackgerrit | Sarath Kumar Sankaran Kutty proposed openstack/os-net-config: Enable os-net-config to support and configure NFVSwitch https://review.openstack.org/345599 | 01:35 |
|---|---|---|
| *** jcoufal_ has quit IRC | 01:45 | |
| *** tzumainn has quit IRC | 01:46 | |
| openstackgerrit | Merged openstack/instack-undercloud: Remove "OK_FILE" from undercloud-install element https://review.openstack.org/345588 | 02:13 |
| *** rlandy has quit IRC | 02:32 | |
| *** jerrygb has joined #tripleo | 02:50 | |
| *** bkreitch has quit IRC | 02:55 | |
| *** padkrish has quit IRC | 03:04 | |
| *** rhallisey has quit IRC | 03:08 | |
| *** jerrygb has quit IRC | 03:19 | |
| *** padkrish has joined #tripleo | 03:21 | |
| *** bswartz_ is now known as bswartz | 03:21 | |
| *** padkrish has quit IRC | 03:28 | |
| *** padkrish has joined #tripleo | 03:36 | |
| *** saneax_AFK is now known as saneax | 04:05 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements https://review.openstack.org/339948 | 04:07 |
| *** tzumainn has joined #tripleo | 04:07 | |
| *** trozet has quit IRC | 04:08 | |
| *** tzumainn has quit IRC | 04:11 | |
| *** saneax is now known as saneax_AFK | 04:16 | |
| *** d0ugal has quit IRC | 04:34 | |
| *** d0ugal has joined #tripleo | 04:36 | |
| *** yamahata has quit IRC | 04:58 | |
| *** honza has quit IRC | 04:59 | |
| *** radek_ has joined #tripleo | 05:07 | |
| *** bandini has joined #tripleo | 05:16 | |
| *** jprovazn has joined #tripleo | 05:23 | |
| *** saneax_AFK is now known as saneax | 05:31 | |
| *** limao has quit IRC | 05:32 | |
| *** limao has joined #tripleo | 05:34 | |
| *** milan has quit IRC | 05:39 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Use Webpack for application processing https://review.openstack.org/343592 | 05:39 |
| *** milan has joined #tripleo | 05:39 | |
| *** skramaja has joined #tripleo | 05:51 | |
| *** jaosorior has joined #tripleo | 05:51 | |
| *** jaosorior has quit IRC | 05:52 | |
| *** padkrish has quit IRC | 05:52 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Enable Manila integration - as a composable controller service https://review.openstack.org/188137 | 05:53 |
| *** numans has joined #tripleo | 05:54 | |
| bandini | marios, can we plus +A this one now? https://review.openstack.org/#/c/337304/ | 05:55 |
| marios | bandini: ACK | 05:58 |
| marios | sry, too early for shouting | 05:58 |
| *** jaosorior has joined #tripleo | 05:59 | |
| bandini | lol | 06:01 |
| bandini | marios, thank you! | 06:01 |
| bandini | dciabrin, ^ | 06:01 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Minor updates might fail with missing MysqlClustercheckPassword property https://review.openstack.org/337304 | 06:02 |
| *** tobias_fb_away has joined #tripleo | 06:05 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Stop Validation https://review.openstack.org/336561 | 06:06 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Triggering validations and messaging https://review.openstack.org/336560 | 06:06 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: List Validations and Validation results https://review.openstack.org/334770 | 06:06 |
| *** akuznetsov has joined #tripleo | 06:06 | |
| *** tobias_fb_away is now known as tobias_fiberdata | 06:06 | |
| *** xinwu has joined #tripleo | 06:06 | |
| *** leanderthal|afk is now known as leanderthal | 06:08 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Use Webpack for application processing https://review.openstack.org/343592 | 06:16 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Stop Validation https://review.openstack.org/336561 | 06:16 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Triggering validations and messaging https://review.openstack.org/336560 | 06:16 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: List Validations and Validation results https://review.openstack.org/334770 | 06:16 |
| openstackgerrit | Xiang Chen proposed openstack/diskimage-builder: add no_proxy when debootstrap trying to use proxy https://review.openstack.org/345830 | 06:21 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/instack: Remove discover from test-requirements https://review.openstack.org/345831 | 06:23 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/instack-undercloud: Remove discover from test-requirements https://review.openstack.org/345832 | 06:24 |
| *** masco has joined #tripleo | 06:25 | |
| *** aufi_ has joined #tripleo | 06:26 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Use Webpack for application processing https://review.openstack.org/343592 | 06:29 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Stop Validation https://review.openstack.org/336561 | 06:29 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Triggering validations and messaging https://review.openstack.org/336560 | 06:29 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: List Validations and Validation results https://review.openstack.org/334770 | 06:29 |
| *** ramishra_ has joined #tripleo | 06:31 | |
| *** bvandenh has joined #tripleo | 06:40 | |
| *** pgadiya has joined #tripleo | 06:40 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/os-refresh-config: Remove discover from test-requirements https://review.openstack.org/345849 | 06:43 |
| *** jubapa has joined #tripleo | 06:44 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/os-net-config: Remove discover from test-requirements https://review.openstack.org/345850 | 06:44 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: WIP Move rabbit's clustering port away from the ephemeral port range https://review.openstack.org/345851 | 06:44 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/os-collect-config: Remove discover from test-requirements https://review.openstack.org/345852 | 06:44 |
| *** tesseract- has joined #tripleo | 06:45 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/os-cloud-config: Remove discover from test-requirements https://review.openstack.org/345854 | 06:45 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/os-apply-config: Remove discover from test-requirements https://review.openstack.org/345855 | 06:46 |
| *** xinwu has quit IRC | 06:49 | |
| *** leanderthal is now known as leanderthal|afk | 06:55 | |
| openstackgerrit | Xiang Chen proposed openstack/diskimage-builder: add no_proxy when debootstrap trying to use proxy https://review.openstack.org/345830 | 06:57 |
| *** bandini has quit IRC | 07:04 | |
| *** Ryjedo_ has joined #tripleo | 07:05 | |
| *** Ryjedo has quit IRC | 07:06 | |
| *** Ryjedo_ is now known as Ryjedo | 07:06 | |
| *** jubapa has quit IRC | 07:09 | |
| *** ohamada has joined #tripleo | 07:17 | |
| *** pcaruana has joined #tripleo | 07:18 | |
| *** zoli_gone-proxy is now known as zoliXXL | 07:18 | |
| *** rcernin has joined #tripleo | 07:20 | |
| *** d0ugal has quit IRC | 07:20 | |
| *** ccamacho has joined #tripleo | 07:21 | |
| *** jubapa has joined #tripleo | 07:21 | |
| *** tobias_fiberdata has quit IRC | 07:25 | |
| *** ebarrera has joined #tripleo | 07:25 | |
| *** ifarkas_afk is now known as ifarkas | 07:30 | |
| *** mcornea has joined #tripleo | 07:32 | |
| *** ohamada has quit IRC | 07:33 | |
| *** ohamada has joined #tripleo | 07:33 | |
| *** xinwu has joined #tripleo | 07:34 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Enable keystone to use the SSL middleware https://review.openstack.org/341354 | 07:34 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Enable glance to use the SSL middleware https://review.openstack.org/341367 | 07:34 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Migrate Puppet Hieradata to composable services https://review.openstack.org/341616 | 07:35 |
| *** florianf has joined #tripleo | 07:35 | |
| *** jprovazn has quit IRC | 07:38 | |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-quickstart: Add third party gating to quickstart https://review.openstack.org/332223 | 07:43 |
| *** ohamada has quit IRC | 07:44 | |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-quickstart: WIP gate upgrade https://review.openstack.org/342161 | 07:46 |
| *** jpich has joined #tripleo | 07:49 | |
| *** d0ugal has joined #tripleo | 07:52 | |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Add pacemaker mistral profile https://review.openstack.org/343346 | 07:52 |
| *** xinwu has quit IRC | 07:53 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Composable Mistral services https://review.openstack.org/323436 | 07:54 |
| openstackgerrit | Chris Jones proposed openstack/tripleo-heat-templates: Next generation HA architecture work https://review.openstack.org/314208 | 07:55 |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-quickstart: WIP gate upgrade https://review.openstack.org/342161 | 08:00 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Use Webpack for application processing https://review.openstack.org/343592 | 08:00 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Stop Validation https://review.openstack.org/336561 | 08:00 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Triggering validations and messaging https://review.openstack.org/336560 | 08:00 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: List Validations and Validation results https://review.openstack.org/334770 | 08:00 |
| *** numans has quit IRC | 08:00 | |
| openstackgerrit | Chris Jones proposed openstack/puppet-tripleo: Next generation HA architecture work https://review.openstack.org/342650 | 08:03 |
| *** stendulker has joined #tripleo | 08:06 | |
| openstackgerrit | Chris Jones proposed openstack/tripleo-heat-templates: Next generation HA architecture work https://review.openstack.org/314208 | 08:06 |
| *** xinwu has joined #tripleo | 08:06 | |
| *** tobias_fiberdata has joined #tripleo | 08:08 | |
| *** openstackgerrit has quit IRC | 08:11 | |
| hewbrocca | Good morning everyone | 08:11 |
| jaosorior | hey man, what's up? | 08:11 |
| *** flaper87 has quit IRC | 08:12 | |
| hewbrocca | Well, unfortunately, https://bugs.launchpad.net/tripleo/+bug/1605359 | 08:12 |
| openstack | Launchpad bug 1605359 in tripleo "[trunk] With master of Ironic, node registration fails" [Critical,Triaged] | 08:12 |
| hewbrocca | is STILL BLOCKING the promote job | 08:12 |
| *** flaper87 has joined #tripleo | 08:12 | |
| *** flaper87 has joined #tripleo | 08:12 | |
| *** jrist has quit IRC | 08:12 | |
| *** bnemec has quit IRC | 08:12 | |
| *** mgould|afk has quit IRC | 08:12 | |
| *** dmacpher has quit IRC | 08:13 | |
| *** jrist has joined #tripleo | 08:13 | |
| *** bnemec has joined #tripleo | 08:13 | |
| *** shardy has joined #tripleo | 08:13 | |
| jaosorior | bummer :/ | 08:14 |
| *** mgould|afk has joined #tripleo | 08:14 | |
| hewbrocca | trown|outtypewww: had the idea that we don't actually test Ironic node registration in tripleo CI | 08:14 |
| *** openstackgerrit has joined #tripleo | 08:14 | |
| hewbrocca | which is disappointing, but I have no context really | 08:14 |
| *** dsneddon has quit IRC | 08:16 | |
| *** dsneddon_ has quit IRC | 08:16 | |
| openstackgerrit | Merged openstack/tripleo-ui: Add error handler to FileReader https://review.openstack.org/337668 | 08:16 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: openstack-core resource does not have interleave=true https://review.openstack.org/342725 | 08:16 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Remove two races during the L->M Keystone under httpd migration https://review.openstack.org/338879 | 08:17 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Generate HAProxy certificates in base profile https://review.openstack.org/345899 | 08:25 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Generate HAProxy certificates in base profile https://review.openstack.org/345899 | 08:27 |
| *** akuznetsov has quit IRC | 08:28 | |
| *** jprovazn has joined #tripleo | 08:28 | |
| *** dsneddon has joined #tripleo | 08:30 | |
| *** d0ugal has quit IRC | 08:30 | |
| *** lucas-afk is now known as lucasagomes | 08:31 | |
| *** dsneddon_ has joined #tripleo | 08:32 | |
| *** rasca_ has quit IRC | 08:34 | |
| *** rasca has joined #tripleo | 08:35 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Generate HAProxy certificates in base profile https://review.openstack.org/345899 | 08:38 |
| hewbrocca | folks | 08:45 |
| hewbrocca | who owns the mistral workflow for node registration? | 08:46 |
| *** panda is now known as panda|sick | 08:46 | |
| *** zoliXXL is now known as zoli|brb | 08:46 | |
| hewbrocca | shardy: do you recall who was working on the Ironic node registration workflow in mistral? | 08:52 |
| hewbrocca | lucasagomes: has posted a solution to https://bugs.launchpad.net/tripleo/+bug/1605359 | 08:52 |
| openstack | Launchpad bug 1605359 in tripleo "[trunk] With master of Ironic, node registration fails" [Critical,Triaged] | 08:52 |
| shardy | hewbrocca: I think d0ugal, jpich or rbrady can probably help | 08:55 |
| hewbrocca | xlnt | 08:55 |
| hewbrocca | thanks | 08:55 |
| shardy | If not then I'll take a look | 08:55 |
| hewbrocca | jpich: around? | 08:55 |
| jpich | Yep | 08:55 |
| *** gfidente has joined #tripleo | 08:55 | |
| *** gfidente has quit IRC | 08:55 | |
| *** gfidente has joined #tripleo | 08:55 | |
| *** electrofelix has joined #tripleo | 08:55 | |
| hewbrocca | Bug above is blocking the RDO trunk promote job, and lucasagomes has posted a fix to the bug | 08:56 |
| shardy | seems like we need to emulate the export OS_BAREMETAL_API_VERSION=1.11 we have in stackrc inside the mistral action | 08:56 |
| hewbrocca | either that or add the flag lucasagomes suggests | 08:56 |
| hewbrocca | no idea which is better | 08:56 |
| shardy | ah, yeah, either is probably fine | 08:56 |
| hewbrocca | shardy: do you know how it makes it through TripleO CI? | 08:56 |
| shardy | hewbrocca: not sure, my guess is that the stackrc environment is passed through by mistral, but would have to check to confirm | 08:57 |
| lucasagomes | shardy, yeah either one should work, the starting with enroll state is just to give operators a time to register the nodes and validate it before it actually goes to the pool of the available nodes | 08:57 |
| hewbrocca | It seems to me like we *always* want to start with "available" | 08:58 |
| hewbrocca | so maybe having the flag is the best approach in this case? | 08:58 |
| hewbrocca | we being TripleO, I mean | 08:58 |
| jpich | I think that flag won't be used anymore though, it lives outside of the workflows | 08:58 |
| shardy | lucasagomes: can you start introspection from an enroll state? | 08:58 |
| shardy | I can imagine operators not wanting new nodes to be available until after introspection is completed, so we need to ensure that's possible | 08:59 |
| jpich | Based on http://lists.openstack.org/pipermail/openstack-dev/2016-May/095456.html we want to let the user decide if they want the nodes to be 'manageable' (and run introspection, etc) or 'available' for deployment | 08:59 |
| lucasagomes | shardy, you can not, so introspection is at the manageable state, after enrolling you can call "ironic node-set-provision-state manage" | 08:59 |
| lucasagomes | to move that state | 08:59 |
| shardy | lucasagomes: ack, thanks for the confirmation | 08:59 |
| lucasagomes | shardy, I believe tripleo will do the same, but from available to manageable | 08:59 |
| lucasagomes | and then back to available | 08:59 |
| shardy | yeah | 09:00 |
| *** jaosorior has quit IRC | 09:00 | |
| lucasagomes | enroll -> manageable -> available Vs available -> manageable -> available | 09:00 |
| shardy | jpich: Yup, we should give them the choice to either require introspection, or skip it | 09:02 |
| *** xinwu has quit IRC | 09:02 | |
| *** jaosorior has joined #tripleo | 09:02 | |
| jpich | So would the flag be something we only set on CI for now? | 09:02 |
| shardy | what we need to avoid is folks adding a bunch of new nodes, then having the scheduler pick them before they've been introspected, e.g if the operator chooses the mandatory introspection path | 09:02 |
| shardy | jpich: I think the workflow/action/cli needs to enable choice of the initial state, not only for CI | 09:05 |
| shardy | So, we'd import nodes as manageable by default, but for cases where we don't run introspection we can choose to go direcly to available (including in CI jobs where we're not running introspection) | 09:06 |
| *** numans has joined #tripleo | 09:06 | |
| shardy | lucasagomes: is that accurate? And the bug is that we're instead defaulting to enroll state | 09:07 |
| * lucasagomes reads | 09:07 | |
| jpich | shadower: Ok, so implementing that flag to be "manageable or available" instead of "enroll or available" is needed as well (adding to my TODOs for the new import command) | 09:07 |
| lucasagomes | shardy, that's accurate yes | 09:08 |
| shardy | lucasagomes: Thanks, and if we pin to 1.11 the default initial state is managable? | 09:08 |
| lucasagomes | by default ironic will create the node in available (as it was before) unless you pin it to a microversion >= 1.11 | 09:08 |
| lucasagomes | shardy, enroll | 09:08 |
| lucasagomes | but you can move it to manageable by calling "ironic node-set-provision-state manageable" | 09:08 |
| shardy | Ok, so it sounds like we revert to the available behavior then figure out the managable/available choice later | 09:09 |
| lucasagomes | the difference is that at manageable the nodes will have credentials sorted, where enroll is just the initial state | 09:09 |
| lucasagomes | shardy, that will fix that problem I believe, yes | 09:09 |
| shardy | great, thanks :) | 09:09 |
| lucasagomes | np | 09:09 |
| *** milan has quit IRC | 09:10 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud: Use certmonger for automatic cert generation https://review.openstack.org/332774 | 09:10 |
| jaosorior | finally! :D | 09:11 |
| jaosorior | ccamacho duuuuude | 09:11 |
| ccamacho | hey jaosorior morning! | 09:12 |
| jaosorior | ccamacho hey dude! how's it going? | 09:12 |
| ccamacho | jajaja finally finished the mistral submission :) | 09:12 |
| ccamacho | jaosorior, you? | 09:12 |
| ccamacho | seems quite happy it because it's friday!!! | 09:13 |
| jaosorior | ccamacho: Pretty excited getting shit working :D. Are you really busy? Just got that patch working with EmilienM's suggestions. Would use an extra hand testing. Tested it myself with FreeIPA now and it seems to work. But of course, extra eyes are always good :D | 09:13 |
| *** mbound_ has joined #tripleo | 09:13 | |
| jaosorior | ccamacho this patch https://review.openstack.org/332774 | 09:13 |
| ccamacho | jaosorior, man I was lurking in your blog xD really interesting, so, why don't you add yourself to http://tripleo.org/planet.html xD | 09:14 |
| ccamacho | jaosorior, np man | 09:14 |
| jaosorior | ccamacho: I still need to separate the RSS feeds | 09:15 |
| jaosorior | maybe I'll start posting about random stuff and nobody here is interested in that haha | 09:15 |
| shardy | https://github.com/openstack/tripleo-common/blob/master/workbooks/baremetal.yaml#L103 | 09:15 |
| jaosorior | so when I finally separate the feeds then I'll add it | 09:15 |
| shardy | So we already explicitly set the state to available, with state_action=provide | 09:15 |
| shardy | even after removing the stackrc version pin I can't make that fail locally | 09:15 |
| jaosorior | ccamacho: Anyway, that commit needs the latest puppet-tripleo. And this patch https://review.openstack.org/#/c/345899/ | 09:16 |
| ccamacho | jaosorior, mmmm yeahp, but, when having some time, its interesting stuff.. will test it now provisioning as yesterday I messed it up XD | 09:16 |
| ccamacho | jaosorior same steps than yesterday/or your blog post :) | 09:16 |
| jaosorior | ccamacho: So, it would be this for instack-undercloud https://review.openstack.org/#/c/332774/29 and this for puppet-tripleo https://review.openstack.org/#/c/345899/ | 09:16 |
| ccamacho | jaosorior ack :) | 09:16 |
| *** mbound has quit IRC | 09:17 | |
| jpich | lucasagomes: Is going directly from 'enroll' to 'available' allowed? | 09:19 |
| lucasagomes | jpich, no, it has to go to manageable in between first | 09:19 |
| jaosorior | ccamacho: now, for that commit only thing you need to do is set this in undercloud.conf: generate_service_certificate = true | 09:19 |
| lucasagomes | jpich, enroll -> manageable -> available | 09:20 |
| ccamacho | jaosorior same as yesterday :) np | 09:20 |
| *** Goneri has joined #tripleo | 09:20 | |
| jaosorior | ccamacho: Awesome, let me know when you're ready | 09:20 |
| jpich | lucasagomes: Ok, thank you - sorry, you actually explained that earlier then :-) | 09:20 |
| shardy | If I do ironic node-create -n foo -d pxe_ssh without OS_BAREMETAL_API_VERSION set the node goes direct to available | 09:20 |
| lucasagomes | jpich, no problem | 09:20 |
| shardy | so the problem must be RDO are pinning to a newer version? | 09:20 |
| ccamacho | sure now installing the packages should not take much time | 09:21 |
| lucasagomes | shardy, tripleo-common is | 09:21 |
| * lucasagomes gets the link | 09:21 | |
| jaosorior | ccamacho: did you read my PM? | 09:21 |
| shardy | lucasagomes: ah yeah, np got it | 09:21 |
| ccamacho | jaosorior, yahp I have it under control :) | 09:21 |
| jpich | shardy: Would you happen to have a link to the full logs of a job that failed like this? | 09:22 |
| lucasagomes | shardy, https://github.com/openstack/tripleo-common/blob/6c727296f4238d88abae07e645e2ae02fbbe73ab/tripleo_common/actions/base.py#L55 | 09:22 |
| lucasagomes | right, sorry double paste then | 09:22 |
| shardy | Aha! | 09:22 |
| shardy | OS_BAREMETAL_API_VERSION is wrong, should be IRONIC_API_VERSION | 09:22 |
| *** d0ugal has joined #tripleo | 09:22 | |
| shardy | so our stackrc pin does nothing | 09:23 |
| openstackgerrit | Xiang Chen proposed openstack/diskimage-builder: Explain the difference between 'DIB_OFFLINE' and 'DIB_DEBIAN_USE_DEBOOTSTRAP_CACHE' https://review.openstack.org/345935 | 09:25 |
| *** zoli|brb is now known as zoli | 09:25 | |
| *** zoli is now known as zoliXXL | 09:25 | |
| openstackgerrit | Xiang Chen proposed openstack/diskimage-builder: Explain the difference between 'DIB_OFFLINE' and 'DIB_DEBIAN_USE_DEBOOTSTRAP_CACHE' https://review.openstack.org/345935 | 09:27 |
| hewbrocca | shardy: huh... how the heck's it working at all then? | 09:33 |
| shardy | hewbrocca: the env vars are different for ironicclient and openstackclient I think | 09:33 |
| hewbrocca | ahhhh | 09:33 |
| hewbrocca | of course they are, why wouldn't they be | 09:34 |
| shardy | jpich: Sorry, I don't, and there's no link in the bug | 09:34 |
| shardy | jpich: pulling trunk ironic locally trying to reproduce | 09:34 |
| jpich | shardy: No problems, thank you | 09:34 |
| *** numans has quit IRC | 09:35 | |
| *** athomas has quit IRC | 09:36 | |
| *** pgadiya has quit IRC | 09:41 | |
| *** jaosorior is now known as jaosorior_lunch | 09:42 | |
| *** athomas has joined #tripleo | 09:43 | |
| *** milan has joined #tripleo | 09:47 | |
| *** apevec has joined #tripleo | 09:48 | |
| apevec | shardy, which repo(s) have you used in https://bugs.launchpad.net/tripleo/+bug/1605359/comments/2 ? | 09:50 |
| openstack | Launchpad bug 1605359 in tripleo "[trunk] With master of Ironic, node registration fails" [Critical,Triaged] | 09:50 |
| *** pgadiya has joined #tripleo | 09:50 | |
| apevec | also please check patch in comment 3 based on lucasagomes' comment 1 suggestion | 09:50 |
| shardy | apevec: Hi! I first tried with the tripleo-common pin, overlaid with trunk tripleo pieces | 09:51 |
| shardy | now I've tried with trunk ironic upgraded, still works | 09:51 |
| shardy | now trying an upgrade of ironicclient | 09:52 |
| shardy | apevec: agree a quickstart patch may be the easiest short term fix | 09:53 |
| hewbrocca | lucasagomes: are we sure that the API change was in 1.11 and not 1.12? | 09:53 |
| lucasagomes | hewbrocca, I am yeah | 09:54 |
| lucasagomes | hewbrocca, http://docs.openstack.org/developer/ironic/webapi/v1.html#api-versions-history | 09:54 |
| lucasagomes | we have a history of what each version includes | 09:54 |
| hewbrocca | Makes me wonder why we are pinning to 1.11 then | 09:54 |
| hewbrocca | when to avoid the API change we would actually need to pin to 1.10... | 09:54 |
| lucasagomes | hewbrocca, by default the ironic client uses 1.9 (historical reasons), so if you don't pin it will go to that version | 09:55 |
| hewbrocca | OH | 09:55 |
| hewbrocca | very interesting | 09:55 |
| hewbrocca | shardy: ^^^ if we were using the wrong env var to pin, that's why it didn't fail for us | 09:56 |
| lucasagomes | hewbrocca, yeah, we have to keep the backwards compat, so since 1.11 is a breaking change we opt to leave the client as-is | 09:56 |
| lucasagomes | so that we don't break people's script | 09:56 |
| hewbrocca | right | 09:56 |
| lucasagomes | hewbrocca, maybe tripleo pinned to 1.11 so that it can use the "new" flow, I believe that starting at enroll state is more correct | 09:56 |
| hewbrocca | I was just assuming that if you did not pin it would go to the latest version | 09:56 |
| lucasagomes | because at least we don't have that widows where the nodes is ready for scheduling before inspection and all that | 09:57 |
| hewbrocca | right | 09:57 |
| lucasagomes | hewbrocca, yeah no. There's a special value "latest", if you pin it to "latest" it will always go to the last version available | 09:58 |
| lucasagomes | but that's not what we want | 09:58 |
| hewbrocca | right | 09:58 |
| hewbrocca | got it | 09:58 |
| jpich | hewbrocca: It looks like we explicitly wanted to use the new state in TripleO: https://github.com/openstack/python-tripleoclient/commit/20fa1ba84f18ad19eb1af74e48c110d0fdbffba8 | 09:58 |
| lucasagomes | jpich, btw, miles is mgould|afk | 09:59 |
| hewbrocca | Oh, very interesting | 09:59 |
| jpich | lucasagomes: Thanks! | 10:00 |
| apevec | so forcing avaiable would decrease test coverage | 10:00 |
| hewbrocca | wow, there's a lot of code in that patch about that, yeah | 10:01 |
| hewbrocca | So... if we are able to get the Mistral workflow pinned to the right API version, then it seems like that solves the real problem? i.e. the problem is the --enroll state isn't available in the version of the Ironic API that Mistral is trying to use? | 10:02 |
| *** zoliXXL is now known as zoli|lunch | 10:02 | |
| shardy | well in that patch we default --initial-state to available | 10:03 |
| apevec | hewbrocca, that's what trown attempted based on dprince's advice but it didn't seem to work | 10:03 |
| shardy | so we must have broken that in the move to mistral | 10:03 |
| apevec | ah so oooq just tested default | 10:04 |
| apevec | then tripleo-quickstart patch might be fine | 10:04 |
| apevec | but with TODO | 10:04 |
| *** numans has joined #tripleo | 10:04 | |
| hewbrocca | apevec: right | 10:04 |
| *** stendulker has quit IRC | 10:05 | |
| jpich | If the state is in 'enroll' to start with, doesn't it mean we're using the correct API version? The issue seems to be switching directly from 'enroll' to 'available' | 10:11 |
| jpich | The workflow should be setting the state to manageable when registering, by default -> https://github.com/openstack/tripleo-common/blob/master/workbooks/baremetal.yaml#L65 | 10:12 |
| *** akrivoka has joined #tripleo | 10:19 | |
| *** tobias_fiberdata has quit IRC | 10:20 | |
| shardy | If I set --initial-state enroll the nodes still end up as manageable | 10:21 |
| apevec | ok, then we need more info from trown how to reproduce | 10:23 |
| jpich | shardy: I think that's the new workflow's doing - the default state has become manageable (see above URL) and we do nothing if the user specified enroll https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/baremetal.py#L238 | 10:23 |
| shardy | jpich: Yup, but that still doesn't explain how trown has nodes in enroll state entering the provide workflow? | 10:24 |
| ccamacho | jaosorior env ready, testing your submission | 10:25 |
| jpich | shardy: Indeed. Maybe something failed earlier, I'd love to see more logs | 10:25 |
| shardy | I'm going to mark the bug incomplete unless apevec can provide a link to some logs for a failing CI job? | 10:25 |
| apevec | latest run failed w/ something else :( https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-delorean-minimal-386/undercloud/home/stack/undercloud_install.log.gz | 10:26 |
| apevec | head-dbsync failed with Access denied for user 'heat'@'192.0.2.1' | 10:26 |
| apevec | !@#@!# | 10:26 |
| openstack | apevec: Error: "@#@!#" is not a valid command. | 10:26 |
| apevec | yeah it is not | 10:26 |
| apevec | openstack, ^ | 10:27 |
| *** tobias_fiberdata has joined #tripleo | 10:27 | |
| apevec | hmm Dependency Package[swift] has failures: true | 10:27 |
| apevec | ok, back to #rdo | 10:27 |
| *** jaosorior_lunch is now known as jaosorior | 10:28 | |
| *** limao has quit IRC | 10:28 | |
| openstackgerrit | Alan Pevec proposed openstack/tripleo-quickstart: Set explicit default provision state [RFC incomplete fix] https://review.openstack.org/345968 | 10:32 |
| *** rajinir has quit IRC | 10:35 | |
| hewbrocca | jpich: thanks for your efforts on that | 10:38 |
| hewbrocca | blearrgh, however | 10:39 |
| hewbrocca | I am getting close to saying we need to down tools entirely until both promote jobs pass again | 10:39 |
| jpich | Wish I could be more helpful | 10:39 |
| jpich | "down" tools? | 10:39 |
| hewbrocca | jpich: halt all work | 10:39 |
| shardy | hewbrocca: it's tough, because the tripleo promote worked yesterday, and some of the reports have been lacking a bit of detail | 10:47 |
| shardy | which obviously makes the process take longer | 10:47 |
| hewbrocca | Yeah. We've got a lot of room for improvement in the process | 10:47 |
| *** ramishra_ has quit IRC | 10:48 | |
| * shardy snapshots undercloud and pulls trunk everything | 10:50 | |
| jaosorior | ccamacho hey dude, how's it going? | 10:52 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates: WIP: Containerized Services for Composable Roles https://review.openstack.org/330659 | 10:52 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Use Webpack for application processing https://review.openstack.org/343592 | 10:53 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Stop Validation https://review.openstack.org/336561 | 10:53 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Triggering validations and messaging https://review.openstack.org/336560 | 10:53 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: List Validations and Validation results https://review.openstack.org/334770 | 10:53 |
| *** d0ugal has quit IRC | 10:54 | |
| *** tosky has joined #tripleo | 10:55 | |
| *** zoli|lunch is now known as zoli | 10:55 | |
| *** zoli is now known as zoliXXL | 10:55 | |
| ccamacho | jaosorior deploying the undercloud should be fine this time | 11:00 |
| jaosorior | ccamacho: Had you missed the puppet-tripleo part? | 11:01 |
| ccamacho | nope | 11:02 |
| ccamacho | ;) | 11:02 |
| jaosorior | lol | 11:02 |
| jaosorior | happens to me a lot | 11:02 |
| openstackgerrit | Lukas Bezdicka proposed openstack/instack-undercloud: Drop broken keystone pki setup https://review.openstack.org/327171 | 11:04 |
| openstackgerrit | Lukas Bezdicka proposed openstack/instack-undercloud: Upgrade only necessary packages https://review.openstack.org/327215 | 11:04 |
| openstackgerrit | Lukas Bezdicka proposed openstack/instack-undercloud: Update puppet dependancies before running puppet https://review.openstack.org/328264 | 11:04 |
| openstackgerrit | Lukas Bezdicka proposed openstack/instack-undercloud: Call systemctl-daemon-reload only if necessary https://review.openstack.org/327227 | 11:04 |
| openstackgerrit | Lukas Bezdicka proposed openstack/instack-undercloud: Use ironic::inspector::ipxe class to setup iPXE https://review.openstack.org/345980 | 11:04 |
| *** xinwu has joined #tripleo | 11:21 | |
| *** pgadiya has quit IRC | 11:22 | |
| ccamacho | jaosorior, man this should be finish soon, which command can I run to test it? | 11:25 |
| jaosorior | ccamacho: openstack endpoint list --long | 11:26 |
| jaosorior | to see if it's setting the public endpoints to TLS | 11:26 |
| jaosorior | and | 11:26 |
| jaosorior | sudo getcert list | 11:26 |
| jaosorior | to see that certmonger is managing HAProxy's certificate | 11:26 |
| ccamacho | nice, BTW in the logs are lot of Notice: /Stage[main]/Ironic::Api/Ironic_config[keystone_authtoken/auth_uri]/value: value changed 'http://192.0.2.1:5000/v3' to 'https://192.0.2.2:13000/v3' messages, going without errors but taking ages,, | 11:26 |
| ccamacho | Ill let you know when finish :) | 11:27 |
| jaosorior | sure | 11:27 |
| *** saneax is now known as saneax_AFK | 11:29 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add 'service_name' to composable services https://review.openstack.org/344440 | 11:29 |
| hewbrocca | shardy: so, weirdly, https://review.openstack.org/#/c/345968/ | 11:31 |
| hewbrocca | passed trunk quickstart CI, but not liberty or mitaka quickstart CI | 11:31 |
| *** lucasagomes is now known as lucas-hungry | 11:35 | |
| *** rhallisey has joined #tripleo | 11:35 | |
| *** pkovar has joined #tripleo | 11:36 | |
| *** pgadiya has joined #tripleo | 11:39 | |
| openstackgerrit | Merged openstack/tripleo-ui: Check if parentPath exists https://review.openstack.org/344560 | 11:43 |
| ccamacho | jaosorior, stuck here http://paste.openstack.org/show/539737/ | 11:43 |
| jaosorior | ccamacho: Is HAProxy running? | 11:44 |
| jaosorior | systemctl status haproxy | 11:44 |
| ccamacho | dead http://paste.openstack.org/show/539738/ | 11:45 |
| jaosorior | ccamacho: That's the issue | 11:46 |
| jaosorior | ccamacho: Try bringing it up again | 11:46 |
| ccamacho | should be active default? | 11:46 |
| jaosorior | ah | 11:46 |
| jaosorior | wait up | 11:46 |
| jaosorior | ccamacho: Is that the same machine where you tried the ironic-inspector TLS stuff? | 11:46 |
| ccamacho | a new one (same hardware just reprovisiones) | 11:47 |
| ccamacho | s/reprovisiones/reprovisioned | 11:47 |
| jaosorior | ccamacho: It shouldn't be active by default. It's actually very strange that it died | 11:47 |
| *** masco has quit IRC | 11:47 | |
| *** zoliXXL is now known as zoli|brb | 11:47 | |
| *** honza has joined #tripleo | 11:48 | |
| ccamacho | Ill cancel it and re launch the install | 11:48 |
| *** honza is now known as Guest40449 | 11:48 | |
| ccamacho | watching the ha proxy status | 11:48 |
| jaosorior | ccamacho | 11:48 |
| jaosorior | before that | 11:48 |
| jaosorior | do | 11:48 |
| ccamacho | ok | 11:48 |
| ccamacho | tell me | 11:48 |
| jaosorior | sudo openstack-service stop | 11:48 |
| jaosorior | to stop all the openstack services, just in case there is some issue there | 11:48 |
| *** morazi has joined #tripleo | 11:56 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Don't fail if no zuul telnet is opened https://review.openstack.org/344908 | 11:57 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Move nova::db data within service template https://review.openstack.org/335561 | 11:58 |
| *** dprince has joined #tripleo | 11:58 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Record Heat resource deployment times to Graphite https://review.openstack.org/314308 | 11:59 |
| *** julim has joined #tripleo | 11:59 | |
| ccamacho | jaosorior, http://paste.openstack.org/show/539741/ | 12:01 |
| ccamacho | you still have access to the machine | 12:01 |
| *** beagles_biab is now known as beagles | 12:01 | |
| ccamacho | ha proxy cant start | 12:01 |
| ccamacho | and openstack service list cant connect with ssl | 12:01 |
| *** Guest40449 is now known as honza_ | 12:03 | |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-quickstart: WIP gate upgrade https://review.openstack.org/342161 | 12:03 |
| jaosorior | well that's messed up | 12:05 |
| jaosorior | for a strange reason keystone is trying to start in IP 0.0.0.0 | 12:05 |
| *** rodrigods has quit IRC | 12:05 | |
| *** rodrigods has joined #tripleo | 12:05 | |
| jaosorior | ccamacho: can you PM me again how to log to that machine? | 12:05 |
| *** zoli|brb is now known as zoli | 12:08 | |
| *** zoli is now known as zoliXXL | 12:08 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Add 'service_name' to composable services https://review.openstack.org/344440 | 12:09 |
| *** cdearborn has joined #tripleo | 12:11 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add temporary script to collect the status of periodic jobs https://review.openstack.org/308865 | 12:11 |
| EmilienM | hello folks | 12:11 |
| *** julim has quit IRC | 12:12 | |
| *** paramite has joined #tripleo | 12:13 | |
| *** tzumainn has joined #tripleo | 12:13 | |
| *** jprovazn has quit IRC | 12:14 | |
| tobias_fiberdata | 0.0.0.0 is the same as localhost jaosorior | 12:19 |
| jaosorior | is it? AFAIK 0.0.0.0 indicates that it's listening on all interfaces in the given port | 12:20 |
| *** jprovazn has joined #tripleo | 12:20 | |
| openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo: New composable service: Sensu https://review.openstack.org/323303 | 12:20 |
| *** trown|outtypewww is now known as trown | 12:21 | |
| tobias_fiberdata | let me rephrase ;) it's listening on all the local IP-adresses assigned to the machine | 12:21 |
| tobias_fiberdata | that's 0.0.0.0 | 12:22 |
| tobias_fiberdata | i think that i have had some problems with just that in our productionenv | 12:22 |
| tobias_fiberdata | and that the RH support has told me to change it to 127.0.0.1, but we are running a single controller env aswell. | 12:23 |
| tobias_fiberdata | but dont know if that was keystone | 12:23 |
| tobias_fiberdata | could of been something else. | 12:23 |
| tobias_fiberdata | was like 1y aog | 12:24 |
| tobias_fiberdata | ago | 12:24 |
| openstackgerrit | Lukas Bezdicka proposed openstack/instack-undercloud: Use ironic::inspector::ipxe class to setup iPXE https://review.openstack.org/345980 | 12:24 |
| *** akrivoka has quit IRC | 12:30 | |
| tobias_fiberdata | hmm interesting | 12:32 |
| tobias_fiberdata | ./var/lib/os-collect-config/local-data not found. Skipping | 12:33 |
| tobias_fiberdata | i get this | 12:33 |
| tobias_fiberdata | checking the os-collect-config | 12:33 |
| tobias_fiberdata | :| | 12:33 |
| tobias_fiberdata | No local metadata found (['/var/lib/os-collect-config/local-data']) | 12:34 |
| gfidente | merge anyone ? https://review.openstack.org/#/c/345542/ | 12:37 |
| dprince | flaper87: I commented here https://review.openstack.org/#/c/345051/3 | 12:40 |
| *** lucas-hungry is now known as lucasagomes | 12:40 | |
| dprince | flaper87: +2 on the approach but do note I think I can make a good bit of that go away with a custom Puppet package provider | 12:40 |
| dprince | flaper87: let me get you a sample patch and you might tinker with it? | 12:40 |
| *** jayg|g0n3 is now known as jayg | 12:41 | |
| flaper87 | dprince: absolutely, thanks :) | 12:42 |
| flaper87 | dprince: any chance we can get this one in already? Or do you want me to implement the Puppet package provider in this same patch ? | 12:42 |
| dprince | flaper87: sent | 12:43 |
| dprince | flaper87: you patch is fine | 12:43 |
| flaper87 | dprince: can hax +W ? Or are we missing something ? | 12:43 |
| flaper87 | dprince: email ? | 12:44 |
| dprince | flaper87: sent the patch | 12:44 |
| dprince | flaper87: +A | 12:44 |
| *** trown is now known as trown|outtypewww | 12:44 | |
| *** jcoufal has joined #tripleo | 12:44 | |
| *** bfournie has joined #tripleo | 12:45 | |
| flaper87 | dprince: danke | 12:45 |
| jaosorior | Any +A for this? https://review.openstack.org/#/c/344188/ | 12:46 |
| EmilienM | dprince: can you quickly look https://review.openstack.org/#/c/345442/ (really small patch) | 12:47 |
| dprince | jaosorior: +A | 12:47 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add multi-node job in cistatus.html https://review.openstack.org/345418 | 12:48 |
| jaosorior | dprince: Thanks | 12:48 |
| *** d0ugal has joined #tripleo | 12:48 | |
| openstackgerrit | Merged openstack/tripleo-common: Extract `etc` files from openstack packages https://review.openstack.org/345051 | 12:49 |
| dprince | EmilienM: can you fix them all? | 12:51 |
| dprince | EmilienM: there are more... | 12:51 |
| dprince | EmilienM: figure out a way to grep them | 12:51 |
| EmilienM | dprince: yes I'll in a next patch | 12:51 |
| dprince | EmilienM: same patch please :) | 12:52 |
| EmilienM | dprince: please merge this one and next patch will fix them all | 12:52 |
| dprince | EmilienM: otherwise it makes it look like you ignore my comment :) | 12:52 |
| EmilienM | dprince: no, I'm working on the next step right now | 12:52 |
| hewbrocca | dprince: don't be so sensitive man | 12:53 |
| *** akrivoka has joined #tripleo | 12:53 | |
| EmilienM | just merge this one please, we avoid running CI again for this one and we can merge the undercloud patch | 12:53 |
| dprince | EmilienM: sorry, man. This is just a general review pattern we seem to run into a lot. I'm happy to land small patches but if I review something and you always fix it another patch it really looks like you ignore me | 12:53 |
| hewbrocca | LOL | 12:53 |
| EmilienM | if I would ignore you I would not ask you to review | 12:53 |
| EmilienM | are you trolling me? it's Friday? | 12:53 |
| dprince | EmilienM: the point is us. it is other reviewers | 12:53 |
| dprince | EmilienM: someone else will come in and look at this and be like !? Why did he switch to +2 | 12:53 |
| openstackgerrit | Merged openstack/python-tripleoclient: Handle empty list of introspected nodes https://review.openstack.org/344188 | 12:54 |
| marios | jaosorior: hey man do you want to re-add you +2 https://review.openstack.org/#/c/188137/ I just rebased for merge conflict | 12:54 |
| EmilienM | they'll just think you're a nice guy | 12:54 |
| dprince | EmilienM: finish the idea and I'll +2, +A | 12:54 |
| dprince | EmilienM: well I am, sometimes | 12:54 |
| EmilienM | you make my life hard | 12:54 |
| EmilienM | ok, Im doing them all | 12:55 |
| EmilienM | and then you leave on PTO and you'll never +2 | 12:55 |
| EmilienM | I know the story | 12:55 |
| openstackgerrit | James Slagle proposed openstack/instack-undercloud: Flush puppet output piped to awk https://review.openstack.org/346021 | 12:55 |
| dprince | EmilienM: funny you should mention this right when I'm working on a new version of this for Flavio, https://review.openstack.org/#/c/208774/ | 12:55 |
| dprince | EmilienM: that is hard | 12:55 |
| dprince | EmilienM: what we speak of here is tiddlywinks | 12:56 |
| marios | shardy: hey o/ another pass on manila https://review.openstack.org/#/c/188137/ appreciated if you get some time, it had a green ci run at https://review.openstack.org/#/c/342961/ - i think it is ready, most of your concerns from last time should be addressed now. thanks | 12:56 |
| *** jeckersb is now known as jeckersb_gone | 12:56 | |
| paramite | slagle, EmilienM: is this ok? https://blueprints.launchpad.net/tripleo/+spec/tripleo-opstools-availability-monitoring | 12:56 |
| EmilienM | paramite: we need to check with shardy if it's enough or if we need a long spec | 12:57 |
| EmilienM | in tripleo-specs repo | 12:57 |
| shardy | marios: sounds good, got a meeting now but will review it later this afternoon :) | 12:58 |
| paramite | Ok, let me know. Will submit the same for centralize logging in the meantime | 12:58 |
| marios | shardy: np thanks for acknowledging, bumping to monday is perfectly acceptable :) but would be nice, of a friday ;) to land that. end of the day, it is an optional service disabled by default. iterating, e.g. to remove the extraconfig, and any fixes come later | 13:00 |
| *** shardy is now known as shardy_mtg | 13:01 | |
| *** mgould|afk is now known as mgould | 13:01 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: use parameter to lookup the step instead of hiera again https://review.openstack.org/345442 | 13:01 |
| EmilienM | dprince: ^ | 13:01 |
| EmilienM | commit message err | 13:02 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: use parameter to lookup the step instead of hiera again https://review.openstack.org/345442 | 13:02 |
| marios | thanks jaosorior | 13:02 |
| *** lblanchard has joined #tripleo | 13:02 | |
| gfidente | EmilienM slagle I think you have to remove +a from https://review.openstack.org/#/c/345542/ and add it back ? | 13:05 |
| EmilienM | not needed | 13:05 |
| EmilienM | +A triggers gerrit to merge it | 13:05 |
| EmilienM | look http://status.openstack.org/zuul/ | 13:05 |
| EmilienM | it's in check | 13:05 |
| EmilienM | it will be in gate once check jobs are finished | 13:05 |
| gfidente | EmilienM heh it didn't post the message in gerrit | 13:06 |
| EmilienM | and since we have the multinode job, we just need to be patient. | 13:06 |
| EmilienM | gfidente: what message? | 13:06 |
| EmilienM | gfidente: it's not in gate now, when it will be the message will be posted | 13:06 |
| EmilienM | slagle: http://tripleo.org/cistatus.html we have now multinode :) | 13:07 |
| gfidente | EmilienM ah because you gave recheck | 13:08 |
| EmilienM | gfidente: I think it is required to send it in CI again, since it failed to merge | 13:09 |
| *** apevec has quit IRC | 13:09 | |
| gfidente | EmilienM right or you can remove/add +a I think | 13:10 |
| gfidente | anyway, check https://review.openstack.org/#/c/335561/ too | 13:10 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Migrate Puppet Hieradata to composable services https://review.openstack.org/341616 | 13:10 |
| EmilienM | gfidente: have you seen why CI fails? | 13:10 |
| EmilienM | http://logs.openstack.org/61/335561/8/check/gate-tripleo-ci-centos-7-nonha-multinode-nv/20db55e/logs/postci.txt.gz#_2016-07-22_12_35_05_000 | 13:11 |
| EmilienM | Resource CREATE failed: The Referenced Attribute (ComputeServiceChain role_data) is incorrect. | CREATE_FAILED | 13:11 |
| *** krotscheck is now known as lolscheck | 13:12 | |
| shardy_mtg | EmilienM: that is normally a misleading error, the outputs of one of the service templates probably has a syntax error in it | 13:13 |
| shardy_mtg | which means the role_data get_attr fails | 13:14 |
| shardy_mtg | I raised a heat bug to make the error more specific | 13:14 |
| EmilienM | right, I think it's related to his patch | 13:14 |
| shardy_mtg | EmilienM: yeah, you can tell which by doing heat stack-show on each of the nested stacks (the service nested stacks) and looking at the outputs | 13:15 |
| shardy_mtg | one of them is probably null for role_data | 13:15 |
| slagle | gfidente: it's b/c the pep8 job failed in the gate pipeline | 13:18 |
| *** mbound has joined #tripleo | 13:18 | |
| slagle | gfidente: in these cases, you can do "reverify bug ###", but you need a bug | 13:18 |
| jaosorior | EmilienM: I moved all the logic for TLS in the undercloud to the profiles as you proposed: https://review.openstack.org/#/c/345899/3 how does it look? | 13:18 |
| gfidente | EmilienM fyi it's the NovaPassword thing | 13:18 |
| EmilienM | jaosorior: I'll look at it | 13:18 |
| tobias_fiberdata | jaosorior, do you have any tips of how to solve this error? Command failed, will not cache new data. Command 'os-refresh-config --timeout 14400' returned non-zero exit status 2 | 13:19 |
| hewbrocca | jpich: trown|outtypewww did update that but a bit | 13:20 |
| hewbrocca | er that bug | 13:20 |
| jaosorior | tobias_fiberdata: I actually haven't seen that before :/ | 13:20 |
| hewbrocca | don't know if what he posted helps or not? | 13:20 |
| jaosorior | slagle: have you seen what tobias_fiberdata is posting? | 13:20 |
| hewbrocca | mgould: actually, hey, maybe you could help with this | 13:21 |
| slagle | jaosorior: there ought be some surrounding context to help find the issue | 13:21 |
| jpich | hewbrocca: I'm trying to create a new environment where "everything comes from master", to see if I can reproduce then | 13:21 |
| hewbrocca | mgould: have a look at this bug: https://bugs.launchpad.net/tripleo/+bug/1605359 | 13:21 |
| openstack | Launchpad bug 1605359 in tripleo "[trunk] With master of Ironic, node registration fails" [Critical,Incomplete] - Assigned to Steven Hardy (shardy) | 13:21 |
| *** mbound_ has quit IRC | 13:21 | |
| slagle | jaosorior: undercloud, overcloud? | 13:21 |
| hewbrocca | jpich: oh, makes sense | 13:21 |
| slagle | jaosorior: check the other logs, and output | 13:21 |
| jaosorior | tobias_fiberdata ^^ | 13:21 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Move nova::db data within service template https://review.openstack.org/335561 | 13:21 |
| tobias_fiberdata | slagle, it's when deploying on overcloud | 13:21 |
| mgould | hewbrocca: looking | 13:22 |
| gfidente | EmilienM actually do you have a patch to move those nova::api and nova::neutron params out of controller.yaml and into service? | 13:23 |
| slagle | tobias_fiberdata: what is the earlier output from os-collect-config when it hit that timeout? | 13:23 |
| slagle | tobias_fiberdata: what command was it running, etc | 13:23 |
| EmilienM | gfidente: https://review.openstack.org/#/c/341616/ ? | 13:23 |
| mgould | hewbrocca: yeah, unless you specifically request API >=1.11, you should get the appearance of the old behaviour | 13:24 |
| tobias_fiberdata | i'll post a pastebin | 13:24 |
| *** fultonj has joined #tripleo | 13:24 | |
| gfidente | EmilienM no the nova:: data in controller.yaml I mean | 13:24 |
| hewbrocca | rbrady: you in yet? | 13:25 |
| tobias_fiberdata | http://paste.openstack.org/show/539771/ | 13:25 |
| tobias_fiberdata | slagle, | 13:25 |
| rbrady | hewbrocca: yes | 13:25 |
| hewbrocca | rbrady: did you do any work on the Mistral workflow around node registration, or if not do you know who did? | 13:25 |
| mgould | I think that was d0ugal | 13:25 |
| d0ugal | No, it was rbrady | 13:26 |
| d0ugal | I just added it to python-tripleoclient | 13:26 |
| rbrady | hewbrocca: dprince and I | 13:26 |
| mgould | oh right, sorry | 13:26 |
| hewbrocca | rbrady: have a look at ttps://bugs.launchpad.net/tripleo/+bug/1605359 | 13:26 |
| hewbrocca | er | 13:26 |
| hewbrocca | https://bugs.launchpad.net/tripleo/+bug/1605359 | 13:26 |
| openstack | Launchpad bug 1605359 in tripleo "[trunk] With master of Ironic, node registration fails" [Critical,Incomplete] - Assigned to Steven Hardy (shardy) | 13:26 |
| tobias_fiberdata | slagle, stuck on these http://paste.openstack.org/show/539772/ | 13:27 |
| hewbrocca | this turns up in the RDO promote job | 13:27 |
| hewbrocca | but we don't hit it in TripleO CI | 13:27 |
| *** julim has joined #tripleo | 13:27 | |
| EmilienM | gfidente: no | 13:27 |
| gfidente | EmilienM ack sounds like we can get rid of NovaPassword there entirely | 13:28 |
| *** lolscheck is now known as krotscheck | 13:31 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: WIP: Containerized Services for Composable Roles https://review.openstack.org/330659 | 13:31 |
| flaper87 | https://hub.docker.com/r/tripleoupstream/heat-docker-agents/tags/ <- 178MB BOOOOOOM | 13:31 |
| EmilienM | jaosorior: done | 13:31 |
| EmilienM | gfidente: ok | 13:31 |
| jaosorior | EmilienM: Answered | 13:32 |
| EmilienM | jaosorior: dude you're so fast | 13:32 |
| EmilienM | +2 | 13:33 |
| *** skramaja has quit IRC | 13:33 | |
| *** d0ugal has quit IRC | 13:33 | |
| jaosorior | EmilienM: How do you get puppet facts in hiera? I've been trying to get the host's domain hiera with this: "%{::domain}" and it keeps returning an empty string | 13:34 |
| *** shardy_mtg has quit IRC | 13:34 | |
| mgould | hewbrocca, rbrady OK, I think I see what's going on | 13:35 |
| EmilienM | jaosorior: in THT or puppet-tripleo? | 13:36 |
| *** jeckersb_gone is now known as jeckersb | 13:36 | |
| *** shardy_mtg has joined #tripleo | 13:36 | |
| *** shardy_mtg is now known as shardy | 13:36 | |
| jaosorior | EmilienM: I'm trying to set it up in the hieradata file of the undercloud | 13:36 |
| jaosorior | EmilienM: Basically the line looks like this: | 13:37 |
| jaosorior | principal: "haproxy/%{hiera('controller_public_vip')}@%{upcase(::domain)}" | 13:37 |
| jaosorior | I need the domain in uppercase there | 13:37 |
| shardy | rbrady: FYI I investigated earlier and cannot reproduce - AFAICS we're passing the correct 1.11 version to ironic, and doing all the right things in terms of moving it from enroll to managed then polling for the state change | 13:38 |
| jaosorior | but it keeps returning an empty string there | 13:38 |
| shardy | so without logs or access to an environment where this happens, I'm a bit confused | 13:38 |
| EmilienM | jaosorior: what does it return now? | 13:38 |
| ccamacho | slagle, EmilienM, gfidente, mind to check the composable Mistral submission when having some time? https://review.openstack.org/#/c/323436/ I had applied the same patch as the one in the gnocchi bug there (missing sync_db) thanks! | 13:40 |
| jaosorior | that turns out as haproxy/192.0.2.2@ | 13:40 |
| rbrady | shardy: +1. Nothing jumped out at me while reading through the comments on the bug | 13:40 |
| slagle | tobias_fiberdata: in the pastebin, i see that after the error it shows the os-refresh-config usage message | 13:40 |
| jaosorior | EmilienM ^^ | 13:40 |
| EmilienM | I think you might need something like @%{upcase(%{::domain})}" | 13:41 |
| EmilienM | I can test it in a few, just finishing something now | 13:42 |
| jaosorior | EmilienM: tested it and it still gives an empty string | 13:43 |
| gfidente | jaosorior you can only run hiera() and scope() functions when interpolating in the hieradata | 13:43 |
| *** Goneri has quit IRC | 13:43 | |
| jaosorior | gfidente: I see, is there a way I can call puppet functions from hiera then? | 13:44 |
| gfidente | jaosorior not that I know of | 13:44 |
| gfidente | you can only call it from the .pp | 13:44 |
| EmilienM | I think you can't use stdlib functions right | 13:44 |
| EmilienM | so your domain might have uppercase, is it a big deal? | 13:44 |
| jaosorior | EmilienM: basically the kerberos realm is (in 99% of the cases) the machine's domain in uppercase | 13:46 |
| jaosorior | all uppercase | 13:46 |
| *** cdearborn has quit IRC | 13:46 | |
| *** cdearborn has joined #tripleo | 13:46 | |
| *** honza_ is now known as honza | 13:47 | |
| EmilienM | jaosorior: I can you can use puppet-tripleo to compute the parameter | 13:48 |
| EmilienM | it's not a big deal | 13:48 |
| jaosorior | EmilienM: I guess I could, only thing is that it differs how you get that value from undercloud to overcloud. Was trying to get the most generic solution | 13:49 |
| tobias_fiberdata | slagle, so what exactly does that mean? What can i look for to find something that causes the errors? | 13:49 |
| *** Goneri has joined #tripleo | 13:50 | |
| EmilienM | jaosorior: you could use puppet-tripleo from undercloud too | 13:50 |
| hewbrocca | mgould: don't leave me hanging, what do you think is going on :) | 13:50 |
| jaosorior | EmilienM: That's what I'm doing here https://review.openstack.org/#/c/332774/29/elements/puppet-stack-config/puppet-stack-config.pp | 13:50 |
| *** ramishra has quit IRC | 13:51 | |
| EmilienM | jaosorior: so you can build the parameter in puppet-tripleo from using generic hiera parameters that you both have in uc and oc | 13:51 |
| *** pgadiya has quit IRC | 13:52 | |
| *** ramishra has joined #tripleo | 13:52 | |
| mgould | hewbrocca: sorry :-) | 13:53 |
| *** numans has quit IRC | 13:54 | |
| mgould | just posted a comment on the bug, but tl;dr: two codepaths, only one supports AVAILABLE state for new nodes | 13:54 |
| *** ebalduf has joined #tripleo | 13:54 | |
| mgould | this code's evolved a bit since I last looked at it | 13:55 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: check the return code of the tempest run and junit2html https://review.openstack.org/346039 | 13:55 |
| jpich | My attempt at creating an environment with the master of everything' didn't work (as in, importing nodes works fine) so I still can't reproduce... | 13:55 |
| hewbrocca | ahhhh very interesting, two codepaths | 13:55 |
| mgould | yeah, not sure how that happened | 13:55 |
| hewbrocca | Is it possible that at least some version of the mistral workflow would hit that second codepath | 13:56 |
| mgould | sounds plausible | 13:56 |
| hewbrocca | the question is why would it do it only on the promote job | 13:57 |
| hewbrocca | well carry on and let us know what you find | 13:57 |
| mgould | will do! | 13:57 |
| jpich | It's not totally clear to me this was actually seen in the promote job | 13:57 |
| jpich | Since the only link is to the last known time it worked | 13:57 |
| hewbrocca | We saw the failure in the promote job, I'm fairly sure | 13:58 |
| *** akshai has joined #tripleo | 13:58 | |
| hewbrocca | See the very top of the bug | 13:58 |
| shardy | mgould: I'm not sure there are two codepaths, but it is a bit confusing | 13:58 |
| shardy | there are two workflows, and we only invoke both if the initial state is specified as available: | 13:58 |
| shardy | https://github.com/openstack/tripleo-common/blob/master/workbooks/baremetal.yaml | 13:59 |
| shardy | thats where they are defined, and they reference the action you mention I think | 13:59 |
| mgould | shardy: ah, thanks | 13:59 |
| shardy | mgould: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/baremetal.py#L239 | 13:59 |
| shardy | there, we only call the provide workflow (that moves them from managable to available) if --initial-state is available | 14:00 |
| shardy | which is the default | 14:00 |
| shardy | the mystery is why, at that point, they are still in enroll vs managable state | 14:00 |
| mgould | yeah, that was my codepath #1 | 14:00 |
| mgould | there's also actions.baremetal.RegisterOrUpdateNodes | 14:01 |
| * mgould needs a minute to read the Mistral code, brb... | 14:01 | |
| gfidente | shardy going back to the net_ip_map emitting _uri and _subnet (as I am updating the bind within services submission) | 14:02 |
| shardy | mgould: You can see how the workflow maps to that here: | 14:02 |
| shardy | https://github.com/openstack/tripleo-common/blob/master/setup.cfg#L63 | 14:02 |
| mgould | thanks | 14:02 |
| gfidente | shardy on instances like {get_param: [ServiceNetMap, IronicApiNetwork]} | 14:02 |
| remix_tj | hi, i'm experiencing issues deploying with tripleo from rdo liberty. Controllers are deployed, but when configuration of the cluster is started (i.e. overcloud-ControllerNodesPostDeployment-3e3spuxutu5b-ControllerLoadBalancerDeployment_Step1-znnud3ecxo2p) goes to UPDATE_FAILED because cluster doesn't start. Looking around on the deployed host i see that corosync.conf is completly missing and the server hangs on pcs cluster auth invoked by puppet | 14:02 |
| shardy | https://github.com/openstack/tripleo-common/blob/master/workbooks/baremetal.yaml#L42 | 14:02 |
| gfidente | what's a quick way to append _uri to the IronicApiNetowk name? | 14:02 |
| remix_tj | anyone has ever seen this behavior? | 14:02 |
| shardy | mgould: ^^ it's the same code-path I think, the tripleoclient calls the workbook which calls the action | 14:03 |
| jaosorior | EmilienM: I ended up just passing the principal as a configuration option. It's only needed for CAs that use kerberos (the local CA doesn't need it; and probably anchor doesn't either). And it gives better flexibility for the deployer to give haproxy whatever service name they want | 14:03 |
| jaosorior | just takes one more configuration option for the undercloud | 14:03 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Move mysql::host param from MysqlInternal to MysqlNoBracketsInternal https://review.openstack.org/345542 | 14:03 |
| jaosorior | in the overcloud it'll come from t-h-t anyway | 14:03 |
| shardy | gfidente: I was thinking we could use str_replace? | 14:03 |
| honza | the tripleo-ui rpm now a) builds the js app b) adds an httpd config file c) reloads httpd --- does it need to do anything else? | 14:03 |
| EmilienM | jaosorior: excellent | 14:03 |
| shardy | gfidente: it's a bit ugly but it should work | 14:03 |
| shardy | str_replace: {template: "NETWORK_uri", params: {NETWORK: {get_attr ... | 14:04 |
| mgould | shardy: right, OK | 14:04 |
| hewbrocca | jpich: so you could not reproduce it after pulling trunk of everything | 14:05 |
| gfidente | shardy ack | 14:05 |
| hewbrocca | the hell | 14:05 |
| jpich | hewbrocca: No, but I'm going to add a comment with the steps I followed in the not unlikely event that I Did It Wrong | 14:05 |
| mgould | jpich: that would be very helpful, thanks! | 14:06 |
| jpich | honza: I think most of the rpm experts hang out on #rdo :) | 14:06 |
| honza | jpich: i thought it was more about what we need to have happen | 14:06 |
| *** akshai has quit IRC | 14:08 | |
| ansiwen | EmilienM: what is the difference between "class { '::nova' : ..." like in overclud_controller.pp and "Nova { ..." like in nova.pp? | 14:08 |
| EmilienM | ansiwen: the second is a collector, to override a value | 14:09 |
| ansiwen | EmilienM: so I would just use "class { '::nova::cache' : ..." in nova.pp? | 14:11 |
| EmilienM | yes | 14:11 |
| ansiwen | EmilienM: ok, thanks | 14:11 |
| *** akshai has joined #tripleo | 14:11 | |
| *** jeckersb is now known as jeckersb_gone | 14:12 | |
| mgould | shardy: OK, I think I understand now | 14:13 |
| mgould | we should remove the now-unused "provide" kwarg to utils.nodes.register_all_nodes | 14:14 |
| *** paramite is now known as paramite|afk | 14:14 | |
| *** jtomasek has quit IRC | 14:14 | |
| ansiwen | EmilienM: can I do a dry-run or something to test if the manifests are consistent at least? | 14:14 |
| *** jprovazn has quit IRC | 14:15 | |
| * slagle notes that there isn't actually a failed CI job that failed with the error in https://bugs.launchpad.net/tripleo/+bug/1605359 | 14:15 | |
| openstack | Launchpad bug 1605359 in tripleo "[trunk] With master of Ironic, node registration fails" [Critical,Incomplete] - Assigned to Steven Hardy (shardy) | 14:15 |
| slagle | hewbrocca: jpich ^ | 14:15 |
| *** jeckersb_gone is now known as jeckersb | 14:15 | |
| slagle | i wonder if we're spinning our wheels hee | 14:15 |
| hewbrocca | slagle: well, trown|outtypewww didn't just make it up :) | 14:15 |
| slagle | here | 14:15 |
| slagle | hewbrocca: well, there isnt enough information in the bug to reproduce apparently | 14:16 |
| hewbrocca | The job that failed was the trunk promote job | 14:16 |
| slagle | hewbrocca: yes, that job did fail | 14:16 |
| slagle | NOT with this error | 14:16 |
| hewbrocca | Now that they've fixed a *different* problem with the promote job, we might be able to try to reproduce it again | 14:16 |
| hewbrocca | hmm, I wonder | 14:16 |
| * mgould boils the kettle for about the fifth time - will I manage to make some tea this time? | 14:16 | |
| slagle | this is the latest error in the promote job: https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-delorean-minimal-386/undercloud/home/stack/undercloud_install.log.gz | 14:17 |
| slagle | that is before node registration even attempted | 14:17 |
| hewbrocca | right, that's due to subsequent breakage of swift packaging | 14:18 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: add TestNetworkBasicOps to the tempest skip list https://review.openstack.org/346053 | 14:18 |
| hewbrocca | which dmsimard is testing a fix for now | 14:18 |
| mgould | OK, I have a new theory as to how it could be breaking | 14:18 |
| slagle | neutron-db-manage fails with an access denied b/c of swift packaging? | 14:18 |
| hewbrocca | yes | 14:18 |
| hewbrocca | :) | 14:19 |
| hewbrocca | so they tell me, anyway | 14:19 |
| mgould | register_or_update_nodes workflow calls set_nodes_managed on success | 14:19 |
| dmsimard | slagle: swift packaging failure cascades down to other things and puppet doesn't configure some things because dependencies have failed | 14:19 |
| slagle | dmsimard: ok, i can believe that :) | 14:19 |
| mgould | does control return to take_action after register_or_update_nodes, or after set_nodes_managed? | 14:20 |
| slagle | dmsimard: is there a bug? i did check here first: https://etherpad.openstack.org/p/delorean_master_current_issues | 14:20 |
| slagle | i see the swift issue, but no way to correlate that with this neutron failure | 14:20 |
| jpich | mgould: Finally updated with the steps I followed, should that happen to be helpful (if you know where I missed something please let me know!) | 14:20 |
| dmsimard | slagle: hopefully bad packaging patches should not land in trunk repositories soon, we're adding gate jobs | 14:20 |
| mgould | jpich: thanks, will take a look | 14:20 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: add TestNetworkBasicOps to the tempest skip list https://review.openstack.org/346053 | 14:20 |
| dmsimard | slagle: it's not a neutron failure, it's a swift failure that prevents other things to be configured | 14:20 |
| slagle | dmsimard: i understand. was just asking if there was a bug | 14:21 |
| dmsimard | slagle: the bug is the swift one in the etherpad | 14:21 |
| dmsimard | 21 | 14:21 |
| slagle | ok, so there is no bug *filed* | 14:22 |
| dmsimard | no, it's a bad merge on the packaging end | 14:22 |
| dmsimard | that occured.. yesterday I think | 14:22 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Remove deprecated net_ip_subnet_map output https://review.openstack.org/346055 | 14:22 |
| dmsimard | slagle: this: https://github.com/rdo-packages/swift-distgit/commit/f4306b42ab9f1d29fd538645fa28acb00db36dff | 14:22 |
| *** tobias_fiberdata has quit IRC | 14:22 | |
| slagle | dmsimard: yea, i got it. all i'm saying is that a filed bug showing the error (neutron-db-manage) that this ^^ causes might be helpful | 14:24 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: add TestNetworkBasicOps to the tempest skip list https://review.openstack.org/346053 | 14:24 |
| dmsimard | hm, I guess the root cause is documented but not the effects | 14:24 |
| dmsimard | slagle: it's a bug affecting tripleo, puppet-openstack and packstack and all three behave differently | 14:25 |
| slagle | peopel looking at the promote job trying to fix it, i have no idea there is already a fix | 14:25 |
| dmsimard | slagle: really, now ? https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/ | 14:26 |
| openstackgerrit | Merged openstack/tripleo-quickstart: add bugs associated w/ tempest failures (master) https://review.openstack.org/343884 | 14:26 |
| dmsimard | The text at the job doesn't make it obvious ? | 14:26 |
| openstackgerrit | Merged openstack/tripleo-quickstart: add TestNetworkBasicOps to the tempest skip list https://review.openstack.org/346053 | 14:26 |
| slagle | dmsimard: no. b/c i was looking at https://ci.centos.org/job/tripleo-quickstart-promote-master-delorean-minimal/ | 14:27 |
| dmsimard | doh ... | 14:27 |
| slagle | and looking at another bug filed that linked to failed job 386 | 14:27 |
| dmsimard | sorry, I tried to make it obvious :( | 14:28 |
| slagle | no worries, if this is where the notices go, let's add it to the etherpad | 14:28 |
| dmsimard | well, yes and no, it's not an official form of communication or anything | 14:28 |
| dmsimard | but when we disable the pipeline, there is usually a comment to mention why | 14:28 |
| slagle | dmsimard: i dont think we're connecting on this point anyway :) | 14:30 |
| hewbrocca | slagle: in general, we need to improve the process for reporting and tracking CI failures | 14:30 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud: Use certmonger for automatic cert generation https://review.openstack.org/332774 | 14:30 |
| hewbrocca | morazi: is working on whole proposal. We should always know exactly what the state of blocked jobs is, who is working on them, etc. | 14:31 |
| hewbrocca | including, bugs filed | 14:31 |
| slagle | hewbrocca: sure, i'm just trying to get context around https://bugs.launchpad.net/tripleo/+bug/1605359 | 14:32 |
| openstack | Launchpad bug 1605359 in tripleo "[trunk] With master of Ironic, node registration fails" [Critical,Incomplete] - Assigned to Steven Hardy (shardy) | 14:32 |
| slagle | e.g., what was being done/run to trigger that failure | 14:32 |
| hewbrocca | Yeah | 14:32 |
| slagle | since we have, what 3, 4 people looking into it? | 14:32 |
| *** paramite|afk is now known as paramite | 14:33 | |
| *** trozet has joined #tripleo | 14:34 | |
| shardy | slagle: I think someone needs to try running a clean quickstart trunk setup equivalent to the CI job | 14:34 |
| slagle | shardy: yea, +1 | 14:35 |
| shardy | I tried pretty hard to reproduce it on my tripleo.sh based environment and failed | 14:35 |
| hewbrocca | as did jpich | 14:35 |
| hewbrocca | makes sense to me | 14:35 |
| shardy | AFAICT the tripleo-common stuff is working just fine | 14:35 |
| slagle | shardy: honestly, i'd just wait for rdo to fix the swift packaging issue | 14:35 |
| *** trozet has quit IRC | 14:35 | |
| slagle | and kick off another CI job at that time | 14:35 |
| *** trozet has joined #tripleo | 14:35 | |
| hewbrocca | that time may be close at hand | 14:35 |
| shardy | yeah if that's happining soon then lets do that | 14:35 |
| *** jtomasek has joined #tripleo | 14:35 | |
| slagle | all environments i have are already polluted | 14:35 |
| mgould | do we have the number of a build where this failure occurs? | 14:37 |
| shardy | mgould: no context other than what's in the bug unfortunately | 14:37 |
| mgould | d'oh | 14:38 |
| mgould | and trown is ill | 14:38 |
| slagle | mgould: the node registration? No | 14:38 |
| shardy | since it's been declared a promotion blocker, I assume it's happening always | 14:38 |
| mgould | OK | 14:38 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Skip pingtest cleanup https://review.openstack.org/345570 | 14:39 |
| bnemec | \o/ faster ci jobs | 14:39 |
| * mgould sees the sea of red on rdo-delorean-promote-master | 14:39 | |
| slagle | mgould: i should clarify, before I delclare there is no failed CI job this way. but i definitely dont see one here: https://ci.centos.org/view/rdo/view/promotion-pipeline/job/tripleo-quickstart-promote-master-delorean-minimal/ | 14:39 |
| dprince | bnemec: FWIW, this means we won't catch Heat convergence cleanup issues anymore https://review.openstack.org/#/c/345570/ | 14:40 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Add environment file to enable DVR https://review.openstack.org/332147 | 14:40 |
| dprince | bnemec: we've already seen those... I'm still fine with your patch just a heads up | 14:40 |
| mgould | trown filed the bug at ~1900 UTC last night, so if there is one it should be shortly before then | 14:40 |
| bnemec | dprince: I have another patch that should help with that: https://review.openstack.org/#/c/296765/ | 14:42 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: add debug if introspection fails https://review.openstack.org/345559 | 14:42 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-common: Fix formatting in doc files https://review.openstack.org/346065 | 14:42 |
| bnemec | Only in periodic jobs, but it's deleting a much more complex stack so it's more likely to catch bugs too. | 14:42 |
| openstackgerrit | Merged openstack/tripleo-common: Fix code highlighting in the README and the title in the toctree https://review.openstack.org/342748 | 14:42 |
| dprince | bnemec: we aren't using convergence on the undercloud though. Only the overcloud at this point so we'd need the periodic job to also delete pingtest stack | 14:43 |
| bnemec | dprince: Ah. We could do that. I'll push a patch today that makes it configurable. | 14:44 |
| dprince | bnemec: cool, thanks for this | 14:44 |
| jaosorior | bnemec, dprince: Hey guys, did you get time to take a look at the ironic-inspector TLS stuff? | 14:44 |
| jaosorior | again tried to reproduce it and couldn't | 14:45 |
| dprince | jaosorior: yeah, it looked fine to me as well. I haven't spent the time to try it yet locally... | 14:45 |
| dprince | jaosorior: sorry, had some issues in my dev env yesterday | 14:45 |
| jaosorior | bnemec: Did you get a chance to try the certmonger cert autogeneration? | 14:47 |
| *** pblaho has quit IRC | 14:47 | |
| jaosorior | would really appreciate some reviews here: https://review.openstack.org/#/c/332774/ tried it with both local CA and using FreeIPA too. If someone wants to try with the local CA I would really appreciate it (not much to configure there, just make sure to include the patch needed from puppet-tripleo | 14:49 |
| jaosorior | ) | 14:49 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-common: Fix formatting in doc files https://review.openstack.org/346065 | 14:50 |
| shardy | slagle: Hey, if you get a moment I'd appreciate your views on https://bugs.launchpad.net/tripleo/+bug/1605596 | 14:51 |
| openstack | Launchpad bug 1605596 in tripleo "Depends-On doesn't work for multinode job" [Undecided,New] | 14:51 |
| shardy | AFAICS we've got issues with Depends-On and the multinode job | 14:51 |
| *** rlandy has joined #tripleo | 14:52 | |
| slagle | i'll take a look | 14:54 |
| bnemec | jaosorior: No, sorry. Swamped with other stuff right now. | 14:54 |
| jaosorior | no problem | 14:55 |
| jaosorior | I'm gonna be off next week | 14:55 |
| *** zoliXXL is now known as zoli|brb | 14:55 | |
| jaosorior | if someone can take care of these two patches https://review.openstack.org/#/c/345899/ https://review.openstack.org/#/c/332774/ I would really appreciate it | 14:56 |
| *** dtrainor_ has quit IRC | 14:59 | |
| *** dtrainor has joined #tripleo | 14:59 | |
| *** tesseract- has quit IRC | 15:09 | |
| *** jistr is now known as jistr|mtg | 15:09 | |
| *** ebarrera has quit IRC | 15:12 | |
| *** snecklifter has joined #tripleo | 15:13 | |
| jaosorior | alright guys, I'm off for a week | 15:13 |
| openstackgerrit | Martin Mágr proposed openstack-infra/tripleo-ci: Add opstools candidate repo https://review.openstack.org/325095 | 15:14 |
| *** jaosorior has quit IRC | 15:14 | |
| *** dprince has quit IRC | 15:15 | |
| weshay | shardy, slagle k.. apetrich is going to send up some bugs.. | 15:17 |
| weshay | FYI.. we have a job here. https://ci.centos.org/view/rdo/view/tripleo-periodic/job/tripleo-quickstart-upgrade-major-mitaka-to-master/ | 15:17 |
| shardy | weshay: I created a tag https://bugs.launchpad.net/tripleo/+bugs?field.tag=update-bugs | 15:17 |
| *** jistr|mtg is now known as jistr | 15:17 | |
| weshay | k.. | 15:17 |
| slagle | weshay: cool....yea what shardy said :) | 15:17 |
| weshay | apetrich, ^ | 15:17 |
| slagle | types faster than me :) | 15:17 |
| shardy | we could create another one to differentiate update from upgrade bugs | 15:18 |
| weshay | looks like the undercloud works, overcloud fails | 15:18 |
| *** aufi_ has quit IRC | 15:18 | |
| shardy | let me know if that would be useful | 15:18 |
| apetrich | shardy, brilliant. right now I can be sure of only one issue. adding there | 15:18 |
| weshay | https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-upgrade-major-mitaka-to-master-26/undercloud/home/stack/upgrade_console.log.gz | 15:19 |
| weshay | (pymysql.err.InternalError) (1054, u"Unknown column 'nodes.network_interface' in 'field list'") | 15:20 |
| shardy | ok sounds like the DB sync didn't happen, or happened at the wrong time | 15:20 |
| openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo: New composable service: Sensu https://review.openstack.org/323303 | 15:20 |
| weshay | shardy, here's the undercloud upgrade https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-upgrade-major-mitaka-to-master-26/undercloud/home/stack/upgrade_undercloud.log.gz | 15:21 |
| *** rcernin has quit IRC | 15:24 | |
| shardy | Do we store the delorean build logs anywhere in CI? | 15:28 |
| shardy | http://logs.openstack.org/10/345510/5/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/3b0613a/console.html | 15:28 |
| shardy | that is failing with a heat package build and I can't figure out why | 15:28 |
| *** jayg has quit IRC | 15:29 | |
| shardy | builds find locally | 15:29 |
| *** jayg|g0n3 has joined #tripleo | 15:29 | |
| slagle | shardy: should be in http://logs.openstack.org/10/345510/5/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/3b0613a/logs/delorean_repos.tar.xz | 15:29 |
| shardy | aha, I just downloaded that, thanks :) | 15:29 |
| *** tosky_ has joined #tripleo | 15:30 | |
| *** dbecker_ has joined #tripleo | 15:31 | |
| *** jokke__ has joined #tripleo | 15:31 | |
| *** mcornea_ has joined #tripleo | 15:31 | |
| slagle | dmsimard: i see the promote pipline reenabled | 15:32 |
| slagle | i guess i can trigger https://ci.centos.org/view/rdo/view/promotion-pipeline/job/tripleo-quickstart-promote-master-delorean-minimal/ ? | 15:32 |
| dmsimard | slagle: not me, shouldn't be | 15:32 |
| dmsimard | slagle: the fix has not yet merged and has not yet been built | 15:32 |
| slagle | oh | 15:32 |
| slagle | what am i looking at | 15:32 |
| dmsimard | slagle: https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/ is still disabled to me | 15:32 |
| *** pleia2_ has joined #tripleo | 15:32 | |
| *** isq_ has joined #tripleo | 15:33 | |
| dmsimard | slagle: also, that particular job shouldn't be triggered by itself | 15:33 |
| dmsimard | slagle: it depends on an artifact that is produced upstream of it | 15:33 |
| *** tosky has quit IRC | 15:33 | |
| *** dbecker has quit IRC | 15:33 | |
| dmsimard | slagle: in the full pipeline I just linked you see there's a step before it that builds an image | 15:33 |
| slagle | so we just wait a couple hours and see what happens? | 15:33 |
| *** jokke_ has quit IRC | 15:33 | |
| dmsimard | slagle: no, the fix is merging right now and will be built shortly. I am monitoring the builds and as soon as it's built I'll re-enable the pipeline and fire a build | 15:33 |
| slagle | ok, thanks | 15:34 |
| openstackgerrit | Merged openstack/puppet-tripleo: Generate HAProxy certificates in base profile https://review.openstack.org/345899 | 15:34 |
| *** zoli|brb is now known as zoli | 15:34 | |
| *** zoli is now known as zoliXXL | 15:34 | |
| *** mcornea has quit IRC | 15:35 | |
| *** pleia2 has quit IRC | 15:35 | |
| openstackgerrit | Martin André proposed openstack/tripleo-common: Create new docker command hook. https://review.openstack.org/312723 | 15:37 |
| openstackgerrit | Martin André proposed openstack/tripleo-common: Add keystone config files and utilities to heat-agents https://review.openstack.org/346087 | 15:37 |
| *** tosky_ has quit IRC | 15:39 | |
| *** paramite has quit IRC | 15:39 | |
| *** flaper87 has quit IRC | 15:39 | |
| *** cwolferh has quit IRC | 15:39 | |
| *** jschlueter has quit IRC | 15:39 | |
| *** isq has quit IRC | 15:39 | |
| *** greghaynes has quit IRC | 15:39 | |
| *** dhill_ has quit IRC | 15:39 | |
| *** timothyb89 has quit IRC | 15:39 | |
| *** stevebaker has quit IRC | 15:39 | |
| *** krotscheck has quit IRC | 15:39 | |
| *** akshai has quit IRC | 15:39 | |
| *** akshai has joined #tripleo | 15:43 | |
| *** bfournie has left #tripleo | 15:44 | |
| EmilienM | shardy, gfidente: I had to rebase https://review.openstack.org/#/c/341616/ - could you +2 it again? | 15:46 |
| *** tosky has joined #tripleo | 15:46 | |
| shardy | EmilienM: sure, looking | 15:46 |
| EmilienM | thanks | 15:46 |
| *** krotscheck has joined #tripleo | 15:47 | |
| *** flaper87 has joined #tripleo | 15:47 | |
| *** stevebaker has joined #tripleo | 15:47 | |
| *** dhill_ has joined #tripleo | 15:47 | |
| *** cwolferh has joined #tripleo | 15:47 | |
| shardy | EmilienM: I actually never +2'd it ;) | 15:47 |
| *** paramite has joined #tripleo | 15:47 | |
| *** greghaynes has joined #tripleo | 15:47 | |
| *** flaper87 is now known as Guest32906 | 15:47 | |
| shardy | I did test it locally, and it works, but did we figure out why trown|outtypewww said it was broken? | 15:47 |
| *** dprince has joined #tripleo | 15:47 | |
| *** jschlueter has joined #tripleo | 15:48 | |
| shardy | I'd like to see it merge, but I'm kind of keen to not get shouted at any more about RDO regressions ;) | 15:48 |
| *** timothyb89 has joined #tripleo | 15:48 | |
| *** xinwu has quit IRC | 15:48 | |
| EmilienM | right | 15:48 |
| EmilienM | I'll let him approve it | 15:48 |
| shardy | EmilienM: ack, I'm about to deploy an overcloud so I'll also re-test locally | 15:49 |
| *** pcaruana has quit IRC | 15:49 | |
| hewbrocca | EmilienM: Somebody needs to test the patch using oooq | 15:50 |
| hewbrocca | that's the only time the failure reproduces | 15:50 |
| zoliXXL | have a nice weekend | 15:50 |
| openstackgerrit | Sven Anderson proposed openstack/puppet-tripleo: Configure memcached using new settings in [cache] section https://review.openstack.org/346097 | 15:50 |
| gfidente | EmilienM can you vote https://review.openstack.org/#/c/336573/, its depending change | 15:51 |
| gfidente | and https://review.openstack.org/#/c/335561/ too | 15:51 |
| *** zoliXXL is now known as zoli|gone | 15:52 | |
| EmilienM | gfidente: ok | 15:52 |
| mgould | shardy: what's going on with https://bugs.launchpad.net/tripleo/+bug/1605359 ? Are we going to wait for trown to provide more info? | 15:52 |
| openstack | Launchpad bug 1605359 in tripleo "[trunk] With master of Ironic, node registration fails" [Critical,Incomplete] - Assigned to Steven Hardy (shardy) | 15:52 |
| shardy | mgould: we're waiting for the next RDO CI run to hopefully reproduce it | 15:52 |
| hewbrocca | should start momentarily | 15:52 |
| mgould | shardy: cool, thanks | 15:52 |
| * mgould -> relocate, brb | 15:52 | |
| EmilienM | gfidente: all +2 | 15:53 |
| gfidente | EmilienM tks | 15:53 |
| *** zoli|gone is now known as zoli_gone-proxy | 15:54 | |
| *** pleia2_ is now known as pleia2 | 15:55 | |
| *** dsariel has joined #tripleo | 15:55 | |
| *** skramaja has joined #tripleo | 15:55 | |
| openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo: New composable service: Sensu https://review.openstack.org/323303 | 15:57 |
| openstackgerrit | Merged openstack/puppet-tripleo: Remove unused redis_vip parameter https://review.openstack.org/345285 | 16:00 |
| *** ebalduf_ has joined #tripleo | 16:01 | |
| *** milan has quit IRC | 16:02 | |
| *** jayg|g0n3 is now known as jayg | 16:05 | |
| *** rasca has quit IRC | 16:06 | |
| *** ebalduf_ has quit IRC | 16:06 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Increase RabbitMQ maximum file descriptors. https://review.openstack.org/337607 | 16:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Increase RabbitMQ maximum file descriptors. https://review.openstack.org/339556 | 16:07 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Remove unused redis_vip parameter https://review.openstack.org/336573 | 16:07 |
| dmsimard | hewbrocca, slagle: swift fix still hasn't been built by dlrn, I'll let you know when it has and I've triggered a promote job | 16:07 |
| slagle | ok, great | 16:10 |
| weshay | dmsimard, hewbrocca tested locally.. seems to fix the undercloud install | 16:10 |
| weshay | yup.. undercloud is good w/ the new swift package | 16:11 |
| openstackgerrit | Merged openstack/puppet-tripleo: use parameter to lookup the step instead of hiera again https://review.openstack.org/345442 | 16:11 |
| EmilienM | weshay: any chance you can test https://review.openstack.org/#/c/341616/ using oooq? | 16:12 |
| EmilienM | shardy, gfidente: could I have your +2 at least? So we can merge it as soon as we know it works in RDO | 16:12 |
| EmilienM | shardy, gfidente: for https://review.openstack.org/#/c/341616/ | 16:12 |
| *** bfournie has joined #tripleo | 16:13 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Enable keystone to use the SSL middleware https://review.openstack.org/341354 | 16:13 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Enable glance to use the SSL middleware https://review.openstack.org/341367 | 16:14 |
| weshay | EmilienM, https://ci.centos.org/view/rdo/view/tripleo-gate/job/tripleo-quickstart-thirdparty-gate-master/19/ | 16:14 |
| openstackgerrit | Merged openstack/tripleo-common: Updated from global requirements https://review.openstack.org/339948 | 16:14 |
| EmilienM | weshay++ | 16:15 |
| EmilienM | thanks | 16:15 |
| *** jubapa has quit IRC | 16:15 | |
| *** dprince has quit IRC | 16:15 | |
| EmilienM | slagle: about https://review.openstack.org/#/c/345658/1/elements/puppet-stack-config/puppet-stack-config.pp | 16:16 |
| EmilienM | slagle: I think I'm going to make undercloud deployment in one step instead of 2. Thoughts? | 16:16 |
| *** jistr is now known as jistr|off | 16:16 | |
| *** jistr|off is now known as jistr | 16:17 | |
| *** david-lyle_ has joined #tripleo | 16:17 | |
| EmilienM | slagle: mhh but it's tricky, because of the os-net-config thing | 16:17 |
| slagle | EmilienM: yea, i was going to say, go4it | 16:17 |
| slagle | if you can make it work | 16:17 |
| slagle | thar be dragons if you ask me | 16:17 |
| *** jubapa has joined #tripleo | 16:18 | |
| EmilienM | slagle: I see some other ways to trigger db_sync, but they would be hacks and I don't want that. | 16:18 |
| slagle | triggering db_sync based on package update is a hack :) | 16:18 |
| dmsimard | slagle, hewbrocca: swift is built, firing promote | 16:18 |
| bnemec | db syncs are idempotent, we shouldn't have any logic around it at all... | 16:18 |
| EmilienM | slagle: I have an idea | 16:19 |
| slagle | bnemec: yes | 16:19 |
| slagle | that's why we should just run it every time | 16:19 |
| EmilienM | slagle: I'll use puppet anchor | 16:19 |
| slagle | part of the issue here is that we've never told anyone they cant use "yum" if they want | 16:20 |
| slagle | so if someone does yum update an openstack package, the db sync will not fire | 16:20 |
| bnemec | In fact we've been explicitly telling people they can yum update packages any time they want. | 16:21 |
| bnemec | Which isn't actually true either. | 16:21 |
| bnemec | But I can tell you we've swapped in newer Heat packages in the field. | 16:21 |
| *** hewbrocca is now known as hewbrocca-afk | 16:22 | |
| openstackgerrit | Merged openstack/instack-undercloud: Deploy MySQL using composable role https://review.openstack.org/345002 | 16:22 |
| *** beagles is now known as beagles_biab | 16:23 | |
| *** david-lyle_ has quit IRC | 16:23 | |
| weshay | shardy, ping re: httpd not starting in newton | 16:25 |
| weshay | can someone verify this issue https://bugs.launchpad.net/tripleo/+bug/1572976 and https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-mitaka-delorean-minimal-634/undercloud/home/stack/failed_deployment_6e3a2c83-9bbc-442a-90b9-94f9f33f3f51.log.gz | 16:26 |
| openstack | Launchpad bug 1572976 in tripleo "Periodically Apache httpd restart fails" [Medium,Triaged] | 16:26 |
| weshay | is the same root cause.. the bug is written on newton, the log is mitaka | 16:26 |
| *** jubapa has quit IRC | 16:28 | |
| *** jokke__ is now known as jokke_ | 16:33 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Implement tripleo::network::os_net_config class https://review.openstack.org/346118 | 16:34 |
| *** mcornea_ has quit IRC | 16:34 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Implement tripleo::network::os_net_config class https://review.openstack.org/346118 | 16:36 |
| *** ayoung has joined #tripleo | 16:36 | |
| weshay | slagle, so I think I recreated the registration issue that trown|outtypewww was hitting | 16:37 |
| weshay | on a local box | 16:37 |
| weshay | + openstack baremetal import --json instackenv.json | 16:38 |
| weshay | WARNING: openstackclient.common.utils is deprecated and will be removed after Jun 2017. Please use osc_lib.utils | 16:38 |
| weshay | Exception registering nodes: The requested action "provide" can not be performed on node "0da378d8-74d9-4293-b1fd-97873620669b" while it is in state "enroll". | 16:38 |
| weshay | [stack@undercloud ~]$ source stackrc | 16:38 |
| dmsimard | weshay: so that means the promote job will fail ? :( | 16:39 |
| weshay | yup | 16:39 |
| dmsimard | fml | 16:39 |
| weshay | srsly | 16:40 |
| jpich | weshay: How did you do it? | 16:40 |
| openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo: New composable service: Sensu https://review.openstack.org/323303 | 16:40 |
| weshay | jpich, using the latest undercloud test image + the rpm update for swift https://review.rdoproject.org/r/#/c/1706/ | 16:41 |
| weshay | jpich, undercloud-install then. + openstack baremetal import --json instackenv.json | 16:41 |
| jpich | weshay: Oh, thank you. Sorry for the basic question, where do these undercloud test images live? | 16:42 |
| weshay | http://artifacts.ci.centos.org/artifacts/rdo/images/master/delorean/testing/undercloud.qcow2 | 16:43 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Deploy undercloud in 1 step instead of 2 https://review.openstack.org/346124 | 16:44 |
| EmilienM | slagle: ^ | 16:44 |
| EmilienM | slagle: I have a question inline | 16:44 |
| weshay | jpich, no worries | 16:45 |
| jpich | weshay: I guess next on my to-learn list will be to figure out how these are made and how to work with them. Thank you for the information!! | 16:45 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Implement tripleo::network::os_net_config class https://review.openstack.org/346118 | 16:46 |
| *** beagles_biab is now known as beagles | 16:46 | |
| EmilienM | ok rebased | 16:46 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Deploy undercloud in 1 step instead of 2 https://review.openstack.org/346124 | 16:46 |
| *** dprince has joined #tripleo | 16:49 | |
| *** skramaja has quit IRC | 16:53 | |
| *** gfidente has quit IRC | 16:55 | |
| *** jpich has quit IRC | 16:55 | |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Deploy undercloud in 1 step instead of 2 https://review.openstack.org/346124 | 16:56 |
| EmilienM | slagle: with upgrade support and db_sync thing ^ | 16:56 |
| slagle | EmilienM: you have a merge conflict marker in there :) | 16:57 |
| slagle | EmilienM: and where is the part that runs dbsync every time, regardless of the package update? | 16:57 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Deploy undercloud in 1 step instead of 2 https://review.openstack.org/346124 | 16:57 |
| EmilienM | slagle: ah, fixing merge conflict, a sec | 16:57 |
| weshay | shardy, slagle added logs for https://bugs.launchpad.net/tripleo/+bug/1605359 | 16:58 |
| openstack | Launchpad bug 1605359 in tripleo "[trunk] With master of Ironic, node registration fails" [Critical,Incomplete] - Assigned to Steven Hardy (shardy) | 16:58 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Deploy undercloud in 1 step instead of 2 https://review.openstack.org/346124 | 16:58 |
| EmilienM | slagle: I explain the magic here: https://review.openstack.org/#/c/345604/1/elements/puppet-stack-config/puppet-stack-config.pp | 16:59 |
| weshay | hrm.. | 16:59 |
| weshay | 2016-07-22 16:51:43.601 14550 ERROR tripleo_common.utils.nodes.set_nodes_state [-] FAIL: Error transitioning Ironic node 5f7bd602-cfc0-4604-b1da-7d5279da3ecd to provision state manageable: Failed to get power state for node 5f7bd602-cfc0-4604-b1da-7d5279da3ecd. Error: SSH driver was not able to find a VM with any of the specified MACs: [u'00:cb:71:df:5f:4f'] for node 5f7bd602-cfc0-4604-b1da-7d5279da3ecd.. Now in | 16:59 |
| weshay | state enroll. | 16:59 |
| EmilienM | slagle: the db_sync are already in catalog, they just need to be refreshed everytime packaging is updated | 17:00 |
| EmilienM | it was not because it was not in same step | 17:00 |
| EmilienM | so not in same catalog | 17:00 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Delete ping test environment in periodic jobs https://review.openstack.org/346134 | 17:00 |
| slagle | EmilienM: what i was saying though is that i'd prefer to see the dbsync run every time | 17:00 |
| EmilienM | slagle: see https://github.com/openstack/puppet-nova/blob/master/manifests/db/sync.pp#L24 | 17:00 |
| slagle | EmilienM: regardless of if a package update happens or not | 17:00 |
| EmilienM | slagle: oh... | 17:01 |
| EmilienM | I can't do this without a terrible hack to run it in a exec | 17:01 |
| EmilienM | right now our puppet modules run dbsync only when config change or packaging is updated | 17:01 |
| EmilienM | right now == in my patch | 17:01 |
| EmilienM | I think it's a good first step, isn't? | 17:02 |
| slagle | EmilienM: probably is, i'll have to look closer, it's a big patch | 17:03 |
| slagle | for what is 6 or 7 lines of cli commands :) | 17:03 |
| EmilienM | slagle: it's a small patch but I'm removing the steps so it's moving code to the left | 17:03 |
| *** hewbrocca-afk is now known as hewbrocca | 17:03 | |
| slagle | EmilienM: ok, well give me a minute, you uploaded 3 PS's in 2 minutes | 17:04 |
| *** yamahata has joined #tripleo | 17:04 | |
| EmilienM | no hurry | 17:04 |
| *** skramaja has joined #tripleo | 17:04 | |
| EmilienM | slagle: there is a dependency | 17:04 |
| slagle | but i do think this is a pretty big hammer, for what is effectively "call 6 db sync commands" | 17:04 |
| EmilienM | slagle: it's doing more than that, it's making the deployment more efficient | 17:06 |
| hewbrocca | weshay: where's that trace from? | 17:06 |
| weshay | mistral | 17:06 |
| slagle | weshay: 2016-07-22 16:51:43.601 14550 ERROR tripleo_common.utils.nodes.set_nodes_state [-] FAIL: Error transitioning Ironic node 5f7bd602-cfc0-4604-b1da-7d5279da3ecd to provision state manageable: Failed to get power state for node 5f7bd602-cfc0-4604-b1da-7d5279da3ecd. Error: SSH driver was not able to find a VM with any of the specified MACs: [u'00:cb:71:df:5f:4f'] for node 5f7bd602-cfc0-4604-b1da-7d5279da3ecd.. Now in state enroll. | 17:07 |
| slagle | weshay: soemthing wrong with virt setup maybe? | 17:07 |
| weshay | ya.. I'm looking at that now | 17:07 |
| weshay | matching the macs | 17:07 |
| *** tosky has quit IRC | 17:07 | |
| slagle | weshay: this log is helpful :) | 17:07 |
| weshay | Error: SSH driver was not able to find a VM with any of the specified MACs: [u'00:cb:71:df:5f:4f'] for node 5f7bd602-cfc0-4604-b1da-7d5279da3ecd.. Now in state enroll. | 17:08 |
| weshay | and | 17:08 |
| weshay | <interface type='bridge'> | 17:08 |
| weshay | <mac address='00:cb:71:df:5f:4f'/> | 17:08 |
| weshay | that was the compute node | 17:08 |
| slagle | weshay: check ironic-conductor.log | 17:10 |
| slagle | weshay: 2016-07-22 16:51:35.845 14604 DEBUG ironic.drivers.modules.ssh [req-3cd9e8fa-c288-4a82-848b-105a0999d677 - - - - -] Retrieved Node List: [u'', u''] _with_retries /usr/lib/python2.7/site-packages/ironic/drivers/modules/ssh.py:484 | 17:10 |
| slagle | weshay: ironic can't find any nodes | 17:10 |
| EmilienM | slagle: yes, it sounds big but any suggestion is welcome. git diff is big because I move the code to the left, that's it. | 17:10 |
| beagles | wrong user doing the virsh list? | 17:10 |
| slagle | so the macs may indeed match, but virsh list isn't returning any nodes | 17:11 |
| slagle | EmilienM: yep, i'll have a look. if it works, i'm good with it | 17:11 |
| *** florianf has quit IRC | 17:11 | |
| slagle | EmilienM: would still like to do the dbsync though, but it can come later | 17:12 |
| EmilienM | slagle: I'll think about it | 17:12 |
| weshay | Failed to get power state for node 0da378d8-74d9-4293-b1fd-97873620669b. Error: SSH driver was not able to find a VM with any of the specified MACs: [u'00:cb:71:df:5f:4b'] for node 0da378d8-74d9-4293-b1fd-97873620669b. | 17:12 |
| weshay | ya | 17:12 |
| EmilienM | slagle: I actually prototype something that will notify the execs without hack | 17:12 |
| EmilienM | slagle: I have an idea for it but I would like to do it in a separated patch | 17:12 |
| *** zaneb has quit IRC | 17:13 | |
| slagle | weshay: virsh uri maybe? | 17:14 |
| weshay | slagle, not sure.. looking into it | 17:14 |
| slagle | k, let me know if you want me to assist | 17:14 |
| weshay | k.. rlandy and I are going to poke around, if we get stuck we'll hollar | 17:15 |
| weshay | thank you! | 17:15 |
| weshay | rlandy, the full context is here. https://bugs.launchpad.net/tripleo/+bug/1605359 | 17:16 |
| openstack | Launchpad bug 1605359 in tripleo "[trunk] With master of Ironic, node registration fails" [Critical,Incomplete] - Assigned to Steven Hardy (shardy) | 17:16 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: WIP: run neutron-db-sync at every puppet run https://review.openstack.org/346138 | 17:17 |
| EmilienM | slagle: here we go ^ | 17:17 |
| hewbrocca | weshay: is that from the promote? | 17:17 |
| EmilienM | slagle: I take the resource from puppet-neutron and override refreshonly from True to False | 17:18 |
| hewbrocca | ahh, no, I see the promote is running now | 17:19 |
| slagle | EmilienM: i like it | 17:19 |
| EmilienM | well all of this needs to be tested, I'll keep an eye on this | 17:19 |
| weshay | hewbrocca, a local recreate of the promote ya.. which is building a new image now.. so we should know in 25 min if it recreates there | 17:19 |
| hewbrocca | OK then | 17:20 |
| *** florianf has joined #tripleo | 17:23 | |
| *** pkovar has quit IRC | 17:24 | |
| *** bfournie has quit IRC | 17:24 | |
| weshay | slagle, the only very recent change is that.. we're using the very latest ipxe rom | 17:25 |
| weshay | all the macs line up | 17:25 |
| slagle | weshay: it's not that the macs don't match | 17:26 |
| EmilienM | slagle: did you already start the work on a "undercloud job only" ? | 17:26 |
| *** akrivoka has quit IRC | 17:26 | |
| slagle | weshay: it's that the ironic found 0 nodes | 17:26 |
| weshay | k.. here's what I have | 17:26 |
| weshay | 2 undercloud running | 17:26 |
| weshay | - compute_0 shut off | 17:26 |
| weshay | - control_0 shut off | 17:26 |
| slagle | weshay: no... | 17:27 |
| slagle | weshay: from the ironic side | 17:27 |
| weshay | k | 17:27 |
| slagle | Retrieved Node List: [u'', u''] | 17:27 |
| slagle | in the conductor log ^ | 17:27 |
| slagle | check the ssh user, private key in the ironic node details | 17:28 |
| slagle | see what user it is using, try to reproduce as that user | 17:28 |
| weshay | k.. it's stack and checking the key | 17:29 |
| weshay | keys appear to match | 17:31 |
| weshay | sec | 17:31 |
| *** fzdarsky has joined #tripleo | 17:32 | |
| *** julim has quit IRC | 17:32 | |
| weshay | ironic node-show.. has | 17:33 |
| weshay | | 4/1ia9RtTuWMpnSGv0zWeZ9hvJEkqVKtkGEg7cl9ro0ivjabL0dzBSV/q/WKw== | | 17:33 |
| weshay | | | ----- | | 17:33 |
| weshay | | | END RSA PRIVATE KEY-----', u'ssh_virt_type': u'virsh', u'ssh_address': | | 17:33 |
| weshay | instackenv.json has | 17:33 |
| weshay | 7BTaf/auqopv3MQMlMVYJIaDm/Qp92MK/spE7mVyOz+3HfSFVz3yo\nn4/1ia9RtTuWMpnSGv0zWeZ9hvJEkqVKtkGEg7cl9ro0ivjabL0dzBSV/q/WKw==\n-----END RSA PRIVATE KEY-----", | 17:33 |
| weshay | "pm_type": "pxe_ssh", | 17:33 |
| beagles | weshay: if there is an identify file in ~stack/.ssh for that key you could try something of the form of 'ssh -i .ssh/id_rsa_virt_power root@192.168.122.1 virsh list --all' ... | 17:36 |
| slagle | weshay: yea you need to try something like that ^ | 17:36 |
| beagles | weshay: replacing file and usernames as necessary of course | 17:36 |
| weshay | ya | 17:36 |
| *** julim has joined #tripleo | 17:37 | |
| beagles | (shameless plug: this kind of thing is part of my guerilla tripleo preso I proposed for Barcelona ;)) | 17:37 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - test undercloud deploy only https://review.openstack.org/346147 | 17:38 |
| EmilienM | slagle: ^ for testing | 17:38 |
| bnemec | EmilienM: I'm inclined to say we don't want to use tripleo-ci for that. Otherwise the undercloud-only job is going to get assigned an entire six-node environment and only use one. | 17:39 |
| bnemec | We should be able to do undercloud-only installs on regular infra instances. | 17:39 |
| EmilienM | bnemec: I'm using infra instances in my patch | 17:39 |
| bnemec | EmilienM: Oh, never mind then. :-) | 17:40 |
| EmilienM | bnemec: note: my patch is using multinode job now for testing purpose because we don't have undercloud-only job atm | 17:40 |
| shardy | slagle thanks for picking up bug #1605359, excellent that it's now been reproduced, but the root cause seems pretty strange | 17:40 |
| openstack | bug 1605359 in tripleo "[trunk] With master of Ironic, node registration fails" [Critical,Incomplete] https://launchpad.net/bugs/1605359 - Assigned to Steven Hardy (shardy) | 17:40 |
| EmilienM | bnemec: if my stuff works, I'll propose a new job in infra using infra instances and I'll run this thing | 17:40 |
| EmilienM | bnemec: right now, I'm re-using multinode job that slagle created | 17:40 |
| shardy | If one of you wants to take that then feel free, I'm at EOD now but will be checking in during the evening | 17:40 |
| bnemec | EmilienM: That would be awesome. I've been wanting to do something similar for an undercloud upgrade job too. | 17:41 |
| shardy | +1 on an undercloud upgrade job | 17:41 |
| slagle | with ssl! | 17:41 |
| EmilienM | shardy: wait, right now I'm working on a undercloud-only job | 17:42 |
| EmilienM | next step will be upgrade | 17:42 |
| EmilienM | slagle: you don't mind if I pick this work? | 17:42 |
| shardy | EmilienM: Yup, I was responding to the comment from bnemec | 17:42 |
| slagle | EmilienM: go4it man | 17:42 |
| EmilienM | shardy: cool. Once we have undercloud only job, should not be hard to run upgrade | 17:42 |
| EmilienM | slagle: ack | 17:42 |
| EmilienM | now we can use openstack instances for free, let's do it :) | 17:43 |
| shardy | those DB sync issues would be caught if we ran the undercloud upgrade job as part of the periodic promote pipeline | 17:43 |
| EmilienM | shardy: I proposed a PoC | 17:43 |
| EmilienM | shardy: https://review.openstack.org/346124 | 17:43 |
| shardy | (and other similar problems that we've seen recently) | 17:43 |
| EmilienM | from L16 to L42 is what you need to actually review | 17:44 |
| EmilienM | in https://review.openstack.org/#/c/346124/5/elements/puppet-stack-config/puppet-stack-config.pp | 17:44 |
| *** skramaja has quit IRC | 17:44 | |
| *** dtrainor has quit IRC | 17:44 | |
| bnemec | I was running an undercloud upgrade job locally on all instack-undercloud patches, but it got broken by the mariadb major version upgrade and I haven't had a chance to figure out how to fix it yet. | 17:44 |
| EmilienM | slagle: do we have a storyboard now? | 17:45 |
| bnemec | The relevant bits of the script: http://paste.openstack.org/show/539828/ | 17:46 |
| slagle | EmilienM: no, sorry | 17:46 |
| slagle | EmilienM: i've been slacking all week | 17:46 |
| EmilienM | slagle: do you want me to create it? | 17:46 |
| slagle | you caught me :) | 17:46 |
| slagle | EmilienM: sure, if you want to. the tripleo-ci project should be imported already | 17:46 |
| EmilienM | bnemec: ack, I'll bookmark it | 17:46 |
| slagle | EmilienM: supposedly they have imported all of openstack-infra | 17:47 |
| bnemec | slagle: You know what your problem is, McSlagle? You're a slacker! Just like your old man. | 17:47 |
| bnemec | :-) | 17:47 |
| slagle | lol | 17:47 |
| *** paramite is now known as paramite|afk | 17:48 | |
| *** bnemec is now known as beekneemech | 17:49 | |
| slagle | dmsimard: i see weirdo promote jobs running, but not quickstart. will those start soon? | 17:49 |
| * beekneemech notes that he hasn't participated in CNF for a while | 17:49 | |
| *** lucasagomes has quit IRC | 17:49 | |
| dmsimard | slagle: look at the top left of the UI | 17:49 |
| dmsimard | slagle: the builds are queued | 17:49 |
| dmsimard | they haven't started yet | 17:49 |
| slagle | ok :) | 17:50 |
| slagle | dmsimard: clearly i dont know how to use jenkins :) | 17:50 |
| dmsimard | slagle: top left of UI here: https://ci.centos.org/ | 17:50 |
| EmilienM | slagle: https://storyboard.openstack.org/#!/story/2000682 | 17:50 |
| EmilienM | is it good? | 17:50 |
| slagle | EmilienM: yes, but I would like all user stories to start with "As an owl..." | 17:51 |
| shardy | "since we don't need to test overcloud." is a little confusing, since any undercloud changes must still be proven to deploy an overcloud | 17:52 |
| EmilienM | as an own | 17:53 |
| EmilienM | l o l | 17:53 |
| shardy | I guess the main argument for an undercloud-only job is that we can do more stuff e.g upgrades within the infra timeout | 17:53 |
| EmilienM | updated | 17:53 |
| EmilienM | I think we'll need like a pingtest for undercloud | 17:54 |
| EmilienM | to make sure openstack is actually up and running | 17:55 |
| EmilienM | I'll poke beekneemech for that | 17:55 |
| *** lucasagomes has joined #tripleo | 17:57 | |
| beekneemech | Yeah, my undercloud upgrade job was taking over 20 minutes and that was starting with a pre-built Mitaka image. | 17:59 |
| beekneemech | Not something we could just tack onto our existing jobs without murdering the runtime. | 17:59 |
| *** bfournie has joined #tripleo | 18:05 | |
| openstackgerrit | Sarath Kumar Sankaran Kutty proposed openstack/os-net-config: Cleanups and new unit test for IVS https://review.openstack.org/346161 | 18:07 |
| *** rajinir has joined #tripleo | 18:09 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Fix Neutron enable_*_agent* Hiera parameters https://review.openstack.org/306335 | 18:11 |
| *** electrofelix has quit IRC | 18:17 | |
| *** xinwu has joined #tripleo | 18:18 | |
| *** zephcom has quit IRC | 18:20 | |
| *** xinwu has quit IRC | 18:21 | |
| *** david-lyle_ has joined #tripleo | 18:21 | |
| *** zephcom has joined #tripleo | 18:21 | |
| EmilienM | weshay: it failed | 18:25 |
| EmilienM | https://ci.centos.org/view/rdo/view/tripleo-gate/job/tripleo-quickstart-thirdparty-gate-master/19/console | 18:25 |
| * weshay looks | 18:25 | |
| *** david-lyle_ has quit IRC | 18:25 | |
| *** bootsha has joined #tripleo | 18:26 | |
| weshay | EmilienM, "Message: No valid host was found. | 18:26 |
| EmilienM | weshay: it's not related to my patch I guess | 18:26 |
| *** lblanchard has quit IRC | 18:27 | |
| EmilienM | what is the state of the job? I see last success, 2 days ago | 18:27 |
| EmilienM | weshay: should it work? | 18:27 |
| EmilienM | can I run rdo-ci-check again? | 18:27 |
| weshay | EmilienM, it worked against https://review.openstack.org/#/c/336442/ | 18:27 |
| weshay | EmilienM, ya man | 18:27 |
| weshay | EmilienM, we can have adarazs help out when he's back from pto | 18:28 |
| EmilienM | ok | 18:28 |
| weshay | I think trown|outtypewww was concerned about that patch | 18:28 |
| EmilienM | right that's why we are blocking it :) | 18:31 |
| weshay | EmilienM, can you look at https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-thirdparty-gate-master-19/undercloud/var/log/yum.log.gz | 18:32 |
| weshay | and see if it looks like the right packages were built for that change | 18:32 |
| *** hewbrocca is now known as hewbrocca-afk | 18:33 | |
| EmilienM | weshay: yes it is | 18:33 |
| *** paramite|afk is now known as paramite | 18:34 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - test undercloud deploy only https://review.openstack.org/346147 | 18:38 |
| *** athomas has quit IRC | 18:38 | |
| slagle | EmilienM: https://storyboard.openstack.org/#!/board/35 | 18:38 |
| slagle | we are so agile | 18:39 |
| * slagle bobs and weaves | 18:39 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: use jinja to update ironic vs. ansible https://review.openstack.org/346168 | 18:39 |
| EmilienM | slagle: don't tell alexis | 18:40 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui: Add visual indicator that a deploy was requested https://review.openstack.org/339120 | 18:42 |
| weshay | beat me to it .. lolz | 18:43 |
| *** paramite has quit IRC | 18:44 | |
| *** lblanchard has joined #tripleo | 18:44 | |
| slagle | weshay: https://ci.centos.org/job/tripleo-quickstart-promote-master-delorean-minimal/387/console is already passed node registration i guess? | 18:45 |
| slagle | can't tell where that happens | 18:45 |
| weshay | I hope so | 18:45 |
| weshay | it's in undercloud-post.. you can't see it until you get the logs | 18:45 |
| slagle | ok | 18:46 |
| weshay | \0/ | 18:46 |
| weshay | slagle, you probably want to review https://review.openstack.org/#/c/345559/ as well | 18:47 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: use jinja to update ironic vs. ansible https://review.openstack.org/346168 | 18:47 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: use jinja to update ironic vs. ansible https://review.openstack.org/346168 | 18:48 |
| slagle | weshay: ok, do we not already get /var/log/journal anyway? | 18:48 |
| weshay | slagle, we do get the journal info from /var/log.. ya | 18:49 |
| weshay | I can remove that.. but def. looking for any additional debug info we can get when it fails | 18:49 |
| slagle | oh it's fine i guess if that makes it easier for folks | 18:50 |
| slagle | inspector should really be configured to create log files | 18:50 |
| slagle | like every other openstack service | 18:50 |
| weshay | ya.. if people want that out.. that's fine | 18:50 |
| *** Goneri has quit IRC | 18:51 | |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Deploy undercloud in 1 step instead of 2 https://review.openstack.org/346124 | 18:55 |
| *** bootsha has quit IRC | 18:56 | |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Deploy undercloud in 1 step instead of 2 https://review.openstack.org/346124 | 18:57 |
| *** Goneri has joined #tripleo | 18:57 | |
| dmsimard | slagle, weshay, hewbrocca-afk: everything green except quickstart: https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/515/ | 19:08 |
| weshay | slagle, dmsimard hewbrocca-afk well.. they're not done yet :) | 19:09 |
| dmsimard | weshay: I didn't say it was red | 19:10 |
| dmsimard | :) | 19:10 |
| weshay | :) | 19:10 |
| *** r-mibu has quit IRC | 19:13 | |
| *** r-mibu has joined #tripleo | 19:13 | |
| *** paramite has joined #tripleo | 19:20 | |
| *** eggmaster has joined #tripleo | 19:21 | |
| *** jubapa has joined #tripleo | 19:26 | |
| slagle | weshay: it failed | 19:30 |
| weshay | https://bugs.launchpad.net/tripleo/+bug/1605744 | 19:31 |
| openstack | Launchpad bug 1605744 in tripleo "openstack-swift-container.service fail to start on newton master" [Undecided,New] | 19:31 |
| slagle | weshay: swift isn't installed | 19:31 |
| weshay | sec.. chatting in #rdo about it | 19:31 |
| openstackgerrit | Elise Gafford proposed openstack/tripleo-puppet-elements: Updating .gitreview for stable/mitaka https://review.openstack.org/346212 | 19:32 |
| openstackgerrit | Elise Gafford proposed openstack/tripleo-puppet-elements: Installing openstack-sahara-ui https://review.openstack.org/346213 | 19:32 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Delete ping test environment in periodic jobs https://review.openstack.org/346134 | 19:34 |
| EmilienM | beekneemech, slagle: so I managed to deploy an undercloud only https://review.openstack.org/#/c/346147/ | 19:34 |
| EmilienM | but what worries me is that there is no "ping test" | 19:34 |
| EmilienM | in regular jobs, deploying an overcloud is the kind of pingtest | 19:35 |
| EmilienM | but now we don't deploy overcloud, we need something that test nova/neutron/heat etc | 19:35 |
| *** saneax_AFK is now known as saneax | 19:35 | |
| beekneemech | EmilienM: That's why I made calls against all of the services at the end of my upgrade job. | 19:35 |
| beekneemech | It's not great, but at least it verifies they're running and responding to requests. | 19:35 |
| EmilienM | beekneemech: in http://paste.openstack.org/show/539828/ ? | 19:36 |
| beekneemech | I'm not sure what we can do beyond that. | 19:36 |
| EmilienM | beekneemech: deploy a small stack like you did with pingtest? | 19:36 |
| beekneemech | EmilienM: Yeah. | 19:36 |
| beekneemech | EmilienM: We can't. You need baremetal nodes to deploy a stack from the undercloud. | 19:36 |
| beekneemech | You might be able to set Nova to the fake driver and deploy something that way, I suppose. | 19:36 |
| EmilienM | ah ok | 19:37 |
| EmilienM | cool I can iterate by having your checks | 19:37 |
| beekneemech | EmilienM: Yeah, we could formalize those checks to actually look at the output to verify everything we expect is there. | 19:37 |
| beekneemech | I was verifying everything by hand in my local job so I just eyeballed it. | 19:38 |
| EmilienM | ok | 19:38 |
| beekneemech | EmilienM: Actually, I wonder if we could run the Tempest API tests at the end of the undercloud install. | 19:39 |
| EmilienM | slagle: fyi I'm going to create a new experimental job for undercloud-only | 19:39 |
| *** jubapa has quit IRC | 19:40 | |
| weshay | we have that :) | 19:40 |
| * weshay runs | 19:40 | |
| EmilienM | weshay: where? | 19:40 |
| weshay | EmilienM, contact hrybacki | 19:40 |
| EmilienM | weshay: where? | 19:41 |
| EmilienM | I'm asking where is the job ;-) | 19:41 |
| EmilienM | I'm going to make it in OpenStack Infra | 19:41 |
| slagle | EmilienM: it's not in openstack ci, so just go ahead and add it | 19:41 |
| weshay | not sure if hrybacki has a job.. but he built out tempest to run against the undercloud for ironic | 19:41 |
| EmilienM | slagle: ack, thx | 19:41 |
| hrybacki | weshay: EmilienM lemme go digging for a patch | 19:42 |
| EmilienM | hrybacki: I already did the patch https://review.openstack.org/#/c/346147/ | 19:42 |
| EmilienM | now I'm doing the project-config patch | 19:42 |
| slagle | weshay: so the swift rdo promote problem. it must be in how quickstart is building images i guess | 19:45 |
| weshay | yup | 19:46 |
| slagle | i moved the bug to tripleo-quickstart | 19:48 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - test undercloud deploy only https://review.openstack.org/346147 | 19:49 |
| EmilienM | beekneemech: with sanity ^ | 19:49 |
| openstackgerrit | Elise Gafford proposed openstack/tripleo-puppet-elements: Installing openstack-sahara-ui https://review.openstack.org/346213 | 19:49 |
| EmilienM | beekneemech, slagle: https://review.openstack.org/346220 | 19:53 |
| EmilienM | beekneemech, slagle : feel free to change name | 19:54 |
| *** florianf has quit IRC | 19:58 | |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Deploy undercloud in 1 step instead of 2 https://review.openstack.org/346124 | 20:09 |
| *** lblanchard has quit IRC | 20:16 | |
| *** mgould is now known as mgould|afk | 20:16 | |
| EmilienM | slagle: I am wondering if yes/no running a single-node job would work out of the box with our current tripleo-ci scripts | 20:16 |
| EmilienM | you might know since you did multinode | 20:16 |
| slagle | EmilienM: no, it's going to need a few changes probably | 20:18 |
| slagle | you dont need multinode for just the undercloud install | 20:19 |
| EmilienM | right | 20:19 |
| EmilienM | slagle: see https://review.openstack.org/#/c/346220/1/jenkins/jobs/projects.yaml | 20:19 |
| slagle | EmilienM: yea, that's going to take some changes to toci_gate_test | 20:22 |
| EmilienM | cool /me looking at it | 20:22 |
| slagle | EmilienM: and you can probably just copy toci_instack_multinode.sh to a new toci_instack_undercloud.sh | 20:22 |
| slagle | and call that | 20:22 |
| slagle | if you find anything common to refactor out, you could have a go at that too | 20:23 |
| *** david-lyle_ has joined #tripleo | 20:23 | |
| EmilienM | slagle: I was about doing it, cool | 20:24 |
| *** yolanda has quit IRC | 20:25 | |
| *** david-lyle_ has quit IRC | 20:28 | |
| *** timothyb89 has quit IRC | 20:33 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: Don't kill zuul-console service https://review.openstack.org/346228 | 20:35 |
| *** timothyb89 has joined #tripleo | 20:35 | |
| pabelanger | we can land that any time^ | 20:35 |
| pabelanger | zuul-console is using tcp/19885 now | 20:35 |
| pabelanger | the last 2 zuul-launchers are shutting down for restart | 20:36 |
| slagle | cool, lgtm | 20:36 |
| EmilienM | same, i'll wait for CI results and approve it | 20:39 |
| *** yolanda has joined #tripleo | 20:41 | |
| *** fultonj has quit IRC | 20:43 | |
| openstackgerrit | Merged openstack/instack-undercloud: Flush puppet output piped to awk https://review.openstack.org/346021 | 20:44 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Allow toci_instack_multinode.sh to run single node https://review.openstack.org/346230 | 20:45 |
| EmilienM | slagle: too lazy to duplicate scripts :P | 20:45 |
| EmilienM | I'll save this time for the tatoo | 20:46 |
| EmilienM | slagle: thoughts on jobname? https://review.openstack.org/#/c/346220/ so we can go ahead | 20:47 |
| *** dbecker has joined #tripleo | 20:47 | |
| slagle | EmilienM: yea, let's just go with "undercloud" | 20:47 |
| EmilienM | oki | 20:47 |
| *** dbecker_ has quit IRC | 20:49 | |
| *** cdearborn has quit IRC | 20:51 | |
| slagle | EmilienM: since that is nv, we could put it straight into the check queue | 20:57 |
| slagle | but either way works for me | 20:57 |
| EmilienM | slagle: mhh it's going to consume openstack-infra nodes | 20:58 |
| EmilienM | slagle: while I'm uncertain I can make it work in short time | 20:59 |
| slagle | k, wfm | 20:59 |
| EmilienM | I prefer taking my time to make it work & stable and then move it | 20:59 |
| EmilienM | so we save infra resources | 20:59 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: use jinja to update ironic vs. ansible https://review.openstack.org/346168 | 21:01 |
| *** kbyrne has quit IRC | 21:07 | |
| *** kbyrne has joined #tripleo | 21:11 | |
| pabelanger | EmilienM: I like the job, especially if it is running on all the clouds | 21:11 |
| EmilienM | pabelanger: it will | 21:14 |
| EmilienM | pabelanger: feel free to review https://review.openstack.org/#/c/346220/ :) | 21:15 |
| *** bootsha has joined #tripleo | 21:16 | |
| EmilienM | slagle: I might need your help or Ben probably, to move the templates out from tripleo-ci to THT. After the discussion on the ML I realized it's more complex that I expected and I'm not sure I can do it quickly | 21:18 |
| EmilienM | slagle: there is one thing I would like to investigate when this move is done, is creating some deployment scenarios in our CI, a bit like I did in Puppet CI https://github.com/openstack/puppet-openstack-integration#description | 21:20 |
| *** bootsha has quit IRC | 21:24 | |
| *** dprince has quit IRC | 21:26 | |
| *** jdob has quit IRC | 21:26 | |
| *** jeckersb is now known as jeckersb_gone | 21:29 | |
| *** ayoung has quit IRC | 21:39 | |
| *** yamahata has quit IRC | 21:40 | |
| *** cdearborn has joined #tripleo | 21:44 | |
| *** ccamacho has quit IRC | 21:44 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: use jinja to update ironic vs. ansible https://review.openstack.org/346168 | 21:44 |
| *** weshay is now known as weshay_afk | 21:45 | |
| *** rlandy has quit IRC | 21:47 | |
| *** hewbrocca-afk is now known as hewbrocca | 21:48 | |
| slagle | EmilienM: yea, that'd be good. | 21:49 |
| EmilienM | https://review.openstack.org/#/c/346230/ is ready to review if you want to look | 21:50 |
| *** shardy has quit IRC | 21:50 | |
| *** mbound has quit IRC | 21:53 | |
| *** yamahata has joined #tripleo | 21:54 | |
| *** dbecker has quit IRC | 21:58 | |
| *** radek_ has quit IRC | 21:59 | |
| *** cdearborn has quit IRC | 22:01 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - test undercloud deploy only https://review.openstack.org/346147 | 22:04 |
| EmilienM | slagle, beekneemech: I got undercloud deployed in one step :) | 22:06 |
| EmilienM | https://review.openstack.org/#/c/346124/ | 22:06 |
| *** jcoufal has quit IRC | 22:06 | |
| *** paramite has quit IRC | 22:08 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-common: Add support to image build yaml input to handle env vars https://review.openstack.org/318087 | 22:18 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: WIP: run neutron-db-sync at every puppet run https://review.openstack.org/346138 | 22:18 |
| *** Goneri has quit IRC | 22:21 | |
| *** jayg is now known as jayg|g0n3 | 22:22 | |
| *** david-lyle_ has joined #tripleo | 22:25 | |
| *** david-lyle_ has quit IRC | 22:29 | |
| openstackgerrit | Merged openstack/tripleo-puppet-elements: Updating .gitreview for stable/mitaka https://review.openstack.org/346212 | 22:29 |
| *** Goneri has joined #tripleo | 22:32 | |
| *** dtrainor_ has joined #tripleo | 22:35 | |
| *** jcoufal has joined #tripleo | 22:39 | |
| *** cdearborn has joined #tripleo | 22:45 | |
| *** mbound has joined #tripleo | 22:53 | |
| *** akshai has quit IRC | 22:57 | |
| *** mbound has quit IRC | 22:58 | |
| *** Ryjedo has quit IRC | 23:04 | |
| *** apetrich has quit IRC | 23:08 | |
| *** apetrich has joined #tripleo | 23:09 | |
| *** jcoufal_ has joined #tripleo | 23:12 | |
| *** jcoufal has quit IRC | 23:13 | |
| *** julim has quit IRC | 23:15 | |
| *** cdearborn has quit IRC | 23:18 | |
| *** Goneri has quit IRC | 23:25 | |
| *** fzdarsky has quit IRC | 23:26 | |
| *** jcoufal_ has quit IRC | 23:26 | |
| *** hewbrocca is now known as hewbrocca-afk | 23:27 | |
| *** jcoufal has joined #tripleo | 23:29 | |
| *** jcoufal has quit IRC | 23:34 | |
| *** jcoufal has joined #tripleo | 23:35 | |
| *** jcoufal has quit IRC | 23:40 | |
| *** rajinir has quit IRC | 23:45 | |
| *** jcoufal has joined #tripleo | 23:50 | |
| *** jcoufal has quit IRC | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!