| *** r-mibu has joined #tripleo | 00:05 | |
| *** xinwu has joined #tripleo | 00:06 | |
| *** rdo has joined #tripleo | 00:07 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
|---|---|---|
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1582115 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1582115 in tripleo "Periodic jobs fail, because there is no instack.qcow2 image" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 00:10 |
| *** mbound has joined #tripleo | 00:15 | |
| *** penick has joined #tripleo | 00:18 | |
| *** mbound has quit IRC | 00:19 | |
| *** saneax is now known as saneax_AFK | 00:32 | |
| *** rhallisey has joined #tripleo | 00:42 | |
| *** xinwu has quit IRC | 01:09 | |
| openstackgerrit | Merged openstack/diskimage-builder: Revert "Revert "Properly fail/trap in eval_run_d"" and fix PIPESTATUS https://review.openstack.org/317137 | 01:09 |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1582115 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1582115 in tripleo "Periodic jobs fail, because there is no instack.qcow2 image" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 01:10 |
| *** ccamacho has quit IRC | 01:39 | |
| *** rhallisey has quit IRC | 01:41 | |
| *** ccamacho has joined #tripleo | 01:42 | |
| *** MaxPC has quit IRC | 01:53 | |
| *** shivrao has quit IRC | 01:57 | |
| *** xinwu has joined #tripleo | 02:04 | |
| *** yamahata has quit IRC | 02:07 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1582115 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1582115 in tripleo "Periodic jobs fail, because there is no instack.qcow2 image" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 02:10 |
| *** penick has quit IRC | 02:13 | |
| *** coolsvap|zzzzzzz has quit IRC | 02:14 | |
| * larsks wonders if anybody is home. | 02:15 | |
| larsks | My swift-proxy service is failing during the undercloud install with: IOError: [Errno 2] No such file or directory: '/etc/swift/container.ring.gz' | 02:15 |
| larsks | But by the time I log in and check , that file exists. Looks like some sort of race condition? | 02:15 |
| *** MaxPC has joined #tripleo | 02:22 | |
| *** MaxPC has quit IRC | 02:26 | |
| EmilienM | larsks: can you paste puppet catalog log? | 02:27 |
| larsks | Sure...which is that? | 02:27 |
| larsks | EmilienM: ^^^^ | 02:28 |
| larsks | If it helps, this is journalctl from the system: http://chunk.io/f/81bcdba23d6f4cbd9bc17f1d2cd8d300 | 02:28 |
| EmilienM | larsks: puppet apply --detailed-exitcodes /etc/puppet/manifests/puppet-stack-config.pp | 02:28 |
| larsks | EmilienM: Huh. If I run that right now, it's going to work just fine. | 02:29 |
| larsks | Because by the time I log in to look, the container.ring.gz file has been created. | 02:29 |
| larsks | And I can manually start the swift services without a problem. | 02:29 |
| larsks | It turns out that someone hit identical symptoms in https://bugzilla.redhat.com/show_bug.cgi?id=1319795 | 02:30 |
| openstack | bugzilla.redhat.com bug 1319795 in rhel-osp-director "Swift services fail to start on director install" [Unspecified,New] - Assigned to athomas | 02:30 |
| larsks | (Although I am running RDO Mitaka) | 02:30 |
| EmilienM | ok I'll look later, breakfast time | 02:30 |
| larsks | Sure, bed time here :) | 02:30 |
| EmilienM | good night | 02:30 |
| *** yamahata has joined #tripleo | 02:37 | |
| *** yamahata has quit IRC | 02:38 | |
| *** yamahata has joined #tripleo | 02:39 | |
| *** coolsvap has joined #tripleo | 02:49 | |
| jrist | EmilienM: ! how is France? | 02:50 |
| EmilienM | jrist: very frenc | 02:50 |
| EmilienM | jrist: very french | 02:50 |
| jrist | :) | 02:50 |
| jrist | I miss France | 02:50 |
| EmilienM | ahaha | 02:50 |
| EmilienM | I missed it too | 02:51 |
| jrist | j'adore France | 02:51 |
| jrist | ;) | 02:51 |
| EmilienM | ahah | 02:55 |
| EmilienM | larsks: ok I think I might have found the race | 02:55 |
| *** dmacpher is now known as dmacpher-afk | 02:55 | |
| EmilienM | https://github.com/openstack/puppet-swift/blob/master/manifests/init.pp#L109 <-- swift.conf is created after /etc/swift dir | 02:56 |
| EmilienM | oh wait no | 02:56 |
| EmilienM | we have this https://github.com/openstack/puppet-swift/blob/master/manifests/storage/server.pp#L186 | 02:56 |
| larsks | ...but the missing file here is container.ring.gz, not the config file... | 02:57 |
| EmilienM | larsks: right | 02:58 |
| EmilienM | I'm trying to see why the file was not here | 02:59 |
| *** MaxPC has joined #tripleo | 02:59 | |
| EmilienM | the swift proxy must starts before rings gets created | 03:00 |
| *** yamahata has quit IRC | 03:00 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-cloud-config: Updated from global requirements https://review.openstack.org/313748 | 03:01 |
| larsks | I'm not seeing any dependencies between the swift services and that file (or anything that claims to provide that file). | 03:01 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-collect-config: Updated from global requirements https://review.openstack.org/317184 | 03:01 |
| EmilienM | larsks: right | 03:02 |
| EmilienM | larsks: can I break the system? trying to see if I can reproduce | 03:04 |
| larsks | Yeah, feel free to do anything! | 03:04 |
| EmilienM | larsks: it looks good no? | 03:08 |
| EmilienM | I needed one single puppet run | 03:08 |
| EmilienM | larsks: I'm going to try again without my patch, to make sure it fails | 03:08 |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1582115 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1582115 in tripleo "Periodic jobs fail, because there is no instack.qcow2 image" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 03:10 |
| *** ChrisHP has joined #tripleo | 03:10 | |
| *** ChrisHP has quit IRC | 03:11 | |
| EmilienM | larsks: yeah ! | 03:13 |
| EmilienM | I reproduced | 03:13 |
| EmilienM | so my fix works | 03:13 |
| larsks | Yay! :) | 03:13 |
| EmilienM | let's try again just to tripleo confirm | 03:13 |
| EmilienM | I'll submit a patch, because I'm not sure we need to fix that in instack | 03:14 |
| EmilienM | maybe I can hack somethign in puppet-swit | 03:14 |
| EmilienM | sorry I don't know how to write at 5.14 am | 03:14 |
| EmilienM | mhh, I looked at puppet swift, I think we'll fix it in instack | 03:16 |
| EmilienM | larsks: ok, beside the heat issue, all is fine | 03:17 |
| EmilienM | larsks: thanks for reporting the issue | 03:17 |
| EmilienM | I'm preparing a patch upstream now | 03:17 |
| larsks | Hey, thanks for looking at it. Send me a link to the patch? | 03:17 |
| EmilienM | larsks: sure, let me finish it | 03:17 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: puppet-stack-config: notify swift-proxy when ring is ready https://review.openstack.org/317206 | 03:21 |
| EmilienM | larsks: ^ | 03:21 |
| larsks | Thanks again! | 03:22 |
| EmilienM | my pleasure to help this time | 03:22 |
| *** links has joined #tripleo | 03:31 | |
| *** MaxPC has quit IRC | 03:36 | |
| *** yamahata has joined #tripleo | 03:37 | |
| *** noslzzp has quit IRC | 03:39 | |
| *** dmacpher-afk is now known as dmacpher | 03:52 | |
| *** yamahata has quit IRC | 03:55 | |
| *** yamahata has joined #tripleo | 03:55 | |
| *** tzumainn has quit IRC | 03:57 | |
| *** stendulker has joined #tripleo | 04:02 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1582115 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1582115 in tripleo "Periodic jobs fail, because there is no instack.qcow2 image" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 04:10 |
| *** anshul has joined #tripleo | 04:13 | |
| *** anshul is now known as Guest72844 | 04:13 | |
| *** masco has joined #tripleo | 04:18 | |
| *** Guest72844 has quit IRC | 04:20 | |
| *** oshvartz has quit IRC | 04:27 | |
| *** Guest72844 has joined #tripleo | 04:35 | |
| *** shivrao has joined #tripleo | 04:42 | |
| *** shivrao_ has joined #tripleo | 04:44 | |
| *** shivrao has quit IRC | 04:47 | |
| *** shivrao_ is now known as shivrao | 04:47 | |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui: Updated packages to the latest stable. https://review.openstack.org/317245 | 04:48 |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui: Fix the small × close icons on plan modals https://review.openstack.org/317247 | 04:55 |
| *** fragatina has quit IRC | 04:56 | |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui: [WIP] Status Page UI - work in progress https://review.openstack.org/310670 | 05:02 |
| *** jcoufal has joined #tripleo | 05:04 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1582115 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1582115 in tripleo "Periodic jobs fail, because there is no instack.qcow2 image" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 05:10 |
| *** mdnadeem_ has joined #tripleo | 05:36 | |
| *** mdnadeem has quit IRC | 05:39 | |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui: Refactor notification for better display https://review.openstack.org/316874 | 05:41 |
| *** jaosorior has joined #tripleo | 05:43 | |
| *** shivrao has quit IRC | 05:43 | |
| openstackgerrit | Qasim Sarfraz proposed openstack/puppet-tripleo: add plumgrid neutron profile https://review.openstack.org/317259 | 05:44 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: [WIP] Add PS4 to show file/function/line https://review.openstack.org/317260 | 05:44 |
| *** shivrao has joined #tripleo | 05:45 | |
| *** shivrao_ has joined #tripleo | 05:47 | |
| *** shivrao has quit IRC | 05:48 | |
| *** shivrao_ has quit IRC | 05:48 | |
| *** ramishra has quit IRC | 05:49 | |
| *** shivrao has joined #tripleo | 05:50 | |
| *** ramishra has joined #tripleo | 05:50 | |
| *** rlandy has quit IRC | 05:53 | |
| *** fragatina has joined #tripleo | 05:53 | |
| *** fragatina has quit IRC | 05:53 | |
| *** fragatina has joined #tripleo | 05:54 | |
| *** tremble has joined #tripleo | 05:57 | |
| *** oshvartz has joined #tripleo | 05:58 | |
| *** rcernin has joined #tripleo | 06:02 | |
| *** liverpooler has quit IRC | 06:04 | |
| *** liverpooler has joined #tripleo | 06:04 | |
| *** rasca has quit IRC | 06:05 | |
| *** nijaba has quit IRC | 06:07 | |
| *** rasca has joined #tripleo | 06:08 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1582115 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1582115 in tripleo "Periodic jobs fail, because there is no instack.qcow2 image" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 06:10 |
| *** rcernin has quit IRC | 06:18 | |
| *** rcernin has joined #tripleo | 06:21 | |
| *** jprovazn has joined #tripleo | 06:38 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: [WIP] Add PS4 to show file/function/line https://review.openstack.org/317260 | 06:39 |
| *** apetrich_ has joined #tripleo | 06:45 | |
| *** apetrich_ has quit IRC | 06:48 | |
| *** apetrich has joined #tripleo | 06:48 | |
| ccamacho | Morning!!! | 06:48 |
| *** jtomasek_ has quit IRC | 06:50 | |
| jaosorior | ccamacho sup duded | 06:52 |
| jaosorior | *dude | 06:53 |
| *** mcornea has joined #tripleo | 06:54 | |
| jaosorior | bummer, CI seems to be failing with this too now https://bugs.launchpad.net/tripleo/+bug/1582556 | 06:55 |
| openstack | Launchpad bug 1582556 in tripleo "CI is failing due to invalid property 'timeout'" [High,Confirmed] | 06:55 |
| *** jaosorior has quit IRC | 06:56 | |
| *** jaosorior has joined #tripleo | 06:57 | |
| *** cmyster has quit IRC | 06:58 | |
| *** florianf has joined #tripleo | 06:58 | |
| jaosorior | This seems suspicious though https://review.openstack.org/#/c/295992/14 | 06:59 |
| *** zoli_gone-proxy is now known as zoliXXL | 07:00 | |
| *** bvandenh has joined #tripleo | 07:00 | |
| zoliXXL | good morning | 07:02 |
| openstackgerrit | Martin André proposed openstack/instack-undercloud: Validation to detect if undercloud disks use 512e https://review.openstack.org/316523 | 07:03 |
| openstackgerrit | Martin André proposed openstack/instack-undercloud: TripleO Ansible validations https://review.openstack.org/316522 | 07:03 |
| *** jtomasek_ has joined #tripleo | 07:05 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1582115 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1582115 in tripleo "Periodic jobs fail, because there is no instack.qcow2 image" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 07:10 |
| *** devvesa has joined #tripleo | 07:12 | |
| *** devvesa has quit IRC | 07:12 | |
| *** devvesa has joined #tripleo | 07:12 | |
| *** jtomasek_ has quit IRC | 07:12 | |
| *** dciabrin has joined #tripleo | 07:13 | |
| *** dsariel has joined #tripleo | 07:18 | |
| *** ebarrera has joined #tripleo | 07:21 | |
| openstackgerrit | Martin André proposed openstack/instack-undercloud: Validation to detect if undercloud disks use 512e https://review.openstack.org/316523 | 07:22 |
| openstackgerrit | Martin André proposed openstack/instack-undercloud: TripleO Ansible validations https://review.openstack.org/316522 | 07:22 |
| *** saneax_AFK is now known as saneax | 07:24 | |
| *** paramite has joined #tripleo | 07:30 | |
| *** mikelk has joined #tripleo | 07:30 | |
| *** ifarkas has joined #tripleo | 07:32 | |
| openstackgerrit | Martin André proposed openstack/instack-undercloud: Validation to detect if undercloud disks use 512e https://review.openstack.org/316523 | 07:32 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: TESTING HEAT BUG FIX - DO NOT MERGE https://review.openstack.org/317287 | 07:32 |
| *** aufi has joined #tripleo | 07:35 | |
| *** cmyster has joined #tripleo | 07:46 | |
| *** nijaba has joined #tripleo | 07:46 | |
| *** nijaba has quit IRC | 07:46 | |
| *** nijaba has joined #tripleo | 07:46 | |
| *** gfidente has joined #tripleo | 07:54 | |
| *** liverpooler has quit IRC | 08:01 | |
| *** liverpooler has joined #tripleo | 08:01 | |
| *** shardy has joined #tripleo | 08:03 | |
| *** absubram has joined #tripleo | 08:03 | |
| *** jtomasek has joined #tripleo | 08:04 | |
| *** ohamada has joined #tripleo | 08:04 | |
| *** zoliXXL is now known as zoli|afk | 08:04 | |
| *** shivrao has quit IRC | 08:06 | |
| *** shivrao has joined #tripleo | 08:06 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1582115 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1582115 in tripleo "Periodic jobs fail, because there is no instack.qcow2 image" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 08:10 |
| *** dmk0202 has joined #tripleo | 08:12 | |
| *** devvesa has quit IRC | 08:13 | |
| *** bvandenh has quit IRC | 08:17 | |
| *** bvandenh has joined #tripleo | 08:18 | |
| *** jistr has joined #tripleo | 08:19 | |
| *** devvesa has joined #tripleo | 08:26 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Composable roles within services - MongoDB https://review.openstack.org/315051 | 08:26 |
| *** shivrao has quit IRC | 08:30 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Composable roles within services - MongoDB https://review.openstack.org/315051 | 08:30 |
| *** chem has joined #tripleo | 08:32 | |
| *** xinwu has quit IRC | 08:33 | |
| *** derekh has joined #tripleo | 08:39 | |
| derekh | master broken again? | 08:41 |
| *** mgould has joined #tripleo | 08:41 | |
| shardy | <facepalm> | 08:41 |
| derekh | 2016-05-17 05:09:14.269 | d5b08a9d-f795-4548-9303-f0c90459f40b: Introspection timeout | 08:41 |
| derekh | nope, thats not it, looks like this is the error | 08:44 |
| derekh | 2016-05-17 07:47:29.728 | 2016-05-17 07:47:23 [overcloud-Controller-zxzf7tujvhjt]: CREATE_FAILED Resource CREATE failed: KeyError: resources[0].resources.NetworkDeployment: u'Invalid Property timeout' | 08:44 |
| *** jcoufal has quit IRC | 08:44 | |
| shardy | https://github.com/openstack/heat/commit/6bd9cb4f99faae7b7f753ae916f1ff4aac99a447 | 08:44 |
| shardy | that landed support for deployment timeouts a few hours ago, related? | 08:45 |
| shardy | I assume t-h-t doesn't use that interface yet, but it should be optional | 08:45 |
| *** akrivoka has joined #tripleo | 08:47 | |
| jaosorior | shardy: I submitted a patch for that | 08:48 |
| *** shivrao has joined #tripleo | 08:48 | |
| jaosorior | shardy, derekh: https://review.openstack.org/#/c/317292/ | 08:48 |
| jaosorior | problem was that the patch in heat didn't take into account StructuredDeployment's | 08:48 |
| jaosorior | derekh, shardy: Here's the launchpad bug https://bugs.launchpad.net/heat/+bug/1582556 | 08:49 |
| openstack | Launchpad bug 1582556 in heat "CI is failing due to invalid property 'timeout'" [High,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 08:49 |
| shardy | jaosorior: thanks | 08:49 |
| jaosorior | it was initially filed for tripleo but later switched to heat | 08:49 |
| shardy | didn't we revert the pull-master-heat change from tripleo-ci? | 08:50 |
| jaosorior | anyway, the fix should be merging soon | 08:50 |
| * shardy checks | 08:50 | |
| derekh | jaosorior: great, looks like it still in a zull queue so we gotta wait | 08:50 |
| derekh | shardy: the revert hasn't landed, we're still using master of heat | 08:51 |
| derekh | shardy: https://review.openstack.org/#/c/309051/ | 08:51 |
| shardy | derekh: ack, thanks I just spotted that | 08:51 |
| derekh | shardy: we should be able to just wait for the heat revert to land, then later when bnemec is online we can see where we are with removing heat from the master whitelist | 08:52 |
| shardy | derekh: +1 - I'm not sure re the delete issues, I thought that was fixed some time ago | 08:53 |
| derekh | shardy: I'm not either | 08:53 |
| *** chem` has joined #tripleo | 08:55 | |
| *** chem has quit IRC | 08:57 | |
| *** shivrao has quit IRC | 09:02 | |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1582115 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1582115 in tripleo "Periodic jobs fail, because there is no instack.qcow2 image" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 09:10 |
| EmilienM | shardy: don't we have tripleo jobs on heat CI ? https://review.openstack.org/#/c/295992/ | 09:11 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Composable roles within services - MongoDB https://review.openstack.org/315051 | 09:11 |
| *** hdsdman has joined #tripleo | 09:12 | |
| hdsdman | any examples available for nic-config with the linux bonding driver? | 09:12 |
| shardy | EmilienM: we do, but it's an experimental job and evidently nobody ran it | 09:12 |
| *** sambetts|afk is now known as sambetts | 09:12 | |
| hdsdman | i got issues with ovs_bond in combination with lacp | 09:13 |
| shardy | EmilienM: we never got to the point of having a regular job, partly because of CI capacity, and partly because if the high rate of false negatives | 09:13 |
| EmilienM | shardy: yeah it makes sense | 09:13 |
| shardy | I try to check experimental when I see a risky change, but lately I've not kept up with heat reviews and this one slipped through | 09:14 |
| *** electrofelix has joined #tripleo | 09:17 | |
| *** olap has joined #tripleo | 09:18 | |
| *** dtantsur|afk is now known as dtantsur | 09:21 | |
| *** sshnaidm has quit IRC | 09:22 | |
| *** zoli|afk is now known as zoli|wfh | 09:23 | |
| panda | derekh: every periodic job has CACHEUPLOAD=1 ? | 09:24 |
| derekh | panda: yes | 09:24 |
| *** coolsvap has quit IRC | 09:27 | |
| *** coolsvap has joined #tripleo | 09:28 | |
| panda | derekh: thanks, I have two more doubts: DIB_INSTALLTYPE_puppet_module is set twice, once in undercloud setup and the other in overcloud setup, but the first time the undercloud image is already DIB created, so I'm not sure what's the effect of that variable. Last (I hope) thing is root/.cache/image-create/source-repositories. What creates this ? DIB ? | 09:29 |
| *** jcoufal has joined #tripleo | 09:30 | |
| EmilienM | shardy: it's ok, we have so much projects, it's impossible to test everything | 09:30 |
| *** dmk0202 has quit IRC | 09:31 | |
| panda | openstack is a doge world, much project, so testing, wow. | 09:32 |
| *** devvesa has quit IRC | 09:34 | |
| shardy | panda: DIB_INSTALLTYPE_puppet_module makes openstack undercloud install pull puppet modules from git source, and the same setting is used when building overcloud images | 09:35 |
| shardy | clearly if you use pre-cached overcloud images, it won't have any effect, but I believe we always run the undercloud install | 09:36 |
| shardy | panda: and yes, source-repositories is a dib element, so that cache data is created by dib | 09:36 |
| panda | shardy: so, openstack undercloud commands are using DIB variables to install additional software in the undercloud ? | 09:37 |
| shardy | panda: yes, there's a toolchain called "instack" which applies DiB elements to the local machine | 09:37 |
| shardy | panda: we're in the process of moving away from that approach tho, see slagle's patches which switches a lot of things from elements to puppet | 09:38 |
| *** akrivoka has quit IRC | 09:39 | |
| panda | shardy: aaah, thanks! | 09:40 |
| *** akrivoka has joined #tripleo | 09:40 | |
| *** dobson has quit IRC | 09:56 | |
| *** yamahata has quit IRC | 10:02 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1582115 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1582115 in tripleo "Periodic jobs fail, because there is no instack.qcow2 image" [Critical,Fix committed] - Assigned to Derek Higgins (derekh) | 10:10 |
| * derekh removed the alert tag for that ^ | 10:10 | |
| *** fragatina has quit IRC | 10:11 | |
| *** fragatina has joined #tripleo | 10:11 | |
| *** sshnaidm has joined #tripleo | 10:14 | |
| *** tosky has joined #tripleo | 10:15 | |
| *** fragatina has quit IRC | 10:16 | |
| EmilienM | shardy: until the revert is merged, can't we pin heat? | 10:17 |
| shardy | EmilienM: the revert is already approved | 10:18 |
| EmilienM | shardy: yeah, but still in check | 10:18 |
| EmilienM | it won't land before 1h, if no error in gate | 10:19 |
| EmilienM | but that's fine, it's lunch break here :P | 10:19 |
| shardy | I don't know why the gate jobs haven't triggered - I just re-approved it | 10:19 |
| shardy | EmilienM: we could just switch back to current-tripleo heat, but bnemec has a patch to tripleo-ci that does that, and he indicated some issues | 10:20 |
| shardy | those are probably fixed, but it would be good to confirm | 10:20 |
| *** saneax is now known as saneax_AFK | 10:20 | |
| EmilienM | shardy: see 317292 in zuul , it's not in gate yet | 10:20 |
| shardy | EmilienM: sigh.. The alternative is to land https://review.openstack.org/#/c/309051/ but we need feedback from bnemec first | 10:23 |
| EmilienM | shardy: last job is almost finished so it moves in gate in a few min | 10:23 |
| EmilienM | shardy: it's ok we can wait 40 more min | 10:24 |
| EmilienM | gate is not so busy atm | 10:24 |
| *** dobson has joined #tripleo | 10:26 | |
| * EmilienM time to eat lunch | 10:26 | |
| *** tremble has quit IRC | 10:30 | |
| *** tremble has joined #tripleo | 10:33 | |
| *** tremble has joined #tripleo | 10:33 | |
| *** athomas has joined #tripleo | 10:34 | |
| sshnaidm | is mistral db-sync failure a known issue today? https://paste.fedoraproject.org/367443/14634812/ | 10:35 |
| shardy | https://github.com/openstack/mistral/commit/ce3b188fc85b6aa1ca6416c161c8df11989fd406 | 10:37 |
| shardy | it seems mistral added designate as a hard requirement | 10:37 |
| shardy | personally I think they should have a failure path that disables the actions when the clients are not found, vs a hard requirement | 10:37 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: WIP: integration of the new puppet pacemaker. https://review.openstack.org/302409 | 10:37 |
| shardy | this is what Heat does for example | 10:37 |
| shardy | but our only option for now is probably to require that new client | 10:38 |
| shardy | sshnaidm: could you raise a bug with steps to reproduce please? | 10:38 |
| *** devvesa has joined #tripleo | 10:38 | |
| *** devvesa has quit IRC | 10:39 | |
| *** devvesa has joined #tripleo | 10:39 | |
| shardy | sshnaidm: it looks like designateclient is packaged, so we can probably just add it to the undercloud install | 10:39 |
| sshnaidm | shardy, it happened in a few last periodic jobs, so I can just link them to the bug. Is it OK? | 10:39 |
| shardy | sshnaidm: Yes, please | 10:39 |
| shardy | also please reference that mistral commit | 10:40 |
| *** dbecker has quit IRC | 10:42 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Remove ControllerClusterConfig from overcloud.yaml https://review.openstack.org/314260 | 10:43 |
| *** dobson has quit IRC | 10:43 | |
| sshnaidm | shardy, https://bugs.launchpad.net/tripleo/+bug/1582651 | 10:44 |
| openstack | Launchpad bug 1582651 in tripleo "Mistral db-sync failure in CI jobs" [Undecided,New] | 10:44 |
| sshnaidm | the bot should report bugs here as it reports patches :) | 10:45 |
| *** jcoufal has quit IRC | 10:48 | |
| *** itamarl has joined #tripleo | 10:54 | |
| *** MaxPC has joined #tripleo | 10:54 | |
| *** dtantsur is now known as dtantsur|bbl | 10:55 | |
| *** dobson has joined #tripleo | 10:55 | |
| sshnaidm | please, take a look at this patch for review: https://review.openstack.org/#/c/314272/ it allows to investigate failures much easier and indexing logs n logstash | 11:03 |
| openstackgerrit | Merged openstack/tripleo-quickstart: Update contributing.md to match reality https://review.openstack.org/314127 | 11:04 |
| *** lucasagomes is now known as lucas-hungry | 11:07 | |
| *** jcoufal has joined #tripleo | 11:09 | |
| EmilienM | the revert in heat should land in ~12 min, and then tripleo CI should be back | 11:10 |
| *** dbecker has joined #tripleo | 11:10 | |
| openstackgerrit | Steven Hardy proposed openstack/instack-undercloud: Add python-designateclient as a mistral required package https://review.openstack.org/317398 | 11:11 |
| shardy | sshnaidm: ^^ | 11:11 |
| shardy | EmilienM: thanks for the update | 11:12 |
| sshnaidm | shardy, thanks | 11:12 |
| shardy | EmilienM: Hey, could you check out ^^ when you get a moment - is the puppet there going to ensure both tripleo-common and designateclient get installed before we run mistral-db-populate? | 11:13 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-tripleo: WIP: integration of the new puppet pacemaker. https://review.openstack.org/309069 | 11:13 |
| *** jistr has quit IRC | 11:24 | |
| *** jcoufal has quit IRC | 11:24 | |
| *** mdnadeem has joined #tripleo | 11:24 | |
| *** athomas has quit IRC | 11:26 | |
| *** rhallisey has joined #tripleo | 11:26 | |
| *** stendulker has quit IRC | 11:26 | |
| *** mdnadeem_ has quit IRC | 11:26 | |
| EmilienM | shardy: imho, it should not be done via Puppet | 11:27 |
| EmilienM | but in packaging | 11:27 |
| EmilienM | mistral should have a requirement on designateclient | 11:27 |
| shardy | EmilienM: as you may see in the comment, this is a temporary workaround | 11:28 |
| EmilienM | shardy: mhh ok either way work | 11:28 |
| shardy | but yes, we could add a package dependency, then remove it later I suppose | 11:28 |
| EmilienM | or keep it | 11:28 |
| EmilienM | we can add this puppet code | 11:28 |
| EmilienM | it's just adding more bits to instack, while this thing is usually managed by packaging | 11:29 |
| shardy | EmilienM: Ok, fair point, I'll see if we can add a dep to the package | 11:29 |
| EmilienM | I'll drop -1, since it's a good workaround though | 11:29 |
| *** mdnadeem has quit IRC | 11:30 | |
| *** mdnadeem has joined #tripleo | 11:30 | |
| EmilienM | shardy: I've +2 if it helps to move forward but I would like to fix it by packaging later | 11:30 |
| EmilienM | shardy: why not using https://github.com/openstack/puppet-designate/blob/master/manifests/client.pp ? | 11:31 |
| EmilienM | mhh, we don't have puppet-designate in tripleo elements, neither in OPM | 11:32 |
| EmilienM | so your patch is valid | 11:32 |
| *** mdnadeem has quit IRC | 11:35 | |
| *** rasca has quit IRC | 11:35 | |
| shardy | EmilienM: I also proposed https://review.gerrithub.io/276918 as an alternative | 11:36 |
| shardy | if that lands I'll abandon the puppet workaround | 11:36 |
| *** rasca has joined #tripleo | 11:38 | |
| EmilienM | shardy: the packages changes need to be submited with https://github.com/rdo-packages/mistral-distgit and git review (it's backed by Software Factory) | 11:39 |
| shardy | EmilienM: I'm confused - are those repos duplicates? | 11:43 |
| shardy | git review against openstack-packages/mistral appears to work.. | 11:43 |
| shardy | Do I now have to re-propose the same patch against the new repo? | 11:44 |
| shardy | apevec has approved it already | 11:44 |
| EmilienM | shardy: nevermind, see on #rdo | 11:44 |
| EmilienM | mistral is not imported in Software Factory zuul :( | 11:44 |
| EmilienM | so your patch is valid | 11:44 |
| *** rhallisey has quit IRC | 11:45 | |
| larsks | EmilienM: hey, I kicked off a quickstart install last night with your patch installed and it completed successfully... | 11:45 |
| EmilienM | larsks: that's a good news | 11:46 |
| EmilienM | larsks: CI was down until now, I'm doing recheck on my patch | 11:46 |
| EmilienM | so we can merge it today maybe | 11:46 |
| *** rhallisey has joined #tripleo | 11:46 | |
| *** tremble has quit IRC | 11:49 | |
| *** dmk0202 has joined #tripleo | 11:52 | |
| *** tremble has joined #tripleo | 11:52 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-docs: Composable roles within services - NTP https://review.openstack.org/311512 | 11:52 |
| *** jistr has joined #tripleo | 12:00 | |
| *** jcoufal has joined #tripleo | 12:02 | |
| *** weshay has joined #tripleo | 12:03 | |
| *** julim has joined #tripleo | 12:05 | |
| *** dprince has joined #tripleo | 12:08 | |
| openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient: Remove the orchestration property from tripleoclient class https://review.openstack.org/308552 | 12:09 |
| *** trown|outtypewww is now known as trown | 12:10 | |
| *** Guest72844 has quit IRC | 12:11 | |
| *** rodrigods has quit IRC | 12:11 | |
| *** rodrigods has joined #tripleo | 12:11 | |
| *** lucas-hungry is now known as lucasagomes | 12:13 | |
| *** sshnaidm has quit IRC | 12:17 | |
| itamarl | Hi gents, I have a quick question about network isolation. Is it possible to deploy an overcloud with both vxlan over the tenant network and also allow for setting up VLAN networks? | 12:19 |
| itamarl | oh, and ladies of course.. how non PC of me! | 12:19 |
| hdsdman | pc principle? :) | 12:20 |
| hdsdman | yeah it is possible | 12:20 |
| hdsdman | i did something similar | 12:20 |
| hdsdman | attach an additional vlan bridge and attach it with a peer port to the integration bridge | 12:20 |
| itamarl | gr8 hdsdman | 12:20 |
| itamarl | can you point me in the right direction? | 12:21 |
| hdsdman | than you can strecht vlan tagged networks over taht bridge into your vm | 12:21 |
| hdsdman | http://docs.openstack.org/liberty/networking-guide/scenario_dvr_ovs.html | 12:22 |
| *** Guest72844 has joined #tripleo | 12:23 | |
| hdsdman | it is a document about DVR but also shows you the vlan bridge principle | 12:23 |
| *** ayoung has quit IRC | 12:23 | |
| hdsdman | http://docs.openstack.org/liberty/networking-guide/_images/scenario-dvr-network2.png | 12:23 |
| *** Guest72844 has quit IRC | 12:24 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Composable role for RabbitMQ https://review.openstack.org/311849 | 12:25 |
| hdsdman | linux_bond driver is not taking the lacp config "mode=4 lacp=slow" | 12:25 |
| hdsdman | what am i doing wrong? | 12:25 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Deploy RabbitMQ as a composable role https://review.openstack.org/311863 | 12:25 |
| *** jayg|g0n3 is now known as jayg | 12:25 | |
| *** rlandy has joined #tripleo | 12:26 | |
| *** aufi has quit IRC | 12:27 | |
| *** tremble has quit IRC | 12:31 | |
| *** sshnaidm has joined #tripleo | 12:33 | |
| *** tremble has joined #tripleo | 12:34 | |
| *** tremble has quit IRC | 12:34 | |
| *** tremble has joined #tripleo | 12:34 | |
| pabelanger | morning | 12:35 |
| pabelanger | any chance we can land: https://review.openstack.org/#/c/316973/ | 12:35 |
| pabelanger | part of the centos-7 migration plan | 12:35 |
| pabelanger | derekh: are you the only person with admin credentials to tripleo-f22-tripleo-test-cloud-rh1? | 12:36 |
| *** thrash has quit IRC | 12:37 | |
| *** fzdarsky has joined #tripleo | 12:40 | |
| panda | shardy: derekh: now that puppet modules are split and updated and gated frequently before creating the packages, is there any reason to keep pulling puppet modules from sources to build the images for master branch ? | 12:42 |
| *** thrash has joined #tripleo | 12:42 | |
| *** thrash has joined #tripleo | 12:42 | |
| *** _prad_ has joined #tripleo | 12:42 | |
| *** dtantsur|bbl is now known as dtantsur | 12:45 | |
| *** akrivoka has quit IRC | 12:45 | |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Adds the base and pacemaker profile for the memcached service https://review.openstack.org/312877 | 12:46 |
| *** akrivoka has joined #tripleo | 12:48 | |
| jdob | jaosorior: ping | 12:48 |
| jaosorior | jdob: pong | 12:48 |
| shardy | panda: no, we're planning to switch master CI over to use the packaged modules | 12:49 |
| jdob | jaosorior: hey, about https://bugs.launchpad.net/heat/+bug/1582556, are you working on it or just the revert? | 12:49 |
| openstack | Launchpad bug 1582556 in heat "CI is failing due to invalid property 'timeout'" [High,Fix released] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 12:49 |
| jaosorior | jdob: It was just the revert | 12:49 |
| jaosorior | not working on it | 12:49 |
| jdob | ok, I'll get on the fix now | 12:49 |
| shardy | pabelanger: derekh, dprince, slagle and perhaps bnemec have credentials I believe | 12:50 |
| *** ohamada has quit IRC | 12:50 | |
| *** jpena is now known as jpena|lunch | 12:51 | |
| pabelanger | shardy: thanks! | 12:52 |
| pabelanger | derekh: dprince: slagle: bnemec: Do one of you mind checking keystone to see what the region is setup as? Or if you have a region configured? | 12:53 |
| dprince | pabelanger: sure, I can. What command output would you line. Endpoint listing? | 12:54 |
| *** Ted has joined #tripleo | 12:54 | |
| dprince | pabelanger: I think everything is regionOne | 12:54 |
| slagle | yea, it's regionOne | 12:55 |
| pabelanger | dprince: not sure the command actually, let me google. | 12:55 |
| slagle | i just checked | 12:55 |
| pabelanger | okay, let me test that | 12:55 |
| slagle | if that's what you're asking for anyway | 12:55 |
| *** Ted has quit IRC | 12:56 | |
| *** jprovazn has quit IRC | 12:56 | |
| *** coolsvap has quit IRC | 12:56 | |
| pabelanger | Great thanks! | 12:57 |
| panda | shardy: ah, thanks ! :) | 12:57 |
| pabelanger | works with shade still | 12:57 |
| openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: Allow import command to set deploy image and local boot https://review.openstack.org/299362 | 12:58 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE Running tests https://review.openstack.org/316436 | 12:59 |
| sshnaidm | gfidente, hi | 13:00 |
| *** fultonj has joined #tripleo | 13:01 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-quickstart: fix network configuration https://review.openstack.org/316264 | 13:01 |
| *** noslzzp has joined #tripleo | 13:02 | |
| *** morazi has joined #tripleo | 13:03 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: Allow import command to set deploy image and local boot https://review.openstack.org/299362 | 13:03 |
| pabelanger | okay, next question, asked this on the ML: we have d1.medium, 4GB, 300GB, 2VCPUs. Do we have the resources to launch one of theses? | 13:07 |
| dprince | pabelanger: you mean like for a mirror? | 13:07 |
| *** Goneri has joined #tripleo | 13:08 | |
| pabelanger | dprince: Right, we don't actually need 300GB, right now other AFS mirror (they are really caches) are only pushing a few GB | 13:08 |
| *** egafford has quit IRC | 13:08 | |
| *** egafford1 has joined #tripleo | 13:08 | |
| dprince | pabelanger: I don't know about the space. I'd have to check. Derekh do you know off hand? | 13:09 |
| *** egafford1 has quit IRC | 13:09 | |
| *** egafford has joined #tripleo | 13:09 | |
| *** egafford has quit IRC | 13:09 | |
| *** egafford1 has joined #tripleo | 13:10 | |
| pabelanger | /dev/mapper/main-afscache 99G 6.4G 92G 7% /var/cache/openafs | 13:10 |
| pabelanger | that's the current volume on mirror.dfw.rax.openstack.org | 13:10 |
| *** noslzzp has quit IRC | 13:11 | |
| *** lblanchard has joined #tripleo | 13:11 | |
| *** rasca has quit IRC | 13:11 | |
| *** noslzzp has joined #tripleo | 13:11 | |
| *** rasca has joined #tripleo | 13:12 | |
| *** zoli|wfh is now known as zoli|lunch | 13:14 | |
| *** egafford1 has quit IRC | 13:14 | |
| EmilienM | shardy: I thought CI would be green after heat revert, but all is red; did I miss somethign? | 13:19 |
| pabelanger | And while were waiting on the HDD space check, could somebody take a moment to read: http://lists.openstack.org/pipermail/openstack-dev/2016-May/095143.html I'm looking for more information about using devstack in the tripleo CI pipeline | 13:20 |
| pabelanger | specifically, why we are installing devstack | 13:20 |
| EmilienM | pabelanger: this is all I know about that: https://github.com/openstack-infra/tripleo-ci/blob/master/docs/TripleO-ci.rst#ci-overcloud-test-sequence | 13:22 |
| EmilienM | pabelanger: point #4 | 13:22 |
| pabelanger | EmilienM: thanks, that is a good start. I would be keep to know the 'Among other things' | 13:23 |
| EmilienM | AFIK tripleo CI uses http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/devstack-vm-gate-wrap.sh | 13:23 |
| EmilienM | which adds a lot of reqs | 13:24 |
| pabelanger | Ya, but I don't see where in toci_gate.sh we are using the local repos | 13:24 |
| *** rasca has quit IRC | 13:26 | |
| *** rasca has joined #tripleo | 13:26 | |
| *** dtantsur has quit IRC | 13:27 | |
| pabelanger | I see toci_instack.sh using tripleo-ci from /opt/stack/new and setting up various other DIB specific paths for puppet modules but I don't see us actually using anything installed by devstack. like keystone, nova or glance on the jenkins slave | 13:28 |
| pabelanger | So, depending on what people say we are using devstack for, I'm going to setup an experimental job to see about using zuul-cloner for some of this | 13:29 |
| bandini | marios, jistr: When doing an overcloud update stack, is the assumption that we will go through all the steps of the ha puppet manifest, a correct assumption? | 13:29 |
| *** athomas has joined #tripleo | 13:29 | |
| *** dtantsur has joined #tripleo | 13:30 | |
| bandini | I have been using that assumption but if I grep through some failed logs of the ci upgrade job, I am not convinced anymore | 13:30 |
| *** athomas has quit IRC | 13:31 | |
| marios | bandini: yes - if you mean a heat stackupdate (the controller post stuff should all happen) | 13:31 |
| jistr | bandini: yeah that is the assumption. can you link the log that doesn't look ok? | 13:31 |
| *** athomas has joined #tripleo | 13:32 | |
| bandini | jistr, marios: http://logs.openstack.org/97/316297/2/check-tripleo/gate-tripleo-ci-f22-upgrades/79d50f5/logs/overcloud-controller-0.tar.xz | 13:32 |
| bandini | I did a grep -E "os-collect-config.*Step" messages | 13:32 |
| bandini | and I see 1,2,3,4,5 and then 3 again | 13:32 |
| *** jobewan has joined #tripleo | 13:32 | |
| *** openstackgerrit has quit IRC | 13:32 | |
| EmilienM | sorry to repeat myself but do we know why tripleo CI is broken now? | 13:33 |
| *** openstackgerrit has joined #tripleo | 13:33 | |
| dprince | EmilienM: I haven't had a chance to look yet. Looks like it started late last night | 13:35 |
| EmilienM | dprince: we reverted a patch in Heat | 13:36 |
| hewbrocca | it was the late-night CI bandit | 13:36 |
| *** jprovazn has joined #tripleo | 13:36 | |
| hewbrocca | again | 13:36 |
| EmilienM | but the revert landed | 13:36 |
| EmilienM | and CI is still broken now | 13:36 |
| *** rain has joined #tripleo | 13:36 | |
| EmilienM | shardy ^ | 13:36 |
| *** links has quit IRC | 13:36 | |
| *** rain is now known as leanderthal | 13:36 | |
| hewbrocca | EmilienM: CI isn't broken -- OpenStack is broken :) | 13:36 |
| derekh | hewbrocca: +1 | 13:37 |
| openstackgerrit | Gonéri Le Bouder proposed openstack/instack-undercloud: ironic: turn on ipxe timeout https://review.openstack.org/294787 | 13:38 |
| derekh | EmilienM: looks like the problem is that the heat package isn't in the trunk repository yet | 13:39 |
| EmilienM | ah ok | 13:39 |
| EmilienM | makes sense then. | 13:39 |
| derekh | EmilienM: you'll have to wait for a new heat package to be build, it will be reported here http://trunk.rdoproject.org/centos7/report.html | 13:40 |
| EmilienM | yeah | 13:41 |
| EmilienM | it's ok, just making sure we don't have something else | 13:41 |
| *** gfidente has quit IRC | 13:43 | |
| *** gfidente^2nd has joined #tripleo | 13:43 | |
| *** gfidente^2nd is now known as gfidente | 13:43 | |
| *** rasca has quit IRC | 13:47 | |
| *** jpena|lunch is now known as jpena | 13:47 | |
| *** rasca has joined #tripleo | 13:48 | |
| jistr | bandini: ah i was wrong, there's an explicit skip for steps 1 and 2 on update, as it used to be that they only performed things that were necessary on the first create. If that's not the case anymore, we'll need to enable them even for update. | 13:50 |
| jistr | bandini: basically we'd remove this line (and same for step 2) https://github.com/openstack/tripleo-heat-templates/blob/aeb9482f4b1ec9d78dc3ac44ee3c0b180cd27574/puppet/controller-post.yaml#L58 | 13:50 |
| jistr | bandini: since the assumption is that puppet is idempotent, i think enabling steps 1 and 2 for updates should be safe to do anytime | 13:52 |
| *** jaosorior has quit IRC | 13:52 | |
| *** ohamada has joined #tripleo | 13:54 | |
| *** tosky has quit IRC | 13:56 | |
| pabelanger | derekh: did you see my question about the d1.medium question? | 13:56 |
| *** myoung|lunch is now known as myoung | 13:57 | |
| bandini | jistr: oh thanks, at least I am not crazy :) | 13:57 |
| bandini | dciabrin: ^ | 13:57 |
| *** tosky has joined #tripleo | 13:58 | |
| derekh | pabelanger: no, looking | 13:58 |
| dciabrin | bandini, damned it :) | 13:58 |
| EmilienM | meeting is about to start folks | 13:59 |
| shardy | meeting time | 14:00 |
| jistr | dciabrin, bandini: i knew about this from before but forgot, it surprised me again :) it makes sense from performance point of view to skip them but if we need to run those steps on updates nowadays as we begin to condense the steps, i think we should enable them. It would also provide a more consistent and expectable behavior for any custom services. | 14:01 |
| derekh | pabelanger: that flavor was created back before we had the SSD's , right now we can launch them but if we ever want to use the SSD's on compute nodes we either need to not use the flavor or use the SSD's as a cache for the spinning disks | 14:01 |
| derekh | pabelanger: I'll reply to your mail later on | 14:01 |
| *** thrash has quit IRC | 14:01 | |
| pabelanger | derekh: okay, please list your recommendation for the HDD space | 14:03 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-docs: Composable roles within services - NTP https://review.openstack.org/311512 | 14:03 |
| derekh | pabelanger: will do | 14:03 |
| shardy | rhallisey, Slower: could you guys join #openstack-meeting-alt please? | 14:05 |
| shardy | we're discussing the containers CI job | 14:05 |
| bandini | jistr: full ack on that | 14:06 |
| *** tzumainn has joined #tripleo | 14:06 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-collect-config: Updated from global requirements https://review.openstack.org/317184 | 14:08 |
| *** thrash has joined #tripleo | 14:10 | |
| *** thrash has joined #tripleo | 14:10 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: Tighten the access rules for galera https://review.openstack.org/316297 | 14:10 |
| *** egafford has joined #tripleo | 14:12 | |
| *** zoli|lunch is now known as zoli|wfh | 14:13 | |
| bandini | jistr: I added the steps1,2 change in the review above. I am more interested in seeing if the upgrade job will pass, we can split it out in a separate change later | 14:13 |
| jistr | ack | 14:15 |
| bandini | jistr, marios: thank you so *much* for the hint there, I would have spent a long time banging my head against the wall | 14:16 |
| *** masco has quit IRC | 14:17 | |
| jistr | np :) | 14:19 |
| *** dsariel has quit IRC | 14:23 | |
| *** absubram_ has joined #tripleo | 14:27 | |
| *** absubram has quit IRC | 14:28 | |
| *** absubram_ is now known as absubram | 14:28 | |
| *** dsariel has joined #tripleo | 14:29 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-quickstart: fix network configuration https://review.openstack.org/316264 | 14:29 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Use the overcloud full images from the cache https://review.openstack.org/312397 | 14:30 |
| *** mgarciam has joined #tripleo | 14:36 | |
| *** aufi has joined #tripleo | 14:38 | |
| openstackgerrit | Giulio Fidente proposed openstack/python-tripleoclient: Generate a password for the Mysql 'clustercheck' user https://review.openstack.org/317542 | 14:40 |
| *** yamahata has joined #tripleo | 14:45 | |
| *** sirushti has quit IRC | 14:46 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Revert check for centos to free HDD space https://review.openstack.org/316973 | 14:48 |
| gfidente | jistr bandini marios ^^ so that is meant to cope better with migration to toles | 14:48 |
| gfidente | jistr bandini marios but let's see if there are better alternatives | 14:48 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: WIP: integrate PCS provider in the merge. https://review.openstack.org/310713 | 14:48 |
| *** sirushti has joined #tripleo | 14:49 | |
| *** itamarl has quit IRC | 14:49 | |
| *** dsariel has quit IRC | 14:50 | |
| sshnaidm | derekh, do you know how can I simulate periodic job with tempest? To hardcode "stable release" in scripts..? | 14:58 |
| *** rhallisey has quit IRC | 14:59 | |
| *** rhallisey has joined #tripleo | 14:59 | |
| *** yamahata has quit IRC | 15:00 | |
| *** yamahata has joined #tripleo | 15:00 | |
| derekh | sshnaidm: something like this, if you want you can just update this patch and add a depends-on and switch it back to using /consistent https://review.openstack.org/#/c/229789/ | 15:01 |
| *** coolsvap has joined #tripleo | 15:01 | |
| trozet | trown: yo | 15:02 |
| trown | trozet: in meetings the next couple hours, but yo to you too :P | 15:02 |
| trozet | trown: heh was wondering if you see this https://bugs.launchpad.net/tripleo/+bug/1571090 | 15:02 |
| openstack | Launchpad bug 1571090 in tripleo "clustercheck always failing on ha job" [Critical,Fix released] | 15:03 |
| *** fultonj has quit IRC | 15:04 | |
| trown | trozet: that was fixed in RDO... looks like I need to remember how and update that bug | 15:04 |
| trozet | trown: yeah i think they changed packages | 15:04 |
| trozet | trown: so that fix should be in the overcloud images you build? | 15:05 |
| trown | trozet: ya | 15:05 |
| trozet | trown: weird cause we still see it every few runs | 15:05 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: WIP: integration of the new puppet pacemaker. https://review.openstack.org/302409 | 15:08 |
| *** ebarrera has quit IRC | 15:08 | |
| *** weshay is now known as weshay_mtg | 15:09 | |
| d0ugal | rbrady: Do we know what other people are running infront of Mistral if it isn't Apache? | 15:11 |
| rbrady | d0ugal: I'll find out for you | 15:11 |
| *** absubram has quit IRC | 15:12 | |
| *** fragatina has joined #tripleo | 15:12 | |
| *** dtrainor has joined #tripleo | 15:14 | |
| *** diazjf has joined #tripleo | 15:14 | |
| shardy | trown: How did you +2 http://review.rdoproject.org/r/1153 so fast?! | 15:15 |
| trown | shardy: we have a bot in #rdo :) | 15:15 |
| shardy | aha :) | 15:15 |
| trown | I was looking out for it too after the meeting | 15:16 |
| rbrady | d0ugal: this is how it's ran according to the mistral docs: https://github.com/openstack/mistral/blob/master/mistral/cmd/launch.py | 15:16 |
| shardy | trown: thanks - EmilienM pointed out I pushed it to the old openstack-packages repo gerrit first | 15:16 |
| *** fragatina has quit IRC | 15:16 | |
| shardy | I had to wait a while for rdoproject to validate my email address for some reason | 15:16 |
| EmilienM | shardy: in puppet meeting atm | 15:17 |
| rbrady | d0ugal: http://docs.openstack.org/developer/mistral/guides/installation_guide.html#running-multiple-mistral-servers-under-the-same-process | 15:19 |
| openstackgerrit | Dmitry Ilyin proposed openstack/puppet-pacemaker: Merge with fuel-infra/puppet-pacemaker https://review.openstack.org/296440 | 15:19 |
| *** aufi has quit IRC | 15:20 | |
| *** fultonj has joined #tripleo | 15:22 | |
| *** jprovazn has quit IRC | 15:23 | |
| *** diazjf has quit IRC | 15:24 | |
| *** mikelk has quit IRC | 15:24 | |
| *** diazjf has joined #tripleo | 15:27 | |
| *** ayoung has joined #tripleo | 15:28 | |
| EmilienM | shardy: do you want me to push it? | 15:31 |
| *** dmk0202 has quit IRC | 15:33 | |
| shardy | EmilienM: no, it's done now, thanks | 15:36 |
| EmilienM | shardy: ok | 15:36 |
| *** dsariel has joined #tripleo | 15:37 | |
| *** jistr has quit IRC | 15:38 | |
| gfidente | dprince shardy not sure if you have ideas about the random keys migration into roles | 15:38 |
| gfidente | meantime can you +/- my comment here https://review.openstack.org/#/c/316297/3/overcloud.yaml ? | 15:38 |
| *** akshai has joined #tripleo | 15:38 | |
| shardy | gfidente: I think we'll have to work around it outside the templates, e.g in tripleo-common, and pass in values either taken from the current stack, or generated on the client side | 15:40 |
| shardy | similar to how we do the current password random strings | 15:41 |
| gfidente | so for new passwords like in that submission tripleoclient sounds okay? | 15:41 |
| shardy | gfidente: I can't think of another way to do it, but we'll need to migrate the logic to tripleo-common so it can be driven via mistral | 15:42 |
| EmilienM | shardy: http://review.rdoproject.org/r/1153 merged! | 15:42 |
| gfidente | shardy ack | 15:42 |
| *** ebarrera has joined #tripleo | 15:42 | |
| shardy | gfidente: in future we can look at heat changes that allow you to default those parameters to a random value if nothing is provided from the client | 15:42 |
| shardy | EmilienM: good news! :) | 15:42 |
| pradk | shardy, hi, sorry missed the upstream meeting today, had a conflict.. i see there was some discussion around aodh upgrades | 15:43 |
| shardy | pradk: yup - can you sync with jistr and slagle re the possible alternative approach to switch the services as part of the upgrade? | 15:43 |
| shardy | pradk: If we can make that work, we won't need the backports, but if it proves unworkable we can revisit the backport discussion | 15:44 |
| pradk | shardy, sure, is the alternative to use stand alone puppet manifest and run it as a pre upgrade script ? | 15:44 |
| shardy | pradk: basically yes | 15:45 |
| pradk | shardy, i understand the hesitation on backports.. i'm cool with any workable alternatives | 15:45 |
| shardy | hopefully we can prove a pattern that will work for other services that need this transition in future | 15:45 |
| shardy | pradk: great, thanks | 15:45 |
| pradk | shardy, so reason i was leaning towards bash was i was told puppet cannot run yet at this stage in upgrades | 15:45 |
| pradk | shardy, if we can leverage existing manifests without duplicating effort i'm cool | 15:46 |
| shardy | I -2'd the backports pending the outcome of the investigation into this alternate approach | 15:46 |
| pradk | shardy, sure, thats fine | 15:46 |
| shardy | pradk: sure, the thing is we don't apply the existing puppet steps pre-upgrade, but we can potentially wire in something that makes use of the same modules | 15:46 |
| *** rhallisey has quit IRC | 15:48 | |
| openstackgerrit | Dmitry Ilyin proposed openstack/puppet-pacemaker: Merge with fuel-infra/puppet-pacemaker https://review.openstack.org/296440 | 15:49 |
| pradk | shardy cool, dint know that was possible.. sounds like a good approach if we can get it to work, without backporting service replacements and giving people strokes :) | 15:49 |
| shardy | \o/ :) | 15:49 |
| pradk | shardy, so jistr is the best person to work with in wiring this ? | 15:49 |
| shardy | pradk: slagle has been testing some things too I think | 15:50 |
| pradk | and assume this will get into mitaka and not liberty correct? what ever pre-upgrade logic is | 15:50 |
| shardy | pradk: Yup, it'd be wired into the mitaka upgrade scripts | 15:50 |
| pradk | cool | 15:51 |
| *** eil397 has joined #tripleo | 15:52 | |
| *** diazjf has quit IRC | 15:52 | |
| pradk | shardy, slagle, so these are the deps we will pull in as part of aodh install -> https://github.com/openstack/aodh/blob/stable/mitaka/requirements.txt .. so long as upgrading these pre-upgrade doesnt cause issues i think this option is viable | 15:53 |
| *** karthiks has quit IRC | 15:55 | |
| *** leanderthal is now known as leanderthal|afk | 15:55 | |
| *** fragatina has joined #tripleo | 15:57 | |
| *** absubram has joined #tripleo | 16:04 | |
| *** zoli|wfh is now known as zoli|gone | 16:05 | |
| *** zoli|gone is now known as zoli_gone-proxy | 16:06 | |
| *** fragatina has quit IRC | 16:07 | |
| *** fragatina has joined #tripleo | 16:07 | |
| *** karthiks has joined #tripleo | 16:09 | |
| *** diazjf has joined #tripleo | 16:11 | |
| *** mgould has quit IRC | 16:15 | |
| *** mgould has joined #tripleo | 16:15 | |
| *** dsariel has quit IRC | 16:17 | |
| *** rhallisey has joined #tripleo | 16:17 | |
| *** oshvartz has quit IRC | 16:17 | |
| *** xinwu has joined #tripleo | 16:20 | |
| *** eil397 has quit IRC | 16:20 | |
| Goneri | hi, could it be possible to have the last ipxe-roms-qemu from mitaka-common installed on the TripleO CI. This to refresh the ipxe version used by ipxe. The current version does not accept the --timeout paramter and this create a lot of problems (freeze). At this point, I've a patch on instack-undercloud that should resolve these ipxe freeze issue, but it is block because of this old ipxe client: https://review.openstack.org/#/c/294787/ | 16:21 |
| Erming_ | larsks: I hope you were not looking for me last Friday. I was out the afternoon. Today I am basically free of meetings. Do you have time to give me a hand on the undercloud stuff today? | 16:21 |
| *** jtomasek has quit IRC | 16:22 | |
| *** saneax_AFK is now known as saneax | 16:23 | |
| bnemec | shardy: derekh: I think I'd be okay with merging https://review.openstack.org/#/c/309051/ | 16:25 |
| bnemec | The CI failures on https://review.openstack.org/#/c/297328/ look bogus to me, and definitely aren't the same problem that I was looking for with that patch. | 16:26 |
| bnemec | I'm wondering if something is broken in tripleo.sh --overcloud-delete. | 16:26 |
| bnemec | It's also possible that an in-repo depends-on doesn't work as expected. | 16:27 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: WIP: integration of the new puppet pacemaker. https://review.openstack.org/302409 | 16:29 |
| *** noslzzp_ has joined #tripleo | 16:29 | |
| *** trown is now known as trown|lunch | 16:32 | |
| *** noslzzp has quit IRC | 16:32 | |
| openstackgerrit | Merged openstack/tripleo-ui: Mistral Nodes Introspection https://review.openstack.org/314023 | 16:35 |
| *** mgould has quit IRC | 16:36 | |
| *** mgould has joined #tripleo | 16:36 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished https://review.openstack.org/297328 | 16:37 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Revert "Test with latest master heat" https://review.openstack.org/309051 | 16:37 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion in periodic job https://review.openstack.org/296765 | 16:37 |
| *** rasca has quit IRC | 16:37 | |
| *** rasca has joined #tripleo | 16:38 | |
| derekh | bnemec: I'm not familiar with the issue but if your happy with it and its passing CI its a +1 from me | 16:39 |
| *** ebarrera has quit IRC | 16:40 | |
| bnemec | derekh: I was mostly thinking about it to unblock ci, but I see the new heat package is available so things are passing again. I'll keep looking into why the delete job is failing. | 16:41 |
| derekh | bnemec: ok | 16:41 |
| *** devvesa has quit IRC | 16:43 | |
| *** diazjf has quit IRC | 16:43 | |
| marios | EmilienM: hey man, revoted at puppet-tripleo for rabbit - i added a note to the etherpad about the Implements (with ChangeId or in main text) | 16:44 |
| marios | EmilienM: i will try it on my patches tomorrow morning to confirm | 16:44 |
| marios | EmilienM: anyway, would be nice to have all listed in the blueprint... though i don't know if sthing landed already which isn't there because of that | 16:45 |
| marios | (i.e. landed with the Implements in the wrong place so wont ever be listed) | 16:45 |
| *** diazjf has joined #tripleo | 16:46 | |
| marios | EmilienM: (this etherpad https://etherpad.openstack.org/p/tripleo-composable-services ) | 16:46 |
| *** derekh has quit IRC | 16:46 | |
| marios | EmilienM: /me EOD | 16:46 |
| *** panda has quit IRC | 16:48 | |
| *** panda has joined #tripleo | 16:48 | |
| *** xinwu has quit IRC | 16:49 | |
| *** diazjf has quit IRC | 16:52 | |
| *** karthiks has quit IRC | 16:53 | |
| *** mgould has quit IRC | 16:54 | |
| *** shivrao has joined #tripleo | 16:59 | |
| *** saneax is now known as saneax_AFK | 17:01 | |
| *** shivrao has quit IRC | 17:02 | |
| *** lucasagomes is now known as lucas-dinner | 17:02 | |
| *** dtantsur is now known as dtantsur|afk | 17:03 | |
| openstackgerrit | Merged openstack/instack-undercloud: Move parts of undercloud-install to puppet https://review.openstack.org/312931 | 17:06 |
| *** sshnaidm has quit IRC | 17:08 | |
| *** thrash is now known as thrash|biab | 17:08 | |
| *** dmsimard has quit IRC | 17:13 | |
| *** mgarciam has quit IRC | 17:13 | |
| *** Goneri has quit IRC | 17:13 | |
| *** mgarciam has joined #tripleo | 17:14 | |
| *** MaxPC1 has joined #tripleo | 17:14 | |
| *** MaxPC has quit IRC | 17:15 | |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Add Cinder API/Scheduler/Volume roles https://review.openstack.org/310939 | 17:16 |
| *** dmsimard has joined #tripleo | 17:16 | |
| *** gfidente has quit IRC | 17:17 | |
| *** Goneri has joined #tripleo | 17:18 | |
| *** jpena is now known as jpena|off | 17:21 | |
| *** florianf has quit IRC | 17:22 | |
| *** tosky has quit IRC | 17:25 | |
| *** sambetts is now known as sambetts|afk | 17:26 | |
| *** electrofelix has quit IRC | 17:27 | |
| *** shivrao has joined #tripleo | 17:27 | |
| *** olap has quit IRC | 17:29 | |
| *** weshay_mtg is now known as weshay | 17:30 | |
| *** mbound has joined #tripleo | 17:30 | |
| *** xinwu has joined #tripleo | 17:31 | |
| openstackgerrit | Tzu-Mainn Chen proposed openstack/tripleo-common: Add TripleO Mistral documentation https://review.openstack.org/313109 | 17:32 |
| *** mcornea has quit IRC | 17:34 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-puppet-elements: Remove puppet-qpid from module list https://review.openstack.org/317641 | 17:36 |
| *** oshvartz has joined #tripleo | 17:37 | |
| *** ppradhan has left #tripleo | 17:45 | |
| *** diazjf has joined #tripleo | 17:48 | |
| *** thrash|biab is now known as thrash | 17:52 | |
| *** trown|lunch is now known as trown | 17:54 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Switch ceilometer meter dispatcher to use gnocchi by default https://review.openstack.org/317656 | 17:55 |
| *** mcornea has joined #tripleo | 17:56 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: partitioning-parted: extraced and adapted element https://review.openstack.org/313938 | 18:01 |
| *** akshai has quit IRC | 18:01 | |
| *** sshnaidm has joined #tripleo | 18:02 | |
| *** akshai has joined #tripleo | 18:03 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: [WIP] Add: lvm element https://review.openstack.org/316529 | 18:08 |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: partitioning-parted: extraced and adapted element https://review.openstack.org/313938 | 18:08 |
| *** mcornea has quit IRC | 18:08 | |
| Slower | dprince: any thoughts/preferences on how you think the containers should be delivered? | 18:10 |
| Slower | dprince: I'm kinda on the fence between doing a hook that would let us define kubernetes pods in heat and then deploy with kubernetes or docker (so we can switch between them or choose what to deploy with k8s) | 18:11 |
| Slower | dprince: or just use atomic | 18:11 |
| Slower | which would keep the heat templates a lot cleaner | 18:12 |
| dprince | Slower: that sounds like worth investigating | 18:12 |
| dprince | Slower: this would be vs. what? | 18:12 |
| Slower | atomic vs switchable kubernetes/docker | 18:13 |
| dprince | Slower: I think I'd have to see the switchable kubernetes/docker to have an oppinion | 18:14 |
| *** jprovazn has joined #tripleo | 18:15 | |
| dprince | Slower: so try it? | 18:15 |
| Slower | yeah could do | 18:15 |
| dprince | Slower: I mean, like prototype it so we can get a better feel for it | 18:15 |
| dprince | Slower: don't have to take it "all the way" | 18:15 |
| Slower | dprince: basically take this: https://github.com/openstack/heat-templates/tree/master/hot/software-config/elements/heat-config-kubelet | 18:16 |
| *** akshai has quit IRC | 18:16 | |
| Slower | and have an alternative implementation that just starts teh containers via docker cmd | 18:16 |
| Slower | or even switchable based on a template input | 18:17 |
| *** akshai has joined #tripleo | 18:18 | |
| Slower | dprince: I guess I just want to talk this out a bit more | 18:19 |
| *** coolsvap has quit IRC | 18:20 | |
| Slower | especially around what kubernetes really gets us | 18:20 |
| Slower | what features can we actually take advantage of? | 18:20 |
| dprince | Slower: upgrades and how we could make use of the framework there basically? | 18:22 |
| dprince | Slower: from a green field standpoint, I think I was fine with the docker-compose Atomic solution... | 18:23 |
| Slower | well I don't think it's going to help a lot there | 18:23 |
| dprince | Slower: but for upgrades there could be something with Kubernetes that is useful. Unclear to me as well | 18:23 |
| Slower | can we make use of the scalability? | 18:23 |
| Slower | is the service replication stuff a big deal to us? | 18:24 |
| Slower | and replication etc | 18:25 |
| Slower | errr ya | 18:25 |
| *** ohamada has quit IRC | 18:31 | |
| *** rcernin has quit IRC | 18:31 | |
| *** rhallisey has quit IRC | 18:35 | |
| *** rhallisey has joined #tripleo | 18:36 | |
| *** akrivoka has quit IRC | 18:36 | |
| *** saneax_AFK is now known as saneax | 18:38 | |
| *** saneax is now known as saneax_AFK | 18:41 | |
| *** akshai has quit IRC | 18:43 | |
| *** tremble has quit IRC | 18:56 | |
| *** tremble has joined #tripleo | 18:57 | |
| *** akshai has joined #tripleo | 18:59 | |
| *** diazjf has quit IRC | 18:59 | |
| *** akshai_ has joined #tripleo | 19:02 | |
| *** diazjf has joined #tripleo | 19:03 | |
| trown | lol slagle... pretty quick on that packaging review, in before I WIP'd it | 19:04 |
| *** akshai has quit IRC | 19:04 | |
| slagle | :) | 19:05 |
| *** shivrao_ has joined #tripleo | 19:12 | |
| Erming_ | trown: do you have a few minutes to help me out the current node introspection issue in undercloud? Even I reinstalled undercloud, it's still there. | 19:13 |
| *** fragatin_ has joined #tripleo | 19:13 | |
| *** tremble has quit IRC | 19:14 | |
| *** dsneddon_ has joined #tripleo | 19:14 | |
| trown | Erming_: how many nodes do you have? do you need introspection? | 19:14 |
| Erming_ | trown: 4 virtual nodes. | 19:15 |
| *** shivrao has quit IRC | 19:15 | |
| *** shivrao_ is now known as shivrao | 19:15 | |
| Erming_ | trown: it's because of adding new nodes your default 2 nodes, then failed to introspect. | 19:15 |
| *** fragatina has quit IRC | 19:15 | |
| Erming_ | and then I re-installed, still not operable. Just no effect, or timeout. | 19:16 |
| Erming_ | trown: I am wondering how to clean it and then I can start from scratch. | 19:16 |
| Erming_ | if you have time to check , you can log in to cirrus, the host I've given you access. | 19:17 |
| trown | Erming_: ok, definitely do not need introspection for virtual set up | 19:17 |
| *** shivrao has quit IRC | 19:17 | |
| Erming_ | really | 19:17 |
| trown | Erming_: introspection is only useful if there is something potentially unknown about the hardware | 19:18 |
| *** dsneddon_ has quit IRC | 19:18 | |
| *** dsneddo__ has joined #tripleo | 19:18 | |
| trown | Erming_: for virts we know everything, because we created them | 19:18 |
| Erming_ | I was just following your steps. Wow, then I am not sure the current status of nodes are ok to deploy overcloud | 19:18 |
| *** fragatin_ has quit IRC | 19:18 | |
| *** tremble has joined #tripleo | 19:18 | |
| *** tremble has quit IRC | 19:18 | |
| *** tremble has joined #tripleo | 19:18 | |
| Erming_ | trown: https://paste.fedoraproject.org/367713/14635127/ | 19:19 |
| Erming_ | I manually changed the first one to manageable to do introspection individually | 19:19 |
| trown | Erming_: ok... the Power State is going to be a problem | 19:20 |
| Erming_ | yes. | 19:20 |
| trown | all of the nodes are in Maintenance as well | 19:20 |
| Erming_ | I don't believe I am able to change it. | 19:20 |
| Erming_ | but I can try again | 19:20 |
| *** mnaser has left #tripleo | 19:21 | |
| trown | no likely it is failing to connect to libvirt via ssh so it cant get the power state | 19:21 |
| Erming_ | something should be wrong because it looks different from the initial status that worked | 19:21 |
| *** dsariel has joined #tripleo | 19:21 | |
| trown | and when it cant get the power state it puts the nodes in maintenance | 19:21 |
| Erming_ | do i need restart libvirt on host? | 19:21 |
| *** shivrao has joined #tripleo | 19:22 | |
| trown | I am a bit confused how you are ending up in that state to begin with | 19:23 |
| Erming_ | OK. 1. I set up an undercloud with your default instackenv.json | 19:23 |
| Erming_ | 2. I tried to add 2 nodes for HA. but introspection failed for the added nodes (OK for original ones) | 19:24 |
| trown | how did you add the 2 nodes? | 19:25 |
| *** fragatina has joined #tripleo | 19:25 | |
| *** akshai_ has quit IRC | 19:25 | |
| *** shivrao_ has joined #tripleo | 19:26 | |
| Erming_ | 3. I tried to re-install undercloud to get a clean start again. / just added into instackenv. json and then repeat the steps (registration, introspection) | 19:26 |
| trown | Erming_: wait this is virt undercloud and baremetal overcloud? or virt/virt? | 19:27 |
| Erming_ | just virt/virt | 19:28 |
| *** shivrao has quit IRC | 19:28 | |
| Erming_ | trown: just virt/virt before I want to redo a baremetal one. | 19:28 |
| Erming_ | I want to set up a virtual one for a good reference. | 19:29 |
| trown | Erming_: good idea... one thing though, did you manually create vms for the extra nodes? | 19:29 |
| Erming_ | so it confuses me for all the subsquent baremetal related instructions in your guide. | 19:29 |
| Erming_ | trown: no I didn't | 19:29 |
| trown | just adding them to instackenv.json wont be enough | 19:30 |
| Erming_ | trown: I thought it can do them for me. I see. | 19:30 |
| trown | instackenv.json just points ironic to existing "hardware" it doesnt create anything | 19:30 |
| Erming_ | trown: then it's a good point, how to add nodes | 19:30 |
| Erming_ | no matter baremetal or virtual ones | 19:31 |
| trown | Erming_: there is nothing built-in to tripleo-quickstart for that... it would be a good RFE | 19:31 |
| Erming_ | trown: OK. fine. then how to hack your script to add nodes from scratch? | 19:31 |
| *** shivrao_ has quit IRC | 19:32 | |
| Erming_ | I like the previous ones you had 3 control nodes + 1 ceph node. now only 1 control+ 1compute | 19:32 |
| trown | Erming_: you can pass a config file to tripleo-quickstart with '-c <config>' | 19:33 |
| trown | you can find examples in https://github.com/openstack/tripleo-quickstart/blob/master/playbooks/centosci/ | 19:34 |
| trown | the key you would want to add nodes to is "overcloud_nodes" | 19:34 |
| *** jcoufal has quit IRC | 19:34 | |
| *** shivrao has joined #tripleo | 19:35 | |
| Erming_ | trown: as I re-tried Lars's ansible playbook there were some strange issues. such as failed to create a log file to write. So I later change to use yours and worked very smoothly. (no offending Lars:) | 19:35 |
| trown | Erming_: ya some changes to tripleo-quickstart made that blog post no longer correct | 19:37 |
| trown | https://bugs.launchpad.net/tripleo-quickstart/+bug/1571026 | 19:37 |
| openstack | Launchpad bug 1571026 in tripleo-quickstart "recent changes invalidate http://blog.oddbit.com/2016/02/19/deploy-an-ha-openstack-development-envir/ " [Medium,Triaged] - Assigned to Lars Kellogg-Stedman (larsks) | 19:37 |
| Erming_ | trown: I was using your quickstart.sh. then which instruction I should use for now | 19:37 |
| trown | Erming_: quickstart.sh is what is tested in CI, so that is the safest bet | 19:39 |
| Erming_ | trown: yes. it's so clean and smooth. but which step I can change the node configuration for more nodes? | 19:40 |
| Erming_ | trown: you mean after bach quickstart.sh before deploying undercloud I can change it? | 19:40 |
| Erming_ | bash quickstart.sh I mean | 19:41 |
| trown | Erming_: not without some manual virsh commands... but you can pass a config file to quickstart.sh | 19:41 |
| *** dprince has quit IRC | 19:41 | |
| slagle | be good to get another review on using the cache'd overcloud-full: https://review.openstack.org/#/c/312397 | 19:41 |
| Erming_ | trown: good. can you show me a command line example? | 19:42 |
| trown | so `bash quickstart.sh -c /tmp/my_config.yml $VIRTHOST` | 19:42 |
| Erming_ | trown: excellent, what's the rough format of my_config.yml? | 19:42 |
| trown | and as for contents of "/tmp/my_config.yml" you can use CI configs as a good starting point: https://github.com/openstack/tripleo-quickstart/blob/master/playbooks/centosci/ | 19:42 |
| trown | for just adding nodes, you would just add more nodes to the "overcloud_nodes" key there | 19:43 |
| Erming_ | trown: great. I will try. you think that's it for this issue? I guess then it will produce a new json file with all the nodes. Do I need do import and introspection after that? | 19:44 |
| Erming_ | I mean: openstack baremetal import --json instackenv.json ; openstack baremetal configure boot ; openstack baremetal introspection bulk star; | 19:44 |
| trown | import is required | 19:45 |
| trown | introspection is optional | 19:45 |
| trown | configure boot is also required | 19:45 |
| Erming_ | trown: Good! Let me try now. will let you know. Thanks a lot! | 19:45 |
| trown | np | 19:46 |
| *** mbound has quit IRC | 19:46 | |
| panda | trown: any thoughts about areas and naming here ? https://review.openstack.org/#/c/313127 | 19:46 |
| trown | panda: replied wrt naming, what do you mean by areas? | 19:51 |
| panda | trown: if those are the only areas we want to teardown | 19:51 |
| trown | panda: ya I think that covers what we have now | 19:53 |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui: Updated packages to the latest stable. https://review.openstack.org/317245 | 19:54 |
| panda | trown: ok, thanks. | 19:56 |
| *** rcernin has joined #tripleo | 19:58 | |
| *** dsneddo__ has quit IRC | 20:01 | |
| Erming_ | trown: one more thing, if it's not big, how can I add ceph flavor into the yml? I added something like: - name: ceph_0 flavor: ceph-storage, then run it, it complained : FAILED! => {"failed": true, "msg": "'dict object' has no attribute u'ceph-storage'"} | 20:01 |
| Erming_ | but I did see this flavor in the undercloud I created even with only 2 nodes, if I am correct. | 20:02 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Use the overcloud full images from the cache https://review.openstack.org/312397 | 20:03 |
| trown | Erming_: what task failed? | 20:04 |
| Erming_ | trown: bash quickstart.sh -c ./ha.yml | 20:04 |
| *** Goneri has quit IRC | 20:04 | |
| *** fragatin_ has joined #tripleo | 20:04 | |
| Erming_ | TASK [setup/overcloud : Create overcloud vm storage] *************************** | 20:05 |
| Erming_ | task path: /home/erming/.quickstart/tripleo-quickstart/playbooks/roles/libvirt/setup/overcloud/tasks/main.yml:55 | 20:05 |
| *** shivrao_ has joined #tripleo | 20:05 | |
| trown | Erming_: ah it is because the flavor defined in quickstart is just "ceph" https://github.com/openstack/tripleo-quickstart/blob/master/playbooks/roles/common/defaults/main.yml#L37-L40 | 20:05 |
| Erming_ | trown: ah. I see. thanks again | 20:06 |
| *** diazjf has quit IRC | 20:08 | |
| *** fragatina has quit IRC | 20:08 | |
| *** shivrao has quit IRC | 20:08 | |
| *** shivrao_ is now known as shivrao | 20:08 | |
| *** fzdarsky has quit IRC | 20:09 | |
| *** absubram has quit IRC | 20:11 | |
| *** yamahata has quit IRC | 20:11 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Explode log tars so they can be indexed https://review.openstack.org/314272 | 20:11 |
| *** ccamacho has quit IRC | 20:18 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Fix the ManagementNetValueSpecs param type https://review.openstack.org/309563 | 20:19 |
| *** jprovazn has quit IRC | 20:22 | |
| *** akshai has joined #tripleo | 20:25 | |
| *** fragatin_ has quit IRC | 20:26 | |
| *** akshai_ has joined #tripleo | 20:26 | |
| *** oneswig has joined #tripleo | 20:26 | |
| *** shivrao has quit IRC | 20:27 | |
| *** shivrao has joined #tripleo | 20:27 | |
| *** fragatina has joined #tripleo | 20:27 | |
| *** fragatina has quit IRC | 20:28 | |
| *** shivrao has quit IRC | 20:28 | |
| *** chem`` has joined #tripleo | 20:29 | |
| *** fragatina has joined #tripleo | 20:29 | |
| *** dmk0202 has joined #tripleo | 20:29 | |
| *** akshai has quit IRC | 20:30 | |
| *** chem` has quit IRC | 20:31 | |
| *** diazjf has joined #tripleo | 20:40 | |
| *** rcernin has quit IRC | 20:41 | |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Explicit Teardown https://review.openstack.org/313127 | 20:42 |
| *** yamahata has joined #tripleo | 20:43 | |
| *** dsneddon_ has joined #tripleo | 20:45 | |
| *** jayg is now known as jayg|g0n3 | 20:45 | |
| *** diazjf has quit IRC | 20:45 | |
| *** oneswig has left #tripleo | 20:47 | |
| *** panda has quit IRC | 20:48 | |
| *** panda has joined #tripleo | 20:48 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished https://review.openstack.org/297328 | 20:49 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion in periodic job https://review.openstack.org/296765 | 20:49 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Don't pipe yes to a function https://review.openstack.org/317730 | 20:49 |
| *** rhallisey has quit IRC | 20:50 | |
| *** shardy has quit IRC | 20:53 | |
| *** cwolferh has quit IRC | 20:54 | |
| *** absubram has joined #tripleo | 20:55 | |
| *** absubram_ has joined #tripleo | 20:56 | |
| *** diazjf has joined #tripleo | 21:00 | |
| *** absubram has quit IRC | 21:01 | |
| *** absubram_ is now known as absubram | 21:01 | |
| *** julim has quit IRC | 21:01 | |
| *** trown is now known as trown|outtypewww | 21:02 | |
| *** athomas has quit IRC | 21:03 | |
| openstackgerrit | Merged openstack/instack-undercloud: Add validation of network configuration opts https://review.openstack.org/231211 | 21:05 |
| *** paramite has quit IRC | 21:07 | |
| *** dsneddon_ has quit IRC | 21:10 | |
| *** dmk0202 has quit IRC | 21:10 | |
| *** lblanchard has quit IRC | 21:15 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Move dhcp agent maps to OS::Heat::None to resource_registry https://review.openstack.org/317736 | 21:16 |
| slagle | EmilienM: does that look right to you ^? | 21:20 |
| EmilienM | slagle: looking | 21:20 |
| *** oshvartz has quit IRC | 21:21 | |
| EmilienM | slagle: I'm not sure | 21:23 |
| slagle | i'll check with dan tomorrow | 21:23 |
| EmilienM | let me dig a bit more | 21:23 |
| *** fragatina has quit IRC | 21:24 | |
| *** fragatina has joined #tripleo | 21:24 | |
| EmilienM | slagle: in overcloud-resource-registry-puppet.yaml, OS::TripleO::Services::NeutronDhcpAgent is under resource_registry | 21:26 |
| EmilienM | so to me, it makes sense | 21:26 |
| EmilienM | but I'm not sure | 21:26 |
| EmilienM | look how useful am I | 21:26 |
| slagle | yea i think it needs to be under resource_registry | 21:28 |
| *** weshay has quit IRC | 21:28 | |
| *** fragatina has quit IRC | 21:29 | |
| *** kbyrne has joined #tripleo | 21:29 | |
| *** fzdarsky has joined #tripleo | 21:30 | |
| openstackgerrit | Merged openstack/instack-undercloud: Generate most of the pystache context automatically https://review.openstack.org/297319 | 21:30 |
| *** ayoung has quit IRC | 21:33 | |
| *** dsariel has quit IRC | 21:35 | |
| *** ccamacho has joined #tripleo | 21:36 | |
| EmilienM | slagle: can you land https://review.openstack.org/#/c/317206/ please ? | 21:36 |
| *** ccamacho has quit IRC | 21:41 | |
| EmilienM | I'm also going to approve https://review.openstack.org/#/c/315238/ since we just approve the puppet-ironic patch | 21:43 |
| *** egafford has quit IRC | 21:45 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Adds memcached as a composable service https://review.openstack.org/312899 | 21:45 |
| *** ccamacho has joined #tripleo | 21:45 | |
| slagle | EmilienM: sure, done | 21:46 |
| EmilienM | slagle: thx | 21:46 |
| *** ccamacho has quit IRC | 21:50 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Composable role for RabbitMQ https://review.openstack.org/311849 | 21:51 |
| *** fultonj has quit IRC | 21:51 | |
| openstackgerrit | Merged openstack/instack-undercloud: puppet-stack-config: notify swift-proxy when ring is ready https://review.openstack.org/317206 | 21:52 |
| EmilienM | larsks: ^ | 21:53 |
| EmilienM | slagle: I know it's a bit late now but I'm having troubles to find the upgrade issue with https://review.openstack.org/#/c/311863/ | 21:54 |
| EmilienM | if you have time, can you look my patch please? | 21:54 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-docs: Document profile and node placement redundancy https://review.openstack.org/301185 | 21:55 |
| *** fragatina has joined #tripleo | 21:56 | |
| *** tremble has quit IRC | 21:56 | |
| *** diazjf has quit IRC | 21:57 | |
| *** zeroshft has joined #tripleo | 21:58 | |
| *** fragatin_ has joined #tripleo | 21:59 | |
| *** tremble has joined #tripleo | 21:59 | |
| *** tremble has quit IRC | 21:59 | |
| *** tremble has joined #tripleo | 21:59 | |
| *** fragatina has quit IRC | 22:01 | |
| *** fragatin_ has quit IRC | 22:01 | |
| *** fragatina has joined #tripleo | 22:02 | |
| *** dbecker has quit IRC | 22:04 | |
| *** weshay has joined #tripleo | 22:04 | |
| *** myoung|remote has joined #tripleo | 22:21 | |
| *** myoung has quit IRC | 22:23 | |
| *** sthillma has joined #tripleo | 22:25 | |
| *** cwolferh has joined #tripleo | 22:28 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo: Add mongodb profiles https://review.openstack.org/304780 | 22:28 |
| EmilienM | pradk: you'll have to do recheck | 22:29 |
| EmilienM | I'm currently merging a patch in instack so CI works again | 22:29 |
| *** fragatin_ has joined #tripleo | 22:29 | |
| EmilienM | 315238 should land very soon, in a few min | 22:30 |
| pradk | ok | 22:31 |
| *** fragatina has quit IRC | 22:32 | |
| openstackgerrit | Merged openstack/instack-undercloud: Cleanup Puppet code that deploys Ironic https://review.openstack.org/315238 | 22:37 |
| *** ccamacho has joined #tripleo | 22:37 | |
| *** fzdarsky has quit IRC | 22:42 | |
| *** ayoung has joined #tripleo | 22:42 | |
| *** thrash is now known as thrash|g0ne | 22:45 | |
| *** _prad_ has quit IRC | 22:47 | |
| *** fragatin_ has quit IRC | 22:47 | |
| *** fragatina has joined #tripleo | 22:48 | |
| *** apetrich has quit IRC | 22:53 | |
| *** zeroshft has quit IRC | 23:02 | |
| *** Goneri has joined #tripleo | 23:07 | |
| *** jobewan has quit IRC | 23:15 | |
| *** jschlueter has quit IRC | 23:18 | |
| *** adarazs has quit IRC | 23:19 | |
| pabelanger | EmilienM: so, this is a thing now: http://mirror.dfw.rax.openstack.org/epel/ | 23:19 |
| *** adarazs has joined #tripleo | 23:22 | |
| *** jschlueter has joined #tripleo | 23:23 | |
| *** fragatina has quit IRC | 23:30 | |
| *** fragatina has joined #tripleo | 23:31 | |
| *** MaxPC1 has quit IRC | 23:35 | |
| *** Goneri has quit IRC | 23:39 | |
| *** MaxPC has joined #tripleo | 23:44 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add PS4 to show file/function/line in debug output https://review.openstack.org/317260 | 23:50 |
| *** chem`` has quit IRC | 23:55 | |
| *** pradk has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
