| *** athomas has quit IRC | 00:01 | |
| *** shakamunyi has joined #tripleo | 00:03 | |
| *** weshay has quit IRC | 00:15 | |
| *** weshay has joined #tripleo | 00:20 | |
| *** shakamunyi has quit IRC | 00:29 | |
| *** MasterPiece has quit IRC | 00:33 | |
| *** weshay has quit IRC | 00:54 | |
| *** chlong has quit IRC | 00:55 | |
| *** radek__ has joined #tripleo | 01:01 | |
| *** chlong has joined #tripleo | 01:12 | |
| *** shakamunyi has joined #tripleo | 01:15 | |
| *** shakamunyi has quit IRC | 01:26 | |
| *** radek__ has quit IRC | 01:31 | |
| *** masco has joined #tripleo | 01:52 | |
| *** masco has quit IRC | 02:08 | |
| *** masco has joined #tripleo | 02:16 | |
| *** thrash is now known as thrash|g0ne | 02:45 | |
| *** untriaged-bot has joined #tripleo | 03:00 | |
| untriaged-bot | No untriaged bugs so far! \o/ | 03:00 |
|---|---|---|
| *** untriaged-bot has quit IRC | 03:00 | |
| *** chlong has quit IRC | 03:11 | |
| *** panda has quit IRC | 03:21 | |
| *** panda has joined #tripleo | 03:22 | |
| *** masco has quit IRC | 03:30 | |
| *** radez_g0n3 has quit IRC | 03:33 | |
| *** radez_g0n3 has joined #tripleo | 03:36 | |
| *** chlong has joined #tripleo | 03:50 | |
| *** lazy_prince has joined #tripleo | 04:26 | |
| *** links has joined #tripleo | 04:30 | |
| *** yamahata has joined #tripleo | 04:40 | |
| *** masco has joined #tripleo | 04:40 | |
| *** Marga_ has joined #tripleo | 04:49 | |
| *** dasm|afk is now known as dasm | 05:01 | |
| *** Marga__ has joined #tripleo | 05:07 | |
| *** Marga_ has quit IRC | 05:09 | |
| *** Marga__ has quit IRC | 05:10 | |
| *** Marga_ has joined #tripleo | 05:10 | |
| *** yog_ has joined #tripleo | 05:24 | |
| *** weshay has joined #tripleo | 05:59 | |
| *** weshay has quit IRC | 06:02 | |
| *** ukalifon1 has joined #tripleo | 06:04 | |
| *** Marga_ has quit IRC | 06:16 | |
| *** ishant has joined #tripleo | 06:22 | |
| *** jprovazn has joined #tripleo | 06:28 | |
| *** jtomasek has joined #tripleo | 06:39 | |
| *** tteggel has quit IRC | 06:43 | |
| *** HenryG has quit IRC | 06:43 | |
| *** mordred has quit IRC | 06:43 | |
| *** isq_ has quit IRC | 06:43 | |
| *** fabbione has quit IRC | 06:43 | |
| *** lsmola_ has quit IRC | 06:43 | |
| *** morganfainberg has quit IRC | 06:43 | |
| *** fabbione has joined #tripleo | 06:43 | |
| *** mordred has joined #tripleo | 06:43 | |
| *** morganfainberg has joined #tripleo | 06:43 | |
| *** lsmola_ has joined #tripleo | 06:43 | |
| *** isq_ has joined #tripleo | 06:43 | |
| *** tteggel has joined #tripleo | 06:44 | |
| *** HenryG has joined #tripleo | 06:44 | |
| *** aufi has joined #tripleo | 06:47 | |
| *** radek__ has joined #tripleo | 06:59 | |
| *** panda has quit IRC | 07:21 | |
| *** panda has joined #tripleo | 07:21 | |
| *** Goneri has joined #tripleo | 07:22 | |
| *** jistr has joined #tripleo | 07:24 | |
| jistr | morning | 07:24 |
| *** paramite has joined #tripleo | 07:31 | |
| *** ifarkas has joined #tripleo | 07:33 | |
| *** radek__ has quit IRC | 07:34 | |
| *** pblaho has joined #tripleo | 07:34 | |
| *** yamahata has quit IRC | 07:37 | |
| *** chlong has quit IRC | 07:39 | |
| jistr | any core around to do a second review on https://review.openstack.org/#/c/184436/ and https://review.openstack.org/#/c/184505/ ? | 07:39 |
| jistr | these should help to stabilize the HA CI job | 07:39 |
| *** gfidente has joined #tripleo | 08:01 | |
| jistr | ^ maybe jprovazn or pblaho? I know it's not precisely your area, but me an gfidente can only give one review on each other's patches, and we don't have marios around today i think. | 08:02 |
| jistr | gfidente: morning :) | 08:02 |
| jprovazn | jistr: sure, /me looks | 08:02 |
| jistr | jprovazn: thanks! | 08:05 |
| pblaho | jistr: I will look too | 08:09 |
| gfidente | morning :) | 08:09 |
| jistr | pblaho: thanks! | 08:10 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Prepare for adding OpenStack services to Pacemaker https://review.openstack.org/184436 | 08:13 |
| *** al has quit IRC | 08:16 | |
| *** al has joined #tripleo | 08:17 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Use clustercheck script to control galera-ready https://review.openstack.org/184505 | 08:20 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates: Start non-pacemakerized services in step 4 https://review.openstack.org/184737 | 08:21 |
| jistr | jprovazn, pblaho: thanks :) | 08:21 |
| jprovazn | np | 08:21 |
| *** mcornea has joined #tripleo | 08:22 | |
| *** daneyon has joined #tripleo | 08:23 | |
| gfidente | huuuuuhhh | 08:24 |
| gfidente | jistr, actually the keystone patch landed | 08:26 |
| gfidente | so we can non_pcmk >= 4 | 08:26 |
| jistr | yeah see a few lines above ^^ already submitted :) | 08:26 |
| gfidente | ah sorry, nice :) | 08:27 |
| *** daneyon has quit IRC | 08:31 | |
| *** pino|work has joined #tripleo | 08:35 | |
| *** chlong has joined #tripleo | 08:44 | |
| *** paramite is now known as paramite|afk | 08:48 | |
| *** untriaged-bot has joined #tripleo | 09:00 | |
| untriaged-bot | No untriaged bugs so far! \o/ | 09:00 |
| *** untriaged-bot has quit IRC | 09:00 | |
| jistr | gfidente: rebasing the cinder bit now, looking at your comment "don't forget require on constraint::base" -- https://review.openstack.org/#/c/181067/3/puppet/manifests/overcloud_controller_pacemaker.pp | 09:03 |
| jistr | gfidente: are you sure that's needed? i'm not sure why would it be necessary | 09:04 |
| gfidente | have to make up my mind as well | 09:04 |
| jistr | ack. I'm thinking the creation of colocation vs. ordering constraints should be independent and having one shouldn't really be a prerequisite for having the other, but i'm not 100% sure. | 09:07 |
| gfidente | was it something we spotted in the module maybe>? | 09:08 |
| jistr | hmm no i don't recall... Astapor has them ordered using -> but i think they just have it this way to give some absolute ordering to things. Maybe if they flipped the order of the two constraints, it would be just as valid... | 09:09 |
| openstackgerrit | Lennart Regebro proposed openstack/tripleo-image-elements: Add roles to plan during Tuskar install https://review.openstack.org/184743 | 09:09 |
| jistr | gfidente: anyway, if the ordering really is a necessity, we'll see a CI failure on this exact thing soon | 09:10 |
| gfidente | :) | 09:10 |
| jistr | the constraint creation has a few retries and if it doesn't succeed, the whole deployment stops | 09:10 |
| openstackgerrit | Lennart Regebro proposed openstack/tripleo-image-elements: Add roles to plan during Tuskar install https://review.openstack.org/184743 | 09:11 |
| *** MasterPiece has joined #tripleo | 09:12 | |
| *** paramite|afk is now known as paramite | 09:15 | |
| gfidente | think we should merge https://review.openstack.org/#/c/184550/2 as well | 09:15 |
| jistr | gfidente: requested a recheck. We should try to treat the HA job as voting now unless we find out it's still too unstable. | 09:17 |
| jistr | i'm hoping that with the latest patches merged it shouldn't be that bad, we'll see :) | 09:18 |
| gfidente | yep | 09:20 |
| gfidente | jistr, how about https://review.openstack.org/#/c/184289/ ? | 09:22 |
| openstackgerrit | Mayank Kumar proposed openstack/tripleo-image-elements: Option to configure virtual_route through keepalived https://review.openstack.org/184547 | 09:24 |
| jistr | ooh i have missed somehow that we have an environments dir now. Nifty. | 09:24 |
| gfidente | jistr, https://review.openstack.org/#/c/183472/ ! ;) | 09:24 |
| *** rlandy has joined #tripleo | 09:24 | |
| gfidente | hi rlandy :) | 09:25 |
| rlandy | gfidente: hello | 09:25 |
| jistr | gfidente: we're missing HA job on changes that go to TOCI | 09:25 |
| gfidente | yeah is it worth it? | 09:26 |
| gfidente | jistr, is you want to add it, can you rebase on https://review.openstack.org/#/c/183473/ | 09:26 |
| gfidente | OR on the change below that? | 09:26 |
| gfidente | (not rebase but base on) | 09:26 |
| jistr | gfidente: yup | 09:27 |
| *** mayank0107 has joined #tripleo | 09:30 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Map NovaEnableRbdBackend to ephemeral_storage from nova::compute::rbd https://review.openstack.org/177117 | 09:32 |
| gfidente | jistr, so the galera-ready thing, would you move that on _master only | 09:33 |
| gfidente | or would you keep it around to enforce sync across nodes? | 09:33 |
| jistr | gfidente: i'd keep it around if it doesn't cause any trouble. Heat will enforce sync between steps anyway, but on the other hand it's nice to know that clustercheck is set up and working on all nodes, and the galera-ready step enforces that. | 09:34 |
| gfidente | jistr, I forgot to remove mysql_user :( | 09:39 |
| jistr | gfidente: ahahahaha | 09:39 |
| gfidente | well I removed it from template though | 09:39 |
| gfidente | sigh :( | 09:39 |
| gfidente | looks like we should remove EnablePacemaker from template as well, I left it there initially so that passing it as param to heat | 09:40 |
| gfidente | wouldn't break | 09:40 |
| gfidente | but my feeling is the sooner we get rid of it, the less it is going to confuse people | 09:40 |
| *** sdake has joined #tripleo | 09:40 | |
| rlandy | gfidente: hi - you ping'ed earlier? | 09:41 |
| jistr | gfidente: ack on that. We should keep the outer interface of tht up to date. | 09:42 |
| gfidente | we should remove sysctl from the images now as well | 09:42 |
| gfidente | lots of little thing here and there | 09:42 |
| gfidente | rlandy, testing the rebase | 09:43 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: We don't need to create the clustercheck user anymore https://review.openstack.org/184476 | 09:44 |
| rlandy | gfidente: +1 nice | 09:45 |
| gfidente | jistr, so one more thing which landed is the single image things from dprince | 09:47 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-incubator: Remove sysctl element from puppet image https://review.openstack.org/184749 | 09:47 |
| gfidente | jistr, I'd merge this https://review.openstack.org/#/c/184737/ if passes CI | 09:50 |
| *** MasterPiece has quit IRC | 09:51 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Remove unused EnablePacemaker param from templates https://review.openstack.org/184751 | 09:54 |
| gfidente | I would also abandon this https://review.openstack.org/#/c/184252/ if we don't see the error popping up again | 09:55 |
| gfidente | https://review.openstack.org/#/c/184737/ green :) I'd merge | 09:57 |
| jistr | pblaho: ^ please? :) simple 4 line change with green CI | 09:59 |
| jistr | gfidente: fyi https://review.openstack.org/#/c/184752/ | 10:00 |
| *** paramite is now known as paramite|afk | 10:01 | |
| gfidente | jistr, yeah those don't pop up with the bot | 10:03 |
| *** dguerri is now known as dguerri`away | 10:08 | |
| *** dguerri`away is now known as dguerri | 10:08 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Start non-pacemakerized services in step 4 https://review.openstack.org/184737 | 10:11 |
| pblaho | jistr, gfidente: acked | 10:11 |
| jistr | pblaho: thx! | 10:11 |
| *** dguerri is now known as dguerri`away | 10:15 | |
| *** paramite|afk is now known as paramite | 10:15 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates: Add Cinder services as Pacemaker resources https://review.openstack.org/181067 | 10:17 |
| openstackgerrit | Lennart Regebro proposed openstack/tripleo-image-elements: Add roles to plan during Tuskar install https://review.openstack.org/184743 | 10:18 |
| *** sdake has quit IRC | 10:26 | |
| *** mcornea has quit IRC | 10:27 | |
| gfidente | jistr, so I can copy things :) | 10:28 |
| gfidente | going for some lunch first :) | 10:28 |
| *** jtomasek has quit IRC | 10:29 | |
| jistr | gfidente: didn't test the Cinder bit locally yet, having trouble getting a quorum in pacemaker, rebuilding the whole setup now. I'm not sure what was the problem. | 10:30 |
| jistr | and yeah i'll go for lunch soon too | 10:30 |
| *** paramite is now known as paramite|afk | 10:41 | |
| *** mcornea has joined #tripleo | 10:58 | |
| *** mcornea has quit IRC | 11:05 | |
| *** panda has quit IRC | 11:21 | |
| *** panda has joined #tripleo | 11:21 | |
| *** mcornea has joined #tripleo | 11:22 | |
| *** thrash|g0ne is now known as thrash | 11:26 | |
| *** masco has quit IRC | 11:26 | |
| *** yog_ has quit IRC | 11:28 | |
| *** larsks has quit IRC | 11:46 | |
| *** HenryG has quit IRC | 11:47 | |
| *** mayank0107 has quit IRC | 11:48 | |
| *** larsks has joined #tripleo | 11:48 | |
| *** HenryG has joined #tripleo | 11:50 | |
| *** paramite|afk is now known as paramite | 11:50 | |
| jistr | hmm do we need even longer timeout? | 11:50 |
| jistr | for the HA job | 11:50 |
| jistr | see http://logs.openstack.org/50/184550/2/check-tripleo/check-tripleo-ironic-overcloud-f20puppet-ha/d35a79f/console.html | 11:50 |
| *** chlong has quit IRC | 11:50 | |
| jistr | 2015-05-21 11:08:54.251 | COMMAND=heat stack-show overcloud | awk '/stack_status / { print $4 }' | 11:50 |
| jistr | 2015-05-21 11:08:54.251 | OUTPUT=CREATE_IN_PROGRESS | 11:50 |
| jistr | but then: | 11:50 |
| jistr | 2015-05-21 11:09:41.313 | | stack_status | CREATE_COMPLETE | 11:52 |
| jistr | this job literally timed out by a 1 second difference | 11:52 |
| jistr | s/second/minute/ actually ;) | 12:03 |
| *** chlong has joined #tripleo | 12:03 | |
| *** mcornea has quit IRC | 12:07 | |
| *** mcornea has joined #tripleo | 12:08 | |
| *** jayg|g0n3 is now known as jayg | 12:09 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates: Add Cinder services as Pacemaker resources https://review.openstack.org/181067 | 12:17 |
| *** paramite is now known as paramite|afk | 12:21 | |
| *** paramite|afk is now known as paramite | 12:23 | |
| jistr | so i just deployed locally | 12:34 |
| jistr | the stack create took 10 minutes | 12:35 |
| * jistr double checks | 12:35 | |
| gfidente | yeah I see a job timing out as well but all resources are in CREATE_COMPLETE | 12:35 |
| jistr | yeah 10 minutes | 12:36 |
| jistr | gfidente: isn't it the one i linked above? | 12:36 |
| jistr | gfidente: 184550 | 12:36 |
| jistr | gfidente: that one is funny, because it timed out, but when it collected the post-failure debugging output, it was actually finished. if the timeout was 1 minute longer, the job might have succeeded | 12:37 |
| jistr | but still | 12:37 |
| *** dguerri`away is now known as dguerri | 12:37 | |
| jistr | how come local stack-create takes 10 minutes and on CI it takes > 1 hour | 12:38 |
| pino|work | vm? | 12:38 |
| jistr | i've just had a full e2e HA deployment run in 14 minutes, including spawning and pinging an instance in overcloud | 12:38 |
| gfidente | I have one which after 1h was still running, from os-collect-config | 12:38 |
| jistr | pino|work: yeah it's both vms | 12:38 |
| jistr | gfidente: local or CI? | 12:39 |
| gfidente | CI | 12:39 |
| jistr | yeah i wonder if the CI workers are so overloaded that things take so long? | 12:40 |
| jistr | or is there some actual difference in CI env besides high load | 12:40 |
| jistr | gfidente: anyway for now, if we want the HA CI jobs to be of any use, i think we'll need to further increase the timeout | 12:41 |
| gfidente | jistr, so when you look at your local os-collect-config | 12:41 |
| gfidente | from one of the controllers | 12:41 |
| gfidente | grep for "Running /var/lib/heat-config/hooks/puppet" (which we should see 4 times) | 12:42 |
| gfidente | on the CI vm, that line is printed at May 21 11:16:55 | 12:42 |
| gfidente | and the next line announcing catalog compiled is at | 12:42 |
| gfidente | May 21 11:19:44 | 12:42 |
| gfidente | so it took almost 3mins to compile | 12:43 |
| gfidente | maybe we can use it as param to compare with local env? | 12:43 |
| jistr | [root@ov-xytbfg2tg3e-0-eg7hdf6mpwjf-controller-eyo676uwjygp ~]# journalctl -u os-collect-config | grep "Running /var/lib/heat-config/hooks/puppet" | awk '{ print $3 }' | 12:43 |
| jistr | 12:26:49 | 12:43 |
| jistr | 12:28:34 | 12:43 |
| jistr | 12:30:01 | 12:43 |
| jistr | 12:30:14 | 12:43 |
| jistr | 12:32:40 | 12:43 |
| gfidente | and "Compiled catalog for" ? | 12:44 |
| *** ishant has quit IRC | 12:44 | |
| gfidente | on this vm the first run is at May 21 11:05:43, the second at May 21 11:09:17 | 12:45 |
| gfidente | then May 21 11:10:40 and May 21 11:11:35 | 12:45 |
| gfidente | finally May 21 11:16:55 | 12:45 |
| jistr | hm that's not *so* bad... | 12:46 |
| jistr | gfidente: compiling the catalog takes about 40 seconds on my env | 12:47 |
| jistr | gfidente: actually the first compilation took a bit longer, ~70 seconds | 12:48 |
| gfidente | so the VM was writing its last refresh complete at May 21 11:19:54 | 12:48 |
| gfidente | which means it is slower, but not so bad indeed | 12:48 |
| gfidente | from 11.05 to 11.19 to finish the entire puppet process | 12:49 |
| jistr | some different VM might have slowed it down then? which job are you looking at? | 12:49 |
| gfidente | it must be something else slowing down things | 12:49 |
| gfidente | 177117/4 | 12:49 |
| *** trown|outttypeww is now known as trown | 12:54 | |
| jistr | oh... actually it's another job which times out http://logs.openstack.org/50/184550/2/check-tripleo/check-tripleo-ironic-overcloud-f20puppet-ha/d35a79f/console.html#_2015-05-21_11_08_54_251 | 12:55 |
| *** CaptTofu_ is now known as CaptTofu | 12:55 | |
| jistr | but stack-create is in fact complete http://logs.openstack.org/50/184550/2/check-tripleo/check-tripleo-ironic-overcloud-f20puppet-ha/d35a79f/console.html#_2015-05-21_11_09_41_313 | 12:55 |
| jistr | WUT | 12:55 |
| gfidente | yeah | 12:55 |
| gfidente | by comparison, the single node run, for 177117/4 | 12:55 |
| openstackgerrit | Lennart Regebro proposed openstack/tripleo-image-elements: Add roles to plan during Tuskar install https://review.openstack.org/184743 | 12:56 |
| gfidente | has first occurrence of 'Running' at May 21 10:43:3 and last completed at May 21 10:47:52 | 12:56 |
| gfidente | so heat/puppet takes 5 mins on single node and 14 mins with three controllers in parallel | 12:57 |
| gfidente | single node job starts at 09:32:35.678 and gets to deploying at 10.39.46 | 12:59 |
| gfidente | three controllers start at 9.32 gets to deploying at 10.21 | 13:00 |
| jistr | oh see this | 13:00 |
| jistr | http://logs.openstack.org/50/184550/2/check-tripleo/check-tripleo-ironic-overcloud-f20puppet-ha/d35a79f/console.html#_2015-05-21_11_09_42_767 | 13:00 |
| gfidente | yeah this completed it seems | 13:00 |
| jistr | but | 13:00 |
| jistr | i meant the times | 13:00 |
| gfidente | probably timed out during users creation | 13:01 |
| jistr | heat stack-create starts at 10:04 | 13:01 |
| jistr | but puppet only starts running at 10:50 | 13:01 |
| jistr | it's not the config which is slow | 13:01 |
| jistr | it's the phases before | 13:01 |
| gfidente | the actual VMs spin up | 13:02 |
| jistr | yes | 13:02 |
| *** dasm is now known as dasm|afk | 13:02 | |
| gfidente | ack for 177117/4 same issue | 13:03 |
| jistr | Controller | 809e1980-e833-4ed6-ab98-3f9304c7b7c0 | state changed | CREATE_IN_PROGRESS | 2015-05-21T10:04:15Z | 13:03 |
| jistr | Controller | 516840aa-fd38-41ad-8ee3-ed167d995708 | state changed | CREATE_COMPLETE | 2015-05-21T10:18:48Z | 13:03 |
| gfidente | stack-create is at 10.21 but first puppet run is at 11.05 | 13:03 |
| jistr | Compute | 2e339aa2-9479-4366-8ff6-7658323aa76a | state changed | CREATE_IN_PROGRESS | 2015-05-21T10:04:14Z | 13:03 |
| jistr | Compute | 8b186328-a75d-4c12-af8d-79cb4eab423c | state changed | CREATE_COMPLETE | 2015-05-21T10:50:00Z | 13:03 |
| gfidente | so what do we do? | 13:06 |
| jistr | in 177117/4 the order is vice versa, controllers took longer | 13:06 |
| jistr | 2015-05-21 11:22:37.579 | | Compute | 234719bc-aa53-4c44-b2cd-134733aaab55 | state changed | CREATE_COMPLETE | 2015-05-21T10:33:26Z | | 13:06 |
| jistr | 2015-05-21 11:22:37.579 | | Controller | 72b821a6-7f4c-48fd-82f1-98ae7f3c0e9a | state changed | CREATE_COMPLETE | 2015-05-21T11:04:19Z | | 13:06 |
| jistr | so it's not a problem specific to compute or controller | 13:06 |
| jistr | it's probably waiting for resources to free up | 13:06 |
| jistr | or i don't know what else could it be | 13:07 |
| gfidente | derek might be able to help | 13:07 |
| jistr | the reason why this problem manifests in HA deployments is probably just that we need to reserve 4 nodes instead of 2 | 13:08 |
| *** adrianopetrich has quit IRC | 13:08 | |
| jistr | gfidente: so... i'd say we should bump up the timeout temporarily? 90 minutes maybe? | 13:09 |
| gfidente | yeah | 13:10 |
| jistr | gfidente: ack, i'm on it | 13:10 |
| gfidente | looks like the only way | 13:10 |
| *** adrianopetrich has joined #tripleo | 13:10 | |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci: Bump up HA job timeout for resource availability https://review.openstack.org/184782 | 13:20 |
| gfidente | jistr, oh the commit message is wrong though | 13:25 |
| gfidente | you only get COMPLETE when the puppet apply finished | 13:25 |
| gfidente | so the real issue there is | 13:25 |
| jprovazn | any cores here who would have a minute for a review? https://review.openstack.org/#/c/184442/ | 13:25 |
| gfidente | while puppet apply takes 14mins, the VMs only become available 30mins after stack-create is launched | 13:26 |
| jistr | gfidente: i think you get COMPLETE on the Compute/Controller before Puppet starts, no? I think the ControllerPostDeployment etc. aren't part of the Controller resource, they depend on it, which means Puppet can only start when Controller resource is CREATE_COMPLETE. I need to verify that though. | 13:27 |
| gfidente | yes! | 13:28 |
| gfidente | I missed you were quoting the resources and not the Deployment :) | 13:28 |
| jistr | haha ok :) | 13:28 |
| jistr | jprovazn: will look. We need to wait for CI to verify a CI fix and then re-CI everything anyway :D | 13:28 |
| gfidente | sorry :) | 13:29 |
| jprovazn | jistr: thanks, sounds like plenty of time :) | 13:29 |
| *** marzif has quit IRC | 13:31 | |
| *** jprovazn has quit IRC | 13:32 | |
| *** marzif has joined #tripleo | 13:32 | |
| *** regebro has quit IRC | 13:37 | |
| jistr | wow nice so heat now supports selecting which nodes to remove when scaling down | 13:38 |
| jistr | +2 | 13:39 |
| pino|work | jistr: could you please let r183891 in? it already got +2 and w+1 | 13:40 |
| * jistr looks | 13:40 | |
| jistr | pino|work: yeah it depends on a patch which didn't get +2+2+A | 13:41 |
| jistr | pino|work: that's why it's not in yet | 13:41 |
| pino|work | ah ok, grr | 13:41 |
| jistr | i think i'll let the dep for StevenK to review too then, it's not exactly my area | 13:42 |
| pino|work | greghaynes: can you please detach r183891 from the current dependency chain? | 13:43 |
| *** yamahata has joined #tripleo | 13:49 | |
| *** masco has joined #tripleo | 13:55 | |
| *** lblanchard has joined #tripleo | 13:57 | |
| *** julim has joined #tripleo | 14:06 | |
| *** ukalifon1 has quit IRC | 14:16 | |
| *** masco has quit IRC | 14:22 | |
| jistr | can we get another +2 so that we can merge as soon as CI passes? https://review.openstack.org/#/c/184782 | 14:32 |
| jistr | this is another CI fix | 14:32 |
| *** radek__ has joined #tripleo | 14:32 | |
| *** links has quit IRC | 14:34 | |
| * jistr reloc | 14:49 | |
| *** jistr has quit IRC | 14:49 | |
| *** yamahata has quit IRC | 14:52 | |
| *** aufi has quit IRC | 14:52 | |
| *** untriaged-bot has joined #tripleo | 15:00 | |
| untriaged-bot | No untriaged bugs so far! \o/ | 15:00 |
| *** untriaged-bot has quit IRC | 15:00 | |
| *** tteggel has quit IRC | 15:08 | |
| *** tteggel has joined #tripleo | 15:09 | |
| *** jistr has joined #tripleo | 15:11 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add Glance as Pacemaker resource https://review.openstack.org/178152 | 15:12 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add Cinder services as Pacemaker resources https://review.openstack.org/181067 | 15:12 |
| gfidente | again :( | 15:12 |
| gfidente | jistr, ^^ actually this is the only time where updating was beneficial | 15:13 |
| *** radek__ has quit IRC | 15:13 | |
| pino|work | gfidente: he's gone | 15:15 |
| jistr | i'm not! :P | 15:15 |
| gfidente | he just joined ! | 15:15 |
| gfidente | pino|work, I got +2 superpower so we can merge all the things now though | 15:15 |
| *** jistr is now known as jistr|mtg | 15:15 | |
| pino|work | ah uh, didn't notice he was back from home | 15:15 |
| *** cwolferh has quit IRC | 15:18 | |
| *** panda has quit IRC | 15:21 | |
| *** panda has joined #tripleo | 15:21 | |
| *** Marga_ has joined #tripleo | 15:24 | |
| *** jistr|mtg is now known as jistr | 15:25 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Bump up HA job timeout for resource availability https://review.openstack.org/184782 | 15:29 |
| jistr | thx pblaho ! | 15:30 |
| jistr | gfidente: ^ | 15:30 |
| jistr | recheck all the things | 15:30 |
| * jistr on it | 15:30 | |
| *** mestery has joined #tripleo | 15:31 | |
| *** paramite has quit IRC | 15:31 | |
| openstackgerrit | Merged openstack/tripleo-common: Scale down heat stack https://review.openstack.org/184442 | 15:31 |
| *** Marga_ has quit IRC | 15:35 | |
| *** Marga_ has joined #tripleo | 15:36 | |
| *** jistr has quit IRC | 15:38 | |
| *** pino|work has quit IRC | 15:40 | |
| *** Marga_ has quit IRC | 15:50 | |
| *** Marga_ has joined #tripleo | 15:50 | |
| *** mestery has quit IRC | 15:51 | |
| *** ifarkas has quit IRC | 15:53 | |
| *** mestery has joined #tripleo | 15:54 | |
| *** sdake has joined #tripleo | 15:54 | |
| *** sdake has quit IRC | 16:00 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Overcloud: bump HOT version to 2015-04-30 https://review.openstack.org/184550 | 16:03 |
| *** david-lyle has joined #tripleo | 16:07 | |
| *** alop has joined #tripleo | 16:08 | |
| *** lazy_prince has quit IRC | 16:19 | |
| *** cwolferh has joined #tripleo | 16:20 | |
| *** tzumainn has joined #tripleo | 16:24 | |
| *** dguerri is now known as dguerri`away | 16:26 | |
| *** athomas has joined #tripleo | 16:31 | |
| *** akrivoka has joined #tripleo | 16:36 | |
| *** pdb has joined #tripleo | 16:38 | |
| *** pdb has quit IRC | 16:44 | |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Update delorean URL https://review.openstack.org/184640 | 16:44 |
| *** mcornea has quit IRC | 16:45 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Align puppet Controller post-deploy Deployment names https://review.openstack.org/182381 | 16:47 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add support for generic controller validations https://review.openstack.org/174150 | 16:47 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: overcloud stepped deployment environment https://review.openstack.org/161927 | 16:47 |
| *** akrivoka has quit IRC | 16:48 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Align puppet Controller post-deploy Deployment names https://review.openstack.org/182381 | 16:50 |
| *** david-lyle has quit IRC | 16:56 | |
| *** david-lyle has joined #tripleo | 16:57 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-incubator: Adding stepped deployment to devtest_overcloud.sh https://review.openstack.org/162109 | 16:58 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-incubator: Adding stepped deployment to devtest_overcloud.sh https://review.openstack.org/162109 | 17:02 |
| *** athomas has quit IRC | 17:05 | |
| *** mestery has quit IRC | 17:07 | |
| *** daneyon has joined #tripleo | 17:11 | |
| *** daneyon_ has joined #tripleo | 17:15 | |
| *** daneyon has quit IRC | 17:18 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-incubator: devtest_testenv.sh: support for multiple bridges https://review.openstack.org/177880 | 17:30 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-incubator: Wire --vlan-trunk-ids into devtest_testenv.sh https://review.openstack.org/183588 | 17:30 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-incubator: Rename brbm.xml template to net.xml https://review.openstack.org/183539 | 17:30 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-incubator: setup-network: add support for vlan trunks https://review.openstack.org/183540 | 17:30 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-incubator: cleanup-env: Allow configurable bridge names. https://review.openstack.org/177877 | 17:30 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-incubator: Move vm.xml to domain.xml https://review.openstack.org/183541 | 17:30 |
| *** jcoufal has joined #tripleo | 17:31 | |
| *** daneyon_ has quit IRC | 17:34 | |
| *** alop has quit IRC | 17:35 | |
| *** david-lyle has quit IRC | 17:42 | |
| *** daneyon has joined #tripleo | 17:43 | |
| *** MasterPiece has joined #tripleo | 17:43 | |
| *** zaneb has joined #tripleo | 17:49 | |
| openstackgerrit | Ryan Hefner proposed openstack/tripleo-heat-templates: Enable NetApp Backends in Cinder https://review.openstack.org/184839 | 17:50 |
| *** jcoufal has quit IRC | 17:51 | |
| *** alop has joined #tripleo | 17:53 | |
| *** zaneb has quit IRC | 17:54 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-incubator: Update puppet docs to set ROOT_DISK https://review.openstack.org/176337 | 17:58 |
| *** david-lyle has joined #tripleo | 18:05 | |
| *** jcoufal has joined #tripleo | 18:16 | |
| *** athomas has joined #tripleo | 18:28 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-puppet-elements: Create a puppet stable dependencies module https://review.openstack.org/184844 | 18:30 |
| *** jdob has joined #tripleo | 18:41 | |
| *** david-lyle has quit IRC | 18:42 | |
| *** Goneri has quit IRC | 18:43 | |
| *** alop has quit IRC | 18:44 | |
| *** alop has joined #tripleo | 18:48 | |
| openstackgerrit | Ryan Hefner proposed openstack/tripleo-heat-templates: Enable NetApp Backends in Cinder https://review.openstack.org/184839 | 18:49 |
| *** alop has quit IRC | 18:49 | |
| *** david-lyle has joined #tripleo | 18:53 | |
| *** sdake has joined #tripleo | 18:57 | |
| *** Marga_ has quit IRC | 18:59 | |
| *** morazi has joined #tripleo | 18:59 | |
| *** david-lyle has quit IRC | 19:08 | |
| openstackgerrit | Jay Dobies proposed openstack/tuskar: Alter the type for the contents column of stored_file https://review.openstack.org/184481 | 19:15 |
| openstackgerrit | Jay Dobies proposed openstack/tuskar: Alter the type for the contents column of stored_file https://review.openstack.org/184481 | 19:15 |
| *** panda has quit IRC | 19:21 | |
| *** panda has joined #tripleo | 19:22 | |
| *** gfidente has quit IRC | 19:22 | |
| *** morazi has quit IRC | 19:26 | |
| *** athomas has quit IRC | 19:26 | |
| *** wfoster_ has joined #tripleo | 19:27 | |
| *** jdob has quit IRC | 19:28 | |
| *** wfoster has quit IRC | 19:28 | |
| *** sdake has quit IRC | 19:31 | |
| *** rlandy has quit IRC | 19:37 | |
| *** jcoufal has quit IRC | 19:40 | |
| *** tzumainn has quit IRC | 19:41 | |
| *** daneyon has quit IRC | 19:43 | |
| *** trown is now known as trown|outttypeww | 20:07 | |
| *** cwolferh has quit IRC | 20:15 | |
| *** lblanchard has quit IRC | 20:17 | |
| openstackgerrit | Merged openstack/diskimage-builder: Initial element tests https://review.openstack.org/174681 | 20:19 |
| openstackgerrit | Merged openstack/diskimage-builder: Install debian locales https://review.openstack.org/183891 | 20:19 |
| *** akrivoka has joined #tripleo | 20:19 | |
| *** tzumainn has joined #tripleo | 20:24 | |
| *** tzumainn has joined #tripleo | 20:24 | |
| *** jcoufal has joined #tripleo | 20:25 | |
| *** pdb has joined #tripleo | 20:27 | |
| *** daneyon has joined #tripleo | 20:30 | |
| *** david-lyle has joined #tripleo | 20:35 | |
| *** pdb has quit IRC | 20:36 | |
| *** akrivoka has quit IRC | 20:39 | |
| *** daneyon_ has joined #tripleo | 20:42 | |
| *** daneyon_ has quit IRC | 20:43 | |
| *** daneyon_ has joined #tripleo | 20:44 | |
| *** jcoufal has quit IRC | 20:44 | |
| *** daneyon has quit IRC | 20:45 | |
| *** untriaged-bot has joined #tripleo | 21:00 | |
| untriaged-bot | No untriaged bugs so far! \o/ | 21:00 |
| *** untriaged-bot has quit IRC | 21:00 | |
| *** Marga_ has joined #tripleo | 21:00 | |
| *** tzumainn has quit IRC | 21:03 | |
| *** Marga_ has quit IRC | 21:05 | |
| *** weshay has joined #tripleo | 21:13 | |
| *** daneyon_ has quit IRC | 21:16 | |
| *** david-lyle has quit IRC | 21:17 | |
| *** jayg is now known as jayg|g0n3 | 21:19 | |
| *** david-lyle has joined #tripleo | 21:23 | |
| *** mestery has joined #tripleo | 21:24 | |
| *** zaneb has joined #tripleo | 21:26 | |
| *** zaneb has quit IRC | 21:33 | |
| *** weshay has quit IRC | 21:34 | |
| *** MasterPiece has quit IRC | 21:38 | |
| *** cody-somerville has joined #tripleo | 21:39 | |
| *** abckey has joined #tripleo | 21:49 | |
| *** abckey has left #tripleo | 21:50 | |
| *** alop has joined #tripleo | 21:50 | |
| *** jcoufal has joined #tripleo | 21:59 | |
| openstackgerrit | Abel Lopez proposed openstack/diskimage-builder: Use environment setfiles https://review.openstack.org/174561 | 21:59 |
| *** alop has quit IRC | 22:00 | |
| *** athomas has joined #tripleo | 22:04 | |
| *** athomas has quit IRC | 22:08 | |
| *** jcoufal has quit IRC | 22:08 | |
| *** thrash is now known as thrash|g0ne | 22:10 | |
| *** mestery has quit IRC | 22:11 | |
| *** mestery has joined #tripleo | 22:11 | |
| *** jdob has joined #tripleo | 22:13 | |
| *** dsneddon has joined #tripleo | 22:13 | |
| *** akrivoka has joined #tripleo | 22:19 | |
| Ng | greghaynes: for the "can we make an image that boot" tests, I really want to find a clever way to tell from qemu, when a guest kernel has initialised :) | 22:19 |
| *** mestery has quit IRC | 22:19 | |
| Ng | like, there ought to be some way to detect that the VM's "hardware" is being used by a kernel, rather than wait for the thing to boot all the way up | 22:19 |
| greghaynes | Ng: eject cd rom drive | 22:20 |
| greghaynes | :p | 22:20 |
| Ng | haha | 22:20 |
| Ng | I meant inspecting it purely from outside :P | 22:20 |
| *** mestery has joined #tripleo | 22:20 | |
| Ng | like you can poke at qemu's monitor interface and dump memory. Maybe there's a magic string in RAM somewhere that tells you within a few seconds "ok the bootloader worked, because Linux is in RAM" | 22:21 |
| greghaynes | Ng: I wonder if we can watch CTS or similar line on the virtual serial port | 22:21 |
| *** chlong has quit IRC | 22:23 | |
| *** cwolferh has joined #tripleo | 22:39 | |
| *** dsneddon has quit IRC | 22:39 | |
| *** weshay has joined #tripleo | 22:41 | |
| *** sdake has joined #tripleo | 22:42 | |
| *** david-lyle has quit IRC | 22:48 | |
| d0ugal | o/ | 22:50 |
| Ng | greghaynes: there must be at least one thing like that, which gives you a super quick "yup, that booted" test result | 22:50 |
| greghaynes | Ng: Yea, so I guess the question is at what point is 'booted' - are you fine if it doesnt get to pivot root for example? | 22:51 |
| greghaynes | Ng: We could grep for activity on the tap interface | 22:52 |
| *** akrivoka has quit IRC | 22:52 | |
| Ng | greghaynes: well I guess it depends what the test is, if it's "can we write a bootloader that works", then the presence of a running kernel suggests yes | 22:52 |
| *** david-lyle has joined #tripleo | 22:54 | |
| *** jdob has quit IRC | 22:55 | |
| clarkb | fwiw booting ubuntu totally works its just slow on qemu | 22:56 |
| clarkb | ~400 seconds to finish initing on our jenkins slaves | 22:56 |
| *** mestery has quit IRC | 23:07 | |
| *** mestery has joined #tripleo | 23:07 | |
| *** david-lyle has quit IRC | 23:08 | |
| *** mestery has quit IRC | 23:09 | |
| *** weshay has quit IRC | 23:09 | |
| *** mestery has joined #tripleo | 23:14 | |
| *** mestery has quit IRC | 23:15 | |
| *** mestery has joined #tripleo | 23:16 | |
| *** chlong has joined #tripleo | 23:16 | |
| *** mestery has quit IRC | 23:18 | |
| *** mestery has joined #tripleo | 23:19 | |
| *** panda has quit IRC | 23:21 | |
| *** panda has joined #tripleo | 23:21 | |
| *** daneyon has joined #tripleo | 23:21 | |
| *** rainya has joined #tripleo | 23:26 | |
| *** Marga_ has joined #tripleo | 23:29 | |
| openstackgerrit | Merged openstack/diskimage-builder: Simple-init should disable cloud-init https://review.openstack.org/181977 | 23:29 |
| *** cody-somerville has quit IRC | 23:31 | |
| *** daneyon has quit IRC | 23:35 | |
| clarkb | greghaynes: SpamapS mordred ^ is that related to the thing I ran into/ | 23:45 |
| clarkb | I don't remember cloud-init running | 23:45 |
| greghaynes | No | 23:45 |
| greghaynes | -minimal doesnt have cloud init on it | 23:46 |
| clarkb | kk | 23:49 |
| *** mestery has quit IRC | 23:51 | |
| *** Marga_ has quit IRC | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!