Thursday, 2013-12-26

jog0lifeless: right now we require nova.conf for an havana cloud to work for an icehouse cloud with no modifications.00:03
jog0right now we cannot do a rolling upgrade without touching nova.conf files00:04
jog0but we can do a non-rolling upgrade without touching the nova.conf file00:04
jog0the question is: in that acceptable or not00:04
lifelessah00:07
lifelessso, it would be a lot easier if rolling upgrades didn'00:07
lifelesst require the editing dance that is in use today00:07
lifelessbut it's not a matter of 'acceptable' - we can cope either way00:08
lifelessright now it would be00:08
lifelessone stack-update to set the version locks00:08
lifelessone stack-update to upgrade the conductor instances00:08
lifelessone stack-update to ugprade the hypervisors and other things00:08
lifelessone stack-update to remove the version locks00:08
lifelessyou can see that that's pretty messy, but doable00:08
*** funzo has joined #tripleo00:11
*** funzo has quit IRC00:16
*** CaptTofu has joined #tripleo00:37
jog0right the current system works, but are we happy enough with that answer or do we make version locks controllable via an REST API00:41
jog0I'm on the fence on this.  one one hand, I think its reasonable to say that to do rolling upgrades you should have some config file management, but on the other hand this is really ugly.  Of course if someone worked on this it would be great, but I am leaning towards saying what we have is good enough and this should be a blueprint for the future.00:44
lifelessshort term I think we have bigger fish to fry00:52
lifelesslong term, nova should do it all internally00:52
lifelessthere is no reason nova can't know what versions are around and just pick the most conservative00:52
jog0lifeless: agreed00:53
*** boris-42 has quit IRC00:58
*** nosnos has joined #tripleo01:08
*** funzo has joined #tripleo01:12
*** funzo has quit IRC01:17
*** CaptTofu has quit IRC01:22
*** funzo has joined #tripleo02:12
*** funzo has quit IRC02:17
*** rongze has joined #tripleo02:18
*** yamahata_ has joined #tripleo02:26
*** slagle has joined #tripleo02:28
*** ccrouch has joined #tripleo02:29
*** michchap_ has joined #tripleo02:29
*** nosnos_ has joined #tripleo02:31
*** phschwartz_ has joined #tripleo02:32
*** nosnos has quit IRC02:33
*** michchap has quit IRC02:34
*** ccrouch1 has quit IRC02:34
*** phschwartz has quit IRC02:34
*** yamahata__ has quit IRC02:34
*** slagle has quit IRC02:35
*** vkozhukalov has joined #tripleo03:06
*** funzo has joined #tripleo03:13
*** funzo has quit IRC03:18
*** funzo has joined #tripleo04:14
*** funzo has quit IRC04:19
*** rongze has quit IRC04:46
*** akuznetsov has joined #tripleo05:13
*** funzo has joined #tripleo05:15
*** funzo has quit IRC05:20
*** rpodolyaka1 has joined #tripleo05:40
*** funzo has joined #tripleo06:16
*** rushiagr has joined #tripleo06:17
*** funzo has quit IRC06:21
*** rongze has joined #tripleo06:21
*** rushiagr2 has joined #tripleo06:21
*** rushiagr has quit IRC06:21
*** rushiagr2 has quit IRC06:22
*** rushiagr2 has joined #tripleo06:25
rpodolyaka1morning tripleo06:48
*** rlandy has joined #tripleo06:50
*** rushiagr has joined #tripleo07:16
*** funzo has joined #tripleo07:16
*** rushiagr2 has joined #tripleo07:20
*** vkozhukalov has quit IRC07:21
*** rushiagr has quit IRC07:21
*** funzo has quit IRC07:21
*** rushiagr3 has joined #tripleo07:24
*** rushiagr2 has quit IRC07:25
*** rpodolyaka1 has quit IRC07:29
*** rushiagr3 is now known as rushiagr07:30
*** rushiagr has quit IRC08:04
*** rushiagr has joined #tripleo08:04
*** funzo has joined #tripleo08:17
*** funzo has quit IRC08:22
*** akuznetsov has quit IRC08:23
*** rushiagr has quit IRC08:28
*** rushiagr has joined #tripleo08:29
*** rushiagr has quit IRC08:33
*** akuznetsov has joined #tripleo09:09
*** max_lobur_afk is now known as max_lobur09:12
*** funzo has joined #tripleo09:18
*** vkozhukalov has joined #tripleo09:21
*** funzo has quit IRC09:23
*** boris-42 has joined #tripleo09:37
*** nosnos_ has quit IRC09:38
*** nosnos has joined #tripleo09:41
*** akuznetsov has quit IRC09:43
openstackgerritVictor Sergeyev proposed a change to openstack/python-tuskarclient: Use common Manager from Oslo code  https://review.openstack.org/6411609:57
*** vkozhukalov_ has joined #tripleo10:09
*** rlandy has quit IRC10:15
*** vkozhukalov_ has quit IRC10:15
*** vkozhukalov has quit IRC10:15
*** vkozhukalov has joined #tripleo10:16
*** funzo has joined #tripleo10:19
*** funzo has quit IRC10:24
*** nosnos has quit IRC10:27
*** akuznetsov has joined #tripleo10:28
*** vkozhukalov has quit IRC10:35
*** vkozhukalov has joined #tripleo10:38
*** rushiagr has joined #tripleo10:44
*** rongze has quit IRC10:45
*** rushiagr has quit IRC10:53
*** rushiagr has joined #tripleo11:02
*** rlandy has joined #tripleo11:03
*** rushiagr2 has joined #tripleo11:09
*** rushiagr has quit IRC11:12
*** rushiagr3 has joined #tripleo11:13
*** rushiagr2 has quit IRC11:14
*** funzo has joined #tripleo11:19
*** funzo has quit IRC11:24
*** rushiagr4 has joined #tripleo11:35
*** rushiagr3 has quit IRC11:36
*** rushiagr has joined #tripleo11:56
*** rongze has joined #tripleo11:56
*** rushiagr4 has quit IRC11:57
*** rongze has quit IRC12:01
*** rongze has joined #tripleo12:03
*** rushiagr has quit IRC12:11
*** rushiagr has joined #tripleo12:14
*** ohadlevy has quit IRC12:16
*** rushiagr2 has joined #tripleo12:18
*** ohadlevy has joined #tripleo12:18
*** ohadlevy is now known as Guest8647012:18
*** rushiagr has quit IRC12:19
*** funzo has joined #tripleo12:20
*** funzo has quit IRC12:25
*** rushiagr3 has joined #tripleo12:25
*** rushiagr2 has quit IRC12:26
*** rushiagr3 is now known as rushiagr12:30
*** Guest86470 has quit IRC12:44
*** ohadlevy_ has joined #tripleo12:47
*** ohadlevy_ has quit IRC12:51
*** rushiagr2 has joined #tripleo12:53
*** ohadlevy_ has joined #tripleo12:53
*** rushiagr has quit IRC12:54
*** rushiagr2 has quit IRC12:54
*** ohadlevy_ has quit IRC13:03
*** ohadlevy_ has joined #tripleo13:05
*** rushiagr2 has joined #tripleo13:10
*** rushiagr2 is now known as rushiagr_away13:10
*** rushiagr_away has quit IRC13:18
*** rushiagr_away has joined #tripleo13:18
*** rushiagr_away is now known as rushiagr213:19
*** funzo has joined #tripleo13:21
*** rushiagr3 has joined #tripleo13:23
*** rushiagr2 has quit IRC13:23
*** vkozhukalov has quit IRC13:24
*** funzo has quit IRC13:25
*** rushiagr4 has joined #tripleo13:32
*** slagle has joined #tripleo13:32
*** rushiagr3 has quit IRC13:32
*** CaptTofu has joined #tripleo13:34
*** rushiagr has joined #tripleo13:49
*** rushiagr4 has quit IRC13:49
*** rushiagr has quit IRC13:58
*** rushiagr2 has joined #tripleo13:58
*** rushiagr2 is now known as rushiagr_away14:12
*** boris-42 has quit IRC14:15
*** funzo has joined #tripleo14:22
*** funzo has quit IRC14:26
*** CaptTofu has quit IRC14:42
*** CaptTofu has joined #tripleo14:42
*** rushiagr_away is now known as rushiagr214:46
*** mrunge has joined #tripleo14:52
*** rongze has quit IRC14:54
*** rushiagr2 has quit IRC14:55
*** rushiagr2 has joined #tripleo14:55
*** rushiagr2 has quit IRC14:59
*** rushiagr2 has joined #tripleo15:00
*** rushiagr3 has joined #tripleo15:07
*** rushiagr2 has quit IRC15:08
*** rushiagr4 has joined #tripleo15:17
*** rushiagr3 has quit IRC15:18
*** funzo has joined #tripleo15:22
*** funzo has quit IRC15:27
*** phschwartz_ is now known as phschwartz15:39
*** akuznetsov has quit IRC16:00
*** rongze has joined #tripleo16:05
*** rushiagr has joined #tripleo16:07
*** rushiagr4 has quit IRC16:08
*** rongze has quit IRC16:10
*** rlandy has quit IRC16:13
*** rushiagr has quit IRC16:13
*** rushiagr2 has joined #tripleo16:14
*** funzo has joined #tripleo16:23
*** funzo has quit IRC16:28
*** akuznetsov has joined #tripleo16:35
*** UtahDave has joined #tripleo16:35
*** rushiagr3 has joined #tripleo16:40
*** rushiagr2 has quit IRC16:41
*** rushiagr4 has joined #tripleo16:44
*** rushiagr3 has quit IRC16:44
*** boris-42 has joined #tripleo16:55
*** rushiagr4 has quit IRC17:19
*** funzo has joined #tripleo17:24
*** funzo has quit IRC17:29
*** UtahDave has quit IRC17:29
*** boris-42 has quit IRC17:32
*** UtahDave has joined #tripleo17:32
*** rushiagr4 has joined #tripleo17:34
SpamapSjog0: I agree with lifeless, RPC version discovery is entirely automatable. However I also think the "upgrade works without changing config file" is a _ridiculous_ requirement.17:39
*** akuznetsov has quit IRC17:54
*** max_lobur is now known as max_lobur_afk17:56
*** slagle has quit IRC17:56
*** rpodolyaka1 has joined #tripleo18:04
*** CaptTofu_ has joined #tripleo18:04
*** CaptTofu has quit IRC18:05
*** AaronGr_Zzz is now known as AaronGr18:11
*** funzo has joined #tripleo18:25
*** funzo has quit IRC18:29
*** rushiagr4 has quit IRC18:34
* jog0 files a nova blueprint for Juno19:07
lifelessSpamapS: why do you think it's ridiculous?19:15
openstackgerritRoman Podoliaka proposed a change to openstack/tripleo-image-elements: Enable mysqld service in mysql element  https://review.openstack.org/6419019:16
*** funzo has joined #tripleo19:25
jog0feedback welcome: https://blueprints.launchpad.net/nova/+spec/automatic-rpc-upgrade-levels-discovery19:26
jog0lifeless: related grenade nova-compute work that brought this question up https://review.openstack.org/#/q/status:open+project:openstack-dev/grenade+branch:master+topic:nova-compute,n,z19:29
SpamapSlifeless: because software + config == deployment in my head. They move forward together.19:29
jog0SpamapS: so that stance made a lot more sense before we had the official openstack deployment project19:30
*** funzo has quit IRC19:30
SpamapSjog0: the OpenStack deployment program makes that stance even simpler to support. Our deployment tool can enable configuration changes in lock-step with software changes.19:31
jog0we (openstack) couldn't say make deployment more complex because everyone was rolling there own at that time19:31
jog0SpamapS: I'm agreeing with you19:31
jog0SpamapS: I previously meant the stance that no config file change needed19:32
SpamapSahh ok right19:32
SpamapSbut even calling that "more complex" .. is confusing to me.19:32
SpamapSI just think of it as the same thing. You have to configure things that you deploy.19:33
jog0SpamapS: one side efect of this policy (no config change needed) is we get better backwards compatibility -- but there are other ways of doing that19:34
jog0anyway I don't have a strong opinion on this .. nor do I want to develop one19:35
SpamapSwell I don't think we should _break_ on an older config without a good reason. But the recent example of Cinder breaking because it had no valid lock dir.. there is no good answer. You now need a place to write locks. You didn't before. There is no secure way to handle it.19:36
lifelessSpamapS: you could downgrade to the older behaviour, even if that was undefined.19:36
lifelessSpamapS: I agree that software+config = deployment, *but*19:37
lifelessSpamapS: The less complected separate things are (pushing software out, delivering config) the better...19:37
SpamapSlifeless: the old behavior is things not happening in parallel that now happen in parallel.19:37
SpamapSlifeless: that basically means downgrading to "the old version of cinder"19:38
lifelessSpamapS: right, so degrade to single threaded in the absence of a lockdir, in the cinder code.19:38
lifelessSpamapS: I'm not saying it's *worth* doing, I'm saying it's *doable*.19:38
lifelessSpamapS: in particular, for config, consider dynamic config systems like 'feature flags' - a hard requirement I put on their design was that they be super loosely defined, with semantics in the code that uses them, and that said code had to work when the flag was undefined.19:39
SpamapSlifeless: I don't think it is complecting things, it is just a dependency chain. Lock dir must be created, and available, before icehouse software will work. It also needs a newer version of python libs x, y, and z.19:39
lifelessSpamapS: This meant that pushing the software out and then enabling stuff was decoupled, and we didn't ever have to make a large atomic step to do both things.19:39
*** UtahDave has quit IRC19:40
jog0I think some of these questions become easier to answer when we can point and say this is how we support change x in tripleo19:41
lifelessjog0: ack19:41
lifelessSpamapS: I think you are defining 'config' too narrowly for this conversation - last mile per-node config matches what you describe19:42
lifelessSpamapS: the broader sense of 'things that can be changed without changing the code' exceeds it19:42
lifelessSpamapS: But ignore that for a second, whats up with your stack - https://review.openstack.org/#/c/63642/ hasn't changed :)19:43
*** rpodolyaka1 has quit IRC19:50
*** AaronGr is now known as AaronGr_Zzz19:56
SpamapSlifeless: EREALLIFE ;)20:04
SpamapSlifeless: also I ran into https://bugs.launchpad.net/tripleo/+bug/1264349 which made me have to rebuild my whole devtest again.. distracted ..20:04
uvirtbotLaunchpad bug 1264349 in tripleo "seed DHCP does not recover from shutdown" [Medium,Triaged]20:04
SpamapSand now we're off to venice beach for a pretzel/beer/sand-play20:05
SpamapSlifeless: I do have a patch but it is entirely untested20:05
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Restart mysql during o-r-c post-configure  https://review.openstack.org/6369920:06
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Use mysql element in boot-stack  https://review.openstack.org/6364620:06
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Remove any accidental extra /etc/my.cnf  https://review.openstack.org/6364520:06
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Remove obsolete haveged and clean-apt from mysql  https://review.openstack.org/6364320:06
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Add ephemeral state preservation support to mysql  https://review.openstack.org/6364220:06
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Make mysql.create-users section optional  https://review.openstack.org/6406520:06
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Initialize underlying database files  https://review.openstack.org/6396620:06
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Remove mysql debian-sys-maint user  https://review.openstack.org/6406420:06
SpamapSthere.. updated stack with fixed apport .. but may be totally bong.. haven't actually tested it20:06
*** funzo has joined #tripleo20:26
*** funzo has quit IRC20:32
lifelessSpamapS: thanks20:34
*** boris-42 has joined #tripleo20:54
*** mrunge has quit IRC21:08
*** jcooley_ has joined #tripleo21:12
*** jcooley_ has quit IRC21:24
*** funzo has joined #tripleo21:27
*** jcooley_ has joined #tripleo21:28
*** funzo has quit IRC21:31
*** jcooley_ has quit IRC21:33
*** d0ugal has quit IRC21:41
*** d0ugal has joined #tripleo21:43
*** d0ugal has joined #tripleo21:44
*** d0ugal has joined #tripleo21:44
*** d0ugal has joined #tripleo21:47
*** d0ugal has joined #tripleo21:47
*** john-n-seattle has quit IRC22:09
*** john-n-seattle has joined #tripleo22:10
*** funzo has joined #tripleo22:28
*** funzo has quit IRC22:32
*** jog0 has quit IRC23:05
*** vipul has quit IRC23:05
*** jog0 has joined #tripleo23:05
*** GheRivero has quit IRC23:05
*** GheRivero has joined #tripleo23:06
*** vipul has joined #tripleo23:06
*** funzo has joined #tripleo23:29
*** funzo has quit IRC23:34

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!