Thursday, 2016-12-15

*** fnaval has quit IRC00:01
*** asettle has joined #osic00:08
*** asettle has quit IRC00:08
*** rajpatel has joined #osic00:08
*** asettle has joined #osic00:08
*** asettle has quit IRC00:09
*** princenana has quit IRC00:16
*** princenana has joined #osic00:17
*** asettle has joined #osic00:19
*** asettle has quit IRC00:23
*** cathrichardson_z has quit IRC00:33
*** mmalik4 has quit IRC00:35
*** princenana has quit IRC00:39
*** princenana has joined #osic00:39
*** rajpatel has quit IRC00:41
*** princenana has quit IRC00:41
*** JRobinson__ has quit IRC00:57
*** ccneill has quit IRC01:00
*** rloo has quit IRC01:00
*** JRobinson__ has joined #osic01:00
*** ntpttr__ has quit IRC01:01
*** JRobinson__ has quit IRC01:05
*** JRobinson__ has joined #osic01:07
*** JRobinson__ has quit IRC01:13
*** JRobinson__ has joined #osic01:13
*** TravT has quit IRC01:28
*** adrian_otto has quit IRC01:54
*** john-davidge has joined #osic01:54
*** di has quit IRC01:56
*** john-davidge has quit IRC01:59
*** Mudpuppy has quit IRC02:19
*** Mudpuppy has joined #osic02:20
*** knangia has quit IRC02:40
*** ccneill has joined #osic02:56
*** ccneill has quit IRC03:01
*** asettle has joined #osic03:12
*** asettle has quit IRC03:17
*** valw has joined #osic03:30
*** valw_ has joined #osic03:33
*** valw has quit IRC03:34
*** cody-somerville has joined #osic03:53
*** cody-somerville has quit IRC03:53
*** cody-somerville has joined #osic03:53
*** csomerville has quit IRC03:53
*** adrian_otto has joined #osic04:01
*** adrian_otto has quit IRC04:13
*** ccneill has joined #osic04:14
*** ccneill has quit IRC04:19
*** john-davidge has joined #osic04:21
*** ccneill has joined #osic04:22
*** john-davidge has quit IRC04:26
*** ccneill has quit IRC04:27
*** JRobinson__ is now known as JRobinson__afk04:32
*** Mudpuppy has quit IRC04:52
*** adrian_otto has joined #osic04:56
*** valw_ has quit IRC05:08
*** JRobinson__afk is now known as JRobinson__05:10
*** knangia has joined #osic05:48
*** coolsvap has joined #osic06:10
*** ccneill has joined #osic06:23
*** ccneill has quit IRC06:27
*** adrian_otto has quit IRC06:39
*** adrian_otto has joined #osic06:42
*** john-davidge has joined #osic06:49
*** john-davidge has quit IRC06:53
*** adrian_otto has quit IRC06:58
*** JRobinson__ has quit IRC07:18
*** john-davidge has joined #osic08:04
*** soliosg has quit IRC08:10
*** ccneill has joined #osic08:11
*** ccneill has quit IRC08:15
*** ccneill has joined #osic08:22
*** ccneill has quit IRC08:26
*** GB21 has joined #osic08:42
*** asettle has joined #osic09:14
*** asettle has quit IRC09:19
*** revon has quit IRC09:23
*** asettle has joined #osic10:10
*** asettle has quit IRC10:10
*** asettle has joined #osic10:11
*** GB21 has quit IRC10:17
*** asettle__ has joined #osic10:22
*** ccneill has joined #osic10:23
*** asettle has quit IRC10:25
*** ccneill has quit IRC10:27
*** GB21 has joined #osic10:48
*** asettle__ is now known as asettle10:48
*** dfflanders has quit IRC11:07
*** david-lyle has quit IRC12:05
*** david-lyle has joined #osic12:05
*** dasanind has quit IRC12:06
*** chrisspencer has quit IRC12:06
*** dasanind has joined #osic12:08
*** chrisspencer has joined #osic12:08
*** ccneill has joined #osic12:24
*** ccneill has quit IRC12:28
*** GB21 has quit IRC12:40
*** GB21 has joined #osic12:41
*** GB21 has quit IRC13:10
*** ccneill has joined #osic13:17
*** GB21 has joined #osic13:17
*** knangia has quit IRC13:20
*** ccneill has quit IRC13:22
*** ccneill has joined #osic13:22
*** GB21 has quit IRC13:23
*** ccneill has quit IRC13:27
*** GB21 has joined #osic13:38
*** dankrs has quit IRC13:54
*** dankolbrs has joined #osic14:08
*** GB21 has quit IRC14:14
*** rloo has joined #osic14:15
*** Mudpuppy has joined #osic14:59
*** fnaval has joined #osic15:03
*** csomerville has joined #osic15:04
*** di has joined #osic15:04
*** knangia has joined #osic15:06
*** cody-somerville has quit IRC15:07
*** ccneill has joined #osic15:23
*** soliosg has joined #osic15:26
*** ccneill has quit IRC15:28
*** valw has joined #osic15:33
*** di has quit IRC15:33
*** rajpatel has joined #osic15:33
*** valw has quit IRC15:33
*** rajpatel has quit IRC15:34
*** valw has joined #osic15:35
*** rajpatel has joined #osic15:38
*** GB21 has joined #osic15:43
kencjohnstonJayF: I got a note asking me to approve your response to the community goals email.15:48
JayFkencjohnston: yeah, I have nfi why I'm not on the approved senders list for osic@lists15:49
kencjohnstonJayF: I GUESS I'll do that, but you should join the list from your Racker email (I'm not sure how you got hte original message otherwise)15:49
JayFkencjohnston: I'm on the list. How else could I have replied?15:49
kencjohnstonmaybe different address? The approval is asking for jason.faulkner@rackspace.com do you have another alias?15:49
JayFkencjohnston: my hunch is someone might have joined one of my aliases, like jay.faulkner@rackspace.com, to the list15:49
JayFsince I was joined to OSIC list, rather than joining it myself15:50
kencjohnstonJayF: Yep that is it. I'm adding jason.faulkner now. Apologies.15:50
JayFnp ty o/15:51
JayFI emailed jcook about it but you beat me to the punch15:52
*** TxGirlGeek has joined #osic15:54
jcookJayF ack15:54
*** chris_hultin|AWA is now known as chris_hultin15:58
*** chris_hultin is now known as chris_hultin|AWA16:10
*** chris_hultin|AWA is now known as chris_hultin16:10
*** ravelar has joined #osic16:22
*** di has joined #osic16:25
*** adrian_otto has joined #osic16:28
*** rajpatel has quit IRC16:34
*** GB21 has quit IRC16:38
*** rajpatel has joined #osic16:40
*** valw has quit IRC16:43
*** valw has joined #osic16:47
*** GB21 has joined #osic16:51
*** csomerville has quit IRC16:57
*** csomerville has joined #osic16:57
*** GB21 has quit IRC17:16
*** ccneill has joined #osic17:23
*** revon has joined #osic17:24
*** asettle has quit IRC17:27
*** cody-somerville has joined #osic17:49
*** cody-somerville has quit IRC17:49
*** cody-somerville has joined #osic17:49
*** asettle__ has joined #osic17:49
*** csomerville has quit IRC17:51
*** cody-somerville has quit IRC17:54
*** csomerville has joined #osic17:54
*** asettle__ has quit IRC17:56
*** TxGirlGeek has quit IRC17:58
*** TxGirlGeek has joined #osic17:59
*** valw has quit IRC18:02
*** valw has joined #osic18:03
*** valw has quit IRC18:07
*** TxGirlGeek has quit IRC18:08
*** TxGirlGeek has joined #osic18:09
*** TxGirlGeek has quit IRC18:10
*** TxGirlGeek has joined #osic18:11
*** TxGirlGeek has quit IRC18:16
*** valw has joined #osic18:16
*** asettle__ has joined #osic18:17
*** valw has quit IRC18:21
*** asettle__ has quit IRC18:27
*** valw has joined #osic18:30
*** john-davidge has quit IRC18:32
*** john-davidge has joined #osic18:33
*** valw has quit IRC18:34
*** asettle__ has joined #osic18:36
*** john-davidge has quit IRC18:37
*** TxGirlGeek has joined #osic18:38
JayFWhat is the "mutable config" everyone is talking about in that email thread about priorites?18:50
stevellegraceful restart with a reload of config18:51
stevelleit's envisioned as "mutable config" because when the app does it internally it can accept the appropriate signal and not actually "restart" thing but new requests start using a freshly instantiated (oslo) config18:53
stevelleand in that case it uses the same python interpreter etc18:53
lbragstadthe oslo.policy bit is interesting18:54
JayFoh18:54
JayFlike being able to hup a service18:54
JayFand reconfigure it18:54
JayFoh man, that's going to be really, really hard18:54
JayFbut would make ironic-python-agent work better, since we're /kinda/ doing config changes on the fly18:54
JayFbut just by being really careful abotu not loading it until it's reconfigured18:55
JayFthe oslo.policy bit is a great goal ...18:55
JayFmainly because the Ironic implementation of policy is already done the new right way18:55
JayFlol18:55
stevelleit IS really hard to do right, which is why I advocate externalizing the concern to the wsgi container which can just make a new interpreter and shuttle new connections to that :P18:55
JayFthat doesn't help all services18:56
JayFdoesn't help the majority of ironic services, to be clear18:56
JayFironic-conductor, ironic-inspector, ironic-python-agent18:56
JayFall wouldn't be able to follow that model18:57
stevelleI'd have to have you explain why18:57
JayFironic-conductor doesn't expose an api.18:57
JayFit just works over rpc.18:57
stevelleif they are background processes, then wsgi containers dont apply18:57
JayFso it doesn't make sense to be a wsgi container18:57
*** valw has joined #osic18:57
JayFexactly18:57
JayFironic-python-agent, while it has an API, has special cases where just redirecting api calls wouldn't be a useful thing18:57
stevellebackground procs can simply be hupped and restarted though, having them pause processing in the background shouldn't cause control plane downtime though right?18:58
stevelleshould just cause a stutter in processing18:58
JayFthe same could be argued for api services behind an LB :)18:59
JayFit doesn't mean it's desirable18:59
stevellenot entirely true for APIs though, because of standing socket connections18:59
JayFand in ironic's case, even though conductors can be shut down non-disruptively, it causes churn in the hash ring and lots of failover work18:59
stevelleif those sockets get closed prematurely you have 5xx response spikes18:59
JayFwhich wouldn't be needed if a HUP was possible.18:59
stevelleyou have to at least gracefully drain the connection pool19:00
JayFTBH, I also think saying "support WSGI containers and let the container runner handle it" shuttles off a lot of responsibility to a deployer19:00
JayFsure; but doing a drain-fail isn't a strange thing for an lb to do19:00
stevelleapache w/ mod_wsgi doesn't handle the gracefull drain right today19:00
stevellebut that's another issue19:01
*** valw has quit IRC19:02
stevelleto be clear, I have no problem with adding the mutable config selectively where appropriate but API processes don't seem like the best fit.19:03
stevelleand that seems like lower hanging fruit19:03
JayFI've run software in production for most of my career (this dev gig is newer for me)19:03
JayFHUP'ing services is just expected to work19:04
JayFIt never even occured to me that it doesn't in openstack until this discussion :(19:04
JayFwhich makes me sad now19:04
stevelleI'm perhaps more sensitive to this b/c I ran the JVM in production stacks19:04
*** asettle__ has quit IRC19:04
stevelleand JVM / Servlet startup time :pain:19:05
JayFOh man, see I'm literally the exact opposite19:05
JayFbecause I hated operating JVM apps in my sysadmin/devops days19:05
JayFI kinda dislike the entire java ecosystem19:06
JayFSorta requires you to toss out most of your systems knowledge and replace it with java-specific knowledge19:06
stevellenot untrue at all19:06
stevelleknowing operators are running Horizon and Keystone under a proper wsgi container already makes me not feel too bad about operator impact in recommending more use of those. Most of the containers I expect to be used in production support some concept for virtual hosts19:08
stevelleprojects should probably provide the wsgi script and even a sample virtual host file which is easy enough to do19:09
*** valw has joined #osic19:11
JayFTo put this in perspective: OnMetal's Ironic deployment does not use WSGI containers19:13
JayFeven though Ironic ships a WSGI container19:13
JayF(not saying it was right, just that it was good enough)19:13
*** valw has quit IRC19:15
*** mmalik4 has joined #osic19:18
*** asettle has joined #osic19:20
*** chris_hultin is now known as chris_hultin|AWA19:21
*** valw has joined #osic19:24
*** cody-somerville has joined #osic19:25
*** cody-somerville has quit IRC19:25
*** cody-somerville has joined #osic19:25
*** csomerville has quit IRC19:28
*** valw has quit IRC19:29
*** valw has joined #osic19:33
*** john-davidge has joined #osic19:33
*** asettle has quit IRC19:36
*** asettle has joined #osic19:37
*** john-davidge has quit IRC19:38
*** asettle has quit IRC19:41
*** adrian_otto has quit IRC20:05
*** valw has quit IRC20:24
*** rajpatel has quit IRC20:28
*** valw has joined #osic20:28
*** valw has quit IRC20:33
*** valw has joined #osic20:33
*** TxGirlGeek has quit IRC20:41
*** TxGirlGeek has joined #osic20:43
*** rajpatel has joined #osic20:43
*** TxGirlGeek has quit IRC20:46
*** asettle has joined #osic20:46
*** TxGirlGeek has joined #osic20:47
*** ravelar has quit IRC20:51
*** valw has quit IRC20:53
*** TxGirlGeek has quit IRC20:56
*** TxGirlGeek has joined #osic20:56
*** valw has joined #osic20:58
*** knangia has quit IRC21:00
*** TxGirlGeek has quit IRC21:02
*** TxGirlGeek has joined #osic21:02
*** JRobinson__ has joined #osic21:06
*** adrian_otto has joined #osic21:10
*** TxGirlGeek has quit IRC21:11
*** TxGirlGeek has joined #osic21:11
*** knangia has joined #osic21:11
*** TxGirlGeek has quit IRC21:14
*** valw has quit IRC21:16
jrollJayF: so oslo.config does all the hard parts of the HUP thing already, we just need to add some hooks to pick up the signal afaik. also don't think IPA needs it since most config comes from not-a-config-file adn it's a pretty ephemeral service21:21
jrollJayF: also, rfe if you're curious https://bugs.launchpad.net/ironic/+bug/158559521:21
openstackLaunchpad bug 1585595 in Ironic "[RFE] Handling SIGHUP on Ironic services" [Wishlist,In progress] - Assigned to Lucas Alvares Gomes (lucasagomes)21:21
jrollI guess there are a few hard bits21:21
*** ravelar has joined #osic21:25
*** valw has joined #osic21:26
*** ravelar has quit IRC21:29
*** valw has quit IRC21:31
*** TxGirlGeek has joined #osic21:32
*** csomerville has joined #osic21:34
*** cody-somerville has quit IRC21:34
*** john-davidge has joined #osic21:35
*** ravelar has joined #osic21:36
*** john-davidge has quit IRC21:40
*** valw has joined #osic21:40
*** ravelar has quit IRC21:41
*** valw has quit IRC21:46
*** ccneill has quit IRC21:47
*** adrian_otto1 has joined #osic21:54
*** valw has joined #osic21:54
*** adrian_otto1 has quit IRC21:54
*** adrian_otto has quit IRC21:55
*** adrian_otto has joined #osic21:58
*** valw has quit IRC21:59
*** asettle has quit IRC22:05
*** asettle has joined #osic22:06
*** valw has joined #osic22:08
*** asettle has quit IRC22:11
*** ccneill has joined #osic22:14
JayFjroll: I wonder if we can hook into those same things22:16
JayFjroll: for metrics reconfiguration in ipa22:16
jrollJayF: ooo, maybe22:16
JayFjroll: i.e. just do whatever oslo.config does on a hup in IPA, instead of trying to dance around the configuration getting cached22:16
*** valw has quit IRC22:17
JayFjroll: I doubt it, they have a mutable= true/false thing22:17
JayFjroll: so I suspect if your config would be cached somewhere in code that you've either gotta handle that yourself or mark it nonmutable22:18
jrollJayF: yeah, maybe, struggling to find something doing it22:18
*** TxGirlGeek has quit IRC22:23
*** JRobinson__ is now known as JRobinson__afk22:26
stevelleglance does the mutable config thing already, not sure if they're doing it right though22:27
stevellemight give that a look jroll22:27
*** valw has joined #osic22:29
*** valw has quit IRC22:34
*** JRobinson__afk is now known as JRobinson__22:48
*** dankrs has joined #osic22:53
*** dankolbrs has quit IRC22:55
jrollah cool, thanks stevelle22:56
*** asettle has joined #osic23:07
*** mmalik4 has quit IRC23:07
*** fnaval has quit IRC23:08
*** asettle has quit IRC23:11
*** ntpttr has quit IRC23:31
*** ntpttr has joined #osic23:36
*** john-davidge has joined #osic23:48
*** john-davidge has quit IRC23:52
*** adrian_otto has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!