*** fnaval has quit IRC | 00:01 | |
*** asettle has joined #osic | 00:08 | |
*** asettle has quit IRC | 00:08 | |
*** rajpatel has joined #osic | 00:08 | |
*** asettle has joined #osic | 00:08 | |
*** asettle has quit IRC | 00:09 | |
*** princenana has quit IRC | 00:16 | |
*** princenana has joined #osic | 00:17 | |
*** asettle has joined #osic | 00:19 | |
*** asettle has quit IRC | 00:23 | |
*** cathrichardson_z has quit IRC | 00:33 | |
*** mmalik4 has quit IRC | 00:35 | |
*** princenana has quit IRC | 00:39 | |
*** princenana has joined #osic | 00:39 | |
*** rajpatel has quit IRC | 00:41 | |
*** princenana has quit IRC | 00:41 | |
*** JRobinson__ has quit IRC | 00:57 | |
*** ccneill has quit IRC | 01:00 | |
*** rloo has quit IRC | 01:00 | |
*** JRobinson__ has joined #osic | 01:00 | |
*** ntpttr__ has quit IRC | 01:01 | |
*** JRobinson__ has quit IRC | 01:05 | |
*** JRobinson__ has joined #osic | 01:07 | |
*** JRobinson__ has quit IRC | 01:13 | |
*** JRobinson__ has joined #osic | 01:13 | |
*** TravT has quit IRC | 01:28 | |
*** adrian_otto has quit IRC | 01:54 | |
*** john-davidge has joined #osic | 01:54 | |
*** di has quit IRC | 01:56 | |
*** john-davidge has quit IRC | 01:59 | |
*** Mudpuppy has quit IRC | 02:19 | |
*** Mudpuppy has joined #osic | 02:20 | |
*** knangia has quit IRC | 02:40 | |
*** ccneill has joined #osic | 02:56 | |
*** ccneill has quit IRC | 03:01 | |
*** asettle has joined #osic | 03:12 | |
*** asettle has quit IRC | 03:17 | |
*** valw has joined #osic | 03:30 | |
*** valw_ has joined #osic | 03:33 | |
*** valw has quit IRC | 03:34 | |
*** cody-somerville has joined #osic | 03:53 | |
*** cody-somerville has quit IRC | 03:53 | |
*** cody-somerville has joined #osic | 03:53 | |
*** csomerville has quit IRC | 03:53 | |
*** adrian_otto has joined #osic | 04:01 | |
*** adrian_otto has quit IRC | 04:13 | |
*** ccneill has joined #osic | 04:14 | |
*** ccneill has quit IRC | 04:19 | |
*** john-davidge has joined #osic | 04:21 | |
*** ccneill has joined #osic | 04:22 | |
*** john-davidge has quit IRC | 04:26 | |
*** ccneill has quit IRC | 04:27 | |
*** JRobinson__ is now known as JRobinson__afk | 04:32 | |
*** Mudpuppy has quit IRC | 04:52 | |
*** adrian_otto has joined #osic | 04:56 | |
*** valw_ has quit IRC | 05:08 | |
*** JRobinson__afk is now known as JRobinson__ | 05:10 | |
*** knangia has joined #osic | 05:48 | |
*** coolsvap has joined #osic | 06:10 | |
*** ccneill has joined #osic | 06:23 | |
*** ccneill has quit IRC | 06:27 | |
*** adrian_otto has quit IRC | 06:39 | |
*** adrian_otto has joined #osic | 06:42 | |
*** john-davidge has joined #osic | 06:49 | |
*** john-davidge has quit IRC | 06:53 | |
*** adrian_otto has quit IRC | 06:58 | |
*** JRobinson__ has quit IRC | 07:18 | |
*** john-davidge has joined #osic | 08:04 | |
*** soliosg has quit IRC | 08:10 | |
*** ccneill has joined #osic | 08:11 | |
*** ccneill has quit IRC | 08:15 | |
*** ccneill has joined #osic | 08:22 | |
*** ccneill has quit IRC | 08:26 | |
*** GB21 has joined #osic | 08:42 | |
*** asettle has joined #osic | 09:14 | |
*** asettle has quit IRC | 09:19 | |
*** revon has quit IRC | 09:23 | |
*** asettle has joined #osic | 10:10 | |
*** asettle has quit IRC | 10:10 | |
*** asettle has joined #osic | 10:11 | |
*** GB21 has quit IRC | 10:17 | |
*** asettle__ has joined #osic | 10:22 | |
*** ccneill has joined #osic | 10:23 | |
*** asettle has quit IRC | 10:25 | |
*** ccneill has quit IRC | 10:27 | |
*** GB21 has joined #osic | 10:48 | |
*** asettle__ is now known as asettle | 10:48 | |
*** dfflanders has quit IRC | 11:07 | |
*** david-lyle has quit IRC | 12:05 | |
*** david-lyle has joined #osic | 12:05 | |
*** dasanind has quit IRC | 12:06 | |
*** chrisspencer has quit IRC | 12:06 | |
*** dasanind has joined #osic | 12:08 | |
*** chrisspencer has joined #osic | 12:08 | |
*** ccneill has joined #osic | 12:24 | |
*** ccneill has quit IRC | 12:28 | |
*** GB21 has quit IRC | 12:40 | |
*** GB21 has joined #osic | 12:41 | |
*** GB21 has quit IRC | 13:10 | |
*** ccneill has joined #osic | 13:17 | |
*** GB21 has joined #osic | 13:17 | |
*** knangia has quit IRC | 13:20 | |
*** ccneill has quit IRC | 13:22 | |
*** ccneill has joined #osic | 13:22 | |
*** GB21 has quit IRC | 13:23 | |
*** ccneill has quit IRC | 13:27 | |
*** GB21 has joined #osic | 13:38 | |
*** dankrs has quit IRC | 13:54 | |
*** dankolbrs has joined #osic | 14:08 | |
*** GB21 has quit IRC | 14:14 | |
*** rloo has joined #osic | 14:15 | |
*** Mudpuppy has joined #osic | 14:59 | |
*** fnaval has joined #osic | 15:03 | |
*** csomerville has joined #osic | 15:04 | |
*** di has joined #osic | 15:04 | |
*** knangia has joined #osic | 15:06 | |
*** cody-somerville has quit IRC | 15:07 | |
*** ccneill has joined #osic | 15:23 | |
*** soliosg has joined #osic | 15:26 | |
*** ccneill has quit IRC | 15:28 | |
*** valw has joined #osic | 15:33 | |
*** di has quit IRC | 15:33 | |
*** rajpatel has joined #osic | 15:33 | |
*** valw has quit IRC | 15:33 | |
*** rajpatel has quit IRC | 15:34 | |
*** valw has joined #osic | 15:35 | |
*** rajpatel has joined #osic | 15:38 | |
*** GB21 has joined #osic | 15:43 | |
kencjohnston | JayF: I got a note asking me to approve your response to the community goals email. | 15:48 |
---|---|---|
JayF | kencjohnston: yeah, I have nfi why I'm not on the approved senders list for osic@lists | 15:49 |
kencjohnston | JayF: I GUESS I'll do that, but you should join the list from your Racker email (I'm not sure how you got hte original message otherwise) | 15:49 |
JayF | kencjohnston: I'm on the list. How else could I have replied? | 15:49 |
kencjohnston | maybe different address? The approval is asking for jason.faulkner@rackspace.com do you have another alias? | 15:49 |
JayF | kencjohnston: my hunch is someone might have joined one of my aliases, like jay.faulkner@rackspace.com, to the list | 15:49 |
JayF | since I was joined to OSIC list, rather than joining it myself | 15:50 |
kencjohnston | JayF: Yep that is it. I'm adding jason.faulkner now. Apologies. | 15:50 |
JayF | np ty o/ | 15:51 |
JayF | I emailed jcook about it but you beat me to the punch | 15:52 |
*** TxGirlGeek has joined #osic | 15:54 | |
jcook | JayF ack | 15:54 |
*** chris_hultin|AWA is now known as chris_hultin | 15:58 | |
*** chris_hultin is now known as chris_hultin|AWA | 16:10 | |
*** chris_hultin|AWA is now known as chris_hultin | 16:10 | |
*** ravelar has joined #osic | 16:22 | |
*** di has joined #osic | 16:25 | |
*** adrian_otto has joined #osic | 16:28 | |
*** rajpatel has quit IRC | 16:34 | |
*** GB21 has quit IRC | 16:38 | |
*** rajpatel has joined #osic | 16:40 | |
*** valw has quit IRC | 16:43 | |
*** valw has joined #osic | 16:47 | |
*** GB21 has joined #osic | 16:51 | |
*** csomerville has quit IRC | 16:57 | |
*** csomerville has joined #osic | 16:57 | |
*** GB21 has quit IRC | 17:16 | |
*** ccneill has joined #osic | 17:23 | |
*** revon has joined #osic | 17:24 | |
*** asettle has quit IRC | 17:27 | |
*** cody-somerville has joined #osic | 17:49 | |
*** cody-somerville has quit IRC | 17:49 | |
*** cody-somerville has joined #osic | 17:49 | |
*** asettle__ has joined #osic | 17:49 | |
*** csomerville has quit IRC | 17:51 | |
*** cody-somerville has quit IRC | 17:54 | |
*** csomerville has joined #osic | 17:54 | |
*** asettle__ has quit IRC | 17:56 | |
*** TxGirlGeek has quit IRC | 17:58 | |
*** TxGirlGeek has joined #osic | 17:59 | |
*** valw has quit IRC | 18:02 | |
*** valw has joined #osic | 18:03 | |
*** valw has quit IRC | 18:07 | |
*** TxGirlGeek has quit IRC | 18:08 | |
*** TxGirlGeek has joined #osic | 18:09 | |
*** TxGirlGeek has quit IRC | 18:10 | |
*** TxGirlGeek has joined #osic | 18:11 | |
*** TxGirlGeek has quit IRC | 18:16 | |
*** valw has joined #osic | 18:16 | |
*** asettle__ has joined #osic | 18:17 | |
*** valw has quit IRC | 18:21 | |
*** asettle__ has quit IRC | 18:27 | |
*** valw has joined #osic | 18:30 | |
*** john-davidge has quit IRC | 18:32 | |
*** john-davidge has joined #osic | 18:33 | |
*** valw has quit IRC | 18:34 | |
*** asettle__ has joined #osic | 18:36 | |
*** john-davidge has quit IRC | 18:37 | |
*** TxGirlGeek has joined #osic | 18:38 | |
JayF | What is the "mutable config" everyone is talking about in that email thread about priorites? | 18:50 |
stevelle | graceful restart with a reload of config | 18:51 |
stevelle | it's envisioned as "mutable config" because when the app does it internally it can accept the appropriate signal and not actually "restart" thing but new requests start using a freshly instantiated (oslo) config | 18:53 |
stevelle | and in that case it uses the same python interpreter etc | 18:53 |
lbragstad | the oslo.policy bit is interesting | 18:54 |
JayF | oh | 18:54 |
JayF | like being able to hup a service | 18:54 |
JayF | and reconfigure it | 18:54 |
JayF | oh man, that's going to be really, really hard | 18:54 |
JayF | but would make ironic-python-agent work better, since we're /kinda/ doing config changes on the fly | 18:54 |
JayF | but just by being really careful abotu not loading it until it's reconfigured | 18:55 |
JayF | the oslo.policy bit is a great goal ... | 18:55 |
JayF | mainly because the Ironic implementation of policy is already done the new right way | 18:55 |
JayF | lol | 18:55 |
stevelle | it IS really hard to do right, which is why I advocate externalizing the concern to the wsgi container which can just make a new interpreter and shuttle new connections to that :P | 18:55 |
JayF | that doesn't help all services | 18:56 |
JayF | doesn't help the majority of ironic services, to be clear | 18:56 |
JayF | ironic-conductor, ironic-inspector, ironic-python-agent | 18:56 |
JayF | all wouldn't be able to follow that model | 18:57 |
stevelle | I'd have to have you explain why | 18:57 |
JayF | ironic-conductor doesn't expose an api. | 18:57 |
JayF | it just works over rpc. | 18:57 |
stevelle | if they are background processes, then wsgi containers dont apply | 18:57 |
JayF | so it doesn't make sense to be a wsgi container | 18:57 |
*** valw has joined #osic | 18:57 | |
JayF | exactly | 18:57 |
JayF | ironic-python-agent, while it has an API, has special cases where just redirecting api calls wouldn't be a useful thing | 18:57 |
stevelle | background procs can simply be hupped and restarted though, having them pause processing in the background shouldn't cause control plane downtime though right? | 18:58 |
stevelle | should just cause a stutter in processing | 18:58 |
JayF | the same could be argued for api services behind an LB :) | 18:59 |
JayF | it doesn't mean it's desirable | 18:59 |
stevelle | not entirely true for APIs though, because of standing socket connections | 18:59 |
JayF | and in ironic's case, even though conductors can be shut down non-disruptively, it causes churn in the hash ring and lots of failover work | 18:59 |
stevelle | if those sockets get closed prematurely you have 5xx response spikes | 18:59 |
JayF | which wouldn't be needed if a HUP was possible. | 18:59 |
stevelle | you have to at least gracefully drain the connection pool | 19:00 |
JayF | TBH, I also think saying "support WSGI containers and let the container runner handle it" shuttles off a lot of responsibility to a deployer | 19:00 |
JayF | sure; but doing a drain-fail isn't a strange thing for an lb to do | 19:00 |
stevelle | apache w/ mod_wsgi doesn't handle the gracefull drain right today | 19:00 |
stevelle | but that's another issue | 19:01 |
*** valw has quit IRC | 19:02 | |
stevelle | to be clear, I have no problem with adding the mutable config selectively where appropriate but API processes don't seem like the best fit. | 19:03 |
stevelle | and that seems like lower hanging fruit | 19:03 |
JayF | I've run software in production for most of my career (this dev gig is newer for me) | 19:03 |
JayF | HUP'ing services is just expected to work | 19:04 |
JayF | It never even occured to me that it doesn't in openstack until this discussion :( | 19:04 |
JayF | which makes me sad now | 19:04 |
stevelle | I'm perhaps more sensitive to this b/c I ran the JVM in production stacks | 19:04 |
*** asettle__ has quit IRC | 19:04 | |
stevelle | and JVM / Servlet startup time :pain: | 19:05 |
JayF | Oh man, see I'm literally the exact opposite | 19:05 |
JayF | because I hated operating JVM apps in my sysadmin/devops days | 19:05 |
JayF | I kinda dislike the entire java ecosystem | 19:06 |
JayF | Sorta requires you to toss out most of your systems knowledge and replace it with java-specific knowledge | 19:06 |
stevelle | not untrue at all | 19:06 |
stevelle | knowing operators are running Horizon and Keystone under a proper wsgi container already makes me not feel too bad about operator impact in recommending more use of those. Most of the containers I expect to be used in production support some concept for virtual hosts | 19:08 |
stevelle | projects should probably provide the wsgi script and even a sample virtual host file which is easy enough to do | 19:09 |
*** valw has joined #osic | 19:11 | |
JayF | To put this in perspective: OnMetal's Ironic deployment does not use WSGI containers | 19:13 |
JayF | even though Ironic ships a WSGI container | 19:13 |
JayF | (not saying it was right, just that it was good enough) | 19:13 |
*** valw has quit IRC | 19:15 | |
*** mmalik4 has joined #osic | 19:18 | |
*** asettle has joined #osic | 19:20 | |
*** chris_hultin is now known as chris_hultin|AWA | 19:21 | |
*** valw has joined #osic | 19:24 | |
*** cody-somerville has joined #osic | 19:25 | |
*** cody-somerville has quit IRC | 19:25 | |
*** cody-somerville has joined #osic | 19:25 | |
*** csomerville has quit IRC | 19:28 | |
*** valw has quit IRC | 19:29 | |
*** valw has joined #osic | 19:33 | |
*** john-davidge has joined #osic | 19:33 | |
*** asettle has quit IRC | 19:36 | |
*** asettle has joined #osic | 19:37 | |
*** john-davidge has quit IRC | 19:38 | |
*** asettle has quit IRC | 19:41 | |
*** adrian_otto has quit IRC | 20:05 | |
*** valw has quit IRC | 20:24 | |
*** rajpatel has quit IRC | 20:28 | |
*** valw has joined #osic | 20:28 | |
*** valw has quit IRC | 20:33 | |
*** valw has joined #osic | 20:33 | |
*** TxGirlGeek has quit IRC | 20:41 | |
*** TxGirlGeek has joined #osic | 20:43 | |
*** rajpatel has joined #osic | 20:43 | |
*** TxGirlGeek has quit IRC | 20:46 | |
*** asettle has joined #osic | 20:46 | |
*** TxGirlGeek has joined #osic | 20:47 | |
*** ravelar has quit IRC | 20:51 | |
*** valw has quit IRC | 20:53 | |
*** TxGirlGeek has quit IRC | 20:56 | |
*** TxGirlGeek has joined #osic | 20:56 | |
*** valw has joined #osic | 20:58 | |
*** knangia has quit IRC | 21:00 | |
*** TxGirlGeek has quit IRC | 21:02 | |
*** TxGirlGeek has joined #osic | 21:02 | |
*** JRobinson__ has joined #osic | 21:06 | |
*** adrian_otto has joined #osic | 21:10 | |
*** TxGirlGeek has quit IRC | 21:11 | |
*** TxGirlGeek has joined #osic | 21:11 | |
*** knangia has joined #osic | 21:11 | |
*** TxGirlGeek has quit IRC | 21:14 | |
*** valw has quit IRC | 21:16 | |
jroll | JayF: so oslo.config does all the hard parts of the HUP thing already, we just need to add some hooks to pick up the signal afaik. also don't think IPA needs it since most config comes from not-a-config-file adn it's a pretty ephemeral service | 21:21 |
jroll | JayF: also, rfe if you're curious https://bugs.launchpad.net/ironic/+bug/1585595 | 21:21 |
openstack | Launchpad bug 1585595 in Ironic "[RFE] Handling SIGHUP on Ironic services" [Wishlist,In progress] - Assigned to Lucas Alvares Gomes (lucasagomes) | 21:21 |
jroll | I guess there are a few hard bits | 21:21 |
*** ravelar has joined #osic | 21:25 | |
*** valw has joined #osic | 21:26 | |
*** ravelar has quit IRC | 21:29 | |
*** valw has quit IRC | 21:31 | |
*** TxGirlGeek has joined #osic | 21:32 | |
*** csomerville has joined #osic | 21:34 | |
*** cody-somerville has quit IRC | 21:34 | |
*** john-davidge has joined #osic | 21:35 | |
*** ravelar has joined #osic | 21:36 | |
*** john-davidge has quit IRC | 21:40 | |
*** valw has joined #osic | 21:40 | |
*** ravelar has quit IRC | 21:41 | |
*** valw has quit IRC | 21:46 | |
*** ccneill has quit IRC | 21:47 | |
*** adrian_otto1 has joined #osic | 21:54 | |
*** valw has joined #osic | 21:54 | |
*** adrian_otto1 has quit IRC | 21:54 | |
*** adrian_otto has quit IRC | 21:55 | |
*** adrian_otto has joined #osic | 21:58 | |
*** valw has quit IRC | 21:59 | |
*** asettle has quit IRC | 22:05 | |
*** asettle has joined #osic | 22:06 | |
*** valw has joined #osic | 22:08 | |
*** asettle has quit IRC | 22:11 | |
*** ccneill has joined #osic | 22:14 | |
JayF | jroll: I wonder if we can hook into those same things | 22:16 |
JayF | jroll: for metrics reconfiguration in ipa | 22:16 |
jroll | JayF: ooo, maybe | 22:16 |
JayF | jroll: i.e. just do whatever oslo.config does on a hup in IPA, instead of trying to dance around the configuration getting cached | 22:16 |
*** valw has quit IRC | 22:17 | |
JayF | jroll: I doubt it, they have a mutable= true/false thing | 22:17 |
JayF | jroll: so I suspect if your config would be cached somewhere in code that you've either gotta handle that yourself or mark it nonmutable | 22:18 |
jroll | JayF: yeah, maybe, struggling to find something doing it | 22:18 |
*** TxGirlGeek has quit IRC | 22:23 | |
*** JRobinson__ is now known as JRobinson__afk | 22:26 | |
stevelle | glance does the mutable config thing already, not sure if they're doing it right though | 22:27 |
stevelle | might give that a look jroll | 22:27 |
*** valw has joined #osic | 22:29 | |
*** valw has quit IRC | 22:34 | |
*** JRobinson__afk is now known as JRobinson__ | 22:48 | |
*** dankrs has joined #osic | 22:53 | |
*** dankolbrs has quit IRC | 22:55 | |
jroll | ah cool, thanks stevelle | 22:56 |
*** asettle has joined #osic | 23:07 | |
*** mmalik4 has quit IRC | 23:07 | |
*** fnaval has quit IRC | 23:08 | |
*** asettle has quit IRC | 23:11 | |
*** ntpttr has quit IRC | 23:31 | |
*** ntpttr has joined #osic | 23:36 | |
*** john-davidge has joined #osic | 23:48 | |
*** john-davidge has quit IRC | 23:52 | |
*** adrian_otto has quit IRC | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!