| *** jmasud has joined #openstack-meeting | 00:06 | |
| *** rubasov has quit IRC | 00:12 | |
| *** jmasud has quit IRC | 00:16 | |
| *** jmasud has joined #openstack-meeting | 00:16 | |
| *** jmasud has quit IRC | 00:20 | |
| *** tosky has quit IRC | 00:23 | |
| *** martial has quit IRC | 00:25 | |
| *** jmasud has joined #openstack-meeting | 00:48 | |
| *** lifeless has quit IRC | 00:53 | |
| *** lifeless has joined #openstack-meeting | 00:54 | |
| *** jmasud has quit IRC | 01:21 | |
| *** jmasud has joined #openstack-meeting | 01:21 | |
| *** gyee has quit IRC | 01:25 | |
| *** jmasud has quit IRC | 01:29 | |
| *** jmasud has joined #openstack-meeting | 01:30 | |
| *** jmasud has quit IRC | 01:30 | |
| *** jmasud has joined #openstack-meeting | 01:53 | |
| *** rubasov has joined #openstack-meeting | 01:59 | |
| *** jmasud has quit IRC | 02:05 | |
| *** jmasud has joined #openstack-meeting | 02:10 | |
| *** macz_ has joined #openstack-meeting | 02:12 | |
| *** rh-jelabarre has quit IRC | 02:29 | |
| *** jmasud has quit IRC | 02:36 | |
| *** armax has quit IRC | 03:12 | |
| *** psachin has joined #openstack-meeting | 03:30 | |
| *** manpreet has joined #openstack-meeting | 03:33 | |
| *** armax has joined #openstack-meeting | 04:11 | |
| *** armax has quit IRC | 04:15 | |
| *** ociuhandu has joined #openstack-meeting | 05:08 | |
| *** ociuhandu has quit IRC | 05:13 | |
| *** jmasud has joined #openstack-meeting | 05:31 | |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-meeting | 05:33 | |
| *** macz_ has quit IRC | 05:45 | |
| *** mvalsecc has joined #openstack-meeting | 06:57 | |
| *** jmasud has quit IRC | 07:02 | |
| *** dklyle has quit IRC | 07:46 | |
| *** macz_ has joined #openstack-meeting | 07:46 | |
| *** macz_ has quit IRC | 07:50 | |
| *** rpittau|afk is now known as rpittau | 08:01 | |
| *** mvalsecc has quit IRC | 08:06 | |
| *** ociuhandu has joined #openstack-meeting | 09:34 | |
| *** ricolin has joined #openstack-meeting | 09:41 | |
| *** macz_ has joined #openstack-meeting | 09:47 | |
| *** macz_ has quit IRC | 09:52 | |
| *** slaweq has joined #openstack-meeting | 09:55 | |
| *** ociuhandu has quit IRC | 09:57 | |
| *** e0ne has joined #openstack-meeting | 09:58 | |
| *** ociuhandu has joined #openstack-meeting | 10:02 | |
| *** slaweq has quit IRC | 10:38 | |
| *** rfolco has joined #openstack-meeting | 10:43 | |
| *** jmasud has joined #openstack-meeting | 10:46 | |
| *** e0ne has quit IRC | 11:16 | |
| *** ricolin has quit IRC | 11:17 | |
| *** cmart has quit IRC | 11:20 | |
| *** cmart has joined #openstack-meeting | 11:27 | |
| *** zaneb has quit IRC | 11:44 | |
| *** zaneb has joined #openstack-meeting | 11:48 | |
| *** ociuhandu has quit IRC | 11:59 | |
| *** ociuhandu has joined #openstack-meeting | 12:00 | |
| *** ociuhandu has quit IRC | 12:05 | |
| *** tosky has joined #openstack-meeting | 12:15 | |
| *** jmasud has quit IRC | 12:17 | |
| *** lpetrut has joined #openstack-meeting | 12:17 | |
| *** slaweq has joined #openstack-meeting | 12:17 | |
| *** ociuhandu has joined #openstack-meeting | 12:26 | |
| *** ociuhandu has joined #openstack-meeting | 12:27 | |
| *** ociuhandu has quit IRC | 12:28 | |
| *** ociuhandu has joined #openstack-meeting | 12:29 | |
| *** ociuhandu has quit IRC | 12:35 | |
| *** e0ne has joined #openstack-meeting | 12:38 | |
| *** ociuhandu has joined #openstack-meeting | 12:51 | |
| *** ociuhandu has quit IRC | 13:02 | |
| *** ociuhandu has joined #openstack-meeting | 13:07 | |
| *** falencastro has quit IRC | 13:10 | |
| *** ociuhandu has quit IRC | 13:12 | |
| *** slaweq has quit IRC | 13:15 | |
| *** ociuhandu has joined #openstack-meeting | 13:33 | |
| *** rosmaita has left #openstack-meeting | 13:34 | |
| *** ociuhandu has quit IRC | 13:37 | |
| *** ricolin has joined #openstack-meeting | 13:41 | |
| *** ociuhandu has joined #openstack-meeting | 13:55 | |
| *** e0ne has quit IRC | 13:56 | |
| *** rh-jelabarre has joined #openstack-meeting | 14:00 | |
| *** jeremyfreudberg has left #openstack-meeting | 14:08 | |
| *** TrevorV has joined #openstack-meeting | 14:37 | |
| *** dklyle has joined #openstack-meeting | 15:26 | |
| *** armax has joined #openstack-meeting | 15:27 | |
| *** lpetrut has quit IRC | 15:27 | |
| *** ociuhandu has quit IRC | 15:34 | |
| *** spotz has quit IRC | 15:44 | |
| *** ociuhandu has joined #openstack-meeting | 15:46 | |
| *** ociuhandu has quit IRC | 15:56 | |
| *** mlavalle has joined #openstack-meeting | 16:01 | |
| *** macz_ has joined #openstack-meeting | 16:10 | |
| *** macz_ has quit IRC | 16:10 | |
| *** macz_ has joined #openstack-meeting | 16:11 | |
| *** jamesden_ is now known as jamesdenton | 16:46 | |
| *** gyee has joined #openstack-meeting | 16:50 | |
| *** ociuhandu has joined #openstack-meeting | 16:51 | |
| *** ociuhandu has quit IRC | 16:52 | |
| *** ociuhandu has joined #openstack-meeting | 16:52 | |
| *** ircuser-1 has joined #openstack-meeting | 17:20 | |
| *** psachin has quit IRC | 17:23 | |
| *** jmasud has joined #openstack-meeting | 17:26 | |
| *** ociuhandu has joined #openstack-meeting | 17:27 | |
| *** ociuhandu has quit IRC | 17:33 | |
| *** rpittau is now known as rpittau|afk | 17:43 | |
| *** ociuhandu has joined #openstack-meeting | 19:13 | |
| *** bnemec has quit IRC | 19:18 | |
| *** bnemec has joined #openstack-meeting | 19:24 | |
| *** ociuhandu has quit IRC | 19:26 | |
| *** bnemec has quit IRC | 19:30 | |
| *** bnemec has joined #openstack-meeting | 19:32 | |
| *** bnemec has quit IRC | 19:37 | |
| *** bnemec has joined #openstack-meeting | 19:39 | |
| *** jamesmcarthur has joined #openstack-meeting | 19:41 | |
| *** jamesmcarthur has quit IRC | 19:57 | |
| *** dsariel has joined #openstack-meeting | 20:04 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:04 | |
| *** jamesmcarthur has quit IRC | 20:09 | |
| *** ociuhandu has joined #openstack-meeting | 20:17 | |
| *** ociuhandu has quit IRC | 20:18 | |
| *** ociuhandu has joined #openstack-meeting | 20:19 | |
| *** ociuhandu has joined #openstack-meeting | 20:20 | |
| *** ociuhandu has quit IRC | 20:29 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:31 | |
| *** ociuhandu has joined #openstack-meeting | 20:34 | |
| *** jamesmcarthur has quit IRC | 20:40 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:41 | |
| *** jamesmcarthur has quit IRC | 20:42 | |
| *** ociuhandu has quit IRC | 20:43 | |
| *** jmasud has quit IRC | 20:45 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:48 | |
| *** ociuhandu has joined #openstack-meeting | 20:56 | |
| *** alecuyer has joined #openstack-meeting | 20:58 | |
| *** jmasud has joined #openstack-meeting | 20:58 | |
| *** zaitcev has joined #openstack-meeting | 20:59 | |
| *** acoles has joined #openstack-meeting | 21:00 | |
| timburke | #startmeeting swift | 21:00 |
|---|---|---|
| openstack | Meeting started Wed Jan 6 21:00:21 2021 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| *** openstack changes topic to " (Meeting topic: swift)" | 21:00 | |
| openstack | The meeting name has been set to 'swift' | 21:00 |
| timburke | who's here for the swift meeting? | 21:00 |
| kota_ | o/ | 21:00 |
| acoles | o/ | 21:00 |
| seongsoocho | o/ | 21:00 |
| rledisez | hi! o/ | 21:01 |
| alecuyer | o/ | 21:01 |
| zaitcev | o/ | 21:01 |
| mattoliverau | o/ | 21:01 |
| timburke | as usual, the agenda's at https://wiki.openstack.org/wiki/Meetings/Swift | 21:01 |
| clayg | 0/ | 21:02 |
| timburke | first up | 21:02 |
| timburke | #topic happy new year | 21:02 |
| *** openstack changes topic to "happy new year (Meeting topic: swift)" | 21:02 | |
| timburke | hope everyone had a good break for the end of the year | 21:02 |
| timburke | we've done a lot of great stuff this last year, and i'm sure this coming year will be great, too :-) | 21:03 |
| *** ociuhandu has quit IRC | 21:03 | |
| timburke | but... there's also some stuff that's not so great | 21:03 |
| mattoliverau | 2020 is finally over, may 2021 be less 2020y :P | 21:03 |
| timburke | #topic stable gates | 21:04 |
| *** openstack changes topic to "stable gates (Meeting topic: swift)" | 21:04 | |
| timburke | mattoliverau, so far... that's not looking great. but we should always be hopeful! | 21:04 |
| timburke | so for about the past month we've had broken stable gates | 21:05 |
| timburke | a lot of fixes have landed to resolve the bandit troubles (on pike, queens, and rocky, and a slightly different tack tacken for victoria) | 21:07 |
| timburke | and is seems like we've got fixes for stein and train, though they're currently held up on some devstack patches | 21:07 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/766214 | 21:07 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/766489 | 21:08 |
| timburke | which depend on | 21:08 |
| timburke | #link https://review.opendev.org/c/openstack/devstack/+/768256 | 21:08 |
| timburke | #link https://review.opendev.org/c/openstack/devstack/+/768257 | 21:08 |
| clayg | Amazing work Tim! 🙏. Do you need any reviews or anything we can do to help? | 21:10 |
| timburke | i tried applying a similar fix for ussuri as was used for r-t | 21:10 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/769439 | 21:10 |
| timburke | but there seems to be some trouble with grenade | 21:11 |
| timburke | i'll keep working at it, will keep folks updated | 21:11 |
| timburke | clayg, thanks -- i'm not sure there *is* much to be done at this point, unless someone else would like to become the stable-branch champion. i'll keep trying to make it work, but there's other stuff i want to get done, too ;-) | 21:13 |
| timburke | #topic OpenStack Xena | 21:13 |
| *** openstack changes topic to "OpenStack Xena (Meeting topic: swift)" | 21:13 | |
| timburke | we have a new release name! | 21:13 |
| timburke | #link http://lists.openstack.org/pipermail/openstack-discuss/2020-December/019537.html | 21:13 |
| mattoliverau | I wonder if we can add the swift core group to swift stable, is there still a stable team? | 21:14 |
| mattoliverau | Nice I used to work on an opensource project called Xena, so this take me back.. let all the warrior princess memes begin :P | 21:14 |
| timburke | there is a separate swift-stable-maint group; if anyone else would like to join it, review some backports and i'd be happy to propose you be added to it | 21:15 |
| timburke | in general, i feel like the problem isn't review bandwidth, though; mostly a matter of putting in time to make sure things still work *shrug* | 21:16 |
| timburke | but speaking of new releases... | 21:17 |
| timburke | #topic swift 2.27.0 | 21:17 |
| *** openstack changes topic to "swift 2.27.0 (Meeting topic: swift)" | 21:17 | |
| clayg | we're only at 2.26.0.6 - it hasn't been *that* long since a release 🤷♂️ | 21:18 |
| timburke | i feel like we've landed a good bit of stuff lately, and we should probably do a fresh release soon | 21:18 |
| *** jmasud has quit IRC | 21:19 | |
| timburke | we've added audit watchers, improved waterfall ec, improved logging, fixed some py3 issues, added a new option to deal with libec upgrades, ... | 21:20 |
| clayg | 💪 :shipit: | 21:21 |
| timburke | so i'm going to work on getting some release notes up in the next week or two; if you know of anything else that really should land for the next release, let me know and i'll try to get it reviewed! | 21:21 |
| clayg | shard range caching (spoiler!!!) | 21:21 |
| timburke | (or add it to https://wiki.openstack.org/wiki/Swift/PriorityReviews -- or do both!) | 21:21 |
| *** jmasud has joined #openstack-meeting | 21:21 | |
| acoles | https://review.opendev.org/c/openstack/swift/+/761659 | 21:21 |
| timburke | speaking of... | 21:21 |
| timburke | #topic shard range caching for listings | 21:22 |
| *** openstack changes topic to "shard range caching for listings (Meeting topic: swift)" | 21:22 | |
| timburke | acoles, clayg take it away;-) | 21:22 |
| acoles | https://review.opendev.org/c/openstack/swift/+/761659 adds caching shard ranges in memcache for container listings | 21:22 |
| acoles | we've had it in production for a month or so and it works | 21:23 |
| clayg | when we shipped it to prod our baseline 5XX dropped to almost nothing and everyone was singing @acoles praises | 21:23 |
| acoles | it's had a few rounds of review so I hope it is close to merging | 21:24 |
| clayg | well, but it's blocked on you BUGFIX!!! (don don DUUUUUUN) | 21:24 |
| acoles | clayg: yeah, I was going to mention the bug too | 21:24 |
| acoles | so while working on this I discovered a nasty bug, but one I doubt any is at risk of yet | 21:25 |
| acoles | the bug fix is here https://review.opendev.org/c/openstack/swift/+/767410/5 | 21:25 |
| mattoliverau | I plan to review your bug + cache chain today. | 21:26 |
| mattoliverau | And is something that we shold land before the next release ;) | 21:26 |
| *** jamesmcarthur has quit IRC | 21:26 | |
| acoles | there's a corner case risk of loops in proxy, but only when shrinking shards, and then only in very particular conditions, but I really want to get that fixed, cos loops aren't good | 21:26 |
| * mattoliverau is never biased toward sharding patches :P | 21:27 | |
| *** jamesmcarthur has joined #openstack-meeting | 21:27 | |
| acoles | happily, the fix is relatively simple. so that is https://review.opendev.org/c/openstack/swift/+/767410 | 21:27 |
| acoles | back to the caching patch, I wanted to mention that by default the shard caching is enabled | 21:28 |
| acoles | (BTW, this is similar to the existing object PUT shard caching that timburke added a while back) | 21:28 |
| clayg | true true, which also was on by default - and helps with object PUT throughput quite a big on sharded containers | 21:29 |
| acoles | the complete set of shard ranges are cached on memcache, so if you have big containers with lots of shard ranges, the memcache values can be large. we have found it necessary to increase the default memcache config to allow for these increased sizes | 21:29 |
| zaitcev | so, how do I know what sizes to use? | 21:30 |
| clayg | hence: https://bugs.launchpad.net/swift/+bug/1890643 | 21:30 |
| openstack | Launchpad bug 1890643 in OpenStack Object Storage (swift) "shard range cache can get too big for memcache" [Undecided,New] | 21:30 |
| acoles | which is why I flag up the 'on by default' property | 21:30 |
| mattoliverau | Maybe we need to make sure that is mentioned something in doc? deployment or admin guide? | 21:30 |
| acoles | mattoliverau: yes! and we knew you would volunteer :D | 21:30 |
| acoles | ;) | 21:30 |
| clayg | mattoliverau: I think a doc change would be a GREAT fix for lp bug #1890643 | 21:30 |
| mattoliverau | lol, ok.. so long as someone gives me a hint on the right asswer I'll add it somewhere :P | 21:31 |
| acoles | zaitcev: yes, so we propose to add doc about memcache sizing | 21:31 |
| clayg | zaitcev: IIRC we bumped up from 1MB to 5MB? although 10MB would have probably been more reasonable 🤔 | 21:31 |
| clayg | by the time we caught it our largest container's shard ranges were something like 1400 KiB (but I think it was also full of overlaps) - point is we're close enough to the default swift deployments should be aware of it | 21:32 |
| timburke | the default for memcache is something like 1MB, right? ballpark an upper bound for a serialized shard range at something like 2-4kb, so you ought to be good until you've got >250 or so shard ranges for a container | 21:32 |
| clayg | maybe worse is that caching 5MB of json in memcache might not be like... "perfectly optimized" 😬 | 21:32 |
| *** jmlowe has quit IRC | 21:33 | |
| timburke | we should probably also flag up what happens when we exceed the max memcache value size (both here and in the deployment guide somewhere ;-) | 21:34 |
| timburke | in short, the `set` then works like a `delete`, and you start hammering the container DB again, similar to if caching were disabled | 21:35 |
| *** ociuhandu has joined #openstack-meeting | 21:36 | |
| clayg | yeah, caching disable sucks - which is why it's on by default | 21:36 |
| clayg | but if you're sharding (which is still notoriously difficult/manual) - but if you're sharding, luckily you'll also be caching (unless you didn't know the sekret memcache tweak - then you won't be caching... which sucks) | 21:37 |
| mattoliverau | hmm, maybe can recommend pulling the size stats from memcache peridically in one's monitoring scripts. Then you can know when your going to hit a ceiling. | 21:37 |
| clayg | but after we merge p 761659 and mattoliverau fixes lp bug #1890643 everything will be great! | 21:37 |
| openstack | Launchpad bug 1890643 in OpenStack Object Storage (swift) "shard range cache can get too big for memcache" [Undecided,New] https://launchpad.net/bugs/1890643 | 21:37 |
| clayg | mattoliverau: uhh... WE should probably do that 🤔 | 21:38 |
| clayg | we have some other memcache stats - like hit/miss - it's possible "min/max/avg key size" comes out too? | 21:39 |
| acoles | we should also figure out shrinking so that our shard lists do not grow infinitely long...I'm working on that | 21:39 |
| mattoliverau | according to google you can 'states sizes' | 21:39 |
| mattoliverau | according to google you can *'stats sizes' | 21:39 |
| *** ociuhandu has quit IRC | 21:40 | |
| mattoliverau | but the call may lock up for a while, so only something you'd want to do occasitionally | 21:40 |
| mattoliverau | acoles: YES! | 21:41 |
| clayg | STAT sizes_status disabled 🤔 | 21:41 |
| timburke | it may also come back with `STAT sizes_status disabled` (apparently; that's what my vsaio says, anyway) | 21:41 |
| mattoliverau | bugger | 21:41 |
| clayg | NEWAY - point is mattoliverau is going to merge this AWESOME FEATURE this afternoon - and do some docs soon - because matt is 'mazing | 21:42 |
| mattoliverau | lol, or rather acoles rocks :) | 21:42 |
| clayg | there's not a finate amount of awesomeness in the universe - you AND acoles can both rock 💪 | 21:42 |
| acoles | you rock I'll roll | 21:43 |
| timburke | is anyone opposed to the caching being on by default? iirc there was some concern about it before, but it sounds like most of the people involved with the patch now feel like on-by-default is the right way to go | 21:43 |
| acoles | (repeating) the object PUT shard caching is already on by default | 21:44 |
| mattoliverau | I figure 1. it's proven itself in prod and 2. sharding isn't something that is suppose to happen all the time so caching for some time is fine :) | 21:44 |
| *** ociuhandu has joined #openstack-meeting | 21:44 | |
| clayg | yeah the "amount of time" is configurable - but the "pounding the root to get ranges every object PUT and every container listing" was NOT working | 21:45 |
| clayg | i guess in theory you could turn the value to 0 if you hate your container servers 🤔 | 21:45 |
| clayg | or your clients | 21:45 |
| timburke | all right, sounds like we've got a plan then | 21:46 |
| timburke | that's all we had on the agenda | 21:46 |
| timburke | #topic open discussion | 21:46 |
| acoles | clayg: yep, setting the expiry time to 0 disables the caching | 21:46 |
| *** openstack changes topic to "open discussion (Meeting topic: swift)" | 21:46 | |
| timburke | what else should we bring up this week? | 21:46 |
| clayg | idk, we have some crazy clients - they be listing like massive concurrency for like parallel search or something | 21:47 |
| acoles | did I see audit watchers merged? | 21:47 |
| zaitcev | Yes | 21:47 |
| acoles | then we should congratulate zaitcev and all others involved - congrats! | 21:48 |
| timburke | it's so great. i need to write a few more watchers :-) | 21:48 |
| clayg | zaitcev: congrats!!! | 21:48 |
| zaitcev | acoles: dsariel did a lot of work | 21:48 |
| acoles | I mean, I had an entire career diversion while you kept plugging away on that | 21:48 |
| mattoliverau | Yeah! great work | 21:48 |
| timburke | slo validation's gonna be a good one... | 21:48 |
| zaitcev | Unfortunately, torgomatic is no longer around. | 21:49 |
| mattoliverau | acoles: lol | 21:49 |
| acoles | dsariel: congrats and thanks too | 21:49 |
| *** TrevorV has quit IRC | 21:50 | |
| zaitcev | We had some good changes done in the very final round of reviews. I just wish this good feedback could be gotten a year ago. I remember what I rolled out 2 PTGs ago, oh boy. And I thought it was ready to merge, too. | 21:50 |
| acoles | zaitcev: :'( yes, but maybe torgomatic is .... 'watching' | 21:50 |
| timburke | if anyone wants to look at some other watcher code, i've got https://review.opendev.org/c/openstack/swift/+/744078/ (EC stats, looking at libec versions and crcs) and https://review.opendev.org/c/openstack/swift/+/766640 (per-policy stats) proposed | 21:51 |
| *** ociuhandu has quit IRC | 21:51 | |
| zaitcev | I don't quite understand what the EC watcher does, but the CRC one clearly is useful. | 21:51 |
| zaitcev | I already went and abandoned Sam's original review 212824. | 21:53 |
| timburke | yeah, the CRC guy seems real useful for figuring out whether it's safe to upgrade libec | 21:53 |
| timburke | the per-policy stats are mainly just me wanting a way to get a size distribution of objects, and a split on how much data's in each policy | 21:54 |
| *** ociuhandu has joined #openstack-meeting | 21:54 | |
| timburke | all right, i'm calling it | 21:55 |
| timburke | thank you all for coming, and thank you for working on swift! | 21:55 |
| timburke | #endmeeting | 21:56 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:56 | |
| openstack | Meeting ended Wed Jan 6 21:56:00 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:56 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/swift/2021/swift.2021-01-06-21.00.html | 21:56 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/swift/2021/swift.2021-01-06-21.00.txt | 21:56 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/swift/2021/swift.2021-01-06-21.00.log.html | 21:56 |
| *** acoles has left #openstack-meeting | 21:56 | |
| *** zaitcev has left #openstack-meeting | 21:56 | |
| *** dsariel has left #openstack-meeting | 21:56 | |
| *** ociuhandu has quit IRC | 21:58 | |
| *** jamesmcarthur has quit IRC | 22:10 | |
| *** ociuhandu has joined #openstack-meeting | 22:10 | |
| *** jamesmcarthur has joined #openstack-meeting | 22:13 | |
| *** ociuhandu has quit IRC | 22:19 | |
| *** rcernin has joined #openstack-meeting | 22:27 | |
| *** jamesmcarthur has quit IRC | 22:28 | |
| *** jamesmcarthur has joined #openstack-meeting | 22:28 | |
| *** jmasud has quit IRC | 22:41 | |
| *** bnemec has quit IRC | 22:45 | |
| *** jamesmcarthur has quit IRC | 22:46 | |
| *** jamesmcarthur has joined #openstack-meeting | 22:47 | |
| *** rfolco has quit IRC | 22:50 | |
| *** jmasud has joined #openstack-meeting | 22:57 | |
| *** bnemec has joined #openstack-meeting | 23:01 | |
| *** eharney has quit IRC | 23:09 | |
| *** rh-jelabarre has quit IRC | 23:21 | |
| *** ociuhandu has joined #openstack-meeting | 23:25 | |
| *** ociuhandu has quit IRC | 23:30 | |
| *** jamesmcarthur has quit IRC | 23:39 | |
| *** jmasud has quit IRC | 23:49 | |
| *** jmasud has joined #openstack-meeting | 23:51 | |
| *** tosky has quit IRC | 23:51 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:58 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!