Tuesday, 2017-08-29

*** alenavolk has quit IRC00:23
*** alenavolk has joined #openstack-swift00:25
*** kiennt has joined #openstack-swift00:38
kota_good morning00:41
*** tovin07_ has joined #openstack-swift00:54
*** abhitechie has joined #openstack-swift00:56
*** mat128 has joined #openstack-swift00:57
*** alenavolk has quit IRC01:09
*** baojg_ has quit IRC01:10
*** klrmn has quit IRC01:13
*** two_tired has joined #openstack-swift01:58
*** CowboyPr1de has quit IRC02:03
*** alenavolk has joined #openstack-swift02:13
openstackgerritMerged openstack/python-swiftclient master: Add support for versionless endpoints  https://review.openstack.org/47374002:15
*** klrmn has joined #openstack-swift02:20
*** itlinux has joined #openstack-swift03:12
*** abhinavtechie has joined #openstack-swift03:13
*** baojg has joined #openstack-swift03:14
*** abhitechie has quit IRC03:15
*** abhinavtechie has quit IRC03:19
*** baojg has quit IRC03:19
*** kei_yama has quit IRC03:36
*** gkadam_ has joined #openstack-swift03:41
*** kei_yama has joined #openstack-swift03:42
*** abhitechie has joined #openstack-swift03:56
*** two_tired has quit IRC04:00
*** links has joined #openstack-swift04:03
*** gyee has quit IRC04:09
*** hoonetorg has quit IRC04:11
*** itlinux has quit IRC04:19
*** hoonetorg has joined #openstack-swift04:23
*** abhitechie has quit IRC04:38
*** abhitechie has joined #openstack-swift04:38
*** alenavolk has quit IRC04:55
*** alenavolk has joined #openstack-swift04:55
*** alenavolk has quit IRC04:56
*** alenavolk has joined #openstack-swift04:56
*** alenavolk has quit IRC04:56
*** alenavolk has joined #openstack-swift04:57
*** alenavolk has quit IRC04:57
*** alenavolk has joined #openstack-swift04:58
*** alenavolk has quit IRC04:58
*** alenavolk has joined #openstack-swift05:26
*** alenavolk has quit IRC05:32
*** alenavolk has joined #openstack-swift05:32
*** alenavolk has quit IRC05:32
*** alenavolk has joined #openstack-swift05:33
*** alenavolk has joined #openstack-swift05:34
*** alenavolk has quit IRC05:34
*** tovin07_ has quit IRC05:41
*** tovin07_ has joined #openstack-swift05:42
*** abhitechie has quit IRC05:57
*** cschwede has joined #openstack-swift06:07
*** ChanServ sets mode: +v cschwede06:07
*** abhitechie has joined #openstack-swift06:12
*** mat128 has quit IRC06:16
*** hseipp has joined #openstack-swift06:21
*** hseipp has quit IRC06:32
*** pcaruana has joined #openstack-swift06:39
*** rcernin has joined #openstack-swift07:10
*** bkopilov has quit IRC07:21
*** silor has joined #openstack-swift07:21
*** oshritf has joined #openstack-swift07:23
*** tesseract has joined #openstack-swift07:25
*** bkopilov has joined #openstack-swift07:26
*** geaaru has joined #openstack-swift07:31
*** __david_ has quit IRC07:33
acolesgood morning07:42
kota_good morning acoles07:47
acoleskota_: hi07:47
rledisezhi08:02
rledisezi was looking at the statsd counter object-server.async_pendings. it is a bit disturbing (even if doc is correct), because it is incremented when a container update fails (or timeouts) AND when an object with X-Delete-At meta is created/deleted08:03
rlediseznot sure it's a bug because doc is right, but it is no help when you want to monitor an issue (container update failure)08:03
rledisezshould we add a new counter for this specific case or stop incrementing when it's about x-delete-at update08:04
rledisez?08:04
acolesrledisez: it is incremented when either of those ops fail, correct? (container update, x-delete-at-update)08:13
acolesrledisez: hmm, but also for delete_at_update for a DELETE? (I'm just reading the code)08:14
rledisezacoles: yes, when there is a delete_at_udpate, there is no request sent, it's a async_pendings directly (to avoid more latency i guess)08:15
mattoliverauDoes the updater itself push the same metrics? /Me isn't looking at code cause he's at hospital with wife (nothing serious, wife just had day surgery)08:19
mattoliverauCause there could be a case for a different one there, so you can see the different types of failures and track potential probs08:20
*** joeljwright has joined #openstack-swift08:22
*** ChanServ sets mode: +v joeljwright08:22
acolesasync_pendings seems to be incremented whenever an update is pickled which as rledisez says is either because the sync update failed or it's a delete_at_update08:24
rledisezmattoliverau: updater only seems to track successes/errors when treating the async-update fules08:24
rledisezso, no way to tell the difference between a "container update error" or a "x-delete-at job"08:25
acolesThe delete_at_update may be because obj server doesn't know the destination for update so defers to the updater which has the container ring loaded???08:25
acolesrledisez: yeah I can see that it could be usefult o differentiate between the two08:26
acolesuseful to*08:26
acolesmattoliverau: o/ hope all goes well there for you08:26
mattoliverauacoles: thanks08:28
acolesrledisez: or at least add another so the async_pendings due to timeouts vs delete_at_updates can be inferred08:29
mattoliverauSo something like async_pendings.timeout and async_pendings08:37
rledisezi might propose to move the increment out of the diskfile to have it in container_update() and delete_at_update(). or a new param for the name of the counter?08:49
*** hseipp has joined #openstack-swift09:15
acolesrledisez: might be worth considering adding another metric for one subset and leaving async_pendings as it is - IDK, I am just wondering if changing async_pendings could affect monitoring for someone - at the moment async_pendings does reflect how many updates are pending, just not *why*09:32
rledisezacoles: sure, makes sense09:37
*** abhitechie has quit IRC09:49
*** silor has quit IRC09:58
*** tovin07_ has quit IRC10:06
*** sanchitmalhotra has joined #openstack-swift10:20
*** sanchitmalhotra has quit IRC10:21
*** sanchitmalhotra has joined #openstack-swift10:27
*** kei_yama has quit IRC10:29
*** joeljwright has quit IRC10:47
*** kiennt has quit IRC11:28
*** baojg has joined #openstack-swift11:52
*** abhitechie has joined #openstack-swift12:19
*** MVenesio has joined #openstack-swift12:20
*** MVenesio has quit IRC12:20
*** bkopilov has quit IRC12:25
*** bkopilov has joined #openstack-swift12:25
*** gkadam_ has quit IRC12:39
*** lucasxu has joined #openstack-swift12:42
*** mat128 has joined #openstack-swift12:47
*** joeljwright has joined #openstack-swift12:47
*** ChanServ sets mode: +v joeljwright12:47
*** zhurong has joined #openstack-swift12:50
*** gabor_antal_ has joined #openstack-swift12:59
*** hoonetorg has quit IRC13:08
*** hoonetorg has joined #openstack-swift13:09
*** links has quit IRC13:18
*** catintheroof has joined #openstack-swift13:19
*** abhinavtechie has joined #openstack-swift13:49
*** abhitechie has quit IRC13:51
*** zhurong has quit IRC14:03
*** baojg has quit IRC14:25
*** baojg has joined #openstack-swift14:26
*** vint_bra has joined #openstack-swift14:34
*** baojg has quit IRC14:37
*** baojg has joined #openstack-swift14:39
*** baojg has quit IRC14:40
*** baojg has joined #openstack-swift14:40
*** baojg has quit IRC14:40
*** chlong has joined #openstack-swift14:41
*** baojg has joined #openstack-swift14:42
*** baojg has quit IRC14:42
*** itlinux has joined #openstack-swift14:49
timburkegood morning14:49
*** SkyRocknRoll has joined #openstack-swift15:10
*** alenavolk has joined #openstack-swift15:15
*** itlinux has quit IRC15:15
*** gyee has joined #openstack-swift15:21
*** tovin07 has joined #openstack-swift15:30
*** saint_ has joined #openstack-swift15:44
*** SkyRocknRoll has quit IRC15:55
*** SkyRocknRoll has joined #openstack-swift16:08
claygI'm confused - do x-delete-at meta updates *always* go to async pending?  i would expect the update at least attempt to hit the container db inline...16:08
rledisezclayg: as far as i understand the code, it always go through async pendings16:11
rledisezhttps://github.com/openstack/swift/blob/master/swift/obj/server.py#L429-L43416:11
rledisezs/always/only/16:11
rledisezooops, forget it, i'm doubting now16:11
* clayg shrugs16:13
*** tesseract has quit IRC16:15
timburkethat makes sense to me -- otherwise we've got as many as three container update attempts before we send back our 2xx16:17
*** saint_ has quit IRC16:19
*** SkyRocknRoll has quit IRC16:22
*** itlinux has joined #openstack-swift16:23
*** SkyRocknRoll has joined #openstack-swift16:24
*** hseipp has quit IRC16:26
*** SkyRocknRoll_ has joined #openstack-swift16:33
*** SkyRocknRoll has quit IRC16:34
*** gkadam_ has joined #openstack-swift16:37
*** rcernin has quit IRC16:46
notmynamehello, world16:47
*** itlinux has quit IRC16:48
*** pcaruana has quit IRC16:48
*** itlinux has joined #openstack-swift16:49
openstackgerritTim Burke proposed openstack/python-swiftclient master: Add Python 3.6 classifier & default tox env  https://review.openstack.org/49798016:50
openstackgerritTim Burke proposed openstack/python-swiftclient master: Add pypy-devel for RPM-based systems  https://review.openstack.org/49886916:50
clayg@timburke: I really want subtest... I think we should depend on unittest2.16:52
claygtimburke: modernizing tests to use py3 patterns would be an ok thing?  What's your opinion?16:53
*** links has joined #openstack-swift16:54
timburkei'm not opposed... though the behavior will depend on the test runner, it seems16:59
timburkehttp://paste.openstack.org/show/619805/17:03
*** geaaru has quit IRC17:07
*** silor has joined #openstack-swift17:12
*** gkadam_ has quit IRC17:15
*** tovin07 has quit IRC17:17
timburkestill, it degrades gracefully17:19
claygtimburke: that's bullshit!17:32
claygnose2?17:34
*** links has quit IRC17:34
claygsome recent toy project on ned batchelder (author of nose) is using https://github.com/HypothesisWorks/hypothesis-python#hypothesis17:39
*** aagrawal has joined #openstack-swift17:40
openstackgerritMerged openstack/swift master: Make X-Backend-Replication consistent for HEAD  https://review.openstack.org/49810717:42
*** abhinavtechie has quit IRC17:44
*** catintheroof has quit IRC17:49
*** lucasxu has quit IRC18:01
*** SkyRocknRoll_ has quit IRC18:02
timburkeinteresting... i've played around with parameterized tests a bit before... where'd i put that...18:18
timburkehttps://gist.github.com/tipabu/1a06eafe0a43b29b82f1d806488cdb8a18:21
*** catintheroof has joined #openstack-swift18:23
*** cschwede has quit IRC18:29
tdasilvaI remember watching a presentation on hypothesis a while back here at redhat...looked pretty neat18:30
*** alenavolk has quit IRC18:33
*** alenavolk has joined #openstack-swift18:34
*** alenavolk has quit IRC18:34
*** alenavolk has joined #openstack-swift18:34
*** alenavolk has quit IRC18:35
*** early has quit IRC18:59
*** early has joined #openstack-swift19:02
*** hseipp has joined #openstack-swift19:05
*** alenavolk has joined #openstack-swift19:11
*** hseipp has quit IRC19:17
*** catintheroof has quit IRC19:30
*** abhinavtechie has joined #openstack-swift19:33
*** catintheroof has joined #openstack-swift19:36
*** aagrawal has quit IRC19:36
*** alenavolk has quit IRC19:38
*** alenavolk has joined #openstack-swift19:41
*** silor has quit IRC20:01
openstackgerritTim Burke proposed openstack/swift master: Move listing formatting out to proxy middleware  https://review.openstack.org/44939420:45
*** alenavolk has quit IRC21:00
*** joeljwright_ has joined #openstack-swift21:05
*** mat128 has quit IRC21:08
*** joeljwright has quit IRC21:08
*** alenavolk has joined #openstack-swift21:24
*** catintheroof has quit IRC21:34
tdasilvanotmyname: https://www.backblaze.com/blog/hard-drive-failure-stats-q2-2017/21:48
notmynametdasilva: thanks. yeah, I read over it this morning21:48
notmynameseems seagate is having a bad time of it lateley :/21:48
tdasilvainteresting bit: "During Q2 we migrated nearly 30 Petabytes of data."...to a remote location21:48
openstackgerritJoel Wright proposed openstack/swift master: Add Preamble and Postamble to SLO and SegmentedIterable  https://review.openstack.org/36537122:05
*** itlinux has quit IRC22:14
*** alenavolk has quit IRC22:19
*** alenavolk has joined #openstack-swift22:19
*** alenavolk has quit IRC22:21
*** vint_bra has quit IRC22:23
*** okdas has quit IRC22:35
*** okdas has joined #openstack-swift22:36
*** okdas has joined #openstack-swift22:36
*** abhinavtechie has quit IRC23:01
*** joeljwright_ has quit IRC23:06
mattoliveraumornign23:12
mattoliverau*morning23:12
*** ianychoi has quit IRC23:17
*** ianychoi has joined #openstack-swift23:17
*** kei_yama has joined #openstack-swift23:34
*** abhitechie has joined #openstack-swift23:41
*** __david_ has joined #openstack-swift23:47
*** nottrobin has quit IRC23:59
*** nottrobin has joined #openstack-swift23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!