Tuesday, 2016-11-01

openstackgerritTim Burke proposed openstack/swift: EC: reconstruct using non-durable fragments  https://review.openstack.org/37663000:04
openstackgerritTim Burke proposed openstack/swift: Ensure update of the container by object-updater  https://review.openstack.org/9959800:07
*** clsacramento has quit IRC00:12
openstackgerritTim Burke proposed openstack/swift: Return 404 on a GET if tombstone is newer  https://review.openstack.org/37115000:48
*** rvasilets___ has quit IRC00:58
*** chlong has quit IRC01:09
*** klrmn has quit IRC01:11
*** nikivi has quit IRC01:34
kota_good morning02:02
kota_\o/ timburke is now a liberasurecode reviewer02:03
kota_thanks man.02:03
kota_which patch causes merge conflict a lot?02:12
kota_me needs to try to rebase almost of mine.02:13
* kota_ /02:13
openstackgerritKota Tsuyuzaki proposed openstack/swift: Support Read/Write Affinity Per Policy  https://review.openstack.org/38276602:17
*** klrmn has joined #openstack-swift02:19
openstackgerritKota Tsuyuzaki proposed openstack/swift: Fix stats calculation in object-reconstructor  https://review.openstack.org/28394602:20
openstackgerritKota Tsuyuzaki proposed openstack/swift: EC Fragment Duplication - Foundational Global EC Cluster Support  https://review.openstack.org/21916502:31
*** bkopilov has quit IRC02:58
*** bkopilov_ has quit IRC02:58
*** Jeffrey4l has joined #openstack-swift03:21
*** ukaynar has joined #openstack-swift03:38
*** vinsh has quit IRC03:43
*** ukaynar has quit IRC03:52
*** links has joined #openstack-swift03:52
*** janonymous has joined #openstack-swift04:12
*** bkopilov has joined #openstack-swift04:19
*** bkopilov_ has joined #openstack-swift04:19
openstackgerritchen.xing proposed openstack/swift: [install] Update the sample configuration file to newton  https://review.openstack.org/39203004:29
*** takashi has joined #openstack-swift04:49
*** vinsh has joined #openstack-swift05:14
*** vinsh has quit IRC05:19
*** sheel has joined #openstack-swift05:28
*** zaitcev has quit IRC05:55
*** takashi has quit IRC06:06
*** janonymous has quit IRC06:24
*** hseipp has joined #openstack-swift06:27
*** rcernin has joined #openstack-swift06:29
*** hseipp has quit IRC06:37
*** sanchitmalhotra has quit IRC07:01
*** sanchitmalhotra has joined #openstack-swift07:01
*** vinsh has joined #openstack-swift07:15
*** takashi has joined #openstack-swift07:19
*** vinsh has quit IRC07:20
*** tesseract has joined #openstack-swift07:21
*** tesseract is now known as Guest1438107:21
*** sams-gleb has joined #openstack-swift07:46
*** sams-gleb has joined #openstack-swift07:46
*** hseipp has joined #openstack-swift08:02
*** geaaru has joined #openstack-swift08:08
*** MRZ_ has joined #openstack-swift08:32
MRZ_Hi. Just a simple question! Does swift support data streaming? I want to read object from swift chunk by chunk. But not the whole object at once.08:33
MRZ_Is there any software component to implement this feature?08:34
*** arunman has joined #openstack-swift08:47
MRZ_Hi. Just a simple question! Does swift support data streaming? I want to read object from swift chunk by chunk, not the whole object at once09:14
*** vinsh has joined #openstack-swift09:17
*** vinsh has quit IRC09:22
*** vint_bra has joined #openstack-swift09:42
*** MRZ_ has quit IRC09:42
*** vint_bra1 has quit IRC09:44
*** dootniz is now known as kragniz09:59
*** arunman has quit IRC10:20
*** arunman has joined #openstack-swift10:22
*** arunman has quit IRC10:35
*** nikivi has joined #openstack-swift10:42
*** arunman has joined #openstack-swift10:43
*** chlong has joined #openstack-swift10:56
*** bkopilov has quit IRC11:07
*** bkopilov_ has quit IRC11:07
*** vinsh has joined #openstack-swift11:19
*** cdelatte has joined #openstack-swift11:23
*** vinsh has quit IRC11:23
openstackgerritKazuhiro MIYAHARA proposed openstack/swift: Remove duplicated 'User-Agent' header from object-updater's requests  https://review.openstack.org/38899911:50
*** arunman has quit IRC12:08
*** hseipp has quit IRC12:16
*** arunman has joined #openstack-swift12:16
*** vinsh has joined #openstack-swift12:20
*** furlongm has joined #openstack-swift12:21
*** arunman has quit IRC12:22
*** vinsh has quit IRC12:25
*** nikivi has quit IRC12:28
*** klamath has joined #openstack-swift12:35
*** klamath has joined #openstack-swift12:35
*** jerrygb_ has quit IRC12:38
*** mvk has quit IRC12:45
*** nikivi has joined #openstack-swift12:46
*** jerrygb has joined #openstack-swift12:52
*** takashi has quit IRC13:12
*** links has quit IRC13:14
*** StraubTW has joined #openstack-swift13:15
*** furlongm has quit IRC13:17
*** StraubTW_ has joined #openstack-swift13:18
*** StraubTW has quit IRC13:20
*** vinsh has joined #openstack-swift13:21
*** mvk has joined #openstack-swift13:23
*** vinsh has quit IRC13:26
openstackgerritJeff Li proposed openstack/swift: go: fix improper request cancellation  https://review.openstack.org/39216213:31
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925013:35
*** arunman has joined #openstack-swift13:36
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873613:36
*** hseipp has joined #openstack-swift13:40
*** nikivi has quit IRC13:53
*** jerrygb_ has joined #openstack-swift14:00
*** jerrygb has quit IRC14:02
*** arunman has quit IRC14:13
*** jordanP has joined #openstack-swift14:15
*** jordanP has quit IRC14:17
*** vinsh has joined #openstack-swift14:19
*** nikivi has joined #openstack-swift14:25
*** sgundur has joined #openstack-swift14:26
*** arunman has joined #openstack-swift14:30
*** jerrygb has joined #openstack-swift14:31
*** jerrygb_ has quit IRC14:33
*** arunman has quit IRC14:33
*** sgundur has quit IRC14:36
*** sgundur has joined #openstack-swift14:38
*** nikivi has quit IRC14:39
*** arunman has joined #openstack-swift14:41
*** sams-gleb has quit IRC14:47
*** sams-gleb has joined #openstack-swift14:48
*** nikivi has joined #openstack-swift14:49
*** sams-gleb has quit IRC14:52
*** silor has joined #openstack-swift14:55
*** silor has quit IRC15:00
*** silor has joined #openstack-swift15:00
*** jerrygb_ has joined #openstack-swift15:00
*** sgundur has quit IRC15:02
*** jerrygb has quit IRC15:03
*** chsc has joined #openstack-swift15:09
*** zaitcev has joined #openstack-swift15:09
*** ChanServ sets mode: +v zaitcev15:09
*** sams-gleb has joined #openstack-swift15:13
*** sgundur has joined #openstack-swift15:28
*** arunman has quit IRC15:29
notmynamegood morning15:29
*** sheel has quit IRC15:40
*** pcaruana has joined #openstack-swift15:44
*** sgundur has quit IRC15:44
*** sgundur has joined #openstack-swift15:46
*** sgundur has quit IRC15:48
*** Guest14381 has quit IRC15:51
*** arunman has joined #openstack-swift15:52
notmynameFYI for some reason I decided it would be a good idea to start today with a fight :-)16:01
notmynamehttp://eavesdrop.openstack.org/irclogs/%23openstack-dev/latest.log.html#t2016-11-01T15:33:5516:02
hseippnotmyname: if that helps, I've got something positive - I just added the Swift design summit sessions to https://wiki.openstack.org/wiki/Design_Summit/Ocata/Etherpads when I resognized they were missing there ;-)16:04
notmynamehseipp: thanks :-)16:04
notmynameI'm currently going through those to make some notes on highlights for the week16:06
notmynamebut I'll definitely want some feedback from people :-)16:06
*** rcernin has quit IRC16:06
notmynamebest place right now is to add any notes you have to one of those etherpads16:06
*** pcaruana has quit IRC16:07
*** peterlisak has quit IRC16:08
*** torgomatic_ has quit IRC16:08
*** blair has quit IRC16:08
*** torgomatic has joined #openstack-swift16:10
*** ChanServ sets mode: +v torgomatic16:10
*** peterlisak has joined #openstack-swift16:10
*** blair has joined #openstack-swift16:20
claygtorgomatic: yeah but if your global side effect was to open the file stat the inode and clear it's cache then close and unlink...16:40
*** jerrygb has joined #openstack-swift16:41
claygtimburke: i it's a fairly reasoned argument to say the debug log message is not needed - when reviewing the previous patch I couldn't help but notice that there was a silent loss of information that yes as you noted results in a purge - my gut was the risk was less than the pain of suppressing the warning - so as a compromise I thought I'd stick in a debug level message16:42
claygtimburke: I think the consolidation of the rsyen regex is a marked *good* improvement16:42
*** jerrygb_ has quit IRC16:43
claygtimburke: is your concern about the noisy debug higher than the good that comes out of that?16:43
*** jerrygb_ has joined #openstack-swift16:44
*** jerrygb has quit IRC16:46
claygi keep really wanting to read the "cross project proprietary driver code recap" - anyone have the recap summary ;)16:46
*** nikivi has quit IRC16:47
*** mvk has quit IRC16:48
notmynameclayg: it's not a long thread at all (4 messages). it's starting a discussion about how to deal with proprietary drivers. the first message has a pretty good summary of the 3 options presented16:51
notmynamebut it doesn't seem like a "recap". seems like the start of a discussion and asking for comments on which way to go forward16:52
notmynamebut the big issue seems to come down to how distros can distribute these drivers16:53
claygyuk16:53
notmynamethe secondary issue is the actual open-source-ness of the driver itself16:53
*** nikivi has joined #openstack-swift16:55
notmynamehas anyone here heard of or used oslo.service? https://github.com/openstack/oslo.service16:55
*** joeljwright has joined #openstack-swift17:11
*** ChanServ sets mode: +v joeljwright17:11
timburkekota_: it occurred to me that it's a bit of a blind spot for us, particularly since liberasurecode/pyeclib aren't on the review dashboard in the topic. some of those had been open and unreviewed for like 4 months!17:12
timburkeclayg: i agree that consolidating the regex is definitely GOOD. no doubt there. my concern is that those files should fall into two categories: stuff we don't care about and can safely clean up, and stuff we do care about (or at least *might* care about) that we should hold off on removing. if we don't care about it and will clean it up, i'm not sure what value we get out of logging about it17:16
timburkeit seems like it's in case our (rather broad) regex accidentally matched something that shouldn't get cleaned up, in which case, let's *fix the regex*17:17
claygtimburke: mostly thinking about the mind of the developer when he's working on the code and doing some probe testing17:17
claygi think the regex is fine17:17
*** nikivi has quit IRC17:17
claygthere's no pattern that won't have a pathaogical false positive (is there?)17:17
timburkei think it's rather broad, as your test demonstrates! we know what these rsync files are going to look like!17:17
claygsorry I can't get behind changing the regex - but if there was some convincing evidence that it should change I'd be glad if I only had to update it in one place17:18
timburkeagreed17:18
claygis there some other adjustment I could make to that diff that would convince you it was a net positive?17:18
timburkei'm not convinced it's a negative, i'm just skeptical of the utility of the debug logging.17:19
claygi'm also skeptical - you think siliencing that debug information would make the change better?17:19
timburkewell, we were getting annoyed at having too much logging information before, right?17:20
*** hseipp has quit IRC17:20
claygi'm 99% sure we should not log a waring when we think it's rsync - i was not 100% sure we should sometimes not log about an unexpected file we're about to delete - when I +2'd the change to supress the warning this seemed like a compromise17:21
claygi think there's a significant difference between a debug message and a warning message17:22
claygin development I'm not "flooded" by rsync temp file warnings - or else there's a good chance it would have been a debug message to begin with17:22
timburkefine, fine! i +2ed it already!17:22
timburke:P17:23
claygtimburke: you didn't have to +2 it - you could just tell me what you wanted changed17:23
claygI'd already conceeded I *also* wasn't sure about the debug?17:23
claygbut whateves17:23
claygthanks for jumping out there and getting that rsync regex consolidated!17:23
timburkenotmyname: what was that about starting the day with a fight? ;-)17:24
*** jerrygb has joined #openstack-swift17:25
claygok, i'm diving into patch 38765517:26
patchbothttps://review.openstack.org/#/c/387655/ - swift - Make ECDiskFileReader check fragment metadata17:26
claygtimburke: "discussion"17:26
timburkenice. i should go make the concern that prompted my question a bit more explicit.17:26
timburkeclayg: whatever it was, definitely *not* passive aggressive :-)17:27
claygi yell when i'm collaborating17:27
timburkeexactly17:27
*** jerrygb_ has quit IRC17:28
claygthis cat has a couple of changes to pending to hummingbird -> https://github.com/bluesalt?tab=repositories17:34
clayghttps://review.openstack.org/#/q/owner:jafelee%2540gmail.com+status:open17:35
claygnadeem: zaitcev: ^ you guys know how to golang?  I'm sure he'd appreciate some feedback?17:35
zaitcevclayg: thanks, I'll have a look17:36
claygzaitcev: yeah maybe we can rope him in yeah!?17:36
claygzaitcev: thank you!17:36
zaitcevclayg: please re-push https://review.openstack.org/#/c/390903/ it's just 1 call delete, surely you can do it in 1 minute. Maybe 2 minutes.17:37
patchbotpatch 390903 - swift (feature/hummingbird) - Better error messages in go/probe17:37
zaitcevbrb17:38
*** arunman has quit IRC17:40
openstackgerritClay Gerrard proposed openstack/swift: Better error messages in go/probe  https://review.openstack.org/39090317:41
*** mvk has joined #openstack-swift17:54
claygtimburke: kota_: you guys know how to liberasurecode right?  after I build/install from the git source I have a number of untracked files in my source tree?  should they be in the .gitignore for the project?17:57
clayg... is it just me?17:57
timburkeclayg: yeah, fairly certain those ought to be ignored17:58
*** joeljwright has quit IRC18:08
*** Jeffrey4l has quit IRC18:08
*** nikivi has joined #openstack-swift18:12
*** nikivi has quit IRC18:12
claygtimur: you have any idea why creating an internalclient takes 300ms?  https://github.com/swiftstack/container-crawler/issues/219:06
*** Administrator__ has joined #openstack-swift19:11
*** zhugaoxiao has quit IRC19:15
*** hseipp has joined #openstack-swift19:15
notmynamehaven't read it in depth yet, but https://zapier.com/learn/the-ultimate-guide-to-remote-working/ seems to have some good info that can apply to open source teams too19:18
*** clsacramento has joined #openstack-swift19:22
*** silor has quit IRC19:27
*** Renich has joined #openstack-swift19:37
*** mtreinish has quit IRC19:40
*** rcernin has joined #openstack-swift19:41
*** hseipp has quit IRC19:43
*** mtreinish has joined #openstack-swift19:43
*** cdelatte has quit IRC19:44
tdasilvanotmyname: when you have a chance could you into https://review.openstack.org/#/c/390846/19:52
patchbotpatch 390846 - swift (stable/newton) - Add a configurable URL base to staticweb19:52
openstackgerritClay Gerrard proposed openstack/swift: Make ECDiskFileReader check fragment metadata  https://review.openstack.org/38765520:11
*** Renich has quit IRC20:11
claygtimburke: you were curious about some sizes of fragment's and df chunks in patch 38765520:12
patchbothttps://review.openstack.org/#/c/387655/ - swift - Make ECDiskFileReader check fragment metadata20:12
*** arch-nemesis has joined #openstack-swift20:12
claygtimburke: can you say if that code handling the frag_buff needs to change before it can land?20:12
*** cdelatte has joined #openstack-swift20:37
notmynamedoes anyone here use a separate workstation/cluster/server(s) for swift dev work? ie instead of VMs20:40
notmynameif so, how's that working for you?20:40
*** sams-gleb has quit IRC20:41
notmynametdasilva: done20:46
tdasilvanotmyname: thanks!20:46
*** csmart has quit IRC20:51
*** csmart has joined #openstack-swift20:51
*** dfflanders has joined #openstack-swift20:54
zaitcevnotmyname: it works fine, except that management and coworkers constantly make passes trying to snatch them20:56
notmynamezaitcev: lol, that's exactly what timur just threatened to do if I get one ;-)20:58
notmynamezaitcev: so it's connected to public internet? or you VPN in?20:59
zaitcevnotmyname: VPN21:00
notmynamezaitcev: do you use one server or multiple?21:00
zaitcevnotmyname: I have 4, 1 proxy an 3 storage21:00
notmynamecool21:00
notmynamehow do you manage it?21:00
zaitcevtrying not to... it's DRAC5 lights-out console, so Fedora 10 is required to run a 32-bit Java21:01
zaitcevmostly just run "dnf update" and hope for the best21:01
zaitcevI have a private network on separate NICs to handle replication and proxy-storage traffic.21:02
notmynameany issues with network latency impacting overall flow of getting work done?21:06
*** joeljwright has joined #openstack-swift21:43
*** ChanServ sets mode: +v joeljwright21:43
zaitcevsingle-request performance is not amazing, but I dunno... Didn't benchmark it well enough.21:44
zaitcevUploading VM images through my cable modem, VPN, and whatnot is pretty slow, as well as counts against my data cap. But it works just as well as S3 would, which is not a speed demon either.21:45
*** jerrygb has quit IRC21:46
*** PsionTheory has joined #openstack-swift21:48
openstackgerritMerged openstack/swift: Make ECDiskFileReader check fragment metadata  https://review.openstack.org/38765521:48
clayg^ boom!  eat that invalid ec data bugs!21:48
*** vint_bra has quit IRC21:50
*** vint_bra has joined #openstack-swift21:51
*** vint_bra has quit IRC21:51
notmynameyay21:53
*** StraubTW_ has quit IRC21:54
*** PsionTheory has quit IRC22:04
*** jerrygb has joined #openstack-swift22:04
*** jerrygb has quit IRC22:06
*** geaaru has quit IRC22:16
*** rcernin has quit IRC22:31
*** klamath has quit IRC22:34
*** bricks_ has joined #openstack-swift22:56
*** bricks_ has left #openstack-swift22:57
*** bricks_ has joined #openstack-swift22:59
*** bricks_ has left #openstack-swift22:59
notmynamehttps://wiki.openstack.org/wiki/Swift/PriorityReviews is updated23:08
openstackgerritTim Burke proposed openstack/swift: Let users know entity size in 416 responses  https://review.openstack.org/39168323:08
*** ChanServ changes topic to "Let's talk, we're nice. | Ideas: https://wiki.openstack.org/wiki/Swift/ideas | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | Meetings: https://wiki.openstack.org/wiki/Meetings/Swift | Priority Reviews: https://wiki.openstack.org/wiki/Swift/PriorityReviews"23:09
*** _JZ_ has joined #openstack-swift23:16
openstackgerritMerged openstack/swift: Mirror X-Trans-Id to X-Openstack-Request-Id  https://review.openstack.org/38735423:18
*** kei_yama has joined #openstack-swift23:29
*** klrmn1 has joined #openstack-swift23:42
*** klrmn has quit IRC23:42
claygxenial/systemd is so much fun23:43
claygif you rm /var/log/syslog because your cleanswift/resetswift says so - be prepared to hit /var/log/syslog with touch ; chown :syslog ; and chmod 664 - because restarting syslog won't do it anymore23:45
notmynameoh interesting23:45
notmynamemy reset script kills /var/log/swift/* but leaves syslog alone23:45
claygnotmyname: oh well that's fine - if you do the syslog splitting23:46
claygdoes *everyone* like the syslog splitting except for me!?23:46
notmynameone-time setup cost seems worth it :/23:46
claygexcept I don't *like* it?  it's not lazyness - it's all automated - i actively do not like developing on a saio that logs somewhere besides /var/log/syslog - and esp. so if swift itself logs other places - I could probably eventually muscle memory `tail -f /var/log/swift.log` or something - then I'd be left with only the annoyance of other stuff I care about (e.g. liberasure) going somewhere besides the file I'm tailing23:48
claygbut like the thing in saio to split idk, like each node has it's own log file?  kill me now23:48
clayghaving all the logs pre correlated is like the good reason we have left to simulte a single node cluster on one machine23:49
claygif i'm missing something awesome about a different log setup i'd love to hear it?23:50
notmynamenot that I'm doing. I look in all.log for swift stuff. that's about it. one place to go for "just swift". hasn't caused any problems for me yet23:51
*** klrmn1 has quit IRC23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!