Wednesday, 2019-02-13

openstackgerritTim Burke proposed openstack/pyeclib master: Try harder to find liberasurecode  https://review.openstack.org/63650100:09
openstackgerritTim Burke proposed openstack/pyeclib master: Try harder to find liberasurecode  https://review.openstack.org/63650100:16
*** mikecmpbll has quit IRC00:24
*** openstackgerrit has quit IRC00:52
*** gyee has quit IRC01:07
*** gyee has joined #openstack-swift01:10
zaitcevIt turned out, liberasurecode has its own problem on s390x:01:23
zaitcevBUILDSTDERR: 14 - test_metadata_crcs_le: UNKNOWN (idx=0) ... lt-liberasurecode_test: liberasurecode_test.c:1779: test_metadata_crcs_le: Assertion `liberasurecode_get_fragment_metadata(header, &res) == 0' failed.01:23
*** gyee has quit IRC01:47
*** spsurya has joined #openstack-swift03:55
*** openstackgerrit has joined #openstack-swift05:06
openstackgerritMerged openstack/swift master: Leave less garbage in /var/tmp  https://review.openstack.org/63626205:06
*** psachin has joined #openstack-swift05:49
openstackgerritPete Zaitcev proposed openstack/liberasurecode master: Make our alt crc32 more portable  https://review.openstack.org/63655606:45
openstackgerritPete Zaitcev proposed openstack/liberasurecode master: Remove get_chksum to hush warnings  https://review.openstack.org/63655806:48
*** gkadam has joined #openstack-swift07:00
*** e0ne has joined #openstack-swift07:36
*** ccamacho has joined #openstack-swift07:48
*** tkajinam has quit IRC08:36
*** early has quit IRC08:54
*** early has joined #openstack-swift08:56
*** early has quit IRC09:06
*** e0ne has quit IRC09:06
*** e0ne has joined #openstack-swift09:07
*** mikecmpbll has joined #openstack-swift09:12
*** early has joined #openstack-swift09:15
*** hseipp has joined #openstack-swift09:21
openstackgerritNguyen Hai proposed openstack/swift master: fix tox python3 overrides  https://review.openstack.org/57298309:30
openstackgerritKota Tsuyuzaki proposed openstack/swift feature/losf: WIP - Abstract file and directory operations in replicator/reconstructor  https://review.openstack.org/63657709:32
openstackgerritKota Tsuyuzaki proposed openstack/swift feature/losf: Lots Of Small Files - alternate diskfile  https://review.openstack.org/63657809:32
kota_alecuyer, rledisez: pushed the two changes in alecuyer's repo into feature/losf branch with rebased.09:33
*** e0ne has quit IRC09:34
*** hseipp has quit IRC09:40
*** hseipp has joined #openstack-swift09:43
rledisezkota_: thx a lot. starting tomorrow i'll be off for one week. but after that, we need to take some time so I can start working on the feature branch with you09:43
rledisezalecuyer: is off this week, he'll be back at work on Monday09:43
kota_rledisez: no worries, I had a week off in the last week ;) then, starting to review the design docs in this week.09:44
kota_I'm thinking that would be nice to have an extra gate job running functests with losf that helps us to know any regressions even if we decided design changes.09:45
kota_ok, we got a lot of failures with sort of tox, pep8, functests in those tests. Let's fix them to stand at the start line.10:13
*** e0ne has joined #openstack-swift10:46
*** e0ne_ has joined #openstack-swift10:50
*** e0ne has quit IRC10:52
openstackgerritKota Tsuyuzaki proposed openstack/swift feature/losf: WIP - Abstract file and directory operations in replicator/reconstructor  https://review.openstack.org/63657711:17
kota_anyway, fix the failures step by step. just fix pep8 failures. I still had a bunch of unit test failures in my local env.11:19
openstackgerritAlexandra Settle proposed openstack/swift stable/rocky: Fixing target for cross-ref 'get_data_dir'  https://review.openstack.org/63659511:21
*** asettle has joined #openstack-swift11:23
*** ccamacho has quit IRC11:39
*** e0ne has joined #openstack-swift11:56
*** e0ne has quit IRC11:57
*** e0ne_ has quit IRC11:57
*** e0ne has joined #openstack-swift12:08
*** ccamacho has joined #openstack-swift12:09
*** e0ne has quit IRC12:12
*** e0ne has joined #openstack-swift12:22
*** e0ne has quit IRC13:11
*** e0ne has joined #openstack-swift13:17
*** e0ne_ has joined #openstack-swift13:20
*** e0ne has quit IRC13:23
*** e0ne_ has quit IRC13:40
*** e0ne has joined #openstack-swift13:45
*** e0ne_ has joined #openstack-swift13:50
*** e0ne has quit IRC13:51
*** hseipp has quit IRC13:54
*** e0ne_ has quit IRC14:04
*** mikecmpbll has quit IRC14:05
*** mikecmpbll has joined #openstack-swift14:07
*** e0ne has joined #openstack-swift14:29
*** e0ne_ has joined #openstack-swift14:35
*** e0ne has quit IRC14:35
*** e0ne_ has quit IRC14:41
*** e0ne has joined #openstack-swift14:50
*** e0ne_ has joined #openstack-swift14:55
*** e0ne has quit IRC14:55
*** hseipp has joined #openstack-swift15:40
*** supamatt has joined #openstack-swift15:47
*** supamatt has quit IRC15:49
*** supamatt has joined #openstack-swift15:49
*** gkadam has quit IRC15:53
*** ianychoi has quit IRC16:08
openstackgerritTim Burke proposed openstack/pyeclib master: Try harder to find liberasurecode  https://review.openstack.org/63650116:46
openstackgerritTim Burke proposed openstack/pyeclib master: Fix gate  https://review.openstack.org/63666816:47
timburke:-( still no release that includes https://github.com/pypa/twine/commit/125b772 ?16:47
*** e0ne has joined #openstack-swift16:47
*** e0ne_ has quit IRC16:48
*** gyee has joined #openstack-swift16:55
*** itlinux has joined #openstack-swift17:05
*** itlinux has quit IRC17:09
*** itlinux_ has joined #openstack-swift17:09
*** itlinux_ has quit IRC17:14
openstackgerritTim Burke proposed openstack/swift master: Make get_data/async/tmp_dir explicit  https://review.openstack.org/63668417:14
openstackgerritTim Burke proposed openstack/swift master: Fixing target for cross-ref 'get_data_dir'  https://review.openstack.org/63668517:14
*** itlinux has joined #openstack-swift17:14
*** psachin has quit IRC17:18
*** hseipp has quit IRC17:21
*** e0ne has quit IRC17:25
*** itlinux has quit IRC17:30
*** mikecmpbll has quit IRC17:30
*** itlinux has joined #openstack-swift17:35
openstackgerritTim Burke proposed openstack/pyeclib master: Fix gate  https://review.openstack.org/63666817:37
openstackgerritTim Burke proposed openstack/pyeclib master: Try harder to find liberasurecode  https://review.openstack.org/63650117:37
*** itlinux_ has joined #openstack-swift17:39
*** itlinux has quit IRC17:41
openstackgerritTim Burke proposed openstack/pyeclib master: Fix gate  https://review.openstack.org/63666817:43
openstackgerritTim Burke proposed openstack/pyeclib master: Try harder to find liberasurecode  https://review.openstack.org/63650117:43
zaitcevEveryone runs "tox -e pep8" locally before "git review", right? RIGHT?17:45
openstackgerritTim Burke proposed openstack/swift master: Make get_data/async/tmp_dir explicit  https://review.openstack.org/63668417:48
openstackgerritTim Burke proposed openstack/swift master: Fixing target for cross-ref 'get_data_dir'  https://review.openstack.org/63668517:48
timburke<_<17:48
timburke>_>17:48
* timburke slinks away sheepily17:49
zaitcevWell, I missed the TMPDIR_BASE so we're even17:55
openstackgerritMerged openstack/pyeclib master: Fix gate  https://review.openstack.org/63666817:56
openstackgerritTim Burke proposed openstack/pyeclib master: Move project-config job definitions in-tree  https://review.openstack.org/63669818:00
timburkezaitcev: again, though -- `tox -e pep8` would've caught it18:05
timburkethe issue i always have is that running tox for a project whose source is hosted on a vagrant shared filesystem *sucks* -- takes several minutes to *setup*, not even run anything...18:08
*** itlinux_ has quit IRC18:08
zaitcevHmm. I just have a directory on the laptop, but I guess in the age of iPad everything you need a VM or VPS somewhere to do anything sensible.18:10
zaitcevtimburke: so, about that py3 "sharder" patch https://review.openstack.org/57032018:16
patchbotpatch 570320 - swift - py3: port the container sharder - 14 patch sets18:16
zaitcevMatt promised to look it, too, but he's not been seen since then.18:16
*** e0ne has joined #openstack-swift18:22
*** mikecmpbll has joined #openstack-swift18:42
*** mikecmpbll has quit IRC18:47
openstackgerritMerged openstack/swift master: Display crypto data/metadata details in swift-object-info  https://review.openstack.org/58690318:53
*** vr42 has joined #openstack-swift19:41
openstackgerritTim Burke proposed openstack/pyeclib master: Move project-config job definitions in-tree  https://review.openstack.org/63669819:46
*** e0ne has quit IRC19:47
timburkeso... are we cool with pyeclib dropping support for libec < 1.4.0? in particular, i want to take advantage of https://github.com/openstack/liberasurecode/commit/09d8bbf in setup.py, instead of trusting the filename of the library...20:00
timburkei suppose 1.3.1 at least had p 393595 ...20:00
patchbothttps://review.openstack.org/#/c/393595/ - liberasurecode - Fix error handling on gf_ivnert_matrix in isa-l ba... (MERGED) - 4 patch sets20:00
timburkebut you needed 1.4.0 to get p 39326320:01
patchbothttps://review.openstack.org/#/c/393263/ - liberasurecode - ISA-L Cauchy support (MERGED) - 8 patch sets20:01
notmynametimburke: IMO, gut reaction, yes. supporting >=1.4.0 is fine20:02
notmynamethat was tagged dec 201620:03
timburkeyeah, we've had a nice long period...20:03
openstackgerritJohn Dickinson proposed openstack/swift stable/ocata: ocata stable backports  https://review.openstack.org/63647120:20
*** vr42 has quit IRC20:20
openstackgerritJohn Dickinson proposed openstack/swift stable/pike: pike stable backports  https://review.openstack.org/63647020:22
openstackgerritJohn Dickinson proposed openstack/swift stable/queens: changelog for queens backports  https://review.openstack.org/63646820:23
openstackgerritJohn Dickinson proposed openstack/swift stable/rocky: rocky stable backports  https://review.openstack.org/63646920:24
openstackgerritTim Burke proposed openstack/pyeclib master: Try harder to find liberasurecode  https://review.openstack.org/63650120:27
openstackgerritTim Burke proposed openstack/pyeclib master: Use liberasurecode_get_version()  https://review.openstack.org/63674820:27
tdasilvatimburke: for p 636698, wondering if it would make sense to add py36 to the gate as non-voting (instead of experimental)20:32
patchbothttps://review.openstack.org/#/c/636698/ - pyeclib - Move project-config job definitions in-tree - 2 patch sets20:32
tdasilvain fact, maybe all those experimental could be moved20:32
openstackgerritMerged openstack/pyeclib master: Move project-config job definitions in-tree  https://review.openstack.org/63669820:36
timburketdasilva: we should probably have both 35 and 36 in check and gate, and both as voting20:39
timburkei wouldn't be opposed to moving all of them though20:40
tdasilvatimburke: just so that we don't have to keep doing the 'check experimental' piece20:40
tdasilvai think they are stable enough20:40
tdasilvaplust the jobs that run pyeclib against libec master are useful IMO20:41
timburkeagreed; they pass now, they are unlikely to suddenly *not pass* later -- if they don't, it's probably a legit probelm with the patch20:41
timburkenotmyname: oh no! http://logs.openstack.org/48/636748/1/check/openstack-tox-py27/a23bfb2/ara-report/result/37b898bb-1321-4a94-a810-3cf420d747de/ says it's testing with 1.1.0 :-(20:43
notmyname1.1.0 is just right out20:44
timburkenotmyname: well... https://packages.ubuntu.com/xenial/liberasurecode120:45
timburkebionic's cool -- it's at 1.5.020:45
tdasilvaright20:46
tdasilvacan we change the job so that it doesn't use xenial?20:46
timburkecentos is smart and doesn't include our code in the distro repos :P20:47
timburkeearliest cloud repo seems to be ocata, which is 1.4.020:47
timburketdasilva: i could get behind that idea... but i could also fix the heuristic in my change20:48
timburkeidk that i want to keep people from being able to do dev work on xenial just yet...20:50
kota_morning20:58
notmynamejust about meeting time in #openstack-meeting20:58
notmynamekota_: mattoliverau: timburke: clayg: tdasilva: zaitcev: rledisez: curtesey ping20:59
claygthanks!21:00
*** itlinux has joined #openstack-swift21:04
*** asettle has quit IRC21:21
openstackgerritTim Burke proposed openstack/liberasurecode master: Make our alt crc32 more portable  https://review.openstack.org/63655621:25
clayggreat meeting21:39
claygpy3 FTW21:39
timburkeclayg: https://review.openstack.org/#/c/636501/ was kinda interesting, needing to backport a cpython fix from dec 2016...21:41
patchbotpatch 636501 - pyeclib - Try harder to find liberasurecode - 6 patch sets21:41
timburke(+/-)21:41
timburkethings like https://github.com/python/cpython/pull/7932 still scare me though -- when are we actually going to be able to run our func tests??21:43
claygtimburke: at least https://bugs.python.org/issue9998 is resolved now right!21:44
timburkeclayg: and https://bugs.python.org/issue22233 !21:44
notmynameisn't there another cpython bug you were tracking, though?21:45
timburkenotmyname: i've written https://bugs.python.org/issue33973 and https://bugs.python.org/issue3469821:46
clayg"a py2 project with a very... robust... test suite" awww that's sweet21:46
timburkefirst one i also wrote a patch for it21:46
claygthe cpython patch!  this one https://github.com/python/cpython/pull/7932 ?  That's awesome!21:48
zaitcevclayg: check this out, I'm coming to a meetup about gRPC https://www.meetup.com/GDG-Cloud-Austin/events/258700734/21:54
zaitcevYou might make it in time if you jump into your car _right now_21:54
claygzaitcev: that's tomorrow!21:54
claygoh, or tonight21:54
claygcan't make it tonight tho :'(21:55
notmynamedo we have any docs page that describes eventual consistency in one place?21:55
clayglet me know how it turns out tho!21:55
*** itlinux has quit IRC21:58
*** rchurch has joined #openstack-swift22:00
*** rchurch_ has quit IRC22:01
openstackgerritMerged openstack/liberasurecode master: Make our alt crc32 more portable  https://review.openstack.org/63655622:04
zaitcevWe're starting on Thursday May 2 in Denver, right?22:17
*** openstackgerrit has quit IRC22:22
*** openstackgerrit has joined #openstack-swift22:27
openstackgerritTim Burke proposed openstack/pyeclib master: Use liberasurecode_get_version()  https://review.openstack.org/63674822:27
openstackgerritTim Burke proposed openstack/pyeclib master: Try harder to find liberasurecode  https://review.openstack.org/63650122:27
timburkenotmyname: thoughts on https://review.openstack.org/#/c/636470/2/releasenotes/notes/2_15_2_release-6996eccabba558b4.yaml@20 ? how do we assure deployers that they won't regress the fix they picked up in 2.15.2 when they upgrade to 2.21.0 if not all the 2.15.2 fixes are on master's changelog?22:33
patchbotpatch 636470 - swift (stable/pike) - pike stable backports - 2 patch sets22:33
notmynamethe fact of the matter is that we backported stuff that wasn't in the master changelog22:35
timburkeso how about we backfill master?22:35
openstackgerritTim Burke proposed openstack/pyeclib master: Use liberasurecode_get_version()  https://review.openstack.org/63674822:38
openstackgerritTim Burke proposed openstack/pyeclib master: Try harder to find liberasurecode  https://review.openstack.org/63650122:38
openstackgerritTim Burke proposed openstack/pyeclib master: Move experimental jobs to be gating  https://review.openstack.org/63677122:41
timburkesee, i *knew* i could come up with something that'd still be happy w/1.1.0...22:49
*** tkajinam has joined #openstack-swift23:05
*** mrjk_ has quit IRC23:10
notmynamezaitcev: timburke: updated https://wiki.openstack.org/wiki/Swift/PriorityReviews23:31
zaitcevnotmyname: thanks, I missed one on that list23:37
zaitcevI'm off to grpc meetup23:37
*** zaitcev has quit IRC23:38
timburkehttps://review.openstack.org/#/c/611686/ was follow-up from zaitcev's py3-account-server work, but isn't strictly needed for py323:48
patchbotpatch 611686 - swift - Clean up account-reaper a bit - 2 patch sets23:48
timburkestill, removing a bunch of string concatenation in favor of ''.join(), net-negative lines, having tests that more-closely reflect reality... what's not to love?23:49
notmynameI simply searched for patches with "py3" in the topic or subject. please feel free to update the wiki as needed :-)23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!