openstackgerrit | Merged openstack/swift feature/deep: Clean up logs a bit https://review.openstack.org/564613 | 00:06 |
---|---|---|
openstackgerrit | Merged openstack/swift feature/deep: Catch more exceptions when recording progress https://review.openstack.org/564605 | 00:06 |
*** brimestone has quit IRC | 00:08 | |
*** vint_bra has joined #openstack-swift | 00:47 | |
*** psachin has joined #openstack-swift | 01:01 | |
*** vint_bra has quit IRC | 01:27 | |
*** vint_bra has joined #openstack-swift | 01:35 | |
*** vint_bra has quit IRC | 02:08 | |
openstackgerrit | Merged openstack/swift feature/deep: Commit from pending file less often https://review.openstack.org/564630 | 02:08 |
openstackgerrit | Merged openstack/swift feature/deep: Reclaim deleted shard range rows after 2 * reclaim_age https://review.openstack.org/564540 | 02:24 |
*** wangyx has joined #openstack-swift | 02:35 | |
kota_ | good morning | 02:50 |
*** gkadam has joined #openstack-swift | 02:51 | |
*** gkadam has quit IRC | 02:58 | |
*** gkadam has joined #openstack-swift | 03:01 | |
*** kei_yama has quit IRC | 03:36 | |
*** kei_yama has joined #openstack-swift | 03:37 | |
*** wangyx has quit IRC | 03:38 | |
*** brimestone has joined #openstack-swift | 04:01 | |
*** brimestone has quit IRC | 04:02 | |
*** links has joined #openstack-swift | 05:04 | |
*** armaan has joined #openstack-swift | 05:04 | |
*** links has quit IRC | 05:08 | |
*** wangyx has joined #openstack-swift | 05:09 | |
*** links has joined #openstack-swift | 05:13 | |
*** links has quit IRC | 05:13 | |
*** onovy has quit IRC | 05:32 | |
*** armaan has quit IRC | 05:42 | |
*** germs has quit IRC | 05:46 | |
*** germs has joined #openstack-swift | 05:47 | |
*** germs has quit IRC | 05:47 | |
*** germs has joined #openstack-swift | 05:47 | |
*** armaan has joined #openstack-swift | 05:58 | |
*** armaan has quit IRC | 05:58 | |
*** armaan has joined #openstack-swift | 05:59 | |
*** armaan has quit IRC | 06:04 | |
*** armaan has joined #openstack-swift | 06:04 | |
*** onovy has joined #openstack-swift | 06:14 | |
*** armaan has quit IRC | 06:21 | |
*** armaan has joined #openstack-swift | 06:21 | |
*** cbartz has joined #openstack-swift | 06:25 | |
*** pcaruana has joined #openstack-swift | 06:33 | |
*** geaaru has joined #openstack-swift | 06:35 | |
*** pcaruana has quit IRC | 06:50 | |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift master: Import swift3 into swift repo as s3api middleware https://review.openstack.org/562943 | 06:54 |
*** pcaruana has joined #openstack-swift | 07:06 | |
*** ccamacho has quit IRC | 07:17 | |
*** rcernin has quit IRC | 07:17 | |
*** ccamacho has joined #openstack-swift | 07:18 | |
*** tesseract has joined #openstack-swift | 07:27 | |
*** armaan has quit IRC | 07:35 | |
*** armaan has joined #openstack-swift | 07:35 | |
*** gkadam has quit IRC | 07:43 | |
*** armaan has quit IRC | 07:52 | |
*** armaan has joined #openstack-swift | 07:53 | |
*** tesseract has quit IRC | 07:53 | |
openstackgerrit | Hajime Kondo proposed openstack/slogging master: Add X-Timestamp header to upload file to swift https://review.openstack.org/564694 | 07:56 |
*** tesseract has joined #openstack-swift | 07:56 | |
*** gkadam has joined #openstack-swift | 08:07 | |
acoles | good morning | 08:12 |
acoles | timburke: I was thinking same overnight about not repeating merges when re-cleaving, going to work on a patch today | 08:24 |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift master: WIP: Add ceph-s3 test non-voting job https://review.openstack.org/564700 | 08:29 |
*** pcaruana has quit IRC | 08:56 | |
openstackgerrit | Hajime Kondo proposed openstack/slogging master: First commit of devstack directory https://review.openstack.org/564708 | 09:05 |
*** pcaruana has joined #openstack-swift | 09:07 | |
*** viks has quit IRC | 09:11 | |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Improve test coverage for metadata reclaim https://review.openstack.org/564710 | 09:20 |
*** kei_yama has quit IRC | 09:28 | |
openstackgerrit | Merged openstack/slogging master: Add X-Timestamp header to upload file to swift https://review.openstack.org/564694 | 09:33 |
openstackgerrit | Merged openstack/swift feature/deep: Parameterize SQL args https://review.openstack.org/564651 | 09:50 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Always update shard brokers with their own range and sharding metadata https://review.openstack.org/564716 | 10:01 |
openstackgerrit | Merged openstack/swift feature/deep: Stop internal client txn_id bleeding into sharder logs https://review.openstack.org/564488 | 10:03 |
*** l4yerffej has quit IRC | 10:15 | |
*** l4yerffej has joined #openstack-swift | 10:17 | |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Always update shard brokers with their own range and sharding metadata https://review.openstack.org/564716 | 10:25 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Store root/parent container in shard ranges table https://review.openstack.org/562603 | 10:25 |
*** itlinux has joined #openstack-swift | 11:45 | |
*** wangyx has quit IRC | 11:59 | |
*** wangyx has joined #openstack-swift | 12:00 | |
*** wangyx has quit IRC | 12:04 | |
*** NM has joined #openstack-swift | 12:15 | |
*** wangyx has joined #openstack-swift | 12:15 | |
*** wangyx has quit IRC | 12:19 | |
*** psachin has quit IRC | 12:41 | |
*** wangyx has joined #openstack-swift | 13:02 | |
*** wangyx has quit IRC | 13:06 | |
*** geaaru has quit IRC | 13:29 | |
*** vint_bra has joined #openstack-swift | 13:50 | |
*** silor has joined #openstack-swift | 14:01 | |
*** itlinux has quit IRC | 14:19 | |
*** ukaynar has joined #openstack-swift | 14:27 | |
*** vint_bra has quit IRC | 14:38 | |
*** itlinux has joined #openstack-swift | 14:43 | |
*** itlinux has quit IRC | 14:53 | |
*** itlinux has joined #openstack-swift | 14:56 | |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Don't repeat merges when re-cleaving to existing shard db https://review.openstack.org/564792 | 14:56 |
acoles | timburke: clayg mattoliverau ^^ | 14:56 |
*** cbartz has quit IRC | 14:57 | |
notmyname | good morning | 15:09 |
*** pcaruana has quit IRC | 15:11 | |
tdasilva | notmyname: o/ | 15:11 |
notmyname | tdasilva: how does tuesday work for you to host a video chat about feature/deep-review? | 15:13 |
notmyname | cschwede: today were you able to do the other testing/review you wanted to do on s3api? | 15:13 |
cschwede | notmyname: still doing it, but will finish within next ~hour :) so far i'm mostly fine with the patch, no blockers | 15:14 |
notmyname | cschwede: thanks :-) | 15:14 |
tdasilva | i was just spinning up my s3api vm too, running tests atm... | 15:14 |
cschwede | no problem, you're welcome :) | 15:14 |
tdasilva | notmyname: what time did you have in mind for the video chat? | 15:15 |
tdasilva | i was wondering if it would make sense to do it at the same time as the community meeting as that would increase the likelihood that others could join, but i'm not sure it is necessary and it would be really late for acoles | 15:16 |
tdasilva | who i imagine would be driving most of the meeting | 15:16 |
*** NM has quit IRC | 15:16 | |
notmyname | I was thinking 9am pacific, noon eastern, 1600utc | 15:17 |
*** silor has quit IRC | 15:18 | |
notmyname | that's not a bad thought (doing it during the meeting) | 15:18 |
notmyname | but yeah, it would be really late for acoles | 15:18 |
notmyname | and I'm afraid people aren't going to start reviewing it until after the meeting. so I don't want to let half the week go by before then | 15:18 |
*** NM has joined #openstack-swift | 15:19 | |
tdasilva | notmyname: yeah, I was thinking same time but Tuesday... | 15:23 |
notmyname | ah, I see | 15:23 |
tdasilva | eitherway Tuesday at noon works for me too, so whatever you prefer... | 15:24 |
*** NM has quit IRC | 15:27 | |
notmyname | https://doodle.com/poll/w5uar77ehiig3mcn | 15:28 |
notmyname | https://doodle.com/poll/w5uar77ehiig3mcn#calendar is easier to read | 15:28 |
notmyname | bah. hang on | 15:29 |
notmyname | I missed a time slot | 15:29 |
tdasilva | notmyname: just fyi...11am EST would *not* work for me :/ | 15:30 |
notmyname | oh, nice. I could update it | 15:30 |
notmyname | fill out the poll :-) | 15:30 |
notmyname | acoles: clayg: torgomatic: cschwede: zaitcev_: kota_: mattoliverau: timburke: please fill out https://doodle.com/poll/w5uar77ehiig3mcn#calendar to help plan when we should have a feature/deep-review overview video chat | 15:33 |
notmyname | we'll choose the best possible time, but tdasilva will record it so anyone who can't make it will be able to watch | 15:33 |
zaitcev_ | notmyname, oh boy | 15:33 |
tdasilva | rledisez: ^ | 15:34 |
zaitcev_ | I have teeth cleaning on Monday... | 15:35 |
notmyname | yes! rledisez too. thanks tdasilva | 15:35 |
rledisez | i'm on vacation for two weeks starting in 25 minutes, i'll be travelling, so i'll miss it | 15:36 |
*** gyee has joined #openstack-swift | 15:36 | |
notmyname | rledisez: ok (I hope you have a relaxing vacation) | 15:37 |
tdasilva | rledisez: enjoy! | 15:42 |
*** wangyx has joined #openstack-swift | 15:46 | |
acoles | notmyname: I just ticked all the boxes on the doodle form. I ticked the late ones not because I prefer late but because I'd prefer kota_ and mattoliverau to be able to make it, so I they cannot make it I'd prefer to avoid the last slot each day at least (2100 UTC). An alternative would be for me to meet up with them separately. | 16:05 |
notmyname | ok | 16:05 |
*** itlinux has quit IRC | 16:15 | |
openstackgerrit | Merged openstack/swift feature/deep: Always update shard brokers with their own range and sharding metadata https://review.openstack.org/564716 | 16:17 |
*** silor has joined #openstack-swift | 16:23 | |
*** wangyx has quit IRC | 16:27 | |
*** geaaru has joined #openstack-swift | 16:31 | |
*** ccamacho has quit IRC | 16:35 | |
notmyname | tdasilva: have you ever run `bindep` from ansible? it exits with an rc of 1 if there's stuff to install, but ansible treats that as a failed task | 16:51 |
notmyname | and whenI set ignore_errors: true, then it's ignoring the results and not putting the output into the registered variable | 16:52 |
tdasilva | notmyname: one sec, pretty sure i did | 16:52 |
tdasilva | notmyname: actually....i did not, in my ansible scripts i just 'manually' install whatever is listed in the bindep.txt files, but infra team appears to have a bindep role somewhere: https://github.com/openstack/pyeclib/blob/master/playbooks/legacy/libec-pyeclib-unit-centos-7/run.yaml#L4 | 16:57 |
notmyname | ok, thanks for checking | 16:59 |
tdasilva | notmyname: if i'm reading this right, you don't have to run bindep from command line, but ansible itself has support for bindep: https://github.com/openstack/ansible-role-bindep | 17:02 |
timburke | most recent commit is "Update bindep.txt to make jobs pass again" -- is it an ouroboros? :P | 17:03 |
notmyname | I found "failed_when: ( bindep_output.rc not in [ 0, 1 ] )" | 17:04 |
notmyname | so that sortof helps | 17:04 |
notmyname | but it didn't fix the problem I was having (but it's probably needed anyway) | 17:05 |
notmyname | oh. nice. https://ansible-role-bindep.readthedocs.io | 17:05 |
*** NM has joined #openstack-swift | 17:06 | |
notmyname | this is what I am getting https://gist.github.com/notmyname/b5f9826c91dde0e199006b62c720b3a3 | 17:06 |
notmyname | I thought the undefined attribute was the bindep_output because it was "failing" with an rc == 1 and I had ignore_errors: true. | 17:06 |
notmyname | however, now I've got the allowed response codes of 0,1 and so it's not being ignored, but I don't know what the undefined attribute is | 17:07 |
*** gkadam has quit IRC | 17:08 | |
*** tesseract has quit IRC | 17:09 | |
*** itlinux has joined #openstack-swift | 17:10 | |
tdasilva | notmyname: so you are just reading bindep.txt and then installing with apt ? | 17:11 |
notmyname | "just reading" is really "running bindep with the appropriate platform and tags" but yes | 17:12 |
notmyname | I've got another ansible task that does the same thing for rpm | 17:12 |
notmyname | put another way, I'm trying to ansible-ify this: `bindep platform:centos -b | xargs yum -y install` | 17:13 |
notmyname | or `bindep platform:dpkg -b | xargs apt-get install -y` | 17:13 |
notmyname | this is what I've got so far: https://gist.github.com/notmyname/59afa6c1dbcc988070e7e64715a35739 | 17:15 |
notmyname | but I don't know what the undefined attribute in "install requirements from bindep (debian)" is | 17:16 |
openstackgerrit | Samuel Merritt proposed openstack/swift master: Refactor replicators' statistics https://review.openstack.org/564646 | 17:19 |
*** germs has quit IRC | 17:22 | |
*** germs has joined #openstack-swift | 17:23 | |
*** germs has quit IRC | 17:23 | |
*** germs has joined #openstack-swift | 17:23 | |
*** ukaynar has quit IRC | 17:29 | |
notmyname | oh wow | 17:38 |
notmyname | I figured it out | 17:38 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Don't repeat merges when re-cleaving to existing shard db https://review.openstack.org/564792 | 17:38 |
acoles | timburke: good spot on ^^ fixed | 17:39 |
*** ukaynar has joined #openstack-swift | 17:40 | |
notmyname | ansible fills in the "register" value every time, even if the task is skipped. so if you have 2 tasks, one for each OS, and they both register the same value because you're using it later, that won't work | 17:40 |
notmyname | the second task that registers the value overwrites the first (even though the second task is skipped). which means you need to register unique variable names for each os (or whatever conditional you're doing) | 17:41 |
acoles | timburke: clayg mattoliverau assuming s3api merges I'll be starting to get feature/deep ready for review on Monday so we need decisions on remaining patches https://tinyurl.com/yc2cbwsm | 17:43 |
clayg | acoles: thanks! | 17:44 |
acoles | IMHO these should land in some shape or form: p 563076, p 563939 | 17:44 |
patchbot | https://review.openstack.org/#/c/563076/ - swift (feature/deep) - Fix unicode errors with non-ascii object names | 17:44 |
patchbot | https://review.openstack.org/#/c/563939/ - swift (feature/deep) - Move objects in all storage policies to shards | 17:44 |
acoles | these we could continue to debate during review: p 564181 p 564184 | 17:45 |
patchbot | https://review.openstack.org/#/c/564181/ - swift (feature/deep) - Remove sharding_lock() | 17:45 |
patchbot | https://review.openstack.org/#/c/564184/ - swift (feature/deep) - Remove TODO re taking lock before deleting retirin... | 17:45 |
acoles | this is my wildcard : p 562603 | 17:46 |
patchbot | https://review.openstack.org/#/c/562603/ - swift (feature/deep) - Store root/parent container in shard ranges table | 17:46 |
*** armaan has quit IRC | 17:46 | |
acoles | and timburke has a few pending too | 17:46 |
acoles | have a good weekend everyone! | 17:47 |
notmyname | you too acoles | 17:48 |
*** armaan has joined #openstack-swift | 17:55 | |
*** NM has quit IRC | 18:04 | |
*** NM has joined #openstack-swift | 18:07 | |
*** NM has quit IRC | 18:14 | |
*** NM has joined #openstack-swift | 18:15 | |
*** silor has quit IRC | 18:23 | |
*** wangyx has joined #openstack-swift | 18:28 | |
*** wangyx has quit IRC | 18:32 | |
*** itlinux has quit IRC | 18:32 | |
*** armaan has quit IRC | 18:35 | |
openstackgerrit | Merged openstack/swift feature/deep: Improve test coverage for metadata reclaim https://review.openstack.org/564710 | 18:49 |
*** ukaynar has quit IRC | 18:54 | |
*** spsurya has quit IRC | 19:01 | |
*** NM has quit IRC | 19:17 | |
*** NM has joined #openstack-swift | 19:27 | |
*** ukaynar has joined #openstack-swift | 19:45 | |
*** NM has quit IRC | 19:59 | |
*** NM has joined #openstack-swift | 20:01 | |
openstackgerrit | Samuel Merritt proposed openstack/swift master: Emit periodic stats from account and container replicators https://review.openstack.org/564875 | 20:17 |
*** zaitcev_ is now known as zaitcev | 20:18 | |
*** NM has quit IRC | 20:33 | |
*** NM has joined #openstack-swift | 20:35 | |
*** NM has quit IRC | 20:37 | |
tdasilva | notmyname: I've added a second +2 on s3api patch, but haven't put the +A in case mattoliverau, zaitcev or timburke wanted to take an additional look, wdyt? | 20:38 |
*** NM has joined #openstack-swift | 20:38 | |
zaitcev | tdasilva: I'm going to have a follow-up, I think. It does not change anything. | 20:39 |
tdasilva | zaitcev: yeah, i think the patch does warrant a number of different follow-ups and even kota_ has said so, but overall I think we can merge as is and then work on the minor stuff after...just my 2 cents | 20:41 |
tdasilva | need to step away for a bit, be right back | 20:45 |
*** itlinux has joined #openstack-swift | 20:50 | |
zaitcev | exploding test requirements are holding me back | 20:53 |
zaitcev | ImportError: No module named requests_mock.contrib | 20:54 |
zaitcev | ImportError: No module named keystonemiddleware.auth_token | 20:54 |
timburke | `pip install -r test-requirements.txt` ? they should be listed... note that bindep.txt also got updated | 21:06 |
zaitcev | Yeah | 21:15 |
zaitcev | I verified that test-requirements.txt is correct. But I'm not going to pollute my laptop with pip. | 21:16 |
*** armaan has joined #openstack-swift | 21:31 | |
*** brimestone has joined #openstack-swift | 21:43 | |
*** NM has quit IRC | 22:03 | |
*** NM has joined #openstack-swift | 22:04 | |
*** itlinux has quit IRC | 22:05 | |
*** itlinux has joined #openstack-swift | 22:10 | |
*** NM has quit IRC | 22:11 | |
*** brimestone has quit IRC | 22:12 | |
*** NM has joined #openstack-swift | 22:14 | |
*** NM has quit IRC | 22:19 | |
notmyname | tdasilva: awesome. thanks | 22:20 |
notmyname | zaitcev: thanks | 22:20 |
zaitcev | notmyname: I've done nothing yet... Just about now logging into a victim VM where I can run pip :-) | 22:20 |
notmyname | :-) | 22:21 |
openstackgerrit | Merged openstack/swift feature/deep: Don't repeat merges when re-cleaving to existing shard db https://review.openstack.org/564792 | 22:31 |
openstackgerrit | Tim Burke proposed openstack/swift feature/deep: Move objects in all storage policies to shards https://review.openstack.org/563939 | 22:53 |
*** itlinux has quit IRC | 23:01 | |
zaitcev | Gah. I need to run to the dojo for tonight. I'll finish tomorrow. | 23:07 |
*** ukaynar has quit IRC | 23:18 | |
*** ukaynar has joined #openstack-swift | 23:19 | |
*** ukaynar has quit IRC | 23:23 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!