| notmyname | did you get that step done? | 00:05 |
|---|---|---|
| JimCheung | yes, it's done | 00:05 |
| notmyname | ok, now to tie it all together | 00:08 |
| notmyname | but first, a footnote | 00:08 |
| notmyname | JimCheung: garyj: do you expect to be contributing to swift itself, or do you expect to keep changes limited to the EC libraries? | 00:08 |
| JimCheung | We would like to contribute to the EC libraries in the near future | 00:09 |
| notmyname | yeah, that's what I'd expect | 00:10 |
| notmyname | so with "official" openstack projects, like swift but not liberasurecode, there's a CLA that must be signed before you can submit a patch | 00:10 |
| JimCheung | Also, we would like to contribute the swift itself as well | 00:10 |
| notmyname | in order to sign the CLA you also have to have an openstack account (again with the same email) | 00:11 |
| JimCheung | Okay, we can wait on that for now | 00:11 |
| notmyname | and then you sign that in gerrit (gerrit == review.openstack.org) | 00:11 |
| JimCheung | Got it | 00:13 |
| garyj | we can get familiarized with the process at the liberasurecode level before moving to the broader swift codebase | 00:13 |
| notmyname | of course | 00:14 |
| notmyname | (sorry, having about 3 conversations at once here) ;-) | 00:14 |
| notmyname | ok, so now we can get the code and tie it all together | 00:14 |
| notmyname | at this point, I know you've already got liberasurecode (hereafter "libec" because that's shorter to type) cloned locally | 00:14 |
| notmyname | so in that libec directory, you need to run `git review -s`. this will set up a remote called "gerrit" and install a commit hook | 00:16 |
| notmyname | the commit hook will add a gerrit change-id to the end of commit messages. all patches proposed have to have it | 00:16 |
| notmyname | and if you have local patches that don't have it, then a `git commit --amend` will add it | 00:16 |
| notmyname | ok, so after `git review -s`, run `git fetch --all` to get the gerrit remote and you're pretty much done with the setup | 00:17 |
| JimCheung | Got it | 00:17 |
| notmyname | ok, so let's do a small test patch to show you how it works. make a change locally, commit it localy, then run `git review` | 00:19 |
| notmyname | like just change a text file or something | 00:19 |
| notmyname | it should put an alert in here and make it available for us all to see in gerrit | 00:19 |
| notmyname | let me know if you see something you don't expect | 00:21 |
| JimCheung | Apparently, got a bit of a problem with git, review is not a git command. Seems the pip install didn't work properly | 00:24 |
| notmyname | hmm | 00:24 |
| notmyname | is `git-review` on your path? | 00:24 |
| JimCheung | No | 00:25 |
| JimCheung | git: 'review' is not a git command. See 'git --help'. | 00:25 |
| zaitcev | It is a separate package in most distributions. | 00:26 |
| JimCheung | okay | 00:26 |
| notmyname | FWIW on my mac it got put in /usr/local/bin/git-review | 00:33 |
| notmyname | (I use my mac for testing and git fu and a linux box for running/testing the code) | 00:34 |
| notmyname | JimCheung: garyj: any luck? | 00:41 |
| notmyname | FWIW, it's https://pypi.python.org/pypi/git-review that you're wanting to have | 00:42 |
| JimCheung | seems there's some issue with my python install. Reinstalling it now | 00:42 |
| notmyname | oh my | 00:43 |
| *** asettle has joined #openstack-swift | 00:50 | |
| *** asettle has quit IRC | 00:55 | |
| notmyname | JimCheung: garyj: ok, just for a summary of what happens after you submit some code, tests get automatically run against it, people look at it and make comments, often you end up submitting a different version, and then someone clicks the "approve" button and more tests are run and it gets committed upstream | 01:01 |
| *** diogogmt has joined #openstack-swift | 01:01 | |
| garyj | got it | 01:01 |
| notmyname | so here's the one big difference that I've seen in openstack and openstack-related projects that is different from most non-openstack projects: each change is one and only one commit | 01:01 |
| notmyname | this means that you squash your work into one change locally before submitting it for review | 01:02 |
| notmyname | if you don't--if you push up some local feature branch--every commit in that branch will be a separate code review | 01:02 |
| notmyname | that's almost never what you mean to do | 01:02 |
| JimCheung | Okay, that's good to know | 01:03 |
| notmyname | (there are times that's used, but it's one of those circumstances where if you know to do it, you also know enough to know when to do it) | 01:03 |
| notmyname | so that gets around to the "what do I do once a reviewer asks for changes?" step. but I don't want to get too far ahead of where you are | 01:07 |
| notmyname | but also, since it's the end of the day for me, I'll write it down so you can read over it. but feel free to ask questions of anyone in here | 01:08 |
| notmyname | when i'm working on a patch, I keep it locally in a (single-commit) local branch. that way i can easily check it out and work on it some more | 01:09 |
| notmyname | gerrit will rebase changes on top of each other, depending on when they land, so merge commits aren't unusual (they aren't common, but they aren't rare either) | 01:09 |
| *** tqtran has quit IRC | 01:10 | |
| notmyname | so i check out the old patch, sometimes `git rebase master` if needed, and make the changes. then I `git commit --amend` the existing commit (the very important part is to keep the same change-id in the commit message) | 01:10 |
| notmyname | then it's another `git review` to push it up for review and the cycle repeats | 01:11 |
| JimCheung | Seems I need a .gitreview file | 01:12 |
| *** _JZ_ has quit IRC | 01:12 | |
| notmyname | I think `git review -s` sets that up | 01:12 |
| notmyname | or actually, that shoudl be in the repo, i think | 01:13 |
| notmyname | yeah, there's one in libec already | 01:13 |
| kota_ | good morning notmyname | 01:14 |
| notmyname | hello kota_! | 01:14 |
| kota_ | sorry i wasn't | 01:14 |
| kota_ | notmyname: and i have to leave soon to update my passport, will see irc logs or i could be available tommorow morning at irc | 01:14 |
| notmyname | no worries | 01:14 |
| kota_ | notmyname: either is fine but anyway, it's great to know new backend may be available in the future in liberasurecode/pyeclib | 01:15 |
| notmyname | kota_: I wanted to introduce you to JimCheung and garyj. They've been working locally on some additions to libec to add support for their proprietary EC algo | 01:15 |
| garyj | good morning kota_ | 01:15 |
| kota_ | notmyname: sure | 01:15 |
| notmyname | from what they've said, it reminds be a little of the one you have from NTT | 01:15 |
| kota_ | garyj: hello! | 01:16 |
| JimCheung | Hi Kota! | 01:16 |
| notmyname | but they say there's is faster than anyone else's ever and the best thing ever created | 01:16 |
| notmyname | ;-) | 01:16 |
| garyj | :) | 01:16 |
| kota_ | JimCheung: Hi! | 01:16 |
| notmyname | *their's | 01:16 |
| JimCheung | Haha! | 01:16 |
| garyj | sliced bread | 01:16 |
| notmyname | garyj: which, interestingly enough was only invented in the early 1920s | 01:16 |
| kota_ | sounds great | 01:17 |
| notmyname | kota_: they're interested in contributing upstream, so they stopped by today to get started (and I wanted to intro them to you). IIRC, they're in the same time zone as me | 01:17 |
| kota_ | ok, I will take a time in my morning to collaborate them. | 01:18 |
| kota_ | notmyname: ^^ | 01:18 |
| JimCheung | Thanks Kota! | 01:18 |
| garyj | that's great. thank you | 01:18 |
| kota_ | garyj, JimCheung: please let me know anything you need to help | 01:18 |
| JimCheung | Thanks! I'm sure we can use the help! | 01:19 |
| kota_ | garyj, JimCheung: looking at irc log, you've already get the first way to push something to upstream. | 01:19 |
| * kota_ is thinking the next step to me is waiting their patches? | 01:20 | |
| JimCheung | Still trying. Have some issues with git review. | 01:20 |
| notmyname | kota_: yep. totally. nothing specific to do right now, other than all of us to help some new contributors get involved ;-) | 01:20 |
| kota_ | k, probably notmyname can help you on gerrit usage better than me :P | 01:21 |
| JimCheung | Here’s the error I got - No '.gitreview' file found in this repository. We don't know where your gerrit is. Please manually create a remote named "gerrit" and try again. | 01:22 |
| notmyname | JimCheung: you're runnign this from inside the libec directory? | 01:22 |
| JimCheung | Yes. My local copy | 01:22 |
| JimCheung | I'll do another pull and try again | 01:23 |
| notmyname | JimCheung: where are you pulling from? | 01:23 |
| * kota_ is leaving for now to go somewhere for my business and will look at logs again | 01:23 | |
| notmyname | kota_: thanks for popping in | 01:23 |
| kota_ | notmyname: sure | 01:24 |
| notmyname | JimCheung: https://github.com/openstack/liberasurecode is the github mirror | 01:24 |
| garyj | kota_: c u later. | 01:24 |
| JimCheung | Bye Kota | 01:25 |
| notmyname | JimCheung: if you clone from the github mirror, it should Just Work (tm) | 01:29 |
| notmyname | JimCheung: garyj: i'm starting to get the pings from home, so I need to take off. I'll likely be online later tonight, and of course I'll be here tomorrow. (others in different timezones have different schedules--perks of a global community) | 01:34 |
| JimCheung | Thanks for your help! | 01:35 |
| notmyname | JimCheung: garyj: i'm glad you stopped by, and i'm looking forward to seeing your integration with libec | 01:35 |
| garyj | notmyname: thank you. we will work though the gerrit issues | 01:35 |
| *** vint_bra has joined #openstack-swift | 01:37 | |
| *** asettle has joined #openstack-swift | 01:52 | |
| *** asettle has quit IRC | 01:56 | |
| openstackgerrit | Merged openstack/swift: tempurls with a prefix-based scope https://review.openstack.org/274048 | 01:58 |
| *** klrmn has quit IRC | 02:13 | |
| *** garyj has quit IRC | 02:14 | |
| *** bkopilov has quit IRC | 02:30 | |
| *** JimCheung has left #openstack-swift | 02:37 | |
| *** vint_bra has quit IRC | 02:39 | |
| *** chlong has quit IRC | 02:45 | |
| *** dmorita has quit IRC | 02:48 | |
| *** asettle has joined #openstack-swift | 02:52 | |
| *** dmorita has joined #openstack-swift | 02:57 | |
| *** asettle has quit IRC | 02:57 | |
| *** chlong has joined #openstack-swift | 02:59 | |
| *** dmorita has quit IRC | 03:01 | |
| *** Worry has joined #openstack-swift | 03:26 | |
| *** raginbajin has quit IRC | 03:27 | |
| *** raginbajin has joined #openstack-swift | 03:32 | |
| *** chsc has joined #openstack-swift | 03:33 | |
| *** chsc has joined #openstack-swift | 03:33 | |
| *** klrmn has joined #openstack-swift | 03:37 | |
| *** garyj has joined #openstack-swift | 03:38 | |
| *** Worry has quit IRC | 03:39 | |
| *** garyj has quit IRC | 03:40 | |
| *** Worry has joined #openstack-swift | 03:40 | |
| *** Worry has quit IRC | 03:50 | |
| *** bkopilov has joined #openstack-swift | 03:50 | |
| *** asettle has joined #openstack-swift | 03:53 | |
| *** asettle has quit IRC | 03:58 | |
| *** Jeffrey4l has quit IRC | 03:58 | |
| *** diogogmt has quit IRC | 04:00 | |
| *** winggundamth has quit IRC | 04:02 | |
| *** Jeffrey4l has joined #openstack-swift | 04:03 | |
| *** winggundamth has joined #openstack-swift | 04:06 | |
| *** psachin has joined #openstack-swift | 04:06 | |
| *** klrmn1 has joined #openstack-swift | 04:08 | |
| *** klrmn has quit IRC | 04:10 | |
| *** links has joined #openstack-swift | 04:22 | |
| *** abhitechie has joined #openstack-swift | 04:25 | |
| *** garyj has joined #openstack-swift | 04:27 | |
| *** garyj has left #openstack-swift | 04:28 | |
| *** dfflanders has quit IRC | 04:48 | |
| *** asettle has joined #openstack-swift | 04:54 | |
| *** asettle has quit IRC | 04:59 | |
| *** abhinavtechie has joined #openstack-swift | 05:05 | |
| hugokuo | Dec 11 03:06:16 mspol13 container-server: 10.175.107.70 - - [11/Dec/2016:11:06:16 +0000] "DELETE /d349/639/.expiring_objects/1481414367" 409 - "DELETE http://localhost/v1/.expiring_objects/1481414367" "tx8485dd8b6da44ddc823cd-00584d3328" "proxy-server 20658" 0.0014 "-" 32573 - | 05:05 |
| *** chsc has quit IRC | 05:05 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 05:05 | |
| *** sanchitmalhotra has quit IRC | 05:05 | |
| *** sanchitmalhotra1 is now known as sanchitmalhotra | 05:05 | |
| *** aagrawal has joined #openstack-swift | 05:06 | |
| hugokuo | What would be the possibility that expirer got 409 ? | 05:06 |
| hugokuo | It's Swift 2.7.0.1 . | 05:06 |
| *** tqtran has joined #openstack-swift | 05:07 | |
| *** abhitechie has quit IRC | 05:08 | |
| *** abhitechie has joined #openstack-swift | 05:09 | |
| *** abhinavtechie has quit IRC | 05:10 | |
| *** sanchitmalhotra has quit IRC | 05:10 | |
| *** sanchitmalhotra has joined #openstack-swift | 05:11 | |
| *** tqtran has quit IRC | 05:11 | |
| *** aagrawal has quit IRC | 05:11 | |
| zaitcev | I guess when you have 2 expirers... | 05:17 |
| *** abhinavtechie has joined #openstack-swift | 05:18 | |
| *** aagrawal has joined #openstack-swift | 05:20 | |
| *** abhitechie has quit IRC | 05:22 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 05:22 | |
| *** abhinavtechie has quit IRC | 05:23 | |
| *** sanchitmalhotra has quit IRC | 05:23 | |
| *** sanchitmalhotra1 is now known as sanchitmalhotra | 05:23 | |
| openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Fix stats calculation in object-reconstructor https://review.openstack.org/283946 | 05:27 |
| *** ppai has joined #openstack-swift | 05:28 | |
| *** abhinavtechie has joined #openstack-swift | 05:30 | |
| *** garyj has joined #openstack-swift | 05:32 | |
| *** abhitechie has joined #openstack-swift | 05:32 | |
| *** aagrawal has quit IRC | 05:33 | |
| *** abhinavtechie has quit IRC | 05:35 | |
| *** abhinavtechie has joined #openstack-swift | 05:36 | |
| *** hseipp has joined #openstack-swift | 05:36 | |
| *** sanchitmalhotra has quit IRC | 05:38 | |
| *** sanchitmalhotra has joined #openstack-swift | 05:38 | |
| *** abhitechie has quit IRC | 05:39 | |
| *** aagrawal has joined #openstack-swift | 05:46 | |
| *** ppai has quit IRC | 05:48 | |
| *** abhinavtechie has quit IRC | 05:49 | |
| hugokuo | @zaitcev interesting... let me take a look | 05:52 |
| hugokuo | Also, just discovered a behaviour which looks like a bug. https://gist.github.com/HugoKuo/abb04c0237fa961ab1104675c59fd2fb | 05:52 |
| hugokuo | The object-replicator creates hundred connections while the concurrency == 1 | 05:53 |
| hugokuo | Re: object-expirer 409 , there's just one expirer in the system | 05:54 |
| *** asettle has joined #openstack-swift | 05:55 | |
| *** asettle has quit IRC | 06:00 | |
| *** abhinavtechie has joined #openstack-swift | 06:06 | |
| *** tovin07 has quit IRC | 06:06 | |
| *** tovin07__ has joined #openstack-swift | 06:06 | |
| mattoliverau | hugokuo: a 409 is usually raised by the container server if its trying to delete a container with objects still in it. so could be the same thing here, is it happening when trying to delete the container? | 06:07 |
| *** aagrawal has quit IRC | 06:09 | |
| hugokuo | @mattoliverau yup. It expirer attempted to delete an entry of exipiring_object. It's a container entry. v1/.expiring_objects/1481414367 | 06:11 |
| hugokuo | so that means the container can't be delete sine there're still have expired object in the queue waiting for purging | 06:12 |
| mattoliverau | yeah, there must still be objects in the container. | 06:15 |
| *** ppai has joined #openstack-swift | 06:20 | |
| *** abhinavtechie has quit IRC | 06:23 | |
| *** abhinavtechie has joined #openstack-swift | 06:23 | |
| *** hseipp has quit IRC | 06:25 | |
| *** ppai has quit IRC | 06:26 | |
| *** links has quit IRC | 06:34 | |
| *** tovin07__ has quit IRC | 06:34 | |
| *** PavelK has joined #openstack-swift | 06:34 | |
| *** tovin07__ has joined #openstack-swift | 06:35 | |
| *** tovin07__ has quit IRC | 06:35 | |
| *** tovin07__ has joined #openstack-swift | 06:35 | |
| *** links has joined #openstack-swift | 06:38 | |
| *** abhitechie has joined #openstack-swift | 06:40 | |
| *** abhinavtechie has quit IRC | 06:40 | |
| *** tovin07__ is now known as tovin07_afk | 06:42 | |
| *** tovin07_afk has quit IRC | 06:50 | |
| *** asettle has joined #openstack-swift | 06:56 | |
| *** garyj has quit IRC | 06:57 | |
| *** ppai has joined #openstack-swift | 06:58 | |
| *** garyj has joined #openstack-swift | 07:00 | |
| *** garyj has left #openstack-swift | 07:00 | |
| *** asettle has quit IRC | 07:01 | |
| *** dmorita has joined #openstack-swift | 07:02 | |
| *** sams-gleb has joined #openstack-swift | 07:05 | |
| *** dmorita has quit IRC | 07:07 | |
| *** abhitechie has quit IRC | 07:15 | |
| *** Jeffrey4l has quit IRC | 07:24 | |
| *** Jeffrey4l has joined #openstack-swift | 07:25 | |
| *** dmorita has joined #openstack-swift | 07:48 | |
| *** dmorita has quit IRC | 07:53 | |
| *** asettle has joined #openstack-swift | 07:57 | |
| *** asettle has quit IRC | 08:02 | |
| *** zackmdavis has quit IRC | 08:03 | |
| *** zackmdavis has joined #openstack-swift | 08:04 | |
| *** rcernin has joined #openstack-swift | 08:05 | |
| *** oshritf has joined #openstack-swift | 08:06 | |
| *** pcaruana has joined #openstack-swift | 08:10 | |
| *** tqtran has joined #openstack-swift | 08:10 | |
| *** tqtran has quit IRC | 08:14 | |
| *** rcernin has quit IRC | 08:22 | |
| *** rcernin has joined #openstack-swift | 08:25 | |
| *** rledisez has joined #openstack-swift | 08:28 | |
| *** JimCheung has joined #openstack-swift | 08:36 | |
| *** geaaru has joined #openstack-swift | 08:37 | |
| *** garyj has joined #openstack-swift | 08:38 | |
| *** JimCheung has quit IRC | 08:41 | |
| *** garyj has quit IRC | 08:43 | |
| *** kelepirci has joined #openstack-swift | 08:46 | |
| kelepirci | hello all | 08:47 |
| kelepirci | just quick question. | 08:47 |
| kelepirci | is it safe to delete quarantined objects? | 08:47 |
| kelepirci | it is taking too much space | 08:47 |
| *** wanghua has joined #openstack-swift | 08:49 | |
| *** cbartz has joined #openstack-swift | 09:00 | |
| *** jordanP has joined #openstack-swift | 09:00 | |
| *** joeljwright has joined #openstack-swift | 09:17 | |
| *** ChanServ sets mode: +v joeljwright | 09:17 | |
| *** asettle has joined #openstack-swift | 09:20 | |
| *** asettle has quit IRC | 09:22 | |
| *** asettle has joined #openstack-swift | 09:22 | |
| *** mvk has quit IRC | 09:23 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 09:39 | |
| *** sanchitmalhotra has quit IRC | 09:39 | |
| *** sanchitmalhotra1 is now known as sanchitmalhotra | 09:39 | |
| *** sanchitmalhotra has quit IRC | 09:44 | |
| *** sanchitmalhotra has joined #openstack-swift | 09:45 | |
| *** sanchitmalhotra has quit IRC | 09:52 | |
| *** sanchitmalhotra has joined #openstack-swift | 09:52 | |
| *** mvk has joined #openstack-swift | 09:54 | |
| *** kelepirci has quit IRC | 09:57 | |
| *** links has quit IRC | 10:16 | |
| *** acoles_ is now known as acoles | 10:24 | |
| *** sanchitmalhotra has quit IRC | 10:27 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 10:27 | |
| *** bkopilov has quit IRC | 10:28 | |
| openstackgerrit | Gábor Antal proposed openstack/swift: Use more specific asserts in test/unit/obj tests https://review.openstack.org/342830 | 10:28 |
| *** sanchitmalhotra1 is now known as sanchitmalhotra | 10:29 | |
| *** links has joined #openstack-swift | 10:29 | |
| *** asettle has quit IRC | 10:30 | |
| *** asettle has joined #openstack-swift | 10:36 | |
| *** asettle has quit IRC | 10:37 | |
| *** asettle has joined #openstack-swift | 10:37 | |
| *** sams-gleb has quit IRC | 10:37 | |
| *** sams-gleb has joined #openstack-swift | 10:38 | |
| *** garyj has joined #openstack-swift | 10:40 | |
| openstackgerrit | Gábor Antal proposed openstack/swift: Use more specific asserts in test/unit/common https://review.openstack.org/342781 | 10:42 |
| *** sams-gleb has quit IRC | 10:42 | |
| *** garyj has quit IRC | 10:44 | |
| *** sams-gleb has joined #openstack-swift | 10:56 | |
| *** daemontool has joined #openstack-swift | 11:02 | |
| *** psachin has quit IRC | 11:03 | |
| *** sanchitmalhotra has quit IRC | 11:05 | |
| *** tqtran has joined #openstack-swift | 11:12 | |
| *** sanchitmalhotra has joined #openstack-swift | 11:12 | |
| *** zhugaoxiao has joined #openstack-swift | 11:13 | |
| *** links has quit IRC | 11:15 | |
| *** psachin has joined #openstack-swift | 11:16 | |
| *** tqtran has quit IRC | 11:17 | |
| *** sanchitmalhotra has quit IRC | 11:23 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 11:23 | |
| *** mvk has quit IRC | 11:24 | |
| *** amoralej|off is now known as amoralej | 11:25 | |
| *** sanchitmalhotra1 is now known as sanchitmalhotra | 11:25 | |
| *** links has joined #openstack-swift | 11:32 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 11:32 | |
| *** sanchitmalhotra has quit IRC | 11:34 | |
| *** sanchitmalhotra1 has quit IRC | 11:37 | |
| *** mvk has joined #openstack-swift | 11:37 | |
| *** sanchitmalhotra has joined #openstack-swift | 11:38 | |
| *** zhugaoxiao has quit IRC | 11:56 | |
| *** zhugaoxiao has joined #openstack-swift | 11:56 | |
| openstackgerrit | Gábor Antal proposed openstack/swift: Use more specific asserts in test/unit/common/middleware https://review.openstack.org/342770 | 12:26 |
| *** garyj has joined #openstack-swift | 12:42 | |
| *** bkopilov has joined #openstack-swift | 12:46 | |
| *** garyj has quit IRC | 12:46 | |
| *** mingyu has joined #openstack-swift | 12:50 | |
| *** mingyu has quit IRC | 12:53 | |
| timss | Hi. I'm able to set ACLs using `swift -r|-w project_id:user_id`, and list contents of the container with a token of the ACL user with `swift --os-auth-token TOKEN --os-storage-url http://../v1/AUTH_ID/container list`. But is it possible to do the last part without having to define storage URL and token, i.e. normal environment/--os-* credentials and specify container with something like `swift list`? | 13:00 |
| timss | It seems to only allow container name. | 13:00 |
| *** siva_krish has joined #openstack-swift | 13:01 | |
| *** kei_yama has quit IRC | 13:02 | |
| *** abhitechie has joined #openstack-swift | 13:02 | |
| *** dmorita has joined #openstack-swift | 13:05 | |
| *** vint_bra has joined #openstack-swift | 13:07 | |
| *** dmorita has quit IRC | 13:09 | |
| *** abhitechie has quit IRC | 13:13 | |
| *** tqtran has joined #openstack-swift | 13:14 | |
| *** juzuluag has joined #openstack-swift | 13:16 | |
| *** tqtran has quit IRC | 13:18 | |
| timss | Hm, seems only the storage url is required. Pretty cool, but the user would have to know the account (AUTH_)/storage URL though, not only the project/container. Or? | 13:19 |
| *** asettle has quit IRC | 13:19 | |
| *** asettle has joined #openstack-swift | 13:19 | |
| *** juzuluag has quit IRC | 13:25 | |
| *** PavelK has quit IRC | 13:29 | |
| *** JimCheung has joined #openstack-swift | 13:34 | |
| *** JimCheung has quit IRC | 13:39 | |
| openstackgerrit | Shashirekha Gundur proposed openstack/python-swiftclient: modify 'swift <sub_command> —help' display https://review.openstack.org/390119 | 13:41 |
| *** amoralej is now known as amoralej|lunch | 13:44 | |
| tdasilva | timss: not sure I understand your question, but if you define env. variables: ST_AUTH, ST_USER, ST_KEY then you should be able to run something like `swift list` | 13:45 |
| timss | tdasilva: Sorry, it got a bit clunky in my effort to be concise. I guess the question is if it's possible to do operations such as `swift list` on containers in other projects/accounts based on ACL, without knowing the storage URL or account/AUTH_ of the container in the other project. | 13:50 |
| timss | Lets say user 'foo' do `swift post -r <bar_project_uuid>:* testcontainer`. A user in project 'bar' can then do `OS_STORAGE_URL=http://../v1/AUTH_<foo_project_uuid> swift list testcontainer`. | 13:51 |
| timss | But can a user in 'bar' list contents of 'testcontainer' when (s)he only knows the domain/name of the project and container, and not the storage URL/account id of the owner of the container? | 13:52 |
| timss | Or would a 'bar' user have to ask 'foo' for their account/storage URL (AUTH_) details? | 13:53 |
| *** dmsimard has left #openstack-swift | 13:59 | |
| tdasilva | timss: I *think* you would have to know their account/storage URL. I'm trying to think if you could get that info from keystone, but i'm not sure if it's possible | 14:04 |
| timss | tdasilva: all right, that sounds plausible. I was trying to think of a way myself, but couldn't find any :) | 14:04 |
| timss | It's not too critical, but will require my users to understand how a storage URL works | 14:05 |
| tdasilva | timss: there are more folks in PT timezone that come in later that might be able to give you a better answer | 14:06 |
| timss | tdasilva: All right, thanks! | 14:06 |
| *** dmsimard has joined #openstack-swift | 14:21 | |
| *** dmsimard has left #openstack-swift | 14:24 | |
| *** dmsimard has joined #openstack-swift | 14:28 | |
| *** abhitechie has joined #openstack-swift | 14:28 | |
| *** dmsimard has quit IRC | 14:28 | |
| *** dmsimard has joined #openstack-swift | 14:30 | |
| *** daemontool has quit IRC | 14:33 | |
| *** siva_krish has quit IRC | 14:34 | |
| *** amoralej|lunch is now known as amoralej | 14:36 | |
| *** abhitechie has quit IRC | 14:41 | |
| *** abhitechie has joined #openstack-swift | 14:42 | |
| openstackgerrit | Mahati Chamarthy proposed openstack/swift: Move documented reclaim_age option to correct location https://review.openstack.org/374419 | 14:42 |
| *** garyj has joined #openstack-swift | 14:44 | |
| *** abhinavtechie has joined #openstack-swift | 14:45 | |
| *** abhitechie has quit IRC | 14:47 | |
| *** garyj has quit IRC | 14:48 | |
| *** ppai has quit IRC | 14:48 | |
| *** dmsimard has left #openstack-swift | 14:49 | |
| *** psachin has quit IRC | 14:50 | |
| *** sams-gleb has quit IRC | 14:51 | |
| *** sams-gleb has joined #openstack-swift | 14:51 | |
| *** wanghua has quit IRC | 14:56 | |
| *** sams-gleb has quit IRC | 14:56 | |
| *** abhinavtechie has quit IRC | 15:00 | |
| *** abhitechie has joined #openstack-swift | 15:03 | |
| *** sams-gleb has joined #openstack-swift | 15:09 | |
| *** abhitechie has quit IRC | 15:13 | |
| *** chlong has quit IRC | 15:13 | |
| *** tqtran has joined #openstack-swift | 15:15 | |
| openstackgerrit | Gábor Antal proposed openstack/swift: Use more specific asserts in test/unit/common/middleware https://review.openstack.org/342770 | 15:15 |
| *** abhitechie has joined #openstack-swift | 15:18 | |
| *** tqtran has quit IRC | 15:20 | |
| *** siva_krish has joined #openstack-swift | 15:22 | |
| *** siva_krish has quit IRC | 15:30 | |
| *** links has quit IRC | 15:42 | |
| *** siva_krish has joined #openstack-swift | 15:45 | |
| *** siva_krish has quit IRC | 15:54 | |
| *** rcernin has quit IRC | 16:04 | |
| *** daemontool has joined #openstack-swift | 16:07 | |
| *** pcaruana has quit IRC | 16:09 | |
| *** _JZ_ has joined #openstack-swift | 16:11 | |
| *** chsc has joined #openstack-swift | 16:16 | |
| *** chsc has joined #openstack-swift | 16:16 | |
| *** tqtran has joined #openstack-swift | 16:17 | |
| openstackgerrit | Merged openstack/swift: Py3: Make test_manager py3 compatable https://review.openstack.org/347799 | 16:20 |
| *** tqtran has quit IRC | 16:21 | |
| *** vint_bra has quit IRC | 16:22 | |
| *** siva_krish has joined #openstack-swift | 16:24 | |
| *** chsc has quit IRC | 16:25 | |
| -openstackstatus- NOTICE: Launchpad SSO is not currently working, so logins to our services like review.openstack.org and wiki.openstack.org are failing; the admins at Canonical are looking into the issue but there is no estimated time for a fix yet. | 16:26 | |
| *** ChanServ changes topic to "Launchpad SSO is not currently working, so logins to our services like review.openstack.org and wiki.openstack.org are failing; the admins at Canonical are looking into the issue but there is no estimated time for a fix yet." | 16:26 | |
| *** tsg has joined #openstack-swift | 16:27 | |
| *** oshritf has quit IRC | 16:31 | |
| notmyname | good morning | 16:35 |
| openstackgerrit | Alistair Coles proposed openstack/swift: Add test for configured reclaim_age being used https://review.openstack.org/410311 | 16:39 |
| *** garyj has joined #openstack-swift | 16:45 | |
| *** chlong has joined #openstack-swift | 16:46 | |
| *** asettle__ has joined #openstack-swift | 16:49 | |
| *** garyj has quit IRC | 16:49 | |
| *** asettle has quit IRC | 16:53 | |
| *** garyj has joined #openstack-swift | 16:56 | |
| *** rcernin has joined #openstack-swift | 17:00 | |
| *** Jeffrey4l has quit IRC | 17:00 | |
| *** Jeffrey4l has joined #openstack-swift | 17:00 | |
| *** asettle__ is now known as asettle | 17:01 | |
| *** ChanServ changes topic to "Let's talk, we're nice. | Ideas: https://wiki.openstack.org/wiki/Swift/ideas | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | Meetings: https://wiki.openstack.org/wiki/Meetings/Swift | Priority Reviews: https://wiki.openstack.org/wiki/Swift/PriorityReviews" | 17:03 | |
| -openstackstatus- NOTICE: Canonical admins have resolved the issue with login.launchpad.net, so authentication should be restored now. | 17:03 | |
| *** htruta` is now known as htruta | 17:07 | |
| *** mvk has quit IRC | 17:07 | |
| *** abhitechie has quit IRC | 17:07 | |
| *** abhitechie has joined #openstack-swift | 17:08 | |
| *** asettle has quit IRC | 17:15 | |
| *** garyj has quit IRC | 17:18 | |
| *** garyj has joined #openstack-swift | 17:19 | |
| *** chsc has joined #openstack-swift | 17:21 | |
| *** chsc has joined #openstack-swift | 17:21 | |
| *** diogogmt has joined #openstack-swift | 17:23 | |
| *** rcernin has quit IRC | 17:24 | |
| *** klamath has joined #openstack-swift | 17:27 | |
| *** klamath has joined #openstack-swift | 17:28 | |
| *** dmorita has joined #openstack-swift | 17:28 | |
| *** rcernin has joined #openstack-swift | 17:35 | |
| *** rcernin has quit IRC | 17:35 | |
| *** JimCheung has joined #openstack-swift | 17:40 | |
| *** JimCheung has left #openstack-swift | 17:43 | |
| openstackgerrit | Tim Burke proposed openstack/swift: py3: port common/ring/, common/linkat.py, and common/utils.py https://review.openstack.org/401397 | 17:43 |
| clayg | notmyname: nice write up this morning! | 17:47 |
| notmyname | thanks | 17:47 |
| notmyname | it's the kind of day where someone asks a 2 dozen work question and I respond with a small novella | 17:47 |
| notmyname | ;-) | 17:48 |
| clayg | an epic battle between in which the heroes of availability come to bear against the evil forces of failure and uncertainty! | 17:49 |
| clayg | *bare | 17:50 |
| clayg | maybe? | 17:50 |
| clayg | i guess i had it right the first time | 17:51 |
| *** siva_krish has left #openstack-swift | 17:53 | |
| *** rledisez has quit IRC | 17:53 | |
| *** jordanP has quit IRC | 17:55 | |
| *** mingyu has joined #openstack-swift | 17:58 | |
| *** abhitechie has quit IRC | 18:02 | |
| *** tqtran has joined #openstack-swift | 18:06 | |
| *** geaaru has quit IRC | 18:07 | |
| *** daemontool has quit IRC | 18:08 | |
| *** abhitechie has joined #openstack-swift | 18:13 | |
| *** asettle has joined #openstack-swift | 18:14 | |
| notmyname | 2.12.0 release notes proposed to https://review.openstack.org/#/c/409924/ | 18:16 |
| patchbot | patch 409924 - swift - Swift 2.12.0 authors/changelog updates | 18:16 |
| notmyname | I'll add the yaml file after it goes through review (I know people will find stuff!) | 18:17 |
| *** siva_krish has joined #openstack-swift | 18:20 | |
| acoles | if a middleware __init__ has an error what's the *right thing* that should happen: middleware __init__ raises exception or middleware calls sys.exit? (I'm looking at patch 393388 and seems we are inconsistent in places) | 18:20 |
| patchbot | https://review.openstack.org/#/c/393388/ - swift - Raise ValueError if a config section does not exist | 18:20 |
| *** chsc has quit IRC | 18:20 | |
| acoles | I feel like whatever is loading middleware should catch exceptions and handle then how it sees fit. | 18:21 |
| acoles | them* | 18:21 |
| *** diogogmt has quit IRC | 18:22 | |
| notmyname | acoles: yeah, it does look odd that there's the inconsistency | 18:25 |
| notmyname | acoles: I don't think it really matters, as long as (1) when someone sees the exit/error it's obvious what didn't work and (2) consistency is preferred | 18:26 |
| acoles | I suspect that in keymaster the sys.exit happens simply because that's what readconf did (which is the bug) - so not by design, just side-effect | 18:26 |
| *** mingyu has quit IRC | 18:26 | |
| acoles | yep, consistency is good, except when it comes to under-performance ;) | 18:27 |
| *** joeljwright has quit IRC | 18:32 | |
| notmyname | oh yay! https://review.openstack.org/#/c/274048/ landed! | 18:34 |
| patchbot | patch 274048 - swift - tempurls with a prefix-based scope (MERGED) | 18:34 |
| notmyname | hmm...means that it needs to be referenced in the changelog | 18:35 |
| *** chsc has joined #openstack-swift | 18:35 | |
| *** chsc has joined #openstack-swift | 18:35 | |
| *** cbartz has left #openstack-swift | 18:44 | |
| *** acoles is now known as acoles_ | 18:44 | |
| *** silor1 has joined #openstack-swift | 18:50 | |
| notmyname | FYI http://lists.openstack.org/pipermail/openstack-dev/2016-December/108875.html | 18:56 |
| notmyname | "[openstack-dev] Golang technical requirements" | 18:56 |
| *** abhinavtechie has joined #openstack-swift | 18:59 | |
| *** dmorita has quit IRC | 19:00 | |
| *** dmorita has joined #openstack-swift | 19:01 | |
| *** abhitechie has quit IRC | 19:03 | |
| *** diogogmt has joined #openstack-swift | 19:03 | |
| *** diogogmt has quit IRC | 19:04 | |
| *** diogogmt has joined #openstack-swift | 19:05 | |
| *** douglascorrea has joined #openstack-swift | 19:07 | |
| *** asettle has quit IRC | 19:08 | |
| *** abhinavtechie has quit IRC | 19:13 | |
| *** rcernin has joined #openstack-swift | 19:14 | |
| notmyname | 2.7.1 and 2.10.1 just landee | 19:14 |
| notmyname | *landed | 19:14 |
| tdasilva | i remember seeing a table of releases somewhere... | 19:15 |
| notmyname | yeah, I'll got update it | 19:16 |
| notmyname | if you're referring to https://wiki.openstack.org/wiki/Swift/version_map | 19:16 |
| tdasilva | yes! thanks! | 19:16 |
| notmyname | done | 19:18 |
| notmyname | not sure on the right visualization on that for stable releases, but that should work | 19:19 |
| *** garyj has quit IRC | 19:33 | |
| *** garyj has joined #openstack-swift | 19:34 | |
| *** silor1 has quit IRC | 19:34 | |
| *** oshritf has joined #openstack-swift | 19:38 | |
| *** garyj has quit IRC | 19:38 | |
| *** jordanP has joined #openstack-swift | 20:02 | |
| *** jordanP has quit IRC | 20:04 | |
| *** douglascorrea has quit IRC | 20:05 | |
| *** douglascorrea has joined #openstack-swift | 20:06 | |
| *** dmorita has quit IRC | 20:09 | |
| *** dmorita has joined #openstack-swift | 20:10 | |
| *** douglascorrea has quit IRC | 20:11 | |
| *** dmorita has quit IRC | 20:14 | |
| *** dmorita has joined #openstack-swift | 20:14 | |
| *** abhitechie has joined #openstack-swift | 20:17 | |
| *** amoralej is now known as amoralej|off | 20:17 | |
| tdasilva | notmyname: might need to update changelog again once patch 391090 merges ;) | 20:17 |
| patchbot | https://review.openstack.org/#/c/391090/ - swift - SLO: Make etag and size_bytes fully optional | 20:17 |
| *** abhinavtechie has joined #openstack-swift | 20:31 | |
| *** dfflanders has joined #openstack-swift | 20:31 | |
| *** abhitechie has quit IRC | 20:32 | |
| notmyname | FWIW, there's now an #openstack-meeting-5 | 20:45 |
| *** _david_cole_soho has joined #openstack-swift | 21:01 | |
| *** tsg has quit IRC | 21:08 | |
| _david_cole_soho | I seem to have gotten myself into a pickle with 2.10 and Encryption at Rest. A week ago I upgraded to 2.10 and enable Encryption at Rest. I upgraded the software but on one out of nine backend (ACO) servers I did not restart the processes (doh!) . For about 3 days 8 ouf of 9 were running 2.10 and one was running 2.7. This issue was resolved mid last week. The issue I have now is that I have invalid etags in | 21:10 |
| _david_cole_soho | container listings, I think this impacts < 20% of the new objects that were added in that three day period. If I HEAD the object which has the invalid etag in the container listing, the object etag is correct. After waiting over the weekend for one of the backend auditors to ‘sort it out’, the etags are still incorrect. Does anyone have any thoughts on fixing this issue? | 21:10 |
| clayg | notmyname: because lp bug #1491605 has the effect of making all the reconstructor concurrency run on a single disk and effect performance during a rebalance i bumped it up to "high" - but medium might be more correct | 21:10 |
| openstack | Launchpad bug 1491605 in OpenStack Object Storage (swift) "Reconstructor jobs are ordered by disk instead of randomized" [High,Confirmed] https://launchpad.net/bugs/1491605 | 21:10 |
| notmyname | clayg: ack | 21:11 |
| clayg | _david_cole_soho: it's not immediately obvious to me why the etags are incorrect in this scenario - my naieve initial thought is that a restarted proxy would encrypt while an un-restarted proxy would not - the object itself should be either encrypted or not and all metadata should match - as the encryption is aways done at the proxy, notated on the object and passed unmodified and more-or-less transparently through the storage | 21:13 |
| *** douglascorrea has joined #openstack-swift | 21:14 | |
| timburke | clayg: i think the trouble is that there were encrypting proxies running without the x-backend-container-update-override-etag (or whatever; i forget exactly) header support in the object nodes | 21:15 |
| clayg | timburke: yup - i was slow - but i'm think i'm there - it's the "more-or-less transparently" | 21:15 |
| clayg | if a new proxy was talking to an old object server - screwed | 21:15 |
| timburke | it's the ... yeah, that bit exactly :-) | 21:16 |
| timburke | that's my fear as well :-/ | 21:16 |
| _david_cole_soho | It would have been a new proxy talking to an old object server | 21:16 |
| clayg | it's weird - i feel like *someone* said turning on encryption on a standing cluster was mis-feature - dunno who said that - but I feel like they said it *a lot* | 21:16 |
| mattoliverau | morning | 21:17 |
| jrichli | pretty sure that was you, clayg ;-) | 21:18 |
| clayg | _david_cole_soho: how many accounts/users/containers do you have on the system? | 21:18 |
| timburke | even *detecting* the problem is somewhat problematic... i guess you might be able to have something go through the object servers looking for etag mismatches, then update the x-timestamp to be something like <old ts>_0000000001, and try the container update again? | 21:18 |
| _david_cole_soho | It was my understanding that enabling encryption on an existing cluster would work , but with the caveat that there is no background scrub to encrypt older objects | 21:19 |
| clayg | _david_cole_soho: my current thinking is a onetime audit of the container db layer to remove offesnive rows so that replicator can sort things out might be one path forward | 21:19 |
| clayg | it's rather operationally intensive tho - to my knowledge no one has reported on this experience to date | 21:19 |
| clayg | timburke: I think you could just delete the rows on the container db's as long as you reset the sync poitns | 21:20 |
| clayg | if none of the object-server replicas repoted an encrypted etag it's probably no worse than just being an old object | 21:20 |
| clayg | the trick is only deleting rows where you think you can find a replacement | 21:20 |
| *** asettle has joined #openstack-swift | 21:21 | |
| clayg | ... so the script might have to go one replica at a time? If two are effected it could take multiple sweeps... it's kinda gross | 21:21 |
| clayg | _david_cole_soho: what's the cardinality on container db's | 21:21 |
| clayg | or object count for that matter | 21:21 |
| _david_cole_soho | If maintaining timestamps was not a prority, could I GET and then re-PUT each of the objects to fix the container listings ? | 21:22 |
| timburke | definitely. | 21:23 |
| _david_cole_soho | I don’t think I can script deleting rows from the sqllite container DB, avoiding all the pitfalls that entails, but I can probably scan for bad objects and script a GET/PUT cycle | 21:24 |
| tdasilva | what about a COPY? | 21:25 |
| clayg | same thing as kota's re-put script | 21:25 |
| clayg | https://launchpadlibrarian.net/292772595/reputter.py | 21:27 |
| *** tsg has joined #openstack-swift | 21:30 | |
| *** chlong has quit IRC | 21:30 | |
| _david_cole_soho | thank you. I will take a look | 21:30 |
| *** siva_krish has quit IRC | 21:30 | |
| openstackgerrit | Bryan Keller proposed openstack/swift: Use case-insensitive headers in proxy-server https://review.openstack.org/410407 | 21:34 |
| *** Jeffrey4l has quit IRC | 21:35 | |
| *** douglascorrea has quit IRC | 21:35 | |
| *** douglascorrea has joined #openstack-swift | 21:36 | |
| *** amoralej|off is now known as amoralej | 21:36 | |
| *** asettle has quit IRC | 21:39 | |
| *** douglascorrea has quit IRC | 21:41 | |
| *** oshritf has quit IRC | 21:43 | |
| *** tsg has quit IRC | 21:46 | |
| *** Jeffrey4l has joined #openstack-swift | 21:47 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 21:50 |
| *** sams-gleb has quit IRC | 21:55 | |
| *** sams-gleb has joined #openstack-swift | 21:55 | |
| *** asettle has joined #openstack-swift | 21:58 | |
| *** sams-gleb has quit IRC | 22:00 | |
| *** amoralej is now known as amoralej|off | 22:01 | |
| *** siva_krish has joined #openstack-swift | 22:02 | |
| *** douglascorrea has joined #openstack-swift | 22:05 | |
| *** tsg has joined #openstack-swift | 22:07 | |
| *** asettle has quit IRC | 22:09 | |
| openstackgerrit | John Dickinson proposed openstack/swift: Swift 2.12.0 authors/changelog updates https://review.openstack.org/409924 | 22:12 |
| *** mvk has joined #openstack-swift | 22:32 | |
| *** garyj has joined #openstack-swift | 22:36 | |
| *** garyj has quit IRC | 22:40 | |
| openstackgerrit | John Dickinson proposed openstack/swift: Swift 2.12.0 authors/changelog updates https://review.openstack.org/409924 | 22:40 |
| openstackgerrit | Merged openstack/python-swiftclient: modify 'swift <sub_command> —help' display https://review.openstack.org/390119 | 23:00 |
| *** _JZ_ has quit IRC | 23:00 | |
| openstackgerrit | Merged openstack/swift: SLO: Make etag and size_bytes fully optional https://review.openstack.org/391090 | 23:02 |
| *** chsc has quit IRC | 23:11 | |
| *** siva_krish has quit IRC | 23:21 | |
| *** klamath has quit IRC | 23:29 | |
| *** garyj has joined #openstack-swift | 23:38 | |
| *** garyj has quit IRC | 23:43 | |
| *** JimCheung has joined #openstack-swift | 23:45 | |
| JimCheung | Hello notmyname: It appears the git review issues from yesterday has been resolved. | 23:49 |
| notmyname | JimCheung: yay! | 23:50 |
| JimCheung | Thanks for the help! | 23:50 |
| notmyname | JimCheung: so `git review -s` to set up the repo, and then `git review` to upload a patch for review | 23:50 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/89250 | 23:52 |
| openstackgerrit | John Dickinson proposed openstack/swift: Swift 2.12.0 authors/changelog updates https://review.openstack.org/409924 | 23:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 23:53 |
| notmyname | JimCheung: I just did it myself^ | 23:53 |
| JimCheung | repo is setup. We'll need to package up all the changes in one commit to submit. | 23:53 |
| *** kei_yama has joined #openstack-swift | 23:54 | |
| notmyname | great | 23:56 |
| JimCheung | may take a little while before submitting. Need to do some refactoring. ;-) | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!