| *** pgbridge has quit IRC | 00:00 | |
| *** jerrygb has quit IRC | 00:00 | |
| *** jerrygb has joined #openstack-swift | 00:02 | |
| *** jamielennox|away is now known as jamielennox | 00:05 | |
| notmyname | ho: thanks for the ring patch review and checking on it with your prod clsuters! | 00:09 |
|---|---|---|
| ho | notmyname: you are welcome! | 00:11 |
| dfg | clayg: notmyname - no i like the new change. thats just what i found. the partitions all being frmo the same set was a little weird. but ya- if those are distributed i don't knwo how much it matters | 00:12 |
| dfg | but over all it seems like a big improvement | 00:12 |
| clayg | dfg: phew | 00:12 |
| dfg | and after the initial change it was great. it was kinda scary tht the old code just left those old nodes out of balance. sorry if i sounded negative- it was exhausting looking at that stuff :p | 00:13 |
| notmyname | oh yeah, I'll agree to that ;-) | 00:14 |
| notmyname | dfg: thanks for the affirmation. and yeah. current master is a little scary when you get down to it. | 00:15 |
| notmyname | so the plan as we said last week is to merge the ring patch tomorrow | 00:15 |
| dfg | clayg: you didn't that they pulling out the same partitions over and over again would be bad? the addition i made was relatively small so if i made a bigger cahnge it might have spread out more. | 00:15 |
| notmyname | dfg: do you have more stuff you want to make sure is looked at or done before that happens? | 00:15 |
| clayg | dfg: I don't think so - but the *next* change should pick up where it left off | 00:16 |
| *** Jeffrey4l has quit IRC | 00:17 | |
| clayg | i need a whiteboard | 00:17 |
| dfg | clayg: but i don't think it did. when i made that second change | 00:17 |
| clayg | dfg: yeah | 00:17 |
| clayg | thinking | 00:17 |
| dfg | anywya- i don't know enough about this to aruge about it. | 00:17 |
| clayg | dfg: i'll look at it - I think you're right to raise the flag - i'm not sure yet | 00:17 |
| *** jerrygb has quit IRC | 00:18 | |
| *** jerrygb has joined #openstack-swift | 00:18 | |
| *** ianbrown has quit IRC | 00:20 | |
| *** ianbrown has joined #openstack-swift | 00:20 | |
| *** jerrygb has quit IRC | 00:23 | |
| *** Jeffrey4l has joined #openstack-swift | 00:23 | |
| *** ianbrown has quit IRC | 00:25 | |
| *** ianbrown_ has joined #openstack-swift | 00:25 | |
| *** Trixboxer has quit IRC | 00:32 | |
| openstackgerrit | Clay Gerrard proposed openstack/swift: Put part-replicas where they go https://review.openstack.org/241571 | 00:40 |
| clayg | ^ just some small updates for kota | 00:40 |
| openstackgerrit | Clay Gerrard proposed openstack/swift: Ring Overview updates https://review.openstack.org/244412 | 00:42 |
| *** alejandrito has quit IRC | 00:46 | |
| *** Trixboxer has joined #openstack-swift | 00:46 | |
| kota_ | morning | 00:50 |
| kota_ | clayg: thanks! i am going to continue to look at :-) | 00:50 |
| *** Guest84101 has quit IRC | 00:50 | |
| *** km has joined #openstack-swift | 00:51 | |
| *** km is now known as Guest64123 | 00:51 | |
| *** kei_yama has quit IRC | 00:51 | |
| *** kei_yama has joined #openstack-swift | 00:52 | |
| *** changbl has quit IRC | 01:00 | |
| clayg | json is such a crappy format | 01:09 |
| *** changbl has joined #openstack-swift | 01:13 | |
| *** changbl has quit IRC | 01:14 | |
| *** dmorita has joined #openstack-swift | 01:18 | |
| *** ianbrown_ has quit IRC | 01:20 | |
| *** rohit_ has joined #openstack-swift | 01:21 | |
| *** onovy has quit IRC | 01:22 | |
| *** peterlisak has quit IRC | 01:23 | |
| *** rohit_ has quit IRC | 01:23 | |
| *** rohit_ has joined #openstack-swift | 01:23 | |
| *** peterlisak has joined #openstack-swift | 01:24 | |
| *** onovy has joined #openstack-swift | 01:24 | |
| *** links has joined #openstack-swift | 01:27 | |
| *** lyrrad_ has quit IRC | 01:27 | |
| *** garthb has quit IRC | 01:31 | |
| *** changbl has joined #openstack-swift | 01:34 | |
| *** badari has quit IRC | 01:42 | |
| *** changbl has quit IRC | 01:47 | |
| *** ianbrown_ has joined #openstack-swift | 01:48 | |
| *** 7F1AA32U1 has joined #openstack-swift | 01:58 | |
| *** changbl has joined #openstack-swift | 02:00 | |
| *** 7F1AA32U1 has quit IRC | 02:01 | |
| *** haomaiwang has joined #openstack-swift | 02:01 | |
| *** janonymous_ has quit IRC | 02:01 | |
| *** Jeffrey4l has quit IRC | 02:13 | |
| *** Jeffrey4l has joined #openstack-swift | 02:14 | |
| *** jerrygb has joined #openstack-swift | 02:14 | |
| *** klrmn1 has quit IRC | 02:16 | |
| *** jerrygb has quit IRC | 02:16 | |
| *** km has joined #openstack-swift | 02:53 | |
| *** Guest64123 has quit IRC | 02:53 | |
| *** km is now known as Guest33155 | 02:54 | |
| *** kei_yama has quit IRC | 02:54 | |
| *** kei_yama has joined #openstack-swift | 02:55 | |
| *** ianbrown_ has quit IRC | 02:57 | |
| *** sanchitmalhotra has joined #openstack-swift | 03:00 | |
| *** haomaiwang has quit IRC | 03:01 | |
| *** haomaiwang has joined #openstack-swift | 03:01 | |
| *** haomaiwang has quit IRC | 03:15 | |
| *** haomaiwang has joined #openstack-swift | 03:15 | |
| *** haomaiwang has quit IRC | 03:16 | |
| *** haomaiwang has joined #openstack-swift | 03:16 | |
| *** haomaiwang has quit IRC | 03:17 | |
| *** haomaiwang has joined #openstack-swift | 03:18 | |
| *** haomaiwang has quit IRC | 03:19 | |
| *** 17WAA5E9R has joined #openstack-swift | 03:19 | |
| *** 17WAA5E9R has quit IRC | 03:20 | |
| *** haomaiwang has joined #openstack-swift | 03:20 | |
| *** haomaiwang has quit IRC | 03:21 | |
| *** dmorita has quit IRC | 03:24 | |
| openstackgerrit | pei ran wu proposed openstack/swift: Fix POST-as-COPY mess up the DLO manifest https://review.openstack.org/252791 | 03:24 |
| *** haomaiwang has joined #openstack-swift | 03:24 | |
| *** haomaiwang has quit IRC | 03:25 | |
| *** haomaiwang has joined #openstack-swift | 03:25 | |
| *** haomaiwang has quit IRC | 03:26 | |
| *** gyee has quit IRC | 03:26 | |
| *** haomaiwang has joined #openstack-swift | 03:26 | |
| *** haomaiwang has quit IRC | 03:27 | |
| *** dmorita has joined #openstack-swift | 03:27 | |
| *** haomaiwang has joined #openstack-swift | 03:27 | |
| *** haomaiwang has quit IRC | 03:28 | |
| *** haomaiwang has joined #openstack-swift | 03:28 | |
| *** haomaiwang has quit IRC | 03:29 | |
| *** haomaiwang has joined #openstack-swift | 03:29 | |
| *** haomaiwang has quit IRC | 03:30 | |
| *** 7F1AA34GJ has joined #openstack-swift | 03:30 | |
| *** 7F1AA34GJ has quit IRC | 03:31 | |
| *** haomaiwang has joined #openstack-swift | 03:31 | |
| *** haomaiwang has quit IRC | 03:32 | |
| *** dmorita has quit IRC | 03:32 | |
| *** haomaiwa_ has joined #openstack-swift | 03:33 | |
| *** haomaiwa_ has quit IRC | 03:34 | |
| *** haomaiwang has joined #openstack-swift | 03:34 | |
| *** klrmn1 has joined #openstack-swift | 03:34 | |
| *** haomaiwang has quit IRC | 03:35 | |
| *** jerrygb has joined #openstack-swift | 03:35 | |
| *** haomaiwa_ has joined #openstack-swift | 03:38 | |
| gmmaha | hey mattoliverau | 03:41 |
| gmmaha | yeah, going to start looking into the gobal clusters card.. | 03:42 |
| *** blmartin has quit IRC | 03:42 | |
| gmmaha | need to get enough background to figure out whats the low hanging fruit that i can knock out | 03:42 |
| *** silor has joined #openstack-swift | 03:47 | |
| *** silor1 has joined #openstack-swift | 03:54 | |
| *** klrmn1 has quit IRC | 03:54 | |
| *** dmorita has joined #openstack-swift | 03:55 | |
| *** ianbrown has joined #openstack-swift | 03:55 | |
| *** silor has quit IRC | 03:56 | |
| *** silor1 is now known as silor | 03:56 | |
| *** dmorita has quit IRC | 03:59 | |
| *** haomaiwa_ has quit IRC | 04:01 | |
| *** haomaiwang has joined #openstack-swift | 04:01 | |
| *** trifon has joined #openstack-swift | 04:03 | |
| *** darrenc is now known as darrenc_afk | 04:06 | |
| *** Jeffrey4l has quit IRC | 04:14 | |
| mattoliverau | gmmaha: yeah, I suspect you'll need to do a bit of R&D for that one, setup a global cluster (or simulate one [there is a slowdown middleware you could use on a "remote" region]), profile/benchmark it with different settings, starting with the defaults. | 04:21 |
| *** wupeiran has joined #openstack-swift | 04:27 | |
| gmmaha | mattoliverau: yeah.. spoke to peluse this morning and i have quite a bit of homework to do before i can work on anyting w.r.t to the clusters | 04:28 |
| gmmaha | thanks for the tip.. didnt know about the middleware.. | 04:28 |
| *** dmorita has joined #openstack-swift | 04:29 | |
| mattoliverau | gmmaha: yeah you will I suspect :) If there is anything I can do to help, just ask. | 04:29 |
| gmmaha | will not hesitate.. ;) | 04:29 |
| notmyname | good evening | 04:30 |
| gmmaha | good evening notmyname | 04:30 |
| *** rohit_ has quit IRC | 04:30 | |
| mattoliverau | notmyname: evening | 04:32 |
| notmyname | mattoliverau: is the osic trello board public? | 04:32 |
| mattoliverau | notmyname: not at the moment, still private, I think it should be, cause the idea is to do it in the open. But I'll bug people about it ;) | 04:34 |
| notmyname | ok :-) | 04:34 |
| mattoliverau | notmyname: do you have access to it? Did peluse add you? | 04:35 |
| *** ianbrown has quit IRC | 04:35 | |
| notmyname | mattoliverau: no, I haven't been added | 04:35 |
| notmyname | but I'd like to be ;-) | 04:36 |
| *** trifon has quit IRC | 04:37 | |
| notmyname | mattoliverau: what's your trello id? | 04:39 |
| notmyname | found it | 04:39 |
| mattoliverau | mattoliverau | 04:39 |
| mattoliverau | :) | 04:39 |
| notmyname | mattoliverau: ok, you (and peluse) can now deal with boards under "openstack swift" | 04:40 |
| notmyname | you probably just got an email | 04:40 |
| mattoliverau | notmyname: \o/ thanks | 04:41 |
| notmyname | eg you could add your osic swift board to the swift group ;-) | 04:42 |
| *** darrenc_afk is now known as darrenc | 04:42 | |
| *** proteusguy_ has quit IRC | 04:43 | |
| mattoliverau | nice, maybe I'll add the container sharding board there too ;) | 04:44 |
| notmyname | mattoliverau: do you know flanders who works at uni melb? | 04:45 |
| mattoliverau | notmyname: no I don't, I think I've talked to him briefly online (well talked to someone from the uni of melb), but I should meet him seeing as he is so close ;) | 04:47 |
| notmyname | heh, ok | 04:47 |
| mattoliverau | notmyname: is he online much? | 04:47 |
| notmyname | no idea ;-) | 04:47 |
| notmyname | anyway, I'm talking to him (ie sent some emails) about meeting some people there to talk about swift during my trip for LCA | 04:47 |
| notmyname | so I'm considering getting to MEL perhaps on friday morning before LCA. | 04:48 |
| notmyname | otherwise, probably getting there sat/sun and headed to geelong on sunday. perhaps trying to find a way back to MEL during the week if there are people interested in swift ther | 04:49 |
| notmyname | point is, I'd love to see you in melb when possible :-) | 04:49 |
| mattoliverau | Oh cool! You should come, and yes, we can do some Melbourne things :) | 04:50 |
| *** SkyRocknRoll has joined #openstack-swift | 04:50 | |
| mattoliverau | Also I'm keen to do any swift meet ups with others if your doing community wise :) | 04:50 |
| notmyname | you'll be down in geelong all week for lca, right? | 04:50 |
| mattoliverau | yup, I head down on Sunday head back up on Sat | 04:50 |
| notmyname | mattoliverau: well to be fair, it will be part community and probably part "let me talk about swiftstack" too. | 04:51 |
| notmyname | but yeah, if there's any community focused stuff (meetups, coffee meetings, etc), I definitely would include you | 04:51 |
| mattoliverau | notmyname: yeah, I suspected as much, but that's ok, if its "work" then that's understandable. Besides you might like melbourne so much you'd need to find some clients so you can move down here ;) | 04:52 |
| notmyname | heh | 04:52 |
| notmyname | my wife and I actually briefly considered a 4 to 6 month home swap with someone there | 04:53 |
| notmyname | nothign came of it, for various reasons, but we'd still love to visit | 04:55 |
| *** proteusguy_ has joined #openstack-swift | 04:56 | |
| mattoliverau | Well I'll just have to do my best to drum up some business for you here then.. don't tell RS :P | 04:58 |
| mahatic | good morning | 05:00 |
| *** ppai has joined #openstack-swift | 05:00 | |
| *** haomaiwang has quit IRC | 05:01 | |
| *** haomaiwang has joined #openstack-swift | 05:01 | |
| mattoliverau | mahatic: morning | 05:02 |
| *** ianbrown has joined #openstack-swift | 05:02 | |
| mahatic | mattoliverau: hello | 05:02 |
| notmyname | wow. "Ran 4344 tests..." | 05:04 |
| notmyname | I remember when we broke 3000 | 05:04 |
| *** klrmn1 has joined #openstack-swift | 05:05 | |
| mattoliverau | next goal 10k :) | 05:05 |
| notmyname | oh you mean land ho's patch? ;-) | 05:06 |
| mattoliverau | lol | 05:06 |
| kota_ | lol | 05:13 |
| kota_ | mahatic: morning | 05:13 |
| kota_ | and notmyname: evening | 05:14 |
| mahatic | kota_: hi | 05:14 |
| *** km has joined #openstack-swift | 05:23 | |
| *** Guest33155 has quit IRC | 05:24 | |
| *** km is now known as Guest67857 | 05:24 | |
| *** asettle is now known as asettle-afk | 05:28 | |
| *** klrmn1 has quit IRC | 05:29 | |
| *** trifon has joined #openstack-swift | 05:42 | |
| notmyname | Zyric: some comments incoming on patch 241978 | 05:42 |
| patchbot | notmyname: https://review.openstack.org/#/c/241978/ - Add support for storage policies to have more than... | 05:42 |
| ho | notmyname: mattoliverau: kota_: let's go ahead to 10k :p | 05:43 |
| *** jerrygb has quit IRC | 05:50 | |
| *** ianbrown has quit IRC | 05:57 | |
| *** ianbrown has joined #openstack-swift | 05:57 | |
| *** ianbrown_ has joined #openstack-swift | 05:57 | |
| *** ianbrown_ has quit IRC | 05:57 | |
| Zyric | Ah neat, thanks notmyname - just got the review comments. | 05:58 |
| notmyname | Zyric: oh, and FYI: a nit comment. normally if you get a "nit" comment, it means "something that maybe should change if you end up doing a different patch set for other reasons but don't do one just for this" | 05:59 |
| notmyname | eg the trailing whitespace | 05:59 |
| openstackgerrit | pei ran wu proposed openstack/swift: Fix POST-as-COPY mess up the DLO manifest https://review.openstack.org/252791 | 06:00 |
| *** ianbrown_ has joined #openstack-swift | 06:00 | |
| *** ianbrown has quit IRC | 06:00 | |
| *** haomaiwang has quit IRC | 06:01 | |
| *** haomaiwang has joined #openstack-swift | 06:01 | |
| *** wolsen has quit IRC | 06:04 | |
| *** wolsen has joined #openstack-swift | 06:05 | |
| *** donghao has joined #openstack-swift | 06:10 | |
| *** ianbrown_ has quit IRC | 06:17 | |
| *** eranrom has joined #openstack-swift | 06:22 | |
| *** ianbrown has joined #openstack-swift | 06:23 | |
| *** haomaiwang has quit IRC | 06:32 | |
| *** asettle-afk is now known as asettle | 06:33 | |
| *** 18WABB396 has joined #openstack-swift | 06:33 | |
| *** donghao has quit IRC | 06:37 | |
| *** Jeffrey4l has joined #openstack-swift | 06:39 | |
| *** ianbrown has quit IRC | 06:40 | |
| *** ianbrown has joined #openstack-swift | 06:40 | |
| *** ianbrown has quit IRC | 06:41 | |
| *** ianbrown_ has joined #openstack-swift | 06:41 | |
| *** ianbrown__ has joined #openstack-swift | 06:43 | |
| *** ianbrown_ has quit IRC | 06:43 | |
| *** ChubYann has quit IRC | 06:47 | |
| *** dmorita has quit IRC | 06:56 | |
| *** 18WABB396 has quit IRC | 07:01 | |
| *** haomaiwang has joined #openstack-swift | 07:01 | |
| *** zaitcev has quit IRC | 07:04 | |
| *** haomaiwang has quit IRC | 07:09 | |
| *** haomaiwang has joined #openstack-swift | 07:09 | |
| *** silor has quit IRC | 07:17 | |
| *** haomaiwang has quit IRC | 07:28 | |
| *** haomaiwa_ has joined #openstack-swift | 07:28 | |
| *** dmorita has joined #openstack-swift | 07:41 | |
| *** arnox has joined #openstack-swift | 08:04 | |
| *** jerrygb has joined #openstack-swift | 08:06 | |
| *** rledisez has joined #openstack-swift | 08:07 | |
| *** jerrygb has quit IRC | 08:12 | |
| openstackgerrit | pei ran wu proposed openstack/swift: Fix POST-as-COPY mess up the DLO manifest https://review.openstack.org/252791 | 08:17 |
| *** dmorita has quit IRC | 08:18 | |
| *** hseipp has joined #openstack-swift | 08:47 | |
| *** hseipp has quit IRC | 08:47 | |
| *** hseipp has joined #openstack-swift | 08:47 | |
| *** links has quit IRC | 08:55 | |
| *** links has joined #openstack-swift | 09:09 | |
| *** shakamunyi has joined #openstack-swift | 09:13 | |
| openstackgerrit | Prashanth Pai proposed openstack/swift: Make object creation more atomic in Linux https://review.openstack.org/162243 | 09:16 |
| openstackgerrit | Béla Vancsics proposed openstack/swift: Not used parameter https://review.openstack.org/254626 | 09:21 |
| *** shakamunyi has quit IRC | 09:23 | |
| *** ho has quit IRC | 09:38 | |
| *** Lickitysplitted_ has quit IRC | 09:41 | |
| *** jordanP has joined #openstack-swift | 09:46 | |
| *** wupeiran has quit IRC | 09:46 | |
| *** Lickitysplitted has joined #openstack-swift | 09:47 | |
| *** torgomatic has quit IRC | 09:54 | |
| *** StevenK has quit IRC | 09:56 | |
| *** StevenK has joined #openstack-swift | 09:57 | |
| *** torgomatic has joined #openstack-swift | 09:57 | |
| *** ChanServ sets mode: +v torgomatic | 09:57 | |
| *** aix has joined #openstack-swift | 10:01 | |
| *** jistr has joined #openstack-swift | 10:14 | |
| *** bwall has quit IRC | 10:21 | |
| *** aix has quit IRC | 10:21 | |
| *** usdsd has joined #openstack-swift | 10:22 | |
| *** bwall has joined #openstack-swift | 10:23 | |
| *** bwall has joined #openstack-swift | 10:23 | |
| *** usdsd has left #openstack-swift | 10:28 | |
| *** aix has joined #openstack-swift | 10:33 | |
| *** jmccarthy has quit IRC | 10:33 | |
| *** jmccarthy has joined #openstack-swift | 10:34 | |
| *** links has quit IRC | 10:37 | |
| *** kei_yama has quit IRC | 10:40 | |
| *** janonymous has quit IRC | 10:49 | |
| *** Guest67857 has quit IRC | 10:50 | |
| *** Lickitysplitted has quit IRC | 10:53 | |
| *** links has joined #openstack-swift | 10:57 | |
| *** openstackgerrit has quit IRC | 11:02 | |
| *** Lickitysplitted has joined #openstack-swift | 11:03 | |
| *** openstackgerrit has joined #openstack-swift | 11:03 | |
| *** haomaiwa_ has quit IRC | 11:06 | |
| *** Jeffrey4l has quit IRC | 11:15 | |
| *** janonymous has joined #openstack-swift | 11:15 | |
| openstackgerrit | janonymous proposed openstack/swift: remove all pyc before starting unit test https://review.openstack.org/254276 | 11:32 |
| *** szaher_ has joined #openstack-swift | 11:34 | |
| *** szaher_ has quit IRC | 11:34 | |
| *** ppai has quit IRC | 11:50 | |
| *** SkyRocknRoll has quit IRC | 11:52 | |
| *** ppai has joined #openstack-swift | 12:00 | |
| *** SkyRocknRoll has joined #openstack-swift | 12:05 | |
| *** jerrygb has joined #openstack-swift | 12:09 | |
| *** jerrygb has quit IRC | 12:13 | |
| *** arnox has quit IRC | 12:18 | |
| *** rledisez has quit IRC | 12:19 | |
| *** rledisez has joined #openstack-swift | 12:32 | |
| *** arnox has joined #openstack-swift | 12:33 | |
| *** silor has joined #openstack-swift | 12:33 | |
| *** links has quit IRC | 12:36 | |
| *** portante has quit IRC | 12:42 | |
| *** ndk has quit IRC | 12:42 | |
| *** ppai has quit IRC | 12:44 | |
| *** ppai has joined #openstack-swift | 12:55 | |
| *** portante has joined #openstack-swift | 13:06 | |
| *** CaioBrentano has joined #openstack-swift | 13:06 | |
| *** ianbrown__ has quit IRC | 13:22 | |
| *** ianbrown_ has joined #openstack-swift | 13:22 | |
| *** SkyRocknRoll has quit IRC | 13:33 | |
| *** ppai has quit IRC | 13:39 | |
| *** jerrygb has joined #openstack-swift | 13:44 | |
| *** diogogmt has quit IRC | 13:58 | |
| *** diogogmt has joined #openstack-swift | 13:58 | |
| *** janonymous_ has joined #openstack-swift | 14:02 | |
| *** sanchitmalhotra has quit IRC | 14:04 | |
| *** changbl has quit IRC | 14:10 | |
| *** breitz has quit IRC | 14:18 | |
| *** breitz has joined #openstack-swift | 14:19 | |
| *** petertr7_away is now known as petertr7 | 14:21 | |
| *** diogogmt has quit IRC | 14:25 | |
| *** badari has joined #openstack-swift | 14:43 | |
| *** hseipp has quit IRC | 14:43 | |
| *** ndk has joined #openstack-swift | 14:44 | |
| *** hseipp has joined #openstack-swift | 14:48 | |
| *** blmartin has joined #openstack-swift | 15:00 | |
| *** dustins|gone is now known as dustins | 15:01 | |
| *** Jeffrey4l has joined #openstack-swift | 15:03 | |
| *** jerrygb has quit IRC | 15:09 | |
| *** jerrygb has joined #openstack-swift | 15:10 | |
| *** chsc has joined #openstack-swift | 15:11 | |
| *** janonymous_ has quit IRC | 15:12 | |
| *** yarkot has joined #openstack-swift | 15:13 | |
| *** siva_krishnan has left #openstack-swift | 15:13 | |
| *** jerrygb has quit IRC | 15:15 | |
| *** blmartin has quit IRC | 15:16 | |
| *** sgundur has joined #openstack-swift | 15:19 | |
| *** Jeffrey4l has quit IRC | 15:20 | |
| *** blmartin has joined #openstack-swift | 15:22 | |
| *** jerrygb has joined #openstack-swift | 15:24 | |
| *** noark9 has joined #openstack-swift | 15:26 | |
| *** diogogmt has joined #openstack-swift | 15:36 | |
| *** trifon has quit IRC | 15:39 | |
| *** thumpba has joined #openstack-swift | 15:39 | |
| *** esker has joined #openstack-swift | 15:40 | |
| *** siva_krishnan has joined #openstack-swift | 15:40 | |
| *** jistr is now known as jistr|mtg | 15:43 | |
| *** patchbot has quit IRC | 15:48 | |
| *** patchbot has joined #openstack-swift | 15:48 | |
| *** pgbridge has joined #openstack-swift | 15:55 | |
| *** garthb has joined #openstack-swift | 15:58 | |
| *** petertr7 is now known as petertr7_away | 16:06 | |
| *** mariusv has joined #openstack-swift | 16:07 | |
| *** mariusv has quit IRC | 16:07 | |
| *** mariusv has joined #openstack-swift | 16:07 | |
| *** aix has quit IRC | 16:08 | |
| *** janonymous_ has joined #openstack-swift | 16:13 | |
| *** changbl has joined #openstack-swift | 16:15 | |
| *** ianbrown_ has quit IRC | 16:17 | |
| *** klrmn1 has joined #openstack-swift | 16:17 | |
| *** noark9 has quit IRC | 16:24 | |
| *** changbl has quit IRC | 16:25 | |
| *** changbl has joined #openstack-swift | 16:26 | |
| *** ianbrown_ has joined #openstack-swift | 16:29 | |
| *** mariusv_ has joined #openstack-swift | 16:29 | |
| *** changbl has quit IRC | 16:30 | |
| *** mariusv has quit IRC | 16:31 | |
| *** kairat has joined #openstack-swift | 16:34 | |
| kairat | Hi guys | 16:34 |
| kairat | Could you please help with the question: when chunked transfer encoding used in swiftclient | 16:35 |
| kairat | I noticed if we don't specify content-length in glance and provides just an iterator to swift | 16:35 |
| kairat | *swiftclient | 16:35 |
| kairat | then swiftclient also do not specify it in request | 16:38 |
| kairat | it causes radosgw to fail | 16:38 |
| *** arnox has quit IRC | 16:39 | |
| kairat | because the requests seems not in accordance with HTTP specification | 16:39 |
| notmyname | does radosgw support chunked transfer encoding? | 16:39 |
| notmyname | do you have a dump of the headers or other request info that are being sent? | 16:39 |
| kairat | Just a sec | 16:39 |
| kairat | notmyname, https://bugs.launchpad.net/glance/+bug/1518431 | 16:40 |
| openstack | Launchpad bug 1518431 in Glance "Glance failed to upload image to swift storage" [Undecided,Confirmed] | 16:40 |
| kairat | here is the bug | 16:40 |
| kairat | notmyname, this is paste: http://paste.openstack.org/show/479621/ | 16:41 |
| kairat | IIUC, there is no content-length nor transfer-encoding here | 16:41 |
| kairat | I actually don't know if RadosGW support chunked-encoding but it seems that requests are not satisfy HTTP spec requirements | 16:42 |
| kairat | https://github.com/openstack/glance_store/blob/master/glance_store/_drivers/swift/store.py#L550 - here is request from glance | 16:42 |
| kairat | content_length here is None | 16:43 |
| *** changbl has joined #openstack-swift | 16:43 | |
| *** noark9 has joined #openstack-swift | 16:43 | |
| kairat | I reviewed all requests from client to swift and it seems that no content-length is specified there if glance do not provide this | 16:45 |
| notmyname | kairat: where's the definition of ChunkReader? | 16:45 |
| notmyname | ah. there at the bottom | 16:46 |
| kairat | notmyname, https://github.com/openstack/glance_store/blob/master/glance_store/_drivers/swift/store.py#L951 | 16:46 |
| kairat | yep | 16:46 |
| *** yarkot has quit IRC | 16:46 | |
| kairat | I stopped in python requests lib | 16:47 |
| kairat | because I think no headers can be specified here | 16:47 |
| *** openstackgerrit has quit IRC | 16:47 | |
| kairat | But I am not sure | 16:47 |
| *** openstackgerrit has joined #openstack-swift | 16:47 | |
| *** sgundur has quit IRC | 16:49 | |
| *** yarkot has joined #openstack-swift | 16:49 | |
| *** garthb_ has joined #openstack-swift | 16:51 | |
| *** garthb has quit IRC | 16:51 | |
| *** nadeem has joined #openstack-swift | 16:53 | |
| *** nadeem has quit IRC | 16:55 | |
| *** ianbrown__ has joined #openstack-swift | 16:55 | |
| *** alejandrito has joined #openstack-swift | 16:55 | |
| *** nadeem has joined #openstack-swift | 16:56 | |
| *** ianbrown_ has quit IRC | 16:57 | |
| *** gyee has joined #openstack-swift | 17:00 | |
| notmyname | kairat: I traced throught he swiftclient code until I got to the requests library | 17:02 |
| kairat | notmyname, I consulted with glance folks also | 17:02 |
| notmyname | from what I can tell, we're relying on requests to set transfer-encoding: chunked if there's no content-length | 17:03 |
| notmyname | I haven't validated that yet | 17:03 |
| kairat | It seems that requests library should add chunked if swiftclient provides a generated | 17:03 |
| kairat | * generator | 17:03 |
| notmyname | kairat: what would be super helpful is if you could trace the request between swift and glance and dump the requests on the wire, including the headers | 17:03 |
| kairat | yep | 17:04 |
| kairat | asking guys about that | 17:04 |
| notmyname | I think that's the next step here | 17:04 |
| kairat | yep | 17:04 |
| notmyname | but I've got to run for the moment. I'll be back in an hour-ish | 17:04 |
| kairat | notmyname, thanks for help | 17:04 |
| *** noark9 has quit IRC | 17:06 | |
| *** janonymous__ has joined #openstack-swift | 17:07 | |
| *** noark9 has joined #openstack-swift | 17:08 | |
| *** petertr7_away is now known as petertr7 | 17:08 | |
| *** janonymous_ has quit IRC | 17:09 | |
| *** pgbridge has quit IRC | 17:09 | |
| *** lyrrad has joined #openstack-swift | 17:12 | |
| *** noark9 has quit IRC | 17:14 | |
| *** rledisez has quit IRC | 17:16 | |
| *** pgbridge has joined #openstack-swift | 17:17 | |
| *** petertr7 is now known as petertr7_away | 17:18 | |
| *** tsg has joined #openstack-swift | 17:20 | |
| openstackgerrit | Peter Chng proposed openstack/swift: Add round-trip encrypter/decrypter unit tests https://review.openstack.org/251606 | 17:21 |
| *** jistr|mtg is now known as jistr | 17:21 | |
| openstackgerrit | Peter Chng proposed openstack/swift: Add round-trip encrypter/decrypter unit tests https://review.openstack.org/251606 | 17:25 |
| *** dmorita has joined #openstack-swift | 17:28 | |
| portante | any znc users out there encountered slow startup of znc after server reboots? | 17:33 |
| portante | what do folks have their server throttle set to? | 17:34 |
| *** insanidade has joined #openstack-swift | 17:35 | |
| insanidade | hi all. is it possible to move data from one container to another? | 17:35 |
| *** janonymous__ has quit IRC | 17:36 | |
| *** esker has quit IRC | 17:37 | |
| *** garthb_ has quit IRC | 17:38 | |
| *** janonymous_ has joined #openstack-swift | 17:38 | |
| janonymous_ | kota: hey, on one of my vm instance some ut's were failing, can you have a look if it is useful or it's my env problem only : http://paste.openstack.org/show/481204/ | 17:38 |
| *** manous has joined #openstack-swift | 17:40 | |
| *** ianbrown__ has quit IRC | 17:52 | |
| insanidade | Would anyone please help me with this question? I have a container A and, some time later, I create container B. I synchronize container A and B. What if I decide to delete container A? Does container B still contain the synced files ? | 17:55 |
| *** ianbrown__ has joined #openstack-swift | 17:56 | |
| *** yarkot has quit IRC | 17:58 | |
| insanidade | anyone ? | 17:58 |
| pdardeau | insanidade: by synchronize, you mean making a copy of the objects? | 17:58 |
| insanidade | pdardeau: yes. from one container to the other. | 17:59 |
| insanidade | pdardeau: what I'm actually trying to do is to "move" data from one container to the other. I know how "moving" things in object storage is not as easy as in common file systems. | 18:00 |
| pdardeau | insanidade: once you delete container A, container B will still contain the copies that were made from container A | 18:00 |
| *** hseipp has quit IRC | 18:00 | |
| insanidade | pdardeau: I see. That would help me with that "move" workaround. | 18:00 |
| pdardeau | insanidade: are you able to give your use case for wanting to move between containers? | 18:01 |
| insanidade | pdardeau: not sure about the details. A customer just asked about it. He tried it with a GUI tool and what the tool did was "download everything and upload to the new cluster" | 18:02 |
| insanidade | pdardeau: that customer wants to know if a "move" feature exists. | 18:02 |
| pdardeau | insanidade: are you really interested in a container rename? | 18:03 |
| insanidade | by "move", he clearly means that traditional "move" definition. download TB of data and uploading again is what that customer is trying to avoid. | 18:03 |
| insanidade | pdardeau: that's not just a rename. I believe there's some other data in the destination container and that makes both containers different. | 18:04 |
| CaioBrentano | insanidade does this help in anyway? http://docs.openstack.org/developer/swift/overview_container_sync.html | 18:05 |
| *** jistr has quit IRC | 18:05 | |
| insanidade | CaioBrentano: that url has been in my favorites for a while now :) it sure helps, but I thing I don't have the required access to configure the cluster and enable it. | 18:06 |
| insanidade | sorry for my typos. my keyboard sucks. | 18:09 |
| ahale | theres also http://developer.openstack.org/api-ref-objectstorage-v1.html#copyObject | 18:10 |
| *** diazjf has joined #openstack-swift | 18:11 | |
| CaioBrentano | insanidade in this case I if you have a "simple" solution! In some way, you'll probably have to create all the objects again | 18:12 |
| insanidade | ahale: would that "copy" functionality apply for copies between containers ? | 18:13 |
| tdasilva | yeah, you basically need a tool to issue copy requests to all objects in your source container and then delete them afterwards... | 18:13 |
| dfg | clayg: you there? | 18:14 |
| insanidade | if that works between containers, yes. I'd have to copy and delete the original objects. that would work. | 18:14 |
| tdasilva | insanidade: yeah, you can copy between containers and even account | 18:14 |
| tdasilva | *accounts | 18:14 |
| ahale | yep it works across containers, you just need some scripting round it like tdasilva says | 18:15 |
| insanidade | ahale tdasilva yes, I got it. | 18:15 |
| notmyname | good morning | 18:16 |
| CaioBrentano | it's nick to know about this copy method! thanks ahale :) | 18:17 |
| CaioBrentano | *nice | 18:17 |
| *** alejandrito has quit IRC | 18:19 | |
| *** alejandrito has joined #openstack-swift | 18:19 | |
| dfg | clayg: nm | 18:19 |
| * tdasilva just realized python-swiftclient doesn't have a copy option | 18:21 | |
| notmyname | tdasilva: watch out. pretty soon you'll be noticing all things swiftclient doesn't have and you'll sound like timburke ;-) | 18:22 |
| tdasilva | lol | 18:22 |
| tdasilva | timburke: what do you sound like??? | 18:22 |
| timburke | i wonder how far you can get with `swift upload -H 'X-Copy-From: ...'` | 18:22 |
| timburke | someone who wants some degree of feature parity between client and server? | 18:23 |
| *** shakamunyi has joined #openstack-swift | 18:25 | |
| tdasilva | timburke: sounds reasonable ;-) | 18:25 |
| timburke | we still can't even post data to an account (for example, so you could use the bulk ops middleware), though patch 190887 will address that | 18:25 |
| patchbot | timburke: https://review.openstack.org/#/c/190887/ - Use bulk-delete middleware when available | 18:25 |
| *** jerrygb has quit IRC | 18:39 | |
| insanidade | tdasilva ahale what about renaming a container ? is it possible ? | 18:39 |
| tdasilva | insanidade: not at the moment | 18:40 |
| *** jerrygb has joined #openstack-swift | 18:46 | |
| *** lucy has joined #openstack-swift | 18:47 | |
| *** lucy is now known as Guest86253 | 18:47 | |
| *** Guest86253 has quit IRC | 18:48 | |
| notmyname | I talked to someone about a patch that was going to remove the beta tag on the EC docs. but I don't remember the context or who I was talking to | 18:49 |
| *** david-ly_ has joined #openstack-swift | 18:50 | |
| *** david-ly_ is now known as david-lyle_ | 18:52 | |
| insanidade | what does it mean when I issue a curl command against Swift and receive the following response: "<html><h1>Accepted</h1><p>The request is accepted for processing.</p></html>" ? | 18:53 |
| *** david-lyle has quit IRC | 18:54 | |
| notmyname | insanidade: that's fine! that's a 202 status code | 18:54 |
| insanidade | does it mean that the requested action will be processed asynchronously ? | 18:54 |
| notmyname | was it a PUT request? | 18:54 |
| insanidade | notmyname: yes | 18:54 |
| notmyname | so in that case, you did an overwrite of an existing object. new objects would have given you a 201 Created. an overwrite gives you 202 Accepted. | 18:54 |
| notmyname | that means that the new data was durably written to multiple disks | 18:55 |
| notmyname | so your data is there | 18:55 |
| *** manous has quit IRC | 18:55 | |
| notmyname | depending on your cluster (eg hw failures, any business when you were doing the PUT, etc) it *might* be possible that a subsequent GET for that object will return the older version of the file | 18:56 |
| notmyname | however, swift will resolve it down to the new version of the file in the background | 18:56 |
| insanidade | notmyname: I'm just trying to copy a file from one container to the other. | 18:56 |
| insanidade | notmyname: a file from one container to an empty container. | 18:56 |
| notmyname | insanidade: the short answer is that a 2xx series response code means that swift has durably stored the data. you're good! | 18:58 |
| insanidade | notmyname: it's been a while since I issued that command and the destination container remains empty. | 19:00 |
| notmyname | insanidade: oh, that's weird then. can you pastebin the command you used to do the copy? | 19:00 |
| notmyname | here's something cool. CaioBrentano shared this with me yesterday. one of the world's biggest soccer stars (neymar jr) has all the static assets on his website hosted in CaioBrentano's swift cluster | 19:01 |
| *** openstackgerrit has quit IRC | 19:02 | |
| *** openstackgerrit has joined #openstack-swift | 19:03 | |
| insanidade | notmyname: http://pastebin.com/xA7mTapB | 19:06 |
| notmyname | insanidade: oh! | 19:06 |
| notmyname | ok, 2 things I see there | 19:06 |
| notmyname | first, you need to PUT to the actual object name you're copying to. in this case, you did a PUT to the container itself, and that's why you got the 202 response | 19:07 |
| *** tsg has quit IRC | 19:07 | |
| notmyname | second, the x-copy-from header value needs to be of the form "[/]<src_container>/<src_object>" | 19:08 |
| insanidade | notmyname: so, I need to explicitly mention the source file name and the destination file name (not only the destination folder) ? | 19:10 |
| notmyname | yes, exactly | 19:10 |
| insanidade | notmyname: what about wildcards? I'd like to copy all files from source folder to destination folder. | 19:11 |
| notmyname | nope | 19:11 |
| notmyname | insanidade: http://developer.openstack.org/api-ref-objectstorage-v1.html#copyObject | 19:12 |
| *** ChubYann has joined #openstack-swift | 19:12 | |
| insanidade | now the server is complaining about Content-Length header not present. | 19:12 |
| *** hferenc has quit IRC | 19:12 | |
| notmyname | yup. PUT requests require a content-length (or chunked transfer encoding). you aren't actually sending a body, so "content-length: 0" is appropriate | 19:13 |
| *** david-lyle_ is now known as david-lyle | 19:14 | |
| *** janonymous_ has quit IRC | 19:17 | |
| *** esker has joined #openstack-swift | 19:24 | |
| insanidade | notmyname: is there a limit for the file sizes ? | 19:26 |
| insanidade | notmyname: I can't copy big files (6GB, for instance) | 19:27 |
| *** esker has quit IRC | 19:28 | |
| *** diazjf has quit IRC | 19:31 | |
| *** diazjf has joined #openstack-swift | 19:31 | |
| notmyname | right. COPY will be limited by the per-object limit (default is 5GB) | 19:32 |
| openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Use application/x-directory content-type for dir markers https://review.openstack.org/254921 | 19:33 |
| notmyname | now, swift does support larger object using manifest objects, and you can do some stuff to copy the manifest | 19:33 |
| *** tsg has joined #openstack-swift | 19:35 | |
| notmyname | mattoliverau: hurricanerix: I think we need to add subunit to test-requirements for patch 214206 | 19:36 |
| patchbot | notmyname: https://review.openstack.org/#/c/214206/ - Modify functional tests to use testr | 19:36 |
| notmyname | hmm maybe not | 19:37 |
| mattoliverau | The latest patch is using os-testr.. So it maynot | 19:37 |
| notmyname | mattoliverau: I *love* this time of year for the tz coordination ;-) | 19:38 |
| notmyname | mattoliverau: `SWIFT_TEST_IN_PROCESS=true SWIFT_TEST_IN_PROCESS_CONF_DIR=/tmp tox -efunc` errors with "no module named subunit" | 19:38 |
| mattoliverau | Well its still early, but I happen to be in an airport on my way to the Sydney office. | 19:39 |
| notmyname | but not doing the in-process works for me. I have subunit installed outside of a venv, so it works if I do the not in process tests | 19:39 |
| mattoliverau | Oh really.. Hmm, I thought I nuked my tox env and tried it | 19:39 |
| mattoliverau | So if you add it to test-req then it works? | 19:40 |
| notmyname | but I added subunit to test-requirements locally and it stiff broke :-/ | 19:40 |
| notmyname | so that was the "hmm maybe not" comment ;-) | 19:40 |
| mattoliverau | Hmm | 19:41 |
| notmyname | indeed | 19:41 |
| notmyname | ah. maybe.... | 19:42 |
| notmyname | got past that one | 19:43 |
| notmyname | keep subunit out of t-r | 19:43 |
| notmyname | I had an old .tox dir | 19:43 |
| notmyname | cleared that | 19:44 |
| notmyname | now whole new errors ;-) | 19:44 |
| mattoliverau | \o/ and :( | 19:44 |
| notmyname | invalid arguments to pyeclib_c_init. something with liberasure code | 19:45 |
| mattoliverau | It works on my saio in both in-process and not, and on my desktop. | 19:45 |
| mattoliverau | OK, so its a pyeclib problem :( | 19:45 |
| notmyname | maybe liberasurecode not being installed? | 19:47 |
| notmyname | not sure yet | 19:47 |
| notmyname | I did see that tsg joined ;-) | 19:48 |
| hurricanerix | yeah, i saw those errors in the gate jobs, but i don't think i got them locally. | 19:48 |
| mattoliverau | I saw them too, but the last patch finally passed in the gate.. So it might have been a bad nodepool image or something, doesn't help notmyname now tho :p | 19:49 |
| papercup | can someone here pls point me to documentation for functional tests -- eg: what's TestFile class ? Is this for testing actual object ? | 19:49 |
| notmyname | papercup: there's not a lot of docs on the tests themselves, other than inline comments | 19:49 |
| notmyname | test/functional/tests.py is the first place to start. it's a big file | 19:49 |
| papercup | sure thanks. yes .. I'm looking at that exact file for TestFile class | 19:50 |
| tsg | o/ notmyname, sorry don't have enough context in the irc history - is there new gate failure? | 19:50 |
| papercup | I'm trying to figure out what is it actually testign | 19:50 |
| papercup | I thought I'll ask here and get inside with some starter information | 19:51 |
| eranrom | acoles around? | 19:52 |
| tsg | notmyname, mattoliverau: let me know how to repro the "invalid arguments" error and I will take a look right away | 19:52 |
| notmyname | papercup: IIRC that's for testing objects. it might be in a helper module. I don't remember | 19:52 |
| papercup | notmyname: some piece of info, thanks for confirming my blind guesses | 19:54 |
| notmyname | tsg: I removed my .tox and then ``SWIFT_TEST_IN_PROCESS=true SWIFT_TEST_IN_PROCESS_CONF_DIR=/tmp tox -efunc`` | 19:55 |
| tsg | notmyname, ok - let me try that on the latest swift master | 19:55 |
| *** dmorita has quit IRC | 19:56 | |
| *** dmorita has joined #openstack-swift | 19:57 | |
| *** petertr7_away is now known as petertr7 | 19:58 | |
| *** dmorita has quit IRC | 19:58 | |
| *** garthb has joined #openstack-swift | 20:04 | |
| notmyname | tsg: is there a version attribute of pyeclib somewhere? | 20:04 |
| tsg | notmyname, there is a PYECLIB_VERSION in ec_iface.py | 20:05 |
| notmyname | ahh. the old 'module' object has no attribute 'ec_iface' error | 20:06 |
| notmyname | so liberasurecode isn't installed. right? | 20:07 |
| notmyname | is it possible it picked up a very new version that doesn't have that bundled? | 20:07 |
| *** mariusv_ has quit IRC | 20:13 | |
| *** mariusv has joined #openstack-swift | 20:15 | |
| *** mariusv has quit IRC | 20:15 | |
| *** mariusv has joined #openstack-swift | 20:15 | |
| *** esker has joined #openstack-swift | 20:17 | |
| * notmyname goes to pick up some lunch | 20:17 | |
| *** yarkot has joined #openstack-swift | 20:18 | |
| *** petertr7 is now known as petertr7_away | 20:20 | |
| *** esker has quit IRC | 20:21 | |
| *** zaitcev has joined #openstack-swift | 20:23 | |
| *** ChanServ sets mode: +v zaitcev | 20:23 | |
| *** silor has quit IRC | 20:25 | |
| *** mariusv has quit IRC | 20:26 | |
| *** chsc has quit IRC | 20:28 | |
| * mattoliverau is boarding his plane so will be afk for a while | 20:28 | |
| *** CaioBrentano has quit IRC | 20:32 | |
| *** CaioBrentano has joined #openstack-swift | 20:32 | |
| *** esker has joined #openstack-swift | 20:37 | |
| *** mariusv_ has joined #openstack-swift | 20:39 | |
| *** gyee has quit IRC | 20:40 | |
| *** dmorita has joined #openstack-swift | 20:41 | |
| *** mariusv_ has quit IRC | 20:41 | |
| gmmaha | hi, anyone running into issues with doing fresh SAIO install on Ubuntu 14.04 | 20:43 |
| gmmaha | ? | 20:43 |
| gmmaha | Me and another colleague are running into two different issues.. setup.py is failing with error in setup command: Invalid environment marker: (python_version>='3.0') | 20:43 |
| gmmaha | tox fails with ValueError: ("Expected ',' or end-of-list in", "dnspython>=1.12.0;python_version<'3.0'", 'at', ";python_version<'3.0'") | 20:44 |
| *** yarkot has quit IRC | 20:49 | |
| Zyric | gmmaha: Yes, I ran into that too. If I recall correctly it's a pip version issue. I ended up removing the "python_version" parts for the 2.7 line I think. http://stackoverflow.com/questions/33723149/error-during-swift-standalone-install-error-in-setup-command-invalid-environme | 20:49 |
| *** esker has quit IRC | 20:49 | |
| gmmaha | Zyric: yeah thats what folks heere also did to get past it.. was wondering if at all we can do something fancy with the requiremtents/tox.ini file to make it work :) | 20:50 |
| Zyric | gmmaha: Good call. Be nice to have a real solution for it especially since it seems to be more common than I thought. | 20:52 |
| gmmaha | Zyric: agreed.. let me see what i can fine | 20:54 |
| notmyname | yeah, it's a combination of setuptools, pbr, and maybe pip | 20:55 |
| notmyname | basically, update everything and it should work | 20:55 |
| notmyname | (yes I know that's a terrible answer, aside from "it works") | 20:55 |
| gmmaha | notmyname: yup, that seems to work. along with installing the dev package for python3 and python2.7 | 20:56 |
| gmmaha | should we add this to the SAIO setup page for new comers? | 20:56 |
| *** pdardeau has quit IRC | 20:56 | |
| notmyname | probably ;-) | 20:57 |
| gmmaha | didnt see this until now as i was happy using fedora.. was testing it out for a colleague and ran into this | 20:57 |
| hrou | Actually gmmaha, I'd add the steps regarding how to upgrade, that is usually a pain wit pip / setuptools as there's already an OS installed version (that's generally much older, what 14.04 ships with), so I think having those steps is useful | 20:58 |
| *** pdardeau- has joined #openstack-swift | 20:58 | |
| gmmaha | hrou: yeah thats definitely useful | 20:59 |
| *** petertr7_away is now known as petertr7 | 21:00 | |
| notmyname | CaioBrentano: I was just asked (via email) if globo could be featured on the openstack foundation's superuser site. is there some contact I can connect you with? | 21:00 |
| notmyname | or someone there? | 21:00 |
| hrou | gmmaha, another FYI is you may find even after upgrading TOX will not work, you generally need to upgrade virtualenv for this, something like pip install --upgrade virtualenv. Something else to add to that doc :) | 21:01 |
| gmmaha | hrou: the list that i upgraded was this sudo pip install -U pip tox pbr virtualenv setuptools | 21:01 |
| *** jlvillal has joined #openstack-swift | 21:01 | |
| gmmaha | with that and the python3-dev package, things are now working just fine | 21:01 |
| gmmaha | sorry its libpython3.4-dev | 21:02 |
| *** thumpba has quit IRC | 21:02 | |
| hrou | gmmaha, that's great; Yea I mean generally these don't change, but over the next little while it'll probably be important for any new dev starting with ubunut 14.04 or the like | 21:02 |
| hrou | i.e. great idea to document | 21:02 |
| gmmaha | hrou: definitely.. given that atleast 3 of us have seen this, its probably fair to put a tiny note | 21:04 |
| hrou | gmmaha, oh its way more than 3 :) Maybe you could add it to this: http://docs.openstack.org/developer/swift/first_contribution_swift.html | 21:05 |
| gmmaha | hrou: should it go into that page or http://docs.openstack.org/developer/swift/development_saio.html? | 21:06 |
| hrou | gmmaha, yea not too sure; Could add it to the "debugging issues" section; Mind you that first contribution page does talk about things like rebasing and the like so it is somewhat fitting. | 21:08 |
| notmyname | tsg: did you find anything? | 21:09 |
| tsg | notmyname, sorry had to step out for a meeting - looking again now | 21:10 |
| tsg | notmyname, this is in a trusty env with no liberasurecode installed? | 21:10 |
| notmyname | I believe there is no liberasurecode installed in the tox environment | 21:11 |
| tsg | notmyname: not in the tox env, on the system | 21:13 |
| gmmaha | hrou: thats true. Let me add it to the first contribution page and see if fits ok | 21:13 |
| notmyname | tsg: it's on the system | 21:14 |
| tsg | notmyname, if it is not installed, versions as of 1.1.2 install liberasurecode prior to installing pyeclib | 21:14 |
| notmyname | tsg: this is precise, but I can try trusty too | 21:14 |
| tsg | notmyname, ok - trying to reproduce now on trusty | 21:14 |
| tsg | notmyname, can you reproduce it with default "tox -e py27" run? | 21:14 |
| *** lcurtis has joined #openstack-swift | 21:15 | |
| notmyname | tsg: yup. repro there too | 21:16 |
| *** diazjf has quit IRC | 21:18 | |
| *** ianbrown__ has quit IRC | 21:19 | |
| *** diazjf has joined #openstack-swift | 21:20 | |
| tsg | notmyname, I am not able to reproduce with liberasurecode-dev installed at the system level - let me try launching another clean precise instance | 21:21 |
| notmyname | ok | 21:22 |
| *** ianbrown has joined #openstack-swift | 21:23 | |
| *** cdelatte has quit IRC | 21:23 | |
| *** yarkot has joined #openstack-swift | 21:24 | |
| tsg | notmyname, can you please post your log? | 21:26 |
| *** ianbrown has quit IRC | 21:27 | |
| *** ianbrown has joined #openstack-swift | 21:28 | |
| pdardeau- | anyone know Scott Simpson's nick? | 21:28 |
| notmyname | ssimpson | 21:28 |
| pdardeau- | notmyname: thx | 21:29 |
| notmyname | pdardeau-: or just bug dfg redbo and glange. they probably all sit within a few feet of him ;-) | 21:29 |
| pdardeau- | notmyname: thanks for tidbit! | 21:30 |
| glange | scott's out of the office for a while, not sure how long | 21:31 |
| glange | pdardeau-: is there anything you need help with? | 21:32 |
| pdardeau- | glange: thx for heads up. i'll post my question in case others know - any background on wanting to increase max number devices in ring? | 21:32 |
| notmyname | pdardeau-: torgomatic has thoughts, I think | 21:33 |
| notmyname | he's standing at my desk instead of sitting at his own though | 21:33 |
| *** ianbrown_ has joined #openstack-swift | 21:33 | |
| *** petertr7 is now known as petertr7_away | 21:33 | |
| *** ianbrown has quit IRC | 21:34 | |
| *** petertr7_away is now known as petertr7 | 21:34 | |
| notmyname | tsg: I think I have it working | 21:36 |
| tsg | notmyname, :-) what did you have to do to get it working (I will include in my upcoming update to docs) | 21:37 |
| notmyname | so I hadn't installed liberasurecode[-dev] with apt. I only had the older version that had been installed with pyeclib. I installed it with apt and things seem to work now | 21:37 |
| torgomatic | pdardeau-: if it were me doing things, I'd just be a lazy bum and go from arrays of unsigned 16-bit ints to arrays of unsigned 32-bit ints, but that would more-or-less double the memory usage for Ring objects, and they're already big | 21:38 |
| torgomatic | I mean, that wouldn't stop me from being a lazy bum about it, but it might make me feel guilty | 21:38 |
| tsg | notmyname, ok - if your older liberasurecode version was 1.0.7 or newer, it should still have worked - perhaps just an ldconfig issue | 21:40 |
| notmyname | yeah, that's what I think. pathing issues rather than code issues | 21:40 |
| notmyname | tsg: thanks for looking, though | 21:40 |
| tsg | notmyname, np - I wasn't able to repro in precise but got notes together for doc update which is good | 21:41 |
| notmyname | good | 21:41 |
| *** ianbrown has joined #openstack-swift | 21:41 | |
| tsg | notmyname, hoping Kevin will get to the pyeclib 1.2.0 reviews today and we can release so the doc/requirement updates can go up | 21:42 |
| notmyname | great | 21:42 |
| pdardeau- | torgomatic: thx. i'm wondering more about the situation of needing more than 64k devices | 21:43 |
| notmyname | mattoliverau: hurricanerix: the testr patch is now also spewing a lot of logging info (instead of just the test name). have you seen that in your runs? is it something with the os_testr thing? | 21:43 |
| notmyname | pdardeau-: I've been part of some conversations about potential clusters that would need more than 64k devices. | 21:44 |
| notmyname | granted, I think there will be several other problems to solve well before we hit a limit on the number of individually addressable storage volumes | 21:44 |
| notmyname | but still, saying "no limit" is better than saying "no limit. ok well maybe there is a limit but it's big and you probably won't hit it and we'll work around it before you get there" | 21:45 |
| notmyname | pdardeau-: I did some back of napkin math on the 64k limit though | 21:46 |
| notmyname | with 65535 8TB drives and 3 replicas, you're at around 174PB of usable storage | 21:46 |
| pdardeau- | notmyname: good stuff! any ideas on how many object server nodes there would be for that number of drives? | 21:47 |
| glange | is part of the problem that if you remove a device from a ring, there is a record of it still in the ring? | 21:47 |
| notmyname | depends how many drive bays per U you have ;-) | 21:47 |
| glange | there are 90 drive jbods out there | 21:48 |
| notmyname | glange: maybe. even if you had 2**15 drives, that's in the neighborhood of 80-90PB per storage policy | 21:48 |
| openstackgerrit | Ganesh Maharaj Mahalingam proposed openstack/swift: Modify functional tests to use testr https://review.openstack.org/214206 | 21:48 |
| openstackgerrit | Ganesh Maharaj Mahalingam proposed openstack/swift: Update SAIO setup for Ubuntu 14.04 https://review.openstack.org/254970 | 21:48 |
| notmyname | which I can imagine some clusters getting close to these days ;-) | 21:48 |
| gmmaha | notmyname: didnt see the log spew.. let me try and run that again on my setup | 21:48 |
| ahale | oh the 64k thing, im worried about that | 21:49 |
| notmyname | and of course, that's with 1 drive = 1 volume. you could raid strip a couple of drives too | 21:49 |
| *** cdelatte has joined #openstack-swift | 21:49 | |
| notmyname | ahale: getting close on a few clusters? | 21:49 |
| pdardeau- | notmyname: glange: is there a rule of thumb for ratio of devices per server? notwithstanding number of drive bays in chassis? ;-) | 21:49 |
| ahale | maybe, i was doing some testing but its super slow | 21:50 |
| openstackgerrit | Ganesh Maharaj Mahalingam proposed openstack/swift: Update SAIO setup for Ubuntu 14.04 https://review.openstack.org/254970 | 21:50 |
| notmyname | pdardeau-: no. common deployment options are 12-bay, 24-bay, 32, 45, 60, 84 | 21:52 |
| gmmaha | notmyname: for patch 214206 the log spew is the test name and the result? or are you seeing something else? | 21:52 |
| patchbot | gmmaha: https://review.openstack.org/#/c/214206/ - Modify functional tests to use testr | 21:52 |
| notmyname | pdardeau-: well, common ones would be 12, 24, and 60, probably | 21:53 |
| ahale | i wanted to add 40k devices, delete 20k, add 20k, delete 20k. see what happens. if the null dev id's are a problem then im more worried :) | 21:53 |
| notmyname | pdardeau-: but what does the number of server nodes matter? changing the dev_id field is independent of that | 21:54 |
| notmyname | I mean, it matters. just not for this problem | 21:54 |
| pdardeau- | notmyname: just wondering | 21:55 |
| pdardeau- | notmyname: trying to get a mental picture of what such a cluster would look like | 21:55 |
| pdardeau- | my god, it's full of spinning platters! | 21:55 |
| notmyname | like this http://www.extremetech.com/wp-content/uploads/2013/12/Google-Datacenter.jpg | 21:56 |
| notmyname | not like this http://farm3.static.flickr.com/2277/2180039413_f54b142ff4_o.jpg | 21:57 |
| pdardeau- | that must be one of those guiness book of world records things, or something | 21:58 |
| openstackgerrit | Ganesh Maharaj Mahalingam proposed openstack/swift: Update SAIO setup for Ubuntu 14.04 https://review.openstack.org/254970 | 22:04 |
| *** insanidade has quit IRC | 22:05 | |
| notmyname | gmmaha: run the testr patch wtih SWIFT_TEST_IN_PROCESS=true SWIFT_TEST_IN_PROCESS_CONF_DIR=/tmp tox -efunc | 22:06 |
| *** david-ly_ has joined #openstack-swift | 22:10 | |
| * gmmaha goes to try that | 22:11 | |
| *** CaioBrentano has quit IRC | 22:12 | |
| *** david-lyle has quit IRC | 22:13 | |
| *** david-ly_ is now known as david-lyle | 22:13 | |
| gmmaha | notmyname: by mistake i rebased patch 214206 and there is now a new version. Is there a recommended way to fix this or is it ok to let it be and Me make sure i dont do it again | 22:16 |
| patchbot | gmmaha: https://review.openstack.org/#/c/214206/ - Modify functional tests to use testr | 22:16 |
| notmyname | gmmaha: are you seeing the log spew too? | 22:18 |
| gmmaha | notmyname: no sir.. just saw the test starting and now its all test_case ... result | 22:18 |
| jlvillal | notmyname, log spew is a good thing :) If you mean os-testr prints out lots of output. | 22:18 |
| notmyname | hmm | 22:18 |
| gmmaha | do i have to make sure that swift isnt running and move the conf? I believe the vars you gave me took care of that | 22:18 |
| jlvillal | notmyname, that is a change from testr. Happened to us in Ironic. | 22:18 |
| jlvillal | Useful for when there are errors to debug them. | 22:19 |
| gmmaha | notmyname: was the spew at the start of the test or the end summary? | 22:19 |
| *** diazjf has quit IRC | 22:19 | |
| notmyname | during | 22:20 |
| notmyname | here's an example of output for one test(!) | 22:20 |
| notmyname | https://gist.github.com/notmyname/432c1a4c072411b0bc6d | 22:20 |
| gmmaha | ohh i did not see that | 22:21 |
| gmmaha | let me try and shutdown swift and check | 22:21 |
| notmyname | jlvillal: it's too much to be useful for debugging | 22:21 |
| notmyname | gmmaha: yeah. you don't actually need swift running at all. | 22:21 |
| notmyname | gmmaha: since the in-process tests do it...in-process :-) | 22:21 |
| jlvillal | notmyname, By spew I thought you meant each test is printed if pass/fail | 22:21 |
| notmyname | jlvillal: I'm fine with that :-) | 22:22 |
| notmyname | but 100 extra log lines per test? nope | 22:22 |
| gmmaha | Ok. yeah its spitting it now | 22:22 |
| jlvillal | notmyname, mtreinish is the expert on os-testr | 22:22 |
| jlvillal | He may know why so many extra lines of output | 22:22 |
| gmmaha | :) i thought the IN_PROCESS will make sure that test doesnt check if its running.. | 22:22 |
| mtreinish | jlvillal: I know nothing :) | 22:23 |
| jlvillal | mtreinish, Liar! :P | 22:23 |
| notmyname | seems like it's a change with os-testr that is no doing the same log/output capturing | 22:23 |
| notmyname | does os-testr capture stderr/stdout? | 22:23 |
| mtreinish | jlvillal: do you have an example for me to look at | 22:24 |
| notmyname | see the gist above | 22:24 |
| mtreinish | notmyname: you need to have a fixture collect stdout and attach it to the subunit stream | 22:24 |
| mtreinish | notmyname: most openstack projects back that into the base test class | 22:24 |
| jlvillal | mtreinish, This patch: https://review.openstack.org/#/c/214206/ | 22:24 |
| jlvillal | And gist above | 22:24 |
| mtreinish | notmyname: if you don't do that the stdout will just passthrough | 22:25 |
| notmyname | a monad is just a moniod in the category of endofunctors. what's the problem? | 22:25 |
| notmyname | so what's a subunit stream fixture? | 22:25 |
| notmyname | an earlier patch set was using testr but not os-testr and this wasn't happening. | 22:26 |
| mtreinish | notmyname: https://github.com/openstack/nova/blob/master/nova/test.py#L177-L187 is an example of how nova does it | 22:27 |
| *** dustins is now known as dustins|gone | 22:27 | |
| jlvillal | mtreinish, notmyname: Something like this? https://github.com/openstack/ironic/blob/master/ironic/tests/base.py#L90-L97 | 22:27 |
| mtreinish | jlvillal: yeah that's a good example too | 22:28 |
| gmmaha | notmyname: also if you run swift on the machine and run tox -efunc there is no log spew.. | 22:30 |
| gmmaha | just when we use the SWIFT_IN_PROCESS flags | 22:30 |
| notmyname | gmmaha: right! but that's because the servers are set up and doing the normal syslog logging | 22:30 |
| *** changbl has quit IRC | 22:31 | |
| gmmaha | ok.. yeah, thats what i thought | 22:31 |
| notmyname | so in this case, they're set up to run in the test process and the logging isn't set up | 22:31 |
| notmyname | unfortunately, that's how the gate job runs. the in-process way. | 22:31 |
| jlvillal | mtreinish, As a note this is 'functional' testing if that makes any difference. | 22:31 |
| gmmaha | aah | 22:31 |
| notmyname | so I don't know if this affects that or not | 22:31 |
| gmmaha | let me try and add the log capturing into it | 22:31 |
| notmyname | ok, thanks | 22:31 |
| mtreinish | jlvillal: I don't think that makes a difference :) | 22:32 |
| *** jordanP has quit IRC | 22:35 | |
| *** yarkot has quit IRC | 22:39 | |
| *** petertr7 is now known as petertr7_away | 22:40 | |
| *** ianbrown_ has quit IRC | 22:55 | |
| *** klrmn has quit IRC | 22:56 | |
| *** ianbrown_ has joined #openstack-swift | 22:57 | |
| *** klrmn1 has quit IRC | 22:57 | |
| *** klrmn has joined #openstack-swift | 22:58 | |
| *** ianbrown has quit IRC | 23:02 | |
| openstackgerrit | Catherine Northcott proposed openstack/swift: Add support for storage policies to have more than one name https://review.openstack.org/241978 | 23:06 |
| *** km has joined #openstack-swift | 23:06 | |
| *** km is now known as Guest52814 | 23:06 | |
| *** chlong has quit IRC | 23:10 | |
| *** badari_ has joined #openstack-swift | 23:11 | |
| *** badari has quit IRC | 23:13 | |
| *** ho has joined #openstack-swift | 23:17 | |
| ho | good morning! | 23:20 |
| Zyric | Good morning ho | 23:20 |
| ho | Zyric: thanks! | 23:21 |
| *** blmartin has quit IRC | 23:21 | |
| notmyname | gmmaha: any luck with supressing all the logging? | 23:29 |
| *** kei_yama has joined #openstack-swift | 23:32 | |
| gmmaha | notmyname: somehow i managed to completely destroy my swift setup.. | 23:32 |
| gmmaha | just revived it and workign on the patch now | 23:32 |
| notmyname | lol | 23:32 |
| gmmaha | the small change i did isnt working | 23:32 |
| gmmaha | will keep cehcking | 23:32 |
| notmyname | ok | 23:33 |
| *** eranrom has quit IRC | 23:33 | |
| *** eranrom has joined #openstack-swift | 23:33 | |
| notmyname | gmmaha: just left a comment there with what I saw | 23:37 |
| gmmaha | notmyname: cool. my tests still arent working.. Will keep trying and drop an update here if i am completely stuck | 23:38 |
| notmyname | ok | 23:38 |
| notmyname | thanks | 23:38 |
| mattoliverau | ho: morning | 23:43 |
| *** sgundur has joined #openstack-swift | 23:43 | |
| ho | mattoliverau: morning! | 23:44 |
| *** jerrygb has quit IRC | 23:55 | |
| *** jerrygb has joined #openstack-swift | 23:56 | |
| *** dewsday has joined #openstack-swift | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
