Tuesday, 2014-07-15

*** kevinc_ has quit IRC00:08
*** mwstorer has quit IRC00:33
openstackgerritpaul luse proposed a change to openstack/swift: Early framework for the EC Reconstructor  https://review.openstack.org/10691000:35
*** mdonohoe has joined #openstack-swift00:37
*** markd has quit IRC00:39
*** shri has quit IRC00:43
openstackgerritpaul luse proposed a change to openstack/swift: Early framework for the EC Reconstructor  https://review.openstack.org/10691000:46
*** nosnos has quit IRC01:13
yuanHi, is it able to specify the number of replicas for one region? e.g. I have 4 replicas and 2 region, can i have 3 replicas stored in region 1 ?01:14
peluse_yuan:  you'll want to read up on Storage Policies introduced in Swift 2.0 at http://docs.openstack.org/developer/swift/overview_policies.html  I will be offline for the rest of the night and a lot of tomorrow but there should be lots of folks that can help answer questions01:29
yuanpeluse_: hmm, I'm afraid we cant do this with storage policy. Using new policies means we could store the different objects with different number of replicas, but what i need is to do is to config the replicas at region level, in this case it's the same object and the same container.01:42
*** tsg has quit IRC01:58
*** chandankumar has joined #openstack-swift02:00
*** bkopilov has joined #openstack-swift02:25
*** chandankumar has quit IRC02:30
*** tsg has joined #openstack-swift02:40
*** openstackgerrit has quit IRC02:42
*** miqui has quit IRC02:42
*** bsdkurt has quit IRC02:42
*** dencaval has quit IRC02:42
*** dencaval has joined #openstack-swift02:42
*** bsdkurt has joined #openstack-swift02:42
*** miqui has joined #openstack-swift02:42
*** openstackgerrit has joined #openstack-swift02:43
*** tsg has quit IRC02:53
*** tsg has joined #openstack-swift02:53
*** tsg has joined #openstack-swift02:54
*** tsg has quit IRC03:04
*** tsg has joined #openstack-swift03:05
*** tsg has quit IRC03:12
*** bsdkurt has quit IRC03:12
*** mariusv has quit IRC03:12
*** charz has quit IRC03:12
*** ctennis has quit IRC03:12
*** zul has quit IRC03:12
*** peluse_ has quit IRC03:12
*** madhuri has quit IRC03:12
*** Shivani has quit IRC03:12
*** openstackgerrit has quit IRC03:12
*** Dafna has quit IRC03:12
*** otoolee has quit IRC03:12
*** rpedde has quit IRC03:12
*** cschwede has quit IRC03:12
*** swat30 has quit IRC03:12
*** acoles_away has quit IRC03:12
*** sandywalsh has quit IRC03:12
*** denca has quit IRC03:12
*** Tyger has quit IRC03:12
*** patchbot has quit IRC03:12
*** anticw_ has quit IRC03:12
*** fleducquede_ has quit IRC03:12
*** Mikalv has quit IRC03:12
*** ekarlso has quit IRC03:12
*** dfg has quit IRC03:12
*** jokke_ has quit IRC03:12
*** mkerrin has quit IRC03:12
*** JelleB has quit IRC03:12
*** redbo has quit IRC03:12
*** thurloat has quit IRC03:12
*** mdonohoe has quit IRC03:12
*** ryao has quit IRC03:12
*** mtreinish has quit IRC03:12
*** zigo has quit IRC03:12
*** MooingLemur has quit IRC03:12
*** openfly has quit IRC03:12
*** bobby_ has quit IRC03:12
*** bgmccollum has quit IRC03:12
*** pandemicsyn has quit IRC03:12
*** nottrobin has quit IRC03:12
*** StevenK has quit IRC03:12
*** zacksh has quit IRC03:12
*** mhu has quit IRC03:12
*** wkelly has quit IRC03:12
*** ahale has quit IRC03:12
*** scotticus has quit IRC03:12
*** creiht has quit IRC03:12
*** amandap has quit IRC03:12
*** zackmdavis has quit IRC03:12
*** notmyname has quit IRC03:12
*** CybergeekDK has quit IRC03:12
*** sudorandom has quit IRC03:12
*** gholt has quit IRC03:12
*** ujjain has quit IRC03:12
*** AbyssOne has quit IRC03:12
*** tanee2 has quit IRC03:12
*** ondergetekende_ has quit IRC03:12
*** infotection has quit IRC03:12
*** joearnold has quit IRC03:12
*** BobBall has quit IRC03:12
*** ciypro|afk has quit IRC03:12
*** ChanServ has quit IRC03:12
*** dosaboy_ has joined #openstack-swift03:17
*** dosaboy has quit IRC03:18
*** openstackgerrit has joined #openstack-swift03:20
*** bsdkurt has joined #openstack-swift03:20
*** mdonohoe has joined #openstack-swift03:20
*** BobBall has joined #openstack-swift03:20
*** ryao has joined #openstack-swift03:20
*** denca has joined #openstack-swift03:20
*** madhuri has joined #openstack-swift03:20
*** Dafna has joined #openstack-swift03:20
*** Shivani has joined #openstack-swift03:20
*** sudorandom has joined #openstack-swift03:20
*** Tyger has joined #openstack-swift03:20
*** patchbot has joined #openstack-swift03:20
*** gholt has joined #openstack-swift03:20
*** ekarlso has joined #openstack-swift03:20
*** mariusv has joined #openstack-swift03:20
*** anticw_ has joined #openstack-swift03:20
*** mtreinish has joined #openstack-swift03:20
*** dfg has joined #openstack-swift03:20
*** fleducquede_ has joined #openstack-swift03:20
*** charz has joined #openstack-swift03:20
*** jokke_ has joined #openstack-swift03:20
*** otoolee has joined #openstack-swift03:20
*** zigo has joined #openstack-swift03:20
*** rpedde has joined #openstack-swift03:20
*** sandywalsh has joined #openstack-swift03:20
*** acoles_away has joined #openstack-swift03:20
*** swat30 has joined #openstack-swift03:20
*** cschwede has joined #openstack-swift03:20
*** Mikalv has joined #openstack-swift03:20
*** thurloat has joined #openstack-swift03:20
*** redbo has joined #openstack-swift03:20
*** dickson.freenode.net sets mode: +vvvv gholt dfg acoles_away redbo03:20
*** JelleB has joined #openstack-swift03:20
*** mkerrin has joined #openstack-swift03:20
*** StevenK has joined #openstack-swift03:20
*** nottrobin has joined #openstack-swift03:20
*** pandemicsyn has joined #openstack-swift03:20
*** bgmccollum has joined #openstack-swift03:20
*** openfly has joined #openstack-swift03:20
*** bobby_ has joined #openstack-swift03:20
*** MooingLemur has joined #openstack-swift03:20
*** CybergeekDK has joined #openstack-swift03:20
*** notmyname has joined #openstack-swift03:20
*** zackmdavis has joined #openstack-swift03:20
*** amandap has joined #openstack-swift03:20
*** creiht has joined #openstack-swift03:20
*** dickson.freenode.net sets mode: +vv notmyname creiht03:20
*** scotticus has joined #openstack-swift03:20
*** ahale has joined #openstack-swift03:20
*** wkelly has joined #openstack-swift03:20
*** mhu has joined #openstack-swift03:20
*** zacksh has joined #openstack-swift03:20
*** ciypro|afk has joined #openstack-swift03:20
*** joearnold has joined #openstack-swift03:20
*** infotection has joined #openstack-swift03:20
*** ondergetekende_ has joined #openstack-swift03:20
*** tanee2 has joined #openstack-swift03:20
*** AbyssOne has joined #openstack-swift03:20
*** ujjain has joined #openstack-swift03:20
*** ctennis has joined #openstack-swift03:20
*** zul has joined #openstack-swift03:20
*** peluse_ has joined #openstack-swift03:20
*** tsg has joined #openstack-swift03:22
*** ChanServ has joined #openstack-swift03:23
*** dickson.freenode.net sets mode: +o ChanServ03:23
*** chandankumar has joined #openstack-swift03:36
*** kopparam has joined #openstack-swift03:47
*** kopparam has quit IRC03:50
*** kopparam has joined #openstack-swift03:51
*** bkopilov has quit IRC03:59
*** bkopilov has joined #openstack-swift03:59
*** nosnos has joined #openstack-swift04:01
*** chandankumar has quit IRC04:05
*** k4n0 has joined #openstack-swift04:27
*** yliu has joined #openstack-swift04:34
*** tsg has quit IRC04:45
*** ppai has joined #openstack-swift04:58
*** chandankumar has joined #openstack-swift04:59
*** psharma has joined #openstack-swift05:08
*** kopparam has quit IRC05:10
*** kopparam has joined #openstack-swift05:10
*** kopparam has quit IRC05:11
*** kopparam has joined #openstack-swift05:11
hugokuomorning ~05:14
*** zaitcev has quit IRC05:22
*** wer has quit IRC05:27
*** wer has joined #openstack-swift05:28
*** anand_ts has joined #openstack-swift05:35
anand_tshello all, how can I upload a file in to a pseudo folder using command line?05:36
hugokuoanand_ts: what's pseudo folder mean ?05:38
anand_tsI created a container and inside that container I created a folder, Horizon says it is a pseudo folder05:40
hugokuoanand_ts: ah ok... I understand now05:41
hugokuoanand_ts: are you going to upload a file via swift CLI ?05:41
anand_tshugokuo: yes. I want to upload a file using swift cli05:41
anand_tshugokuo: but file should be moved to a folder inside container05:42
hugokuoanand_ts: The simplest way : 1. Create a folder locally 2. put the file into the folder. 3. swift upload $container $folder_name05:44
hugokuodone ......... perfect !05:44
*** bkopilov has quit IRC05:44
anand_tshugokuo: That works perfect :) Also If I want to delete a pseudo folder through dashboard it says Error: You are not allowed to delete object: test05:45
hugokuoanand_ts: it's odd tho. You should able to delete it via CLI05:47
hugokuoanand_ts: prolly a bug on Horizan05:47
anand_tshugokuo: I can delete entire container via, but not a specific pseudo folder I guess05:47
hugokuoanand_ts: I do not use Horizon tho. Here's my output of the operation with Swift CLI http://paste.openstack.org/show/86507/05:50
anand_tshugokuo: Thank you. let me try that05:51
hugokuoThe pseudo folder just another object. You can delete any object as your will anytime05:51
mattoliverauanand_ts: a pseudo folder is confusing because it is really just a prefix to the object name, according to the documentation: http://docs.openstack.org/api/openstack-object-storage/1.0/content/folders-directories.html05:56
mattoliverauSo you should be able to just specify the path (directory) as part of the object name in the path.05:58
anand_tsmattoliverau: yes it works,I forgot to give exact path earlier.06:01
mattoliverau:)06:01
*** ppai has quit IRC06:16
*** ppai has joined #openstack-swift06:31
*** nosnos has quit IRC06:32
anand_tsmattoliverau: Is it possible to customize horizon such that only object store panel should only be available. there is no image, volume, instance overview should be there in horizon dashboard.06:46
*** kopparam has quit IRC06:47
*** kopparam has joined #openstack-swift06:48
*** Dev_Jin has joined #openstack-swift06:59
*** anticw_ has quit IRC06:59
Dev_JinI want to access swift storage with non admin tenant.. can I do that? I am unable to find anything on how to do it? I can access it with admin user07:00
*** anticw has joined #openstack-swift07:00
*** kopparam has quit IRC07:01
*** mmcardle has joined #openstack-swift07:07
anand_tsDev_Jin: edit your /etc/swift/proxy-server.conf file. set your non-admin tenant user role here in operator_rules like this http://paste.openstack.org/show/86513/07:14
*** madhuri has quit IRC07:19
Dev_Jinthanks anand_ts.. I created a new role swiftoperator and associated it with my required tenant. this way I can get more granular control on which of the tenants can access swift store07:19
anand_tsDev_Jin: Okay.07:21
*** bkopilov has joined #openstack-swift07:23
*** foexle has joined #openstack-swift07:30
*** ppai has quit IRC07:52
*** omame has joined #openstack-swift08:01
*** bvandenh has joined #openstack-swift08:02
*** kopparam has joined #openstack-swift08:03
*** nacim has joined #openstack-swift08:04
*** kopparam has quit IRC08:08
mattoliverauMorning all08:17
ahalemorning08:18
*** kopparam has joined #openstack-swift08:24
omamegood afternoon08:24
*** acoles_away is now known as acoles08:25
*** bvandenh has quit IRC08:33
*** Dev_Jin has quit IRC08:33
*** bvandenh has joined #openstack-swift08:46
*** ppai has joined #openstack-swift08:51
openstackgerritMatthew Oliver proposed a change to openstack/swift: Add object-server partial write prevention tests  https://review.openstack.org/10174309:26
*** bszabo has joined #openstack-swift09:30
*** ChanServ has quit IRC09:55
*** anticw has quit IRC09:55
*** bkopilov has quit IRC09:55
*** yliu has quit IRC09:55
*** k4n0 has quit IRC09:55
*** bsdkurt has quit IRC09:55
*** mariusv has quit IRC09:55
*** charz has quit IRC09:55
*** ctennis has quit IRC09:55
*** zul has quit IRC09:55
*** peluse_ has quit IRC09:55
*** anand_ts has quit IRC09:56
*** Shivani has quit IRC09:56
*** ppai has quit IRC09:56
*** openstackgerrit has quit IRC09:56
*** Dafna has quit IRC09:56
*** otoolee has quit IRC09:56
*** rpedde has quit IRC09:56
*** cschwede has quit IRC09:56
*** swat30 has quit IRC09:56
*** acoles has quit IRC09:56
*** sandywalsh has quit IRC09:56
*** bvandenh has quit IRC09:56
*** denca has quit IRC09:56
*** Tyger has quit IRC09:56
*** patchbot has quit IRC09:56
*** fleducquede_ has quit IRC09:56
*** Mikalv has quit IRC09:56
*** ekarlso has quit IRC09:56
*** dfg has quit IRC09:56
*** jokke_ has quit IRC09:56
*** mkerrin has quit IRC09:56
*** JelleB has quit IRC09:56
*** redbo has quit IRC09:56
*** thurloat has quit IRC09:56
*** mdonohoe has quit IRC09:56
*** ryao has quit IRC09:56
*** mtreinish has quit IRC09:56
*** zigo has quit IRC09:56
*** MooingLemur has quit IRC09:56
*** openfly has quit IRC09:56
*** bobby_ has quit IRC09:56
*** bgmccollum has quit IRC09:56
*** pandemicsyn has quit IRC09:56
*** nottrobin has quit IRC09:56
*** StevenK has quit IRC09:56
*** zacksh has quit IRC09:56
*** mhu has quit IRC09:56
*** wkelly has quit IRC09:56
*** ahale has quit IRC09:56
*** scotticus has quit IRC09:56
*** creiht has quit IRC09:56
*** amandap has quit IRC09:56
*** zackmdavis has quit IRC09:56
*** notmyname has quit IRC09:56
*** CybergeekDK has quit IRC09:56
*** bszabo has quit IRC09:56
*** psharma has quit IRC09:56
*** sudorandom has quit IRC09:56
*** gholt has quit IRC09:56
*** ujjain has quit IRC09:56
*** AbyssOne has quit IRC09:56
*** tanee2 has quit IRC09:56
*** ondergetekende_ has quit IRC09:56
*** infotection has quit IRC09:56
*** joearnold has quit IRC09:56
*** BobBall has quit IRC09:56
*** ciypro|afk has quit IRC09:56
*** omame has quit IRC09:56
*** mmcardle has quit IRC09:56
*** dosaboy_ has quit IRC09:56
*** IRTermite has quit IRC09:56
*** pconstantine has quit IRC09:56
*** haomaiw__ has quit IRC09:56
*** clayg has quit IRC09:56
*** kopparam has quit IRC09:56
*** foexle has quit IRC09:56
*** dencaval has quit IRC09:56
*** Anticimex has quit IRC09:56
*** zhiyan has quit IRC09:56
*** TaiSHi has quit IRC09:56
*** hugokuo has quit IRC09:56
*** Alex_Gaynor has quit IRC09:56
*** serverascode has quit IRC09:56
*** jroll has quit IRC09:56
*** goodes has quit IRC09:56
*** sileht has quit IRC09:56
*** esmute has quit IRC09:56
*** acorwin has quit IRC09:56
*** d0ugal has quit IRC09:56
*** otherjon has quit IRC09:56
*** kragniz_ has quit IRC09:56
*** Dieterbe has quit IRC09:56
*** JoshNang has quit IRC09:56
*** chandankumar has quit IRC09:56
*** miqui has quit IRC09:56
*** lpabon has quit IRC09:56
*** annegentle has quit IRC09:56
*** wer has quit IRC09:56
*** occupant has quit IRC09:56
*** jd__ has quit IRC09:56
*** chmouel has quit IRC09:56
*** anderstj has quit IRC09:56
*** alpha_ori has quit IRC09:56
*** byeagerz_away has quit IRC09:56
*** jeblair has quit IRC09:56
*** j_king has quit IRC09:56
*** torgomatic has quit IRC09:56
*** hurricanerix has quit IRC09:56
*** portante has quit IRC09:56
*** briancline has quit IRC09:56
*** JoshNang has joined #openstack-swift10:03
*** Dieterbe has joined #openstack-swift10:03
*** kragniz_ has joined #openstack-swift10:03
*** otherjon has joined #openstack-swift10:03
*** d0ugal has joined #openstack-swift10:03
*** acorwin has joined #openstack-swift10:03
*** esmute has joined #openstack-swift10:03
*** sileht has joined #openstack-swift10:03
*** goodes has joined #openstack-swift10:03
*** jroll has joined #openstack-swift10:03
*** Alex_Gaynor has joined #openstack-swift10:03
*** serverascode has joined #openstack-swift10:03
*** hugokuo has joined #openstack-swift10:03
*** TaiSHi has joined #openstack-swift10:03
*** zhiyan has joined #openstack-swift10:03
*** Anticimex has joined #openstack-swift10:03
*** dencaval has joined #openstack-swift10:03
*** foexle has joined #openstack-swift10:03
*** kopparam has joined #openstack-swift10:03
*** clayg has joined #openstack-swift10:03
*** haomaiw__ has joined #openstack-swift10:03
*** pconstantine has joined #openstack-swift10:03
*** IRTermite has joined #openstack-swift10:03
*** dosaboy_ has joined #openstack-swift10:03
*** mmcardle has joined #openstack-swift10:03
*** omame has joined #openstack-swift10:03
*** bszabo has joined #openstack-swift10:03
*** ppai has joined #openstack-swift10:03
*** bvandenh has joined #openstack-swift10:03
*** bkopilov has joined #openstack-swift10:03
*** anticw has joined #openstack-swift10:03
*** anand_ts has joined #openstack-swift10:03
*** psharma has joined #openstack-swift10:03
*** yliu has joined #openstack-swift10:03
*** k4n0 has joined #openstack-swift10:03
*** ChanServ has joined #openstack-swift10:03
*** peluse_ has joined #openstack-swift10:03
*** zul has joined #openstack-swift10:03
*** ctennis has joined #openstack-swift10:03
*** ujjain has joined #openstack-swift10:03
*** AbyssOne has joined #openstack-swift10:03
*** tanee2 has joined #openstack-swift10:03
*** ondergetekende_ has joined #openstack-swift10:03
*** infotection has joined #openstack-swift10:03
*** joearnold has joined #openstack-swift10:03
*** ciypro|afk has joined #openstack-swift10:03
*** dickson.freenode.net sets mode: +vo clayg ChanServ10:03
*** zacksh has joined #openstack-swift10:03
*** mhu has joined #openstack-swift10:03
*** wkelly has joined #openstack-swift10:03
*** ahale has joined #openstack-swift10:03
*** scotticus has joined #openstack-swift10:03
*** creiht has joined #openstack-swift10:03
*** amandap has joined #openstack-swift10:03
*** zackmdavis has joined #openstack-swift10:03
*** notmyname has joined #openstack-swift10:03
*** CybergeekDK has joined #openstack-swift10:03
*** MooingLemur has joined #openstack-swift10:03
*** bobby_ has joined #openstack-swift10:03
*** openfly has joined #openstack-swift10:03
*** bgmccollum has joined #openstack-swift10:03
*** pandemicsyn has joined #openstack-swift10:03
*** nottrobin has joined #openstack-swift10:03
*** StevenK has joined #openstack-swift10:03
*** mkerrin has joined #openstack-swift10:03
*** JelleB has joined #openstack-swift10:03
*** redbo has joined #openstack-swift10:03
*** thurloat has joined #openstack-swift10:03
*** Mikalv has joined #openstack-swift10:03
*** cschwede has joined #openstack-swift10:03
*** swat30 has joined #openstack-swift10:03
*** acoles has joined #openstack-swift10:03
*** dickson.freenode.net sets mode: +vvvv creiht notmyname redbo acoles10:03
*** sandywalsh has joined #openstack-swift10:03
*** rpedde has joined #openstack-swift10:03
*** zigo has joined #openstack-swift10:03
*** otoolee has joined #openstack-swift10:03
*** jokke_ has joined #openstack-swift10:03
*** charz has joined #openstack-swift10:03
*** fleducquede_ has joined #openstack-swift10:03
*** dfg has joined #openstack-swift10:03
*** mtreinish has joined #openstack-swift10:03
*** mariusv has joined #openstack-swift10:03
*** ekarlso has joined #openstack-swift10:03
*** gholt has joined #openstack-swift10:03
*** patchbot has joined #openstack-swift10:03
*** Tyger has joined #openstack-swift10:03
*** sudorandom has joined #openstack-swift10:03
*** Shivani has joined #openstack-swift10:03
*** Dafna has joined #openstack-swift10:03
*** denca has joined #openstack-swift10:03
*** ryao has joined #openstack-swift10:03
*** BobBall has joined #openstack-swift10:03
*** dickson.freenode.net sets mode: +vv dfg gholt10:03
*** mdonohoe has joined #openstack-swift10:03
*** bsdkurt has joined #openstack-swift10:03
*** openstackgerrit has joined #openstack-swift10:03
*** wer has joined #openstack-swift10:03
*** occupant has joined #openstack-swift10:03
*** jd__ has joined #openstack-swift10:03
*** chmouel has joined #openstack-swift10:03
*** anderstj has joined #openstack-swift10:03
*** alpha_ori has joined #openstack-swift10:03
*** byeagerz_away has joined #openstack-swift10:03
*** jeblair has joined #openstack-swift10:03
*** j_king has joined #openstack-swift10:03
*** torgomatic has joined #openstack-swift10:03
*** hurricanerix has joined #openstack-swift10:03
*** portante has joined #openstack-swift10:03
*** briancline has joined #openstack-swift10:03
*** dickson.freenode.net sets mode: +vv torgomatic portante10:03
*** occupant has quit IRC10:04
*** occupant has joined #openstack-swift10:04
*** kopparam has quit IRC10:06
*** chandankumar has joined #openstack-swift10:08
*** miqui has joined #openstack-swift10:08
*** lpabon has joined #openstack-swift10:08
*** annegentle has joined #openstack-swift10:08
*** msahin has joined #openstack-swift10:08
msahinhi everyone10:08
msahinı enter this channel first10:09
msahinand ı ask a question openstack swift10:09
msahinI have a problem with invalid user token - rejecting request10:11
msahinif ı want to check object url on browser ı take this error10:12
msahinı make configuration step by step and ı open a question openstack forum10:12
msahinquestion link is https://ask.openstack.org/en/question/42556/invalid-user-token-rejecting-request10:12
msahincan you help me?10:13
msahingood works...10:13
*** ppai has quit IRC10:25
*** madhuri has joined #openstack-swift10:32
madhuriHi, can anyone tell me whats the use of hashes.pkl file?10:33
msahinhashes.pkl file ?10:33
madhuriyes10:34
msahinı search my system and find alot of file in /srv/*10:35
madhuriYeah, object server maintains that file10:35
msahinand ı dont understand which you say10:36
madhuriWhat's the use?10:36
msahinfor a file10:36
msahin<80>^B}q^AU^Cbc5q^BU 9ea8686625ce49552883b194ab661ac8q^Cs.10:36
msahinthis is written in that file10:37
*** ppai has joined #openstack-swift10:37
msahinwhat can ı understand tahat10:38
msahin?10:38
msahinand how can ı learn that you say10:38
msahin?10:38
madhuriThat file stores the hash directories created during object upload10:39
anand_tsmadhuri, read this http://docs.openstack.org/developer/swift/overview_replication.html . it make some sense?10:41
msahinso what can ı do now10:41
madhurianand_ts: Thanks :)10:42
anand_tsmadhuri: yw!10:44
msahinmadhuri what can ı do ?10:51
*** erlon has joined #openstack-swift10:59
*** zul has quit IRC11:00
*** ppai has quit IRC11:04
*** zul has joined #openstack-swift11:05
*** kopparam has joined #openstack-swift11:07
*** BobBall has left #openstack-swift11:12
*** k4n0 has quit IRC11:15
*** ppai has joined #openstack-swift11:19
*** openstackgerrit has quit IRC11:21
*** msahin has quit IRC11:24
*** kopparam has quit IRC11:29
*** kopparam has joined #openstack-swift11:31
*** bvandenh has quit IRC11:44
*** bszabo has quit IRC11:59
*** bvandenh has joined #openstack-swift11:59
*** ppai has quit IRC12:04
*** openstackgerrit has joined #openstack-swift12:16
*** ppai has joined #openstack-swift12:18
*** tongli has joined #openstack-swift12:25
*** kopparam has quit IRC12:28
*** kopparam has joined #openstack-swift12:29
*** kopparam has quit IRC12:33
*** bvandenh has quit IRC12:56
*** mmcardle has quit IRC12:57
*** ppai has quit IRC13:02
*** psharma has quit IRC13:15
*** mmcardle has joined #openstack-swift13:21
*** openstackgerrit has quit IRC13:31
*** 17SAAF480 has joined #openstack-swift13:31
*** 17SAAF480 has quit IRC13:38
*** openstackgerrit has joined #openstack-swift13:39
*** anand_ts has quit IRC13:41
*** jeblair has quit IRC13:50
*** jeblair has joined #openstack-swift13:51
*** bkopilov has quit IRC14:06
*** nshaikh has joined #openstack-swift14:15
*** bkopilov has joined #openstack-swift14:21
*** annegentle is now known as anneonthebus14:26
openstackgerritJulien Danjou proposed a change to openstack/python-swiftclient: Allow to retrieve response from put_container  https://review.openstack.org/8757514:34
*** bkopilov has quit IRC14:39
*** zslot has joined #openstack-swift15:05
openstackgerritAlistair Coles proposed a change to openstack/swift: Enable object system metadata on PUTs  https://review.openstack.org/7999115:10
notmynamegood morning15:10
*** chandankumar has quit IRC15:14
*** kevinc_ has joined #openstack-swift15:14
*** openstackgerrit has quit IRC15:21
*** nacim has quit IRC15:23
*** msahin_ has joined #openstack-swift15:39
*** mmcardle has quit IRC15:49
notmynameyay, the register is still snarky ;-) http://www.theregister.co.uk/2014/07/15/openstack_swift_gets_storage_policies/15:51
*** mmcardle has joined #openstack-swift15:52
*** nshaikh has quit IRC15:55
*** tongli has quit IRC15:58
*** tongli has joined #openstack-swift15:58
jokke_notmyname: :)16:04
jokke_notmyname: well how do they say, All publicity is good publicity16:04
notmynamewhich is not true, but I am glad the register is talking about swift :-)16:04
*** bkopilov has joined #openstack-swift16:05
jokke_tru ... and even admitting that it could succeed in real production ... something done right there :P16:06
*** chandankumar has joined #openstack-swift16:09
*** bvandenh has joined #openstack-swift16:16
mattoliveraugood afternoon all from a beer garden!16:16
notmynameguten tag ;-)16:17
mattoliveraunotmyname: can't please everyone (re register)16:17
notmynameheh. I think the past 4 years of swift demonstrates that we've never tried to please everyone ;-)16:18
*** mwstorer has joined #openstack-swift16:18
mattoliverauWow, I'm surrounded by German :p guten arbend notmyname16:18
mattoliverauLol16:18
torgomatichm, so how long until we can get rid of rsync entirely in favor of ssync?16:20
torgomaticI have things I want to do with object metadata, but I can't make them (a) performant after hundreds of POSTs, (b) atomic, and (c) rsyncable16:21
notmynametorgomatic: aren't you just writing all your new features for ssync and then some day someone will drop in here and ask about replication with rsync and everyone will say "wait, people still do that" ;-)16:21
torgomaticI can get the first two though :)16:21
notmynametorgomatic: if we can demonstrate that (1) ssync is at least as good as rsync, perf and scalability wise and (2) new improvements go to ssync, I think we should consider switching the default right after the juno release16:23
torgomaticnotmyname: yeah, but not being horribly craptacular with rsync is still a prerequisite, and I can't meet it :|16:24
notmynamebut I'd also prefer a lot of input from gholt, dfg, and creiht since they are looking at it at bigger scale16:24
*** kevinc_ has quit IRC16:25
*** foexle has quit IRC16:26
*** msahin has joined #openstack-swift16:27
*** kevinc_ has joined #openstack-swift16:29
acolestorgomatic: i reached same conclusion re rsync :(16:29
*** elambert has joined #openstack-swift16:31
torgomaticacoles: yup... I can make it work, but it would require N .meta files for N POSTs, and even with some kind of rolled-up metadata cache thing, that'll have terrible performance16:31
notmynamereminder that the swift team meeting tomorrow and we'll be going over the patches on https://wiki.openstack.org/wiki/Swift/PriorityReviews again. also, we need to do better about getting specs docs landed faster.16:33
*** kevinc_ has quit IRC16:39
*** mmcardle has quit IRC16:53
*** kevinc_ has joined #openstack-swift16:55
*** kopparam has joined #openstack-swift16:55
*** kopparam_ has joined #openstack-swift16:58
*** kopparam has quit IRC16:58
*** kopparam_ has quit IRC17:03
*** kopparam has joined #openstack-swift17:03
*** kopparam has quit IRC17:04
*** kopparam has joined #openstack-swift17:05
*** shri has joined #openstack-swift17:08
*** zslot has quit IRC17:09
*** pberis has joined #openstack-swift17:15
notmynameFYI, the openstack technical committee has, over the years, generated a set of requirements for new projects. now that those requirements are pretty steady-state, they are doing a gap-analysis of the already-integrated projects. the questions (an my answers) are at https://etherpad.openstack.org/p/swift_gap_analysis17:16
*** kopparam has quit IRC17:19
*** kevinc_ has quit IRC17:46
*** tdasilva has joined #openstack-swift17:46
*** acoles is now known as acoles_away17:48
*** mwstorer has quit IRC17:49
*** cpjjl has joined #openstack-swift18:06
*** kevinc_ has joined #openstack-swift18:11
cpjjlHi. Please could someone explain to me the difference between node_timeout and client_timeout in swift’s code? I don’t get what the documentation means by “Request timeout to external services”.18:15
notmynamecpjjl: sure18:15
notmynamecpjjl: the client (ie end user) talks to the proxy. the proxy talks to storage nodes.18:15
notmynamecpjjl: the client_timeout is the delay on receiving data from the end user. the node_timeout is the opposite18:16
notmynameeg if you tell the proxy with a content-length header that you are sending 100 bytes and you send 90 then sleep for a while, the client_timeout will trigger and the connection will be closed18:17
notmynameif you request data from swift and a node dies in the middle of sending the response, the proxy will catch the node_timeout and get the rest of the data from a different node18:18
notmynamecpjjl: and there's also a connection timeout that is just on the time for the proxy to establish a connection (ie tcp handshake) with a storage node. you'll notice that its value is much smaller18:18
notmynamecpjjl: make sense?18:18
cpjjlYeah, thanks notmyname18:19
cpjjlSo, client_timeout is for data that come from the end user, and node_timeout is for data that come from a node. Is that right?18:20
notmynamecpjjl: yup18:21
claygtorgomatic: account and container still gunna use rsync?18:22
cpjjland node_timeout is smaller because nodes are supposed to be more reliable than end users. Is that right?18:22
-openstackstatus- NOTICE: python2.6 jobs are failing due to bug 1342262 "virtualenv>=1.9.1 not found" A fix is out but there are still nodes built on the old stale images18:23
*** ChanServ changes topic to "python2.6 jobs are failing due to bug 1342262 "virtualenv>=1.9.1 not found" A fix is out but there are still nodes built on the old stale images"18:23
TygerHeh I was about to ask about the py26 failures.18:23
notmynamecpjjl: ya, pretty much. also because, in general, nodes are a lot closer, network-wise, than clients. eg many times they are in the same rack, if not the same DC. instead of the client which many times is a mobile phone or web browser18:23
claygtorgomatic: acoles_away: you guys are gunna do the rollup in the hash_dir_cleanup anyway right?  just use a two vecotr timestamp - you have enough bits you could probably fit an md5 of the contents in the offset.18:24
claygtorgomatic: acoles_away: as long as the files that get rsynced over have a different name and include all the rolled up per key times the other side should be able to slide it into his biz when he rolls up?18:25
ahaleyeah cpjjl you also want to fail over internally for handoff etc. faster than a client will timeout, for availability18:28
cpjjlgot it18:29
*** chandankumar has quit IRC18:38
*** chandankumar has joined #openstack-swift18:39
cpjjlbut will the proxy catch a client_timeout if a client dies while *receiving* data?18:42
cpjjlI mean, notmyname, what matters is who is faulty rather than who send the data, right?18:44
notmynamecpjjl: IIRC that would be caught by the overall connection timeout. that defaults to a full day. so make sure you close your connection in less than 24 hours after you open it18:45
notmynameI gotta run for a bit. I'll be back in probably about 90 minutes18:45
cpjjlok thanks18:48
*** anneonthebus has quit IRC18:59
*** kevinc_ has quit IRC19:17
*** kevinc_ has joined #openstack-swift19:29
torgomaticclayg: yeah, that'd be okay until you get an object that's been POSTed to 1000s of times; then all that rollup checking stuff gets real expensive19:33
*** chandankumar has quit IRC19:34
claygtorgomatic: well i mean you'd do it every post in hash dir cleanup or listdir cleanup or whatever it's called19:39
claygtorgomatic: i mean the format in the file would have to be all (timestamp, key): value - but you could always throw out timestamps that are older for that key or something - right?19:39
torgomaticclayg: maybe? I guess I need to think about it more with the 2-part timestamps in mind19:40
*** kevinc_ has quit IRC19:42
*** openstackgerrit has joined #openstack-swift19:43
*** tdasilva_ has joined #openstack-swift19:51
*** tdasilva has quit IRC19:52
*** tatialchueyr has joined #openstack-swift19:53
tatialchueyrhi guys, I'm new to swift and I have a question regarding StatsdClient (swift/common/utils) - is anyone aware of this part of the code?19:54
*** annegentle has joined #openstack-swift20:06
*** zaitcev has joined #openstack-swift20:06
*** ChanServ sets mode: +v zaitcev20:06
*** tdasilva_ has quit IRC20:08
*** kevinc_ has joined #openstack-swift20:12
*** tdasilva has joined #openstack-swift20:14
torgomatictatialchueyr: what's the question?20:30
tatialchueyrtorgomatic: Considering statsd is enabled, each time something is logged, a new socket is being opened.20:32
torgomaticyes20:32
tatialchueyrtorgomatic: if we reused the same socket, we could improve the performance20:33
tatialchueyrtorgomatic: is there any reason for opening a new socket each time?20:34
torgomatictatialchueyr: we started with that; unfortunately, you could get two greenthreads performing concurrent(ish) writes to the same socket, resulting in errors from Eventlet and garbled data20:34
tatialchueyrtorgomatic: I see :/20:36
torgomatictatialchueyr: possibly we could have used a pool of sockets that greenthreads could check out, use, and return, but nobody's made that effort20:36
creihtthe memcache middleware basically does that20:38
tatialchueyrI'm interested in contributing to this20:38
creihtfor an example of how you might do that20:38
tatialchueyrthat sounds perfect, I'll try to implement this and will keep in touch with you here, if I find any problem, ok?20:39
creihttatialchueyr: anyone in this channel should be able to help you :)20:39
tatialchueyrthank you very much!20:40
tatialchueyrwill any of you be at OSCON?20:41
notmynametatialchueyr: I haven't heard of anyone going. at least people that lurk in here20:41
*** mwstorer has joined #openstack-swift20:41
tatialchueyrwell, no problem, I'll keep you informed here20:42
tatialchueyrthakns a lot! :)20:42
notmynametatialchueyr: looking forward to it :-)20:44
*** msahin has quit IRC20:48
*** tongli has quit IRC20:57
tatialchueyr:)21:03
notmynametatialchueyr: out of curiosity, why solve this problem? is this an issue you are seeing in a swift cluster that you have? or is this a way you're looking to get involved in an open-source project?21:05
tatialchueyrnotmyname: there was a real issue related to this21:06
notmynametatialchueyr: ah, ok (sorry you had the issue, but I'm thrilled to see patches in response to production issues)21:06
notmynametatialchueyr: can you share anything about the use case or the cluster or just the problem you saw?21:07
*** zacksh has quit IRC21:07
*** mhu has quit IRC21:07
*** wkelly has quit IRC21:07
*** ahale has quit IRC21:07
*** scotticus has quit IRC21:07
*** creiht has quit IRC21:07
*** amandap has quit IRC21:07
*** zackmdavis has quit IRC21:07
*** notmyname has quit IRC21:07
*** CybergeekDK has quit IRC21:07
*** creiht has joined #openstack-swift21:07
*** ChanServ sets mode: +v creiht21:07
*** ahale has joined #openstack-swift21:07
*** mhu1 has joined #openstack-swift21:07
*** notmyname has joined #openstack-swift21:07
*** scotticus has joined #openstack-swift21:07
*** zacksh has joined #openstack-swift21:07
*** ChanServ sets mode: +v notmyname21:07
tatialchueyrnotmyname: sure :) I will just check with my boss about how far I can tell21:07
*** mhu1 is now known as mhu21:07
*** zackmdavis has joined #openstack-swift21:08
*** wkelly has joined #openstack-swift21:08
notmynametatialchueyr: cool, ok :-)21:08
*** amandap has joined #openstack-swift21:08
*** CybergeekDK has joined #openstack-swift21:09
tatialchueyrnotmyname: ok, I can tell you more details :)21:12
tatialchueyrnotmyname: in front of our statsd we have a load balancer21:13
notmynameyay21:13
tatialchueyrnotmyname: this load balancer limits the number of connections we are allowed to make21:13
tatialchueyrnotmyname: apparently, to generate its statistics of usage, this load balancer caches the tuples <client:port> to <server:port>21:14
notmynameand so the LB ran out of slots to store it?21:15
tatialchueyrexactly21:15
tatialchueyrwe realized that many messages were being lost21:15
tatialchueyrand increased this config21:15
tatialchueyrup to 20k21:16
tatialchueyrmessages stoped being lost21:16
tatialchueyrbut the server suffered, and we are afraid that if we have more usage of swift, the LB will run out of slots21:16
tatialchueyrnotmyname: do you see any other possible solution, despite reusing the sockets?21:17
peluse_.query notmyname21:19
notmynamepeluse_: no rows returned21:20
peluse_nice21:20
*** shri1 has joined #openstack-swift21:20
peluse_the . and the / are just too damned close together21:20
notmyname:-)21:21
*** shri has quit IRC21:21
notmynametatialchueyr: I wonder if it's possible to use a local collector for statsd and use local unix sockets for the traffic21:21
tatialchueyrnotmyname: the company where I work is huge and all services are provided in two machines at least, due to availability concerns... the default solution for this is to have the load balancer in front21:24
ahalelowering overall socket usage (or making a subset more predictable) on proxies seems like a pretty good thing in itself though21:24
tatialchueyrnotmyname: unfortunately, this load balancer is a black box to us :/21:24
notmynametatialchueyr: ya that makes sense. I'm not sure what I said is reasonable or not. but ya what ahale said :-)21:24
*** shri1 has quit IRC21:25
notmynametatialchueyr: I was thinking along the lines of how to break the problem into smaller pieces21:25
notmynameoverall, reducing socket usage, especially on the proxy, is a really good thing overall that will benefit the entire community21:26
tatialchueyrnotmyname: I negotiated with my company to work on this (pool of sockets to be used by the greenthreads) for a few hours during work21:27
tatialchueyrnotmyname: next week I'll be at OSCON during the whole week and I'm willing to work on this issue there21:27
tatialchueyrnotmyname: as I'm total newbie at Swift source code, it might take some time, but the possibility of studying memcache middleware and trying to adapt the behavior to this issue seams a start21:28
notmynametatialchueyr: great. please feel free to ask any questions you have21:30
tatialchueyrnotmyname: I'll surely forward  to you guys, thanks a lot!21:30
notmynametatialchueyr: any chance you can share what you use swift for?21:31
tatialchueyrnotmyname: we are trying to replace a proprietary filer using swift21:32
notmynameah, interesting. how are you talking to swift? rewriting the apps to speak swift or do you have some FS->swift adapter?21:33
notmynamewhat kind of files? pictures? backups? videos?21:33
tatialchueyrnotmyname: we have nginx in front of swift, and apps are talking directly through it21:34
notmyname /queue normal "nginx in front of swift" response21:35
tatialchueyrnotmyname: currrent mostly static files used by our several internet portals, but the idea is to use it for more usages, including storing VM images21:35
notmynamevery cool21:35
tatialchueyrnotmyname: is there a better way of serving swift, than having a nginx in front of it?21:36
notmynametatialchueyr: beware that nginx spools uploads, so it can be a serious bottleneck on file uploads when it's used in front of swift. best-practice among most people here is to use haproxy for load balancing21:36
notmynameand some of us pass through the ssl to the proxy and terminate there and others terminate ssl at the load balancer21:37
notmynametatialchueyr: what version of swift are you using?21:38
tatialchueyrnotmyname: currently 1.13.021:39
*** tdasilva has quit IRC21:39
notmynameah, good. that actually tells me a lot :-)21:39
notmynamefirst up, it tells me that you aren't using distro packages and are paying attention to the upstream code :-)21:40
notmyname(which I like to hear)21:40
tatialchueyrnotmyname: :)21:40
zaitcevRHELOSP 5 shipped yesterday with 1.13.121:41
notmynamezaitcev: ah, good to know21:42
tatialchueyrwell, I'll do my best on this task and will keep you informed21:43
tatialchueyrthanks a lot for all your support21:43
notmynametatialchueyr: happy to help21:43
notmynametatialchueyr: you haven't contributed code yet, have you? need anything to get started?21:44
tatialchueyrnotmyname: not to swift or openstack..! I've downloaded devstack and it is running fine in my local machine21:45
tatialchueyrnotmyname: I didn't check the docs yet, about how to run the project tests - so I won't bother you before I have this set :)21:46
notmynametatialchueyr: cool. that's an ok start, but I'd recommend using the Swift all-in-one (SAIo) for swift dev work. either http://docs.openstack.org/developer/swift/development_saio.html or https://github.com/swiftstack/vagrant-swift-all-in-one21:46
notmynametatialchueyr: the vagrant SAIO is by far the fastest way to get a swift dev environment up and running21:47
tatialchueyrnotmyname: fantastic, will work on this :)21:47
*** tdasilva has joined #openstack-swift21:59
openstackgerritpaul luse proposed a change to openstack/swift: Initial Erasure Code Docs  https://review.openstack.org/10471322:08
*** shri has joined #openstack-swift22:26
*** gholt has quit IRC22:26
*** tdasilva has quit IRC22:41
*** dencaval has quit IRC22:47
*** dencaval has joined #openstack-swift22:48
JoshNanghey guys, can I get reviews on adding temp urls to the client: https://review.openstack.org/#/c/102632/? We're hoping to integrate this into Ironic to make deploys better23:00
*** jthorne_ has joined #openstack-swift23:09
*** tatialchueyr has quit IRC23:22
*** cpjjl has quit IRC23:58
*** cpjjl has joined #openstack-swift23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!