Monday, 2014-03-31

*** matsuhashi has joined #openstack-swift00:23
*** godb has joined #openstack-swift00:41
*** grapsus__ has joined #openstack-swift01:08
*** taras_ has joined #openstack-swift01:08
*** jeblair_ has joined #openstack-swift01:08
*** yuanz has joined #openstack-swift01:09
*** torgomatic_ has joined #openstack-swift01:11
*** rturk-aw` has joined #openstack-swift01:11
*** amandap_ has joined #openstack-swift01:12
*** zackmdavis_ has joined #openstack-swift01:13
*** zul has quit IRC01:13
*** krtaylor has quit IRC01:13
*** bada has quit IRC01:13
*** rturk-away has quit IRC01:13
*** IRTermite has quit IRC01:13
*** jeblair has quit IRC01:13
*** bsdkurt1 has quit IRC01:13
*** nprivalova has quit IRC01:13
*** taras__ has quit IRC01:13
*** torgomatic has quit IRC01:13
*** amandap has quit IRC01:13
*** yuan has quit IRC01:13
*** grapsus_ has quit IRC01:13
*** zackmdavis has quit IRC01:13
*** torgomatic_ is now known as torgomatic01:13
*** fifieldt has joined #openstack-swift01:17
*** bada has joined #openstack-swift01:20
*** zul has joined #openstack-swift01:21
*** nprivalova has joined #openstack-swift01:21
*** IRTermite has joined #openstack-swift01:22
*** matsuhashi has quit IRC01:24
*** matsuhashi has joined #openstack-swift01:26
*** nosnos has joined #openstack-swift01:31
*** bsdkurt has joined #openstack-swift01:31
*** krtaylor has joined #openstack-swift01:31
godb!tray01:37
openstackgodb: Error: "tray" is not a valid command.01:37
godb!Æ®·¹ÀÌ01:37
godb¢Æ Zero IRC ¢Æ < Æ®·¹ÀÌ»óÅ·ΠÀüȯÇÕ´Ï´Ù! >01:37
openstackgodb: Error: "Æ®·¹ÀÌ" is not a valid command.01:37
*** saschpe has quit IRC01:44
*** saschpe has joined #openstack-swift01:46
godb!Æ®·¹ÀÌ02:26
godb¢Æ Zero IRC ¢Æ < Æ®·¹ÀÌ»óÅ·ΠÀüȯÇÕ´Ï´Ù! >02:26
openstackgodb: Error: "Æ®·¹ÀÌ" is not a valid command.02:26
godb!Æ®·¹ÀÌ02:42
godb¢Æ Zero IRC ¢Æ < Æ®·¹ÀÌ»óÅ·ΠÀüȯÇÕ´Ï´Ù! >02:42
openstackgodb: Error: "Æ®·¹ÀÌ" is not a valid command.02:42
*** ChanServ sets mode: +o notmyname03:00
*** godb was kicked by notmyname (godb)03:00
*** godb has joined #openstack-swift03:00
StevenKnotmyname: Love your work.03:00
*** ChanServ sets mode: +b godb!*@*03:03
*** godb was kicked by ChanServ (User is banned from this channel)03:03
notmynameStevenK: done03:04
notmynameStevenK: I saw some Zero IRC messages from him. can you provide any more details?03:04
*** sunh has quit IRC03:05
*** notmyname sets mode: -o notmyname03:06
StevenKnotmyname: Nope, I saw the same, every twenty minutes and thought enough was enough03:10
*** haomaiwang has joined #openstack-swift03:17
*** matsuhashi has quit IRC03:19
*** mordred has joined #openstack-swift03:23
*** nosnos has quit IRC03:34
*** saurabh_ has quit IRC03:43
*** ashish_ has joined #openstack-swift03:44
*** ashish_ has quit IRC03:48
*** haomaiw__ has joined #openstack-swift03:56
*** matsuhashi has joined #openstack-swift03:57
*** haomaiwang has quit IRC03:58
*** ashish_ has joined #openstack-swift04:01
*** nosnos has joined #openstack-swift04:02
*** ashish_ has quit IRC04:15
Anjuclayg : hii  , https://bugs.launchpad.net/swift/+bug/1079075 yeah , then its a invalid bug .04:17
openstackgerritMadhuri Kumari proposed a change to openstack/swift: Added swift-account-info tool.  https://review.openstack.org/8229604:30
*** madhuri has joined #openstack-swift04:31
openstackgerritMadhuri Kumari proposed a change to openstack/swift: Added swift-account-info tool.  https://review.openstack.org/8229604:36
*** matsuhashi has quit IRC04:39
*** bsdkurt has quit IRC04:39
*** krtaylor has quit IRC04:39
*** matsuhashi has joined #openstack-swift04:43
*** krtaylor has joined #openstack-swift04:48
*** bsdkurt has joined #openstack-swift04:51
*** patchbot has joined #openstack-swift05:14
*** gadb has joined #openstack-swift05:39
*** chandan_kumar has joined #openstack-swift05:50
*** nosnos_ has joined #openstack-swift05:53
*** nosnos has quit IRC05:53
*** matsuhashi has quit IRC05:54
*** matsuhashi has joined #openstack-swift05:55
*** bvandenh has joined #openstack-swift06:10
*** mkollaro has joined #openstack-swift06:18
*** sungju_ has quit IRC06:28
*** briancline has quit IRC06:40
*** Manish has joined #openstack-swift07:01
Manishhugokuo: Hi...07:02
hugokuomlanner: yo... wasup07:03
ManishHow are you ?07:04
ManishIs there any place where i can find some documentation about all the DB tables (account_stat, container, container_stat, object etc) and their columns?07:05
*** chandan_kumar has quit IRC07:06
*** matsuhashi has quit IRC07:08
*** matsuhashi has joined #openstack-swift07:08
*** nosnos_ has quit IRC07:09
*** nosnos has joined #openstack-swift07:10
gadbhugokuo : hi07:14
hugokuoManish: ... use sqlite3 to open the DB file and then using .schema to get what you want07:15
hugokuogadb: good afternoon07:15
hugokuoManish: btw... no any documentation about that besides from source code or the way I mentioned there.07:15
Manishhugokuo: I wanted to undersand some fields and their purpose...such as in account_stat table..there is one column by name "put_timestamp"....07:17
Manishdoes this column gets updated for every object PUT under that account, or for every container operation under that account..or at some other time07:18
*** briancline has joined #openstack-swift07:19
ManishAlso... does "hash" column contains just the hash value of account name? in this case this field will never update in its complete life span..right?07:19
hugokuoManish: https://github.com/openstack/swift/blob/901bd044c38e7aa1ff2b79d3790ea27f9990b1c8/swift/account/backend.py#L3807:19
hugokuoManish: re: "hash" I think you are correct.07:21
*** matsuhashi has quit IRC07:22
*** mkollaro has quit IRC07:27
*** matsuhashi has joined #openstack-swift07:28
*** foexle has joined #openstack-swift07:29
*** matsuhashi has quit IRC07:46
*** matsuhashi has joined #openstack-swift07:47
*** mlipchuk has joined #openstack-swift07:51
*** mmcardle has joined #openstack-swift07:55
*** mkerrin has joined #openstack-swift07:59
*** nacim has joined #openstack-swift08:03
*** nacim has quit IRC08:03
*** nacim has joined #openstack-swift08:04
*** Trixboxer has joined #openstack-swift08:20
*** tanee-away is now known as tanee08:21
*** cheri has joined #openstack-swift08:29
*** d89 has joined #openstack-swift08:29
*** saschpe has left #openstack-swift08:34
*** SUNH has joined #openstack-swift08:36
*** RockKuo_TW_PC has joined #openstack-swift08:48
*** RockKuo_TW has quit IRC08:52
*** cheri has quit IRC08:53
*** bvandenh has quit IRC08:55
*** SUNH has quit IRC08:56
*** bvandenh has joined #openstack-swift09:01
*** haomaiw__ has quit IRC09:13
*** haomaiwa_ has joined #openstack-swift09:13
*** sungju_ has joined #openstack-swift09:23
*** sungju_ has quit IRC09:27
*** haomaiw__ has joined #openstack-swift09:32
*** haomaiwa_ has quit IRC09:35
*** acoles_ is now known as acoles09:38
*** sungju_ has joined #openstack-swift09:40
*** sungju_ has quit IRC10:00
*** Midnightmyth has joined #openstack-swift10:05
*** gadb has quit IRC10:20
*** sungju_ has joined #openstack-swift10:26
openstackgerritVictor Stinner proposed a change to openstack/python-swiftclient: Fix swiftclient.client.quote() for Python 3  https://review.openstack.org/8410210:41
*** gadb has joined #openstack-swift10:51
gadbhugokuo : are u there?10:51
openstackgerritVictor Stinner proposed a change to openstack/python-swiftclient: Fix test_multithreading on Python 3  https://review.openstack.org/8410410:53
gadbgholt : hi. i have some question. about object-replicator source code. do you have some time?10:55
gadbclayg : hi. are you there?10:55
*** sungju_ has quit IRC11:03
*** matsuhashi has quit IRC11:26
*** nosnos has quit IRC11:27
*** Manish has quit IRC11:46
*** saju_m has joined #openstack-swift11:51
*** saju_m has quit IRC12:00
*** JuanManuelOlle has joined #openstack-swift12:02
*** saju_m has joined #openstack-swift12:06
*** saju_m has quit IRC12:08
openstackgerritVictor Stinner proposed a change to openstack/python-swiftclient: Fix swiftclient.client.quote() for Python 3  https://review.openstack.org/8410212:18
*** Atti has joined #openstack-swift12:22
*** Atti has quit IRC12:22
*** Midnightmyth has quit IRC12:31
*** changbl has quit IRC12:32
*** mrsnivvel has joined #openstack-swift12:36
*** Longgeek_ has joined #openstack-swift12:49
*** Midnightmyth has joined #openstack-swift12:50
*** mlipchuk has quit IRC13:03
*** mrsnivvel has quit IRC13:20
*** mlipchuk has joined #openstack-swift13:20
*** tdasilva has joined #openstack-swift13:45
*** zigo has quit IRC13:50
*** pberis has joined #openstack-swift13:51
*** zigo has joined #openstack-swift13:58
*** mlipchuk has quit IRC14:02
*** pberis has quit IRC14:02
*** pberis has joined #openstack-swift14:04
openstackgerritYuan Zhou proposed a change to openstack/swift: Update swift-object-info/swift-get-nodes to be storage policy aware  https://review.openstack.org/8273414:05
*** dmsimard has joined #openstack-swift14:07
*** zackf has joined #openstack-swift14:07
*** lpabon has joined #openstack-swift14:09
*** mlipchuk has joined #openstack-swift14:16
*** judd7 has joined #openstack-swift14:20
*** changbl has joined #openstack-swift14:41
*** piyush has joined #openstack-swift14:41
*** Longgeek_ has quit IRC14:44
*** Longgeek_ has joined #openstack-swift14:50
*** mkerrin has quit IRC14:53
*** jeblair_ is now known as jeblair14:59
*** dmsimard has quit IRC14:59
notmynameacoles: I'm online now15:04
acolesnotmyname: hi. just hit send on email reply :)15:05
*** changbl has quit IRC15:08
*** dmsimard has joined #openstack-swift15:08
*** tanee is now known as tanee-away15:09
*** mkerrin has joined #openstack-swift15:11
*** tanee-away is now known as tanee15:15
*** d89 has quit IRC15:23
*** foexle has quit IRC15:26
*** gyee has joined #openstack-swift15:30
*** mkerrin has quit IRC15:31
*** mkerrin has joined #openstack-swift15:38
*** d89 has joined #openstack-swift15:40
openstackgerritA change was merged to openstack/swift: minor cleanups for swift-container-info  https://review.openstack.org/8320115:42
notmynameportante: good morning. around?15:48
*** tanee is now known as tanee-away15:49
*** tanee-away is now known as tanee15:51
*** tanee is now known as tanee-away15:51
*** tanee-away is now known as tanee15:51
*** zackmdavis_ is now known as zackmdavis15:55
*** changbl has joined #openstack-swift16:09
pelusegood morning guys16:11
notmynamepeluse: howdy16:12
*** mlipchuk has quit IRC16:21
dmsimardAsked in #openstack-ceilometer but no luck… I've been reading on the swift meters, I see that some are reported by the middleware and others must be polled by ceilometer-agent-central. I can't seem to find documentation on how to have ceilometer-agent-central poll swift - any hints ?16:23
notmynamedmsimard: IIRC ceilometer asks keystone for a list of all the swift accounts and then does a HEAD request to each of them. but that's a question for the ceilometer team16:24
notmynamedmsimard: but I'm not sure exactly what your question is. or, I don't know how to answer "how do you poll a swift cluster?"16:24
dmsimardnotmyname: Well, referring to the ceilometer "meters": http://docs.openstack.org/developer/ceilometer/measurements.html#object-storage-swift16:26
dmsimardnotmyname: There are metrics that are "notified" by the ceilometer middleware from the swift-proxy pipeline16:27
dmsimardOthers are made available by being "polled" by what seems to be ceilometer-agent-central but I haven't found documentation on how to poll swift in that way.16:28
notmynamedmsimard: I agree that there seems to be a thing in ceilometer that does that. but you've now exhausted my knowledge of configuring ceilometer. I think that's a question for the ceilometer team16:29
dmsimardAgreed, i'll try to poke them harder :P16:30
*** tanee is now known as tanee-away16:36
*** d89 has quit IRC16:38
*** d89 has joined #openstack-swift16:41
*** d89 has joined #openstack-swift16:43
*** Stressed has joined #openstack-swift16:45
*** RockKuo_TW_PC has quit IRC16:46
StressedHello swift gurus16:46
StressedI have a quick question...do you mind asnwering me?16:46
notmynamewell, I hope it isn't Swift that's making you Stressed ;-)16:47
notmynameStressed: what's up?16:47
StressedHehe, it is actually, just a bit16:47
Stressedokay so, if you have a file in quarantine that gives 404 on a head request how can we grab the file of the quarantine folder and insert it back properly with all the headers??16:48
*** mmcardle has quit IRC16:48
notmynameStressed: so all replicas in the cluster are missing and/or quarantined?16:49
*** dfg has left #openstack-swift16:49
*** dfg has joined #openstack-swift16:49
notmynameStressed: normally, replication ensures that the quarantined replica is replaced by a known good other replica16:49
*** ChanServ sets mode: +v dfg16:49
*** marcusvrn has joined #openstack-swift16:50
*** mmcardle has joined #openstack-swift16:50
StressedI think not all replicas are missing16:50
notmynameStressed: so then the first question is to understand why you are getting a 40416:50
notmynameStressed: and then you need to check that the quarantined object is actually the same object you are trying to fetch (ie before moving it around on the local filesystem)16:51
Stressednotmyname: okay. So I can look into what's causing 404. I wrote a script, to look for quarantined files, look for replicas. If it exists, remove the quarantined file.16:53
Stressednotmyname: but somehow, on some files i get a 404 error.16:53
*** RockKuo_iPad has joined #openstack-swift16:53
peluseI would be curious as to why the replcator isn't addressing this - a separate script should not be needed if some replcas are still good, correct?16:54
Stressednotmyname: So, I am looking for a way to put the quarantined file back, with all the headers.16:54
notmynameStressed: ok. check the proxy logs (first) and then trace the rest of the logs using the transaction id. use swift-recon to ensure you have the same rings deployed everywhere. also use swift-get-nodes to ensure that the right data is good. and swift-object-info on the quarantined file to see why it's quarantined16:55
notmynamepeluse: ya his script is ok since swift doesn't automatically remove the quarantined objects16:55
notmynameStressed: checking on one thing first...16:55
pelusenotmyname:  gotcha, but if there are good replcias still the node w/the quaranteed file will have a new copy pushed to it - so why manually try to pull the one from the quanarteed folder?16:56
notmynameright16:57
notmynamethat's the question :-)16:57
*** RockKuo_iPad has quit IRC16:57
Stressednotmyname, peluse: that is the problem right there. Not all quarantined files are replicated.16:57
Stressedand we need to perform cleanup, as its filling up the hdd to max.16:58
StressedI am manually trying to clear all quarantined files that have replicated properly.16:58
*** Trixboxer has quit IRC16:58
notmynameStressed: ok. found what I was looking for16:58
notmynameStressed: in general, a good strategy for dealing with quarantined objects is to do a HEAD request to the cluster for them and see if you get a 2xx response (you should). if so, you can safely delete the quarantined object since you know that the cluster can find it. of course, also ensure that you've got replication, etc running to keep the cluster healthy17:00
Stressedyea, I have completed all that part.17:00
notmynameStressed: but, assuming for whatever reason you want to move a quarantined object back...17:00
notmynameStressed: do you know why the object was quarantined?17:01
notmynameStressed: cause just copying it back will cause it to get quarantined again. quarantined objects have something wrong with them17:01
StressedSo I get 404 for a few files, and I thought, they might not exist in quarantined folder. Bu they do. and those files have not replicated. So i want to put them back manually, with all headers intact.17:02
*** mmcardle has quit IRC17:02
Stressedwe had a suffix mismatch at some point, thats what caused this issue.17:02
notmynameah17:02
notmynameStressed: here's what I did: write an object to the cluster and then manually corrupt it. here's what's in the quarantined directory: https://gist.github.com/notmyname/37864426a76f847278de17:03
notmynameStressed: so the good news is that for you, the data should be good17:03
notmynameStressed: importantly, you should be able to run swift-object-info on the quarantined file and see everything you need (and also that it's not longer being flagged as bad)17:04
notmynameStressed: the quarantined directory structure is <prefix>/quarantined/objects/<object hash>/<timestamped files>17:04
StressedData says valid on object-info.17:05
notmynameStressed: so by running swift-object-info on one of those timestamp files, you'll see the actual path location that's expected (ie including the partition and suffix splay directories)17:05
notmynameStressed: and you can either screen-scrape that or look at the swift-object-info code to get it more cleanly17:05
notmynameStressed: note the "Ring locations" section of my swift-object-info output17:06
notmynameStressed: so you'll need to find the "local" ring location and then move it out. and also update the hashes.pkl file.17:07
notmynameStressed: hmm...or is there a better way?17:07
*** Longgeek_ has quit IRC17:08
Stressedokay17:09
notmynameswiftclient doesn't have an "internal" mode, but there is an internal client in the swift source code you could use17:09
notmynameeg instead of doing a FS copy and ensuring that all the right things happen, simply send the data to the local object server17:09
notmynameand let swift take care of it for you17:09
Stressedokay17:10
notmynameis that enough to get you started?17:10
Stressedyes it is Sir!17:10
Stressedi am gonna do a quick lookup of stuff, and get back to you :)17:11
notmynamegreat! jump back i if you have any other questions.17:11
Stressedokay, one more quick questions, how do I send the data to the local object server?17:12
notmyname"just" HTTP17:12
Stressedwe do swift internal to use the local object server17:12
Stressedhmmm17:13
StressedI can try that17:14
Stressednotmyname: I am sorry, do you mind giving me an example of http request?17:17
Stressedlike using curl...17:17
portantenotmyname: around now17:19
notmynameportante: I made something for you17:19
*** nacim has quit IRC17:20
portanteoh?17:20
portantehow sweet and thoughtful of you!17:20
notmynameportante: can you review patch 83919?17:20
pelusepottery?17:20
notmynameportante: oh wait!17:20
notmynamepatchbot: patch 8391917:20
patchbotnotmyname: https://review.openstack.org/#/c/83919/17:20
notmynameportante: ta da! ^17:20
portanteyes17:20
portanteyes!17:20
portantenice17:20
notmynameportante: since you like to send bare gerrit patch numbers around, I made a linkifier17:20
notmynamepatchbot: p 8391917:21
patchbotnotmyname: https://review.openstack.org/#/c/83919/17:21
portantelove it, color is just fabulous, darling17:21
portantepatchbot: p 100017:22
patchbotportante: https://review.openstack.org/#/c/1000/17:22
portantekewl17:23
Stressednotmyname: Thanks a lot for your help. Really appreciate it :)17:23
notmynameStressed: sure. I'm looking into your last question17:23
notmynameStressed: ie I don't think curl is the answer, but I'm looking for what is. or a better example17:24
*** bvandenh has quit IRC17:24
*** d89 has quit IRC17:24
Stressednotmyname: okay. You the best!17:25
notmynameStressed: using the same example I did as above, the object server request is a PUT to /d1/304/AUTH_test/c/o17:29
*** shri has joined #openstack-swift17:29
notmynameStressed: that's /drive/partition/account/container/object17:30
notmynameStressed: and the headers are the same.17:30
notmynameStressed: alternatively, you could make a "normal" PUT request to the proxy server (ie the public API) and then you'd know you have durability. in that case you'd also need to send the X-Timestamp header if you needed the timestamp to not be changed17:31
notmynameStressed: the long-term safest way would be to do a PUT to the proxy with the data. and probably the simplest17:31
*** piousbox has joined #openstack-swift17:32
notmynameStressed: alternatively, you could simply copy the file back under the local objects directory (to the right partition and suffix directories), update hashes.pkl, and then let replication take over17:32
notmynameStressed: but that 2nd way, while perhaps more efficient from a network perspective, is more dependent on getting some internal state all set correctly17:33
notmynameStressed: ie don't mess it up17:34
Stressednotmyname17:36
*** bvandenh has joined #openstack-swift17:36
Stressednotmyname: Thanks a lot. I got what I needed17:36
StressedReally really appreciate it :)17:36
notmynamegood luck17:39
werso what are people doing to get the correct mime types set in swift.  If some client doesn't set it correctly in the request?17:42
wererr  Content-Types and Content-Encoding and things :/17:42
dfgwer: if you send the header: X-Detect-Content-Type then swift will ignore the content-type sent to it from teh client and guess it from the file extension. don't think we can do anythign about Content-Encoding though17:44
*** piyush has quit IRC17:44
werdfg good to know.  ty.17:45
notmynamewer: dfg: if the content-type header isn't sent at all, swift will guess too17:45
dfgya17:45
dfgwas about to type that...17:46
dfg:)17:46
werare you sure :)17:46
notmynamewer: that header (thanks dfg I had forgotten about that) will simply override what's send it17:46
notmynamewer: line 504 of obj.py ;-)17:46
notmynamepretty sure :-)17:46
werso is it controlled by /etc/mime.types?  And looking ty.17:46
notmynameya17:46
dfglots of clients won't not send a content-type- so even though you don't set it, one gets sent17:46
*** rustlebee is now known as russellb17:47
dfgwell- idk about lots. some of RAX's old clients17:47
dfgsending X-Detect-Content-Type will force it17:47
notmynamecurl will not send it if you use -T. it will send "Content-Type: application/x-www-form-urlencoded" with --data-binary17:48
notmynamewer: just confirmed that not sending a content type for an object named "o.txt" results in the content type being set to text/plain17:48
openstackgerritA change was merged to openstack/swift: Move like unit tests together; add comments  https://review.openstack.org/8327617:56
openstackgerritA change was merged to openstack/swift: Mock out time and sleep to avoid races  https://review.openstack.org/8327717:56
wernotmyname: well sunofabitch.  These are good things.17:56
openstackgerritA change was merged to openstack/swift: Added swift-account-info tool.  https://review.openstack.org/8229618:00
*** ChanServ sets mode: +v torgomatic18:04
creihtnotmyname: I was just thinking since there have been a couple of issues with people accidently having the wrong hash settings on servers18:05
*** ashish_ has joined #openstack-swift18:05
creihtmaybe every send a hash of the prefix/suffix with every internal call, and if they don't match, log an error and don't allow the request to continue18:06
notmynamecreiht: ya. ie don't allow something to be saved that will be immediately quarantined18:07
creihtyeah18:07
notmynamemakes sense18:07
creihtand make sure to log so that it makes it obvious what is wrong18:07
notmynamecschwede: glange: so I have a question about the swift-[account,container]-info thingies just merged18:08
notmynamecreiht: right18:08
notmynamecschwede: glange: I hadn't used it, so I just created an account and container and tried to. and I get https://gist.github.com/notmyname/eebc29fd08ab6140a3eb18:08
notmynamewhat am I doing wrong?18:08
ashish_Hey everyone.I have a qusestion about swift-browser.After having git cloned it it is working on 127.0.0.1:8080.But the UI of the swift browser is disrupted.What could be the possible reasons?Please help18:11
notmynameashish_: what's the swift-browser?18:11
glangenotmyname: those cammands work if you pass in the entire db path18:12
*** Longgeek_ has joined #openstack-swift18:12
notmynameglange: I'm not.18:12
*** gyee has quit IRC18:13
openstackgerritBrian Cline proposed a change to openstack/swift: Fixes SUPER important typo in CHANGELOG.  https://review.openstack.org/8419618:13
ashish_notmyname swift browser provides me an UI for logging in with the authenticated accounts and veiwing the associated containers and objects.18:13
notmynamebriancline: WOW!18:14
*** Longgeek_ has quit IRC18:14
notmynameashish_: that's not part of the swift codebase, so I don't think we could help you much with it. where did you get it?18:14
werhrm, so I would still need something special if the client isn't specifying the Content-Encoding if I require that.  Apache of course just Adds that.  Damn So handled some custom mime types incorrectly, but would still need to check for Encoding it seems if I want that stored in the metadata.18:14
*** Longgeek_ has joined #openstack-swift18:15
*** gyee has joined #openstack-swift18:15
werAddEncoding x-gzip .gz  equivalent is what I am looking for.18:15
ashish_notmyname i got it from the github repository.It works perfectly well with swift.Except for the slight errors in the UI.18:15
ashish_Could someone tell me How to change the number of replicas in OpenStack  Swift.18:18
brianclinenotmyname: I know, I nearly had a coronary18:19
*** _bluev has joined #openstack-swift18:19
gholtAnybody know how to use python-swiftclient with Rackspace Cloud Files? (I know, I know, normally folks would ask /me/.)18:20
_bluevwould I be crazy reckless if I increase node timeout from 10sec to 30 or 40sec ? I see very occasional disk issues which push me over 10seconds, but logs files show the operation completing even though users see 503s18:21
zackmdavisgholt, http://blog.chmouel.com/2013/09/27/how-to-access-rackspace-cloud-with-latest-swiftclient-novaclient/ worked for me18:21
*** piyush1 has joined #openstack-swift18:22
notmynamegholt: did something break somewhere?18:22
gholtI'll try that and see. Apparently I need to install python-keystoneclient now18:23
cschwedeashish: sounds like the static files are missing for swiftbrowser18:23
cschwedenotmyname: looking18:23
notmynamegholt: that didn't land did it? I don't see it in my requirements.txt18:24
gholtI don't know what "that" is in this conversation. :)18:25
notmynamehttps://review.openstack.org/#/c/79498/18:25
cschwedeashish_: did you run "python manage.py collectstatic" ?18:25
notmynamegholt: https://review.openstack.org/#/c/79498/18:25
notmynamegholt: I had seen someone propose adding that to requirements18:25
gholtI tried running what chmouel's blog post said and it said it needed keystoneclient. I installed that too, but I still can't quite get it all to work.18:25
cschwedenotmyname: when i used swift-account-info with the full db path, it worked fine for me18:25
notmynamegholt: using RAX auth v2?18:25
gholtYeppers18:25
chmouelrax auth v2 is weird :p18:26
gholtHis blog post was back in Sept, so who knows what all changed at this point, hehe.18:26
gholtBut it does mean swift-bench no worky as well18:26
zackmdavisgholt, are you doing the set-tenant-name to-an-empty-space thing?18:26
notmynamecschwede: hmm..ok. works if I'm not in the db directory (even if I give it the whole path)18:27
notmynamecschwede: seems buggy. why can't I give it just a local db file (like swift-object-info does?)18:27
cschwedecschwede: let me check, firing up my saio18:28
gholtOh, his blog post indicates that I should use the "password" not the api-key...18:28
gholtI have to find my password though... be a sec18:28
*** _bluev has quit IRC18:29
cschwedenotmyname: looks to me like it happens in the broker?18:30
notmynamecschwede: something about being dependent on the pwd?18:30
notmynamecschwede: ah, I think I found it18:30
gholtThat worked. password, api-key.. got it18:30
notmynamecschwede: I'll bet the dentry of my pwd was expired18:31
notmynamecschwede: going out worked. then going back in worked18:31
gholtnotmyname: zackmdavis: chmouel: Works fine. Just needed to read that password!key thing. Thanks.18:31
zackmdavisgholt, this is what worked for me specifically: storage_url, auth_token =  swiftclient.client.get_auth(auth_url, username, password, auth_version='2', tenant_name=" ")18:31
* notmyname still wants the non-full-path to work. and a pony18:31
cschwedenotmyname: this breaks things: http://paste.openstack.org/show/74678/ -> doesn't work if you're in the DB directory18:32
gholtAnd now I have all sorts of new python packages installed. ;)18:32
*** zaitcev has joined #openstack-swift18:32
*** ChanServ sets mode: +v zaitcev18:32
cschwedethe path name calling mkdirs() in swift/swift/common/utils.py is empty18:33
cschwedenotmyname: however it works if you call swift-account-info ./c8bcccab3ddbfdc34b08e9223f4f5178.db <- note the "./" in front18:34
notmynameah, interesting18:34
notmynamecschwede: thanks for looking :-)18:35
cschwedenotmyname: the question is where to patch this - either in account/container-info, or in mkdirs() in swift/swift/common/utils.py18:35
ashish_Hey cschwede I did run the python m,anage.py18:35
openstackgerritAlex Gaynor proposed a change to openstack/python-swiftclient: Use the standard library's copy of mock when it's available.  https://review.openstack.org/8420518:35
cschwedenotmyname: you're welcome :) should we patch swift-[account|container]-info?18:36
ashish_Hey cschwede could it be that my bwowser needs plugins18:36
notmynameashish_: are you talking about https://github.com/slupers/swift_browser ?18:36
cschwedeashish_: no, should work without plugins. so you called the collectstatic command?18:36
cschwedenotmyname: i think it is https://github.com/cschwede/django-swiftbrowser18:36
notmynamecschwede: ah, well then *punt* ;-)18:37
cschwede;-)18:37
ashish_csschwede I did run the collectstatic command.18:37
notmynamehmm...maybe I shouldn't use american football metaphors when talking to someone from europe ;-)18:38
cschwedeashish_: so there is now a directory "static" in the top of your project?18:38
cschwedeashish_: where did you installed it to - /var/www/myproj ? or in your homedir? in that case you need to modify the settings.py file and change the directory name18:39
ashish_cshwede could you tell me how to do this18:40
*** Longgeek_ has quit IRC18:41
cschwedeashish_: sure, no problem! so there is a directory "myproj" somewhere on your host. where is it?18:43
*** piyush has joined #openstack-swift18:43
ashish_cschwede I have installed it to my /var/www/myproj directory.18:43
ashish_but could you tell me the changes to be made to settings.py.18:43
cschwedeashish_: ok, thats great. do you see a subdirectory "static" there?18:44
*** piyush1 has quit IRC18:44
cschwedeashish_: if you installed it to /var/www/myproj no change should be required18:45
ashish_cschwede but still the browser login page looks distorted.What cud be the reasi=ons18:46
ashish_cschwede but still the browser login page looks distorted.What cud be the reasons18:46
cschwedeashish_: is the static dir there?18:46
ashish_csschwede Yes its there.18:47
cschwedeashish_: wait a minute18:48
ashish_cschwede okay sure.18:48
*** zackf1 has joined #openstack-swift18:51
*** zackf has quit IRC18:51
cschwedeashish_: ok, got it. try running with "manage.py runserver --insecure"18:54
cschwedeashish_: or - 2nd option - add a "DEBUG = True" to myproj/settings.py18:55
ashish_cschwede j=Please give me a minute.18:55
cschwedeashish_: or - 3rd option, for production - set ALLOWED_HOSTS in myproj/settings.py correct. use option 1 and 2 only for local testing18:55
cschwedeashish_: thing is: "manage.py runserver" only serves static files if in debug or insecure mode. otherwise you need a full django installation with a static file server (or swift staticweb :))18:57
ashish_cschwede Thanks a lot.That solved my problem.You have saved hours of my research surfing the net.18:58
cschwedeashish_: you're welcome, glad that i could help :)18:59
ashish_cschwede could you tell me how to change the nos of replicas is swift18:59
cschwedeashish_: yep, you do that with swift-ring-builder19:00
cschwedeashish_: swift-ring-builder <builder_file> set_replicas <replicas>19:00
cschwedeashish_: after that you need a rebalance and then you push the changed ring to all nodes19:01
ashish_okay Thanks got it.Would that change the number of replicas of my preexisting objects.19:01
*** briancline has quit IRC19:01
cschwedeashish_: yes, replicators will take care of this. might need some time though19:02
ashish_cschwede  thanks a lot.I had another doubt.19:03
ashish_cschwede When I try to upload an object I get the following error:"UNAUTHORISED:Server couldnt verify that you are authorized to access  the document you requested ."19:06
cschwedeashish_: from swiftbrowser or swift?19:06
ashish_cschwede from the swiftbrowser19:06
cschwedeashish_: if its happening in swiftbrowser it is likely that formpost middleware is missing in swift proxy19:06
cschwedeashish_: make sure you have "formpost" and "tempurl" both in your pipeline in proxy-server.conf19:07
ashish_cschsede what is the purpose of formpost.19:08
cschwedeashish_: to allow uploads using a http form: http://docs.openstack.org/trunk/config-reference/content/object-storage-form-post.html19:08
ashish_Could you tell me how to edit the proxyserver.conf file to add the tempauth and formpost.19:10
ashish_cschwede. Could you tell me how to edit the proxyserver.conf file to add the tempauth and formpost.19:13
cschwedeashish_: one sec19:13
ashish_okay sure.19:13
cschwedeashish_: http://paste.openstack.org/show/74688/19:15
cschwedeashish_: i'll add it to the readme as well19:15
ashish_Thanks a lot19:15
ashish_Please give me a minute.19:16
ashish_cschwede I have done the changes but still get the same error.19:21
cschwedeashish_: reloaded swift proxy?19:21
ashish_No.Could you tell me the command for it.19:22
cschwedesudo swift-init restart proxy19:22
ashish_cschwede Thanks that worked.19:25
ashish_One last doubt.19:25
ashish_Cschwede could you also tell me when I download an object using the swift CLI where does it get stored on my device.I am using a single node.19:25
cschwedeashish_: in your current path (as long as there is no '/' in the object name)19:26
cschwedeashish_: thus "swift download mycontainer myobject" will create a file myobject in the current directory19:26
cschwedeashish_: or you specify the target filename with "swift download -o someothername mycontainer myobject"19:27
ashish_could I pass the entire directory path where I need to store the object.19:28
marcusvrnportante: ping19:28
*** ankit_deshwal has joined #openstack-swift19:29
marcusvrnportante: I have a question about swift module....can the module swift icehouse works with havana openstack?19:29
notmyname marcusvrn: yes, it should19:30
notmynamemarcusvrn: if it doesn't it's probably a bug (at least for docs, if not in the code)19:31
marcusvrnnotmyname: thx!19:31
portantenotmyname, marcusvrn: what do you two mean by swift module?19:31
portantewould like to be able to speak the same language. ;)19:31
cschwedeashish_: yes, you can use the complete path19:32
notmynamemarcusvrn: "swift module" == swift as part of openstack?19:33
marcusvrnportante: lol.. it's about to use the icehouse swift (with diskfile API) working an openstack havana.19:33
ashish_cschwede Also  I have uploaded an object from some directory and then after uploading  I moved the file to some other directory.When I tried to download that object it gave me a permission denied error.What could be the reason for it.19:33
marcusvrnnotmyname: yes19:33
cschwedeashish_: could you paste the error? -> paste.openstack.org19:33
*** Stressed has quit IRC19:35
*** erlon has joined #openstack-swift19:35
portanteah, thanks that makes sense now19:35
openstackgerritA change was merged to openstack/swift: Update swift-get-nodes to use storage_directory util func  https://review.openstack.org/8296819:36
notmynameTIL that Apple's A7 ARM processor is codenamed "Swift" (http://www.anandtech.com/show/7910/apples-cyclone-microarchitecture-detailed)19:37
creihtyay19:38
notmynameSwift on Swift?19:39
creihtmaybe all openstack projects names should be UUIDs19:41
creihtmaybe that would make a good 4/1 mailing list post :)19:42
notmynamecreiht: as long as the uuids are managed in oslo. I mean 1b06d8e2cdac4f409b6765de526c65e119:42
ashish_cschwede I got that errror because i was using the wrong cmd.Thats resolved.19:43
cschwedeashish_: nice :)19:44
notmynamecreiht: did you get a chance to try printing the swift bird?19:45
ashish_sschwede could you tell me how should I proceed with Benchmarking of swift using ssbench on a single node deployment.19:46
ashish_sschwede Thanks a lot for your help.It has solved a whole lot of my queries and also I have learned several new terms.19:54
*** ashish_ has quit IRC19:55
creihtnotmyname: not yet19:56
*** ankit_deshwal has quit IRC20:06
*** ashish_ has joined #openstack-swift20:06
*** ashish_ has quit IRC20:06
notmynamezaitcev: is there are reason you didn't approve https://review.openstack.org/#/c/80383/ ? I want to make sure I'm not missing something before I click the button20:09
notmynamecreiht: dfg: any progress on range requests in SLOs? https://review.openstack.org/#/c/82895/ the last comment on the patch says y'all are still looking into it20:10
notmynameportante: in process functests (https://review.openstack.org/#/c/66108/) last comment by you says WIP, but it's not set on the patch. status?20:10
dfgnotmyname: oh ya- its still broken. we had an offsite on friday, i'll look at it again today.20:11
notmynamedfg: thanks20:11
notmynamedfg: I think that one's pretty important to get into Icehouse, so earlier this week is better than late this week20:11
notmynameright now there is thunder in San Francisco. this is the first time since I've moved here (nearly 2 years!) that I've heard it.20:12
notmynameI don't know if I'll lose connectivity or not. I have no idea if this city (power, etc) can deal with thunderstorms.20:12
*** _bluev has joined #openstack-swift20:15
*** ashish_ has joined #openstack-swift20:20
*** briancline has joined #openstack-swift20:24
brianclinedangit tmux20:25
*** mmcardle has joined #openstack-swift20:26
*** lpabon has quit IRC20:26
*** zackf1 is now known as zackf20:27
*** ashish_ has quit IRC20:28
openstackgerritA change was merged to openstack/swift: Fixes SUPER important typo in CHANGELOG.  https://review.openstack.org/8419620:31
brianclinephew20:31
Dieterbe><20:36
*** mmcardle has quit IRC20:39
*** tdasilva has left #openstack-swift20:43
notmynamebriancline: finally got that patch in20:45
notmynamewhew20:45
*** bobf1 has joined #openstack-swift20:45
*** bobf has joined #openstack-swift20:47
creihtlol20:47
Dieterbechampagne!20:49
*** bobf has quit IRC20:50
*** bobf1 has quit IRC20:50
notmynameugh20:51
notmynamewhy are swift-container-info and swift-account-info so different? they should be virtually identical except for the Broker used. they don't print out things in the same order or with the same name.20:52
notmynameI'll work on that some night with a glass of tequila20:53
notmynamecreiht: looking at https://review.openstack.org/#/c/81646/ now (PUT if-none-match)20:53
creihtnotmyname: cool, thanks20:55
creihtI need to take a loog about the question about the expect header20:55
creihtlook20:55
notmynamecreiht: should at least be slightly less frustrating than gratuitous differences in helper scripts ;-)20:56
creihtwe've been a bit busy, but should be back on track tomorrow20:56
creihtheh20:56
notmynamecreiht: you're busy because you have team outings. have less fun, get more done ;-)20:56
creihtlol20:56
creihtwell today I'm working out my openstack summit stuff20:57
notmynamecool20:57
creihtwe finally got perms to go, so working out final details20:57
notmynamecreiht: who's going?21:00
creihtI don't remember the entire list21:01
creihtbut gholt will be for sure21:01
creihtscott and jason21:02
notmynamecreiht: great!21:02
notmynameredbo: you going?21:02
notmynamepandemicsyn: ?21:02
creihtnot this time21:02
notmynamesaving for paris? ;-)21:02
creihtI think we have to split a bit between the summit and the hackathon21:02
creihtsince they are so close together21:03
notmynameya21:03
pandemicsynnotmyname: yea i opted for hackathon, this way i can come and help make swift "operationally awesome!"21:03
notmynameI expect the hackathon to be slightly more productive as far as "get stuff done" goes, but I'm looking forward to the summit to.21:03
notmynamepandemicsyn: "more operationally awesomer"21:03
creihtoperationalr21:04
portantenotmyname: in my gerrit view that in-process functional tests says it is status "Work in Progess", unless I am not looking at the same thing, https://review.openstack.org/6610821:04
portantepatchbot: p 6610821:04
patchbotportante: https://review.openstack.org/#/c/66108/21:04
notmynamepandemicsyn: ie, code a clone of (pandemicsyn, ahale, strunk, perm) into the code21:04
notmynameportante: ah, yes21:05
Alex_Gaynorchmouel: thanks.21:05
notmynameportante: think you'll get that non-WIP by EOD tomorrow?21:06
*** briancline has quit IRC21:06
notmynameportante: otherwise, it will be more difficult to get it into icehouse21:06
notmynameportante: it's not really blocking anything, but it's nice to have IMO21:06
creihtnotmyname: http://summit.openstack.org/cfp/details/19221:07
portantenotmyname: I might be able to, just still buried with lots of stuff21:07
creihti wonder if that one should be in the cross-product group?21:07
notmynameI'm more concerned about the if-none-match and the range on SLOs actually21:07
portantenotmyname: can't say that I blame you21:08
redbonotmyname: this is Rackspace, I won't know if I can go until 3 days before.21:08
notmynameredbo: it's like a spy agency? they had you a passport and a plane ticket on your way out of the office and tell you the plane leaves in 3 hours?21:08
redboOh, sorry, I'm not going to the summit.  Possibly on the other thing.21:11
*** _bluev1 has joined #openstack-swift21:13
gholtNever take the same route to work twice.21:13
*** _bluev has quit IRC21:15
*** JuanManuelOlle has quit IRC21:16
*** briancline has joined #openstack-swift21:16
brianclinenotmyname: much appreciated. I'll pull some weight soon to account for the wasted 9h50m of test runner time :p21:18
*** csd has joined #openstack-swift21:20
zaitcevnotmyname: I wated to test and re-read one more time. The code in 80383 looked safe against regressions.21:40
notmynamepatchbot: p 8038321:40
patchbotnotmyname: https://review.openstack.org/#/c/80383/21:40
notmynamezaitcev: cool. so no issues with merging it?21:41
*** piyush has quit IRC21:54
zaitcevnotmyname: I'm fine with it.21:55
zaitcevI'm just ashamed not to know much about DLO and SLO. I only read how they work, but never looked closer.21:55
*** sungju_ has joined #openstack-swift21:57
*** marcusvrn has quit IRC21:58
*** tburnes has quit IRC22:01
*** _bluev1 has quit IRC22:08
*** piousbox has quit IRC22:13
*** changbl has quit IRC22:13
*** dmsimard has quit IRC22:19
*** Midnightmyth has quit IRC22:37
*** erlon has quit IRC22:52
notmynamecreiht: still here?23:01
notmynamecreiht: comments left. I hope I was lucid enough with my questions about if-none-match23:09
notmynamecreiht: just looking for understanding, first23:09
*** piousbox has joined #openstack-swift23:23
piousboxhello23:23
piousboxLooking at the API, can an object have a slash (/) in it?23:23
piousboxPOST/v1/{account}/{container}/{object}23:24
piousboxCreates or updates object metadata.23:24
piousbox{object} is like a filename, or like a path?23:24
ctennispiousbox: yes objects can have a slash in their name23:24
piousboxthanks23:25
piousboxctennis: thanks23:25
piousboxctennis, is there a page in the docs that actually says that? I believe you but if I have to argue this to my manager I'd like a reference23:31
piousboxctennis: from here http://docs.openstack.org/api/openstack-object-storage/1.0/content/COPY_copyObject_v1__account___container___object__storage_object_services.html I am getting that slashes in object names are not allowed23:33
anticwpiousbox: slashes in object names work23:48
piousboxanticw: okay, thanks.23:51
*** RockKuo_iPad has joined #openstack-swift23:57
*** RockKuo_iPad has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!