Thursday, 2017-10-19

*** gouthamr has joined #openstack-manila00:19
*** wes_dillingham has joined #openstack-manila00:46
*** masuberu has joined #openstack-manila01:00
*** masber has quit IRC01:04
*** junboli has joined #openstack-manila01:17
*** kaisers_ has joined #openstack-manila01:26
*** kaisers has quit IRC01:29
*** masber has joined #openstack-manila01:44
*** masuberu has quit IRC01:47
*** markstur has quit IRC01:56
*** zhiguo has joined #openstack-manila02:05
*** masber has quit IRC02:19
*** openstackgerrit has joined #openstack-manila02:53
openstackgerritMerged openstack/manila-specs master: Add count info in /shares and /shares/detail response  https://review.openstack.org/50193402:53
openstackgerritzhiguo.li proposed openstack/python-manilaclient master: List Share Network: Implement /v2/{tenant_id}/share-networks/detail  https://review.openstack.org/51137602:54
*** gouthamr has quit IRC02:57
*** sapcc-bot1 has joined #openstack-manila03:09
*** sapcc-bot has quit IRC03:12
*** toabctl has quit IRC03:14
openstackgerritzhiguo.li proposed openstack/manila master: Fix NoneType error when 'access_mapping' is None  https://review.openstack.org/50429603:21
*** toabctl has joined #openstack-manila03:21
*** arnewiebalck has quit IRC04:14
*** zhiguo has quit IRC04:36
*** wes_dillingham has quit IRC04:40
*** arnewiebalck_ has joined #openstack-manila04:49
*** sage__ has quit IRC05:15
*** masber has joined #openstack-manila05:15
*** sage__ has joined #openstack-manila05:16
*** masuberu has joined #openstack-manila05:17
*** masber has quit IRC05:19
*** hoonetorg has quit IRC06:09
*** jprovazn has joined #openstack-manila06:09
*** hoonetorg has joined #openstack-manila06:25
openstackgerritMerged openstack/python-manilaclient master: Add MAPRFS protocol in create help  https://review.openstack.org/50745406:32
*** kaisers has joined #openstack-manila06:41
*** kaisers_ has quit IRC06:42
*** zhiguo has joined #openstack-manila06:45
*** arnewiebalck_ has quit IRC06:51
*** pcaruana has joined #openstack-manila06:55
*** markstur has joined #openstack-manila07:02
*** markstur has quit IRC07:06
masuberugood afternoon, I got manila installed a couple of days ago and got my first share already setup07:10
masuberunow I wanted to extend the share so I first updated my quota and then ran manila extend but the operation ended with an error07:11
masuberuI can't find anything in the logs, what can I do?07:11
masuberuso the status of the share right now is "extending_error"07:12
zhongjunmasuberu: Did you open the debug log level?07:13
zhongjunmasuberu: What is your backend driver?07:13
zhongjunmasuberu: You could use reset-state command to reset your share status to 'available', then extend again and see what happens.07:16
masuberuzhongjun, NFS and ceph as a backend storage07:20
masuberuok, let me reset the status and try again07:20
masuberuzhongjun, same issue07:23
masuberuzhongjun, yes I did enable the debug logs07:23
masuberuso which log file should I be looking at?07:23
zhongjunmasuberu: you still can not find anything in the logs?07:23
openstackgerritjunbo.li proposed openstack/manila master: [Api-ref] update parameters for share types api  https://review.openstack.org/50654607:24
masuberuyes I found it07:25
masuberuzhongjun, http://paste.openstack.org/raw/624055/07:25
zhongjunmasuberu: It looks like we have a bug in translate_volume_exception07:38
masuberuok07:39
masuberuzhongjun, are a manila developer?07:42
zhongjunmasuberu: but it is not the reason  of the extend share fail07:48
zhongjunmasuberu: yes07:49
masuberuzhongjun, is has also broken the share, now my vms can't access it now07:49
zhongjunmasuberu: What's your manila version07:49
masuberuzhongjun, 1.17.207:49
masuberuzhongjun, look the storage folder which is a shared drive http://paste.openstack.org/raw/624056/07:51
zhongjunmasuberu: your vms can access before?07:52
masuberuzhongjun, yes, that is why I decided to expand the share, because I saw it was running short of space07:53
*** gcb has quit IRC07:55
zhongjunmasuberu: https://github.com/openstack/manila/blob/master/manila/share/drivers/generic.py#L64207:57
zhongjunmasuberu: We will umount volume, _detach_volume before we extend volume. So if the extend volume operation is failure, the share is broke07:59
masuberuI see08:00
masuberubut I umount it and then mount it back08:00
masuberuand now it is empty08:00
zhongjunyou mount it back manually?08:02
masuberuzhongjun, sorry it doesn't let me mount it08:06
masuberumount.nfs: access denied by server while mounting 10.254.0.7:/shares/share-b582a372-e82b-49b2-87ff-e8054dd7db0508:06
masuberuzhongjun, yes I mount it manually08:06
zhongjunmasuberu: It looks like you need to find the real reason about why extend share is fail in  https://github.com/openstack/manila/blob/master/manila/volume/cinder.py#L33108:07
zhongjunmasuberu: in your environment08:08
masuberuoh08:08
masuberuok08:08
masuberuERROR cinder.volume.api [req-357fbd99-f1e3-476f-9f1f-e2443e082459 - - - - -] Quota exceeded for 67512ed5765f425fba4277a28b36adb3, tried to extend volume by 1000G, (1000G of 1000G already consumed).08:08
masuberuthis may be the real issue then08:09
zhongjunmasuberu: We used the cinder interface to extend the volume.08:09
zhongjunmasuberu: okay, then you find it.08:09
masuberuok, sorry I miss this08:10
masuberu*missed08:10
zhongjunmasuberu: :) It is ok08:11
masuberuI am not sure if I understand what is happening, so cinder complains about the quota saying that the limit is 1000G and I am already consuming it08:12
masuberubut openstack quota show says I have 30000 gigabytes08:12
zhongjunmasuberu: you have 30000 gigabytes in  67512ed5765f425fba4277a28b36adb3 project?08:14
masuberuno08:14
masuberuonly 1000 gigabytes08:15
zhongjunmasuberu: It would be better to check the db table08:15
masuberuok08:15
masuberulet me check08:15
masuberuzhongjun, so you mean I have to check mariadb --> nova schema and quota_usage table?08:26
masuberuis that right?08:26
*** AlexeyAbashkin has joined #openstack-manila08:28
masuberuoh ok sorry, cinder schema also has a quota table with the gigabytes field08:28
zhongjunmasuberu:   yes, cinder schema itself08:28
*** gcb has joined #openstack-manila08:28
masuberuzhongjun, could you please help to understand this http://paste.openstack.org/show/624057/?08:35
masuberuI don't understand why cinder quota_usage shows 5000 for the admin project but openstack quota show says 3000008:36
zhongjunmasuberu: There are two projects08:36
masuberuyes but I login as admin08:36
masuberuthe other project is for "service"08:38
zhongjunmasuberu: you use manila to create a cinder volume. Could you check your volume db about what project the volume belong to08:40
zhongjunmasuberu: volume table in cinder schema08:41
masuberuok08:41
zhongjunmasuberu: you can check your manila.conf08:42
zhongjunmasuberu: there are some options about cinder  in cinder node08:42
zhongjunmasuberu: The default project name is set to service " project_name = service"08:43
masuberuyes you are right so the manila volume belongs tot he service project with id 67512ed5765f425fba4277a28b36adb308:43
masuberuand according to cinder quota that project has maximum of 1000 which matches the cinder error message when I tried to extend the volume using manila08:44
zhongjunmasuberu: yes08:44
masuberuso manila is using the service project to create volumes08:45
masuberuok i understand now08:45
zhongjunmasuberu: good08:45
masuberuthank you08:45
zhongjunmasuberu: you are welcome08:45
*** dsariel has joined #openstack-manila08:49
masuberuzhongjun, so can I change this settings so manila will use the quota from the same user creating the shares instead of service?08:50
openstackgerritRaissa Sarmento proposed openstack/manila master: Migrating legacy jobs  https://review.openstack.org/51255909:15
*** lpetrut has joined #openstack-manila09:29
*** junboli has quit IRC09:33
*** ganso has joined #openstack-manila09:48
*** vivsoni has quit IRC09:53
*** vivsoni has joined #openstack-manila09:53
*** markstur has joined #openstack-manila10:38
*** markstur has quit IRC10:43
*** wes_dillingham has joined #openstack-manila10:48
masuberuzhongjun, ok, I have expanded the share but now it says mount.nfs: access denied by server while mounting 10.254.0.7:/shares/share-b582a372-e82b-49b2-87ff-e8054dd7db0510:56
*** wes_dillingham has quit IRC10:56
masuberubut access has been allowed as I get this when I run manila allow-access ERROR: Share access ip:192.168.1.108 exists.10:57
zhongjunmasuberu: yeah, you could change this setting, but we usually don't do that, we want to distinguish the tenant between admin and service11:05
zhongjunmasuberu: You could remove it and then added it11:05
masuberuok11:06
masuberuso what happened then, the tenant of the share has changed from admin to service?11:06
masuberu?11:07
masuberuzhongjun, sorry do you mean remove the share?11:08
masuberuam I going to loose data?11:09
zhongjunmasuberu: no, just access ?11:09
masuberuok ok11:10
*** tpsilva has joined #openstack-manila11:16
*** AlexeyAbashkin has quit IRC11:24
*** AlexeyAbashkin has joined #openstack-manila11:26
*** zhiguo has quit IRC11:42
*** AlexeyAbashkin has quit IRC11:51
*** eharney has joined #openstack-manila11:52
*** AlexeyAbashkin has joined #openstack-manila11:55
*** catintheroof has joined #openstack-manila12:27
*** catintheroof has quit IRC12:42
*** catintheroof has joined #openstack-manila12:51
*** catintheroof has quit IRC12:53
*** zhiguo has joined #openstack-manila12:57
*** wes_dillingham has joined #openstack-manila12:58
*** dustins has joined #openstack-manila13:02
*** xyang1 has joined #openstack-manila13:54
*** markstur has joined #openstack-manila13:57
*** markstur has quit IRC14:01
*** gouthamr has joined #openstack-manila14:20
*** zhiguo has quit IRC14:35
*** markstur has joined #openstack-manila15:00
*** dsariel has quit IRC15:05
*** MVenesio has joined #openstack-manila15:21
gouthamrwonder if the Cinder ChangeID on this change: https://review.openstack.org/#/c/509152/ is messing up the CI for Generic and NetApp drivers15:49
gouthamrvery weird, complains of a conflicting configuration option in the cinder tempest plugin and manila15:50
gouthamrhttp://logs.openstack.org/52/509152/8/check/legacy-manila-tempest-dsvm-mysql-generic/d3455e2/job-output.txt.gz#_2017-10-14_19_17_12_49383315:51
openstackgerritGoutham Pacha Ravi proposed openstack/manila-image-elements master: DNM  https://review.openstack.org/51343015:58
gouthamr^ i thought we recently concluded that the image is being tested from build in the job... so just testing again15:59
bswartzzhongjun: what didn't get updated?16:00
tbarrongouthamr: well I hope I'm wrong!16:00
tbarrondustins: that was quite productive I think, all hail the bug czar!16:01
dustinswoooo16:01
bswartzzhongjun: according to http://tarballs.openstack.org/manila-image-elements/images/ the last image was updated 2017-9-2716:01
bswartzthat looks accurate16:01
zhongjunI asked infra guys, they check their environment, he said we build the right image, but translate image to tarball link if fail16:01
dustinsStill a lot more to do, but we're getting there!16:01
zhongjuns/if /is16:01
gouthamrtbarron: this was added just for building on the gate, and moving the image built to the public_html directory so it can be downloaded from the slave node itself: https://github.com/openstack/manila-image-elements/blob/master/tools/gate/build-images16:02
zhongjunbswartz: Then he update it for us   manually16:02
gouthamrzhongjun: ouch, that kinda could explain what's going on :P16:02
bswartzinteresting16:02
bswartzI observed it working very shortly after we forced a rebuild, and I presumed the automated upload worked16:03
bswartzif there's another issue that needs fixing, we should capture that and file another bug16:03
bswartz+1 all hail the bug czar16:03
tbarrongouthamr: maybe I mis-read the logs then.16:03
zhongjunbswartz: Acutally, yeah, it is not the automated upload work16:03
zhongjunbswartz: The automated upload work have some problem, but he didn't know why 300MB image will changed to 230MB image after translate16:05
*** ianychoi has quit IRC16:06
openstackgerritAlexander Pugachev proposed openstack/python-manilaclient master: Increase code coverage  https://review.openstack.org/51343316:07
*** ianychoi has joined #openstack-manila16:07
*** lpetrut has quit IRC16:07
tbarrongouthamr: when your new image is built I'll look at the logs again.  Hopefully we'll see that it's checking the image from this local webserver and I was hallucinating.16:10
*** dustins_ has joined #openstack-manila16:17
*** pcaruana has quit IRC16:18
gouthamrtbarron: i was scouring through older logs, funnily all the log files are deleted, the folders aren't :P16:20
tbarrongouthamr: nice (not)16:21
*** MVenesio has quit IRC16:21
*** dustins has quit IRC16:27
*** lpetrut has joined #openstack-manila16:43
*** AlexeyAbashkin has quit IRC16:46
*** lpetrut has quit IRC16:57
*** lpetrut has joined #openstack-manila17:10
*** MVenesio has joined #openstack-manila17:58
*** chenying has quit IRC18:13
*** chenying has joined #openstack-manila18:13
*** AlexeyAbashkin has joined #openstack-manila18:19
*** AlexeyAbashkin has quit IRC18:23
*** lpetrut has quit IRC18:24
*** markstur has quit IRC18:34
gouthamrtbarron bswartz: http://logs.openstack.org/30/513430/1/check/legacy-manila-tempest-dsvm-generic-scenario-custom-image/dd0355d/job-output.txt.gz#_2017-10-19_17_54_56_47050318:41
bswartzgouthamr tbarron: http://logs.openstack.org/30/513430/1/check/legacy-manila-tempest-dsvm-generic-scenario-custom-image/dd0355d/logs/devstacklog.txt.gz#_2017-10-19_18_16_12_14118:45
gouthamrthis one? http://logs.openstack.org/30/513430/1/check/legacy-manila-tempest-dsvm-generic-scenario-custom-image/dd0355d/logs/devstacklog.txt.gz#_2017-10-19_17_55_14_48918:45
gouthamro.O18:45
bswartzjust sayin, it appears to not work as intended18:46
bswartzIDK what the bug is, but the evidence points to a bug18:46
*** arnewiebalck_ has joined #openstack-manila18:49
gouthamr+118:49
gouthamrwait, the MANILA_SERVICE_IMAGE_URL is being set in post-test-hook18:50
gouthamrpre_test_hook*18:51
bswartztoo early or too late?18:51
gouthamrbefore the drivers are started...18:51
bswartzneeds to be set before the devstack plugin runs18:52
bswartzbecause the devstack plugin is what installs the service image18:52
bswartzso it should be in local.conf18:52
gouthamryou're right... however, something in the image build's failed too18:54
bswartzI think that's what zhongjun was alluding to18:54
gouthamrsh: 1: debootstrap: not found18:54
bswartzin the meeting before lunch18:54
bswartz>_<18:54
bswartzsudo apt-get -y install debootstrap18:55
*** MVenesio has quit IRC19:07
gouthamrso that's mentioned in bindep.txt, and perhaps that needs some tinkering with ZuulV3?19:09
gouthamrwe don't have a bindep tox environment though19:12
*** AlexeyAbashkin has joined #openstack-manila19:17
*** AlexeyAbashkin has quit IRC19:21
*** lpetrut has joined #openstack-manila19:44
*** dsariel has joined #openstack-manila19:56
*** jprovazn has quit IRC20:00
*** kaisers has quit IRC20:01
*** wes_dillingham has quit IRC20:04
*** kaisers has joined #openstack-manila20:11
*** kaisers has quit IRC20:15
*** AlexeyAbashkin has joined #openstack-manila20:17
*** dsariel has quit IRC20:17
*** AlexeyAbashkin has quit IRC20:21
*** markstur has joined #openstack-manila20:26
openstackgerritMerged openstack/manila master: doc: move stuff from contributor to admin  https://review.openstack.org/50815720:32
*** AlexeyAbashkin has joined #openstack-manila20:38
*** AlexeyAbashkin has quit IRC20:42
*** AlexeyAbashkin has joined #openstack-manila20:59
*** AlexeyAbashkin has quit IRC21:03
*** arnewiebalck_ has quit IRC21:04
*** gouthamr has quit IRC21:15
*** lpetrut has quit IRC21:39
*** tpsilva has quit IRC21:42
*** xyang1 has quit IRC21:47
*** wes_dillingham has joined #openstack-manila21:56
openstackgerritVictoria Martinez de la Cruz proposed openstack/manila master: CentOS share node install docs  https://review.openstack.org/51289522:01
*** dustins_ has quit IRC22:01
*** kaisers has joined #openstack-manila22:12
*** kaisers has quit IRC22:16
*** drico_ has quit IRC22:21
*** drico_ has joined #openstack-manila22:27
*** drico_ has quit IRC22:41
*** drico_ has joined #openstack-manila22:47
*** wes_dillingham has quit IRC23:15
*** AlexeyAbashkin has joined #openstack-manila23:16
*** AlexeyAbashkin has quit IRC23:21
*** wes_dillingham has joined #openstack-manila23:26
openstackgerritMerged openstack/puppet-manila master: Prepare for Queens Milestone 1  https://review.openstack.org/51283223:38
*** AlexeyAbashkin has joined #openstack-manila23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!