Thursday, 2015-05-07

*** primechuck has quit IRC00:01
*** tsekiyama has quit IRC00:01
*** DCWillia_ has quit IRC00:02
*** annegentle has joined #openstack-cinder00:03
*** swamireddy1 has joined #openstack-cinder00:05
*** annegentle has quit IRC00:08
*** nikeshm has joined #openstack-cinder00:16
openstackgerritEdwin Wang proposed openstack/cinder: Add iSCSI protocol support for IBM FlashSystem  https://review.openstack.org/15620600:21
*** MentalRay has joined #openstack-cinder00:25
*** heyun has joined #openstack-cinder00:26
*** setmason has joined #openstack-cinder00:27
*** zhenguo has joined #openstack-cinder00:28
*** IlyaG has quit IRC00:28
*** adurbin_ has quit IRC00:31
*** annegentle has joined #openstack-cinder00:39
*** DCWilliams_VA has joined #openstack-cinder00:40
*** setmason has quit IRC00:40
*** nikeshm has quit IRC00:44
*** IlyaG has joined #openstack-cinder00:45
*** _cjones_ has quit IRC00:47
*** IanGovett1 has joined #openstack-cinder00:49
*** IanGovett has quit IRC00:49
*** leeantho has quit IRC00:51
*** IlyaG has quit IRC00:52
*** daneyon_ has quit IRC00:53
*** annegentle has quit IRC00:56
*** shakamunyi has quit IRC01:02
*** jungleboyj has joined #openstack-cinder01:08
*** DCWilliams_VA has quit IRC01:12
*** primechuck has joined #openstack-cinder01:24
*** Lee1092 has joined #openstack-cinder01:25
*** setmason has joined #openstack-cinder01:27
openstackgerritThang Pham proposed openstack/cinder: WIP: Object pinning  https://review.openstack.org/18039301:31
*** dannywilson has quit IRC01:31
*** IlyaG has joined #openstack-cinder01:31
openstackgerritThang Pham proposed openstack/cinder: WIP: Object pinning  https://review.openstack.org/18039301:33
openstackgerritThang Pham proposed openstack/cinder: WIP: Object pinning  https://review.openstack.org/18039301:36
*** vincent_hou has joined #openstack-cinder01:36
*** Yogi1 has joined #openstack-cinder01:41
*** Apoorva has quit IRC01:46
*** Yogi1 has quit IRC01:46
*** Yogi1 has joined #openstack-cinder01:48
*** _cjones_ has joined #openstack-cinder01:48
*** swamireddy1 has quit IRC01:48
*** vilobhmm1 has quit IRC01:56
*** annegentle has joined #openstack-cinder01:56
*** patrickeast has quit IRC01:59
*** erlon has quit IRC02:01
*** annegentle has quit IRC02:02
*** shakamunyi has joined #openstack-cinder02:10
*** vincent_hou has quit IRC02:12
*** primechuck has quit IRC02:13
*** mriedem has quit IRC02:14
openstackgerritOpenStack Proposal Bot proposed openstack/cinder: Updated from global requirements  https://review.openstack.org/17841002:14
openstackgerritLin Yang proposed openstack/python-cinderclient: Fix typo in comment message  https://review.openstack.org/17902002:20
openstackgerritOpenStack Proposal Bot proposed openstack/os-brick: Updated from global requirements  https://review.openstack.org/18083002:20
*** _cjones_ has quit IRC02:27
*** vincent_hou_ has joined #openstack-cinder02:29
*** vincent_hou_ is now known as vincent_hou02:31
*** mtanino has quit IRC02:32
jgriffithvincent_hou: given that the feature was written by IBM I would fully expect it to work with Stwz02:35
*** heyun has quit IRC02:35
*** bkopilov has quit IRC02:35
*** Yogi1 has quit IRC02:38
*** r-daneel has quit IRC02:49
*** dims_ has quit IRC02:51
*** dims has joined #openstack-cinder02:52
*** jungleboyj has quit IRC02:56
*** annegentle has joined #openstack-cinder02:57
*** setmason has quit IRC02:58
*** setmason has joined #openstack-cinder03:01
*** markvoelker has quit IRC03:04
jgriffithvincent_hou: hmm... https://www.dropbox.com/s/ozrnfbr52dqctny/Screenshot%202015-05-06%2021.05.32.png?dl=003:05
jgriffithvincent_hou: so retype w/migrate once seems to have worked fine as the cleanup is on the LVM volume by name03:06
jgriffithvincent_hou: but then try and retype again....03:06
*** heyun has joined #openstack-cinder03:06
jgriffithvincent_hou: not only does it say it "worked"03:06
jgriffithvincent_hou: but it lied :)03:06
jgriffithvincent_hou: and it gets worse...03:07
jgriffithvincent_hou: delete the volume03:07
jgriffithvincent_hou: the call goes to the DB and deltes it just fine03:07
jgriffithvincent_hou: HOWEVER it sent the command to the lvm backend (wrong backend)03:07
jgriffithvincent_hou: which the "delete non-existent volume" passes (by design)03:08
jgriffithvincent_hou: so user thinks the volume is deleted/gone03:08
jgriffithvincent_hou: but in reality it's stillon the backend03:08
jgriffithvincent_hou: ^^  That's what smcginnis and tbarron were trying to explain in the bug03:08
vincent_houjgriffith: Hmm, that is a really bad issue.03:09
jgriffithvincent_hou: yes, I'd agree03:09
vincent_houjgriffith: Thank you for the testing. It helps me to better understand this issue.03:10
jgriffithvincent_hou: no problem :)03:11
jgriffithvincent_hou: let me know if you're going to keep the bug and owrk on it03:11
jgriffithvincent_hou: otherwise I can look at working on it later this week03:11
*** dims has quit IRC03:11
vincent_houjgriffith: Sure I will keep on it.03:12
jgriffithvincent_hou: cool, let's touch base tomorrow and see how things are going03:12
jgriffithvincent_hou: I'd like to get this fixed/closed and backported *soon*03:12
vincent_houjgriffith: OK.03:13
jgriffithvincent_hou: and on that note... I'm going to feed some horses and call it a night :)03:13
jgriffithvincent_hou: take care!!03:13
vincent_houjgriffith: Thanks. Good night.03:14
jgriffithvincent_hou: although I may be back... this whole WARNING keyston auth.identity thing is REALLY pissing me off at this point03:14
vincent_houjgriffith: what is the bug number?03:15
jgriffithvincent_hou: for the keystone thing?03:15
vincent_houjgriffith: Yeah. You said the issue bothers you.03:16
vincent_houIs it really bad for the release?03:16
jgriffithvincent_hou: http://goo.gl/t0e1dO03:16
jgriffithvincent_hou: thingee and morganfainberg have been working it, think they're just going to remove the warning message in keystoneclient last I heard03:17
vincent_houjgriffith: OK.03:18
morganfainbergjamielennox: ^^ was that the resulting plan?03:18
jamielennoxthe fix was merged for that, has there been a cinderclient release lately?03:18
jgriffithjamielennox: haha... nope03:18
morganfainbergDid we release the ksc?03:18
jgriffithjamielennox: but I'd PAY good money to be allowed to do one now :)03:18
jamielennoxthe last one isn't that old:  2015-04-2103:19
jgriffithmorganfainberg: jamielennox yeah, so I thought we just needed it in KSC?03:19
*** setmason has quit IRC03:19
jgriffithjamielennox: morganfainberg so maybe I was mistaken that I thought this was in progress?03:20
jamielennoxhttps://review.openstack.org/#/c/178439/03:20
morganfainbergAhh so just need cinder client.03:20
morganfainbergCool.03:20
jamielennoxso there was an issue on the receiving end, for every one of those requests there was a corresponding failure warning in auth_token middleware which we silenced and released03:20
jgriffithjamielennox: oh, so that's better then, I thought this was only "1/2" of the fix03:21
morganfainbergYeah ksm is fixed.03:21
* morganfainberg should verify a stable ksm was released.03:21
jamielennoxafaik if you check out master then this issue is resolved03:21
morganfainbergBeen a busy month... Can't remember if I did stable ksm yet.03:21
jamielennoxmaster cinderclient03:21
jgriffithjamielennox: morganfainberg OK.. SWEET03:22
jgriffithjamielennox: morganfainberg just installed master and indeed, we're good :)03:22
jgriffithjamielennox: morganfainberg sorry for bugging/invoking you on that :)03:22
jamielennoxno worries03:22
morganfainbergjgriffith: all good.03:22
jgriffithjamielennox: morganfainberg I'll beg thingee to do a tag/push tomorrow03:22
jgriffithno reason not to now that we've released03:23
jgriffithjamielennox: morganfainberg and on that note, both of you have a fantastic evening03:23
* jgriffith has left the building03:23
*** annegentle has quit IRC03:25
thingeejgriffith, jamielennox: I was waiting on some stuff to land. Looks like it merged today, so I can proceed.03:26
morganfainbergHehe03:26
jgriffiththingee: SWEEET!!!!03:26
jgriffithwhat a great day :)03:27
*** setmason has joined #openstack-cinder03:31
*** sgotliv has joined #openstack-cinder03:31
*** nikeshm has joined #openstack-cinder03:36
*** IlyaG has quit IRC03:37
*** setmason has quit IRC03:38
*** IanGovett1 has quit IRC03:40
*** lpetrut has joined #openstack-cinder03:41
*** rhefner has quit IRC03:44
*** daneyon has joined #openstack-cinder03:45
*** links has joined #openstack-cinder03:45
*** nikeshm has quit IRC03:46
*** _cjones_ has joined #openstack-cinder03:53
*** MentalRay has quit IRC03:53
*** MentalRay has joined #openstack-cinder03:53
*** ebalduf has joined #openstack-cinder03:56
*** _cjones_ has quit IRC03:57
*** setmason has joined #openstack-cinder03:58
*** shyama has joined #openstack-cinder04:00
*** bkopilov has joined #openstack-cinder04:01
*** ebalduf has quit IRC04:01
*** emagana has quit IRC04:03
*** markvoelker has joined #openstack-cinder04:04
openstackgerritwanghao proposed openstack/cinder: Notification with volume and snaphost metadata  https://review.openstack.org/18040004:07
*** markvoelker has quit IRC04:09
*** setmason_ has joined #openstack-cinder04:12
*** setmason has quit IRC04:13
*** setmason_ is now known as setmason04:13
openstackgerritMike Perez proposed openstack/python-cinderclient: Update release notes for 1.2.0 and 1.2.1  https://review.openstack.org/18085204:17
thingeejgriffith: ^04:18
openstackgerritMike Perez proposed openstack/python-cinderclient: Update release notes for 1.2.0 and 1.2.1  https://review.openstack.org/18085204:18
*** swamireddy1 has joined #openstack-cinder04:21
*** shyama has quit IRC04:36
*** lpetrut has quit IRC04:40
*** swamireddy1 has quit IRC04:40
*** sgotliv has quit IRC04:40
*** sgotliv has joined #openstack-cinder04:40
*** swamireddy1 has joined #openstack-cinder04:40
*** emagana has joined #openstack-cinder04:41
*** avishay has joined #openstack-cinder04:45
*** emagana has quit IRC04:46
*** MentalRay has quit IRC04:47
*** shyama has joined #openstack-cinder04:47
*** setmason has quit IRC04:53
*** setmason has joined #openstack-cinder04:54
*** BharatK has quit IRC04:56
*** setmason has quit IRC05:00
*** swamireddy1 has quit IRC05:03
*** coolsvap|afk is now known as coolsvap05:03
*** nkrinner has joined #openstack-cinder05:04
*** markvoelker has joined #openstack-cinder05:05
*** markvoelker has quit IRC05:10
*** BharatK has joined #openstack-cinder05:12
*** swamireddy1 has joined #openstack-cinder05:12
*** vilobhmm1 has joined #openstack-cinder05:12
*** IlyaG has joined #openstack-cinder05:21
*** mdbooth has quit IRC05:27
*** mdbooth has joined #openstack-cinder05:31
*** Longgeek has joined #openstack-cinder05:33
*** emagana has joined #openstack-cinder05:35
*** sgotliv has quit IRC05:39
*** emagana has quit IRC05:40
*** _cjones_ has joined #openstack-cinder05:42
*** tshefi has joined #openstack-cinder05:44
*** _cjones_ has quit IRC05:46
*** markvoelker has joined #openstack-cinder05:51
*** vincent_hou_ has joined #openstack-cinder05:53
*** vincent_hou has quit IRC05:54
*** vincent_hou_ is now known as vincent_hou05:54
*** markvoelker has quit IRC05:56
*** shyama has quit IRC05:56
*** shyama has joined #openstack-cinder05:56
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087305:57
*** agarciam has joined #openstack-cinder05:58
*** vilobhmm1 has quit IRC05:59
*** nlevinki has joined #openstack-cinder06:02
*** deepakcs has joined #openstack-cinder06:06
*** Longgeek has quit IRC06:06
*** anshul has joined #openstack-cinder06:17
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087306:23
openstackgerritwanghao proposed openstack/cinder-specs: Adds support to force-delete backups  https://review.openstack.org/9832506:23
*** IlyaG has quit IRC06:26
*** IlyaG has joined #openstack-cinder06:26
*** IlyaG has quit IRC06:31
*** vincent_hou has quit IRC06:35
*** emagana has joined #openstack-cinder06:37
*** emagana has quit IRC06:42
*** alecv has joined #openstack-cinder06:45
*** lpetrut has joined #openstack-cinder06:47
*** markvoelker has joined #openstack-cinder06:52
*** nlevinki has quit IRC06:52
*** shyama has quit IRC06:55
*** dannywilson has joined #openstack-cinder06:55
*** dannywilson has quit IRC06:56
*** markvoelker has quit IRC06:56
*** dannywilson has joined #openstack-cinder06:57
*** ronis has joined #openstack-cinder06:58
*** avishay_ has joined #openstack-cinder07:00
*** avishay has quit IRC07:01
*** ankit_ag has joined #openstack-cinder07:01
*** Longgeek has joined #openstack-cinder07:07
*** alecv has quit IRC07:11
*** alecv has joined #openstack-cinder07:13
*** Longgeek has quit IRC07:21
*** Longgeek has joined #openstack-cinder07:21
*** dulek has joined #openstack-cinder07:24
openstackgerritwanghao proposed openstack/cinder: Notification with volume and snaphost metadata  https://review.openstack.org/18040007:28
*** avishay_ has quit IRC07:29
*** avishay_ has joined #openstack-cinder07:29
*** _cjones_ has joined #openstack-cinder07:30
*** markus_z has joined #openstack-cinder07:31
*** lpetrut has quit IRC07:31
*** emagana has joined #openstack-cinder07:32
*** _cjones_ has quit IRC07:35
*** emagana has quit IRC07:36
*** takedakn has joined #openstack-cinder07:37
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087307:39
*** sgotliv has joined #openstack-cinder07:40
*** jordanP has joined #openstack-cinder07:41
*** lpetrut has joined #openstack-cinder07:42
*** takedakn has quit IRC07:44
*** jistr has joined #openstack-cinder07:54
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087308:02
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087308:08
openstackgerritAnton Arefiev proposed openstack/python-cinderclient: Add findall server side filtering  https://review.openstack.org/18053408:14
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087308:19
*** pck has quit IRC08:21
*** pck has joined #openstack-cinder08:21
*** e0ne has joined #openstack-cinder08:23
*** emagana has joined #openstack-cinder08:26
*** IlyaG has joined #openstack-cinder08:27
*** dannywilson has quit IRC08:28
*** dannywilson has joined #openstack-cinder08:30
*** emagana has quit IRC08:31
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087308:51
*** markvoelker has joined #openstack-cinder08:53
openstackgerritwanghao proposed openstack/cinder: Notification with volume and snaphost metadata  https://review.openstack.org/18040008:58
*** markvoelker has quit IRC08:58
*** e0ne is now known as e0ne_09:03
*** dannywilson has quit IRC09:05
*** Miouge has quit IRC09:08
*** aix has joined #openstack-cinder09:14
*** _cjones_ has joined #openstack-cinder09:19
*** emagana has joined #openstack-cinder09:20
*** Miouge has joined #openstack-cinder09:23
*** _cjones_ has quit IRC09:24
*** Miouge has quit IRC09:24
openstackgerritwanghao proposed openstack/cinder: Fix response when query host detail by host name  https://review.openstack.org/16260109:24
*** emagana has quit IRC09:25
openstackgerritwanghao proposed openstack/cinder: Fix response when query host detail by host name  https://review.openstack.org/16260109:29
wanghaohi guys: There is a tiny bug need your help to review: https://review.openstack.org/#/c/162601/. Thanks:)09:30
*** e0ne_ is now known as e0ne09:33
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087309:35
*** dims has joined #openstack-cinder09:36
*** dims has quit IRC09:41
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087309:43
openstackgerritTom Barron proposed openstack/cinder: Use nfs_oversub_ratio when reporting pool capacity  https://review.openstack.org/18019909:46
*** IanGovett has joined #openstack-cinder09:48
*** markvoelker has joined #openstack-cinder09:54
*** markvoelker has quit IRC09:58
*** dims_ has joined #openstack-cinder09:59
*** dulek has quit IRC10:01
*** dulek has joined #openstack-cinder10:02
*** IanGovett1 has joined #openstack-cinder10:02
*** dulek has quit IRC10:03
*** IanGovett has quit IRC10:05
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087310:10
*** emagana has joined #openstack-cinder10:14
*** emagana has quit IRC10:18
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087310:25
deepakcswanghao, ping10:26
*** avishay_ has quit IRC10:31
*** avishay__ has joined #openstack-cinder10:32
*** BharatK has quit IRC10:36
*** swamireddy1 has quit IRC10:37
*** Miouge has joined #openstack-cinder10:37
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087310:40
*** heyun has quit IRC10:42
*** coolsvap is now known as coolsvap|afk10:43
*** sgotliv has quit IRC10:43
deepakcse0ne, ping10:44
e0ne deepakcs: hi10:45
deepakcse0ne, Hello, quick q on ur comment @ https://review.openstack.org/#/c/172808/3/cinder/db/sqlalchemy/api.py10:45
e0nesure10:45
*** Miouge has quit IRC10:45
deepakcse0ne, should i change to _foo(...).( <next line> filter_by(key=key).( <next line> first())10:46
*** ociuhandu has joined #openstack-cinder10:47
e0nedeepakcs: i think yes. we try to go away from \ usage. but we have a lot of it for in cinder/db/sqlalchemy/api.py:(10:47
e0nedeepakcs: my -1 was more for 'deleted_at field' update10:48
e0nei can update my comment10:48
deepakcse0ne, yeah, i inherited what was before, but i am willing to fix my part, just wanted to check the right syntax10:48
*** alexpilotti has joined #openstack-cinder10:49
*** BharatK has joined #openstack-cinder10:49
deepakcse0ne, reg: deleted_at field... how come thats not needed for _volume_x_metadata_update ?10:49
deepakcse0ne, I am new to db changes, so I just followed what volume_admin_metadata api's did, as I wanted to create a similar table10:50
*** agarciam has quit IRC10:50
deepakcse0ne, and turns out that volume_admin_md doesn't update deleted_at ?10:50
*** sgotliv has joined #openstack-cinder10:50
*** alecv has quit IRC10:50
*** agarciam has joined #openstack-cinder10:51
*** cdelatte has quit IRC10:51
e0nedeepakcs: it's confusing10:51
deepakcse0ne, what is confusing ? my q or api.py ?10:52
e0nedeepakcs: in general, we don't update deleted_at manually because we use delete() method of the model10:52
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087310:52
deepakcse0ne, so IIUC , in _update we are updating deleted, hence need to update deleted_at also ?10:53
e0nedeepakcs: but if you somewhy don't use delete() methon you need to do it manually. why not just call model_ref.delete()?10:54
*** markvoelker has joined #openstack-cinder10:55
*** Miouge has joined #openstack-cinder10:58
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087310:58
*** Longgeek has quit IRC10:58
openstackgerritSean McGinnis proposed openstack/cinder: Logging not using oslo.i18n guidelines (db)  https://review.openstack.org/18093910:58
*** Longgeek has joined #openstack-cinder10:58
*** markvoelker has quit IRC11:00
*** alecv has joined #openstack-cinder11:00
*** Miouge has quit IRC11:03
deepakcse0ne, as i said i am new to db code, so I just followed what other (similar looking) table did11:03
deepakcse0ne, model_ref.delete() deletes the whole table or the row associated with model_ref ?11:05
*** _cjones_ has joined #openstack-cinder11:08
*** BharatK has quit IRC11:08
*** emagana has joined #openstack-cinder11:08
*** ebalduf has joined #openstack-cinder11:10
*** swamireddy1 has joined #openstack-cinder11:10
*** ankit_ag has quit IRC11:11
*** ankit_ag has joined #openstack-cinder11:11
*** emagana has quit IRC11:13
*** _cjones_ has quit IRC11:13
*** ebalduf has quit IRC11:14
e0nedeepakcs: actually, it marks row as deleted: https://github.com/openstack/cinder/blob/master/cinder/db/sqlalchemy/models.py#L4711:14
deepakcse0ne, replacing \ with () gives syntax error with flake8, i think for now i will leave the \ as is11:14
*** swamireddy1 has quit IRC11:15
e0nedeepakcs: ok, fair enough to leave it as is and make these changes in all file in a separate patch11:15
deepakcse0ne, :) once i figure what to replace \ with11:16
*** avishay__ has quit IRC11:18
*** avishay__ has joined #openstack-cinder11:18
*** BharatK has joined #openstack-cinder11:20
openstackgerritAbhijeet Malawade proposed openstack/cinder: Cinder os-attach api returns 500  https://review.openstack.org/17856511:21
openstackgerritAbhijeet Malawade proposed openstack/cinder: cinder os-detach api returns 500  https://review.openstack.org/17857811:23
openstackgerritAnkit Agrawal proposed openstack/cinder: Fix missing translations for log messages  https://review.openstack.org/16469211:25
*** agarciam has quit IRC11:25
*** agarciam has joined #openstack-cinder11:25
*** timcl has joined #openstack-cinder11:26
*** e0ne is now known as e0ne_11:27
*** links has quit IRC11:31
*** links has joined #openstack-cinder11:32
*** dulek has joined #openstack-cinder11:38
*** marcusvrn has joined #openstack-cinder11:41
*** marcusvrn2 has quit IRC11:43
*** agarciam has quit IRC11:49
*** agarciam has joined #openstack-cinder11:49
*** nlevinki has joined #openstack-cinder11:49
*** avishay__ has quit IRC11:50
*** avishay has joined #openstack-cinder11:51
*** e0ne_ is now known as e0ne11:51
*** openstackgerrit has quit IRC11:52
*** openstackgerrit has joined #openstack-cinder11:53
*** markvoelker has joined #openstack-cinder11:56
*** swamireddy1 has joined #openstack-cinder11:57
openstackgerritwanghao proposed openstack/cinder: Notification with volume and snaphost metadata  https://review.openstack.org/18040011:58
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087311:59
*** markvoelker has quit IRC12:00
*** lpabon has joined #openstack-cinder12:01
*** emagana has joined #openstack-cinder12:02
*** emagana has quit IRC12:07
openstackgerrityogeshprasad proposed openstack/cinder: Fix the KeyError in CloudByte iSCSI cinder driver  https://review.openstack.org/18096212:10
*** ankit_ag has quit IRC12:11
*** akerr has joined #openstack-cinder12:12
*** ankit_ag has joined #openstack-cinder12:12
*** waterkinfe has joined #openstack-cinder12:13
*** anuragpalsule has joined #openstack-cinder12:15
*** markvoelker has joined #openstack-cinder12:15
*** waterkinfe has quit IRC12:15
*** sgotliv has quit IRC12:20
*** jungleboyj has joined #openstack-cinder12:23
*** fthiagogv has joined #openstack-cinder12:25
*** cdelatte has joined #openstack-cinder12:28
openstackgerritwanghao proposed openstack/cinder-specs: Adds support to force-delete backups  https://review.openstack.org/9832512:35
*** Yogi1 has joined #openstack-cinder12:36
*** bkopilov has quit IRC12:39
*** marcusvrn1 has joined #openstack-cinder12:42
*** fthiagogv has quit IRC12:43
*** swamireddy2 has joined #openstack-cinder12:44
*** swamireddy1 has quit IRC12:44
*** marcusvrn has quit IRC12:45
*** dencaval has joined #openstack-cinder12:45
*** fthiagogv has joined #openstack-cinder12:46
*** sgotliv has joined #openstack-cinder12:49
*** dulek has quit IRC12:50
*** dims_ has quit IRC12:51
*** dims has joined #openstack-cinder12:51
*** bswartz has quit IRC12:53
*** dulek has joined #openstack-cinder12:54
*** deepakcs has quit IRC12:54
*** emagana has joined #openstack-cinder12:57
*** _cjones_ has joined #openstack-cinder12:57
*** IanGovett1 has quit IRC12:58
*** crose has joined #openstack-cinder12:59
*** crose has quit IRC12:59
*** IanGovett has joined #openstack-cinder13:00
*** emagana has quit IRC13:01
*** merooney has joined #openstack-cinder13:01
*** mriedem has joined #openstack-cinder13:02
*** _cjones_ has quit IRC13:02
*** ctina__ has joined #openstack-cinder13:02
*** IanGovett has quit IRC13:10
openstackgerritDeepak C Shetty proposed openstack/cinder: WIP: Cinder part of volume snapshot improvements  https://review.openstack.org/17280813:12
*** IanGovett has joined #openstack-cinder13:13
openstackgerritGorka Eguileor proposed openstack/cinder: Follow i18n guidelines in LIO target  https://review.openstack.org/18052013:14
*** pwehrle has joined #openstack-cinder13:18
*** david-lyle has quit IRC13:19
*** merooney has quit IRC13:20
*** nlevinki has quit IRC13:21
*** openstackstatus has quit IRC13:25
*** openstackstatus has joined #openstack-cinder13:25
*** ChanServ sets mode: +v openstackstatus13:25
openstackgerritPh. Marek proposed openstack/cinder: Re-add DRBD driver.  https://review.openstack.org/17857313:26
*** primechuck has joined #openstack-cinder13:27
*** eharney has quit IRC13:28
*** dustins has joined #openstack-cinder13:28
*** bswartz has joined #openstack-cinder13:29
*** changbl has quit IRC13:33
*** jungleboyj has quit IRC13:33
*** e0ne is now known as e0ne_13:34
*** rushil has joined #openstack-cinder13:35
*** nlevinki has joined #openstack-cinder13:36
*** e0ne_ is now known as e0ne13:37
*** BharatK has quit IRC13:38
*** chlong has joined #openstack-cinder13:39
*** marcusvrn1 has quit IRC13:41
*** marcusvrn has joined #openstack-cinder13:44
*** kashyap has joined #openstack-cinder13:44
*** nlevinki has quit IRC13:47
*** nlevinki has joined #openstack-cinder13:47
*** rushil has quit IRC13:48
*** r-daneel has joined #openstack-cinder13:49
*** esker has joined #openstack-cinder13:50
*** ebalduf has joined #openstack-cinder13:50
kashyapHi folks, an admin question: is it possible to migrate a Cinder volume from one LVM backend to another LVM backend on the _same_ host?13:50
*** jamielennox is now known as jamielennox|away13:51
*** setmason has joined #openstack-cinder13:52
*** swamireddy2 has quit IRC13:52
*** fanyaohong has joined #openstack-cinder13:54
jbernardkashyap: yes..13:54
jbernardkashyap: at least once :)13:54
*** links has quit IRC13:54
*** IanGovett1 has joined #openstack-cinder13:55
kashyapjbernard: Ah, thanks for confirming, you saved time from digging into code (although that'd be a more useful exercise) :-)13:55
kashyapjbernard: I've setup a local DevStack instance w/ two LVM backends13:55
jbernardkashyap: here's a command that should get you close: 'cinder retype --migration-policy on-demand <volume> <backend>'13:55
smcginniskashyap: There is a patch out there right now to address an issue with the aftermath of a migration though: https://review.openstack.org/#/c/180873/13:56
smcginniskashyap: As it is right now, there may be some manual cleanup to delete the volume after migration.13:56
smcginnisSee the referenced bug for more details.13:56
jbernardsmcginnis: thanks13:57
smcginnisjbernard: np!13:57
*** IanGovett has quit IRC13:57
kashyapscottda: jbernard: Thanks, both for the details and URLs. I don't normally test Cinder in my DevStack workflow, now I've made it part of it :-).13:57
kashyapsmcginnis: Is there any place where I can read about this aftermath cleanup?13:58
smcginniskashyap: Just the comments in the bug.13:58
*** geguileo has quit IRC13:59
smcginniskashyap: The main issue being after it's migrated the driver can't find it anymore.13:59
*** delattec has joined #openstack-cinder13:59
smcginniskashyap: So when you try to delete the volume the driver can't find it and thinks it's already gone.13:59
smcginniskashyap: So it returns success.13:59
smcginniskashyap: But the volume is still out there, so you would need to manually run the LVM commands to clean it up.14:00
smcginniskashyap: Also applies to any other operations beside delete where the driver needs to modify the volume.14:00
kashyapsmcginnis: Ah, I see, thanks for this info. I created the 2nd LVM backend, but didn't create the VG, so Cinder complained after a restart. So I just did the sequence of:14:01
kashyap$ truncate -s 10250M /home/kashyapc/src/cloud/data/stack-volumes-lvmdriver-2-backing-file14:01
kashyap$ sudo losetup -f --show /home/kashyapc/src/cloud/data/stack-volumes-lvmdriver-2-backing-file14:01
kashyap$ sudo vgcreate stack-volumes-lvmdriver-2 /dev/loop214:01
kashyapFollowing that, I did this - https://kashyapc.fedorapeople.org/virt/openstack/cinder-lvm-backends-test.txt14:01
kashyapSo, after restartin Cinder services (presumably just 'c-vol' would suffice I guess), `cinder-manage host list` should enumerate both the backends, I guess?14:02
*** cdelatte has quit IRC14:02
*** thangp has joined #openstack-cinder14:03
*** nkrinner has quit IRC14:04
kashyapI'll investigate the details, thanks all for the responses.14:04
smcginniskashyap: Looks right. Though to be honest, other than knowing about that bug I haven't done much with the LVM driver myself.14:05
*** geguileo has joined #openstack-cinder14:05
kashyapsmcginnis: No problem. Me neither, I mostly work  with qcow2 files and backing chains.14:05
*** eharney has joined #openstack-cinder14:06
*** anuragpalsule has quit IRC14:07
*** IlyaG has quit IRC14:07
*** IlyaG has joined #openstack-cinder14:08
*** IlyaG has quit IRC14:12
*** IlyaG has joined #openstack-cinder14:12
*** atan8 has joined #openstack-cinder14:14
*** Yogi1 has quit IRC14:14
*** ankit_ag has quit IRC14:14
*** rushil has joined #openstack-cinder14:16
*** setmason has quit IRC14:16
*** agarciam has quit IRC14:18
openstackgerritPh. Marek proposed openstack/cinder: Re-add DRBD driver.  https://review.openstack.org/17857314:20
*** hodos has joined #openstack-cinder14:20
*** bkopilov has joined #openstack-cinder14:20
*** avishay_ has joined #openstack-cinder14:27
*** avishay has quit IRC14:27
openstackgerritEric Harney proposed openstack/cinder: LIO: Use rtslib property instead of private method  https://review.openstack.org/16514214:28
openstackgerritEric Harney proposed openstack/cinder: LIO: Enable iSER for IPv6  https://review.openstack.org/16514314:28
*** geguileo has quit IRC14:30
*** geguileo has joined #openstack-cinder14:34
*** jungleboyj has joined #openstack-cinder14:34
*** setmason has joined #openstack-cinder14:39
*** emagana has joined #openstack-cinder14:41
*** merooney has joined #openstack-cinder14:42
*** BharatK has joined #openstack-cinder14:44
thangpDuncanT: hi, do you have time to go over what you plan for rpc version compatibility?14:45
*** _cjones_ has joined #openstack-cinder14:45
jordanPsomeone with a glusterfs at hand here ?14:46
jordanPwhen I "cinder create --snapshot-id $snap_id $volume_size", the volume size seems not honored14:46
jordanPalthough cinder list reports the correct size, on the backend the file is not correctly sized (I am using raw image)14:47
hodoswhy tox -e all -- 'tempest.api.volume.(?!.*(test_volume_upload|test_volume_backup))'  runs only 243 tests ?14:47
*** crose has joined #openstack-cinder14:48
openstackgerrityogeshprasad proposed openstack/cinder: Fix the KeyError in CloudByte iSCSI cinder driver  https://review.openstack.org/18096214:48
*** MentalRay has joined #openstack-cinder14:49
*** ronis has quit IRC14:49
*** _cjones_ has quit IRC14:50
*** hemnafk is now known as hemna14:52
jungleboyjhemna: Morning sir.14:53
hemnamornin14:53
hemnait's raining here in CA!14:53
hemna:P14:53
e0nehemna: it's good sunny evening;)14:54
hemna:)14:54
jungleboyj:-)  We are waiting to see if severe weather develops this afternoon.  :-)14:54
jgriffithhemna: now, if it will do that for about the next 90 days straight, you guys will be all set!14:54
jungleboyjhemna: Oh master of FC do you know if Brocade has any plan to pick the virtual fabrics support back up?14:55
hemnajgriffith, +1!14:55
hemnajungleboyj, afaik, I think they were going to.14:55
*** nlevinki has quit IRC14:55
hemnajungleboyj, they also were going to update their drive to use an http API instead of ssh14:55
*** ociuhandu_ has joined #openstack-cinder14:56
*** ociuhandu has quit IRC14:56
*** ociuhandu_ is now known as ociuhandu14:56
*** anshul has quit IRC14:57
jungleboyjhemna: Ok, cool.  Have some people here looking at it.  Going to see if we can give Brocade a push on that.14:57
hemnayah that might be good14:57
*** crose has quit IRC14:58
*** xyang1 has joined #openstack-cinder14:58
*** juzuluag has joined #openstack-cinder15:00
jgriffithsmcginnis: tbarron did you see my conversation last night WRT migration ?15:01
smcginnisjgriffith: Yea, thanks!15:01
jgriffithcool15:01
smcginnisjgriffith: Looks like he has a patch out there for it.15:01
jgriffithmeh15:01
tbarronjgriffith: yes, thanks on that15:01
smcginnisjgriffith: Haven't tested it yet with our driver. Didn't realize there was a method in there already.15:01
jgriffithsmcginnis: well, there wasn't.. his patch added one15:02
jgriffithUnless you're looking at something else15:03
DuncanTthangp: I'm out at the moment, can do in about two hours if that helps?15:03
jgriffithDuncanT: "out" where... you seem "here" to me :)15:03
thangpDuncanT: sure, thx15:03
smcginnisjgriffith: https://github.com/openstack/cinder/blob/master/cinder/volume/driver.py#L134515:03
e0nehemna: i'll publish early poc of cinder agent tonight. one 1 call (get connector initiator works)15:03
hemnasweet15:03
smcginnisjgriffith: He just made some updates.15:03
hemnanice job15:03
e0nehemna: i'm hitting with keystonemiddleware:(15:04
jgriffithsmcginnis: ahh.. indeed15:04
e0neit's very easy to implement new features. but it takes a lot of time to integrate with openstack infrastructure. need to know about logging, configuration, etc15:05
*** annegentle has joined #openstack-cinder15:09
*** tshefi has quit IRC15:11
hemnae0ne, so are we sure we actually need keystone though?15:11
hemnathis is most likely targeted as an ironic BM node install, so I'm not sure we want that agent talking to the deployed keystone service ?15:12
e0nehemna: may be not. i'll share current code with you once it pass pep815:12
*** pwehrle has quit IRC15:13
hemnaIt's something we should talk about I guess15:13
*** annegentle has quit IRC15:14
smcginnisjgriffith: Oh, this is funny. https://github.com/openstack/cinder/blame/master/cinder/volume/driver.py#L134515:14
smcginnishehe15:14
*** annegentle has joined #openstack-cinder15:14
e0neagree. if we'll deploy it inside ironic instance, it won't be able to access keystone in some cases15:15
hodosjgriffith: hi john. what string do you use when start tempest? tox -e all -- vollume15:15
jgriffithhodos: yeah, but I spell volume with one 'l' :)15:15
e0ne:)15:16
hodosjgriffith: sure. for some reason my test count in this case is 24415:16
hodoshodos: not 30415:16
jgriffithhodos: missing services maybe?15:16
jgriffithhodos: what's your local.conf look like?15:16
hodosjgriffith: kinda like yours from sos-ci repo15:16
openstackgerritWalter A. Boring IV (hemna) proposed openstack/cinder: WIP: Remove Brick from cinder codebase  https://review.openstack.org/15555215:17
jgriffithhodos: hmm... do you have the testr_results.html file?15:17
openstackgerritWalter A. Boring IV (hemna) proposed openstack/cinder: Remove Brick from cinder codebase  https://review.openstack.org/15555215:17
hodosjgriffith: i can see that region_list and quotas are omitted15:17
hodosjgriffith: http://140.174.232.106/refs-changes-43-170143-58/testr_results.html15:18
hodosjgriffith: i skipped backup and upload i think. maybe it's the reason ?15:18
jgriffithhodos: hmm15:19
*** JayJ_ has joined #openstack-cinder15:21
jgriffithhodos: strage there are 60 tests not even showing up15:21
jgriffithhodos: lemme double check my tox arg15:21
jgriffithhodos: yeah, just "tox -e all -- volume"15:22
*** harlowja_at_home has joined #openstack-cinder15:22
*** garthb has joined #openstack-cinder15:22
*** dannywilson has joined #openstack-cinder15:22
jgriffithhodos: and you of course have: http://hastebin.com/fidohezige.ini in your local.conf15:23
jgriffithhodos: or your equivalent of it15:23
jgriffithhodos: what I'm not sure I get is your count is different15:24
jgriffithhodos: it's not even a matter of skips or anything15:24
jgriffithhodos: oh.. wait15:25
jgriffithhodos: what's enabled-services have in your local.conf file?15:25
smcginnishodos: Do you limit ENABLED_SERVICES?15:25
hodosjgriffith: ok, sorry for disturbance15:25
jgriffithhodos: assuming that means a missing service perhaps?15:25
hodossmcginnis: jgriffith: sorry guys; my string looks like this15:25
jgriffithhodos: BTW, you should publish the local.conf file with the results as well15:26
hodosjgriffith: smcginnis: tox -e all -- 'tempest.api.volume.(?!.*(test_volume_upload|test_volume_backup))' and some tests are NOT tempest.api15:26
hodosjgriffith: that's the reason15:26
jgriffithhodos: yep15:26
smcginnishodos: Yeah, I used to do similar (api.volume) but had to expand that15:26
jgriffithhodos: that's the "old" test15:26
*** jdurgin1 has joined #openstack-cinder15:31
*** harlowja_at_home has quit IRC15:35
*** rushil has quit IRC15:39
thingeejgriffith: https://review.openstack.org/#/c/180852/15:39
*** daneyon_ has joined #openstack-cinder15:41
jgriffiththingee: Rock ON!15:41
*** zhenguo has quit IRC15:44
*** daneyon has quit IRC15:44
*** fthiagogv_ has joined #openstack-cinder15:46
e0nehemna: https://github.com/e0ne/cinder-agent-poc15:47
hemnae0ne, coolio15:47
hemnaI'll take a look at it later today.15:47
hemnatrying to update my nova os-brick patch15:47
*** LarsN has joined #openstack-cinder15:48
*** lpetrut has quit IRC15:48
e0nethanks. any feedback is welcome15:48
LarsNhttps://wiki.openstack.org/wiki/Cinder/blueprints/multi-attach-volume15:48
e0neit's really draft code15:48
jgriffithsmcginnis: so that's not really the problem15:48
*** fthiagogv has quit IRC15:48
LarsNis that Blueprint for Multi-Attach on the roadmap?15:48
smcginnisjgriffith: No?15:48
jgriffithsmcginnis: the real problem is that there's ZERO scheudler involvement in that migrate/retype op15:48
thingeehemna: link to os-brick nova patch?15:48
jgriffithsmcginnis: so the rpc call is sent directly to the backend/driver15:48
*** markus_z has quit IRC15:49
smcginnisjgriffith: Is it missing something then by not going through the scheduler?15:49
hemnathingee, https://review.openstack.org/#/c/175569/15:49
jgriffithsmcginnis: and most of the drivers "assume" that if the request got to them the scheduler did it's job and gave it something it can do15:49
tbarronping winston-d_zzZ, xyang1: you two may not be on now but I just want to see if we can talk about future nfs overprovisioning and integration with the scheduler overprovisioning work you two have done.15:49
jgriffiththe result is they typically find this to be a noop and just return True15:49
hemnathingee, I'm updating it to fix the unit tests and also to migrate to use the other connectors in os-brick (FC, iSER, etc)15:49
smcginnisjgriffith: So there's a gap if the migration fails? I'm still not clear.15:49
jgriffithin the manager the code say "ok" it's done15:49
jgriffithsmcginnis: no, the gap is migration is never even called15:50
*** fthiagogv_ has quit IRC15:50
smcginnisjgriffith: Oh!?15:50
*** mtanino has joined #openstack-cinder15:50
jgriffithsmcginnis: yeah, because we just blindly send the retype down15:50
*** fthiagogv has joined #openstack-cinder15:50
tbarronnfs overprovisioning pre-dated the scheduler based overprovisioning introduced in kilo15:50
jgriffithsmcginnis: no regard for whehter the backend is capable or not15:50
thingeehemna: right on!15:51
jgriffithsmcginnis: try this lille test:15:51
hemnaI want to get this done in L1 if possible15:51
tbarronand relies on the driver over-reporting free space back up to the scheduler (via manager of course)15:51
*** eglynn has joined #openstack-cinder15:51
jgriffithsmcginnis: stub a migrate complete method in your driver and set a break point15:51
thingeee0ne: https://review.openstack.org/#/c/180852/ :)15:51
jgriffithsmcginnis: create a volume on your backend15:51
jgriffithsmcginnis: then retype it to lvm with migration on-demand15:51
thingeexyang1: https://review.openstack.org/#/c/180852/15:51
xyang1tbarron: I am in a call now.  Should we discuss at the summit about this?  This is for future, right?15:51
tbarronwe should either deprecate the nfs overprovisioning options or re-implement them on top of the new scheduler-based overprovisioning.15:52
e0nethingee: great! thanks a lot for doing it and notifiing me15:52
xyang1thingee: Nice!15:52
tbarronxyang1: yes, but I think we should get it done in liberty.15:52
tbarronyes future in that sense ^^^^15:52
*** mtanino_ has joined #openstack-cinder15:52
smcginnisjgriffith: I need to get my stack up again. Sounds like I've some testing to do.15:52
xyang1tbarron: Summit is for liberty15:52
tbarronxyang1: ok, we'll talk then15:53
tbarronxyang1: thingee: eharney: winston-1: winston-d_zzZ: could be a sprint, or maybe just a coffee break15:54
thingeewe really should get the sprint thing organized15:54
thingeeWe have the full day friday for it15:55
tbarronthingee: :-)15:55
thingeeI was imagining the first half would be people talking/getting ideas from discussion from the group.15:55
thingeethe second half is actual doing stuff. POC's15:55
*** mtanino has quit IRC15:55
eharneytbarron: i think we've already got a reasonable start on this... with https://review.openstack.org/#/c/149765/ landed, i think the only task is to make sure the driver reports the requisite stats?15:55
thingeeis it possible? or will we be fried?15:55
tbarronthingee: that makes sense to me15:55
tbarroneharney: great, I'll take a look.15:56
*** vincent_hou has joined #openstack-cinder15:56
xyang1tbarron: Sounds good15:56
eharneytbarron: i think we just need something like https://review.openstack.org/#/c/162718/ for the NFS driver, i'm not sure there's a lot else to figure out on that front15:56
vincent_houjgriffith: Ping again :-)15:56
jgriffithvincent_hou: oh, you're still up :)15:57
*** marcusvrn has quit IRC15:57
vincent_houjgriffith: Y. I have submitted a patch for the issue we discussed.15:57
vincent_houhttps://review.openstack.org/#/c/18087315:58
tbarroneharney: do you have an opinion as to whether we should deprecate 'nfs_oversub_ratio' and just ues 'max_oversubscription_ratio', or whether15:58
*** avishay_ has quit IRC15:58
tbarronwe should support the old option using the new scheduler mechanics?15:58
*** daneyon_ has quit IRC15:58
LarsNIs the ability to attach to a Cinder Volume from multiple instances a feature that exists, or might exist soon?15:58
tbarronI'm kinda inclined towards deprecate, and document that one kind of "thin" provisioning with NFS etc. involves sparse volume creation.15:59
eharneytbarron: yes, if we use the NFS driver configuration method above, there's no reason to not move toward the new option and deprecate the nfs_oversub_ratio one15:59
tbarroneharney: +115:59
*** daneyon has joined #openstack-cinder15:59
*** mtanino_ has quit IRC15:59
*** fanyaohong has quit IRC15:59
eharneytbarron: part of my goal with that configuration change was to remove the pseudo-scheduling code that's in the NFS driver anyway, which this lines up with15:59
*** marcusvrn has joined #openstack-cinder16:00
*** rmesta has joined #openstack-cinder16:00
tbarronso as far as the scheduler is concerned, we'll report that the pool has "thin" provisioning if either it has sparse-volumes (default for NFS)16:00
tbarronor if they aren't sparse but there is some vendor-specific thin provisioning going on.16:00
tbarroneharney: I am in complete agreement about eliminating pseudo-scheduling code from the NFS driver.16:01
eharneytbarron: yes i think so16:01
*** _cjones_ has joined #openstack-cinder16:01
tbarroneharney: thanks for the review references, I'll start up work on the generic NFS and NetApp NFS fronts that corresponds - unless you are already doing generic NFS.16:02
jgriffithwinston-1: you around?16:02
eharneytbarron: i'm not but i think there is probably a starting point or some overlap in the glusterfs patch referenced above, which puts some of the code in remotefs for reuse16:02
*** Yogi1 has joined #openstack-cinder16:03
tbarroneharney: my plan of action was: #1) steal what I can (#2) iterate on #1, etc.16:03
eharneysounds good :)16:03
tbarron:-)16:03
*** bkopilov has quit IRC16:04
*** e0ne is now known as e0ne_16:08
*** bkopilov has joined #openstack-cinder16:09
vincent_houjgriffith: can you help to look at https://review.openstack.org/#/c/180873/?16:10
jgriffithvincent_hou: yes16:11
jgriffithvincent_hou: so that's part of the problem and looks ok so far16:12
jgriffithvincent_hou: but there's another bigger problem16:12
jgriffithvincent_hou: I'm working on right now16:12
jgriffithvincent_hou: we never check to see if the backend is able to support the type when we send the retype command down16:12
jgriffithvincent_hou: there's no scheduling checks at all :(16:12
tbarronjgriffith: +116:13
tbarronjgriffith: now I know why you were asking if winston-1 is around.16:13
*** _cjones_ has quit IRC16:14
jgriffithtbarron: yeah, working on a temporary hack to check volume_backend_name in the types16:14
jgriffithtbarron: then, follow up with a full on scheduler/capability check16:15
*** lpetrut has joined #openstack-cinder16:15
tbarronjgriffith: makes sense to me16:15
jgriffithtbarron: this sort of thing has come up before, wanted to make sure there wasn't an easy hook to that call burried somewhere that I could just "use" :)16:16
*** vincent_hou_ has joined #openstack-cinder16:16
vincent_hou_jgriffith: It seems migration really has a lot of work to do. If you think there needs to do any improvement to it, you can add here https://etherpad.openstack.org/p/volume-migration-improvement.16:16
jgriffithvincent_hou_: oh.. handy16:16
*** e0ne_ is now known as e0ne16:17
*** vincent_hou has quit IRC16:17
*** vincent_hou_ is now known as vincent_hou16:17
vincent_houjgriffith: I would like to make migration more stable in the coming release. Already put some items in this page.16:18
*** rushil has joined #openstack-cinder16:18
xyang1tbarron: How are you planning to move forward with your current patch? Get it in first, and then move to new mechanism later in liberty?  Or are you going to redo the current patch?16:18
tbarronxyang1: I want to go ahead with the current patch so I can cherry-pick and backport to the customer, who won't see liberty code for a long time.16:19
xyang1tbarron: Ok, makes sense to me16:19
openstackgerritWalter A. Boring IV (hemna) proposed openstack/cinder: Remove Brick from cinder codebase  https://review.openstack.org/15555216:19
tbarronBut then I want to re-do it in liberty so that the driver no longer reports apparent free space up to the scheduler16:20
xyang1tbarron: Sure16:20
tbarronwe can document that nfs_oversub_ratio is no longer supported and how to get the same thing done with the new options.16:20
*** aviramb has joined #openstack-cinder16:20
xyang1tbarron: Ok16:21
tbarronit looks like eharney has already been doing this for glusterfs and remotefs, so we'll try to leverage that work for consistent approach.16:21
xyang1tbarron: Right16:21
tbarronso on the current review I think I just have to fix a pylint issue and you and Winston will be OK since you know I'm not trying to have that code live on.16:22
*** _cjones_ has joined #openstack-cinder16:23
xyang1tbarron: I am ok with your plan16:23
tbarronTo make pylint happy I have to do a literal copy of the same method into two libraries and do a NotImplemented version in a third :-)16:23
*** changbl has joined #openstack-cinder16:23
tbarronat run-time the method resolution just worked :-)16:23
xyang1Have fun:)16:23
tbarronxyang1: will do, and thanks for the help.16:24
xyang1tbarron: Welcome16:24
*** mtanino has joined #openstack-cinder16:25
*** vincent_hou_ has joined #openstack-cinder16:25
*** Apoorva has joined #openstack-cinder16:26
*** vincent_hou has quit IRC16:27
*** vincent_hou_ is now known as vincent_hou16:27
openstackgerritVincent Hou proposed openstack/cinder: Implement the update_migrated_volume for the drivers  https://review.openstack.org/18087316:27
*** shakamunyi has quit IRC16:29
mtaninovincent_hou: hi,16:30
vincent_houmtanino: Hi16:30
mtaninoI'm looking the https://review.openstack.org/#/c/180873/ :)16:30
mtaninovincent_hou: just one question,16:31
vincent_houmtanino: Yeah. I just provide the fix today.16:31
mtaninovincent_hou: migrate_volume_completion() is called only the volume is not attached case, so we can solve this issue only if the volume is not attached16:32
*** xyang1 has quit IRC16:32
vincent_houmtanino: No. The attached volume also calls this one.16:33
vincent_houmtanino: It is called from nova16:33
Swansonmodel_update = {'_name_id': None}  What does that mean?!?16:33
mtaninovincent_hou: oh, really,16:33
vincent_houYep.16:33
*** ronis has joined #openstack-cinder16:34
mtaninovincent_hou: So, if the volume path is changed suddenly after attached volume migration, I think the VM will cause I/O error because the VM does not know the renamed vg/lv, no?16:35
*** emagana has quit IRC16:35
vincent_houSwanson: the back-end id and the volume id map to each other via the column _name_id in the table volumes. If we can update the backend id to the volume id, we do not need _name_id any more.16:35
mtaninovincent_hou: Let me check both nova and cinder code for attached volume migration again.16:36
vincent_houmtanino: I only checked the non-attached volumes.16:36
Swansonvincent_hou: Thanks!  I'm implementing this right now in the Dell driver.16:37
mtaninovincent_hou: I guess above but let me investigate the code again.16:37
vincent_houmtanino: I think technically it should allow us to rename a volume attached to VMs.16:38
vincent_houmtanino: I will need to verify that.16:38
*** atan8 has quit IRC16:38
*** annegentle has quit IRC16:39
*** anuragpalsule has joined #openstack-cinder16:39
mtaninovincent_hou: Doing attached volume migration using your patch is easy to understand what will happen, I will also try it.16:39
*** rushiagr_away is now known as rushiagr16:40
*** rushil has quit IRC16:41
hemnawho is in charge of the nimblestorage CI ?16:41
hemnatheir CI seems to be broken at the moment.16:41
*** leeantho has joined #openstack-cinder16:41
hemnahttp://ftp.nimblestorage.com/openstack_ci/iscsi/155552/10/check/nimble-iscsi-driver-dsvm-volume/1526/logs/devstacklog.txt16:41
*** rushil has joined #openstack-cinder16:42
*** emagana has joined #openstack-cinder16:42
*** tsekiyama has joined #openstack-cinder16:44
asselinhemna, https://wiki.openstack.org/wiki/ThirdPartySystems/Nimble_Storage_CI16:44
asseline-mail, but no irc contact16:44
hemnaasselin, ok thanks16:44
hemnaI'm just trying to be careful with the cinder os-brick patch watching all CI Failures16:45
asselin+116:45
*** dulek has quit IRC16:45
*** patrickeast has joined #openstack-cinder16:46
*** IanGovett1 has quit IRC16:46
*** vincent_hou_ has joined #openstack-cinder16:47
hemnaok sent them an email, asking them to look into their failures.16:48
*** IanGovett has joined #openstack-cinder16:48
hemnathat failure looks like a novaclient -> keystone puke to me.16:48
*** vincent_hou has quit IRC16:49
*** vincent_hou_ is now known as vincent_hou16:49
openstackgerritWalter A. Boring IV (hemna) proposed openstack/cinder: Remove Brick from cinder codebase  https://review.openstack.org/15555216:51
*** swamireddy1 has joined #openstack-cinder16:51
*** vilobhmm1 has joined #openstack-cinder16:54
* e0ne bb in ~2 hours16:56
*** _cjones_ has quit IRC16:56
*** sgotliv has quit IRC16:59
*** Yogi11 has joined #openstack-cinder16:59
*** emagana has quit IRC17:00
*** _cjones_ has joined #openstack-cinder17:00
*** emagana has joined #openstack-cinder17:01
*** Yogi1 has quit IRC17:02
*** jordanP has quit IRC17:02
openstackgerritJohn Griffith proposed openstack/cinder: Check volume_backend in retype  https://review.openstack.org/18107917:03
jgriffithsmcginnis: tbarron vincent_hou ^^17:03
jgriffithsmcginnis: tbarron vincent_hou in my case at least that seems to fix the "orphaned" backend issue17:03
*** Yogi11 has quit IRC17:04
jgriffithpay no attention to the fact that now you're pretty well F'd when you try and figure out where the new volume is and what the mapping is17:04
jgriffithrequires you go into the DB and manually inspect, assumign you know WTF you're even looking for17:04
tbarronjgriffith: in meeting but will look with interest later17:05
*** avishay_ has joined #openstack-cinder17:05
*** rushil has quit IRC17:05
thingeejgriffith: https://github.com/openstack/python-cinderclient/tree/1.2.117:09
thingeejgriffith: waiting for jenkins job http://logs.openstack.org/33/33a4f17fa03811a5a9d2778c8c0c8dfe343cd3bb/17:10
thingeefile not found... not sure if this takes a while to show up17:10
*** Yogi1 has joined #openstack-cinder17:11
*** BharatK has quit IRC17:11
*** e0ne has quit IRC17:11
thingeeah there we go17:12
jgriffiththingee: :)17:12
jgriffiththingee: patience Grass Hopper17:12
thingee;)17:12
jgriffiththingee: that lag can be long sometimes, and annoying most times ;)17:13
thingeehttps://review.openstack.org/#/c/181083/17:13
thingeejgriffith: ^17:14
*** vincent_hou_ has joined #openstack-cinder17:15
*** vincent_hou has quit IRC17:16
*** vincent_hou_ is now known as vincent_hou17:17
*** jistr has quit IRC17:17
*** lpetrut has quit IRC17:18
*** IanGovett has quit IRC17:19
*** garthb has quit IRC17:20
jgriffiththingee: LOL "How important is workinf wifi"17:22
jgriffiththingee: You're a funny guy :)17:22
vincent_houHave to drop off now. C U folks.17:22
thingeejgriffith: that's all DuncanT  :)17:22
jgriffithvincent_hou: good night sir17:23
*** IanGovett has joined #openstack-cinder17:23
*** vincent_hou has quit IRC17:24
*** xyang1 has joined #openstack-cinder17:26
*** merooney has quit IRC17:33
*** merooney has joined #openstack-cinder17:35
*** ctina__ has quit IRC17:37
*** ctina___ has joined #openstack-cinder17:37
*** emagana has quit IRC17:40
*** annegentle has joined #openstack-cinder17:40
*** erlon has joined #openstack-cinder17:43
*** emagana has joined #openstack-cinder17:43
*** avishay_ has quit IRC17:44
*** koralgolek has joined #openstack-cinder17:45
*** anteaya has quit IRC17:45
koralgolekHi everyone, I start using openstack and I'm wondering if is it possible to attach directly local disk to vm? I guess cinder throught iscsi would be slower than local storage. Local storage I also mean LUN by Fibre Channel.17:45
*** annegentle has quit IRC17:46
*** swamireddy1 has quit IRC17:48
*** emagana has quit IRC17:48
*** kaisers has quit IRC17:48
jgriffithkoralgolek: there's not a built in mechanism for what you're describing17:49
*** jistr has joined #openstack-cinder17:49
*** kaisers has joined #openstack-cinder17:49
jgriffithkoralgolek: although you contradict your self a bit there "Local storage I also mean LUN by Fibre Channel."17:49
jgriffithso I guess the answer techinally is "yes" and "no" at the same time17:50
*** angela-s has joined #openstack-cinder17:50
patrickeast^ maybe there is already a FC LUN on the compute node and they want to use it for ephemeral storage?17:50
jgriffithpatrickeast: ephemeral != persistent17:50
*** madskier has joined #openstack-cinder17:51
patrickeastjgriffith: well yea, they never said persistent17:51
patrickeastjust local storage17:51
jgriffithpatrickeast: but regardless... san/FC is NOT local disk either17:51
patrickeasthaha true17:51
koralgolekThe problem is that I've several servers with hba cards yet. im using now ganeti and to whole servers there is presented LUN with LVS VG17:51
jgriffiththat was actually my main point there17:51
jgriffithand perhaps an FC device with a cinder FC driver17:52
koralgolekevery lv is separate vm17:52
jgriffithkoralgolek: yeah, sorry I'm not going to be much help17:52
*** theanalyst has quit IRC17:52
koralgolek "patrickeast: but regardless... san/FC is NOT local disk either" I know its not but on host server it is visible as block storage17:54
*** theanalyst has joined #openstack-cinder17:55
*** merooney has quit IRC17:56
*** garthb has joined #openstack-cinder17:58
*** rushiagr is now known as rushiagr_away18:00
koralgolekbtw assume Im gonna use classic cinder. Is there possible to setup few nodes of it to make load balance?18:02
jgriffithkoralgolek: sorry, I don't know what "classic" cinder is18:03
koralgolekevery node will have the same lun with the same lvm - maybe even clvm18:03
*** vilobhmm1 has quit IRC18:03
*** vilobhmm1 has joined #openstack-cinder18:03
jgriffithkoralgolek: clustered LVM type thing..  mtanino I believe had some proposals around thetype of thing you're describing18:03
*** vilobhmm1 has quit IRC18:04
jgriffithkoralgolek: at least the multi-attach LVM thing18:04
*** vilobhmm1 has joined #openstack-cinder18:04
*** emagana has joined #openstack-cinder18:05
*** annegentle has joined #openstack-cinder18:06
*** e0ne has joined #openstack-cinder18:06
*** vmtrooper has joined #openstack-cinder18:07
*** _cjones_ has quit IRC18:07
koralgolekclassic cinder I mean machine with persistent or not persistent sotarage with lvm which is presented to computed nodes throught iscsi (am I right?)18:08
hemnalooks like the microsoft CI is failing due to a local.conf REQUIREMENTS_BRANCH setting.18:08
hemnahttp://64.119.130.115/cinder/155552/11/iscsi/devstack_config/local.conf.gz18:09
hemnanot sure why they have that in there.18:09
hemnait will fail to pickup any changes in the global requirements repo18:09
hemnawhich is what it's doing for os-brick18:09
hemna:(18:09
hemna+ python update.py /opt/stack/cinder18:09
hemna'os-brick' is not in global-requirements.txt18:09
jgriffithhemna: I suspect that's why they're doing it18:09
hemnawhen it's there.18:09
*** _cjones_ has joined #openstack-cinder18:09
hemnaI'll email them18:10
*** dencaval has quit IRC18:10
jgriffithhemna: https://review.openstack.org/#/c/171060/18:11
*** vmtrooper has quit IRC18:11
hemnahrmm18:12
hemnamaybe I'm wrong, but doesn't local.conf REQUIREMENTS_BRANCH force a specific branch of the requirements repo ? which I think is missing the os-brick patch that just merged18:12
*** jordanP has joined #openstack-cinder18:12
jgriffithhemna: FWIW, you might have better luck adding the requirement "before" making the switch-over18:12
hemnaso a separate patch just to add os-brick to cinder's requirements.txt ?18:13
*** jordanP has quit IRC18:13
hemnathen wait a few hours kinda deal ?18:13
jgriffithhemna: yeah... well, that part sucks :(18:13
jgriffithhemna: but you can make your next series a dep18:13
hemnaheh ok.  I'll try that.18:13
*** vilobhmm1 has quit IRC18:13
jgriffithhemna: and to your other question "yes"18:14
jgriffithhemna: the thing is it appears the microsoft team "needed" that installer patch to work properly18:14
jgriffithhemna: so they froze on that branch18:14
jgriffithhemna: now that the change has merged they should be able to remove it18:14
hemnaprobably why they pinned it to that18:14
jgriffithalexpilotti: ^^18:15
*** merooney has joined #openstack-cinder18:15
openstackgerritWalter A. Boring IV (hemna) proposed openstack/cinder: Add os-brick to cinder requirements.txt  https://review.openstack.org/18110218:16
*** anuragpalsule has quit IRC18:16
*** vilobhmm1 has joined #openstack-cinder18:18
*** adam_g has left #openstack-cinder18:18
*** anteaya has joined #openstack-cinder18:18
*** ctina___ has quit IRC18:20
*** merooney has quit IRC18:20
*** vilobhmm1 has quit IRC18:21
*** vilobhmm1 has joined #openstack-cinder18:22
tbarronjgriffith: w.r.t. https://review.openstack.org/#/c/181079/ do you need to make a similar check for the fallback migrate path?  (I could be missing something fundamental here, dunno much about migration.)18:22
jgriffithtbarron: well, that's *why* the fall-back migrate path is there18:23
jgriffithtbarron: if the driver.retype fails or can't be done, it does the migrate process18:23
jgriffithtbarron: the whole point of migrate in that context is that the types aren't compatible on the same backend... see what i mean?18:23
*** vilobhmm1 has quit IRC18:24
mtaninokoralgolek: default Cinder LVM driver provides LV as a volume via iISCSI using tgtd, LIO, iet etc,18:24
*** vilobhmm1 has joined #openstack-cinder18:24
tbarronkk, that's what I was suspecting.18:24
*** ebalduf has quit IRC18:25
tbarronjgriffith: a pain, but you should modify the retype tests in unit/test_volume.py, no?18:25
tbarronlooks like they just test when extra-specs are {} for old and new at a quick glance18:26
*** madskier has quit IRC18:26
jgriffithtbarron: I'm pretty opposed to doing things like writing unit tests to see if an "if" statement works18:27
*** MentalRay has quit IRC18:27
hemnahrmm guess you can't email the microsoft cinder ci email address18:27
hemnait bounced18:27
hemnaheh18:27
tbarronjgriffith: well, I'm not trying to start a unit-test holy ware atm18:27
tbarrons/ware/war/18:28
jgriffithtbarron: me neither :)18:28
smcginnishemna: You have to send it using Outlook. :)18:28
hemnagah18:28
*** ebalduf has joined #openstack-cinder18:28
jgriffithhemna: you're not fooling anyone, we know you have Outlook18:28
hemna:P18:29
smcginnisHe just uses linux for show. He has a whole active directory, Exchange home network set up.18:29
hemnasssh18:29
hemnasmcginnis, no beer for you!18:29
*** merooney has joined #openstack-cinder18:30
smcginnishehhe18:30
tbarronjgriffith: will just say, before ducking, that the point of the unit test is not to verify that the if works, but rather that someone doesn't break your fix later on.18:30
* tbarron ducks now18:30
koralgolekmtanino: to be sure - so there is NO possibility to serve storage directly from FC LUN or local distk to vm on given host server?18:30
jgriffithtbarron: LOL, that's really not true actually.  If someobdy makes a code change and it breaks the test 9.9 times out of 10, they'll just modify the test to work :)18:31
openstackgerritVilobh Meshram proposed openstack/cinder: Bad link in API version details response  https://review.openstack.org/18069118:31
mtaninokoralgolek: If the local means internal HDD, the only way to use the HDD is using LVM driver and pass it via iSCSI using tgtd.18:34
*** eharney_ has joined #openstack-cinder18:35
mtaninokoralgolek: but if your FC storage has Cinder driver, you can attach a LUN as a volume to your VM directly(via FC/iSCSI) using that Cinder driver.18:35
koralgolekmtanino: then I need to install cinder on every node?18:36
mtaninokoralgolek: no, it is enough to install cinder volume, scheduler, api only for one node.18:37
*** eharney has quit IRC18:38
mtaninokoralgolek: but you need to install nova compute to other hyper-visor nodes.18:38
koralgolekmtanino: sorry maybe for stupid question but why do I need Cinder driver to use FC LUN when on servers I've already configured multipathd and I see LUNs like block devices?18:38
hemnakoralgolek, guests in kvm don't have an FC HBA18:39
hemnaonly the host OS has the FC HBA available18:39
*** timcl has quit IRC18:40
hemnaunfortunately, libvirt can't do a virtual FC HBA PCI device :(18:40
koralgolekI know but Im wondering why can't I attach block device directly to vm?18:40
hemnathe block device has to be attached to the host first18:40
koralgolekfor example I can do pvcreate, vgcreate and on this finally lvcreate18:40
hemnathen passed in to the guest18:40
hemnabecause of what I just explained.18:40
hemnaif it's an FC LUN18:41
jgriffithhemna: koralgolek time out :)18:41
jgriffithkoralgolek: so the reason you "can't" currently is only because that's not how Cinder was designed18:41
* hemna sits in the corner18:41
hemna:P18:41
mtaninokoralgolek: so the answer is Cinder is an abstracted storage management layer I think.18:42
jgriffithkoralgolek: what you want to do is completely "possible" with KVM (local disk already attached and just pass through) just like we do today18:42
jgriffithmtanino: +118:42
jgriffithkoralgolek: there's an LVM driver and components in Nova18:42
jgriffithkoralgolek: you could certainly tweak some things around to do what you want18:42
jgriffithkoralgolek: you could even manipulate Cinder to manage/orchestrate some of it18:42
jgriffithkoralgolek: but it's not very straight forward18:43
jgriffithkoralgolek: and you probably won't get much help in the dev channel18:43
koralgolek:(18:43
jgriffithhemna: so you're correct, but keep in mind his proposal is similar to what was discussed by Hitachi in Paris18:43
hemnaoh, another one of those18:43
jgriffithhemna: you maually attach FC luns to all the compute notes, make them all the same shared VG18:44
*** eharney_ is now known as eharney18:44
jgriffithand carve LV's out of them.  That means "all" compute nodes are sharing the VG/LV's18:44
koralgolekexcatly!!18:44
jgriffithkoralgolek: yeah, I get it... I was just avoiding it :)18:44
koralgolekI use this setup on ganeti18:44
jgriffithkoralgolek: the fact is that I'm pretty opposed to that concept18:45
hemnaI'm not sure why you would ever want to do that18:45
hemnabut to each their own I suppose.18:45
jgriffithhemna: there are lots of good reasons actually18:45
jgriffithhemna: you don't need a driver in Cinder being one of the best18:45
hemnawell I'm not sure that's a good reason :)18:45
jgriffithhemna: the other reason is it makes things like multi-attach obsolete and irrelevant18:46
jgriffithhemna: you get it for free18:46
koralgolekin my opinion the main reason is performance18:46
jgriffithhemna: you just flip a bit in Cinder to turn it on18:46
hemnawell for linux based hypervisors sure.18:46
jgriffithkoralgolek: now that's where I disagree :)18:46
jgriffithkoralgolek: I benchmarked this when it came up a while back18:47
hemnaperformance is not something to highlight in this one18:47
jgriffithkoralgolek: I saw ZERO improvement in performance18:47
hemnait's not for performance at all. IMHO18:47
jgriffithkoralgolek: the only performance tests that were shown that had a significant improvement did things like:18:47
*** JayJ_ has quit IRC18:47
hemnaadding LVM on top of an FC VOLUME makes for better performance ?!?!?18:47
koralgolekjgrffith: even in number of IOs?18:48
koralgolekper second18:48
jgriffithcompare FC attached luns to iSCSI over 1Gig18:48
jgriffithkoralgolek: if comparing apples to apples I wasn't able to see a different18:48
jgriffithdifference18:48
jgriffithDuncanT: however stated he tested it and saw a sifnificant difference18:48
*** reed has quit IRC18:49
jgriffithI went home that night and tried it again but couldn't arrive at the same results.. dont' know why18:49
jgriffithkoralgolek: in most cases the transport layer isn't the bottle-neck for performance these days (in most cases)18:49
DuncanTjgriffith: It depends heavily on what you're using as your c-col node, it turns out18:49
jgriffithkoralgolek: I'll put 10G iSCSI against FC and sometimes win18:49
jgriffithsometimes loose, but it's rarely because of the transport layer18:50
jgriffithDuncanT: now that makes sense of course18:50
jgriffithDuncanT: because of the tgt work and CPU/Memory load it takes18:50
koralgolekcorrect me if im wrong but I dont belevie one thig. I have 20 servers with many vm's and I dont believe that one target node (cinder) will manage these all servers18:50
jgriffithDuncanT: you have a big enough c-vol node it doesn't matter18:51
*** jistr has quit IRC18:51
jgriffithDuncanT: in my case/testing I used SolidFire so that part wasn't a factor18:51
DuncanTjgriffith: And how fast you backend is.... fast backend and a relatively weedy c-vol node (or a crappy 10 gig card, which I think was the bottleneck for us... drive the 10gig hard and the CPU goes nuts) and you loose big time18:51
jgriffithagain apples to apples18:51
jgriffithDuncanT: yeah, that's fair18:51
DuncanTthangp: You about?18:51
*** MentalRay has joined #openstack-cinder18:52
koralgolekwhat about IOPS in this case?18:52
jgriffithkoralgolek: that's the only real test of performance IMO18:52
thangpDuncanT: hey18:52
jgriffithkoralgolek: anyway.. I gotta run.  Good luck to ya18:52
koralgolekthx jgriffith ;)18:53
thangpDuncanT: ready to talk about the rpc version compat?18:53
*** emagana has quit IRC18:53
DuncanTthangp: Yup18:53
thangpDuncanT:  :) cool, what are your plans?18:53
thangpDuncanT: btw, i was able to prototype a way to do object version compat: https://review.openstack.org/#/c/180393/18:54
thangpDuncanT: I tested it on a 2015.1.1 and 2015.2.0 release18:54
*** dencaval has joined #openstack-cinder18:54
*** emagana has joined #openstack-cinder18:55
*** emagana has quit IRC18:55
openstackgerritWalter A. Boring IV (hemna) proposed openstack/cinder: Add os-brick to cinder requirements.txt  https://review.openstack.org/18110218:56
DuncanTthangp: Cool, I'll take a look at that in a sec18:56
*** reed has joined #openstack-cinder18:57
DuncanTAnybody having issues with etherpad?18:58
DuncanTI keep getting disconnected18:58
*** emagana has joined #openstack-cinder18:59
vilobhmm1thingee : ping18:59
DuncanTthangp: Trying to type up a few thoughts on an etherpad18:59
thingeevilobhmm1: hi18:59
DuncanThttps://etherpad.openstack.org/p/duncant-on-versioned-things19:00
vilobhmm1can you please have a look at https://review.openstack.org/#/c/173141/19:00
thangpDuncanT: ok, np19:00
vilobhmm1seems ok for me DuncanT19:00
e0necan't find myself. will we remove APIv1 from Cinder in Liberty19:00
e0ne?19:00
vilobhmm1thingee : https://review.openstack.org/#/c/173141/ seems to have got blessing from most of the members of our team19:00
thangpDuncanT: I got in19:00
thingeevilobhmm1: great19:01
vilobhmm1if you also find it ok i can officially start posting changes for review19:01
thingeevilobhmm1: yes that would be the plan.19:01
vilobhmm1thingee : great…so please have a look when you get time…19:02
vilobhmm1thnx19:02
DuncanTGrrrr, infernal network connection!19:02
thangpDuncanT: google docs?19:02
*** MentalRay has quit IRC19:02
thangpDuncanT: another alt19:02
thingeevilobhmm1: I'm aware of specs pending for review, thank you.19:02
vilobhmm1thingee : cool19:03
vilobhmm1ok19:03
*** merooney has quit IRC19:04
vilobhmm1DuncanT : regarding our talk apart from the points mentioned in the etherpad do you want to cover anything else like interaction with nova, using compare and set (at the db layer)19:04
vilobhmm1right now also i feel we have enough to cover but i think it would be nice to cover things like using compare and set for guaranting atomicity19:06
*** merooney has joined #openstack-cinder19:06
DuncanTvilobhmm1: I'll get onto that once I've finished writing up my thoughts on versioning. Things like compare and set .v. DLM need to be talked about... the benchmarks were not promising19:06
vilobhmm1sure…19:06
vilobhmm1please ping me when you are free19:06
DuncanTcompare and set (update status='new' where id='xxxyyyzzz' and status='oldstatus') looked best in benchmarks19:06
vilobhmm1yup…thats the way we should go…19:07
DuncanTthangp: Typing up elsewhere and will paste in a minute19:09
*** fthiagogv has quit IRC19:09
thangpDuncanT: ok np19:09
vilobhmm1is anyone aware from where does Cinder API docs get generated ? does it get built by manuals or something in cinder codebase invokes it19:11
annegentlevilobhmm1: it's in the openstack/api-site repo19:11
annegentlevilobhmm1: in WADL, handwritten, maintained19:11
vilobhmm1annegentle : cool thnx19:11
annegentlevilobhmm1: I'm working on a spec to start automating just the ref info19:11
annegentlevilobhmm1: what's your interest area?19:11
vilobhmm1we have some unit test for them in https://github.com/openstack/cinder/tree/master/cinder/tests/unit/api19:12
vilobhmm1and i was working on on bug where the links were broken19:12
vilobhmm1i checked openstack-manuals and cinder codebase19:12
annegentlevilobhmm1: last release we did move an openstack/volume-api repo to openstack-attic/volume-api19:12
annegentlevilobhmm1: and some of the info went to api-site and some went to cinder-specs19:13
annegentlevilobhmm1: http://specs.openstack.org/openstack/cinder-specs/#volume-v2-api19:13
annegentlevilobhmm1: http://developer.openstack.org/api-ref-blockstorage-v2.html19:13
vilobhmm1but couldn't find one so..was curious to know…thanks for the details annegentle...19:13
annegentlethose are the links that are now official19:13
annegentlevilobhmm1: here to serve19:14
vilobhmm1annegentle : i would like you to review https://review.openstack.org/#/c/180691/19:14
annegentlevilobhmm1: looking now19:14
vilobhmm1cool19:14
vilobhmm1thanks19:14
openstackgerritMike Perez proposed openstack/cinder: Allow rexports for targets with Datera  https://review.openstack.org/18112019:15
openstackgerritMike Perez proposed openstack/cinder: Rename Datera test to test_datera for discovery  https://review.openstack.org/18112119:15
annegentlevilobhmm1: yep that's the PDF you want19:15
vilobhmm1awesome19:15
annegentlevilobhmm1: oh actually, no. that's the v1, you want v2.0 based on the ID in line 91?19:16
*** nikeshm has joined #openstack-cinder19:16
nikeshmpatrickeast asselin : hi19:16
vilobhmm1sure you can comment that on the review will be easy19:16
patrickeastnikeshm: hey19:16
vilobhmm1annegentle : ^^19:16
nikeshmis supports for ubuntu 14.0419:17
nikeshmCI19:17
patrickeastnikeshm: for which part?19:17
*** merooney has quit IRC19:17
nikeshmpatrickeast:jenkins master19:17
patrickeastnikeshm: yea i use 14.04 for my masters19:17
patrickeastnikeshm: and for the nodepool nodes19:18
annegentlevilobhmm1: yep, done19:18
nikeshmpatrickeast : where nodepool comes in picture in jenkins,zuul and gearman19:18
vilobhmm1annegentle : thanks19:19
annegentlevilobhmm1: thank You!19:19
*** IlyaG has quit IRC19:20
patrickeastnikeshm: nodepool runs in the background and provides workers for jenkins to run jobs on19:21
*** _cjones_ has quit IRC19:21
patrickeastnikeshm: the zuul->gearman->jenkins flow works the same with our without nodepool (for the most part)19:22
nikeshmnikesm: still i was facing issue with image-build,ok will try again,BTW,when i am trying to upload a patch in sandbox,i am able to see noopcheck in build history of jenkins saying (pending—Waiting for next available executor)19:23
nikeshmits not able to build19:24
patrickeastnikeshm: its probably waiting for a build node with the correct label, if nodepool hasn’t been able to build an image and attach slaves to jenkins they won’t be able to run19:24
nikeshmpending from long time19:24
nikeshmohhh19:25
*** madskier has joined #openstack-cinder19:25
nikeshmis this nodepool yaml file http://paste.openstack.org/show/216406/19:27
nikeshmpatrickeast: is this nodepool yaml file http://paste.openstack.org/show/216406/  do we have to create a image 'dpc' in glance manually19:28
*** abhiram_moturi has joined #openstack-cinder19:28
DuncanTthangp: Hopefully what is up now makes some sense?19:28
nikeshmpatrickeast : is this yaml fine? do we have do create a image manually in glance19:28
thangpDuncanT: so my question is - why not have some kind of rpc function to grab the version?19:29
DuncanTthangp: How do you version that RPC? Who do you send it to?19:30
*** madskier has quit IRC19:30
thangpDuncanT: we could have a rpc function that never changes, so no need to version...19:31
thangpe.g. get_version19:31
DuncanTthangp: Ok, who sends it to who, and when?19:31
DuncanTthangp: The service coming up has to send it, since only it knows it just came up19:32
*** merooney has joined #openstack-cinder19:32
thangpDuncanT: brb...got a quick mtg19:32
DuncanTthangp: Ok, I should be here for a while19:32
*** bkopilov has quit IRC19:33
thangpDuncanT: mtg canceled, so i'm back19:33
DuncanTBest kind of meeting19:35
thangpDuncanT: so usually a host is selected before an rpc call is made, right?  e.g. new_host = utils.extract_host(volume['host'])19:35
DuncanTthangp: Ok...19:36
DuncanTthangp: Though sheduler is bcast19:36
thangpDuncanT: since we know the host, we can ask the version, make the rpc version and obj version compatibile, then send?19:36
thangpDuncanT: I have to look at scheduler19:36
thangpDuncanT: not sure19:37
DuncanTthangp: That works for c-vol but not sched and not backup in future19:37
DuncanTIt also means every RPC becomes a syncronous RPC + a second fire and forget19:37
thangpDuncanT: schedule does a cast so yes, its a broadcast19:38
DuncanTSo if a c-vol process is hung, then you start eating up workers on API/scheduler, waiting for it to respond19:38
DuncanTas well as being slower19:38
DuncanTeven when everything works19:38
*** ociuhandu has quit IRC19:38
thangpDuncanT: ok, i get what you're saying19:39
DuncanTthangp: Ideally I want services to suicide before connecting to the RPC bus if they don't support the minimum version19:40
DuncanTthangp: And the advantage of the DB approach is it can all be cached at startup, and no extra work is needed until the get an upgrade message19:41
thangpDuncanT: reading etherpad...19:42
*** bkopilov has joined #openstack-cinder19:43
*** timcl has joined #openstack-cinder19:44
*** abhiram_moturi has quit IRC19:46
openstackgerritRajini Ram proposed openstack/cinder: Eqlx: Fixes the retries on Network Connection Error  https://review.openstack.org/17173619:46
*** abhiram_moturi has joined #openstack-cinder19:46
*** merooney has quit IRC19:48
thangpDuncanT: with your plan, how do we know when all the services are upgraded?19:48
*** MentalRay has joined #openstack-cinder19:48
thangpDuncanT: so that the services will use the new rpc/obj versions instead of the pinned19:48
nikeshmpatrickeast: there?19:49
DuncanTthangp: They're running the new version of the software when they've written in the new, higher max version at startup. They're using the new rpc/obj version when they've cleared the desired field and updated the pin19:49
*** IlyaG has joined #openstack-cinder19:49
*** bkopilov has quit IRC19:53
thangpDuncanT: so when a rpc call is made or an obj is instantiated, we have to check the db for the version to make compatible to?19:53
*** bkopilov has joined #openstack-cinder19:53
DuncanTthangp: I suggest it is read at startup and cached in a global19:53
DuncanTthangp: It can't change after startup until an 'upgrade your version now' rpc is received19:54
thangpDuncanT: ah ok19:55
*** ronis has quit IRC19:55
thangpso who ends up sending the 'upgrade your version'?19:55
*** ronis has joined #openstack-cinder19:55
DuncanTThe API service will send it to all 'up' services, in response to an admin request (i.e. it isn't automatic)19:56
*** merooney has joined #openstack-cinder19:56
thangpok, so to summarize this based on my understanding...19:56
thangpeach service gets updated individually, when it is started, it updates the db with its supported version.  in the end, when all services are updated, the admin sends an update request to use the latest version19:58
DuncanTthangp: Yup19:58
thangpDuncanT: got it now :)19:59
*** bkopilov has quit IRC19:59
thangpDuncanT: sounds like a good plan to me19:59
*** bkopilov has joined #openstack-cinder19:59
*** delattec has quit IRC19:59
*** annegentle has quit IRC20:02
*** annegentle has joined #openstack-cinder20:02
*** koralgolek has quit IRC20:02
*** _cjones_ has joined #openstack-cinder20:03
*** dencaval has quit IRC20:03
DuncanTthangp: Awesome :-)20:03
vilobhmm1DuncanT : but cinder.services doesn't not contain any version info20:03
DuncanTvilobhmm1: Yet20:04
vilobhmm1the version_string is just computed here https://github.com/openstack/cinder/blob/master/cinder/service.py#L14020:04
vilobhmm1right20:04
DuncanTthangp: Please feel free to add / edit the etherpad20:04
thangpthangp: ok20:04
vilobhmm1so in the above summary that thang mentioned how does version get updated to db ?20:04
*** MentalRay has quit IRC20:05
thangpvilobhmm1: we have to add to start() to do that20:05
vilobhmm1i know so my question is will there be a new field called as "version" in cinder.services ?20:07
vilobhmm1or for that matter in any other table ?20:07
DuncanTvilobhmm1: Yes. Or maybe one object_version and one rpc_version20:08
*** alexpilotti has quit IRC20:08
vilobhmm1DuncanT : now it makes sense20:08
thangpDuncanT: we need a min and max version, no?20:08
DuncanTthangp: Yeah, or 'supported' and 'pinned' might be better (clearer) names20:09
*** alexpilotti has joined #openstack-cinder20:09
thangpDuncanT: ok20:09
vilobhmm1sounds good20:09
asselinnikeshm, hi20:10
*** rushil has joined #openstack-cinder20:12
*** jkremer has joined #openstack-cinder20:14
*** MentalRay has joined #openstack-cinder20:15
*** alexpilotti has quit IRC20:16
*** breitz has quit IRC20:17
*** breitz has joined #openstack-cinder20:17
*** Longgeek has quit IRC20:18
*** AlkaD has joined #openstack-cinder20:20
*** _cjones_ has quit IRC20:21
*** alexpilotti has joined #openstack-cinder20:21
hemnahttps://review.openstack.org/#/c/181102/20:23
patrickeastnikeshm: sry, stepped out of the office for a little bit, that image should be re-built from that cron setting, so like i’ve configured mine to a new one every day at 2am, you shouldn’t have to upload it manually to glance, nodepool does it for you20:25
*** timcl has quit IRC20:25
*** _cjones_ has joined #openstack-cinder20:25
*** drjones has joined #openstack-cinder20:25
*** abhiram_moturi has quit IRC20:27
*** abhiram_moturi has joined #openstack-cinder20:28
*** ronis has quit IRC20:28
*** alexpilotti has quit IRC20:29
*** ebalduf has quit IRC20:30
*** emagana has quit IRC20:31
*** ebalduf has joined #openstack-cinder20:31
asselinnikeshm, I still recomend manually building the node image the first time: nodepool image-build dpc (as nodepool user)20:32
*** emagana has joined #openstack-cinder20:32
openstackgerritDerrick Wippler proposed openstack/python-cinderclient: Avoid _get_keystone_session() if auth_plugin  https://review.openstack.org/15551820:34
*** bnemec has quit IRC20:36
*** abhiram_moturi has quit IRC20:41
e0nehemna: why do we need separate patch to add a dependency?20:41
*** abhiram_moturi has joined #openstack-cinder20:42
*** abhiram_moturi has quit IRC20:44
*** abhiram_moturi has joined #openstack-cinder20:44
hemnae0ne, mirror delays20:44
e0nehemna: thanks! didn't know about such hack:)20:46
* e0ne bb in ~12 hours20:46
*** abhiram_moturi has quit IRC20:48
*** abhiram_moturi has joined #openstack-cinder20:49
*** abhiram_moturi has quit IRC20:51
*** lpabon has quit IRC20:51
*** abhiram_moturi has joined #openstack-cinder20:51
*** e0ne has quit IRC20:51
*** bnemec has joined #openstack-cinder20:51
*** abhiram_moturi has quit IRC20:53
asselinnikeshm, also export DIB_OFFLINE=true to make it go faster20:53
*** abhiram_moturi has joined #openstack-cinder20:54
openstackgerritDerrick Wippler proposed openstack/python-cinderclient: Avoid _get_keystone_session() if auth_plugin  https://review.openstack.org/15551820:54
*** bswartz has quit IRC20:57
*** akerr has quit IRC20:58
*** jungleboyj has quit IRC21:00
*** merooney has quit IRC21:02
*** thangp has quit IRC21:04
*** annegentle has quit IRC21:04
*** abhiram_moturi has quit IRC21:06
*** abhiram_moturi has joined #openstack-cinder21:06
*** vmtrooper has joined #openstack-cinder21:08
*** Lee1092 has quit IRC21:11
*** juzuluag has quit IRC21:12
*** Anticime1 is now known as Anticimex21:14
*** EmilienM is now known as EmilienM|afk21:16
*** abhiram_moturi has quit IRC21:18
*** abhiram_moturi has joined #openstack-cinder21:18
*** abhiram_moturi has quit IRC21:20
*** abhiram_moturi has joined #openstack-cinder21:21
*** bnemec has quit IRC21:25
*** IlyaG has quit IRC21:28
*** Yogi1 has quit IRC21:28
*** IlyaG has joined #openstack-cinder21:31
*** IanGovett has quit IRC21:33
openstackgerritMatt Riedemann proposed openstack/cinder: Log command failure details before raising ISCSITargetDetachFailed  https://review.openstack.org/18115721:35
*** akerr has joined #openstack-cinder21:36
*** akerr_ has joined #openstack-cinder21:37
*** jkremer has quit IRC21:37
*** akerr has quit IRC21:41
*** IlyaG has quit IRC21:42
openstackgerritTom Swanson proposed openstack/cinder: Dell: Added support for update_migrated_volume  https://review.openstack.org/18116021:44
*** bill_az has joined #openstack-cinder21:47
*** dustins has quit IRC21:49
*** dustins has joined #openstack-cinder21:50
*** IlyaG has joined #openstack-cinder21:51
thingeexyang1: is this happening for liberty? https://blueprints.launchpad.net/cinder/+spec/emc-isilon-iscsi-volume-driver21:55
*** rushil has quit IRC21:55
openstackgerritTom Swanson proposed openstack/cinder: Dell: Added support for update_migrated_volume  https://review.openstack.org/18116021:56
xyang1thingee: That is an old one, we are not contributing21:56
*** david-lyle has joined #openstack-cinder21:56
xyang1thingee: Not sure if there is a way to abandon a bp21:56
thingeexyang1: I took care of it21:57
thingeexyang1: thanks21:57
xyang1thingee: Thanks21:57
xyang1thingee: There is a new driver bp for scaleio.  That is for liberty21:58
xyang1thingee: Did you see it?21:58
SwansonHow do you go about identifying something as a potential bug fix for a previous release (kilo, in this case)?21:58
thingeexyang1: I believe I already approved it21:59
xyang1thingee: Great, thanks21:59
*** chlong has quit IRC21:59
*** dannywilson has quit IRC22:00
*** madskier has joined #openstack-cinder22:00
*** dannywil_ has joined #openstack-cinder22:01
*** dannywil_ has quit IRC22:02
*** ebalduf has quit IRC22:03
*** dannywilson has joined #openstack-cinder22:04
*** madskier has quit IRC22:05
*** emagana has quit IRC22:07
*** eharney has quit IRC22:07
*** akerr_ has quit IRC22:10
*** jungleboyj has joined #openstack-cinder22:10
*** akerr has joined #openstack-cinder22:11
*** abhiram_moturi has quit IRC22:18
*** abhiram_moturi has joined #openstack-cinder22:18
*** abhiram_moturi has quit IRC22:22
hemnais that the error message you are seeing ?22:23
*** abhiram_moturi has joined #openstack-cinder22:23
*** hodos has quit IRC22:24
*** abhiram_moturi has quit IRC22:27
*** abhiram_moturi has joined #openstack-cinder22:27
openstackgerritJohn Griffith proposed openstack/cinder: Fix xxx=\n pep8 errors in volume_utils.py  https://review.openstack.org/18117922:28
openstackgerritJohn Griffith proposed openstack/cinder: Check volume_backend in retype  https://review.openstack.org/18107922:28
*** primechuck has quit IRC22:30
openstackgerritVilobh Meshram proposed openstack/cinder: Bad link in API version details response  https://review.openstack.org/18069122:31
*** vmtrooper has quit IRC22:31
*** abhiram_moturi has quit IRC22:34
*** ociuhandu has joined #openstack-cinder22:34
*** abhiram_moturi has joined #openstack-cinder22:34
openstackgerritJohn Griffith proposed openstack/cinder: Check volume_backend in retype  https://review.openstack.org/18107922:36
*** changbl has quit IRC22:36
*** david-lyle has quit IRC22:38
*** IanGovett has joined #openstack-cinder22:39
*** esker has quit IRC22:42
*** dannywilson has quit IRC22:44
*** dannywilson has joined #openstack-cinder22:46
*** akerr has quit IRC22:49
*** abhiram_moturi has quit IRC22:52
*** abhiram_moturi has joined #openstack-cinder22:53
*** abhiram_moturi has quit IRC22:55
*** abhiram_moturi has joined #openstack-cinder22:55
*** abhiram_moturi has quit IRC22:57
*** abhiram_moturi has joined #openstack-cinder22:58
*** abhiram_moturi has quit IRC23:02
*** AlkaD has quit IRC23:02
*** abhiram_moturi has joined #openstack-cinder23:02
*** abhiram_moturi has quit IRC23:08
*** abhiram_moturi has joined #openstack-cinder23:08
*** abhiram_moturi has quit IRC23:10
*** abhiram_moturi has joined #openstack-cinder23:11
*** abhiram_moturi has quit IRC23:15
*** abhiram_moturi has joined #openstack-cinder23:15
*** hemna is now known as hemnafk23:17
*** MentalRay has quit IRC23:18
*** abhiram_moturi has quit IRC23:24
*** chlong has joined #openstack-cinder23:24
*** abhiram_moturi has joined #openstack-cinder23:24
*** bswartz has joined #openstack-cinder23:25
*** markvoelker has quit IRC23:26
openstackgerritOpenStack Proposal Bot proposed openstack/cinder: Updated from global requirements  https://review.openstack.org/17841023:30
*** abhiram_moturi has quit IRC23:35
*** abhiram_moturi has joined #openstack-cinder23:35
openstackgerritJohn Griffith proposed openstack/cinder: Check volume_backend in retype  https://review.openstack.org/18107923:37
*** abhiram_moturi has quit IRC23:39
*** abhiram_moturi has joined #openstack-cinder23:40
*** abhiram_moturi has quit IRC23:44
*** abhiram_moturi has joined #openstack-cinder23:44
*** abhiram_moturi has quit IRC23:46
*** abhiram_moturi has joined #openstack-cinder23:46
*** abhiram_moturi has quit IRC23:48
*** abhiram_moturi has joined #openstack-cinder23:49
*** dims_ has joined #openstack-cinder23:50
*** dims has quit IRC23:52
*** mriedem is now known as mriedem_away23:54
*** takedakn has joined #openstack-cinder23:55
*** markvoelker has joined #openstack-cinder23:56
*** dustins has quit IRC23:56
*** markvoelker has quit IRC23:57
*** markvoelker has joined #openstack-cinder23:57
openstackgerritVilobh Meshram proposed openstack/cinder: Bad link in API version details response  https://review.openstack.org/18069123:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!