Thursday, 2018-12-13

*** mriedem has quit IRC00:01
*** itlinux has joined #openstack-cinder00:11
*** itlinux has quit IRC00:11
*** Liang__ has joined #openstack-cinder00:16
*** markguz_ has quit IRC00:36
*** dklyle has joined #openstack-cinder00:53
*** brinzhang has joined #openstack-cinder01:08
*** dave-mccowan has joined #openstack-cinder01:17
*** hedvig_01 has quit IRC01:20
*** lixiaoy1 has joined #openstack-cinder01:21
lixiaoy1jungleboyj: smcginnis eharney could you help to have a look at our rsd driver https://review.openstack.org/#/c/621465/ ? anything we missed?01:25
openstackgerritBrian Rosmaita proposed openstack/cinder master: Add policy configuration howto  https://review.openstack.org/62442401:54
*** bhagyashris has joined #openstack-cinder01:56
*** Dinesh_Bhor has joined #openstack-cinder01:59
*** Dinesh_Bhor has quit IRC02:09
*** Dinesh_Bhor has joined #openstack-cinder02:10
*** dave-mccowan has quit IRC02:14
*** itlinux has joined #openstack-cinder02:17
openstackgerritBrian Rosmaita proposed openstack/cinder master: Add policy configuration howto  https://review.openstack.org/62442402:18
*** mhen has quit IRC02:27
*** mhen has joined #openstack-cinder02:28
openstackgerritLisaLi proposed openstack/cinder master: Driver reinitialization after failure  https://review.openstack.org/61870202:37
openstackgerritLisaLi proposed openstack/cinder-specs master: nitialization after failure  https://review.openstack.org/62485303:09
openstackgerritLisaLi proposed openstack/cinder-specs master: Driver reinitialization after failure  https://review.openstack.org/62485303:14
*** dklyle has quit IRC03:22
*** brinzhang has quit IRC03:28
openstackgerritMerged openstack/cinder master: VMware: Check empty provider location  https://review.openstack.org/60446203:45
*** itlinux has quit IRC04:11
*** khomesh has joined #openstack-cinder04:16
openstackgerritMerged openstack/cinder stable/rocky: SF ensure the correct volume is deleted  https://review.openstack.org/62303604:20
*** itlinux has joined #openstack-cinder04:43
*** udesale has joined #openstack-cinder04:49
*** bhagyashris has quit IRC05:01
*** itlinux has quit IRC05:11
*** _alastor_ has joined #openstack-cinder05:24
*** Liang__ is now known as LiangFang05:29
*** bhagyashris has joined #openstack-cinder05:52
whoami-rajatenriquetaso I've put up the fix for the openstackclient bug, https://review.openstack.org/#/c/624860/ . Kindly check.05:56
openstackgerritLisaLi proposed openstack/cinder master: Driver reinitialization after failure  https://review.openstack.org/61870206:02
openstackgerritLisaLi proposed openstack/cinder master: Driver reinitialization after failure  https://review.openstack.org/61870206:05
*** _alastor_ has quit IRC06:20
openstackgerritLiang Fang proposed openstack/cinder master: Handle image download and conversion errors  https://review.openstack.org/61897606:39
*** _alastor_ has joined #openstack-cinder06:40
openstackgerritBrin Zhang proposed openstack/cinder master: api-ref: Fix the parameters of update volume type interface's response  https://review.openstack.org/62486506:52
*** _alastor_ has quit IRC06:59
*** rcernin has quit IRC07:09
*** pcaruana has joined #openstack-cinder07:12
*** yikun has quit IRC07:20
*** Luzi has joined #openstack-cinder07:33
*** _alastor_ has joined #openstack-cinder07:35
lixiaoy1eharney: abishop: please help to review the updated spec for driver reinitialization. https://review.openstack.org/#/c/624853/ and its implementation is here https://review.openstack.org/#/c/618702/07:36
*** _alastor_ has quit IRC07:40
openstackgerritWoojay Poynter proposed openstack/cinder master: Update DRBD (drbdmanagedrv) Driver to LINSTOR (linstordrv)  https://review.openstack.org/62423307:47
*** dklyle has joined #openstack-cinder08:07
*** _alastor_ has joined #openstack-cinder08:08
openstackgerritWoojay Poynter proposed openstack/cinder master: Update DRBD (drbdmanagedrv) Driver to LINSTOR (linstordrv)  https://review.openstack.org/62423308:08
*** _alastor_ has quit IRC08:12
*** imacdonn has quit IRC08:23
*** imacdonn has joined #openstack-cinder08:24
*** dklyle has quit IRC08:27
openstackgerritYingxin Cheng proposed openstack/os-brick master: Support RSD scenario of nvme connector  https://review.openstack.org/62025008:31
*** Dinesh_Bhor has quit IRC08:31
*** Dinesh_Bhor has joined #openstack-cinder08:32
*** brinzhang has joined #openstack-cinder08:45
*** brinzh has joined #openstack-cinder08:48
*** brinzhang has quit IRC08:50
openstackgerritYingxin Cheng proposed openstack/cinder master: [wip] Cinder RSD Driver  https://review.openstack.org/62146508:57
openstackgerritYingxin Cheng proposed openstack/cinder master: [wip] Cinder RSD Driver  https://review.openstack.org/62146508:59
*** alkhodos has quit IRC09:06
*** alkhodos has joined #openstack-cinder09:06
*** arne_wiebalck has quit IRC09:14
*** arne_wiebalck_ has joined #openstack-cinder09:14
*** trident has quit IRC09:16
*** trident has joined #openstack-cinder09:19
*** dcdamien has joined #openstack-cinder09:29
*** sayalilunkad has quit IRC09:31
*** luizbag has joined #openstack-cinder09:39
*** e0ne has joined #openstack-cinder09:41
openstackgerritBrin Zhang proposed openstack/cinder master: api-ref: Fix the parameter of update volume type interface's response  https://review.openstack.org/62486509:42
*** markvoelker has joined #openstack-cinder09:46
*** bhagyashris has quit IRC09:47
*** ganso has joined #openstack-cinder10:06
*** mpasserini1 has joined #openstack-cinder10:11
*** trident has quit IRC10:15
*** trident has joined #openstack-cinder10:15
*** helenafm has joined #openstack-cinder10:16
*** mvkr has quit IRC10:24
*** sayalilunkad has joined #openstack-cinder10:35
*** mvkr has joined #openstack-cinder10:56
*** LiangFang has quit IRC11:03
*** mvkr has quit IRC11:16
*** mvkr has joined #openstack-cinder11:16
*** _alastor_ has joined #openstack-cinder11:25
*** _alastor_ has quit IRC11:30
*** tobias-urdin is now known as tobias-urdin_afk11:41
*** tobias-urdin_afk is now known as tobias-urdin11:42
*** tobias-urdin is now known as tobias-urdin_afk11:43
*** Dinesh_Bhor has quit IRC12:14
*** helenafm has quit IRC12:17
openstackgerritDou Rui Yuan proposed openstack/os-brick master: Fix create ceph conf failed when cephx disable  https://review.openstack.org/62496912:23
*** eharney has quit IRC12:24
*** markvoelker has quit IRC12:24
*** udesale has quit IRC12:25
*** udesale has joined #openstack-cinder12:26
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/cinder master: Fix _per_gb_min usage with _per_gb  https://review.openstack.org/62497012:28
*** brinzh has quit IRC12:32
openstackgerritYikun Jiang proposed openstack/cinder master: Add policy test for volume create policy  https://review.openstack.org/61754212:36
openstackgerritGhanshyam Mann proposed openstack/cinder master: Add irrelevant-files for integrated test jobs  https://review.openstack.org/62497512:36
openstackgerritYikun Jiang proposed openstack/cinder master: Add policy test for volume create policy  https://review.openstack.org/61754212:37
openstackgerritGhanshyam Mann proposed openstack/cinder master: Add irrelevant-files for integrated test jobs  https://review.openstack.org/62497512:38
*** mriedem has joined #openstack-cinder12:42
openstackgerritMaciej Szwed proposed openstack/cinder master: Adding SPDK volume driver  https://review.openstack.org/56422912:42
openstackgerritMaciej Szwed proposed openstack/cinder master: SPDK drivers documentation  https://review.openstack.org/60927612:42
openstackgerritLisaLi proposed openstack/cinder-specs master: Driver reinitialization after failure  https://review.openstack.org/62485312:49
*** e0ne has quit IRC12:51
*** tobias-urdin_afk is now known as tobias-urdin12:53
*** abishop has joined #openstack-cinder12:54
*** markvoelker has joined #openstack-cinder13:10
*** eharney has joined #openstack-cinder13:16
openstackgerritLisaLi proposed openstack/cinder master: Driver reinitialization after failure  https://review.openstack.org/61870213:17
*** lixiaoy1 has quit IRC13:18
*** zul has quit IRC13:32
*** e0ne has joined #openstack-cinder13:35
*** zul has joined #openstack-cinder13:40
openstackgerritJay Rubenstein proposed openstack/cinder master: SF: Handle qos values on extend volume  https://review.openstack.org/60695913:40
*** e0ne has quit IRC13:49
*** helenafm has joined #openstack-cinder13:52
*** Liang__ has joined #openstack-cinder13:54
*** e0ne has joined #openstack-cinder13:57
*** Liang__ is now known as LiangFang13:59
*** irclogbot_0 has quit IRC14:00
*** markvoelker has quit IRC14:03
*** irclogbot_0 has joined #openstack-cinder14:08
*** irclogbot_0 has quit IRC14:14
*** mchlumsky has joined #openstack-cinder14:22
*** irclogbot_0 has joined #openstack-cinder14:23
enriquetasowhoami-rajat: thanks!!!14:25
*** _alastor_ has joined #openstack-cinder14:33
*** markvoelker has joined #openstack-cinder14:36
*** _alastor_ has quit IRC14:38
openstackgerritDan Smith proposed openstack/cinder master: Synchronize all LVM operations  https://review.openstack.org/62480914:46
dansmithmriedem: first patch passed so here's one we could keep if we decide ^14:47
dansmithhere's one that would have run concurrently but waited for the lock: http://logs.openstack.org/09/624809/1/check/tempest-full/ee9862a/controller/logs/screen-c-vol.txt.gz#_Dec_12_21_50_37_00509814:52
openstackgerritFrancois Deppierraz proposed openstack/cinder master: cinder-volume: Stop masking IOError different than ENOSPC  https://review.openstack.org/61239314:53
openstackgerritFrancois Deppierraz proposed openstack/cinder master: cinder-volume: Stop masking IOError different than ENOSPC  https://review.openstack.org/61239314:54
dansmiththere are several in there actually14:54
jungleboyjdansmith:  Would be really nice if that was the key.14:54
dansmithyeah, the lock makes it easy to see that many things would be run concurrently, so it seems like a reasonable stab to take in the dark14:55
jungleboyj:-)14:56
* mriedem is currently fighting in like 4 channels at once14:57
jungleboyjdansmith:  So how do you think we should proceed with that patch?14:58
jungleboyjKeep running it through and see how it fairs?14:59
noonedeadpunkFolks, can you take a look at https://review.openstack.org/#/c/624970/ ? It's fixing min per_gb qos14:59
openstackgerritFrancois Deppierraz proposed openstack/cinder master: cinder-volume: Stop masking IOError different than ENOSPC  https://review.openstack.org/61239314:59
noonedeadpunkmnaser ^ it might be interesting for you, as an author (and probably you're using it in prod)15:00
dansmithjungleboyj: I think it won't hurt anything, could help a lot, and we won't know for sure until we get it running at gate scale, so .. yeah I think it's worth putting it in and seeing what effect it has, if you guys are cool with it15:00
mriedemdansmith: Dec 12 21:50:37.005098 ubuntu-bionic-vexxhost-sjc1-0001160633 cinder-volume[13331]: DEBUG oslo_concurrency.lockutils [None req-8373164f-7f9b-4a67-a02a-69aee338bcb5 tempest-ServersNegativeTestJSON-439819850 None] Lock "cinder-lvm-exec" acquired by "cinder.brick.local_dev.lvm._execute" :: waited 0.304s {{(pid=13442) inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:327}} also looks like the15:01
mriedemest wait i see in there15:01
mriedem.3 seconds15:01
mriedembetter than ~60 seconds...15:01
jungleboyjAgreed.15:01
dansmithmriedem: there's a half second wait in there to do an lv delete15:01
dansmithbut most are ~0.2ish seconds15:01
jungleboyjmriedem: I would say, based on discussion yesterday, that this isn't hurting anything and it is the best guess we have at the moment.15:02
jungleboyjIf it causes other issues at scale, we can always roll it back.15:02
mriedemyes, and we should know within a week of it's helped15:03
mriedemb/c the e-r graph will go down15:03
mriedemcommented and +115:04
*** dpawlik has quit IRC15:06
*** itlinux has joined #openstack-cinder15:06
*** dpawlik has joined #openstack-cinder15:07
*** dpawlik has quit IRC15:07
mnasernoonedeadpunk: that’s super bad if that’s the case. Are you able to add a test that shows that?15:08
noonedeadpunkHad 2 disks, which are connected to the instance - 10Gb VDC and 200GB VDD: http://paste.openstack.org/show/737139/15:09
noonedeadpunkand qos limits http://paste.openstack.org/show/737138/15:10
noonedeadpunkAlso, I'm going to add another patch, to remove conflict with %s_sec_max, as it's used with %_per_gb, and per_gb is higher, than max - instance will fail booting15:12
noonedeadpunkBut I don't know, how to do the best way - in addition to per_gb_min add per_gb_max, or rely on existing max options, so that the operator could set maximum available capacity, even if per_gb is used15:14
fricklercinder might be broken on centos-7 with mysl5.6, see http://logs.openstack.org/86/624986/1/check/devstack-platform-centos-7/893f067/job-output.txt.gz#_2018-12-13_13_43_54_348189 and https://stackoverflow.com/questions/1814532/1071-specified-key-was-too-long-max-key-length-is-767-bytes15:21
*** mpasserini1 has quit IRC15:25
noonedeadpunkmnaser: so after this slight fix, and volume re-attach, it has right number of iops in virsh xml15:25
fricklerjungleboyj: smcginnis: dansmith: this is the patch that introduced the migration https://review.openstack.org/61153015:33
*** markvoelker has quit IRC15:38
*** dpawlik has joined #openstack-cinder15:40
jungleboyjfrickler:  Ugh.15:41
jungleboyjThat is not good.15:42
*** dpawlik has quit IRC15:44
*** Luzi has quit IRC15:52
*** morgan is now known as kmalloc16:09
*** LiangFang has quit IRC16:16
openstackgerritSofia Enriquez proposed openstack/cinder stable/pike: ScaleIO Driver - adding cache and refactoring tests  https://review.openstack.org/62504116:19
*** eharney has quit IRC16:22
*** eharney_ has joined #openstack-cinder16:22
*** e0ne has quit IRC16:30
*** e0ne has joined #openstack-cinder16:30
*** _alastor_ has joined #openstack-cinder16:34
*** markguz_ has joined #openstack-cinder16:40
*** udesale has quit IRC16:41
markguz_jungleboyj: i found another interesting problem. Not sure if it;s the zone manager or flashsystem driver.  if i create two volumes and map them to the same vm. The first volume maps ok16:42
jungleboyjmarkguz_: That is very odd.  Do you have replication set in the extra specs or something?16:43
*** _alastor_ has quit IRC16:43
markguz_the second fails to map.  What i see in the log is that zone manager says "zone already present in I-T mode, not creating" and then the flashsystem driver never creates the vdiskhostmap to the second volume16:43
jungleboyjSo Cinder things there are two volumes but there is only one?16:44
markguz_jungleboyj: no there are two volumes.  zonemanager says "i don't need to create another zone because there's already a zone in place", but then i would expect cinder to carry on and tell the flashsystem to create the vdisk->host map for the second volume16:45
markguz_but it never does and nova just times out the attachment process16:46
markguz_in short. I cannot map more than one volume from the same flashsystem to the same host16:47
openstackgerritAlan Bishop proposed openstack/cinder master: Fix A/A 'resource_backend' when scheduling volumes  https://review.openstack.org/62505216:47
markguz_jungleboyj: i feel like i'm doing something wrong because this seems pretty fundamental to me16:51
jungleboyjYeah.  That should be a pretty fundamental function.  I would think if that wasn't working someone would have seen it.16:52
markguz_indeed. not sure how to debug it16:53
*** eharney_ is now known as eharney16:53
openstackgerritMerged openstack/os-brick stable/rocky: Tests: Add unit tests for nfs mount race  https://review.openstack.org/62303416:54
openstackgerritMerged openstack/os-brick stable/rocky: Fix NFS "already mounted" detection  https://review.openstack.org/62303516:54
whoami-rajatjungleboyj: Hi Jay, can you take a look at this https://review.openstack.org/#/c/619676 . It will be easier for me to write the remaining tests if the base framework gets merged. Thanks.16:59
jungleboyjOk.  Will take a look today.17:00
whoami-rajatjungleboyj: Thanks !17:03
*** helenafm has quit IRC17:07
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/cinder master: Allow to use _max qos option together with per_gb  https://review.openstack.org/62505817:12
*** zul has quit IRC17:35
*** ianychoi has quit IRC17:42
*** dcdamien has quit IRC17:42
dansmithmriedem: jungleboyj smcginnis: at the end of the 4h window that it takes to get a vote on a patch, we'll see that the lvm-serialization patch failed a single glance test and needs to be rechecked17:51
smcginnisYeah, was tempted to abandon/restore to short circuit the recheck, but I'd like to see the tempest-full results.17:52
dansmithyeah17:52
dansmithactually it looks like that job is either stuck or zuul isn't updating its console for some reason17:54
dansmithlatest log entry is from 10m after it started17:54
* dansmith heads to infra17:54
dansmithsmcginnis: it just finished, zero failed17:56
smcginnisLooks like it's still running.17:59
*** erlon has joined #openstack-cinder18:01
dansmithit is, but it's cleaning up.. tempest succeeded was all I meant18:02
dansmithnot much use in short circuiting now I think18:02
dansmithsmcginnis: http://logs.openstack.org/09/624809/2/check/grenade-py3/151dee7/18:03
dansmither18:03
dansmithhttp://logs.openstack.org/09/624809/2/check/tempest-full/c399a0b/18:03
*** e0ne has quit IRC18:11
*** e0ne has joined #openstack-cinder18:15
*** e0ne has quit IRC18:16
*** _alastor_ has joined #openstack-cinder18:31
*** markguz_ has quit IRC18:37
*** _alastor_ has quit IRC18:39
*** mvkr has quit IRC18:40
*** dcdamien has joined #openstack-cinder18:45
openstackgerritMerged openstack/os-brick stable/queens: Tests: Add unit tests for nfs mount race  https://review.openstack.org/62323718:47
*** jmlowe has quit IRC18:47
openstackgerritMerged openstack/os-brick stable/queens: Fix NFS "already mounted" detection  https://review.openstack.org/62323818:56
*** jmlowe has joined #openstack-cinder19:12
*** luizbag has quit IRC19:18
*** eharney has quit IRC19:20
*** mvkr has joined #openstack-cinder19:21
*** N3l1x has joined #openstack-cinder19:24
*** alkhodos has quit IRC19:24
*** alkhodos has joined #openstack-cinder19:24
*** N3l1x has quit IRC19:30
dansmithsmcginnis: heh, now it failed a unit test (for unrelated reasons)19:36
*** N3l1x has joined #openstack-cinder19:39
*** pcaruana has quit IRC19:47
enriquetasowhoami-rajat: I'm trying to get the " _info" inside VolumeBackupsRetore object (https://bugs.launchpad.net/python-openstackclient/+bug/1733315).  I'm putting a LOG.info(backup) but I can't see it in c-api logs. Where should I look for it?19:51
openstackLaunchpad bug 1733315 in python-openstackclient "cinder-backup - CLI 'VolumeBackupsRestore' object is not iterable" [Undecided,Confirmed] - Assigned to Rajat Dhasmana (whoami-rajat)19:51
*** e0ne has joined #openstack-cinder19:53
*** e0ne has quit IRC19:58
*** erlon has quit IRC20:15
*** eharney has joined #openstack-cinder20:24
lbragstadjust double checking, but cinder is planning on having a team meeting next week, right?20:28
jungleboyjlbragstad:  Yes.20:28
lbragstadcool20:28
lbragstadi saw rosmaita's note http://lists.openstack.org/pipermail/openstack-discuss/2018-December/000875.html and wanted to swing by in case y'all end up talking about it again20:28
jungleboyjlbragstad:  Would you like us to discuss it?  Do you have more input because we were kind-of flailing on the subject.20:32
jungleboyjJust wondering if I should put it on the agneda.20:33
lbragstadi posted a follow up here - http://lists.openstack.org/pipermail/openstack-discuss/2018-December/000916.html20:33
lbragstadand we can certainly keep iterating on the thread, but i can make myself available during the cinder meeting if people what more synchronous communication20:34
rosmaitalbragstad: so i completely missed all the default roles stuff happening in rocky20:35
lbragstadrosmaita to be fair, it was keystone specific - we had to take the first step in order for others to start consuming it20:36
lbragstadearly in the cycle we were asking for feedback on naming, but that's about it20:36
rosmaitafrom a quick look it seems like we could do some policy config on our side to take advantage of those in our default settings20:37
lbragstadyeah - which is kinda related to the testing point you brought up20:37
lbragstad(which came up in Denver, too)20:37
* jungleboyj is reading20:38
lbragstadrosmaita my response to you got a little long winded... but did the testing bit make sense?20:39
rosmaitanot sure, i need to look at the patches20:40
lbragstadack20:41
jungleboyjlbragstad:  Glad you got looped in.  It looks like that may be a much safer approach for what rosmaita  was shooting for.20:41
lbragstadyeah - the testing stuff would be idea, but i also completely understand it's a lot of work20:41
lbragstad(i'm hoping we can make it an incremental thing moving forward)20:42
lbragstadbut - if it makes you feel better, keystone isn't exempt from any of this... we're currently bolstering our own API protection testing as we implement those default roles https://review.openstack.org/#/q/status:open+project:openstack/keystone+branch:master+topic:implement-default-roles20:43
rosmaitalbragstad: i will look at the patches, i have been reviewing Yikun Jiang's policy test patches, but haven't really figured out the strategy20:43
rosmaitawxy left a comment for me that i need to look at your original patch, so i will20:44
lbragstadoh - nice20:44
* lbragstad digs for a link20:44
lbragstadhttps://review.openstack.org/#/c/617542/ is one of them?20:45
rosmaitayes, that's one20:45
rosmaitawxy left a link to https://review.openstack.org/#/c/602489/20:45
rosmaitawhich i see you also mentioned in your email20:45
lbragstadyep20:51
lbragstadlooking at yikun's patch quick20:52
*** psachin has joined #openstack-cinder20:52
*** lpetrut has joined #openstack-cinder20:53
*** ianychoi has joined #openstack-cinder20:59
*** jmlowe has quit IRC21:01
*** mriedem has quit IRC21:02
*** markvoelker has joined #openstack-cinder21:11
*** tpsilva has quit IRC21:12
*** jmlowe has joined #openstack-cinder21:22
*** ganso has quit IRC21:22
*** mriedem has joined #openstack-cinder21:26
*** jmlowe has quit IRC21:26
*** psachin has quit IRC21:27
*** tobias-urdin has quit IRC21:32
*** hedvig_01 has joined #openstack-cinder21:40
*** jmlowe has joined #openstack-cinder21:50
*** lpetrut has quit IRC22:00
*** N3l1x has quit IRC22:04
*** dklyle has joined #openstack-cinder22:05
*** abishop has quit IRC22:06
*** markvoelker has quit IRC22:06
*** david-lyle has joined #openstack-cinder22:09
*** dklyle has quit IRC22:12
*** rcernin has joined #openstack-cinder22:21
*** david-lyle has quit IRC22:23
imacdonnOuch .. I believe I just found a somewhat nasty bug in cinder ... it causes it to ignore the case where the an image downloaded from glance (CC rosmaita) fails checksum/hash verification22:26
imacdonnwhen that happens, glanceclient throws a IOError with code EPIPE: https://github.com/openstack/python-glanceclient/blob/master/glanceclient/common/utils.py#L466-L46922:28
imacdonncinder catches the IOError, but ignores it unless it's a ENOSPC: https://github.com/openstack/cinder/blob/master/cinder/image/image_utils.py#L375-L38722:28
eharneyimacdonn: i think this is being fixed here: https://review.openstack.org/#/c/612393/22:29
eharneydefinitely need to get that one in..22:29
imacdonnahh, that looks right22:29
imacdonnPS14? urgh22:29
eharneythere are some weird db errors on the py36 job...22:33
eharney"Command out of sync" doesn't ring a bell for me22:33
imacdonnyeah, I was just going to look at what failed .. seems it should be a straightforward fix22:33
eharneyand, uhy, more ceph job stuff for me to patch up.  i turned on encryption test cases there, but the blacklist to turn off the unsupported tests in that job apparently only worked in the devstack-plugin-ceph jobs and not in the cinder runs22:35
*** itlinux has quit IRC22:36
*** lbragstad has quit IRC22:37
imacdonnI think I'm going to recheck this, unless you object ... that DB error looks unrelated to the code changed22:39
eharneyi think it is unrelated22:39
imacdonnoh, doh, smcginnis already recheck'ed it22:41
*** mchlumsky has quit IRC22:45
*** dcdamien has quit IRC22:45
*** noonedeadpunk has quit IRC23:02
*** noonedeadpunk has joined #openstack-cinder23:03
*** _alastor_ has joined #openstack-cinder23:30
*** mriedem has quit IRC23:41

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!