Saturday, 2017-11-11

« Friday, 2017-11-10 Index Sunday, 2017-11-12 »
*** beekneemech is now known as bnemec-pto00:02
*** gouthamr has quit IRC00:05
openstackgerritMerged openstack/nova-specs master: Add spec for symmetric GET and PUT of allocations  https://review.openstack.org/50816400:06
*** thorst has joined #openstack-nova00:07
*** Sukhdev has quit IRC00:16
openstackgerritMatt Riedemann proposed openstack/nova master: Add FlavorPayload.description for versioned notifications  https://review.openstack.org/51478200:20
openstackgerritMatt Riedemann proposed openstack/nova master: Add microversion to allow setting flavor description  https://review.openstack.org/51521300:20
*** gbarros has joined #openstack-nova00:22
*** thorst has quit IRC00:31
*** thorst has joined #openstack-nova00:31
*** thorst has quit IRC00:33
*** thorst has joined #openstack-nova00:33
*** thorst has quit IRC00:38
*** gbarros has quit IRC00:40
*** jmlowe has joined #openstack-nova00:44
*** andreas_s has joined #openstack-nova00:47
*** gyee_ has joined #openstack-nova00:48
*** andreas_s has quit IRC00:53
*** AlexeyAbashkin has joined #openstack-nova00:55
*** gbarros has joined #openstack-nova00:55
*** rodolof has quit IRC00:57
*** AlexeyAbashkin has quit IRC00:59
*** yamamoto has joined #openstack-nova01:01
*** gbarros has quit IRC01:02
*** Apoorva_ has joined #openstack-nova01:05
*** Apoorva has quit IRC01:08
*** mdnadeem has joined #openstack-nova01:09
*** Apoorva_ has quit IRC01:10
*** gbarros has joined #openstack-nova01:10
*** jmlowe has quit IRC01:14
*** gyee_ has quit IRC01:27
*** gbarros has quit IRC01:29
*** gbarros has joined #openstack-nova01:31
*** esberglu has quit IRC01:33
openstackgerritMerged openstack/nova master: Move last_bytes into the path module  https://review.openstack.org/50941701:50
openstackgerritMerged openstack/nova master: Factor out duplicated notification sample data  https://review.openstack.org/45281801:50
openstackgerritMerged openstack/nova master: Factor out duplicated notification sample data (2)  https://review.openstack.org/45281901:55
*** AlexeyAbashkin has joined #openstack-nova01:55
openstackgerritMerged openstack/nova master: Deduplicated instance.(un)pause notification samples  https://review.openstack.org/45282001:55
*** salv-orlando has joined #openstack-nova01:56
*** AlexeyAbashkin has quit IRC01:59
*** salv-orlando has quit IRC02:00
*** dave-mccowan has joined #openstack-nova02:05
*** mdnadeem has quit IRC02:12
*** mdnadeem has joined #openstack-nova02:13
openstackgerritMerged openstack/nova master: Deduplicate instance.power-off notification samples  https://review.openstack.org/47586002:13
openstackgerritMerged openstack/nova master: Deduplicate instance.interface_attach samples  https://review.openstack.org/51574002:13
openstackgerritMerged openstack/nova master: Deduplicate instance.live_migration notification samples  https://review.openstack.org/51574502:13
openstackgerritMerged openstack/nova master: Deduplicate instance.reboot notification samples  https://review.openstack.org/51575102:13
*** gbarros has quit IRC02:17
*** eharney has quit IRC02:17
*** dave-mcc_ has joined #openstack-nova02:23
*** gbarros has joined #openstack-nova02:26
*** dave-mccowan has quit IRC02:26
*** armax has quit IRC02:26
*** armax has joined #openstack-nova02:27
*** armax has quit IRC02:32
*** yamamoto has quit IRC02:32
*** fragatina has quit IRC02:33
*** thorst has joined #openstack-nova02:35
*** yamamoto has joined #openstack-nova02:35
*** fragatin_ has joined #openstack-nova02:36
*** fragatin_ has quit IRC02:38
*** yamamoto has quit IRC02:40
*** fragatina has joined #openstack-nova02:40
*** thorst has quit IRC02:43
*** thorst has joined #openstack-nova02:44
*** thorst has quit IRC02:44
*** fragatina has quit IRC02:44
*** amodi has joined #openstack-nova02:44
*** sree has joined #openstack-nova02:48
*** sree_ has joined #openstack-nova02:49
*** sree_ is now known as Guest7719402:50
*** sree has quit IRC02:53
*** salv-orlando has joined #openstack-nova02:57
*** salv-orlando has quit IRC03:01
*** amodi has quit IRC03:06
*** gbarros has quit IRC03:08
*** artom_ has joined #openstack-nova03:11
*** artom_ has joined #openstack-nova03:11
*** artom has quit IRC03:14
*** vladikr has quit IRC03:20
*** vladikr has joined #openstack-nova03:21
*** sapd__ has joined #openstack-nova03:22
*** sapd_ has quit IRC03:22
*** dave-mcc_ has quit IRC03:26
*** yamamoto has joined #openstack-nova03:39
*** gbarros has joined #openstack-nova03:41
*** gbarros has quit IRC03:45
*** yamamoto has quit IRC03:46
*** Guest77194 has quit IRC03:47
*** sree has joined #openstack-nova03:47
*** gbarros has joined #openstack-nova03:52
*** sree has quit IRC03:52
*** AlexeyAbashkin has joined #openstack-nova03:54
*** salv-orlando has joined #openstack-nova03:58
*** AlexeyAbashkin has quit IRC03:58
*** salv-orlando has quit IRC04:03
*** vladikr has quit IRC04:11
*** gbarros has quit IRC04:28
*** ramishra has joined #openstack-nova04:40
*** sree has joined #openstack-nova04:43
*** thorst has joined #openstack-nova04:45
*** yamamoto has joined #openstack-nova04:48
*** yamamoto has quit IRC04:53
*** AlexeyAbashkin has joined #openstack-nova04:54
*** gbarros has joined #openstack-nova04:57
*** AlexeyAbashkin has quit IRC04:59
*** salv-orlando has joined #openstack-nova05:00
*** salv-orlando has quit IRC05:05
*** ramishra has quit IRC05:14
*** sree has quit IRC05:20
*** sree has joined #openstack-nova05:20
*** fragatina has joined #openstack-nova05:22
*** fragatin_ has joined #openstack-nova05:24
*** sree has quit IRC05:25
*** fragatina has quit IRC05:27
*** gbarros has quit IRC05:27
*** armax has joined #openstack-nova05:28
*** ramishra has joined #openstack-nova05:33
*** gbarros has joined #openstack-nova05:33
*** gbarros has quit IRC05:39
*** fragatin_ has quit IRC05:39
*** fragatina has joined #openstack-nova05:40
*** psachin has joined #openstack-nova05:43
*** ramishra has quit IRC05:43
*** ramishra has joined #openstack-nova05:45
*** fragatina has quit IRC05:56
*** fragatina has joined #openstack-nova06:01
*** gbarros has joined #openstack-nova06:02
*** psachin has quit IRC06:23
*** armax has quit IRC06:43
*** armax has joined #openstack-nova06:43
*** armax has quit IRC06:44
*** armax has joined #openstack-nova06:44
*** armax has quit IRC06:44
*** armax has joined #openstack-nova06:45
*** armax has quit IRC06:45
*** salv-orlando has joined #openstack-nova07:01
*** salv-orlando has quit IRC07:05
*** moshele has joined #openstack-nova07:07
*** gbarros has quit IRC07:14
*** moshele has quit IRC07:27
*** brault has quit IRC07:57
*** brault has joined #openstack-nova07:57
*** brault has quit IRC08:02
*** salv-orlando has joined #openstack-nova08:02
*** salv-orlando has quit IRC08:06
*** sree has joined #openstack-nova08:20
*** sree has quit IRC08:22
*** sree has joined #openstack-nova08:23
*** ramishra has quit IRC08:29
*** ramishra_ has joined #openstack-nova08:30
*** thorst has quit IRC08:30
*** ramishra_ has quit IRC08:40
*** brault has joined #openstack-nova08:50
*** salv-orlando has joined #openstack-nova09:23
*** yamamoto has joined #openstack-nova09:25
*** yamamoto has quit IRC09:42
openstackgerritMichael Still proposed openstack/nova master: Convert ext filesystem resizes to privsep.  https://review.openstack.org/51751609:44
openstackgerritMichael Still proposed openstack/nova master: Move flushing block devices to privsep.  https://review.openstack.org/51901009:44
openstackgerritMichael Still proposed openstack/nova master: Start moving users of parted to privsep.  https://review.openstack.org/51901109:44
*** salv-orlando has quit IRC10:02
*** salv-orlando has joined #openstack-nova10:02
*** salv-orlando has quit IRC10:07
*** thorst has joined #openstack-nova10:28
*** mdnadeem has quit IRC10:34
*** yamamoto has joined #openstack-nova10:43
*** yamamoto has quit IRC11:04
*** AlexeyAbashkin has joined #openstack-nova11:10
*** AlexeyAbashkin has quit IRC11:21
*** AlexeyAbashkin has joined #openstack-nova11:28
*** nsingh has quit IRC11:39
*** bhagyashri_s has quit IRC11:39
*** bhagyashri_s has joined #openstack-nova11:39
*** nsingh has joined #openstack-nova11:40
*** andreas_s has joined #openstack-nova11:43
*** tbachman has quit IRC11:45
*** sree has quit IRC11:48
*** andreas_s has quit IRC11:48
*** AlexeyAbashkin has quit IRC11:49
*** gszasz has joined #openstack-nova11:55
*** brault has quit IRC12:00
*** sree has joined #openstack-nova12:03
*** sree has quit IRC12:08
*** sdague has joined #openstack-nova12:18
*** salv-orlando has joined #openstack-nova12:20
*** yamamoto has joined #openstack-nova12:20
*** yamamoto has quit IRC12:24
*** thorst has quit IRC12:27
*** AlexeyAbashkin has joined #openstack-nova12:57
*** brault has joined #openstack-nova12:58
*** brault has quit IRC13:00
*** brault has joined #openstack-nova13:00
*** AlexeyAbashkin has quit IRC13:01
*** takedakn has joined #openstack-nova13:02
*** yamamoto has joined #openstack-nova13:08
*** takedakn has quit IRC13:12
*** thorst has joined #openstack-nova13:24
*** salv-orlando has quit IRC13:29
*** salv-orlando has joined #openstack-nova13:29
*** gszasz has quit IRC13:30
*** salv-orlando has quit IRC13:33
*** jmlowe has joined #openstack-nova13:38
*** thorst has quit IRC13:54
*** thorst has joined #openstack-nova13:54
*** thorst has quit IRC13:56
*** McNinja has quit IRC14:02
*** sdague has quit IRC14:20
*** owalsh has quit IRC14:24
*** dave-mccowan has joined #openstack-nova14:27
*** dave-mccowan has quit IRC14:29
*** mvk has quit IRC14:29
*** mvk has joined #openstack-nova14:29
*** jmlowe has quit IRC14:33
*** dave-mccowan has joined #openstack-nova14:34
*** mvk has quit IRC14:37
*** mvk has joined #openstack-nova14:38
*** sree has joined #openstack-nova14:40
*** dave-mccowan has quit IRC14:42
*** takedakn has joined #openstack-nova14:43
*** gszasz has joined #openstack-nova14:47
*** takedakn has quit IRC14:54
*** thorst has joined #openstack-nova14:56
openstackgerritHironori Shiina proposed openstack/nova master: virt/ironic: Implement rescue and unrescue  https://review.openstack.org/41648714:59
*** snasir has quit IRC15:10
*** snasir has joined #openstack-nova15:10
*** salv-orlando has joined #openstack-nova15:30
*** salv-orlando has quit IRC15:36
*** fragatina has quit IRC15:44
*** david-lyle has quit IRC15:45
*** dave-mcc_ has joined #openstack-nova15:59
*** moshele has joined #openstack-nova16:12
*** moshele has quit IRC16:20
*** salv-orlando has joined #openstack-nova16:31
*** yamamoto has quit IRC16:34
*** thorst has quit IRC16:35
*** salv-orlando has quit IRC16:35
*** gbarros has joined #openstack-nova16:43
*** fried_rice is now known as efried16:53
*** mriedem has joined #openstack-nova16:57
mriedemboooooya16:57
efriedDo tell16:57
efriedmriedem Back stateside?16:58
mriedemrotting in LAX16:59
efriedSorry to hear that.17:01
efriedmriedem You looking around for easy reviews to keep you busy?17:03
efried<smiles sweetly>17:03
mriedemnope17:03
mriedemi'm going on about 1 hour of sleep so it wouldn't be helpful17:04
efriedmriedem What sacrifices need to be made to what gods to get a requirements bump backported to stable?17:07
mriedemwhich one?17:08
efriedpypowervm.  Found a bug that makes OVS-connected VMs drop their connections unrecoverably on reboot.17:10
efriedThere's no patch up yet; still working through the fix on the pypowervm & nova-powervm side.17:10
efriedJust testing the waters to see if we're going to be able to backport the nova-powervm fix in its pretty form, or if we're gonna have to hack the crap out of it for stable.17:11
*** mriedem1 has joined #openstack-nova17:15
*** dave-mcc_ has quit IRC17:15
mriedem1sorry, wifi sucks17:15
mriedem1efried: in general we don't bump minim version in g-r17:16
*** mriedem has quit IRC17:16
mriedem1*minimum17:16
efriedYuh.  Are there cases for not-in-general?17:17
mriedem1yeah, cve's for one17:17
mriedem1we could maybe fudge this since it's an optional dependency,17:18
mriedem1but it is in requirements.txt so it kind of depends on how packagers handle requirements,17:18
mriedem1i know fedora/rhel strip out the requirements.txt and just handle package deps in the rpm spec17:18
efriedIt's not really a security thing.  Just a your-vm-will-break thing.17:20
mriedem1sure17:28
*** mriedem1 is now known as mriedem17:28
mriedemone of the risks of putting a bunch of the driver functionality into a library, which makes things sticky17:29
mriedemi will happily defer to his tonyb-ness on this17:29
*** salv-orlando has joined #openstack-nova17:32
openstackgerritMatt Riedemann proposed openstack/nova master: Add FlavorPayload.description for versioned notifications  https://review.openstack.org/51478217:32
openstackgerritMatt Riedemann proposed openstack/nova master: Add microversion to allow setting flavor description  https://review.openstack.org/51521317:32
*** yamamoto has joined #openstack-nova17:35
*** owalsh has joined #openstack-nova17:37
*** salv-orlando has quit IRC17:37
*** fragatina has joined #openstack-nova17:38
*** yamamoto has quit IRC17:44
*** dave-mccowan has joined #openstack-nova17:50
mriedemefried: is this new? http://logs.openstack.org/73/513473/2/check/legacy-tempest-dsvm-cells/be1a0fa/logs/screen-placement-api.txt.gz#_Nov_10_01_14_05_23038217:52
efried...17:52
efriedmriedem It doesnae look good.17:52
efriedlooking...17:53
mriedemshit i don't think we index the placement api logs17:54
* mriedem checks17:54
clarkbwe should, though indexing has been funky with the zuul v3 switch (slowly been improving its performance)17:58
efriedmriedem ensure_consumer_project_user is only a couple weeks old (https://review.openstack.org/#/c/500410/) but I don't see how the _ensure_project thing could fail unless timing (someone else came along and whacked the entry) or the insert failed.17:59
mriedemhttps://bugs.launchpad.net/nova/+bug/173166818:00
openstackLaunchpad bug 1731668 in OpenStack Compute (nova) "placement: claim allocations fails with IndexError in _ensure_lookup_table_entry" [Undecided,New]18:00
efriedoh.  Or external_id ain't in there.18:00
efriednaw, cause that should insert it.18:01
mriedemthis is during scheduling, so not sure if it's a race or what - it must be a race otherwise we'd have a pretty high failure rate18:03
mriedem21 hits in 10 days18:03
openstackgerritEric Fried proposed openstack/nova master: EXPERIMENTAL: Retry getting project ID  https://review.openstack.org/51903418:07
efriedmriedem If it's racey, this'll fix it ^18:07
efriedBut the real deal ought to have a limited number of retries :)18:07
mriedemthat seems pretty wrong, i mean, if the insert fails because of a duplicate entry18:11
efriedmriedem Depends how racey it is.  Clearly the second SELECT failed, or we wouldn't be seeing the error.  So we got to the exception clause, inserted a new one, then someone else came in and deleted it before we got to the return.18:16
*** thorst has joined #openstack-nova18:17
efriedSorry, let me try that again: The first SELECT returns nada.  Then we try to INSERT, but someone had already inserted, so we get the exception.  Then before we get a chance to run the second SELECT, someone comes along and deletes the entry.18:18
mriedemtrue18:18
efriedThat'd be a pretty wild race to be seeing so frequently.18:18
mriedemin debugging this failed job, it looked like the scheduler was creating allocations twice for the same instance in the same scheduling run, but maybe it was moving the instance or something, i didn't dig into what the test does18:26
mriedemactually this just failed in server create18:26
efriedmriedem Where do project IDs ever get deleted?18:28
mriedemtempest cleanup18:29
mriedembut that wouldn't be happening here,18:29
mriedemand the project delete would be via keystone on test teardown in tempest18:29
mriedemwhen we set allocations in placement, we first remove all of the existing allocations it looks like,18:30
mriedemso i'm wondering if that's related somehow18:30
*** mriedem has quit IRC18:30
*** mriedem has joined #openstack-nova18:33
mriedemthe test tries to create 2 servers, the first one gets its allocations created in placement, the 2nd fails to create allocations in placement18:33
*** salv-orlando has joined #openstack-nova18:34
mriedemthe instances are processed serially and we're only using 1 scheduler worker, so it's weird that something would be racing here18:34
mriedemwe should start running 2 scheduler workers in our CI jobs just to tease out concurrency bugs, but that's a separate todo18:35
efriedI haven't looked at the test cases yet, but if this external_id is a uuidsentinel that we're repeating in multiple (different, unrelated) test cases, could that be causing collisions?18:36
efriedOr does each test case get its own database?18:36
*** salv-orlando has quit IRC18:38
*** moshele has joined #openstack-nova18:39
mriedemthis is integration testing, so real things18:42
mriedemsingle db18:42
mriedemi'm not sure what external_id is, is that the project_id in this case?18:42
efriedDunno.18:43
mriedemyeah it is18:43
mriedemwe ensure there is an entry in the projects table for that entry before linking it to the consumers table which is linked to the allocations table18:44
mriedemi think18:44
mriedem*entry in the projects table for that project id18:44
mriedemand if we're scheduling 2 instanes with the same project, and the first instance scheduled created allocations successfully, the projects table should already have that entry for that project_id18:46
mriedemso the select() should fine it and we shouldn't even attempt the insert()18:46
mriedem*find it18:46
mriedemdamn, brain no work good18:46
mriedemefried: this one is up your alley too https://bugs.launchpad.net/nova/+bug/173080018:56
openstackLaunchpad bug 1730800 in OpenStack Compute (nova) "UnknownConnectionError" [Undecided,New]18:56
mriedemlooks like ksa adapter stuff18:56
efriedlooking...18:56
*** thorst has quit IRC19:00
mriedembattery is gonna die, and so am i, so i'm shutting 'er down. ttyl.19:02
*** mriedem has quit IRC19:02
*** moshele has quit IRC19:03
*** fragatina has quit IRC19:04
*** cburgess has quit IRC19:05
*** cburgess has joined #openstack-nova19:05
*** Apoorva has joined #openstack-nova19:16
*** salv-orlando has joined #openstack-nova19:34
*** salv-orlando has quit IRC19:38
*** gbarros has quit IRC19:42
*** armax has joined #openstack-nova20:22
*** salv-orlando has joined #openstack-nova20:22
*** AlexeyAbashkin has joined #openstack-nova20:25
*** AlexeyAbashkin has quit IRC20:29
*** brault has quit IRC20:30
*** brault has joined #openstack-nova20:31
*** brault has quit IRC20:35
*** thorst has joined #openstack-nova20:38
*** thorst has quit IRC20:44
*** mvk has quit IRC20:49
*** mvk has joined #openstack-nova20:49
*** salv-orlando has quit IRC21:01
*** salv-orlando has joined #openstack-nova21:02
*** salv-orlando has quit IRC21:06
*** AlexeyAbashkin has joined #openstack-nova21:25
*** AlexeyAbashkin has quit IRC21:29
openstackgerritMerged openstack/nova master: Don't update RT in _allocate_network  https://review.openstack.org/51347321:42
*** sree has quit IRC21:45
*** dave-mccowan has quit IRC21:55
*** salv-orlando has joined #openstack-nova22:02
*** salv-orlando has quit IRC22:06
*** yangyapeng has quit IRC22:10
*** yangyapeng has joined #openstack-nova22:11
*** yangyapeng has quit IRC22:16
*** AlexeyAbashkin has joined #openstack-nova22:25
*** AlexeyAbashkin has quit IRC22:29
*** snasir has quit IRC22:38
*** snasir has joined #openstack-nova22:38
*** jmlowe has joined #openstack-nova22:41
*** andreas_s has joined #openstack-nova22:41
*** dave-mccowan has joined #openstack-nova22:42
*** andreas_s has quit IRC22:46
*** salv-orlando has joined #openstack-nova23:03
*** salv-orlando has quit IRC23:07
*** gszasz has quit IRC23:13
*** dave-mccowan has quit IRC23:15
*** AlexeyAbashkin has joined #openstack-nova23:25
*** AlexeyAbashkin has quit IRC23:29
*** andreas_s has joined #openstack-nova23:43
*** andreas_s has quit IRC23:49
« Friday, 2017-11-10 Index Sunday, 2017-11-12 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!