| *** awalende has joined #openstack-nova | 00:00 | |
| *** tbachman has joined #openstack-nova | 00:01 | |
| *** wolverineav has quit IRC | 00:01 | |
| *** wolverineav has joined #openstack-nova | 00:01 | |
| *** wolverineav has quit IRC | 00:04 | |
| *** awalende has quit IRC | 00:04 | |
| *** wolverineav has joined #openstack-nova | 00:05 | |
| *** tetsuro has joined #openstack-nova | 00:08 | |
| *** wolverineav has quit IRC | 00:10 | |
| *** tbachman has quit IRC | 00:15 | |
| *** alex_xu has quit IRC | 00:27 | |
| *** tbachman has joined #openstack-nova | 00:27 | |
| *** bbowen has joined #openstack-nova | 00:32 | |
| openstackgerrit | Merged openstack/nova master: Don't warn on network-vif-unplugged event during live migration https://review.openstack.org/642877 | 00:32 |
|---|---|---|
| *** bbowen__ has quit IRC | 00:33 | |
| *** wolverineav has joined #openstack-nova | 00:35 | |
| *** igordc has quit IRC | 00:36 | |
| mriedem | this uh, seems not so necessary https://github.com/openstack/nova/commit/70c7ba7324cf47179d978b4073545e3837d4fd24#diff-12951ec32bc2b8cae6ea1933599a3dbcR334 | 00:37 |
| mriedem | and potentially a security issue | 00:41 |
| mriedem | efried: melwitt: ^ is new in stein so if it's something we shouldn't be exposing in the notifications we should probably think about that for rc2 | 00:43 |
| sean-k-mooney | wait we send the db connection field in the cellmapping notifcation? | 00:47 |
| mriedem | apparently | 00:47 |
| mriedem | and transport_url | 00:47 |
| sean-k-mooney | is that now the templated url? | 00:47 |
| openstackgerrit | Merged openstack/nova master: Drop migrate_keypairs_to_api_db data migration https://review.openstack.org/649648 | 00:47 |
| openstackgerrit | Merged openstack/nova master: Add functional test for the JsonFilter https://review.openstack.org/647811 | 00:47 |
| openstackgerrit | Merged openstack/nova master: api-ref: document ordering for instance actions and events https://review.openstack.org/649748 | 00:47 |
| openstackgerrit | Merged openstack/nova master: api-ref: fix description of os-server-external-events 'events' param https://review.openstack.org/649750 | 00:47 |
| openstackgerrit | Merged openstack/nova master: Remove mox in unit/network/test_neutronv2.py (6) https://review.openstack.org/574113 | 00:48 |
| sean-k-mooney | hehe a lot of nova patches were in the last job run | 00:48 |
| sean-k-mooney | anyway if its the tempalted url its may not be an issue but ya if its the actully connetion sting that is bad | 00:49 |
| mriedem | it does not need to be templated | 00:50 |
| mriedem | https://docs.openstack.org/nova/latest/user/cells.html#template-urls-in-cell-mappings | 00:50 |
| mriedem | even if it was templated, it would be the full url when pulled out of the CellMapping object attribute | 00:51 |
| sean-k-mooney | :( | 00:52 |
| sean-k-mooney | the patch mentioned it was transfroming the notificaiton to the versioned form | 00:52 |
| *** luksky has quit IRC | 00:52 | |
| sean-k-mooney | was this previouly sent via the unversioned endpoint | 00:52 |
| mriedem | i doubt it | 00:53 |
| sean-k-mooney | ok so it is a regression in stien and i agree it a security concern too. | 00:53 |
| sean-k-mooney | how did you come across it | 00:53 |
| mriedem | the unversioned notification sent RequestSpec.to_legacy_request_spec_dict() | 00:54 |
| mriedem | tssurya -1ed a change of mine saying i should add more stuff to that notification since i added a new field to the Destination object | 00:54 |
| mriedem | https://review.openstack.org/#/c/614035/ | 00:55 |
| sean-k-mooney | mriedem: ah ok i similarly modifed a field in one of my patches and it ended up changin the image metadata notificaion | 00:55 |
| sean-k-mooney | which i undersand in a way but i also was confused by | 00:55 |
| sean-k-mooney | it seams that we not have to version some object when field in an objec support new values | 00:55 |
| *** wolverineav has quit IRC | 00:55 | |
| sean-k-mooney | previousl we did not version bump object for compostion | 00:56 |
| sean-k-mooney | only when fields were added or removed | 00:56 |
| *** wolverineav has joined #openstack-nova | 00:56 | |
| mriedem | gibi_off: stephenfin: https://review.openstack.org/#/c/508506/28/nova/notifications/objects/request_spec.py@334 - if we don't need those i don't tihnk we should be sending them out of nova on the notification bus | 00:56 |
| *** ileixe has joined #openstack-nova | 00:57 | |
| *** wolverineav has quit IRC | 01:00 | |
| *** tetsuro has quit IRC | 01:01 | |
| *** tetsuro_ has joined #openstack-nova | 01:01 | |
| sean-k-mooney | mriedem: do we want to even include the cell here https://review.openstack.org/#/c/508506/28/nova/notifications/objects/request_spec.py@284 | 01:02 |
| mriedem | idk, the legacy notification for select_destinations didn't send all of this stuff | 01:02 |
| mriedem | so i don't know why it was all added | 01:02 |
| mriedem | the legacy notification sent a legacy more minimal view of the request spec | 01:03 |
| mriedem | this version is everything | 01:03 |
| mriedem | sending the name/uuid of the cell is meh to me | 01:03 |
| mriedem | sending the URLs with credentials to connect to the cell...that's a bad idea | 01:04 |
| sean-k-mooney | ya i was just looking at what the to_legacy_request_spec_dict function did | 01:04 |
| sean-k-mooney | i would proably change 'cell': fields.ObjectField('CellMappingPayload', nullable=True), | 01:04 |
| mriedem | well i threw this on the RC2 etherpad so i guess can wait for others to look and provide an opinion | 01:05 |
| sean-k-mooney | to 'cell': fields.UUIDFiled(nullable=True), | 01:05 |
| sean-k-mooney | and then drop the CellMappingPayload object entirely | 01:05 |
| sean-k-mooney | i think we require the host to be unique across all cells anyway though so the cell is uudi is not really needed | 01:06 |
| mriedem | i'm dropping off | 01:09 |
| *** mriedem has quit IRC | 01:09 | |
| sean-k-mooney | o/ | 01:09 |
| *** tiendc has joined #openstack-nova | 01:19 | |
| openstackgerrit | Tetsuro Nakamura proposed openstack/nova master: Pass node uuid to new Destination.node_uuid https://review.openstack.org/649533 | 01:45 |
| openstackgerrit | Tetsuro Nakamura proposed openstack/nova master: Add in_tree field to RequestGroup object https://review.openstack.org/649534 | 01:45 |
| openstackgerrit | Tetsuro Nakamura proposed openstack/nova master: node_uuid from RequestSpec to ResourceRequest https://review.openstack.org/649535 | 01:45 |
| *** wolverineav has joined #openstack-nova | 02:03 | |
| *** whoami-rajat has joined #openstack-nova | 02:03 | |
| *** wolverineav has quit IRC | 02:08 | |
| *** tinwood has quit IRC | 02:10 | |
| *** tinwood has joined #openstack-nova | 02:12 | |
| *** hongbin has joined #openstack-nova | 02:12 | |
| *** BjoernT has joined #openstack-nova | 02:15 | |
| ileixe | Hi forks. | 02:20 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Obfuscate CellMappingPayload database_connection and transport_url https://review.openstack.org/649775 | 02:20 |
| ileixe | Is this bp https://review.openstack.org/#/c/599598/ abonded at all? | 02:20 |
| ileixe | abandoned* | 02:20 |
| ileixe | We need this functionality a lot, so I wonder about it. | 02:21 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Obfuscate CellMappingPayload database_connection and transport_url https://review.openstack.org/649775 | 02:22 |
| *** mriedem has joined #openstack-nova | 02:23 | |
| mriedem | melwitt: added you and others https://review.openstack.org/#/c/649775/ | 02:24 |
| mriedem | wip until people chew on the alternatives | 02:24 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove MIN_COMPUTE_MULTIATTACH conditions in API https://review.openstack.org/649757 | 02:27 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add nova-status upgrade check for minimum required cinder API version https://review.openstack.org/649759 | 02:27 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Drop pre-cinder 3.44 version compatibility https://review.openstack.org/621061 | 02:27 |
| *** ileixe has quit IRC | 02:29 | |
| *** markvoelker has joined #openstack-nova | 02:29 | |
| *** mriedem has quit IRC | 02:29 | |
| openstackgerrit | zhufl proposed openstack/nova master: Remove reading xvpconf_template in xvp.py https://review.openstack.org/649777 | 02:31 |
| openstackgerrit | Bhagyashri Shewale proposed openstack/nova master: Ignore root_gb for BFV in simple tenant usage API https://review.openstack.org/612626 | 02:36 |
| *** zhubx has quit IRC | 02:36 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova-specs master: Spec for API inconsistency cleanup https://review.openstack.org/603969 | 02:37 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Change a log level for overwriting allocation https://review.openstack.org/649788 | 02:44 |
| *** psachin has joined #openstack-nova | 02:44 | |
| *** markvoelker has quit IRC | 02:59 | |
| *** zhubx has joined #openstack-nova | 03:16 | |
| *** samueldmq has quit IRC | 03:16 | |
| *** wolverineav has joined #openstack-nova | 03:20 | |
| *** wolverineav has quit IRC | 03:25 | |
| openstackgerrit | Alex Xu proposed openstack/nova master: [DNM] debug the LM test https://review.openstack.org/649807 | 03:26 |
| *** alex_xu has joined #openstack-nova | 03:28 | |
| *** BjoernT has quit IRC | 03:38 | |
| *** BjoernT has joined #openstack-nova | 03:44 | |
| *** BjoernT has quit IRC | 03:44 | |
| *** tetsuro_ has quit IRC | 03:50 | |
| *** tetsuro has joined #openstack-nova | 03:51 | |
| *** BjoernT has joined #openstack-nova | 03:52 | |
| *** hongbin has quit IRC | 03:52 | |
| *** markvoelker has joined #openstack-nova | 03:57 | |
| *** zhubx has quit IRC | 03:57 | |
| *** BjoernT has quit IRC | 04:00 | |
| *** zhubx has joined #openstack-nova | 04:03 | |
| *** udesale has joined #openstack-nova | 04:09 | |
| *** ceryx has quit IRC | 04:10 | |
| *** markvoelker has quit IRC | 04:29 | |
| openstackgerrit | Jake Yip proposed openstack/nova master: Add --before to nova-manage db archive_deleted_rows https://review.openstack.org/556751 | 04:31 |
| *** cfriesen has quit IRC | 04:33 | |
| *** erlon has joined #openstack-nova | 04:44 | |
| *** ileixe has joined #openstack-nova | 04:46 | |
| *** ricolin has joined #openstack-nova | 04:57 | |
| *** pcaruana has joined #openstack-nova | 04:58 | |
| *** lbragstad has quit IRC | 05:06 | |
| *** tetsuro has quit IRC | 05:09 | |
| *** ratailor has joined #openstack-nova | 05:12 | |
| *** tetsuro has joined #openstack-nova | 05:14 | |
| *** ccamacho has quit IRC | 05:22 | |
| *** bhagyashris_ has joined #openstack-nova | 05:23 | |
| *** krypto has joined #openstack-nova | 05:24 | |
| *** markvoelker has joined #openstack-nova | 05:27 | |
| *** shilpasd has quit IRC | 05:35 | |
| *** tetsuro_ has joined #openstack-nova | 05:38 | |
| *** tetsuro has quit IRC | 05:40 | |
| *** phasespace has quit IRC | 05:59 | |
| *** markvoelker has quit IRC | 06:00 | |
| *** tetsuro_ has quit IRC | 06:03 | |
| openstackgerrit | Huqiang Wang proposed openstack/nova-specs master: Separate the vCPUs into different pools based on priority https://review.openstack.org/649882 | 06:07 |
| *** zhubx has quit IRC | 06:09 | |
| *** zhubx has joined #openstack-nova | 06:09 | |
| *** janki has joined #openstack-nova | 06:13 | |
| *** sridharg has joined #openstack-nova | 06:15 | |
| *** alex_xu has quit IRC | 06:15 | |
| *** Luzi has joined #openstack-nova | 06:18 | |
| *** slaweq has joined #openstack-nova | 06:21 | |
| *** dpawlik has joined #openstack-nova | 06:26 | |
| *** sidx64 has joined #openstack-nova | 06:30 | |
| *** erlon has quit IRC | 06:36 | |
| *** manjeets has quit IRC | 06:36 | |
| *** mdbooth_ has quit IRC | 06:45 | |
| *** rpittau|afk is now known as rpittau | 06:48 | |
| *** markvoelker has joined #openstack-nova | 06:57 | |
| *** tesseract has joined #openstack-nova | 07:09 | |
| *** ccamacho has joined #openstack-nova | 07:11 | |
| *** awalende has joined #openstack-nova | 07:13 | |
| *** awalende has quit IRC | 07:17 | |
| *** awalende has joined #openstack-nova | 07:18 | |
| *** wolverineav has joined #openstack-nova | 07:21 | |
| *** dims has quit IRC | 07:22 | |
| *** dims has joined #openstack-nova | 07:24 | |
| *** sidx64 has quit IRC | 07:25 | |
| *** wolverineav has quit IRC | 07:25 | |
| *** tosky has joined #openstack-nova | 07:26 | |
| *** helenafm has joined #openstack-nova | 07:27 | |
| *** markvoelker has quit IRC | 07:30 | |
| openstackgerrit | Huqiang Wang proposed openstack/nova-specs master: Separate the vCPUs into different pools based on priority https://review.openstack.org/649882 | 07:31 |
| *** dims has quit IRC | 07:31 | |
| *** dims has joined #openstack-nova | 07:34 | |
| *** ralonsoh has joined #openstack-nova | 07:34 | |
| *** ralonsoh has quit IRC | 07:34 | |
| *** jistr is now known as jistr|afk | 07:35 | |
| *** ralonsoh has joined #openstack-nova | 07:37 | |
| *** krypto has quit IRC | 07:43 | |
| *** elod_off has quit IRC | 07:45 | |
| *** brinzhang has quit IRC | 07:50 | |
| *** brinzhang has joined #openstack-nova | 07:50 | |
| *** elod_off has joined #openstack-nova | 07:52 | |
| *** spsurya has joined #openstack-nova | 07:55 | |
| *** tssurya has joined #openstack-nova | 07:56 | |
| *** tkajinam has quit IRC | 08:22 | |
| *** dtantsur|afk is now known as dtantsur | 08:25 | |
| *** markvoelker has joined #openstack-nova | 08:28 | |
| openstackgerrit | zhaixiaojun proposed openstack/nova master: Update description of valid whitelist https://review.openstack.org/642403 | 08:30 |
| openstackgerrit | zhaixiaojun proposed openstack/nova master: Update description of valid whitelist https://review.openstack.org/642403 | 08:33 |
| kashyap | Is there some 'tox' shortcut to build _just_ one releases's specs? | 08:34 |
| kashyap | `tox -e docs train` or something like that | 08:34 |
| *** mdbooth has joined #openstack-nova | 08:42 | |
| openstackgerrit | Michael Still proposed openstack/nova master: Hacking N362: Don't abbrev/alias privsep import https://review.openstack.org/649190 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Improve test coverage of nova.privsep.path. https://review.openstack.org/648601 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Improve test coverage of nova.privsep.fs. https://review.openstack.org/648602 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Improve test coverage of nova.privsep.fs, continued. https://review.openstack.org/648603 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Add test coverage for nova.privsep.libvirt. https://review.openstack.org/648616 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Add test coverage for nova.privsep.qemu. https://review.openstack.org/649191 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Privsepify ipv4 forwarding enablement. https://review.openstack.org/635431 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Remove unused FP device creation and deletion methods. https://review.openstack.org/635433 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Privsep the ebtables modification code. https://review.openstack.org/635435 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move adding vlans to interfaces to privsep. https://review.openstack.org/635436 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move iptables rule fetching and setting to privsep. https://review.openstack.org/636508 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move dnsmasq restarts to privsep. https://review.openstack.org/639280 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move router advertisement daemon restarts to privsep. https://review.openstack.org/639281 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move calls to ovs-vsctl to privsep. https://review.openstack.org/639282 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move setting of device trust to privsep. https://review.openstack.org/639283 | 08:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move final bridge commands to privsep. https://review.openstack.org/639580 | 08:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: Cleanup the _execute shim in nova/network. https://review.openstack.org/639581 | 08:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: We no longer need rootwrap. https://review.openstack.org/554438 | 08:45 |
| openstackgerrit | zhaixiaojun proposed openstack/nova master: Update description of valid whitelist for non-admin user https://review.openstack.org/642403 | 08:49 |
| *** krypto has joined #openstack-nova | 08:51 | |
| *** ricolin has quit IRC | 08:53 | |
| *** jaosorior has quit IRC | 08:54 | |
| *** markvoelker has quit IRC | 09:01 | |
| *** yan0s has joined #openstack-nova | 09:14 | |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Avoid building an encryptor when device_path isn't provided https://review.openstack.org/649951 | 09:17 |
| *** mvkr has joined #openstack-nova | 09:24 | |
| stephenfin | kashyap: Not that I'm aware of, no. It's all or nothing | 09:33 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Change a log level for overwriting allocation https://review.openstack.org/649788 | 09:35 |
| *** bhagyashris_ has quit IRC | 09:43 | |
| *** wolverineav has joined #openstack-nova | 09:45 | |
| openstackgerrit | Boxiang Zhu proposed openstack/nova master: Make evacuation respects anti-affinity rule https://review.openstack.org/649953 | 09:47 |
| *** wolverineav has quit IRC | 09:49 | |
| *** luksky has joined #openstack-nova | 09:51 | |
| *** markvoelker has joined #openstack-nova | 09:58 | |
| *** sidx64 has joined #openstack-nova | 10:00 | |
| *** brinzhang has quit IRC | 10:04 | |
| *** dtantsur is now known as dtantsur|brb | 10:07 | |
| *** awalende has quit IRC | 10:10 | |
| *** awalende has joined #openstack-nova | 10:11 | |
| *** sidx64 has quit IRC | 10:15 | |
| openstackgerrit | Boxiang Zhu proposed openstack/nova master: Use the functional test test_parallel_evacuate_with_server_group https://review.openstack.org/649963 | 10:21 |
| *** bbowen has quit IRC | 10:21 | |
| *** sidx64 has joined #openstack-nova | 10:22 | |
| *** phasespace has joined #openstack-nova | 10:22 | |
| *** jistr|afk is now known as jistr | 10:23 | |
| *** awalende has quit IRC | 10:30 | |
| *** awalende has joined #openstack-nova | 10:30 | |
| *** awalende has quit IRC | 10:30 | |
| *** markvoelker has quit IRC | 10:31 | |
| *** awalende has joined #openstack-nova | 10:31 | |
| *** derekh has joined #openstack-nova | 10:35 | |
| *** sidx64 has quit IRC | 10:36 | |
| *** tbachman has quit IRC | 10:44 | |
| *** nicolasbock has joined #openstack-nova | 10:45 | |
| *** sapd1_x has joined #openstack-nova | 10:50 | |
| *** jaosorior has joined #openstack-nova | 10:52 | |
| *** ratailor has quit IRC | 10:54 | |
| *** udesale has quit IRC | 10:54 | |
| *** ratailor has joined #openstack-nova | 10:56 | |
| *** nicolasbock has quit IRC | 10:57 | |
| *** sidx64 has joined #openstack-nova | 10:59 | |
| *** jaosorior has quit IRC | 10:59 | |
| *** yan0s has quit IRC | 11:09 | |
| *** erlon has joined #openstack-nova | 11:14 | |
| *** zbr has quit IRC | 11:14 | |
| *** sidx64 has quit IRC | 11:14 | |
| *** sidx64 has joined #openstack-nova | 11:15 | |
| awalende | following problem: I had a semi-failed migration. The instance has been migrated to another host and is working so far. However, not everything has been adjusted in the db and I get the following log repeatedly in the source host: | 11:17 |
| awalende | Instance a3fcb5a8-74e3-42f9-9659-428ffe710c19 has been moved to another host schwalm. There are allocations remaining against the source host that might need to be removed: {u'resources': {u'VCPU': 2, u'MEMOR | 11:17 |
| awalende | Y_MB': 2048, u'DISK_GB': 21}} | 11:17 |
| *** cdent has joined #openstack-nova | 11:17 | |
| awalende | Where can I find the responsible parts in the db to clean up this mess? | 11:18 |
| *** sidx64 has quit IRC | 11:19 | |
| *** sidx64 has joined #openstack-nova | 11:20 | |
| *** nicolasbock has joined #openstack-nova | 11:20 | |
| *** helenafm has quit IRC | 11:22 | |
| tssurya | awalende: depending on the release you are running this would be the "allocations" table in the nova_api or placement database | 11:24 |
| awalende | It's queens :) | 11:24 |
| tssurya | you could use the https://docs.openstack.org/osc-placement/latest/cli/index.html#resource-provider-allocation-delete CLI to remove the allocation against the migration record on the source host | 11:24 |
| tssurya | ah if queens its nova_api database | 11:25 |
| tssurya | allocations table | 11:25 |
| tssurya | awalende: you should be able to find records for that migration_uuid as the consumer against the source resource_provider | 11:26 |
| awalende | select * from allocations where consumer_id='a3fcb5a8-74e3-42f9-9659-428ffe710c19'; | 11:28 |
| *** markvoelker has joined #openstack-nova | 11:28 | |
| awalende | this gave me 3 rows, so I simply have to overwrite the resource_provider_id with the id from the new host? | 11:28 |
| tssurya | awalende: the consumer_id is name of your instance ? or the migration_uuid ? | 11:29 |
| awalende | instance id | 11:29 |
| tssurya | ah so these are the allocations against the new host for your instance | 11:29 |
| awalende | ah okay | 11:30 |
| *** mvkr has quit IRC | 11:30 | |
| tssurya | could you verify by checking the resource_provider_id ? these three records should be the ones you should NOT delete | 11:30 |
| tssurya | what you should do is query with consumer_id=migration_uuid | 11:30 |
| awalende | is there a smart way to find out the resource_provider_id of each computehost? | 11:30 |
| *** bbowen has joined #openstack-nova | 11:31 | |
| *** zbr has joined #openstack-nova | 11:31 | |
| *** yan0s has joined #openstack-nova | 11:33 | |
| awalende | Ah I believe I got it | 11:38 |
| awalende | So the 3 rows in my db still have the resource_provider_id from the "old" host | 11:39 |
| tssurya | awalende: ah no allocations against new host ? | 11:39 |
| awalende | For now, I'm not finding anyone. As I mentioned before, I had to finish the failed migration manually by myself | 11:40 |
| awalende | something has been really messed up by this | 11:40 |
| *** samueldmq has joined #openstack-nova | 11:40 | |
| tssurya | ah ok that's bad then no allocations were formed against the target host and we don't know how far the migration went | 11:40 |
| tssurya | yea | 11:40 |
| awalende | for example I had to manually transfer the swap partition disk | 11:41 |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: Use migration_status during volume migrating and retyping https://review.openstack.org/637224 | 11:42 |
| awalende | Would probably the best idea to scrap this instance completely, but my customer will try to assassinate me | 11:42 |
| sean-k-mooney | jaypipes: thanks jay for your comments on https://review.openstack.org/#/c/620115/29 can you confim my understanding of what you want changed is correct | 11:42 |
| *** sidx64 has quit IRC | 11:44 | |
| awalende | but anyway, thanks for the help tssurya. much appreciated | 11:44 |
| tssurya | awalende: np :) | 11:45 |
| *** tiendc has quit IRC | 11:45 | |
| *** erlon_ has joined #openstack-nova | 11:45 | |
| *** sidx64 has joined #openstack-nova | 11:46 | |
| *** sidx64 has quit IRC | 11:47 | |
| *** sidx64 has joined #openstack-nova | 11:48 | |
| *** ratailor has quit IRC | 11:49 | |
| *** dtantsur|brb is now known as dtantsur | 11:57 | |
| awalende | ha, it worked | 11:58 |
| tssurya | awalende: you just changed the allocations manually ? :) | 11:58 |
| awalende | exactly, the warnings in the compute logs went away and the instance is still working :D | 11:59 |
| tssurya | :) let's hope for the best then | 12:00 |
| *** mvkr has joined #openstack-nova | 12:00 | |
| awalende | fingers crossed | 12:00 |
| *** markvoelker has quit IRC | 12:02 | |
| jaypipes | sean-k-mooney: I really don't know why a new "utils.lock" variable was introduced. | 12:03 |
| jaypipes | sean-k-mooney: instead of just using utils.synchronized | 12:03 |
| *** phasespace has quit IRC | 12:03 | |
| sean-k-mooney | ya neither do i which is why i was going to change it as you suggested | 12:04 |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: compute: Reject resize requests when the source host is down https://review.openstack.org/623489 | 12:04 |
| *** tbachman has joined #openstack-nova | 12:05 | |
| jaypipes | sean-k-mooney: answered on review | 12:06 |
| sean-k-mooney | jaypipes: thanks | 12:06 |
| jaypipes | sean-k-mooney: remove the utils.lock thing and I'm +2 | 12:06 |
| sean-k-mooney | perfect ill start work on that now so. if you have time to review the follow up patch its pretty short but if not that ok too. | 12:07 |
| jaypipes | sean-k-mooney: yep, already on it. | 12:07 |
| jaypipes | sean-k-mooney: I had to spend time this morning correcting your comma misuse. :P | 12:08 |
| jaypipes | sean-k-mooney: and don't get me started on your abuse of the apostrophe. | 12:08 |
| sean-k-mooney | :) i hear punction is a think people find useful. | 12:09 |
| sean-k-mooney | isnt my use of it novel | 12:09 |
| * jaypipes goes to buy sean-k-mooney a copy of "Elements of Style" as a gift for Denver PTG. | 12:09 | |
| jaypipes | "punction", eh? :) | 12:09 |
| sean-k-mooney | punctuation, i was 72% there. | 12:12 |
| artom | ... that's how they take cerebro-spinal fluid samples, no? | 12:12 |
| *** jamesdenton has quit IRC | 12:13 | |
| *** brinzhang has joined #openstack-nova | 12:21 | |
| *** yan0s has quit IRC | 12:22 | |
| sean-k-mooney | i may have lost a tab in firefox and realised its still open in one of the 14 firefox windows i currently have open. | 12:32 |
| sean-k-mooney | proably | 12:32 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove DiffieHellmann tests https://review.openstack.org/649974 | 12:34 |
| *** yan0s has joined #openstack-nova | 12:37 | |
| *** sidx64 has quit IRC | 12:38 | |
| *** sidx64 has joined #openstack-nova | 12:39 | |
| *** krypto has quit IRC | 12:39 | |
| *** Luzi has quit IRC | 12:48 | |
| *** mriedem has joined #openstack-nova | 12:54 | |
| *** lbragstad has joined #openstack-nova | 12:59 | |
| *** alex_xu has joined #openstack-nova | 13:00 | |
| *** dklyle has quit IRC | 13:02 | |
| ganso | hi alex_xu, could you please take a look at https://review.openstack.org/#/c/647566 ? The other part of that bugfix has already merged, we are waiting on this fix to land so we can backport. Thanks in advance! | 13:02 |
| alex_xu | ganso: let me check | 13:03 |
| adrianc | sean-k-mooney: Hey, are you planning to work on : https://review.openstack.org/#/c/620115/29 ? | 13:03 |
| openstackgerrit | Alex Xu proposed openstack/nova master: [DNM] debug the LM test https://review.openstack.org/649807 | 13:04 |
| sean-k-mooney | im in a meeting for the next hour but after | 13:04 |
| sean-k-mooney | if you want to do it fell free | 13:05 |
| *** udesale has joined #openstack-nova | 13:05 | |
| efried | ileixe: It appears to be abandoned. It looks like dansmith was going to make it work some other way, you may want to follow up with him. | 13:06 |
| adrianc | sean-k-mooney, jaypipes : also replied on the utils.lock() | 13:06 |
| efried | ileixe: I also seem to recall there was going to be a forum session following on from one we had in Berlin on this topic... | 13:06 |
| efried | ileixe: https://www.openstack.org/summit/denver-2019/summit-schedule/events/23675/change-ownership-of-resources-followup | 13:07 |
| *** Luzi has joined #openstack-nova | 13:07 | |
| adrianc | sean-k-mooney: have some meetings and prior engagements will probably get to it on Sunday. | 13:08 |
| *** davidsha has joined #openstack-nova | 13:08 | |
| sean-k-mooney | adrianc: ill read your comments if you have no objections to useing syncronised instead of util.lock then i can make the changes today | 13:08 |
| adrianc | sean-k-mooney: well i intentionally defined the utils.lock() so ill be able to use as a context manager and save the wrapping | 13:09 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Change a log level for overwriting allocation https://review.openstack.org/649788 | 13:09 |
| adrianc | sean-k-mooney: but if decorators are preferred then I have no objection. | 13:10 |
| *** gaoyan has joined #openstack-nova | 13:12 | |
| *** itlinux has quit IRC | 13:12 | |
| mriedem | anyone hit this grenade failure yet? http://logs.openstack.org/12/648912/4/check/grenade-py3/19a6549/logs/grenade.sh.txt.gz#_2019-04-03_03_50_29_324 | 13:13 |
| mriedem | efried: cdent: ^? | 13:14 |
| * cdent reads | 13:14 | |
| cdent | mriedem: I remember hitting that some months ago and thinking I fixed it | 13:15 |
| cdent | It happens when the openstack client is reinstalled, at a different python version, so the plugins are no longer visible | 13:15 |
| mriedem | hmm, only happening on stable/stein and master http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22cval%3D'openstack%3A%20'%5C%5C''resource%20provider%20inventory%20show%20openstack%3A%20VCPU%20-f%20value%20-c%20total'%5C%5C''%20is%20not%20an%20openstack%20command.%20See%20'%5C%5C''openstack%20--help'%5C%5C''.%5C%22%20AND%20tags%3A%5C%22console%5C%22&from=7d | 13:16 |
| mriedem | grenade was maybe branched? | 13:16 |
| cdent | so, somewhere in that log will be something causing whichever openstack command is on the path to become a different one | 13:17 |
| cdent | this was the original bug https://bugs.launchpad.net/grenade/+bug/1805156 | 13:18 |
| openstack | Launchpad bug 1805156 in grenade "In a python3 grenade run, openstack client plugins are lost after swift install" [Undecided,Fix released] - Assigned to Chris Dent (cdent) | 13:18 |
| openstackgerrit | Hamdy Khader proposed openstack/nova master: Do not perform port update in case of baremetal instance. https://review.openstack.org/649345 | 13:18 |
| mriedem | cdent: looks like osc-placement is installed into py2.7 and python-openstackclient is installed into py3.6 | 13:18 |
| efried | mriedem: Yes, I was looking at that last night. | 13:19 |
| efried | okay, looks like you guys are further along than I got | 13:20 |
| mriedem | WARNING: Did not find python 3 classifier for remote package osc-placement | 13:20 |
| mriedem | that's why osc-placement isn't installed on py3 | 13:20 |
| cdent | mriedem: swift is reinstalling python-openstackclient here: http://logs.openstack.org/12/648912/4/check/grenade-py3/19a6549/logs/grenade.sh.txt.gz#_2019-04-03_03_26_57_820 | 13:20 |
| mriedem | https://github.com/openstack/osc-placement/blob/master/setup.cfg#L18 | 13:21 |
| mriedem | assuming this is a rax-dfw node... | 13:21 |
| cdent | are you sure that's more than a warning? | 13:22 |
| mriedem | that makes me think it's bug 1820892 | 13:23 |
| openstack | bug 1820892 in devstack "Intermittent "Error starting thread.: ModuleNotFoundError: No module named 'etcd3gw'" in grenade-py3 jobs since March 14" [High,In progress] https://launchpad.net/bugs/1820892 - Assigned to Dr. Jens Harbott (j-harbott) | 13:23 |
| mriedem | devstack failing to parse the py3 classifier on pypi for rax-dfw nodes and thinks it's a py2.7 package and installs there | 13:23 |
| mriedem | https://review.openstack.org/#/c/649096/ | 13:23 |
| cdent | I agree with that fix | 13:24 |
| *** Sundar has joined #openstack-nova | 13:24 | |
| cdent | I'll fix osc-placement in the meantime | 13:25 |
| mriedem | osc-placement looks OK, except it doesn't have a 3.6 classifier, but devstack isn't looking for that | 13:25 |
| frickler | cdent: mriedem: hmm, maybe there's more to it with the "swift reinstalling osc" thing. might be swift shouldn't be installed at all for a py3 job as long as they don't do py3 | 13:25 |
| cdent | frickler: I've wondered that too | 13:26 |
| mriedem | frickler: that would be a pretty big change to the integrated gate i think since by default swift backs glance | 13:26 |
| mriedem | in devstack i mean | 13:26 |
| frickler | because some time soon we also might want to make sure that py3 jobs are able to run without py2 at all | 13:26 |
| mriedem | this was a rax-dfw node as well btw | 13:27 |
| mriedem | it's something about the networks to pypi for those nodes | 13:27 |
| cdent | that's...bizarre? | 13:28 |
| frickler | https://review.openstack.org/#/c/649096/ should help with that. if we can get it to pass all those unstable tests, that is | 13:28 |
| *** sridharg has quit IRC | 13:29 | |
| cdent | mriedem: is there anything I need to do here, or is the situation in hand? | 13:30 |
| *** sidx64 has quit IRC | 13:30 | |
| mriedem | cdent: if the underlying issue is the same bug that ^ is fixing then i think we're ok | 13:32 |
| efried | mriedem: if we're trying to cut RC2 today, we need to resolve https://review.openstack.org/#/c/649775/ ASAP, right? | 13:33 |
| efried | What's the next step there? | 13:33 |
| mriedem | efried: i'd like input from you and dansmith on that one, seems gibi thinks bumping the major and dropping the fields is better (alternative 1) and i tend to agree | 13:34 |
| mriedem | i wrote that patch before bed in haste | 13:34 |
| *** Luzi has quit IRC | 13:34 | |
| mriedem | taking my kid to the bus stop | 13:34 |
| efried | mriedem: I've only skimmed, but was there a concern that the malicious user would be able to opt into the insecure version? and how was that allayed? | 13:34 |
| *** sidx64 has joined #openstack-nova | 13:35 | |
| efried | I'll read it more deeply here... | 13:35 |
| dansmith | those fields have no place in a notification, best I can tell | 13:35 |
| *** Luzi has joined #openstack-nova | 13:37 | |
| efried | dansmith: I think that's agreed; the question is just whether we can get away with removing them from the existing version since nobody's using it yet, or if we need a new version | 13:38 |
| efried | in which case can we still get hacked by people asking for the old one | 13:38 |
| dansmith | the *only* reason to do the 1.1 version is if we really want to backport that or something | 13:39 |
| dansmith | but since, as matt said on the review, the user doesn't get to choose what they get, I think it'd be better to signal "no, these really aren't going to be in your notification" with a major version bump | 13:40 |
| dansmith | what I meant by "want to backport" is "want to backport without the appearance of a major bump and breaking change" | 13:40 |
| efried | there's not like a way to spoof a client asking for the old version? | 13:41 |
| dansmith | but I don't think we should do that | 13:41 |
| dansmith | you don't ask not notification versions | 13:41 |
| dansmith | you get what you get | 13:41 |
| dansmith | the version is just a signal to tell you something has changed | 13:41 |
| efried | okay, neat. Then I'm on board. | 13:41 |
| dansmith | it's not like objects where we try to backport a version to the one you want | 13:41 |
| *** BjoernT has joined #openstack-nova | 13:42 | |
| efried | cool | 13:43 |
| *** BjoernT has quit IRC | 13:43 | |
| *** sidx64 has quit IRC | 13:44 | |
| *** awalende has quit IRC | 13:44 | |
| mriedem | ok i'll bump the major and drop the fields | 13:45 |
| mriedem | do we still by default emit both legacy and versioned.... | 13:45 |
| mriedem | yup | 13:46 |
| mriedem | https://docs.openstack.org/nova/latest/configuration/config.html#notifications.notification_format | 13:46 |
| *** wolverineav has joined #openstack-nova | 13:46 | |
| mriedem | the amount of object translation work to build these payloads is likely a detriment to scheduling performance as wel | 13:46 |
| mriedem | *well | 13:46 |
| mriedem | anywho, that's a different known issue | 13:46 |
| dansmith | mriedem: the base object has some version that increments with each subclass change? | 13:49 |
| dansmith | oh, nm | 13:49 |
| dansmith | event_type | 13:49 |
| dansmith | which won't need to change with this | 13:49 |
| *** wolverineav has quit IRC | 13:50 | |
| *** spsurya has quit IRC | 13:51 | |
| *** awalende has joined #openstack-nova | 13:52 | |
| *** altlogbot_3 has quit IRC | 13:55 | |
| efried | Nova meeting in five minutes in #openstack-meeting | 13:55 |
| *** awalende has quit IRC | 13:56 | |
| *** awaugama has joined #openstack-nova | 13:58 | |
| *** BjoernT has joined #openstack-nova | 14:01 | |
| *** ivve has joined #openstack-nova | 14:01 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove CellMappingPayload database_connection and transport_url fields https://review.openstack.org/649775 | 14:03 |
| mriedem | gibi_off: stephenfin: dansmith: melwitt: efried: ^ | 14:03 |
| *** imacdonn has quit IRC | 14:03 | |
| stephenfin | ack | 14:03 |
| efried | thx mriedem | 14:03 |
| *** amodi has joined #openstack-nova | 14:04 | |
| *** munimeha1 has joined #openstack-nova | 14:05 | |
| *** udesale has quit IRC | 14:06 | |
| *** udesale has joined #openstack-nova | 14:07 | |
| *** udesale has quit IRC | 14:11 | |
| *** udesale has joined #openstack-nova | 14:11 | |
| *** gaoyan has quit IRC | 14:14 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: devstack: Remove 'tempest-dsvm-tempest-xen-rc' https://review.openstack.org/650018 | 14:16 |
| *** mlavalle has joined #openstack-nova | 14:16 | |
| *** janki has quit IRC | 14:17 | |
| *** awalende has joined #openstack-nova | 14:19 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add docs on what not to include in notifications https://review.openstack.org/650020 | 14:22 |
| *** dpawlik has quit IRC | 14:22 | |
| *** awalende has quit IRC | 14:23 | |
| sean-k-mooney | jaypipes: looking at adrianc responce https://review.openstack.org/#/c/620115/29/nova/compute/manager.py@7193 i think its a resonable argument but im also happy to create the new function and use the synchronized decorator. | 14:27 |
| sean-k-mooney | ill leave the decission up to you. the current decorator cant be used as a context manager but i think that could be added in the future to oslo concurancy | 14:29 |
| sean-k-mooney | i think we would jsut have to change this return to a yeild https://github.com/openstack/oslo.concurrency/blob/master/oslo_concurrency/lockutils.py#L328 | 14:30 |
| sean-k-mooney | and add the contextlib.contextmanager decorator https://docs.python.org/3/library/contextlib.html#contextlib.contextmanager | 14:31 |
| *** itlinux has joined #openstack-nova | 14:32 | |
| sean-k-mooney | its something i need to tink about but its a sepreate form this change | 14:32 |
| *** itlinux has quit IRC | 14:32 | |
| *** Luzi has quit IRC | 14:34 | |
| mriedem | efried: i shared a link to those charts i mentioned, you can peruse them at your leisure and if you think they are fine as further reading (albeit targeted topics) i can make them public and share on the ML or something | 14:42 |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/stein: Remove CellMappingPayload database_connection and transport_url fields https://review.openstack.org/650043 | 14:47 |
| efried | mriedem: thank you. | 14:47 |
| *** BjoernT has quit IRC | 14:47 | |
| *** itlinux has joined #openstack-nova | 14:48 | |
| *** mvkr has quit IRC | 14:48 | |
| *** itlinux has quit IRC | 14:49 | |
| *** itlinux has joined #openstack-nova | 14:51 | |
| *** Sundar has quit IRC | 14:53 | |
| *** BjoernT has joined #openstack-nova | 14:56 | |
| *** hongbin has joined #openstack-nova | 14:59 | |
| *** BjoernT has quit IRC | 15:01 | |
| *** takashin has left #openstack-nova | 15:01 | |
| *** BjoernT has joined #openstack-nova | 15:02 | |
| *** cfriesen has joined #openstack-nova | 15:03 | |
| *** jamesdenton has joined #openstack-nova | 15:10 | |
| mriedem | hmm, because of that recent devstack change to add a 2nd shared public network we're always getting this in n-cpu logs during tempest runs now | 15:16 |
| mriedem | http://logs.openstack.org/58/637058/15/check/nova-next/f4e8140/logs/screen-n-cpu.txt.gz?level=TRACE#_Apr_04_00_07_20_968719 | 15:16 |
| mriedem | seems that should not trace, nor be an error really - the user made a bad request essentially but we catch it in compute rather than the api | 15:16 |
| *** yan0s has quit IRC | 15:17 | |
| mriedem | yeah it's just a 400 INFO response in the api http://logs.openstack.org/58/637058/15/check/nova-next/f4e8140/logs/screen-n-api.txt#_Apr_04_00_07_20_975380 | 15:18 |
| *** awaugama has quit IRC | 15:19 | |
| mriedem | huh surprising we even get that far, the request is empty Body: {"interfaceAttachment": {}} | 15:20 |
| *** awaugama has joined #openstack-nova | 15:23 | |
| mriedem | https://bugs.launchpad.net/nova/+bug/1823198 is anyone has opinions | 15:25 |
| openstack | Launchpad bug 1823198 in OpenStack Compute (nova) "NetworkAmbiguous traceback in nova-compute logs even though it's a user error" [Low,Triaged] | 15:25 |
| mriedem | *if | 15:25 |
| *** awaugama has quit IRC | 15:26 | |
| *** awaugama has joined #openstack-nova | 15:26 | |
| *** dklyle has joined #openstack-nova | 15:27 | |
| *** erlon has quit IRC | 15:29 | |
| *** udesale has quit IRC | 15:32 | |
| *** gyee has joined #openstack-nova | 15:43 | |
| *** brinzhang has quit IRC | 15:45 | |
| *** tssurya has quit IRC | 15:52 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Drop pre-cinder 3.44 version compatibility https://review.openstack.org/621061 | 15:53 |
| efried | dansmith: You around to hit https://review.openstack.org/#/c/649775/ ? | 15:53 |
| dansmith | I will, I'm just about to finish my two hours of morning calls | 15:54 |
| efried | cool, thanks. | 15:54 |
| *** efried is now known as efried_mtg | 15:54 | |
| *** Sundar has joined #openstack-nova | 15:54 | |
| *** hongbin has quit IRC | 15:57 | |
| *** hongbin has joined #openstack-nova | 15:58 | |
| *** hongbin has quit IRC | 16:00 | |
| ganso | alex_xu: thanks for the +W! =) | 16:01 |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/stein: Don't warn on network-vif-unplugged event during live migration https://review.openstack.org/650060 | 16:03 |
| *** hongbin has joined #openstack-nova | 16:12 | |
| *** BjoernT has quit IRC | 16:17 | |
| *** awaugama has quit IRC | 16:20 | |
| *** tbachman has quit IRC | 16:22 | |
| *** sapd1_x has quit IRC | 16:24 | |
| openstackgerrit | Lee Yarwood proposed openstack/nova stable/rocky: prevent common kwargs from glance client failure https://review.openstack.org/650064 | 16:25 |
| *** dpawlik has joined #openstack-nova | 16:25 | |
| *** tbachman has joined #openstack-nova | 16:25 | |
| openstackgerrit | Lee Yarwood proposed openstack/nova stable/queens: prevent common kwargs from glance client failure https://review.openstack.org/650065 | 16:25 |
| *** awaugama has joined #openstack-nova | 16:32 | |
| *** awaugama is now known as awaugama_lunch | 16:32 | |
| *** igordc has joined #openstack-nova | 16:33 | |
| *** dpawlik has quit IRC | 16:38 | |
| *** tosky has quit IRC | 16:43 | |
| *** rpittau is now known as rpittau|afk | 16:44 | |
| *** itlinux has quit IRC | 16:45 | |
| *** itlinux has joined #openstack-nova | 16:47 | |
| *** tbachman has quit IRC | 16:51 | |
| *** itlinux has quit IRC | 16:54 | |
| *** itlinux has joined #openstack-nova | 16:55 | |
| *** awaugama_lunch is now known as awaugama | 16:56 | |
| *** ccamacho has quit IRC | 16:58 | |
| *** itlinux has quit IRC | 16:59 | |
| *** tbachman has joined #openstack-nova | 16:59 | |
| *** itlinux has joined #openstack-nova | 17:00 | |
| *** dtantsur is now known as dtantsur|afk | 17:00 | |
| *** davidsha has quit IRC | 17:03 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Handle Invalid exceptions as expected in attach_interface https://review.openstack.org/650077 | 17:12 |
| *** derekh has quit IRC | 17:18 | |
| *** imacdonn has joined #openstack-nova | 17:27 | |
| *** spsurya has joined #openstack-nova | 17:37 | |
| *** gmann is now known as gmann_afk | 17:44 | |
| *** wolverineav has joined #openstack-nova | 17:45 | |
| *** wolverineav has quit IRC | 17:45 | |
| *** wolverineav has joined #openstack-nova | 17:45 | |
| *** ralonsoh has quit IRC | 17:49 | |
| *** munimeha1 has quit IRC | 17:50 | |
| *** BjoernT has joined #openstack-nova | 17:59 | |
| *** wolverineav has quit IRC | 18:01 | |
| *** wolverineav has joined #openstack-nova | 18:02 | |
| *** wolverineav has quit IRC | 18:04 | |
| *** wolverineav has joined #openstack-nova | 18:04 | |
| *** erlon_ has quit IRC | 18:07 | |
| *** derekh has joined #openstack-nova | 18:09 | |
| *** derekh has quit IRC | 18:10 | |
| *** BjoernT_ has joined #openstack-nova | 18:22 | |
| *** BjoernT has quit IRC | 18:24 | |
| *** psachin has quit IRC | 18:28 | |
| openstackgerrit | Adrian Chiris proposed openstack/nova master: Move get_pci_mapping_for_migration to MigrationContext https://review.openstack.org/643023 | 18:32 |
| openstackgerrit | Adrian Chiris proposed openstack/nova master: Allow driver to properly unplug VIFs on destination on confirm resize https://review.openstack.org/643024 | 18:32 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Do not log a warning about not using compute monitors https://review.openstack.org/650092 | 18:33 |
| mriedem | jaypipes: i know you love compute monitors ^ | 18:33 |
| mriedem | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Excluding%20nova.compute.monitors.cpu%20monitor%20virt_driver.%20Not%20in%20the%20list%20of%20enabled%20monitors%20(CONF.compute_monitors).%5C%22%20AND%20tags%3A%5C%22screen-n-cpu.txt%5C%22&from=7d | 18:33 |
| *** owalsh has quit IRC | 18:34 | |
| *** owalsh_ has joined #openstack-nova | 18:34 | |
| *** itlinux has quit IRC | 18:35 | |
| * jaypipes gets out the red pen | 18:38 | |
| *** owalsh_ has quit IRC | 18:39 | |
| *** cdent has quit IRC | 18:40 | |
| *** owalsh has joined #openstack-nova | 18:41 | |
| *** tbachman has quit IRC | 18:44 | |
| *** mdbooth_ has joined #openstack-nova | 18:44 | |
| *** jmlowe has quit IRC | 18:44 | |
| *** mdbooth has quit IRC | 18:47 | |
| *** itlinux has joined #openstack-nova | 18:49 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Handle PortLimitExceeded in POST /servers/{server_id}/os-interface https://review.openstack.org/650097 | 18:49 |
| *** BjoernT has joined #openstack-nova | 18:52 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Handle PortLimitExceeded in POST /servers/{server_id}/os-interface https://review.openstack.org/650097 | 18:52 |
| *** BjoernT_ has quit IRC | 18:53 | |
| *** eharney has quit IRC | 18:55 | |
| *** eharney has joined #openstack-nova | 18:58 | |
| *** jmlowe has joined #openstack-nova | 18:59 | |
| *** wolverineav has quit IRC | 19:02 | |
| *** mmethot has joined #openstack-nova | 19:03 | |
| *** wolverineav has joined #openstack-nova | 19:03 | |
| *** wolverineav has quit IRC | 19:07 | |
| mriedem | melwitt: have you seen this? intermittent unit test failure http://logs.openstack.org/06/641806/7/check/openstack-tox-lower-constraints/1f1fce6/job-output.txt.gz#_2019-04-03_22_36_18_975096 | 19:08 |
| *** tbachman has joined #openstack-nova | 19:08 | |
| *** BjoernT has quit IRC | 19:11 | |
| mriedem | looks like this unit test starts up a conductor service using the ServiceFixture which calls self.addCleanup(self.service.kill) | 19:12 |
| melwitt | no, haven't seen that before. I've seen the error before, I remember helping to fix a bug for that way back when | 19:13 |
| melwitt | this one https://review.openstack.org/555093 | 19:14 |
| melwitt | and in the fail you linked, we're getting it during service.destroy() this time | 19:15 |
| melwitt | which must mean in that flow somewhere we have a reader transaction context nested outside a writer transaction context | 19:15 |
| mriedem | yeah not sure, also doesn't really show up much in logstash | 19:18 |
| mriedem | so i guess i'll recheck and assume it's a fluke | 19:18 |
| melwitt | looking at the code, so far I don't see how the nesting could be happening | 19:18 |
| *** owalsh_ has joined #openstack-nova | 19:25 | |
| *** owalsh has quit IRC | 19:25 | |
| *** itlinux has quit IRC | 19:33 | |
| *** tosky has joined #openstack-nova | 19:33 | |
| mriedem | efried_mtg: these failures http://logs.openstack.org/13/621313/21/check/openstack-tox-py36/ba2c848/testr_results.html.gz definitely started spiking after 4/1 with https://github.com/openstack/nova/commit/e5269f2fbb773953266fccbfd9df3f75e351eeb9 | 19:33 |
| *** BjoernT has joined #openstack-nova | 19:34 | |
| mriedem | i wonder if removing kipsdist = True in tox.ini is contributing | 19:34 |
| mriedem | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22sqlalchemy.exc.InterfaceError%3A%20(pymysql.err.InterfaceError)%20(0%2C%20'')%5C%22%20AND%20tags%3A%5C%22console%5C%22&from=7d | 19:34 |
| mriedem | *skipsdist = True | 19:34 |
| mriedem | and it's always on node provider: limestone-regionone | 19:34 |
| *** awaugama has quit IRC | 19:37 | |
| *** wolverineav has joined #openstack-nova | 19:38 | |
| *** tbachman has quit IRC | 19:38 | |
| *** owalsh has joined #openstack-nova | 19:39 | |
| *** owalsh_ has quit IRC | 19:40 | |
| *** wolverineav has quit IRC | 19:42 | |
| mriedem | tox on the limestone node is 3.8.4 and on an ovh node that passes tox is 3.8.1 | 19:45 |
| mriedem | pymysql is the same between them | 19:45 |
| *** artom has quit IRC | 19:46 | |
| *** efried_mtg is now known as efried | 19:46 | |
| efried | mriedem: What can I do to help? | 19:47 |
| mriedem | hold me | 19:47 |
| mriedem | but not in a tap out kind of way | 19:47 |
| mriedem | i'm reporting a new bug and will push an e-r query | 19:47 |
| efried | should I push a change adding skipdist back and see what happens? | 19:48 |
| mriedem | idk, i wasn't involved in that lower-constraints fix so i don't know if that will screw up the lower-constraints job, but i guess you'd find out | 19:49 |
| *** gmann_afk is now known as gmann | 19:49 | |
| efried | according to the commit message, cdent thought skipdist was "otherwise superfluous" | 19:49 |
| efried | so hopefully that means it at least won't hurt anything. | 19:49 |
| * efried tries... | 19:49 | |
| mriedem | if lower-constraints needs usedevelop=false and skipsdist=false, it could just specify that explicitly | 19:49 |
| efried | yuh | 19:49 |
| mriedem | usedevelop defaults to false also, so i'm not sure why the lower-constraints job is calling it out | 19:50 |
| mriedem | i'm currently being defeated by launchpad timeouts | 19:50 |
| *** BjoernT has quit IRC | 19:52 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: DNM: Re-add skipsdist=True https://review.openstack.org/650123 | 19:53 |
| efried | mriedem: ^ any way to get that to run on the offending node? | 19:53 |
| mriedem | not that i know of | 19:53 |
| mriedem | unless there is a way to specify that in the zuul job definition | 19:54 |
| mriedem | fungi: ^ | 19:54 |
| mriedem | question is can we restrict a change to only run on limestone-regionone nodes | 19:54 |
| *** BjoernT has joined #openstack-nova | 19:55 | |
| mriedem | btw this would explain the unit test job timeouts creeping up again | 19:56 |
| mriedem | b/c when this fails, i think there is some thread switch or something and the fixture just goes away and we timeout | 19:56 |
| logan- | i can provide a project to run it on in limestone-regionone | 19:57 |
| logan- | aside from setting up custom nodepool labels I don't think there is a way to set affinity in the job | 19:58 |
| *** wolverineav has joined #openstack-nova | 19:58 | |
| openstackgerrit | Merged openstack/nova master: Remove CellMappingPayload database_connection and transport_url fields https://review.openstack.org/649775 | 19:59 |
| openstackgerrit | Merged openstack/nova master: Add docs on what not to include in notifications https://review.openstack.org/650020 | 19:59 |
| *** ttsiouts has joined #openstack-nova | 20:01 | |
| *** wolverineav has quit IRC | 20:03 | |
| *** wolverineav has joined #openstack-nova | 20:04 | |
| *** bbowen has quit IRC | 20:04 | |
| fungi | mriedem: efried: logan- is correct. we'd need special node labels or nodesets | 20:04 |
| *** ttsiouts has quit IRC | 20:04 | |
| mriedem | https://bugs.launchpad.net/nova/+bug/1823251 | 20:05 |
| openstack | Launchpad bug 1823251 in OpenStack Compute (nova) "Spike in TestNovaMigrationsMySQL.test_walk_versions/test_innodb_tables failures since April 1 2019" [Medium,Confirmed] | 20:05 |
| mriedem | fungi: logan-: ok i guess we'll just tinker with seeing if adding skipsdist=True back fixes the issue | 20:05 |
| mriedem | and i'll get an e-r query up | 20:05 |
| efried | mriedem: So is https://review.openstack.org/#/c/650043/ not safe to recheck? | 20:06 |
| efried | we're holding RC2 for it, nah? | 20:06 |
| mriedem | efried: melwitt already approved it | 20:06 |
| mriedem | but i just looked at the grenade failure, it's a known gate failure | 20:06 |
| efried | yes but it's sitting failed | 20:06 |
| mriedem | don't need to recheck it if it's approved now | 20:06 |
| efried | right, I'm asking if it's a 100% failure or if we can recheck? | 20:06 |
| melwitt | it's in the zuul check queue | 20:06 |
| efried | oh, okay. | 20:06 |
| mriedem | for this pymysql InterfaceError, it's showing up in more than just nova, | 20:13 |
| mriedem | so did something change in upper-constraints or something more global on 4/1? | 20:13 |
| mriedem | https://github.com/openstack/requirements/commit/27d0b42e23f8d964464862cb5590dea870ae9fd7#diff-0bdd949ed8a7fdd4f95240bd951779c8 merged on 4/1 | 20:14 |
| mriedem | i don't see anything obvious though | 20:15 |
| mriedem | logan-: are you able to tell if anything changed around 4/1 wrt limestone-regionone bionic node packages? | 20:19 |
| mriedem | specifically related to mysql/sqlalchemy/pymysql | 20:20 |
| mriedem | although the latter 2 should be coming from pypi in our CI runs | 20:20 |
| logan- | the region came back online after a p->q->r upgrade on 3/27, nothing has changed since then though. | 20:20 |
| *** BjoernT has quit IRC | 20:20 | |
| logan- | since we have been chatting, I just found a config issue that is being resolved: https://review.openstack.org/#/c/650135/ | 20:21 |
| *** tesseract has quit IRC | 20:21 | |
| mriedem | heh what a coincidence https://review.openstack.org/#/c/641981/ | 20:22 |
| *** tbachman has joined #openstack-nova | 20:22 | |
| *** artom has joined #openstack-nova | 20:23 | |
| logan- | hah | 20:23 |
| *** pcaruana has quit IRC | 20:29 | |
| *** pcaruana has joined #openstack-nova | 20:30 | |
| *** dpawlik has joined #openstack-nova | 20:31 | |
| *** hongbin has quit IRC | 20:34 | |
| *** dpawlik has quit IRC | 20:35 | |
| *** itlinux has joined #openstack-nova | 20:37 | |
| *** itlinux has quit IRC | 20:38 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: DNM: Re-add skipsdist=True, except for lower-constraints https://review.openstack.org/650123 | 20:39 |
| *** itlinux has joined #openstack-nova | 20:39 | |
| efried | kashyap, aspiers: FYI, I did not seed the review-day etherpad with the specs you mentioned, because it sounded like they weren't quite ready for that yet. | 20:40 |
| *** ttsiouts has joined #openstack-nova | 20:42 | |
| openstackgerrit | Michael Still proposed openstack/nova master: Hacking N362: Don't abbrev/alias privsep import https://review.openstack.org/649190 | 20:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Improve test coverage of nova.privsep.path. https://review.openstack.org/648601 | 20:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Improve test coverage of nova.privsep.fs. https://review.openstack.org/648602 | 20:44 |
| openstackgerrit | Michael Still proposed openstack/nova master: Improve test coverage of nova.privsep.fs, continued. https://review.openstack.org/648603 | 20:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: Add test coverage for nova.privsep.libvirt. https://review.openstack.org/648616 | 20:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: Add test coverage for nova.privsep.qemu. https://review.openstack.org/649191 | 20:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: Privsepify ipv4 forwarding enablement. https://review.openstack.org/635431 | 20:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: Remove unused FP device creation and deletion methods. https://review.openstack.org/635433 | 20:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: Privsep the ebtables modification code. https://review.openstack.org/635435 | 20:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move adding vlans to interfaces to privsep. https://review.openstack.org/635436 | 20:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move iptables rule fetching and setting to privsep. https://review.openstack.org/636508 | 20:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move dnsmasq restarts to privsep. https://review.openstack.org/639280 | 20:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move router advertisement daemon restarts to privsep. https://review.openstack.org/639281 | 20:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move calls to ovs-vsctl to privsep. https://review.openstack.org/639282 | 20:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move setting of device trust to privsep. https://review.openstack.org/639283 | 20:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move final bridge commands to privsep. https://review.openstack.org/639580 | 20:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: Cleanup the _execute shim in nova/network. https://review.openstack.org/639581 | 20:45 |
| openstackgerrit | Michael Still proposed openstack/nova master: We no longer need rootwrap. https://review.openstack.org/554438 | 20:45 |
| efried | mdbooth_: anything on this morning's weird db race topic? | 20:45 |
| efried | o, it's like midnight for you. | 20:45 |
| *** wolverineav has quit IRC | 20:46 | |
| *** wolverineav has joined #openstack-nova | 20:47 | |
| *** ttsiouts has quit IRC | 20:47 | |
| *** hongbin has joined #openstack-nova | 20:48 | |
| *** wolverineav has quit IRC | 20:51 | |
| *** wolverineav has joined #openstack-nova | 20:51 | |
| *** spsurya has quit IRC | 20:54 | |
| *** BjoernT has joined #openstack-nova | 20:55 | |
| *** slaweq has quit IRC | 20:58 | |
| *** cdent has joined #openstack-nova | 20:58 | |
| *** amodi has quit IRC | 20:59 | |
| *** wolverineav has quit IRC | 21:03 | |
| *** dpawlik has joined #openstack-nova | 21:04 | |
| *** wolverineav has joined #openstack-nova | 21:05 | |
| efried | mriedem: I'm dyin here. Can't figure out how to get logstash to return these. Here are representative examples: | 21:09 |
| efried | http://logs.openstack.org/57/649757/1/check/openstack-tox-py37/a965c6b/testr_results.html.gz | 21:09 |
| efried | http://logs.openstack.org/92/627892/21/check/openstack-tox-py37/66b8eab/testr_results.html.gz | 21:09 |
| efried | http://logs.openstack.org/13/621313/21/check/openstack-tox-py36/ba2c848/testr_results.html.gz | 21:09 |
| efried | http://logs.openstack.org/53/639453/9/check/openstack-tox-py36/2b6b01f/testr_results.html.gz | 21:09 |
| efried | http://logs.openstack.org/66/649566/1/check/openstack-tox-py37/e989684/testr_results.html.gz | 21:09 |
| efried | http://logs.openstack.org/01/648601/5/check/openstack-tox-py36/0e12826/testr_results.html.gz | 21:09 |
| mriedem | think i already got it https://review.openstack.org/650136 | 21:11 |
| efried | sigh | 21:12 |
| *** ttsiouts has joined #openstack-nova | 21:12 | |
| efried | I was trying to include other parts of the "message". How do you do that? Whenever I use AND it comes back with nothing. | 21:12 |
| efried | fixtures._fixtures.timeout.TimeoutException seems relevant. Because I would have thought that InterfaceException could be caused by any number of things. | 21:13 |
| efried | InterfaceError, rather | 21:13 |
| mriedem | console log entries are indexed as single lines | 21:15 |
| mriedem | so you unfortunately can't do an AND on messages from different lines | 21:15 |
| mriedem | the only multi-line indexing we have is tracebacks in screen logs | 21:15 |
| mriedem | e.g. nova-compute | 21:15 |
| mriedem | which is frustrating with tests that fail like this https://bugs.launchpad.net/nova/+bug/1823215 | 21:16 |
| openstack | Launchpad bug 1823215 in OpenStack Compute (nova) "TestInstanceNotificationSampleWithMultipleComputeOldAttachFlow._test_live_migration_force_complete intermittent fails with MismatchError: 6 != 7" [Medium,Confirmed] | 21:16 |
| mriedem | means we have to do a better job of logging at the point of failure | 21:16 |
| mriedem | melwitt: dansmith: i was going to write up something in our contributor testing reference docs about testing with a down cell in devstack, my notes are here http://paste.openstack.org/show/748904/ - do you see anything in there that i could be missing which might be interesting/useful? | 21:19 |
| mriedem | somewhere linked from here https://docs.openstack.org/nova/latest/contributor/#testing | 21:19 |
| cdent | did any of mdbooth's eventlet clean ups merge? | 21:21 |
| mriedem | cdent: https://review.openstack.org/#/q/topic:bug/1808975+(status:open+OR+status:merged) | 21:22 |
| cdent | because it seems like what the pymysql interface errors are showing is that something has disrupted some delicate timing and a bit of unitidiness in the opportunistic tests is not getting the leeway desired | 21:22 |
| cdent | hmmm, that's further back than would make sense for this | 21:22 |
| mriedem | cdent: i definitely suspect eventlet weirdness with http://status.openstack.org/elastic-recheck/#1793364 | 21:22 |
| mriedem | cdent: but yeah that | 21:22 |
| mriedem | timing doesn't line up with the failures | 21:22 |
| mriedem | i do think we hit some thread switch and then the test just times out | 21:23 |
| mriedem | older notes are in https://bugs.launchpad.net/nova/+bug/1793364 | 21:23 |
| openstack | Launchpad bug 1793364 in Manila "mysql db opportunistic unit tests timing out intermittently in the gate (bad thread switch?)" [Undecided,In progress] - Assigned to Goutham Pacha Ravi (gouthamr) | 21:23 |
| efried | mriedem: https://review.openstack.org/#/c/650043/ is failing in grenade again. Ima rebase it so we don't have to wait for the rest to finish, if you can re+W it? | 21:25 |
| mriedem | sure | 21:25 |
| *** slaweq has joined #openstack-nova | 21:25 | |
| openstackgerrit | Eric Fried proposed openstack/nova stable/stein: Remove CellMappingPayload database_connection and transport_url fields https://review.openstack.org/650043 | 21:25 |
| efried | mriedem: needed trivial edit ^ since no newer master commit to rebase onto | 21:26 |
| melwitt | mriedem: looks comprehensive to me, I can't think of anything missing other than linking to the docs about what down cell means and such when you propose the patch | 21:26 |
| mriedem | melwitt: yup lots of links to be made | 21:26 |
| mriedem | thanks for looking | 21:26 |
| cdent | if it turns out to be sdist we should decode why. in at least some of our tests runs when sdist is true we'll install requirements as discovered by python setup.py sdist and then install requirements _again_ so there's a possibility that pip is changing it's mind about some things when upper constraints is more involved. hard to say, especially at my late hour | 21:26 |
| melwitt | mriedem: yeah, looks good. good stuff to have in the docs | 21:27 |
| mriedem | efried: you could have chosen something besides the cherry-picked line :) | 21:27 |
| mriedem | well i guess not, whatever | 21:27 |
| efried | mriedem: Yeah, then it would have differed from its cherry-pick-ees. | 21:28 |
| mriedem | efried: maybe should ask fungi to promote that? | 21:28 |
| *** ttsiouts has quit IRC | 21:28 | |
| dansmith | mriedem: why the upgrade levels thing? | 21:28 |
| *** ttsiouts has joined #openstack-nova | 21:28 | |
| mriedem | dansmith: because of https://bugs.launchpad.net/nova/+bug/1815697 | 21:28 |
| openstack | Launchpad bug 1815697 in OpenStack Compute (nova) "[upgrade_levels]compute=auto grinds the API response times when a cell is down" [Medium,Confirmed] | 21:28 |
| mriedem | "Also note the default database max_attempts and retry_interval are 10 which means for each API object created that hits this, it's going to take 100 seconds to timeout per route handler per API worker. I count 31 route handlers that create an API object, so that's by default 3100 seconds or about ~52 minutes per worker on startup." | 21:29 |
| dansmith | oh because auto doesn't support the timeouts? | 21:29 |
| melwitt | mriedem, efried: reminder we're also waiting on https://review.openstack.org/649630 it's #1 in the gate but if it fails... | 21:29 |
| dansmith | I think I remember that now | 21:29 |
| efried | fungi: TLDR https://review.openstack.org/#/c/650043/ represents a security regression we're holding nova-stein-rc2 for | 21:29 |
| mriedem | dansmith: not really about the timeouts, it's just we hit that query on each API controller startup x number of API workers | 21:29 |
| efried | melwitt: ack, succeeding so far. | 21:29 |
| efried | though it hasn't finished the freakin grenade-lm job yet | 21:30 |
| mriedem | heh we could have rebased https://review.openstack.org/#/c/650043/ on top of https://review.openstack.org/649630 | 21:30 |
| melwitt | yeah. wanted to point that out in case of gate promotions, we have two that are in flight | 21:30 |
| *** slaweq has quit IRC | 21:30 | |
| mriedem | dansmith: https://review.openstack.org/#/c/649197/ was an attempt at something semi-related | 21:32 |
| dansmith | mriedem: oh, is this because we actually start them in threads early enough (because wsgi) that we haven't populated the cache yet? | 21:33 |
| *** ttsiouts has quit IRC | 21:33 | |
| mriedem | well, in my devstack recreate, cell1 is down and cell1 is the only thing that has compute services, | 21:33 |
| mriedem | so we get 0 back for the min compute service version which does not get cached | 21:33 |
| mriedem | https://review.openstack.org/#/c/649197/1/nova/compute/rpcapi.py@424 | 21:34 |
| dansmith | oh okay I meant the perf thing, but that's probably legit too | 21:34 |
| mriedem | also related https://bugs.launchpad.net/nova/+bug/1815692 | 21:34 |
| openstack | Launchpad bug 1815692 in OpenStack Compute (nova) "minimum nova-compute service version is not cached in nova-api when running under wsgi" [Low,Triaged] | 21:34 |
| dansmith | ah | 21:35 |
| mriedem | that would not affect the other bug on startup though because we don't call that method which uses the cache https://github.com/openstack/nova/blob/0bed18ffbb46c4f2d0ec87e64a39188c165398eb/nova/objects/service.py#L507 | 21:36 |
| mriedem | but as i recall objects.Service.enable_min_version_cache() is meant for perf gains in the api lookups | 21:36 |
| mriedem | after startup | 21:36 |
| dansmith | I think your singleton patch looks okay | 21:36 |
| dansmith | so, | 21:37 |
| mriedem | i haven't looked into the functional test failures | 21:37 |
| dansmith | with the sighup thing not working, | 21:37 |
| dansmith | you might not want to fix the caching thing :P | 21:37 |
| dansmith | that might be why it hasn't been as much of a thing.. potentially.. if people aren't sighupping but still getting the pin recalculated | 21:37 |
| dansmith | although the perf impact is probably worse than just having to bump all your services fully | 21:37 |
| mriedem | the sighup for nova-compute is particularly busted b/c of the privsep usage and neutron event callback handler stuff, | 21:38 |
| dansmith | what a tangled mess of shit | 21:38 |
| dansmith | right, but it's also going to cause anything else to do a full restart | 21:38 |
| mriedem | but i wasn't sure if hup'ing the controller services was still ok because we have the cells cache for connections and disabled cells and all that | 21:38 |
| dansmith | not as impactful for apis I guess | 21:38 |
| dansmith | but for conductor it's probably not great either | 21:39 |
| mriedem | ok so i think you're saying huping the controller services will do what you want - reload caches, but not in the graceful way we intended | 21:39 |
| dansmith | I dunno about conductor, probably not great there, | 21:39 |
| mriedem | b/c it's a restart | 21:39 |
| mriedem | scheduler has the hup for the disabled cells i think | 21:39 |
| dansmith | as I think anything currently waiting on an rpc call, or polling for state or whatever will die | 21:39 |
| mriedem | and cells cache in the request context | 21:39 |
| mriedem | tangled mess of shit yes | 21:40 |
| dansmith | for serious | 21:40 |
| mriedem | who's being depressing NOW! | 21:40 |
| dansmith | o/ | 21:40 |
| mriedem | maybe my depression rubs off on those that speak with me | 21:40 |
| dansmith | and it's thursday, closer to friday | 21:40 |
| mriedem | efried: melwitt: how are you feeling right now? | 21:40 |
| dansmith | you're also the arsehole that is finding this stuff | 21:41 |
| dansmith | we could just ignore it if it wasn't for you | 21:41 |
| melwitt | yeah, seriously | 21:43 |
| melwitt | :) | 21:43 |
| mriedem | it is also cold and rainy here right now (well most of this week) | 21:44 |
| mriedem | so it's just a gloom | 21:44 |
| *** BjoernT has quit IRC | 21:45 | |
| fungi | efried: cool, yeah i was advancing/monitoring the master branch version of 650043 earlier so that one could be approved sooner, can also shuffle that one up now that it's been approved (sorry for the delay, was just out for an afternoon walk) | 21:46 |
| *** awalende has joined #openstack-nova | 21:46 | |
| efried | thanks fungi | 21:46 |
| *** slaweq has joined #openstack-nova | 21:47 | |
| *** awalende has quit IRC | 21:50 | |
| *** slaweq has quit IRC | 21:51 | |
| *** pcaruana has quit IRC | 21:51 | |
| *** slaweq has joined #openstack-nova | 21:52 | |
| *** dpawlik has quit IRC | 21:53 | |
| *** slaweq has quit IRC | 21:57 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Log notifications if assertion in _test_live_migration_force_complete fails https://review.openstack.org/650155 | 21:59 |
| *** bnemec has quit IRC | 22:01 | |
| *** dpawlik has joined #openstack-nova | 22:05 | |
| *** dpawlik has quit IRC | 22:09 | |
| *** hongbin has quit IRC | 22:09 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Re-propose cross-cell-resize spec for Train https://review.openstack.org/642807 | 22:19 |
| *** rcernin has joined #openstack-nova | 22:23 | |
| *** cdent has quit IRC | 22:26 | |
| melwitt | efried, fungi: 650043,2 just failed lower-constraints :( for what looks to be https://bugs.launchpad.net/nova/+bug/1793364 | 22:28 |
| openstack | Launchpad bug 1793364 in Manila "mysql db opportunistic unit tests timing out intermittently in the gate (bad thread switch?)" [Undecided,In progress] - Assigned to Goutham Pacha Ravi (gouthamr) | 22:28 |
| fungi | melwitt: thanks for the heads up, i've manually reset the gate so it will restart jobs on that change now | 22:30 |
| melwitt | thanks! | 22:31 |
| *** whoami-rajat has quit IRC | 22:32 | |
| *** igordc has quit IRC | 22:34 | |
| *** wolverineav has quit IRC | 22:35 | |
| *** mrhillsman_bbiab is now known as mrhillsman | 22:40 | |
| *** ttsiouts has joined #openstack-nova | 22:50 | |
| *** slaweq has joined #openstack-nova | 22:54 | |
| *** wolverineav has joined #openstack-nova | 22:56 | |
| *** luksky has quit IRC | 22:57 | |
| efried | melwitt, mriedem: fungi: I gotta run. You got this? | 22:58 |
| *** slaweq has quit IRC | 22:58 | |
| *** tkajinam has joined #openstack-nova | 22:59 | |
| melwitt | efried: yeah, I'll watch the patches tonight | 22:59 |
| efried | Thanks melwitt | 22:59 |
| fungi | i'll be around as well | 23:00 |
| fungi | feel free to ping me for anything | 23:00 |
| fungi | eager to see this resolved so it doesn't become a bigger issue after release | 23:00 |
| melwitt | ok, thank you | 23:01 |
| mriedem | no VMT bias there :) | 23:01 |
| fungi | (since that usually means more work for all of us, and we already have more than enough of that to go around) | 23:01 |
| fungi | ;) | 23:01 |
| fungi | yeah, juggling plenty of security issues which have cropped up in releases we can't go back in time to fix, so it's nice when we catch one *before* releasing | 23:02 |
| *** keekz has joined #openstack-nova | 23:14 | |
| *** dklyle has quit IRC | 23:19 | |
| *** ttsiouts has quit IRC | 23:23 | |
| *** wolverineav has quit IRC | 23:27 | |
| *** itlinux has quit IRC | 23:31 | |
| *** wolverineav has joined #openstack-nova | 23:31 | |
| *** wolverineav has quit IRC | 23:31 | |
| *** wolverineav has joined #openstack-nova | 23:32 | |
| *** igordc has joined #openstack-nova | 23:39 | |
| *** Sundar has quit IRC | 23:39 | |
| *** eharney has quit IRC | 23:40 | |
| *** tosky has quit IRC | 23:43 | |
| *** slaweq has joined #openstack-nova | 23:54 | |
| *** tjgresha has joined #openstack-nova | 23:56 | |
| *** gyee has quit IRC | 23:58 | |
| *** slaweq has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!