| *** gyee has quit IRC | 00:42 | |
| *** imacdonn has quit IRC | 00:49 | |
| openstackgerrit | Brin Zhang proposed openstack/python-novaclient master: Add support changes-before for microversion 2.66 https://review.openstack.org/603549 | 00:57 |
|---|---|---|
| *** hongbin_ has joined #openstack-nova | 01:00 | |
| *** jogo has quit IRC | 01:00 | |
| *** yankcrime has quit IRC | 01:00 | |
| *** ebbex has quit IRC | 01:00 | |
| *** vabada has quit IRC | 01:00 | |
| *** tobias-urdin has quit IRC | 01:00 | |
| openstackgerrit | Tetsuro Nakamura proposed openstack/nova-specs master: Spec: allocation candidates in tree https://review.openstack.org/603585 | 01:07 |
| *** tetsuro has joined #openstack-nova | 01:07 | |
| *** mriedem_away has quit IRC | 01:08 | |
| *** imacdonn has joined #openstack-nova | 01:09 | |
| *** slaweq has joined #openstack-nova | 01:11 | |
| openstackgerrit | Tao Li proposed openstack/python-novaclient master: Remove the unused instance-name https://review.openstack.org/602520 | 01:12 |
| *** imacdonn has quit IRC | 01:14 | |
| *** imacdonn has joined #openstack-nova | 01:15 | |
| *** slaweq has quit IRC | 01:16 | |
| *** mhen has quit IRC | 01:18 | |
| *** mhen has joined #openstack-nova | 01:21 | |
| *** mrsoul has joined #openstack-nova | 01:25 | |
| *** Kevin_Zheng has joined #openstack-nova | 01:34 | |
| lbragstad | gmann sounds good | 01:35 |
| *** erlon has joined #openstack-nova | 01:35 | |
| *** _pewp_ has quit IRC | 01:46 | |
| *** _pewp_ has joined #openstack-nova | 01:47 | |
| *** _hemna has quit IRC | 01:47 | |
| *** _hemna has joined #openstack-nova | 01:49 | |
| *** erlon has quit IRC | 01:52 | |
| *** Dinesh_Bhor has joined #openstack-nova | 02:04 | |
| *** hoonetorg has quit IRC | 02:04 | |
| *** cfriesen has quit IRC | 02:09 | |
| *** jiteka has quit IRC | 02:11 | |
| *** eandersson has quit IRC | 02:11 | |
| *** jiteka has joined #openstack-nova | 02:11 | |
| *** tbachman has quit IRC | 02:12 | |
| *** tbachman has joined #openstack-nova | 02:15 | |
| *** jiteka has quit IRC | 02:15 | |
| *** hoonetorg has joined #openstack-nova | 02:17 | |
| *** jiteka has joined #openstack-nova | 02:18 | |
| *** eandersson has joined #openstack-nova | 02:24 | |
| *** eandersson has quit IRC | 02:31 | |
| openstackgerrit | Sundar Nadathur proposed openstack/nova-specs master: Nova Cyborg interaction specification. https://review.openstack.org/603955 | 02:33 |
| *** jiteka has quit IRC | 02:41 | |
| openstackgerrit | Brin Zhang proposed openstack/python-novaclient master: Add support changes-before for microversion 2.66 https://review.openstack.org/603549 | 02:50 |
| *** jiteka has joined #openstack-nova | 02:52 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (3) https://review.openstack.org/574104 | 02:57 |
| *** jiteka has quit IRC | 03:01 | |
| *** hongbin_ has quit IRC | 03:02 | |
| *** slaweq has joined #openstack-nova | 03:11 | |
| *** Dinesh_Bhor has quit IRC | 03:11 | |
| *** Dinesh_Bhor has joined #openstack-nova | 03:12 | |
| openstackgerrit | fupingxie proposed openstack/python-novaclient master: Do not translate log messages. https://review.openstack.org/603962 | 03:12 |
| *** slaweq has quit IRC | 03:16 | |
| *** sapd1_ has quit IRC | 03:45 | |
| *** sapd1 has joined #openstack-nova | 03:45 | |
| *** Dinesh_Bhor has quit IRC | 03:50 | |
| *** udesale has joined #openstack-nova | 03:53 | |
| *** tetsuro has quit IRC | 04:06 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova-specs master: Spec for API inconsistency cleanup https://review.openstack.org/603969 | 04:16 |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova-specs master: Spec for API inconsistency cleanup https://review.openstack.org/603969 | 04:28 |
| *** med_ has joined #openstack-nova | 04:29 | |
| *** eandersson has joined #openstack-nova | 04:34 | |
| *** cfriesen has joined #openstack-nova | 04:41 | |
| *** Dinesh_Bhor has joined #openstack-nova | 04:46 | |
| gmann | lyarwood: i replied on this - https://review.openstack.org/#/c/602018/ | 04:47 |
| gmann | lyarwood: stable branch patches needs to get in before openstack-infra/openstack-zuul-jobs one | 04:47 |
| *** med_ has quit IRC | 04:51 | |
| *** med_ has joined #openstack-nova | 04:52 | |
| *** ShilpaSD has joined #openstack-nova | 04:52 | |
| *** janki has joined #openstack-nova | 05:02 | |
| *** jaosorior has quit IRC | 05:03 | |
| *** ratailor has joined #openstack-nova | 05:18 | |
| *** brinzhang has joined #openstack-nova | 05:36 | |
| *** med_ has quit IRC | 05:38 | |
| *** alexchadin has joined #openstack-nova | 05:39 | |
| *** Luzi has joined #openstack-nova | 05:44 | |
| *** Dinesh_Bhor has quit IRC | 06:08 | |
| *** alexchadin has quit IRC | 06:08 | |
| *** holser_ has joined #openstack-nova | 06:09 | |
| *** Dinesh_Bhor has joined #openstack-nova | 06:15 | |
| *** tetsuro has joined #openstack-nova | 06:19 | |
| *** jaosorior has joined #openstack-nova | 06:25 | |
| openstackgerrit | huanhongda proposed openstack/nova stable/ocata: Cleanup RP and HM records while deleting a compute service. https://review.openstack.org/603749 | 06:28 |
| openstackgerrit | fupingxie proposed openstack/nova master: Avoid Forcing the Translation of Translatable Variables https://review.openstack.org/603993 | 06:29 |
| *** dpawlik_ has joined #openstack-nova | 06:38 | |
| *** Dinesh_Bhor has quit IRC | 06:38 | |
| *** belmoreira has joined #openstack-nova | 06:39 | |
| *** dpawlik has quit IRC | 06:39 | |
| *** Dinesh_Bhor has joined #openstack-nova | 06:42 | |
| *** dpawlik_ has quit IRC | 06:45 | |
| *** dpawlik has joined #openstack-nova | 06:45 | |
| *** slaweq has joined #openstack-nova | 06:47 | |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Only update cells' transport_url and database_connection when needed. https://review.openstack.org/603998 | 06:47 |
| *** ralonsoh has joined #openstack-nova | 06:50 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/os-vif master: Add support for Windows network commands https://review.openstack.org/487405 | 06:53 |
| *** skatsaounis has joined #openstack-nova | 07:02 | |
| *** rcernin has quit IRC | 07:02 | |
| *** sahid has joined #openstack-nova | 07:08 | |
| openstackgerrit | Brin Zhang proposed openstack/python-novaclient master: Add support changes-before for microversion 2.66 https://review.openstack.org/603549 | 07:38 |
| *** Dinesh_Bhor has quit IRC | 07:39 | |
| bauzas | good morning | 07:44 |
| sean-k-mooney | good morning :) | 07:45 |
| gibi | good morning folks | 07:46 |
| *** jpena|off is now known as jpena | 07:47 | |
| *** Dinesh_Bhor has joined #openstack-nova | 07:49 | |
| *** cfriesen has quit IRC | 07:49 | |
| *** helenafm has joined #openstack-nova | 07:51 | |
| *** Dinesh_Bhor has quit IRC | 07:54 | |
| *** Dinesh_Bhor has joined #openstack-nova | 08:01 | |
| *** hoangcx has quit IRC | 08:04 | |
| *** hoangcx has joined #openstack-nova | 08:04 | |
| *** ebbex has joined #openstack-nova | 08:06 | |
| *** jaosorior has quit IRC | 08:12 | |
| *** janki has quit IRC | 08:13 | |
| *** yankcrime has joined #openstack-nova | 08:17 | |
| *** janki has joined #openstack-nova | 08:20 | |
| openstackgerrit | Merged openstack/nova master: libvirt: Drop MIN_LIBVIRT_VHOSTUSER_MQ https://review.openstack.org/565472 | 08:26 |
| *** bhagyashris has joined #openstack-nova | 08:27 | |
| *** jchhatbar has joined #openstack-nova | 08:27 | |
| *** janki has quit IRC | 08:28 | |
| *** jchhatba_ has joined #openstack-nova | 08:29 | |
| *** jchhatbar has quit IRC | 08:32 | |
| *** jiteka_ has joined #openstack-nova | 08:46 | |
| kashyap | Hey folks, I wonder if anyone here knows Linux systems where only /dev/random exists | 08:49 |
| kashyap | And not /dev/urandom. | 08:49 |
| kashyap | Because I'm considering to add a default 'virtio-rng' device for Nova guests, whic uses /dev/urandom. | 08:50 |
| kashyap | https://bugs.launchpad.net/nova/+bug/1789868 | 08:50 |
| openstack | Launchpad bug 1789868 in OpenStack Compute (nova) "RFE: Add a virtio-rng device to Nova instances by default" [Medium,Triaged] - Assigned to Kashyap Chamarthy (kashyapc) | 08:50 |
| *** jiteka_ has quit IRC | 08:50 | |
| kashyap | (If anyone is wondering why '/dev/urandom'? It is non-blocking, and doesn't have the same limitations of `/dev/random`, which is a legacy interface. | 08:52 |
| *** wznoinsk_ is now known as wznoinsk | 08:52 | |
| *** jaosorior has joined #openstack-nova | 08:58 | |
| *** Bhujay has joined #openstack-nova | 09:00 | |
| *** frankwang has joined #openstack-nova | 09:01 | |
| *** Dinesh_Bhor has quit IRC | 09:01 | |
| openstackgerrit | huanhongda proposed openstack/nova stable/ocata: Cleanup the caches when deleting a resource provider https://review.openstack.org/604021 | 09:02 |
| kashyap | stephenfin: The last clean up (IIRC) in that series: https://review.openstack.org/#/c/562313/ (libvirt: Drop MIN_LIBVIRT_PARALLELS_SET_ADMIN_PASSWD) | 09:13 |
| *** Tahvok has left #openstack-nova | 09:19 | |
| *** Dinesh_Bhor has joined #openstack-nova | 09:19 | |
| *** tetsuro has quit IRC | 09:28 | |
| *** helenafm has quit IRC | 09:30 | |
| stephenfin | kashyap: cool, I'll take a look now | 09:30 |
| *** jchhatba_ has quit IRC | 09:31 | |
| *** janki has joined #openstack-nova | 09:31 | |
| kashyap | stephenfin: Thanks; it's not urgent. Just a boring thing to tick off, when you have time | 09:34 |
| *** tobias-urdin has joined #openstack-nova | 09:35 | |
| *** derekh has joined #openstack-nova | 09:37 | |
| *** belmoreira has quit IRC | 09:38 | |
| *** moshele has joined #openstack-nova | 09:38 | |
| *** bhagyashris has quit IRC | 09:40 | |
| *** dtantsur|afk is now known as dtantsur | 09:43 | |
| *** janki has quit IRC | 09:45 | |
| *** janki has joined #openstack-nova | 09:51 | |
| openstackgerrit | Yikun Jiang proposed openstack/nova master: WIP: Add nova database migration script(psql version) https://review.openstack.org/604026 | 09:51 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: libvirt: Drop MIN_LIBVIRT_PF_WITH_NO_VFS_CAP_VERSION https://review.openstack.org/565517 | 09:51 |
| *** kevko_home has joined #openstack-nova | 09:52 | |
| kevko_home | Hello guys , can i have simple question on you :) ? | 09:52 |
| *** jaosorior has quit IRC | 09:53 | |
| *** jlvillal has quit IRC | 09:54 | |
| *** jlvillal has joined #openstack-nova | 09:54 | |
| openstackgerrit | Yikun Jiang proposed openstack/nova master: WIP: Add nova database migration script(psql version) https://review.openstack.org/604026 | 09:57 |
| *** jchhatbar has joined #openstack-nova | 10:00 | |
| *** janki has quit IRC | 10:03 | |
| *** helenafm has joined #openstack-nova | 10:04 | |
| *** pcaruana has joined #openstack-nova | 10:04 | |
| kashyap | kevko_home: Just ask, someone might respond. | 10:06 |
| *** Dinesh_Bhor has quit IRC | 10:13 | |
| *** takashin has quit IRC | 10:13 | |
| *** Dinesh_Bhor has joined #openstack-nova | 10:15 | |
| *** Dinesh_Bhor has quit IRC | 10:16 | |
| openstackgerrit | Brin Zhang proposed openstack/python-novaclient master: Add support changes-before for microversion 2.66 https://review.openstack.org/603549 | 10:24 |
| *** alexchadin has joined #openstack-nova | 10:27 | |
| *** alexchadin has quit IRC | 10:28 | |
| *** alexchadin has joined #openstack-nova | 10:28 | |
| *** alexchadin has quit IRC | 10:33 | |
| *** tbachman has quit IRC | 10:42 | |
| *** takashin has joined #openstack-nova | 10:43 | |
| openstackgerrit | John Garbutt proposed openstack/nova-specs master: WIP: Spec for API policy updates https://review.openstack.org/547850 | 10:47 |
| *** jlvillal has quit IRC | 10:50 | |
| gibi | bauzas, tetsuro: I managed to re-use the existing ServerMovingTests functional test set to verify the nested allocations during move operations. I found that force livemigrate and every evacuate case are faulty. | 10:51 |
| gibi | bauzas, tetsuro: I will push the patch soon | 10:51 |
| gibi | bauzas, tetsuro: I mean the fault reproduction patch, then I will look at how to solve the problem | 10:52 |
| *** jlvillal has joined #openstack-nova | 10:53 | |
| *** jchhatbar is now known as janki | 10:56 | |
| *** belmoreira has joined #openstack-nova | 10:57 | |
| *** jpena is now known as jpena|lunch | 10:57 | |
| *** jaosorior has joined #openstack-nova | 10:58 | |
| openstackgerrit | huanhongda proposed openstack/nova stable/ocata: Cleanup RP and HM records while deleting a compute service. https://review.openstack.org/603749 | 10:58 |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova-specs master: Spec for API inconsistency cleanup https://review.openstack.org/603969 | 10:58 |
| *** udesale has quit IRC | 10:58 | |
| *** tetsuro has joined #openstack-nova | 10:59 | |
| *** s10 has joined #openstack-nova | 11:06 | |
| *** erlon has joined #openstack-nova | 11:07 | |
| openstackgerrit | Vlad Gusev proposed openstack/nova stable/pike: libvirt: Reduce calls to qemu-img during update_available_resource https://review.openstack.org/604039 | 11:07 |
| *** pcaruana has quit IRC | 11:15 | |
| *** ratailor has quit IRC | 11:16 | |
| *** pcaruana has joined #openstack-nova | 11:20 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Add API ref guideline for examples https://review.openstack.org/604060 | 11:22 |
| *** alexchadin has joined #openstack-nova | 11:28 | |
| *** pcaruana has quit IRC | 11:32 | |
| *** alexchadin has quit IRC | 11:33 | |
| *** pcaruana has joined #openstack-nova | 11:39 | |
| *** tssurya has joined #openstack-nova | 11:39 | |
| kevko_home | Guys, i am packaging nova for debian. Current situation is that i have several packages , nova-common , nova-api, nova-placement-api, nova-conductor ...etc | 11:48 |
| kevko_home | Each of package is doing his work, for example nova-common creating database users, etc, and also populating nova db. I have also nova-placement-api and nova-api which are doing same stuff with populating db, nova-placement-api creating database placement , users, grants ..etc ..fill connection in config and run nova-manage api_db sync , same in nova-api create db nova , users , grants, run nova-manage api_db sync. | 11:48 |
| kevko_home | Problem is that i have error when api_database connection is missing in nova-placement-api package, does it mean that nova-placement-api needs both nova_api and placement connection settings filled ? Shouldn't be command separate for nova_api and placement ... something like nova-manage api_db sync , nova-mange api_placement sync ? | 11:48 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Fix missing specifying doctrees directory https://review.openstack.org/604068 | 11:49 |
| *** pcaruana has quit IRC | 11:50 | |
| bauzas | gibi: hola, what's the fault ? | 11:55 |
| tssurya | kevko_home: which release are you using ? | 11:58 |
| kevko_home | tssurya: rocky | 11:58 |
| tssurya | I think in Rocky for a new set-up its something like nova_api DB is the default placement-DB | 11:59 |
| kevko_home | tssurya: does it mean that placement database not needed ? | 12:00 |
| tssurya | https://docs.openstack.org/nova/rocky/configuration/config.html#placement_database.connection | 12:00 |
| tssurya | refer to ^ , | 12:01 |
| kevko_home | tssurya: i don't think you understand me :) | 12:01 |
| *** priteau has joined #openstack-nova | 12:04 | |
| tssurya | there is no seperate DB sync commands as of yet, but probably cdent can help you more | 12:04 |
| kevko_home | tssurya: i have several deb packages , nova-common - create nova db, db user, db grants, set api_database.connection in nova.conf ( questions are answered in debconf ), run nova-manage db sync , nova-api do the same thing with one difference , run nova-manage api_db sync with fill api_database.connection to right value , nova-placement-api same thing with difference that set placement_database.connection value .... everything is | 12:05 |
| kevko_home | work as expected ....but in nova-placement api postinst i have this : http://paste.openstack.org/show/730413/ | 12:05 |
| kevko_home | tssurya: so basically , i think nova-manage api_db sync should be splitted to two separate commands for fill api_db and placement_api | 12:06 |
| kevko_home | tssurya: because nova-placement-api and nova-api can run standalone ...why there is sync command which is trying fill both databases if i let's say configuring nova-placement-api only on some server ? | 12:07 |
| *** alexchadin has joined #openstack-nova | 12:08 | |
| kevko_home | tssurya: or add if clauses on CONF.placement_database.connection is not None: else: LOG.warning(''Nova-manage will not run , you have to configure api_database.connection') | 12:08 |
| kevko_home | tssurya: i can send a code to review ..but wanted to discuss this with you guys in nova channel ... | 12:09 |
| kevko_home | tssurya: because if i know , placement will be totally moved into separate project ...but don't know when .. | 12:10 |
| tssurya | its in the transition phase | 12:10 |
| kevko_home | tssurya: and what do you think about my above thinkings ? :/ | 12:11 |
| tssurya | looking more into the code.. | 12:12 |
| tssurya | kevko_home: okay so you basically want the user to be warned if placement_database.connection is not set ? | 12:14 |
| tssurya | and nova_api.databaseconnection is also not set ? | 12:14 |
| kevko_home | tssurya: yes, something like that ..let me send you diff ..w8 a minute | 12:15 |
| tssurya | well I guess the Rocky documentation deployment (https://docs.openstack.org/nova/rocky/user/placement.html#deployment) states api_db sync command is used for both syncing and if you set placement_db conn it will be used and if you don't set that, it is expected that you set the api_db conn. | 12:16 |
| tssurya | I understand your concern though, and the need for a check seems ok to me, | 12:17 |
| kevko_home | tssurya: something like this http://paste.openstack.org/show/730414/ | 12:19 |
| kevko_home | tssurya: ok, i will send a review then | 12:19 |
| gibi | bauzas: sorry I was out grabbing food. The fault is that nova does not consider allocations agains the child RPs during the move | 12:22 |
| tssurya | kevko_home: ack | 12:22 |
| *** tbachman has joined #openstack-nova | 12:24 | |
| *** tbachman has quit IRC | 12:30 | |
| Kevin_Zheng | tssurya Hi | 12:33 |
| Kevin_Zheng | does this bothers CERN? | 12:33 |
| Kevin_Zheng | https://launchpad.net/bugs/1793423 | 12:33 |
| openstack | Launchpad bug 1793423 in OpenStack Compute (nova) "Should not read config options while update cells" [Undecided,In progress] - Assigned to Zhenyu Zheng (zhengzhenyu) | 12:33 |
| Kevin_Zheng | or it is made this way | 12:33 |
| *** aloga has quit IRC | 12:35 | |
| *** aloga has joined #openstack-nova | 12:36 | |
| tssurya | Kevin_Zheng: we don't use the update_cell command command very often, but what you have reported has always bugged me :) | 12:36 |
| Kevin_Zheng | Ha | 12:36 |
| tssurya | meaning the update_cell command is used for a lot of other stuff than just updating the DB connection and transport_url | 12:36 |
| tssurya | so it is not fair that these two always have to be passed to ensure they don't get over written by the config options | 12:37 |
| *** tbachman has joined #openstack-nova | 12:38 | |
| tssurya | Kevin_Zheng: although I don't understand your point 2: where you say you can't use nova_ | 12:39 |
| tssurya | nova_cell1.conf | 12:39 |
| tssurya | because you need api_database connection, | 12:40 |
| tssurya | for update_cell ? | 12:40 |
| Kevin_Zheng | sorry disconnected | 12:40 |
| tssurya | np, did you get the messages ^ ? | 12:41 |
| Kevin_Zheng | yeah, I saw them | 12:41 |
| Kevin_Zheng | reading | 12:41 |
| Kevin_Zheng | yeas | 12:41 |
| Kevin_Zheng | yeah | 12:41 |
| Kevin_Zheng | we have to update the records in api_db | 12:42 |
| tssurya | ah okay | 12:42 |
| tssurya | yea sorry, got confused | 12:42 |
| tssurya | but now that you mention "up_calls" we have the same problem for nova-manage db archive_deleted_rows | 12:43 |
| Kevin_Zheng | hmm | 12:43 |
| *** Bhujay has quit IRC | 12:43 | |
| *** Bhujay has joined #openstack-nova | 12:44 | |
| *** Bhujay has quit IRC | 12:45 | |
| *** Bhujay has joined #openstack-nova | 12:45 | |
| *** alexchadin has quit IRC | 12:48 | |
| *** alexchadin has joined #openstack-nova | 12:48 | |
| *** janki has quit IRC | 12:50 | |
| *** med_ has joined #openstack-nova | 12:51 | |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Only update cells' transport_url and database_connection when needed. https://review.openstack.org/603998 | 12:52 |
| openstackgerrit | huanhongda proposed openstack/nova master: Fix instance delete stuck in deleting task_state https://review.openstack.org/598084 | 12:52 |
| *** alexchadin has quit IRC | 13:01 | |
| openstackgerrit | Vlad Gusev proposed openstack/nova stable/pike: libvirt: Reduce calls to qemu-img during update_available_resource https://review.openstack.org/604039 | 13:04 |
| *** mriedem has joined #openstack-nova | 13:06 | |
| *** cdent has joined #openstack-nova | 13:15 | |
| mnaser | there isn't a way to delete a compute node from the db, is there? | 13:16 |
| bauzas | mnaser: by SQL goos ? | 13:16 |
| mnaser | well, without sql | 13:16 |
| bauzas | ah | 13:17 |
| mnaser | nova service-delete deletes the service but the compute node record is still there | 13:17 |
| mnaser | and scheduler complains constantly about 'No compute service record found for host <foo>' | 13:17 |
| bauzas | that's a good point | 13:17 |
| bauzas | compute_node records are automatically populated by the resource tracker | 13:17 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Use provider tree in virt FakeDriver https://review.openstack.org/604083 | 13:17 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Run ServerMovingTests with nested resources https://review.openstack.org/604084 | 13:17 |
| gibi | bauzas, tetsuro ^^ | 13:18 |
| mnaser | maybe that error should check if there is an existing service, or something | 13:18 |
| bauzas | mnaser: I thought we were checking this in the RT code | 13:18 |
| mnaser | but this is on the nova-scheduler code, i think RT code sits in nova-compute ? | 13:18 |
| bauzas | gibi: all cool, been frankly diverted by working on the reshape patch | 13:18 |
| bauzas | (and by meetings) | 13:18 |
| bauzas | mnaser: yup, run by nova-compute service | 13:19 |
| bauzas | I'm just saying we populate the entries there | 13:19 |
| mnaser | yeah but in this case it's taking a hypervisor out of service forever | 13:19 |
| mnaser | so turn it off, nova service-delete <foo> and that error doesnt go ahway | 13:19 |
| mnaser | s/ahway/away/ | 13:19 |
| lbragstad | johnthetubaguy gmann nice work on https://review.openstack.org/#/c/547850/ | 13:20 |
| bauzas | yup, I see the problem | 13:20 |
| mnaser | https://github.com/openstack/nova/blob/master/nova/scheduler/host_manager.py#L716-L720 | 13:20 |
| mnaser | maybe we should clean up there (or delete compute record when a nova-compute binary is deleted) | 13:20 |
| bauzas | mnaser: here is where we create the entry in the DB https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L587 | 13:21 |
| bauzas | mnaser: we had a FK before | 13:21 |
| bauzas | between service and CN | 13:21 |
| mnaser | but i guess with the os-services api addition and making it managable by api | 13:21 |
| mnaser | that might have disappeared | 13:21 |
| mnaser | or some other historic reason you might know more than me :) | 13:21 |
| mnaser | oh you know what | 13:22 |
| mnaser | FK might not do anything anyways, because we just change deleted field | 13:22 |
| mnaser | so for all that sql cares, FK is still satisified | 13:22 |
| bauzas | well, actually that's a good point | 13:23 |
| bauzas | we shadow the services table | 13:23 |
| bauzas | so a CASCADE DELETE isn't like super important | 13:23 |
| bauzas | BBIAB | 13:24 |
| mnaser | filed a bug: https://bugs.launchpad.net/nova/+bug/1793533 -- i can take care of pushing the code to fix it if i can get some guidance on the best approach | 13:26 |
| openstack | Launchpad bug 1793533 in OpenStack Compute (nova) "Deleting a service with nova-compute binary doesn't remove compute node" [Undecided,New] | 13:26 |
| *** udesale has joined #openstack-nova | 13:27 | |
| *** jpena|lunch is now known as jpena | 13:29 | |
| mriedem | mnaser: deleting the compute service should also delete the compute node record in the db | 13:31 |
| mnaser | o | 13:31 |
| mriedem | mnaser: the problem is you need to also have nova-compute for that host stopped | 13:31 |
| mriedem | otherwise the RT will re-create the compute node record | 13:31 |
| mriedem | https://developer.openstack.org/api-ref/compute/#delete-compute-service | 13:31 |
| *** jistr is now known as jistr|call | 13:32 | |
| mnaser | i'm pretty sure it was stopped when i did this (actually, the hypervisor was rebooted with a new hostname so i just deleted the old one) | 13:32 |
| mnaser | let me see the created_at time for the compute node record if there is one | 13:32 |
| mriedem | https://github.com/openstack/nova/blob/d87852ae6a1987b6faa3cb5851f9758b47ef4636/nova/db/sqlalchemy/api.py#L404 | 13:34 |
| mriedem | ^ is the DB API deleting the service and compute node record when you delete the service via DELETE /os-services/{service_id} | 13:34 |
| *** frankwang has quit IRC | 13:34 | |
| mnaser | mriedem: created_at for compute node record is '2018-04-13 00:21:53', created_at for service (that was deleted) is '2018-04-13 00:21:53' | 13:34 |
| mnaser | oo | 13:35 |
| mriedem | do the host values align? | 13:35 |
| mnaser | deleted=16 on compute node | 13:35 |
| mnaser | so it was soft deleted | 13:36 |
| mnaser | yes, they do, it was actually soft deleted | 13:36 |
| mnaser | could it be that loop doesn't grab non-soft deleted compute nodes? | 13:37 |
| mnaser | that would be the only logical thing happening | 13:37 |
| mnaser | OR | 13:37 |
| mriedem | by default that query is only going to look up non-soft-deleted cmpute node records that match the query | 13:37 |
| mnaser | it looks like it uses _get_computes_for_cells ? | 13:37 |
| mnaser | so maybe it is looking in nova_api compute node lists? | 13:38 |
| mriedem | which loop are you talking about? | 13:38 |
| mnaser | mriedem: https://github.com/openstack/nova/blob/master/nova/scheduler/host_manager.py#L713 | 13:38 |
| mnaser | whatever comes in here is including a deleted item | 13:38 |
| mnaser | i just confirmed it by adding LOG.debug(computes) | 13:38 |
| mnaser | and i see the deleted one that it complains about | 13:39 |
| mriedem | is there a resource provider in placement for the deleted compute node still? | 13:39 |
| mriedem | openstack resource provider show <compute node uuid> | 13:39 |
| mnaser | yes | 13:40 |
| mriedem | hmm, you're on rocky right? is nova-api configured to talk to placement? | 13:40 |
| mnaser | this is a queens deployment | 13:40 |
| mnaser | nova-api talking to placement | 13:40 |
| mriedem | ok, well we backported a fix for that to queens also, | 13:40 |
| mnaser | and also, shouldn't we need to delete it from nova_api mappings? maybe thats where its getting it from? | 13:40 |
| mriedem | but only if nova-api is configured to talk to placement, | 13:41 |
| mriedem | then the api will also delete the RP record in placement when the compute node is deleted | 13:41 |
| mriedem | host mappings? | 13:41 |
| mriedem | that's also part of that fix | 13:41 |
| tssurya | HMs are also deleted | 13:41 |
| mriedem | lemme dig it up | 13:41 |
| mnaser | nova_api host_mappings still contains that compute node | 13:41 |
| mnaser | now this is early queens so that could very well be the cause, be good to see if i have that fix or not | 13:42 |
| tssurya | https://review.openstack.org/#/c/563698/ | 13:42 |
| mnaser | aaaa | 13:42 |
| mriedem | yup that's the one | 13:42 |
| *** liuyulong has joined #openstack-nova | 13:42 | |
| mnaser | let me double check that doesnt exist | 13:42 |
| mnaser | nope | 13:43 |
| mnaser | that's probably it | 13:43 |
| mnaser | ill mark my bug as duplicate of that one | 13:43 |
| mriedem | yeah so the RP is still in placement, and it gave it back to the scheduler, and the scheduler somehow looked it up | 13:44 |
| mriedem | i'm curious as to why the scheduler is looking up deleted compute nodes though | 13:44 |
| mnaser | yeah, that doesn't seem right i guess | 13:44 |
| dansmith | um, guys, obvi | 13:44 |
| dansmith | it's scheduling a deleted instances | 13:45 |
| mnaser | objects.ComputeNodeList.get_all(cctxt) | 13:45 |
| mriedem | i see the bug | 13:45 |
| mriedem | 1756179 | 13:45 |
| mriedem | oops | 13:45 |
| mriedem | def _db_compute_node_get_all_by_uuids(context, compute_uuids): | 13:45 |
| mriedem | db_computes = context.session.query(models.ComputeNode).filter( | 13:45 |
| mriedem | models.ComputeNode.uuid.in_(compute_uuids)).all() | 13:45 |
| mriedem | return db_computes | 13:45 |
| *** alexchadin has joined #openstack-nova | 13:46 | |
| *** brinzhang has quit IRC | 13:46 | |
| mriedem | isn't using model_query so it's not filtering out soft deleted records | 13:46 |
| tssurya | yikes | 13:46 |
| mnaser | do i want to mark my bug as duplicate and create another one for that ^ or use the same one to cover that | 13:47 |
| dansmith | hmm, I wonder why we did that | 13:47 |
| dansmith | instead of writing it in sqla/api.py | 13:47 |
| mriedem | because the new jazz is to write db stuff in the objects | 13:47 |
| mriedem | mnaser: we'll use yours for the query thing | 13:48 |
| mriedem | i'll un-invalidate it | 13:48 |
| dansmith | mriedem: only for api objects | 13:48 |
| mriedem | oh, then idk | 13:48 |
| dansmith | or at least, I've been still putting main stuff in there | 13:48 |
| dansmith | IIRC we agreed to not put api stuff int here, but keep doing it for the main stuff, but | 13:49 |
| mriedem | you'd have to ask papa bear https://review.openstack.org/#/c/418134/ | 13:49 |
| * dansmith scrolls up lookin for what the bug is | 13:49 | |
| mriedem | dansmith: https://bugs.launchpad.net/nova/+bug/1793533 | 13:50 |
| openstack | Launchpad bug 1793533 in OpenStack Compute (nova) "Scheduler doesn't filter out deleted compute node records based on placement RP UUIDs" [Medium,Triaged] | 13:50 |
| bauzas | I'm back | 13:50 |
| bauzas | PapaOurs is here | 13:50 |
| mriedem | dansmith: so you got this one? | 13:50 |
| bauzas | any regression I made, mmm ? | 13:50 |
| *** mdbooth_ has joined #openstack-nova | 13:50 | |
| *** mdbooth_ is now known as mdbooth | 13:50 | |
| tssurya | Q: placement should not even return deleted RPs right ? the list of compute_uuids coming from placement should be legit ? or its okay because the post-scheduler compute filter is supposed to check for these conditions like it doesn for enabled/disabled ? | 13:50 |
| *** mschuppert has joined #openstack-nova | 13:51 | |
| dansmith | mriedem: but the real problem is not in placement but that we keep finding the compute node in our search yeah? | 13:51 |
| bauzas | tssurya: we have a filter for this | 13:51 |
| mriedem | tssurya: mnaser didn't have https://review.openstack.org/#/c/563698/ | 13:51 |
| mriedem | tssurya: so yes this is a side effect that shouldn't otherwise happen | 13:51 |
| bauzas | we have the ComputeFilter | 13:51 |
| tssurya | (I understand that beore this fix, the RPs were not deleted so it they are returned, but in current situation it should be okay right ?) | 13:51 |
| dansmith | mriedem: I got this one what? you want me to fix it up? | 13:51 |
| tssurya | bauzas: yea that filter | 13:51 |
| mriedem | dansmith: i assumed you were asking for the bug in order to push a change | 13:52 |
| mnaser | if we get a fix it'd be nice to get a dot release for nova, last queens release was end of may | 13:52 |
| dansmith | no, I was just curious what the symptom was.. but I can fix it up, sure | 13:52 |
| jroll | TIL papa bear is not a name for comstud | 13:52 |
| dansmith | mnaser: ++ | 13:52 |
| bauzas | so I think we agreed maybe in Portland that the Placement API wouldn't check whether the node is active or not | 13:52 |
| mriedem | mnaser: we know - i've been watching rocky/queens/pike/ocata approved changes sit in the gate for 3 days | 13:52 |
| mnaser | :( | 13:52 |
| cdent | bauzas: correct | 13:53 |
| mriedem | http://lists.openstack.org/pipermail/openstack-dev/2018-September/134867.html | 13:53 |
| mnaser | rough times out here | 13:53 |
| tssurya | ack | 13:53 |
| bauzas | jroll: https://scontent-cdt1-1.xx.fbcdn.net/v/t1.15752-9/41984667_323237498424760_7346301711654322176_n.jpg?_nc_cat=0&oh=a19da45f6d7b7b799d8f831e7f3c4a05&oe=5C1954CF | 13:53 |
| mriedem | bauzas: tssurya: cdent: dansmith: mnaser: in true form, we're all talking past each other | 13:53 |
| mriedem | does someone want me to summarize the issue here? | 13:53 |
| jroll | bauzas: add a guitar and you can come work on ironic :) | 13:53 |
| dansmith | seems clear, | 13:54 |
| cdent | mriedem: I think i was following along okay, was just trying to pause bauzas | 13:54 |
| tssurya | I have understood this to be something needed as a regression fix for the code before this patch | 13:54 |
| gibi | nova meeting stars in 6 minutes on #openstack-meeting | 13:54 |
| tssurya | so its clear to me too | 13:54 |
| bauzas | wait wait | 13:54 |
| mriedem | so bauzas is the odd man out | 13:54 |
| dansmith | we are not filtering the list of placement results against compute nodes that exist | 13:54 |
| mnaser | yes, we're getting *all* including deleted ones | 13:54 |
| bauzas | can someone explains me what's the problem ? | 13:54 |
| tssurya | yep yep | 13:54 |
| dansmith | bauzas: wait for my bug fix | 13:54 |
| mriedem | dansmith: yes, but we were only given those uuids for deleted records because mnaser doesn't have https://review.openstack.org/#/c/563698/ | 13:54 |
| dansmith | it'll be clear then | 13:54 |
| bauzas | see my BBIAB 30 mins before :) | 13:54 |
| bauzas | dansmith: ok cool | 13:54 |
| dansmith | mriedem: right | 13:54 |
| mriedem | which would have deleted the RP in placement when the compute service was deleted | 13:55 |
| * bauzas goes to use a coffee machine | 13:55 | |
| mriedem | it's just a simple side effect | 13:55 |
| mnaser | bauzas: if a compute service is deleted (but still somehow in placement and has host_mappings, something which a bug has fixed not long ago), then nova ComputeNodeList.get_all_by_uuids returns that, it shouldn't | 13:55 |
| dansmith | mriedem: yeah, but we could need to delete a compute node when placement is down or something, so definitely should fix this issue | 13:55 |
| bauzas | jroll: meh, I do have a guitar as well at home... | 13:55 |
| jroll | ++ | 13:56 |
| mnaser | bauzas: and the reason was because get_all_by_uuids() doesn't use model_query so it doesn't filter against soft deleted stuff | 13:56 |
| mnaser | that's what i got out of it and it makes sense enough for me :p | 13:56 |
| *** awaugama has joined #openstack-nova | 13:56 | |
| mriedem | dansmith: sure i agree | 13:56 |
| bauzas | mnaser: we don't have services in placement, just compute nodes, but okay I understand you :) | 13:56 |
| mnaser | i'm trying here | 13:56 |
| mnaser | haha | 13:56 |
| * mriedem moves to the meeting channel | 13:56 | |
| bauzas | 3 mins dude | 13:57 |
| bauzas | too early | 13:57 |
| mnaser | one last thing: is someone pushing up a patch for this or is it on me? | 13:57 |
| mriedem | dan is | 13:57 |
| mnaser | (i dont mind) | 13:57 |
| mnaser | ok cool | 13:57 |
| bauzas | i think dansmith said | 13:57 |
| mnaser | thanks dansmith | 13:57 |
| bauzas | yeah that | 13:57 |
| mriedem | *head explodes* | 13:57 |
| bauzas | just throw me tomatoes now if I regressed :) | 13:57 |
| dansmith | bauzas: you did regress | 13:57 |
| dansmith | but I will fix | 13:58 |
| efried | stephenfin: Can you please see if I used the correct arguments here? https://review.openstack.org/#/c/603993/ | 13:58 |
| bauzas | dansmith: you're the hero and I'm the villain then ;) | 13:58 |
| dansmith | per usual | 13:58 |
| bauzas | I can snip fingers, don't tempt me | 13:58 |
| bauzas | snap* | 13:59 |
| *** litao has quit IRC | 14:00 | |
| *** jaypipes is now known as jaypipes-ooo | 14:03 | |
| *** mdbooth has quit IRC | 14:06 | |
| *** mdbooth has joined #openstack-nova | 14:07 | |
| *** dpawlik has quit IRC | 14:11 | |
| *** mlavalle has joined #openstack-nova | 14:11 | |
| *** moshele has quit IRC | 14:11 | |
| *** claudiub has joined #openstack-nova | 14:21 | |
| *** alexchadin has quit IRC | 14:21 | |
| *** alexchadin has joined #openstack-nova | 14:25 | |
| *** jistr|call is now known as jistr | 14:34 | |
| openstackgerrit | Dan Smith proposed openstack/nova master: Filter deleted computes from get_all_by_uuids() https://review.openstack.org/604108 | 14:37 |
| *** Luzi has quit IRC | 14:37 | |
| *** dpawlik has joined #openstack-nova | 14:41 | |
| mriedem | mdbooth: did you see the evacuate integration tests are passing? | 14:45 |
| *** dpawlik has quit IRC | 14:45 | |
| mdbooth | mriedem: I didn't, but I will as soon as poss :) | 14:45 |
| mriedem | not much to see - we evacuate with the down compute so it fails, and then bring libvirtd back up and evacuate and it passes | 14:46 |
| mriedem | only question is if it should be horked into the live migration job which is convenient but sorta confusing | 14:46 |
| mdbooth | mriedem: Ideally we'd have it in a few places: would be good to cover both shared and non-shared. | 14:47 |
| mdbooth | Perfectly we'd cover 'all 4' cases, but I don't think we have all 4 in CI. | 14:47 |
| mriedem | all 4 is what again? volume-backed, local disk not shared, local disk shared | 14:48 |
| mriedem | what's the other? | 14:48 |
| mdbooth | 2 axes are: shared instance, shared disk. | 14:48 |
| mriedem | right now the patch is running on ceph local shared | 14:48 |
| mriedem | the script could be updated to create a volume-backed server and evacuate again | 14:49 |
| mnaser | is there a reason why running debug=True doesn't show the http requests done by placement client? | 14:49 |
| *** ratailor has joined #openstack-nova | 14:49 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: WIP: libvirt: Turn off max_unit https://review.openstack.org/604110 | 14:49 |
| mnaser | rather than reconstructing the http request, it'd be nice to know what nova-scheduler is asking placement | 14:50 |
| mriedem | we call placement over ksa, | 14:50 |
| mriedem | so our debug=True logging is likely not carrying over to ksa | 14:50 |
| mnaser | because before debug=True would show you the filters running through things | 14:51 |
| mnaser | and you'd be able to debug scheduler issues | 14:51 |
| mriedem | you just want to see like the GET /allocation_candidates request right? | 14:51 |
| mnaser | now it just starts filtering a subset and you don't know where that came from so yeah | 14:51 |
| *** Bhujay has quit IRC | 14:51 | |
| mnaser | stuff like that, yes, so that i know why this live migration is not getting scheduled on one of the hosts | 14:51 |
| mnaser | there's empty capacity but it's not adding it | 14:52 |
| mnaser | probably something along the lines of placement being inconsistent | 14:52 |
| * mnaser should really write a tool that audits placement / nova | 14:52 | |
| mriedem | are you passing the specific target host for the live migration to the compute API? | 14:52 |
| mriedem | because i know of another bug related to that... | 14:53 |
| mnaser | nope im not passing one | 14:53 |
| mriedem | ok, you just expect a certain host to be picked b/c of weights and capacity etc? | 14:53 |
| mnaser | yeah, it's not even hitting weight/capacity, placement is not returning a host that has capacity | 14:53 |
| mriedem | i think we'd have to add something like this https://github.com/openstack/nova/blob/master/nova/config.py#L39 | 14:54 |
| efried | Does the placement log not show the full command line? | 14:54 |
| *** cfriesen has joined #openstack-nova | 14:54 | |
| mnaser | which tells me there's probably incorrect allocations in placement that make that host look 'overloaded' | 14:54 |
| mnaser | ah that's a good alternative, checking uwsgi logs on placement side | 14:54 |
| mriedem | there should be the same request id on both sides | 14:54 |
| mriedem | that's your workaround for now | 14:54 |
| efried | The placement logs by default won't show the payloads (request or response) but the queryparams are there I thought. | 14:54 |
| mriedem | yes they should be | 14:55 |
| mnaser | i should be able to rerun that http request | 14:55 |
| mriedem | http://logs.openstack.org/75/470775/38/check/tempest-full/a97793a/controller/logs/screen-placement-api.txt.gz#_Sep_06_13_02_32_181234 | 14:55 |
| efried | sorry, "command line" was a bogus phrase | 14:55 |
| mriedem | Sep 06 13:02:32.181234 ubuntu-xenial-ovh-bhs1-0001824138 devstack@placement-api.service[6991]: DEBUG nova.api.openstack.placement.requestlog [req-68f9280e-61b2-446e-8622-a64e27e7c617 req-df696f1f-3435-4b6c-8a3b-c6dc1c58c1ba service placement] Starting request: 158.69.79.172 "GET /placement/allocation_candidates?limit=1000&resources=MEMORY_MB%3A64%2CVCPU%3A1" {{(pid=6993) __call__ /opt/stack/nova/nova/api/openstack/placement/r | 14:55 |
| mriedem | stlog.py:38}} | 14:55 |
| mriedem | must be a bfv instance ^ because there is no DISK_GB requested | 14:55 |
| mnaser | yup /allocation_candidates?limit=1000&resources=DISK_GB%3A10%2CMEMORY_MB%3A2048%2CVCPU%3A4 | 14:56 |
| mnaser | lets see | 14:56 |
| *** Swami has joined #openstack-nova | 14:57 | |
| mnaser | openstack allocation candidate list --resource DISK_GB=10 --resource MEMORY_MB=2048 --resource VCPU=4 => Operation or argument is not supported with version 1.0 | 14:58 |
| mnaser | mriedem: do i need some special env variable? | 14:58 |
| mnaser | sigh | 14:58 |
| mnaser | --os-placement-api-version 1.10 | 14:58 |
| mnaser | ill read docs from now on | 14:58 |
| gibi | FYI, I've added the bp use-nested-allocation-candidates to the 3rd runway slot | 14:59 |
| gibi | First part of https://blueprints.launchpad.net/nova/+spec/use-nested-allocation-candidates (gibi) [END: 2018-10-04] | 14:59 |
| cdent | i guess I need to learn osc-placement so I can parse this stuff. I'm still back on raw curl which is nice and comfy and explicit | 15:00 |
| mnaser | yeah it's returning one host (the host itself) which gets filtered out in a live migration, i think i'll have to write up the clean up / audit stuff | 15:00 |
| *** mdbooth has quit IRC | 15:00 | |
| mnaser | cdent: it's nice to not have to write it all out esp to grab a token and then build out a curl request | 15:00 |
| *** mdbooth has joined #openstack-nova | 15:00 | |
| mriedem | mnaser: yeah osc is opt-in per request for microversions, unlike nova cli | 15:01 |
| mriedem | you could just set an env var if you want the latest, | 15:01 |
| mriedem | export OS_PLACEMENT_API_VERSION=<whatever you have that is the latest> | 15:01 |
| *** takashin has left #openstack-nova | 15:02 | |
| cdent | mnaser: yeah, totally agree that if you haven't built the curl-based habits the osc way is good. It's just that since I've been curl-ing against placement for such a long time I've got habits (including the token getting and using parts) that are rather built in. I'm complaining about myself here, not other people. | 15:03 |
| mnaser | cdent: yeah i have a lot of terrible old habits | 15:03 |
| mnaser | cdent: like using LOG.debug() instead of an actual debugger | 15:03 |
| cdent | dood! LOG.debug() is too fancy. sys.stderr.write() 4evah | 15:03 |
| mnaser | System.out.println() | 15:04 |
| mnaser | at least we're not in that darkest timeline | 15:04 |
| *** alexchadin has quit IRC | 15:04 | |
| *** dklyle has joined #openstack-nova | 15:04 | |
| *** etp has joined #openstack-nova | 15:06 | |
| tobias-urdin | when live migrating is the vcpu_pin_set option a 1:1 mapping for source and dest host? I start at the same lowest possible core but some machines have different amount of vcpus available, if I migrate an instances that has vcpu 79 but source host only has 60 vcpu will it reallocate where to place that or error out? | 15:06 |
| mnaser | i think that's a libvirt decision | 15:07 |
| tobias-urdin | you are probably correct, will trace some more | 15:08 |
| openstackgerrit | Brin Zhang proposed openstack/python-novaclient master: Add support changes-before for microversion 2.66 https://review.openstack.org/603549 | 15:08 |
| mriedem | i didn't think live migration + cpu pinning was supported yet? | 15:09 |
| mriedem | cfriesen: ^? | 15:09 |
| *** helenafm has quit IRC | 15:10 | |
| cfriesen | mriedem: tobias-urdin: live migration doesn't currently recalculate CPUs on the dest node. This is one of the things covered under the "numa-aware live migration" blueprint. | 15:12 |
| tobias-urdin | cfriesen: roger that, thanks :) | 15:12 |
| cfriesen | tobias-urdin: the live migration *might* succeed, but it might end up putting multiple guest CPUs on the same host CPU, or it might fail due to different host topology. | 15:13 |
| tobias-urdin | ok, that explains why it worked atleast thanks | 15:14 |
| zzzeek | jaypipes-ooo: think fast! what's your favorite innodb_flush_method setting ! don't think! | 15:14 |
| *** jiaopengju has quit IRC | 15:15 | |
| *** jiaopengju has joined #openstack-nova | 15:15 | |
| jaypipes-ooo | zzzeek: direct? | 15:16 |
| zzzeek | jaypipes-ooo: OK | 15:16 |
| zzzeek | jaypipes-ooo: we're adding the option to tripleo | 15:17 |
| jaypipes-ooo | zzzeek: but only if there is a battery-backed write cache on the disks. | 15:17 |
| jaypipes-ooo | zzzeek: otherwise, keep it normal. | 15:17 |
| openstackgerrit | Merged openstack/nova stable/rocky: Fix nova-status "_check_resource_providers" check https://review.openstack.org/600098 | 15:18 |
| openstackgerrit | Brin Zhang proposed openstack/python-novaclient master: Add support changes-before for microversion 2.66 https://review.openstack.org/603549 | 15:19 |
| zzzeek | jaypipes-ooo: OK is that impacting the durability of the logs only? usually b.c. we use galera, we assume write sets have also gone to other nodes | 15:20 |
| zzzeek | jaypipes-ooo: so w/ these kinds of options, we have to worry about all galera nodes power off simultaneously, but if only one machine, then not | 15:20 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Run negative server moving tests with nested RPs https://review.openstack.org/604125 | 15:20 |
| zzzeek | jaypipes-ooo: we certainly arent changing this setting by default | 15:20 |
| zzzeek | jaypipes-ooo: Im just trying to create my own importance by curating what option we expose :) | 15:21 |
| jaypipes-ooo | zzzeek: :) just leave it defaulted to normal then. It's mostly micro-tuning for write-heavy environments anyway. | 15:21 |
| jaypipes-ooo | zzzeek: which openstack's DBs definitely are *not*. | 15:21 |
| zzzeek | jaypipes-ooo: yes. I just need to have an intelligent answer for why someone would want to set this | 15:22 |
| zzzeek | jaypipes-ooo: it's usually folks with old OSP and struggling w/ huge keystone token table | 15:22 |
| jaypipes-ooo | zzzeek: ack. there's a solution to that, though... TRUNCATE TABLE tokens; :P | 15:22 |
| zzzeek | jaypipes-ooo: agree | 15:22 |
| *** s10 has quit IRC | 15:23 | |
| jaypipes-ooo | zzzeek: yeah, overall I'd advise not mucking with many of the innodb config settings other than innodb_buffer_pool_size. | 15:23 |
| openstackgerrit | Brin Zhang proposed openstack/python-novaclient master: Add support changes-before for microversion 2.66 https://review.openstack.org/603549 | 15:23 |
| zzzeek | jaypipes-ooo: it's an argument im slwoly losing due to the occasional angry customer | 15:24 |
| zzzeek | with a mysql DBA | 15:24 |
| zzzeek | jaypipes-ooo: which of course only matters to me if I have to be on the phone w/ them on friday night b.c. they lost their DB | 15:24 |
| jaypipes-ooo | zzzeek: really no need considering nova, ironic, etc's database schemas are so poor anyway (lots of "blobject" storage and bloated not-really-relational-relations schema that those settings won't IMHO make much of a diff. | 15:24 |
| zzzeek | jaypipes-ooo: agree | 15:24 |
| *** dave-mccowan has quit IRC | 15:25 | |
| *** dave-mccowan has joined #openstack-nova | 15:31 | |
| openstackgerrit | Merged openstack/nova master: libvirt: Use 'virt' as the default machine type for ARMv7 https://review.openstack.org/602592 | 15:39 |
| openstackgerrit | Merged openstack/nova master: Fix evacuate logging https://review.openstack.org/593055 | 15:40 |
| openstackgerrit | Merged openstack/nova stable/queens: Fix soft deleting vm fails after "nova resize" vm https://review.openstack.org/603340 | 15:40 |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/queens: Add tempest-slow job to run the tempest slow tests https://review.openstack.org/604134 | 15:50 |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: Return a minimal construct for nova show when a cell is down https://review.openstack.org/591658 | 15:51 |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: Return a minimal construct for nova service-list when a cell is down https://review.openstack.org/584829 | 15:51 |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Add tempest-slow job to run the tempest slow tests https://review.openstack.org/604138 | 15:56 |
| mnaser | woo | 15:58 |
| mnaser | i got a script going and it helped figure out the issue too | 15:58 |
| *** gyee has joined #openstack-nova | 15:58 | |
| mnaser | it's really not cleaned up but does the job, here's a placement 'audit' script: http://paste.openstack.org/show/730450/ | 15:59 |
| mriedem | cool, throw that into "nova-manage placement audit" or something | 16:01 |
| mriedem | should be able to use nova.scheduler.client.report.SchedulerReportClient for the HTTP calls | 16:02 |
| mnaser | yeah, and probably can use nova objects to avoid http calls? | 16:02 |
| mriedem | yeah maybe | 16:02 |
| mnaser | oh boi | 16:03 |
| mnaser | i think i'd say its a bug if a field is missing in nova api if it's empty/blank? | 16:03 |
| mriedem | depends | 16:04 |
| mriedem | which field | 16:04 |
| mnaser | with_servers=True | 16:04 |
| mnaser | the servers: [] field is omitted if no servers are there | 16:04 |
| mnaser | so rather than servers: []. its just not there | 16:04 |
| mriedem | welcome to the compute api | 16:04 |
| mnaser | i.e.: {u'status': u'disabled', u'state': u'down', u'id': u'13b1a4b6-d242-44c5-828e-e6f0a94284da', u'hypervisor_hostname': u'foobar'} | 16:04 |
| mriedem | i believe that's how https://developer.openstack.org/api-ref/compute/#list-hypervisor-servers worked | 16:05 |
| mnaser | https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/hypervisors.py#L90-L92 | 16:05 |
| mnaser | if servers with servers = [] evaluates to false? | 16:06 |
| mriedem | yes | 16:06 |
| mnaser | i mean that could have been omitted but i dunno if thats an api bug or something we're expecting | 16:06 |
| mriedem | that's just how that's always worked, | 16:07 |
| mriedem | and this is probably not the only instance of it | 16:07 |
| mriedem | where a field is omitted in the response if it doesn't have any value | 16:07 |
| * mnaser adds .get('servers', []) and move son | 16:07 | |
| mriedem | in this case it was just an oversight when i rewrote os-hypervisors in 2.53 | 16:07 |
| mriedem | b/c it's using the same view builder code | 16:07 |
| mnaser | its nice that it gave compute node uuids | 16:08 |
| mnaser | it made this a lot easier | 16:08 |
| mriedem | yup, that's part of why we had to do 2.53 | 16:08 |
| mriedem | https://docs.openstack.org/nova/latest/reference/api-microversion-history.html#maximum-in-pike | 16:08 |
| mriedem | it wasn't a fun microversion to write let me tell you | 16:08 |
| mriedem | gmann does have a spec started for fixing random warts like this https://review.openstack.org/#/c/603969/ | 16:09 |
| mriedem | i'll throw this into the etherpad | 16:10 |
| openstackgerrit | caoyuan proposed openstack/nova master: Option "scheduler_default_filters" is deprecated. https://review.openstack.org/604148 | 16:11 |
| mnaser | holy crap | 16:12 |
| mnaser | i just ran this on a much bigger deployment and its a terrifying amount of stuff that is misreported | 16:12 |
| mnaser | deleted vms, rps missing, and incorrect assignments | 16:13 |
| *** liuyulong has quit IRC | 16:13 | |
| mriedem | so you have orphaned allocations and rps for deleted things in nova yes? | 16:13 |
| mriedem | likely because of that fix referenced earlier | 16:14 |
| mriedem | incorrect assignments is more troubling | 16:14 |
| tobias-urdin | i've had the same after bombing clouds with testing | 16:14 |
| mnaser | mriedem: im assuming its live migrations not cleaning up | 16:14 |
| mriedem | failed live migrations? | 16:15 |
| mnaser | i dont really know, this cloud is been around for a while so i wouldnt know | 16:15 |
| mnaser | pike though | 16:15 |
| mnaser | err no | 16:15 |
| mnaser | queens | 16:15 |
| mriedem | we definitely have functional tests for successful and failed live migrations where we assert the allocations are in the right place once we're done | 16:15 |
| mnaser | 108 deleted vms that are in placement | 16:16 |
| mriedem | at pike GA i think there were quite a few holes like that though for move operations | 16:16 |
| mnaser | 8 missing RPs (but that is probably related to the bug we just spoke about and doesnt hurt that much) | 16:16 |
| mnaser | 6 'incorrect' assignments | 16:16 |
| mriedem | of those 108 deleted vms still in placement, | 16:16 |
| mriedem | i'd be willing to bet a lot of those were local deletes in the API? | 16:17 |
| mriedem | which was also fixed later | 16:17 |
| * mriedem gets the fix | 16:17 | |
| *** sahid has quit IRC | 16:17 | |
| mnaser | yeah, i mean i can do some checking if you want me to do that before deeleting | 16:17 |
| *** ratailor has quit IRC | 16:17 | |
| mriedem | https://review.openstack.org/#/q/If507e23f0b7e5fa417041c3870d77786498f741d | 16:18 |
| mriedem | https://review.openstack.org/#/c/580498/ isn't even released yet on pike | 16:18 |
| dansmith | sheesh | 16:18 |
| *** derekh has quit IRC | 16:18 | |
| mriedem | merged july 9... | 16:19 |
| mriedem | mnaser: so that 108 and 8 orphaned things are pretty safe to cleanup i think | 16:19 |
| mriedem | the 6 incorrect will likely require a bit of investigation, but could just see where is the instance now and compare to what it's allocations are | 16:20 |
| jroll | jaypipes-ooo: way late, but I just found out we also have a john snow in our org (cc stephenfin) | 16:24 |
| *** holser_ has quit IRC | 16:33 | |
| *** Swami has quit IRC | 16:36 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/os-vif master: Fix upper-constraints link in tox file https://review.openstack.org/604158 | 16:37 |
| * mnaser looks at larsks | 16:38 | |
| * mnaser looks at https://github.com/larsks/os-placement-tools | 16:38 | |
| larsks | mnaser: that has been useful twice so far :) | 16:39 |
| mnaser | larsks: meanwhile i just spent most of the past few hours doing the same thing | 16:39 |
| mnaser | but in a different approach that does list all servers + all tenants because that would burn down some oof our deployments | 16:39 |
| *** Bhujay has joined #openstack-nova | 16:40 | |
| *** Bhujay has quit IRC | 16:41 | |
| *** Bhujay has joined #openstack-nova | 16:42 | |
| *** mdbooth has quit IRC | 16:43 | |
| mriedem | dansmith: you know how we added a microversion to make live migration an async rpc cast from api to conductor? | 16:47 |
| mriedem | i'm kind of wondering if we should do something similar for resize | 16:48 |
| mnaser | mriedem: hacked some more, http://paste.openstack.org/show/730450/ generates http://paste.openstack.org/show/730460/ | 16:48 |
| mnaser | ill test it out a bit more and try to see if i can add it to nova-manage | 16:48 |
| mriedem | with resize we only finally return the api response once conductor casts to prep_resize on compute | 16:48 |
| dansmith | mriedem: is resize not async already? | 16:48 |
| mriedem | nope | 16:48 |
| openstackgerrit | Merged openstack/nova master: Merge extended_volumes extension response into server view builder https://review.openstack.org/596285 | 16:48 |
| dansmith | because it could take a long ass time | 16:48 |
| mriedem | well, | 16:48 |
| openstackgerrit | Merged openstack/nova stable/rocky: Update RequestSpec.flavor on resize_revert https://review.openstack.org/602403 | 16:48 |
| mriedem | it's async once we pick a compute and cast to it | 16:48 |
| dansmith | ah, okay | 16:48 |
| mriedem | the live migration task before that async microversion would do the reschedules and such within conductor | 16:49 |
| mriedem | which could timeout the api response | 16:49 |
| mriedem | for cross-cell resize, i'm considering doing similar to the pre-migration checks *from* conductor and going back to the scheduler well for more hosts if the one selected doesn't pass the pre-check | 16:49 |
| mriedem | *pre-live migration checks | 16:50 |
| mriedem | likely a todo to throw on the pile for my patch at this point | 16:50 |
| dansmith | ack | 16:50 |
| mriedem | i have officially started losing sleep over this | 16:50 |
| mriedem | need to contract out some hot alaski action | 16:51 |
| *** udesale has quit IRC | 16:52 | |
| dansmith | heh | 16:54 |
| mnaser | i dont have time right now to get this audit code into nova-manage so i'll leave it for anyone to hack on later (till iget the time) | 16:56 |
| mriedem | mnaser: can you report a bug and throw it in there so we don't lose track of it? | 16:57 |
| mnaser | mriedem: fair enough | 16:57 |
| mnaser | https://bugs.launchpad.net/nova/+bug/1793569 | 16:59 |
| openstack | Launchpad bug 1793569 in OpenStack Compute (nova) "Add placement audit commands" [Undecided,New] | 16:59 |
| *** Swami has joined #openstack-nova | 17:05 | |
| mriedem | thanks | 17:05 |
| *** jpena is now known as jpena|off | 17:09 | |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: API microversion bump for handling-down-cell https://review.openstack.org/591657 | 17:13 |
| *** gouthamr has left #openstack-nova | 17:17 | |
| *** ralonsoh has quit IRC | 17:19 | |
| lucidguy | if I curl the placment API for an allocation (instance) its | 17:19 |
| lucidguy | responding it exists on the wrong hypervisor ID. Openstack | 17:19 |
| lucidguy | calls show it in the right place. How can I edit this, can't | 17:19 |
| lucidguy | figure out the PUT equivalent syntax. Tempted to delete but | 17:19 |
| lucidguy | that sounds very wrong | 17:19 |
| lucidguy | Ouch, sorry about that | 17:19 |
| *** tssurya has quit IRC | 17:20 | |
| lucidguy | if I curl the placment API for an allocation (instance) its responding it exists on the wrong hypervisor ID. Openstack calls show it in the right place. How can I edit this, can't figure out the PUT equivalent syntax. Tempted to delete but that sounds very wrong. | 17:20 |
| lucidguy | That's better | 17:21 |
| dansmith | lucidguy: you should use osc-placement to fix it | 17:25 |
| lucidguy | osc-placement.. hmm, never heard of it. | 17:25 |
| lucidguy | How does it work. | 17:27 |
| dansmith | https://docs.openstack.org/osc-placement/latest/index.html | 17:27 |
| dansmith | lucidguy: also check out https://github.com/larsks/os-placement-tools | 17:27 |
| larsks | dansmith: hah, I just pasted that to him in #openstack :) | 17:28 |
| lucidguy | Sounds like something new and time consuming to learn. | 17:28 |
| lucidguy | I would pay for a quick solution.. :) | 17:29 |
| larsks | lucidguy: I haven't been following the conversation, but that script on github may be a quick solution. | 17:30 |
| dansmith | larsks: good, because that's the right place to discuss :) | 17:30 |
| larsks | Yeah | 17:30 |
| lucidguy | I don't think the orginization would like a random script hitting the production enviroment. | 17:32 |
| lucidguy | I'm sure it's fine, but if things were to go wrong, I would be screwed | 17:32 |
| dansmith | so wat | 17:32 |
| dansmith | *wait | 17:32 |
| dansmith | you wanted a quick solution instead of learning a tool, | 17:33 |
| dansmith | and were just going to curl delete an instance's resource allocation, | 17:33 |
| dansmith | but a "random script" that was written by people that know openstack and have tested it in production is not okay? | 17:33 |
| *** Bhujay has quit IRC | 17:34 | |
| *** eandersson has quit IRC | 17:34 | |
| lucidguy | Again, I'm sure it's safe. But my knowledge of the placment service is little to none. Ideally there was a tool provided that can assist me. | 17:35 |
| cdent | lucidguy: what release are you running? | 17:35 |
| lucidguy | Queens | 17:36 |
| cdent | lucidguy: yeah, in that case osc-placement _is_ the tool provided to assist you | 17:36 |
| *** jiteka has joined #openstack-nova | 17:37 | |
| dansmith | and check_placement is the automated use of that tool to fix your exact problem without you having to learn everything about the tool | 17:37 |
| cdent | lucidguy: also see https://bugs.launchpad.net/nova/+bug/1793569 | 17:38 |
| openstack | Launchpad bug 1793569 in OpenStack Compute (nova) "Add placement audit commands" [Wishlist,Confirmed] | 17:38 |
| lucidguy | I can see https://paste.ubuntu.com/p/8F3JwHqSjz/ with the appropriate curl GET command, is it as simple as performing a PUT to change that hypervisor ID? | 17:39 |
| bauzas | dansmith: mriedem: others: gentle notice that I'll be on PTO tomorrow | 17:39 |
| bauzas | I'm actively working on libvirt reshape, still work to do on inventories | 17:39 |
| *** eandersson has joined #openstack-nova | 17:39 | |
| bauzas | then I'll push a WIP for review | 17:40 |
| dansmith | bauzas: ack | 17:40 |
| cdent | lucidguy: which curl GET produced that? | 17:40 |
| dansmith | FWIW, I'm out next week from tuesday->friday | 17:40 |
| bauzas | ok | 17:40 |
| dansmith | bauzas: so just have it all ready on monday, k? :) | 17:40 |
| cdent | me M->W | 17:40 |
| cdent | going to dan's house | 17:40 |
| *** dtantsur is now known as dtantsur|afk | 17:40 | |
| bauzas | dansmith: I'm really rushing to provide it ASAP :) | 17:40 |
| bauzas | but there are a couple of things I need to consider | 17:41 |
| jiteka | mriedem: thanks for the answer for my question from yesterday about cold-migration support in Mitaka | 17:41 |
| mriedem | jiteka: yw | 17:41 |
| bauzas | since I was a bit off when implementing reshape, I just wonder if the only trigger for reshape is the ReshapeNeeded exception that then sends allocations ? | 17:41 |
| bauzas | dansmith: ^ | 17:41 |
| jiteka | mriedem: Today I did some testing and face the same exception that was I was getting from live-migration | 17:41 |
| lucidguy | cdent: https://paste.ubuntu.com/p/n3GCFR8MSt/ | 17:41 |
| bauzas | dansmith: IIUC, the update_provider_tree() method is just running periodically, but we only pass allocations as a non-null param when we trigger a reshape, right? | 17:42 |
| * bauzas thinking of the fact that I'm writing the first bits of multiple vgpu types support | 17:42 | |
| jiteka | mriedem: http://paste.openstack.org/show/730464/ | 17:42 |
| dansmith | bauzas: I haven't followed the whole thing, but IIRC you only get to raise that on the first call of update so that it's done before compute starts up | 17:42 |
| bauzas | dansmith: yup, that I understood | 17:43 |
| cdent | lucidguy: so the is issue is that you've got the allocations showing up on two different resource providers and it should just be one. If that's the case, edit the json to remove the block identified by the wrong one, and PUT it back to the same URL | 17:43 |
| bauzas | dansmith: and then we call again this method by passing an allocations param | 17:43 |
| bauzas | so we only reshape when allocations is non-None | 17:43 |
| bauzas | the other cases are then periodic | 17:43 |
| dansmith | bauzas: not sure the details | 17:43 |
| lucidguy | cdent: Sadly I don't know how to do that. | 17:43 |
| dansmith | lucidguy: luckily there is a script that fixes this for you so you don't haveto | 17:44 |
| *** dave-mccowan has quit IRC | 17:44 | |
| cdent | yeah, lucidguy, if you're not comfortable running curl, use the scripts | 17:44 |
| bauzas | dansmith: no worries, I'll test it on my devbox then | 17:44 |
| bauzas | I should dump the DB to fake a reshape then | 17:45 |
| *** gouthamr has joined #openstack-nova | 17:46 | |
| *** dave-mccowan has joined #openstack-nova | 17:46 | |
| *** jungleboyj has joined #openstack-nova | 17:47 | |
| *** lucidguy has quit IRC | 17:50 | |
| *** slaweq has quit IRC | 18:03 | |
| *** alaski has joined #openstack-nova | 18:09 | |
| *** munimeha1 has joined #openstack-nova | 18:16 | |
| *** tbachman has quit IRC | 18:20 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: Nix update_instance_allocation, _allocate_for_instance https://review.openstack.org/604186 | 18:29 |
| *** tbachman has joined #openstack-nova | 18:40 | |
| *** cdent has quit IRC | 18:44 | |
| *** tbachman has quit IRC | 18:45 | |
| efried | jaypipes-ooo, gibi, mriedem: --^ | 18:45 |
| *** tbachman has joined #openstack-nova | 18:46 | |
| mriedem | fake news | 18:46 |
| mriedem | lemme -1 quick | 18:49 |
| mriedem | just need to update some docstrings | 18:50 |
| mriedem | otherwise i'm in love with your patch | 18:50 |
| efried | mm, good eye | 18:51 |
| mriedem | i only have one | 18:51 |
| efried | I used ^g, not grep | 18:51 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Nix update_instance_allocation, _allocate_for_instance https://review.openstack.org/604186 | 18:53 |
| efried | mriedem: Not sure if I did that right | 18:53 |
| efried | I didn't go and look at the resource tracker | 18:53 |
| mriedem | i did, with jay's change underneath it's good | 18:54 |
| efried | coo | 18:54 |
| openstackgerrit | Elancheran S proposed openstack/nova master: Add exact match aggregate image properties matcher/filter https://review.openstack.org/593167 | 18:54 |
| mriedem | baby talk will get you everywhere | 18:56 |
| *** afazekas has joined #openstack-nova | 18:59 | |
| *** dtantsur|afk has quit IRC | 19:01 | |
| *** dtantsur has joined #openstack-nova | 19:01 | |
| openstackgerrit | Merged openstack/nova master: doc trivial: additional info to admin-password-injection https://review.openstack.org/603414 | 19:01 |
| *** med_ has quit IRC | 19:02 | |
| *** dpawlik has joined #openstack-nova | 19:12 | |
| *** dtantsur has quit IRC | 19:13 | |
| openstackgerrit | Merged openstack/nova stable/pike: Fix DB archiver AttributeError due to wrong table name attribute used https://review.openstack.org/599883 | 19:14 |
| *** dpawlik has quit IRC | 19:16 | |
| *** tbachman has quit IRC | 19:16 | |
| *** dtantsur has joined #openstack-nova | 19:17 | |
| *** tbachman has joined #openstack-nova | 19:18 | |
| openstackgerrit | Jim Rollenhagen proposed openstack/nova master: ironic: stop hammering ironic API in power sync loop https://review.openstack.org/602127 | 19:23 |
| jroll | mriedem: that has a bug report and such now per your request, should also be passing tests now ^ | 19:23 |
| mriedem | ok | 19:24 |
| openstackgerrit | Merged openstack/nova master: XenAPI/Stops the migration of volume backed VHDS https://review.openstack.org/533168 | 19:25 |
| *** med_ has joined #openstack-nova | 19:33 | |
| *** panda is now known as panda|dinner | 19:34 | |
| *** belmoreira has quit IRC | 19:35 | |
| *** tssurya has joined #openstack-nova | 19:35 | |
| openstackgerrit | Merged openstack/nova master: Refactor NeutronFixture https://review.openstack.org/588338 | 19:41 |
| *** awaugama has quit IRC | 19:41 | |
| *** slaweq has joined #openstack-nova | 19:53 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/rocky: XenAPI/Stops the migration of volume backed VHDS https://review.openstack.org/604203 | 19:57 |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: Making instance/migration listing skipping down cells configurable https://review.openstack.org/592428 | 20:05 |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: Add get_by_cell_and_project() method to InstanceMappingList https://review.openstack.org/591656 | 20:05 |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: Return a minimal construct for nova list when a cell is down https://review.openstack.org/567785 | 20:05 |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: Add scatter-gather-single-cell utility https://review.openstack.org/594947 | 20:05 |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: Return a minimal construct for nova show when a cell is down https://review.openstack.org/591658 | 20:05 |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: Return a minimal construct for nova service-list when a cell is down https://review.openstack.org/584829 | 20:05 |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: API microversion bump for handling-down-cell https://review.openstack.org/591657 | 20:05 |
| openstackgerrit | Matthew Edmonds proposed openstack/nova master: [WIP] PowerVM: implement instance_on_disk https://review.openstack.org/604204 | 20:06 |
| *** erlon has quit IRC | 20:07 | |
| *** slaweq has quit IRC | 20:08 | |
| *** priteau has quit IRC | 20:13 | |
| *** panda|dinner is now known as panda | 20:24 | |
| *** owalsh has joined #openstack-nova | 20:27 | |
| mriedem | jroll: i'll wait until the ironic ci vote shows up, probably in a couple of days | 20:28 |
| mriedem | i've got a change that's been in the gate for over 20 hours | 20:29 |
| *** tssurya has quit IRC | 20:35 | |
| *** holser_ has joined #openstack-nova | 20:49 | |
| mriedem | dansmith: so random question, if i want to poll an instance for it's vm_state to change, i'm guessing Instance.get_by_uuid() is going to be faster since i can control the joins i don't care about in the db, rather than just calling instance.refresh() | 20:59 |
| mriedem | nvm, just talking out loud | 20:59 |
| dansmith | mriedem: yeah I guess probably | 21:04 |
| mriedem | i already know a faster thing | 21:05 |
| mriedem | muwahahaha | 21:05 |
| *** mrjk has quit IRC | 21:05 | |
| *** mrjk has joined #openstack-nova | 21:06 | |
| openstackgerrit | Elancheran S proposed openstack/nova stable/pike: Add exact match aggregate image properties matcher/filter https://review.openstack.org/599870 | 21:10 |
| *** claudiub has quit IRC | 21:15 | |
| openstackgerrit | Merged openstack/nova stable/queens: Fix the request context in ServiceFixture https://review.openstack.org/599762 | 21:27 |
| *** munimeha1 has quit IRC | 21:29 | |
| openstackgerrit | Merged openstack/nova stable/queens: Add functional test for affinity with multiple cells https://review.openstack.org/599765 | 21:33 |
| openstackgerrit | Merged openstack/nova stable/queens: Make scheduler.utils.setup_instance_group query all cells https://review.openstack.org/599766 | 21:33 |
| *** tetsuro has quit IRC | 21:35 | |
| *** tetsuro has joined #openstack-nova | 21:37 | |
| *** takashin has joined #openstack-nova | 21:50 | |
| openstackgerrit | Merged openstack/nova master: Add contributor guide for upgrade status checks https://review.openstack.org/596902 | 21:51 |
| openstackgerrit | Merged openstack/nova master: libvirt: mdevs returning parent and vendor PCI info https://review.openstack.org/562304 | 21:58 |
| *** holser_ has quit IRC | 22:00 | |
| *** DinaBelova has quit IRC | 22:04 | |
| *** DinaBelova has joined #openstack-nova | 22:06 | |
| *** burt has quit IRC | 22:07 | |
| mriedem | dansmith: do instances get saved as we pass them over rpc? kind of confusing how the instance.az updates in conductor are getting persisted in a few cases b/c we're not calling instance.save() right after we update the az | 22:12 |
| mriedem | e.g. https://github.com/openstack/nova/blob/master/nova/conductor/manager.py#L815 | 22:13 |
| dansmith | mriedem: the act of sending an instance over rpc does not save it, no | 22:13 |
| dansmith | is that what you're asking? | 22:13 |
| mriedem | hmm, | 22:13 |
| mriedem | yeah, | 22:13 |
| mriedem | so it must be getting passed dirty over the wire, | 22:13 |
| mriedem | and then saved on the compute side | 22:13 |
| dansmith | yep | 22:13 |
| mriedem | either when we're done (vm_state update) or fail (record a fault and revert task _state) | 22:13 |
| mriedem | ok | 22:14 |
| dansmith | yar | 22:14 |
| *** tbachman has joined #openstack-nova | 22:27 | |
| mriedem | welp, | 22:32 |
| mriedem | i think i've got a thing here | 22:32 |
| mriedem | TODOs aplenty | 22:32 |
| *** tbachman_ has joined #openstack-nova | 22:32 | |
| mriedem | can we pretend this is grizzly and i just don't need tests or to worry about rolling back and cleaning up on failure? | 22:32 |
| *** tbachman has quit IRC | 22:33 | |
| *** tbachman_ is now known as tbachman | 22:33 | |
| mriedem | efried: i think i might actually consider thinking about maybe using taskflow | 22:34 |
| efried | mriedem: Or you could use go | 22:35 |
| mriedem | should i just shell out to some go script? | 22:35 |
| efried | what could possibly go wrong? | 22:35 |
| mriedem | i've never written any go | 22:35 |
| efried | I started learning yesterday | 22:35 |
| efried | 'defer' ftw | 22:35 |
| mriedem | for fun? | 22:35 |
| efried | ahem, got "volunteered" for a side project. | 22:36 |
| mriedem | or for PowerK*S? | 22:36 |
| mriedem | *PowerK8S | 22:36 |
| efried | something like that. | 22:36 |
| mriedem | haha | 22:36 |
| mriedem | i'm sorry | 22:36 |
| mriedem | so just uh, you know, get all the powervm stuff done, some placement stuff, some cyborg stuff, etc etc | 22:36 |
| mriedem | kthx | 22:36 |
| *** spsurya has quit IRC | 22:48 | |
| *** xyang has quit IRC | 22:48 | |
| *** david-lyle has joined #openstack-nova | 22:49 | |
| *** spsurya has joined #openstack-nova | 22:50 | |
| *** dklyle has quit IRC | 22:51 | |
| *** manjeets has quit IRC | 22:51 | |
| *** rcernin has joined #openstack-nova | 22:53 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Cross-cell resize https://review.openstack.org/603930 | 22:58 |
| mriedem | dansmith: pretty sure this is ready for production ^ | 22:58 |
| *** mriedem is now known as mriedem_away | 23:10 | |
| *** slaweq has joined #openstack-nova | 23:11 | |
| *** dpawlik has joined #openstack-nova | 23:12 | |
| *** slaweq has quit IRC | 23:16 | |
| *** erlon has joined #openstack-nova | 23:16 | |
| *** dpawlik has quit IRC | 23:16 | |
| *** tbachman has quit IRC | 23:24 | |
| *** brinzhang has joined #openstack-nova | 23:26 | |
| *** mlavalle has quit IRC | 23:32 | |
| *** andreykurilin has quit IRC | 23:34 | |
| openstackgerrit | Brin Zhang proposed openstack/python-novaclient master: Add support changes-before for microversion 2.66 https://review.openstack.org/603549 | 23:35 |
| *** andreykurilin has joined #openstack-nova | 23:35 | |
| *** rcernin has quit IRC | 23:36 | |
| *** rcernin has joined #openstack-nova | 23:36 | |
| *** panda is now known as panda|off | 23:39 | |
| *** gyee has quit IRC | 23:41 | |
| *** Swami has quit IRC | 23:45 | |
| *** dpawlik has joined #openstack-nova | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
