openstackgerrit | Matt Riedemann proposed openstack/nova master: Convert nova-next to a zuul v3 job https://review.opendev.org/670196 | 00:00 |
---|---|---|
*** zhubx has quit IRC | 00:00 | |
*** zhubx has joined #openstack-nova | 00:01 | |
*** boxiang has joined #openstack-nova | 00:06 | |
*** zhubx has quit IRC | 00:08 | |
*** zhubx has joined #openstack-nova | 00:09 | |
*** zhubx has quit IRC | 00:10 | |
*** zhubx has joined #openstack-nova | 00:10 | |
*** boxiang has quit IRC | 00:10 | |
*** slaweq has joined #openstack-nova | 00:11 | |
*** hemna has quit IRC | 00:12 | |
*** hemna has joined #openstack-nova | 00:12 | |
*** mriedem has quit IRC | 00:15 | |
*** slaweq has quit IRC | 00:15 | |
*** lbragstad has quit IRC | 00:16 | |
openstackgerrit | Artom Lifshitz proposed openstack/nova master: Revert resize: wait for events according to hybrid plug https://review.opendev.org/667177 | 00:31 |
openstackgerrit | Artom Lifshitz proposed openstack/nova master: Pass migration to finish_revert_migration() https://review.opendev.org/668631 | 00:31 |
openstackgerrit | Artom Lifshitz proposed openstack/nova master: [DNM] testing bug/1813789 revert resize events https://review.opendev.org/664442 | 00:31 |
*** boxiang has joined #openstack-nova | 00:35 | |
*** zhubx has quit IRC | 00:36 | |
*** gyee has quit IRC | 00:47 | |
*** zhubx has joined #openstack-nova | 00:54 | |
*** hongbin has joined #openstack-nova | 00:57 | |
*** boxiang has quit IRC | 00:57 | |
*** hemna has quit IRC | 00:59 | |
*** boxiang has joined #openstack-nova | 01:00 | |
*** zhubx has quit IRC | 01:00 | |
*** hemna has joined #openstack-nova | 01:02 | |
*** hemna has quit IRC | 01:08 | |
*** hemna has joined #openstack-nova | 01:08 | |
*** imacdonn has quit IRC | 01:14 | |
*** imacdonn has joined #openstack-nova | 01:14 | |
*** ricolin has joined #openstack-nova | 01:23 | |
*** spatel has joined #openstack-nova | 01:30 | |
*** zhubx has joined #openstack-nova | 01:44 | |
*** lei-zh has joined #openstack-nova | 01:44 | |
*** boxiang has quit IRC | 01:47 | |
*** boxiang has joined #openstack-nova | 01:48 | |
*** zhubx has quit IRC | 01:49 | |
*** irclogbot_0 has joined #openstack-nova | 02:06 | |
*** slaweq has joined #openstack-nova | 02:11 | |
*** irclogbot_0 has quit IRC | 02:13 | |
*** slaweq has quit IRC | 02:16 | |
*** irclogbot_3 has joined #openstack-nova | 02:16 | |
*** hemna has quit IRC | 02:17 | |
*** altlogbot_1 has joined #openstack-nova | 02:18 | |
*** irclogbot_3 has quit IRC | 02:19 | |
*** hemna has joined #openstack-nova | 02:19 | |
*** zhubx has joined #openstack-nova | 02:20 | |
*** boxiang has quit IRC | 02:20 | |
*** mvkr_ has joined #openstack-nova | 02:23 | |
*** mvkr has quit IRC | 02:25 | |
*** rcernin has quit IRC | 02:29 | |
*** dklyle has joined #openstack-nova | 02:32 | |
*** BjoernT has quit IRC | 02:34 | |
*** altlogbot_1 has quit IRC | 02:34 | |
*** rcernin has joined #openstack-nova | 02:46 | |
*** dklyle has quit IRC | 02:59 | |
openstackgerrit | Brin Zhang proposed openstack/nova-specs master: Support for changing deleted_on_termination after boot https://review.opendev.org/580336 | 03:05 |
*** brault has joined #openstack-nova | 03:08 | |
*** slaweq has joined #openstack-nova | 03:11 | |
*** brault has quit IRC | 03:12 | |
*** slaweq has quit IRC | 03:15 | |
*** irclogbot_0 has joined #openstack-nova | 03:20 | |
*** whoami-rajat has joined #openstack-nova | 03:20 | |
*** psachin has joined #openstack-nova | 03:20 | |
*** whoami-rajat has quit IRC | 03:24 | |
*** whoami-rajat has joined #openstack-nova | 03:25 | |
*** irclogbot_0 has quit IRC | 03:25 | |
*** zhubx has quit IRC | 03:27 | |
*** lei-zh1 has joined #openstack-nova | 03:32 | |
*** lei-zh has quit IRC | 03:34 | |
*** psachin has quit IRC | 03:38 | |
*** rcernin has quit IRC | 03:39 | |
*** hongbin has quit IRC | 03:44 | |
*** spatel has quit IRC | 03:50 | |
*** altlogbot_0 has joined #openstack-nova | 03:54 | |
*** dannins has joined #openstack-nova | 03:54 | |
*** rcernin has joined #openstack-nova | 03:55 | |
*** altlogbot_0 has quit IRC | 03:59 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova stable/rocky: doc: Fix a parameter of NotificationPublisher https://review.opendev.org/670225 | 04:03 |
openstackgerrit | Takashi NATSUME proposed openstack/nova stable/queens: doc: Fix a parameter of NotificationPublisher https://review.opendev.org/670226 | 04:05 |
*** slaweq has joined #openstack-nova | 04:11 | |
*** udesale has joined #openstack-nova | 04:13 | |
*** slaweq has quit IRC | 04:16 | |
*** BjoernT has joined #openstack-nova | 04:16 | |
*** _alastor1 has quit IRC | 04:24 | |
*** lei-zh1 has quit IRC | 04:50 | |
*** pcaruana has joined #openstack-nova | 04:55 | |
*** lei-zh has joined #openstack-nova | 05:00 | |
*** ccamacho has quit IRC | 05:33 | |
*** Luzi has joined #openstack-nova | 05:43 | |
*** BjoernT has quit IRC | 05:49 | |
*** lei-zh has quit IRC | 06:01 | |
*** lei-zh has joined #openstack-nova | 06:05 | |
*** slaweq has joined #openstack-nova | 06:11 | |
*** ccamacho has joined #openstack-nova | 06:14 | |
*** slaweq has quit IRC | 06:16 | |
*** altlogbot_0 has joined #openstack-nova | 06:18 | |
*** altlogbot_0 has quit IRC | 06:23 | |
*** altlogbot_0 has joined #openstack-nova | 06:24 | |
*** bbowen_ has joined #openstack-nova | 06:27 | |
*** bbowen_ has quit IRC | 06:28 | |
*** bbowen has quit IRC | 06:28 | |
*** altlogbot_0 has quit IRC | 06:29 | |
*** dpawlik has joined #openstack-nova | 06:29 | |
*** rpittau|afk is now known as rpittau | 06:33 | |
*** ricolin has quit IRC | 06:39 | |
*** luksky11 has joined #openstack-nova | 06:39 | |
*** belmoreira has joined #openstack-nova | 06:46 | |
*** slaweq has joined #openstack-nova | 06:46 | |
*** ricolin has joined #openstack-nova | 06:46 | |
*** maciejjozefczyk has joined #openstack-nova | 06:53 | |
*** altlogbot_2 has joined #openstack-nova | 06:56 | |
openstackgerrit | huanhongda proposed openstack/nova stable/pike: [Stable Only] libvirt: Handle volume API failure in post_live_migration https://review.opendev.org/670016 | 06:57 |
*** altlogbot_2 has quit IRC | 07:01 | |
*** ivve has joined #openstack-nova | 07:04 | |
*** tetsuro has joined #openstack-nova | 07:06 | |
*** yaawang has quit IRC | 07:07 | |
*** yaawang has joined #openstack-nova | 07:08 | |
*** helenafm has joined #openstack-nova | 07:10 | |
*** ccamacho has quit IRC | 07:12 | |
*** ccamacho has joined #openstack-nova | 07:12 | |
*** awalende has joined #openstack-nova | 07:13 | |
*** irclogbot_3 has joined #openstack-nova | 07:16 | |
*** rcernin has quit IRC | 07:17 | |
*** tssurya has joined #openstack-nova | 07:19 | |
*** irclogbot_3 has quit IRC | 07:21 | |
*** lei-zh has quit IRC | 07:22 | |
*** irclogbot_1 has joined #openstack-nova | 07:24 | |
*** irclogbot_1 has quit IRC | 07:27 | |
*** lei-zh has joined #openstack-nova | 07:28 | |
*** xek_ has joined #openstack-nova | 07:39 | |
*** lei-zh has quit IRC | 07:40 | |
*** belmoreira has quit IRC | 07:40 | |
*** lei-zh has joined #openstack-nova | 07:41 | |
openstackgerrit | huanhongda proposed openstack/nova stable/pike: [Stable Only] libvirt: Handle volume API failure in post_live_migration https://review.opendev.org/670016 | 07:41 |
*** tetsuro has quit IRC | 07:42 | |
*** belmoreira has joined #openstack-nova | 07:46 | |
*** altlogbot_0 has joined #openstack-nova | 07:48 | |
*** altlogbot_0 has quit IRC | 07:49 | |
*** tetsuro has joined #openstack-nova | 07:51 | |
*** irclogbot_0 has joined #openstack-nova | 07:52 | |
*** irclogbot_0 has quit IRC | 07:55 | |
*** ralonsoh has joined #openstack-nova | 07:59 | |
*** ttsiouts has joined #openstack-nova | 08:05 | |
*** elod has quit IRC | 08:07 | |
*** cdent has joined #openstack-nova | 08:08 | |
*** irclogbot_1 has joined #openstack-nova | 08:08 | |
*** elod has joined #openstack-nova | 08:08 | |
*** suzhengwei_ has joined #openstack-nova | 08:10 | |
*** tkajinam has quit IRC | 08:10 | |
*** suzhengwei_ has quit IRC | 08:12 | |
*** irclogbot_1 has quit IRC | 08:12 | |
*** suzhengwei_ has joined #openstack-nova | 08:13 | |
*** suzhengwei_ has quit IRC | 08:15 | |
*** ociuhandu has joined #openstack-nova | 08:15 | |
*** ttsiouts has quit IRC | 08:17 | |
*** ttsiouts has joined #openstack-nova | 08:18 | |
*** udesale has quit IRC | 08:30 | |
*** udesale has joined #openstack-nova | 08:31 | |
*** xek_ has quit IRC | 08:35 | |
*** derekh has joined #openstack-nova | 08:40 | |
*** suzhengwei has joined #openstack-nova | 08:41 | |
*** tetsuro has quit IRC | 08:45 | |
*** tetsuro has joined #openstack-nova | 08:48 | |
*** mdbooth has joined #openstack-nova | 08:49 | |
*** suzhengwei has quit IRC | 08:50 | |
*** tetsuro has quit IRC | 08:53 | |
openstackgerrit | Shilpa Devharakar proposed openstack/nova master: Support filtering of hosts by forbidden aggregates https://review.opendev.org/667952 | 08:55 |
*** dtantsur|afk is now known as dtantsur | 08:57 | |
*** mdbooth has quit IRC | 08:59 | |
*** xek has joined #openstack-nova | 09:02 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Fix no propagation of nova context request_id https://review.opendev.org/662715 | 09:03 |
*** udesale has quit IRC | 09:08 | |
*** udesale has joined #openstack-nova | 09:09 | |
*** lei-zh1 has joined #openstack-nova | 09:10 | |
*** lei-zh has quit IRC | 09:11 | |
*** damien_r has joined #openstack-nova | 09:12 | |
*** dpawlik has quit IRC | 09:12 | |
*** dpawlik has joined #openstack-nova | 09:13 | |
*** dpawlik has quit IRC | 09:18 | |
*** damien_r has quit IRC | 09:18 | |
*** dpawlik has joined #openstack-nova | 09:18 | |
*** FlorianFa has joined #openstack-nova | 09:36 | |
*** udesale has quit IRC | 09:37 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: nova-manage: heal port allocations https://review.opendev.org/637955 | 09:37 |
*** udesale has joined #openstack-nova | 09:38 | |
*** belmoreira has quit IRC | 09:39 | |
*** udesale has quit IRC | 09:40 | |
*** udesale has joined #openstack-nova | 09:41 | |
*** mdbooth has joined #openstack-nova | 09:46 | |
*** irclogbot_0 has joined #openstack-nova | 09:48 | |
*** mkrai_ has joined #openstack-nova | 09:49 | |
*** mkrai__ has joined #openstack-nova | 09:50 | |
*** irclogbot_0 has quit IRC | 09:51 | |
*** cdent has quit IRC | 10:00 | |
*** udesale has quit IRC | 10:02 | |
*** udesale has joined #openstack-nova | 10:02 | |
*** udesale has quit IRC | 10:03 | |
*** udesale has joined #openstack-nova | 10:03 | |
*** shilpasd has joined #openstack-nova | 10:04 | |
*** psachin has joined #openstack-nova | 10:13 | |
*** ttsiouts has quit IRC | 10:19 | |
*** ttsiouts has joined #openstack-nova | 10:20 | |
*** belmoreira has joined #openstack-nova | 10:24 | |
*** ttsiouts has quit IRC | 10:25 | |
*** altlogbot_0 has joined #openstack-nova | 10:26 | |
*** belmoreira has quit IRC | 10:28 | |
*** altlogbot_0 has quit IRC | 10:29 | |
*** yonglihe has quit IRC | 10:29 | |
openstackgerrit | Eric Fried proposed openstack/os-resource-classes master: Propose ACCELERATOR_{FPGA|GPU} resource classes https://review.opendev.org/657464 | 10:32 |
*** janki has joined #openstack-nova | 10:32 | |
*** altlogbot_3 has joined #openstack-nova | 10:34 | |
*** davidsha has joined #openstack-nova | 10:35 | |
openstackgerrit | Yongli He proposed openstack/nova master: clean up orphan instances https://review.opendev.org/627765 | 10:39 |
*** altlogbot_3 has quit IRC | 10:39 | |
*** altlogbot_0 has joined #openstack-nova | 10:40 | |
*** irclogbot_3 has joined #openstack-nova | 10:40 | |
*** lpetrut has joined #openstack-nova | 10:45 | |
*** altlogbot_0 has quit IRC | 10:45 | |
*** irclogbot_3 has quit IRC | 10:45 | |
*** brinzhang_ has quit IRC | 10:48 | |
*** belmoreira has joined #openstack-nova | 10:50 | |
*** mkrai__ has quit IRC | 10:52 | |
*** mkrai_ has quit IRC | 10:52 | |
*** altlogbot_0 has joined #openstack-nova | 10:56 | |
ralonsoh | hi folks, can I have your attention to https://review.opendev.org/#/c/641670/? | 10:58 |
ralonsoh | thank you in advance! | 10:58 |
*** altlogbot_0 has quit IRC | 11:01 | |
*** lpetrut has quit IRC | 11:01 | |
*** lpetrut has joined #openstack-nova | 11:03 | |
*** belmoreira has quit IRC | 11:06 | |
*** belmoreira has joined #openstack-nova | 11:09 | |
*** lei-zh1 has quit IRC | 11:15 | |
*** belmoreira has quit IRC | 11:17 | |
*** tbachman has quit IRC | 11:18 | |
*** tesseract has joined #openstack-nova | 11:21 | |
*** belmoreira has joined #openstack-nova | 11:24 | |
*** _erlon_ has joined #openstack-nova | 11:24 | |
*** belmoreira has quit IRC | 11:27 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Move consts from neutronv2/api to constants module https://review.opendev.org/668945 | 11:27 |
*** belmoreira has joined #openstack-nova | 11:28 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Translatable output strings in heal allocation https://review.opendev.org/668925 | 11:28 |
*** priteau has joined #openstack-nova | 11:29 | |
*** belmoreira has quit IRC | 11:30 | |
*** tbachman has joined #openstack-nova | 11:37 | |
*** ttsiouts has joined #openstack-nova | 11:38 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Use neutron contants in cmd/manage.py https://review.opendev.org/668946 | 11:39 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add 'resource_request' to neutronv2/constants https://review.opendev.org/668947 | 11:39 |
*** udesale has quit IRC | 11:39 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Use the safe get_binding_profile https://review.opendev.org/669817 | 11:45 |
*** tbachman has quit IRC | 11:45 | |
*** tbachman has joined #openstack-nova | 11:50 | |
*** altlogbot_3 has joined #openstack-nova | 11:56 | |
*** tbachman has quit IRC | 11:59 | |
*** altlogbot_3 has quit IRC | 12:01 | |
*** ttsiouts has quit IRC | 12:12 | |
*** priteau has quit IRC | 12:13 | |
*** ttsiouts has joined #openstack-nova | 12:13 | |
*** tbachman has joined #openstack-nova | 12:15 | |
*** janki has quit IRC | 12:21 | |
openstackgerrit | Stephen Finucane proposed openstack/nova stable/stein: docs: Correct issues with 'openstack quota set' commands https://review.opendev.org/670096 | 12:25 |
openstackgerrit | Stephen Finucane proposed openstack/nova stable/rocky: docs: Correct issues with 'openstack quota set' commands https://review.opendev.org/670097 | 12:26 |
openstackgerrit | Stephen Finucane proposed openstack/nova stable/queens: docs: Correct issues with 'openstack quota set' commands https://review.opendev.org/670100 | 12:27 |
*** irclogbot_3 has joined #openstack-nova | 12:33 | |
shilpasd | efried: dansmith: requesting to further review https://review.opendev.org/#/c/667952/7 | 12:33 |
*** irclogbot_3 has quit IRC | 12:35 | |
alex_xu | efried: after review the vpmem, I want to point the Luyao to move the vpmem ns assigment inside the resource tracker. https://review.opendev.org/#/c/662702/4/nova/compute/manager.py@2200, want to hear you opionion whether it is right direction I pointed to | 12:39 |
*** jmlowe has quit IRC | 12:40 | |
*** luksky11 has quit IRC | 12:41 | |
*** hamzy has quit IRC | 12:42 | |
*** janki has joined #openstack-nova | 12:43 | |
*** janki has quit IRC | 12:45 | |
openstackgerrit | Stephen Finucane proposed openstack/nova master: docs: Scrub available quotas https://review.opendev.org/670125 | 12:47 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: docs: Rewrite quotas documentation https://review.opendev.org/667165 | 12:47 |
*** helenafm has quit IRC | 12:50 | |
*** altlogbot_1 has joined #openstack-nova | 12:51 | |
*** altlogbot_1 has quit IRC | 12:53 | |
*** abhishekk has joined #openstack-nova | 12:53 | |
openstackgerrit | ya.wang proposed openstack/nova master: Add method 'get_all_required_traits' to scheduler utils https://review.opendev.org/670297 | 12:59 |
openstackgerrit | ya.wang proposed openstack/nova master: vCPU mdoels selection https://review.opendev.org/670298 | 12:59 |
openstackgerrit | ya.wang proposed openstack/nova master: Add compatibility checks for CPU mode and CPU models and extra flags https://review.opendev.org/670299 | 12:59 |
openstackgerrit | ya.wang proposed openstack/nova master: Support report multi CPU model traits https://review.opendev.org/670300 | 12:59 |
*** helenafm has joined #openstack-nova | 13:00 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Fix no propagation of nova context request_id https://review.opendev.org/662715 | 13:00 |
efried | alex_xu: looking... | 13:03 |
alex_xu | efried: thanks! | 13:04 |
efried | alex_xu: instance_claim is a good idea, I think. Aptly named, protected by COMPUTE_RESOURCE_SEMAPHORE... but where is bauzas claiming VGPUs? | 13:05 |
bauzas | efried: on a meeting atm | 13:05 |
efried | I would have expected that to be the same as vpmems | 13:05 |
efried | no worries bauzas, I can look. | 13:06 |
alex_xu | efried: actually, I just find the vgpu allocation have race problem | 13:06 |
alex_xu | I talk that with bauzas yesterday | 13:06 |
efried | ah, okay. So it sounds like vgpu needs to be moved to instance_claim as well | 13:06 |
efried | do we have a bug for that yet? | 13:06 |
*** shilpasd has quit IRC | 13:07 | |
*** yaawang has quit IRC | 13:07 | |
alex_xu | not yet, I can file a bug | 13:07 |
efried | alex_xu: hold on, isn't COMPUTE_RESOURCES_SEMAPHORE held throughout the `with instance_claim` block? | 13:10 |
efried | oh, no, never mind | 13:10 |
efried | instance_claim isn't itself a context manager; it returns one. | 13:11 |
*** belmoreira has joined #openstack-nova | 13:12 | |
alex_xu | efried: here is the bug, that help you understand the problem https://bugs.launchpad.net/nova/+bug/1836204 | 13:12 |
openstack | Launchpad bug 1836204 in OpenStack Compute (nova) "The allocation of VGPU has race problem" [Undecided,New] | 13:12 |
*** belmoreira has quit IRC | 13:12 | |
alex_xu | efried: also the vpmem isn't quite same with vgpu in the resize case, we need to allcoate vpmem for migration the data from the src host. so we need to assign a pmem in the beginning of resize https://review.opendev.org/#/c/662709/4/nova/compute/manager.py@4359 | 13:13 |
*** shilpasd has joined #openstack-nova | 13:13 | |
efried | in that case do we want to fold it into resize_claim? | 13:14 |
alex_xu | yes, and that doesn't sounds good we add new virt interface just for allocae a pmem. | 13:14 |
alex_xu | and there isn't a way to resolve the race problem just by listing libvirt domain | 13:14 |
efried | alex_xu: We shouldn't be putting this libvirt-specific code into the rt anyway | 13:15 |
alex_xu | since we assign vpmem without create libvirt domain on the dst host in the beginning of resize | 13:15 |
efried | a virt driver interface to say "claim the things in this allocation" would seem appropriate. | 13:15 |
efried | it doesn't need to be vpmem specific | 13:15 |
alex_xu | efried: yes, so I'm thinking we should use virt.get_available_resources reporting the vpmem to the rt, then rt will track the assignement | 13:16 |
alex_xu | efried: ok, I see you point | 13:16 |
alex_xu | another problem is we also need some code to handle the rollback like we spawn the instance failed | 13:17 |
efried | yup, the methods would need to be symmetrical. claim_for_instance/unclaim_for_instance | 13:17 |
efried | and the virt driver doesn't really need to do anything with the device other than mark it as "used" in whatever way it sees fit. | 13:18 |
alex_xu | efried: yea, that we can do | 13:18 |
alex_xu | efried: should we call that claim_for_instance inside rt.instance_claim? | 13:19 |
*** belmoreira has joined #openstack-nova | 13:19 | |
efried | totally | 13:19 |
efried | and resize_claim | 13:19 |
alex_xu | cool | 13:19 |
efried | but | 13:19 |
efried | I think we should probably create this framework outside of the vpmem series | 13:19 |
efried | and put the vgpu stuff into it | 13:19 |
efried | and then build the vpmem series on top of that | 13:20 |
*** arxcruz|rover is now known as arxcruz|ruck | 13:20 | |
sean-k-mooney | efried: well im not sure that is true in all cacses | 13:20 |
alex_xu | yea, that makes sense | 13:20 |
efried | Because we already know the vgpu stuff is "working" (other than the race condition" | 13:20 |
efried | ) | 13:20 |
sean-k-mooney | that the virt driver does not need to do anything | 13:20 |
efried | sean-k-mooney: That's the point, though | 13:20 |
efried | the virt driver gets to decide what all it needs to do | 13:20 |
efried | the RT cannot (and should not need to) know that. | 13:20 |
sean-k-mooney | but the RT would need to know about numa affintiy and other constrtits | 13:21 |
efried | E.g. this would be a great time to kick off cyborg fpga programming. | 13:21 |
kashyap | Anyone from Ubuntu / Debian packaging here? | 13:21 |
kashyap | We need some packaging work done in Debian & Ubuntu (I did it in Fedora) for the firmware packages. | 13:22 |
* kashyap will write a short email to the list, with an update and an example of what's required. | 13:22 | |
efried | kashyap: coreycb is who mriedem said was his go-to for that | 13:22 |
alex_xu | sean-k-mooney: in the future the placement will know about the numa affinity | 13:22 |
kashyap | efried: Noted | 13:23 |
sean-k-mooney | yes but it doesnte right now | 13:23 |
kashyap | coreycb: Hi, let me know when you have a block of 15 minutes to chat about some packaging work. | 13:23 |
efried | right, the fact that the RT has to know about NUMA affinity today is a bastardization | 13:23 |
sean-k-mooney | efried: not really | 13:23 |
efried | sean-k-mooney: remember, I come from a world where libvirt isn't the only virt driver in existence :P | 13:23 |
sean-k-mooney | sure but that does not mean that all legacy systems are bad | 13:24 |
coreycb | kashyap: can you point me to the source? | 13:24 |
efried | Didn't say that at all. | 13:24 |
efried | NUMA affinity is simply Not A Thing in pvm. So the fact that all that logic is in the RT is kind of incestuous from that perspective. | 13:24 |
sean-k-mooney | hyperv support numa affintiy | 13:25 |
sean-k-mooney | although i dont know if they use the RT for that | 13:25 |
kashyap | coreycb: Hi, see my Fedora PullRequest here: https://src.fedoraproject.org/rpms/edk2/pull-request/3 | 13:25 |
efried | missing the point. "Give my VM 5 VCPU" is universal. "NUMA nodes" is not. | 13:25 |
kashyap | coreycb: It is essentially to ship JSON "firmware descriptor" files. | 13:26 |
sean-k-mooney | and PVM systems still have non umiform memory access unless the hardware has only one memory contoler | 13:26 |
sean-k-mooney | they jsut dont expose it | 13:26 |
kashyap | coreycb: My commit message contains all the details. I'll actually write an e-mail to 'openstack-discuss' list, perhaps | 13:26 |
efried | I've mostly retired this soapbox since leaving PowerVM, but it's still an issue. | 13:26 |
kashyap | coreycb: As SUSE also needs to the packaging work. (They're aware of it; I informed them in Denver.) | 13:27 |
sean-k-mooney | ya i know it should be optional | 13:27 |
sean-k-mooney | and not enforced on driver that dont care | 13:27 |
efried | yes, that's exactly the point. PowerVM systems don't (need to) expose NUMA-isms. | 13:27 |
coreycb | kashyap: ok so they're part of qemu source? | 13:27 |
*** jmlowe has joined #openstack-nova | 13:27 | |
efried | right; and it's not much of a comfort that drivers that don't care can "just ignore" those code paths | 13:27 |
kashyap | coreycb: Yes. Currently in Git. Will be part of 4.1 -- due in Auguest. | 13:27 |
efried | that doesn't always work | 13:27 |
kashyap | (As noted in the commit message.) | 13:27 |
efried | like the convolutions that were necessary to make sure the sysfs code paths didn't get activated on PowerVM systems when doing PCI passthrough. | 13:28 |
sean-k-mooney | efried: anyway old argment we are changing this eventually | 13:28 |
coreycb | kashyap: i'll try to sync you up with cpaelzer. he does our qemu/libvirt packaging. | 13:28 |
sean-k-mooney | well we were not allowed to make those systems only work for libvirt | 13:28 |
sean-k-mooney | since virt driver are not allowed created db tables | 13:28 |
kashyap | coreycb: "Our"? I'm not sure you're of Ubuntu or Debian or... | 13:29 |
coreycb | kashyap: ubuntu | 13:29 |
*** luksky11 has joined #openstack-nova | 13:29 | |
sean-k-mooney | if the libvirt driver was allowed to have its own db table like neturon allows its ml2 driver to do then libvirt would have had its own RT | 13:29 |
coreycb | kashyap: well we contribute to both though | 13:29 |
sean-k-mooney | anyway brb | 13:30 |
kashyap | coreycb: (Nod) | 13:30 |
alex_xu | efried: sean-k-mooney so the virt_driver.claim_for_instance/unclaim_for_instance still makes sense? | 13:30 |
*** BjoernT has joined #openstack-nova | 13:31 | |
efried | alex_xu: sean-k-mooney: This is an interesting point. Whatever tracking the virt driver is doing (in memory) will need to be a) rebuilt when the compute service is restarted; and b) able to survive an instance reboot, because the same information will be necessary to rebuild the XML. | 13:31 |
efried | so what happens if we hard stop a VM and then restart the compute service and try to restart the VM? | 13:31 |
efried | without a real persistence mechanism, this may get flaky. | 13:31 |
dansmith | libvirt itself is a persistence mechanism | 13:32 |
*** rafaeldtinoco has joined #openstack-nova | 13:32 | |
alex_xu | yea, the compute service will sync some status I think | 13:33 |
efried | but kind of like what we've done pushing allocations onto the virt driver via what is effectively a callback (update_provider_tree), the results of which the RT uses to push to hard storage (placement db), I wonder if this claiming could do the same thing. | 13:33 |
efried | sorry, s/allocations/inventories etc./ | 13:33 |
efried | the artifacts RT pushes to hard storage (in this case the nova db) would have to be opaque to the RT. | 13:34 |
alex_xu | that claim is about specific device, the placement doesn't care about | 13:34 |
efried | yes, I'm drawing a parallel | 13:34 |
efried | I'm saying: {the way placement is used as the persistence mechanism for provider inventories etc} is equivalent in principle to {the way the nova db would need to be used for claim/assignment information we're discussing} | 13:35 |
alex_xu | actually we needn't persistent the claim and assigment in nova db, since libvirt persistent the info as dansmith said | 13:36 |
efried | You mean via the domain XML? | 13:37 |
alex_xu | yes, we read all assigned devices from the domain xml in the startup of compute service | 13:38 |
efried | But we rebuild the domain XML when we hard reboot the instance, right? | 13:38 |
*** shilpasd has quit IRC | 13:38 | |
efried | So if the instance is hard stopped, and then we restart the compute service, we have to rebuild the domain XML from somewhere. | 13:38 |
*** lbragstad has joined #openstack-nova | 13:39 | |
efried | or am I misunderstanding that lifecycle flow completely? | 13:39 |
alex_xu | efried: if you just stop the instance, the xml still in libvirt. do you mean remove the domain from the libvirt? | 13:39 |
dansmith | but the xml doesn't go away until you rebuild it, so you can read it, then do your regeneration | 13:39 |
efried | okay, cool. Then I guess we're okay. | 13:39 |
efried | but | 13:39 |
dansmith | we depend on libvirt keeping the domain xml for us in lots of cases | 13:40 |
efried | in this flow, the claim needs to happen before spawn is invoked | 13:40 |
efried | i.e. before we even start to build the domain xml | 13:40 |
efried | so the claim info will need to be stored temporarily somewhere else | 13:40 |
alex_xu | yes | 13:40 |
*** irclogbot_3 has joined #openstack-nova | 13:40 | |
alex_xu | in memory | 13:40 |
efried | and then we can flush it once the instance is alive | 13:40 |
efried | okay, that wfm. | 13:41 |
stephenfin | bauzas: (Because I don't have a deployment available to test this on) Can standard, non-admin users specify the availability zone an instance lands in? | 13:41 |
bauzas | stephenfin: that's the whole purpose of AZs :) | 13:41 |
efried | alex_xu: Are you planning to work on this? | 13:41 |
alex_xu | yes, I can take a look that | 13:41 |
stephenfin | bauzas: okay, phew. So they can specify an AZ but not a destination host/node within that AZ, yeah? | 13:42 |
stephenfin | By default, that is | 13:42 |
bauzas | stephenfin: to tell a way how to land somewhere you don't know but different from some other way you don't want | 13:42 |
*** mriedem has joined #openstack-nova | 13:42 | |
*** belmoreira has quit IRC | 13:42 | |
bauzas | stephenfin: yeah it's borked, because the AZ hack is a terrible way | 13:42 |
* kashyap wonders if there is a mailing list tag for distros | 13:42 | |
bauzas | so, yeah, we're accepting users to set an AZ name but they're trampled if they use ':' | 13:42 |
stephenfin | bauzas: yeah, that's why https://review.opendev.org/#/c/666767/ and its predecessor exists, presumably | 13:43 |
bauzas | stephenfin: I need to take a look on those things | 13:43 |
bauzas | efried: alex_xu: my meeting is done, wazzup ? | 13:43 |
stephenfin | bauzas: I'm rewriting the AZ/host aggregate docs atm. They're not done but when they are, you'll be the first person I ping for reviews ;) https://review.opendev.org/#/c/667133/ | 13:43 |
bauzas | (well I have other meetings in 20 mins, so my time is counted :( ) | 13:44 |
efried | bauzas: We were just discussing the race condition whereby two instances could try to assign the same vgpu | 13:44 |
efried | talking about moving the vgpu "assignment" (though actually not the assignment, see below) into instance_claim | 13:44 |
bauzas | efried: k, basically alex_xu made a good point | 13:44 |
bauzas | efried: that's overthinking I feel | 13:44 |
bauzas | stephenfin: ack, bump me with review requests tomorrow :) | 13:44 |
efried | tldr we're talking about adding claim_for_instance/unclaim_for_instance to the ComputeDriver interface, since only the specific virt driver can know how to identify the specific device, and what needs to be done to "reserve" it. | 13:45 |
*** belmoreira has joined #openstack-nova | 13:45 | |
*** irclogbot_3 has quit IRC | 13:45 | |
efried | In the case of the libvirt driver for vgpus, it would be sufficient to mark it in an in-memory dict as belonging to the instance | 13:45 |
*** BjoernT_ has joined #openstack-nova | 13:46 | |
efried | then purge that dict entry during spawn, since that information can be gleaned from the domain XML thereafter. | 13:46 |
*** takashin has quit IRC | 13:46 | |
efried | this takes hypervisor-specific code out of the RT, which is ++ | 13:46 |
efried | and fixes the race | 13:46 |
efried | and is reusable for other things like vpmem | 13:47 |
*** BjoernT has quit IRC | 13:47 | |
bauzas | efried: FWIW, this is somehow related to the spec you love :) | 13:47 |
efried | which, vgpu affinity? | 13:47 |
*** hamzy has joined #openstack-nova | 13:47 | |
bauzas | efried: correct, as we check things in instance_claim() already | 13:48 |
bauzas | efried: and that's what I really want to amend for vGPUs | 13:48 |
*** whoami-rajat has quit IRC | 13:48 | |
efried | yeah, basically "figure out which specific thingy on the system is going to be assigned to the instance for a particular unit of resource class in an allocation" should be the purview of the virt driver. | 13:48 |
bauzas | as I said, the vGPU weigher and the object update aren't necessary | 13:49 |
efried | because only the virt driver has a view to "specific thingy on the system" | 13:49 |
bauzas | sec, giving you a link | 13:49 |
* efried awaits link | 13:49 | |
sean-k-mooney | bauzas: its even more related to the draft i wrote for that | 13:50 |
*** takashin has joined #openstack-nova | 13:52 | |
sean-k-mooney | efried: i think bauzas means https://review.opendev.org/#/c/650963/9/specs/train/approved/libvirt-vgpu-numa-affinity.rst | 13:52 |
*** whoami-rajat has joined #openstack-nova | 13:52 | |
bauzas | https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L2223 eventualls calls https://github.com/openstack/nova/blob/master/nova/compute/claims.py#L220 | 13:53 |
bauzas | efried: ^ | 13:53 |
*** yaawang has joined #openstack-nova | 13:54 | |
bauzas | efried: so what you'd like is that the device assignment (ie. the mdev choice of https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L6416) would be called by something close to https://github.com/openstack/nova/blob/master/nova/compute/claims.py#L220 ? | 13:55 |
bauzas | if so, I'm not opposed to | 13:55 |
*** shilpasd has joined #openstack-nova | 13:55 | |
bauzas | but xen needs substantial changes too | 13:56 |
*** artom has quit IRC | 13:56 | |
*** udesale has joined #openstack-nova | 13:56 | |
coreycb | kashyap: cpaelzer added it to his 20.04 virt stack work. thanks for the heads up. | 13:57 |
efried | bauzas: I would like it if the hypervisor-specific aspects of all of that were in the virt driver -- but yes, to fix the race, the "mdev choice" needs to happen somewhere inside instance_claim. | 13:57 |
kashyap | coreycb: Cool. I'll send a note to the list as well once I get around | 13:57 |
coreycb | ok | 13:57 |
kashyap | Also need to remind the SUSE folks. And Debian | 13:57 |
efried | bauzas: I'll take this opportunity to point out that _test_numa_topology is far from hypervisor-agnostic. | 13:58 |
bauzas | efried: that's what I said yes | 13:58 |
sean-k-mooney | personally i think we should be calling calim_for_instacnce form the conductor by they way way before we get to the compute node after we select the host but before we call spawn | 13:58 |
bauzas | oh | 13:58 |
bauzas | surze | 13:58 |
bauzas | but that's a waaaay more complicated | 13:58 |
efried | baby steps | 13:58 |
sean-k-mooney | efried: babysteps that predate placement | 13:58 |
sean-k-mooney | we keep putting that off | 13:58 |
*** artom has joined #openstack-nova | 13:59 | |
sean-k-mooney | it prevents all the races that placemetn will eventurally solve | 13:59 |
* alex_xu begins to dream that beautiful day | 14:00 | |
sean-k-mooney | if we do claim for instance in teh conductor via an rpc to the compute we nolonger race on any pci or numa resouce | 14:00 |
mriedem | meeting? | 14:00 |
artom | meating. | 14:00 |
efried | oh, craaap | 14:00 |
alex_xu | ok, that is my fault :) | 14:01 |
*** ccamacho has quit IRC | 14:03 | |
mnaser | i'm really curious if there's a possible case where nova-compute gets a request an complains abut InstanceActionNotFound_Remote | 14:11 |
mnaser | it means that the instane action was *not* created (or committed to db) when the rpc request was recieved ? | 14:13 |
*** donnyd_pto is now known as donnyd | 14:21 | |
*** spatel has joined #openstack-nova | 14:23 | |
*** spatel has quit IRC | 14:23 | |
*** mkrai_ has joined #openstack-nova | 14:25 | |
*** mkrai__ has joined #openstack-nova | 14:25 | |
*** hongbin has joined #openstack-nova | 14:26 | |
mriedem | check the request id - the actions are keyed by request id so if the request id isn't the same for some reason it wouldn't be found | 14:27 |
mriedem | e.g. a periodic task in compute using an admin context with a generated request id hitting some method that expects an action to exist | 14:28 |
*** spatel has joined #openstack-nova | 14:31 | |
*** Luzi has quit IRC | 14:32 | |
bauzas | efried: FWIW https://review.opendev.org/#/c/552924/ | 14:46 |
*** ociuhandu has quit IRC | 14:47 | |
bauzas | it needs a bit of caring ^ | 14:47 |
efried | ah, nice bauzas, thanks. | 14:47 |
bauzas | mriedem: https://review.opendev.org/#/c/645520/35/doc/api_samples/servers/v2.74/server-create-req-with-only-host.json I thought we were no longer accepting to only provide a host field without also providing the node name ? | 14:52 |
bauzas | lemme look at the spec | 14:52 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Convert nova-next to a zuul v3 job https://review.opendev.org/670196 | 14:52 |
bauzas | mriedem: hell, yeah, I already had that concern https://review.opendev.org/#/c/645458/18/specs/train/approved/add-host-and-hypervisor-hostname-flag-to-create-server.rst@125 | 14:53 |
mriedem | bauzas: not sure what you're talking about | 14:54 |
bauzas | mriedem: asking a destination by only the 'host' field | 14:54 |
mriedem | so what? for non-ironic the host == hypervisor_hostname | 14:55 |
mriedem | so why require the user to specify both? | 14:55 |
mriedem | that's just shitty ux imo | 14:55 |
bauzas | mriedem: I'm all good with only providing the node name | 14:55 |
bauzas | what I'm concerned is by only asking for a service name | 14:55 |
bauzas | and depending on the virt driver, the service name can be different from the node name | 14:56 |
mriedem | only for ironic, right? | 14:56 |
bauzas | I don't recall which one specifically | 14:56 |
mriedem | if you're using kvm, requesting the server land on a particular host is the same as asking that it land on a given node since they are the same thing | 14:57 |
mriedem | if you're using ironic, you can ask that it land on a particular compute service host meaning it will use a particular ironic cluster, you don't care which node, | 14:57 |
*** awalende has quit IRC | 14:57 | |
mriedem | or you can ask for a node and we'll lookup the host | 14:57 |
mriedem | or you can ask for both if you know exactly where it goes | 14:57 |
mriedem | as you'd do today for ironic | 14:58 |
mriedem | with the forced stuff for the JsonFilter | 14:58 |
mriedem | query hint | 14:58 |
*** awalende has joined #openstack-nova | 14:58 | |
sean-k-mooney | bauzas: we still hit the schdler so if we just pass the service name the schduler could chose a host managed by that ironic compute service | 14:59 |
sean-k-mooney | and ya i know that the hyperviors hosts can move between teh compute service but its proably still makes sense | 14:59 |
mriedem | i really really don't want to encode/enforce some dumb "you have to specify both host and node because of ironic" thing in the api | 15:00 |
bauzas | I just feel we're regressing with https://review.opendev.org/#/c/645520/35/nova/scheduler/host_manager.py | 15:00 |
mriedem | how? | 15:00 |
sean-k-mooney | oh and mriedem already said that above :) | 15:00 |
*** tbachman has quit IRC | 15:01 | |
*** lyarwood has quit IRC | 15:01 | |
*** kenperkins has joined #openstack-nova | 15:03 | |
kenperkins | can someone point me to where in the instance create codepath the password gets generated when not provided? | 15:03 |
*** awalende has quit IRC | 15:04 | |
sean-k-mooney | do we always generate one? | 15:04 |
sean-k-mooney | i assumed not | 15:04 |
kenperkins | if we don't where does it come from? | 15:05 |
bauzas | mriedem: actually, if we need to keep the same UX as it is now, nodename is optional | 15:05 |
kenperkins | maybe it's baked into the image? <thinking> | 15:05 |
sean-k-mooney | some images have it backed in yes | 15:05 |
sean-k-mooney | we may always generate one but i was not expecting us too | 15:05 |
artom | donnyd, so, just to be clear, http://project.fortnebula.com/ is your personal project with your personal hardware, and... you're the sole sysadmin for it? | 15:06 |
donnyd | yep | 15:07 |
kenperkins | sean-k-mooney https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/servers.py#L581 perhaps? | 15:07 |
kenperkins | then here i think https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/servers.py#L1206 | 15:07 |
artom | donnyd, I'm worried about gate resources with a 1 person bottleneck :) For your sanity as much as cloud stability | 15:08 |
donnyd | artom: I am also the sole funder, maintainer, electrician, and cooling engineer | 15:08 |
donnyd | LOL | 15:08 |
*** tbachman has joined #openstack-nova | 15:08 | |
sean-k-mooney | kenperkins: https://docs.openstack.org/nova/latest/configuration/config.html#libvirt.inject_password | 15:08 |
*** abhishekk has quit IRC | 15:08 | |
sean-k-mooney | kenperkins: by defualt we do not inject admin password in the vm wit libvirt | 15:09 |
artom | donnyd, the bus factor is *really* high with you :) | 15:09 |
kenperkins | where is the default libvirt config in code? :D | 15:09 |
donnyd | Well openstack isn't very hard, so maintenance is pretty low | 15:09 |
sean-k-mooney | and its a libvirt specific option so other virt dirvres proably dont do this | 15:09 |
sean-k-mooney | donnyd: artom just be aware that we cant have any voting jobs without at least 2 providers | 15:10 |
mriedem | bauzas: hypervisor_hostname *is* optional in the new microversion | 15:10 |
mriedem | as is host | 15:10 |
artom | donnyd, I'll trust you on that one - my experience has been with devstack mostly, and maintenance is definitely *not* low | 15:10 |
mriedem | same as it is with the zone:host:node hack | 15:10 |
mriedem | you can specify zone:host only, or zone::node only | 15:10 |
kenperkins | @sean-k-mooney thx for the pointer re: libvirt config | 15:10 |
mriedem | the *only* difference is in how the scheduler processes it | 15:10 |
bauzas | mriedem: yeah, that's what I just said | 15:10 |
artom | sean-k-mooney, yeah, that's fine, just having a thing in experimental that we can run as-needed is a great 1st step | 15:11 |
sean-k-mooney | kenperkins: https://github.com/openstack/nova/blob/master/nova/conf/libvirt.py#L139 it there but we should not change it | 15:11 |
sean-k-mooney | in code that is | 15:11 |
bauzas | force_hosts supports only host, and evacuate/livemigrate do support only host too | 15:11 |
sean-k-mooney | kenperkins: feel free to set it in you local config | 15:11 |
*** pcaruana has quit IRC | 15:11 | |
mriedem | bauzas: force_hosts is only *hosts* because we also have the force_nodes field | 15:11 |
mriedem | you can also just have force_nodes | 15:11 |
mriedem | b/c zone::node | 15:12 |
bauzas | yup, and https://github.com/openstack/nova/blob/master/nova/compute/api.py#L958 allows you to only check the HostMapping | 15:12 |
mriedem | i don't see what evacuate and live migrate really have to do with this, you can't force those anymore on the latest microversion | 15:12 |
*** _alastor1 has joined #openstack-nova | 15:12 | |
mriedem | and node doesn't really matter for those since migrations aren't supported for ironic anyway | 15:12 |
mriedem | evacuate might be, but who knows if it actually works | 15:12 |
kenperkins | wait, that contradicts a little bit sean-k-mooney; that link says that `False`: Allow the injection of an admin password for instance only at ``create`` and | 15:13 |
kenperkins | ``rebuild`` process. | 15:13 |
*** bbobrov has joined #openstack-nova | 15:13 | |
kenperkins | which reads like one value is only create/rebuild, the other is at any time | 15:13 |
*** shilpasd has quit IRC | 15:13 | |
bauzas | mriedem: well, we use the same internal object than livemig/evac https://review.opendev.org/#/c/645520/35/nova/compute/api.py@1056 | 15:13 |
mriedem | bauzas: yes i know | 15:13 |
mriedem | and cold migrate | 15:13 |
donnyd | artom: Just lmk if you need anything custom, or a space to play | 15:14 |
mriedem | and rebuild if we'd get https://review.opendev.org/#/c/650376/ in | 15:14 |
donnyd | just an FYI I can only offer ipv6 access publically | 15:14 |
sean-k-mooney | kenperkins: the docs say "False: Disallows the injection. Any via the REST API provided admin password will be silently ignored." | 15:14 |
artom | donnyd, flavors with 2 NUMA nodes. This implies nested virt. | 15:14 |
donnyd | I don't have a bunch of ipv4 address because they cost lots of the $$$ | 15:14 |
sean-k-mooney | kenperkins: https://github.com/openstack/nova/blob/master/nova/conf/libvirt.py#L158-L159 | 15:14 |
donnyd | I can work up anything needed | 15:15 |
*** ttsiouts has quit IRC | 15:15 | |
donnyd | This gear was for a big data project I was working on, so if its just going to sit there... might as well do something fun with it | 15:15 |
sean-k-mooney | donnyd: the power load form ci testing can be high | 15:16 |
*** ttsiouts has joined #openstack-nova | 15:16 | |
artom | donnyd, so, being blunt, is the gear availability "stable"? Or there's a chance that it'll get repurposed/offlined at some point in the future? | 15:16 |
artom | I realize we always have that doubt with any nodepool provider | 15:17 |
artom | But it seems it'll be higher with 1 dude than, say, Vexxhost | 15:17 |
artom | donnyd, don't get me wrong, I'm genuinely grateful that you're doing this, and frankly that no other company has stepped up before (including my own) | 15:17 |
artom | *and frankly angry | 15:18 |
donnyd | Well we started small at 10 instances, and from what I can measure (which is quite a lot) it seemed to me to be about 150W per 10 instances so about 1500W at scale | 15:18 |
donnyd | but we will go slow and test to see what is sustainable | 15:18 |
bauzas | mriedem: my only concern is that we don't replicate the same logic than in evac/rebuild/livemig and set the host field on the Destination object if not provided like in https://github.com/openstack/nova/blob/master/nova/compute/api.py#L4627 | 15:18 |
bauzas | that's why I can regression something like https://review.opendev.org/#/c/645520/35/nova/scheduler/host_manager.py | 15:18 |
mriedem | that happens in the scheduler | 15:19 |
sean-k-mooney | artom: well intel ran an nfv ci for 4 years | 15:19 |
sean-k-mooney | it should be comming back later this year | 15:19 |
mriedem | bauzas: see resources_from_request_spec | 15:19 |
artom | sean-k-mooney, past tense being the key word there ;) | 15:19 |
mriedem | https://review.opendev.org/#/c/645520/35/nova/scheduler/utils.py@528 | 15:19 |
donnyd | At some point in the future sure... but it will likely be when this gear is used up completely and no longer functional | 15:19 |
mriedem | bauzas: you haven't been around, but ^ handles that | 15:19 |
*** tbachman has quit IRC | 15:20 | |
bauzas | mriedem: thanks, just saw it | 15:20 |
*** tbachman has joined #openstack-nova | 15:20 | |
bauzas | okay, I'm all good then | 15:20 |
sean-k-mooney | well i left and it had already been outsouce + osic happend and the lab that hosted it got decomissioned so ya. | 15:20 |
*** BLZbubba has joined #openstack-nova | 15:21 | |
BLZbubba | hi guys, what is the proper way to switch the default nova acceleration from tcg to kvm? | 15:22 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: docs: Rewrite host aggregate, availability zone docs https://review.opendev.org/667133 | 15:22 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: tox: Keeping going with docs https://review.opendev.org/670332 | 15:22 |
sean-k-mooney | BLZbubba: set virt_type=kvm in the [libivrt] section in the nova.conf | 15:23 |
sean-k-mooney | then restart the compute agent | 15:23 |
sean-k-mooney | and hard reboot any vms on the host | 15:23 |
*** gyee has joined #openstack-nova | 15:23 | |
BLZbubba | thank you, i couldn't quite get the right google search terms to find that one | 15:24 |
donnyd | Well I am just happy I can help in whatever way I can... and it's both professionally and personally fun for me | 15:24 |
sean-k-mooney | BLZbubba: https://docs.openstack.org/nova/latest/configuration/config.html#libvirt.virt_type | 15:25 |
donnyd | LMK how I can help | 15:25 |
sean-k-mooney | BLZbubba: it should be defaulting to kvm by the way not the tcg backend | 15:27 |
*** udesale has quit IRC | 15:28 | |
*** mlavalle has joined #openstack-nova | 15:29 | |
*** takashin has left #openstack-nova | 15:30 | |
BLZbubba | sean-k-mooney: this is the centos el7 version, maybe they were going for compatibility out of the box or something; who knows. the config had virt_type=qemu | 15:32 |
Zara | hi! I'm trying to work out why user roles would affect speed of api calls; does anyone know where docs for that area would live? (I'm having this problem: https://ask.openstack.org/en/question/123025/nova-api-calls-slow-for-non-admin-users ; asked in #openstack but no responses, so this is my last hope :) ) | 15:34 |
sean-k-mooney | BLZbubba: its proably your installer not centos that changed it | 15:35 |
mriedem | stephenfin: i've dropped the -2s on the ec2 removal patches | 15:35 |
stephenfin | mriedem: Cheers | 15:35 |
sean-k-mooney | Zara: it proably resulting in addtional or more expencive calls to keystone to validate teh authtoken that is in the request has the correct roles | 15:36 |
*** dtantsur is now known as dtantsur|afk | 15:36 | |
openstackgerrit | Stephen Finucane proposed openstack/nova master: docs: Rewrite host aggregate, availability zone docs https://review.opendev.org/667133 | 15:36 |
*** mkrai__ has quit IRC | 15:39 | |
*** mkrai_ has quit IRC | 15:39 | |
*** kenperkins has quit IRC | 15:39 | |
stephenfin | bauzas: There's the AZ doc rework promised, if you care to bookmark for later https://review.opendev.org/#/c/667133/ | 15:40 |
bauzas | ack | 15:40 |
*** helenafm has quit IRC | 15:43 | |
*** maciejjozefczyk has quit IRC | 15:47 | |
Zara | sean-k-mooney: hm, it seems odd since keystone itself seems to work fast (the POST auth/tokens calls seem to be the same length; it's the GET /servers/detail that's slow for the different roles. I'd've thought the token posting would be slow. maybe a dodgy assumption) | 15:47 |
mriedem | listing servers is going to be slower for admins b/c the api returns more data | 15:51 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Convert nova-next to a zuul v3 job https://review.opendev.org/670196 | 15:51 |
mriedem | also depends on if you're using all_tenants filtering in the request | 15:51 |
stephenfin | gibi: Is my comment about docs here correct? https://review.opendev.org/#/c/657796/ | 15:52 |
sean-k-mooney | mriedem: well not jsut admins right. if you are uing custom roles to expose more data different roles could be slower depending on what is being returned for that role | 15:53 |
sean-k-mooney | but ya that is proably more likely the reason for the delta in performance | 15:53 |
mriedem | sean-k-mooney: of course | 15:54 |
Zara | it's the other way around, though; the member role is the slow one and the admin role is the fast one | 15:54 |
mriedem | sounds like it's time to do some profiling | 15:55 |
*** lpetrut has quit IRC | 15:56 | |
mriedem | tssurya: can't we have some functional test on https://review.opendev.org/#/c/645611/ ? | 15:57 |
*** pcaruana has joined #openstack-nova | 15:57 | |
mriedem | efried: don't we have some rules about removing things from a runway slot if they've been in merge conflict for over a week and the author is not responsive? | 15:58 |
mriedem | "The code author must be ready for quick iteration on the patch reviews and responding to review comments. The author will be consulted before moving the blueprint to a runway to make sure the next 2 weeks are suitable for quick iteration on the reviews. If the next 2 weeks are not suitable, the next blueprint in line will be tried and the deferred blueprint will maintain its place in line." | 15:59 |
efried | mriedem: if not, we should. | 15:59 |
mriedem | ok i'm going to remove the sev stuff | 15:59 |
tssurya | mriedem: hmm I guess we could, I'll add some using your fake driver suggestion | 15:59 |
efried | mriedem: I've poked aspiers a couple of times about the merge conflict, so yeah. | 15:59 |
efried | thanks | 15:59 |
sean-k-mooney | mriedem: i think in general if the authour is not responcive that is enough to kick it | 15:59 |
sean-k-mooney | assuming it has -1 form a core | 15:59 |
tssurya | and I guess I have to bump microversion | 16:00 |
sean-k-mooney | e.g. it need to be reworked but no active engagment form the owner | 16:00 |
*** belmoreira has quit IRC | 16:03 | |
*** francoisp has quit IRC | 16:04 | |
*** altlogbot_1 has joined #openstack-nova | 16:05 | |
*** francoisp has joined #openstack-nova | 16:06 | |
*** altlogbot_1 has quit IRC | 16:07 | |
*** jmlowe has quit IRC | 16:08 | |
*** ttsiouts has quit IRC | 16:14 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Convert nova-next to a zuul v3 job https://review.opendev.org/670196 | 16:15 |
*** tssurya has quit IRC | 16:18 | |
*** luksky11 has quit IRC | 16:19 | |
*** factor has quit IRC | 16:20 | |
*** rpittau is now known as rpittau|adk | 16:20 | |
*** rpittau|adk is now known as rpittau|afk | 16:20 | |
mriedem | artom: pro tip, if rebasing https://review.opendev.org/#/c/667177/ is not necessary, don't do it | 16:21 |
sean-k-mooney | mriedem: gerrit need a diff diff setting | 16:21 |
*** spatel has quit IRC | 16:22 | |
sean-k-mooney | e.g. generate teh diff for the old patch against old base + new patch against new base and display the diff of those two diff per file | 16:22 |
sean-k-mooney | aka the eye ball diff we currently do but automated | 16:23 |
*** ivve has quit IRC | 16:23 | |
melwitt | yeah, been wanting that to exist for years. does git-review support something like that locally? I keep forgetting | 16:24 |
sean-k-mooney | not that i know of but it could | 16:25 |
sean-k-mooney | a 4 way diff is not that uncommon a thing | 16:25 |
Zara | (thanks for the suggestions so far btw; I disappeared to stare at the output of `nova list --debug` :) ) | 16:26 |
dansmith | git review does have a thing | 16:27 |
artom | mriedem, I know, not sure what happened | 16:31 |
artom | I guess I was careless | 16:32 |
artom | I must have `git rebase -i` to edit that middle patch, and forgotten that I'd updated the remote? | 16:33 |
* artom relocates for a bit | 16:33 | |
mriedem | git review -R | 16:33 |
*** davidsha has quit IRC | 16:33 | |
artom | Aha, noted | 16:33 |
*** tesseract has quit IRC | 16:36 | |
*** artom has quit IRC | 16:38 | |
*** mlavalle has quit IRC | 16:40 | |
openstackgerrit | Dustin Cowles proposed openstack/nova master: Introduces SDK to IronicDriver and uses for node.get https://review.opendev.org/642899 | 16:42 |
openstackgerrit | Dustin Cowles proposed openstack/nova master: Use SDK instead of ironicclient for node.list https://review.opendev.org/656027 | 16:42 |
openstackgerrit | Dustin Cowles proposed openstack/nova master: Use SDK instead of ironicclient for validating instance and node https://review.opendev.org/656028 | 16:42 |
openstackgerrit | Dustin Cowles proposed openstack/nova master: Use SDK instead of ironicclient for setting instance id https://review.opendev.org/659690 | 16:42 |
openstackgerrit | Dustin Cowles proposed openstack/nova master: Use SDK instead of ironicclient for add/remove instance info from node https://review.opendev.org/659691 | 16:42 |
openstackgerrit | Dustin Cowles proposed openstack/nova master: Use SDK instead of ironicclient for getting network metadata from node https://review.opendev.org/670213 | 16:42 |
*** altlogbot_3 has joined #openstack-nova | 16:45 | |
efried | mriedem: artom: or in .gitconfig, so you don't have to remember -R each time: | 16:45 |
efried | [gitreview] | 16:45 |
efried | rebase = false | 16:45 |
melwitt | mriedem: do you know if the add/remove security group to/from instance API is a candidate for deprecation? was just looking at this abandoned patch after noticing the bug in launchpad https://review.opendev.org/535510 | 16:46 |
mriedem | efried: i don't personally want it in config since i make the decision each time | 16:46 |
mriedem | melwitt: i want to say it wasn't in https://specs.openstack.org/openstack/nova-specs/specs/newton/implemented/deprecate-api-proxies.html because it's an operation on the server which is not deprecated | 16:48 |
mriedem | even if it's a proxy to neutron | 16:48 |
mriedem | but we're not very consistent about that b/c the floating IP things in https://specs.openstack.org/openstack/nova-specs/specs/pike/implemented/deprecate-multinic-proxy-api.html are similar | 16:49 |
*** altlogbot_3 has quit IRC | 16:49 | |
melwitt | mriedem: yeah, was thinking similar. at first I was comparing to attach interface but that's different bc you can't do that without nova. whereas it looks like you could do the add/remove secgroup to port without nova | 16:49 |
mriedem | addFloatingIP and removeFloatingIP would be in the same group as add/removeSecurityGroup on a server | 16:49 |
melwitt | ok, yeah. just wanted to ask bc the patch was abandoned on that basis (the potential for deprecation). otherwise, someone said they had tested the patch and it worked to fix the concurrent update problem | 16:51 |
*** psachin has quit IRC | 16:52 | |
*** hemna has quit IRC | 17:04 | |
*** d34dh0r53 has quit IRC | 17:05 | |
*** artom has joined #openstack-nova | 17:10 | |
*** weshay is now known as weshay|rover | 17:12 | |
*** ralonsoh has quit IRC | 17:17 | |
*** factor has joined #openstack-nova | 17:23 | |
*** altlogbot_2 has joined #openstack-nova | 17:23 | |
*** altlogbot_2 has quit IRC | 17:25 | |
*** hemna has joined #openstack-nova | 17:28 | |
*** lbragstad has quit IRC | 17:30 | |
*** fhalbach is now known as aram1s | 17:30 | |
*** altlogbot_3 has joined #openstack-nova | 17:31 | |
*** jmlowe has joined #openstack-nova | 17:34 | |
*** altlogbot_3 has quit IRC | 17:35 | |
*** altlogbot_2 has joined #openstack-nova | 17:37 | |
*** tbachman has quit IRC | 17:39 | |
*** tbachman has joined #openstack-nova | 17:40 | |
*** altlogbot_2 has quit IRC | 17:41 | |
*** d34dh0r53 has joined #openstack-nova | 17:42 | |
*** altlogbot_0 has joined #openstack-nova | 17:43 | |
*** altlogbot_0 has quit IRC | 17:45 | |
*** tbachman has quit IRC | 17:46 | |
*** tbachman has joined #openstack-nova | 17:48 | |
*** hemna has quit IRC | 17:53 | |
*** artom has quit IRC | 17:57 | |
mriedem | efried: i'm +2 on gibi's big heal_allocations change now https://review.opendev.org/#/c/637955/35 | 18:04 |
efried | oh goodie | 18:05 |
mriedem | i'm sure you can just rubber stamp it with no effort | 18:05 |
efried | I'm sure | 18:05 |
efried | been waiting for you to quit hammering at it before looking again | 18:05 |
efried | I'm sure it's nigh unrecognizable now. | 18:05 |
mriedem | not since you last looked on | 18:05 |
mriedem | *no | 18:05 |
mriedem | more tests, | 18:06 |
mriedem | and the rollback stuff was changed | 18:06 |
mriedem | he first tries to update ports before allocations and if the port updates fail or allocation update fails the port updates are rolled back | 18:06 |
efried | okay, all of that sounds familiar. | 18:07 |
efried | I'll hit it now. | 18:07 |
*** hemna has joined #openstack-nova | 18:08 | |
*** ociuhandu has joined #openstack-nova | 18:10 | |
*** hemna has quit IRC | 18:14 | |
*** hemna has joined #openstack-nova | 18:16 | |
mriedem | i'm working on a fup patch for my nits | 18:18 |
*** hemna has quit IRC | 18:20 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Follow up for "nova-manage: heal port allocations" https://review.opendev.org/670361 | 18:21 |
*** tbachman has quit IRC | 18:26 | |
*** tbachman has joined #openstack-nova | 18:28 | |
openstackgerrit | Merged openstack/nova master: Add host and hypervisor_hostname flag to create server https://review.opendev.org/645520 | 18:35 |
*** ociuhandu has quit IRC | 18:42 | |
*** luksky11 has joined #openstack-nova | 18:44 | |
*** bnemec has quit IRC | 18:45 | |
*** cdent has joined #openstack-nova | 18:46 | |
*** bnemec has joined #openstack-nova | 18:47 | |
*** derekh has quit IRC | 19:05 | |
*** artom has joined #openstack-nova | 19:13 | |
*** lbragstad has joined #openstack-nova | 19:21 | |
*** irclogbot_0 has joined #openstack-nova | 19:29 | |
*** irclogbot_0 has quit IRC | 19:33 | |
*** bnemec has quit IRC | 19:38 | |
*** altlogbot_3 has joined #openstack-nova | 19:39 | |
*** hemna has joined #openstack-nova | 19:39 | |
*** altlogbot_3 has quit IRC | 19:41 | |
*** jistr has quit IRC | 19:43 | |
*** jistr has joined #openstack-nova | 19:45 | |
*** bnemec has joined #openstack-nova | 19:46 | |
efried | mriedem: gonna need your help understanding a thing here... | 19:50 |
efried | neutron.update_port(uuid, body=body) | 19:51 |
efried | is this a patch-style update or a replace? | 19:51 |
efried | i.e. does it only change the fields that are present in the body? | 19:51 |
mriedem | artom: sean-k-mooney: dansmith: https://review.opendev.org/#/c/667177/10 | 20:01 |
mriedem | efried: replace | 20:01 |
artom | zomgies | 20:02 |
mriedem | efried: are you worried about overwriting something in the binding profile during the rollback from the time we originally got the port? | 20:02 |
efried | mriedem: Actually I'm worried about blowing away the whole content of the port *except* the binding:profile['allocation'] when we're trying to set that guy. | 20:02 |
mriedem | efried: wait, | 20:03 |
mriedem | efried: link me to the line | 20:03 |
efried | mriedem: yes, sec. | 20:03 |
mriedem | but we do port binding updates like this in the neutronv2/api code as well | 20:03 |
*** jistr has quit IRC | 20:03 | |
efried | mriedem: https://review.opendev.org/#/c/637955/35/nova/cmd/manage.py@1896 and continuation https://review.opendev.org/#/c/637955/35/nova/cmd/manage.py@1926 | 20:04 |
*** jistr has joined #openstack-nova | 20:05 | |
melwitt | I didn't think it's like placement where anything not in the payload will get "erased" like a replace | 20:05 |
efried | well, there's a bug somewhere then. Because either we blow away everything but the allocation on the initial pass, or we do nothing on the rollback. | 20:05 |
efried | but mriedem yes indeed, I see port updates in neutronv2/api.py which are similar in spirit. | 20:06 |
melwitt | https://developer.openstack.org/api-ref/network/v2/?expanded=update-port-detail#update-port | 20:07 |
efried | melwitt: I read that; are you seeing something in there that implies "partial update"? | 20:08 |
efried | (I admit I didn't scrutinize it) | 20:08 |
mriedem | efried: agree that https://review.opendev.org/#/c/637955/35/nova/cmd/manage.py@1896 looks like trouble | 20:08 |
mriedem | https://developer.openstack.org/api-ref/network/v2/index.html?expanded=update-port-detail#revisions | 20:08 |
mriedem | neutron does have revisions and an If-Match header | 20:08 |
mriedem | like generations in placement and etags | 20:09 |
mriedem | anyway, that's more about what i thought you were going to bring up | 20:09 |
efried | I guess I would sort of hope you're not effing out of band with whatever ports you're trying to heal | 20:10 |
efried | but yeah, it would be nice to handle generations too. | 20:10 |
mriedem | looking at where this is used https://github.com/openstack/nova/blob/ff0feed25d56c8ccd2298d5b5b82e636880fa986/nova/network/neutronv2/api.py#L92 | 20:11 |
mriedem | it looks like we only ever modify the full binding:profile and then send back our updates | 20:11 |
mriedem | not just pieces of it | 20:11 |
efried | so like, update_port knows to replace the thing for the top-level key you're sending, but doesn't go deeper? | 20:12 |
mriedem | i would assume that the neutron API takes the value for whatever key in the PUT /ports/{port_id} request and replaces the value, not parts of the value | 20:12 |
efried | in which case the second one (rollback) is fine, but the first one is broken? | 20:12 |
mriedem | it would assume so | 20:12 |
*** irclogbot_2 has joined #openstack-nova | 20:13 | |
efried | "whatever key in the PUT request" -- the key that's in there is 'port'. | 20:13 |
efried | you mean the one under 'port'? | 20:13 |
mriedem | yes | 20:13 |
efried | okay | 20:13 |
mriedem | keys in the port resource body | 20:13 |
efried | okay, so the first one is borked. I shall -1 accordingly. Thanks. | 20:14 |
*** irclogbot_2 has quit IRC | 20:16 | |
cdent | all this fiddling suggests some kind of heal integration test would be a nice thing | 20:21 |
cdent | if one could be conceived | 20:21 |
efried | I think mriedem wrote one recently. Though I sort of doubt it went anywhere near this deep. | 20:22 |
mriedem | gibi has a patch for that eventually | 20:22 |
mriedem | fiddle me timbers | 20:22 |
efried | cdent: https://review.opendev.org/#/c/667994/ | 20:22 |
mriedem | https://review.opendev.org/#/c/669879/ | 20:22 |
mriedem | drats | 20:22 |
efried | different patches | 20:23 |
mriedem | oh right, gibi's builds on mine | 20:23 |
cdent | yeah, the depth is apparently not quite depthy? | 20:23 |
efried | cdent: look at gibi's followon, it does a little better | 20:24 |
mriedem | i didn't dig into his actual test changes | 20:24 |
mriedem | if i can get https://review.opendev.org/#/c/670196/ then eventually we could break apart the post_test_hook mega script into a smaller series of exercises | 20:24 |
mriedem | so it's more manageable | 20:24 |
cdent | that would be nice | 20:25 |
cdent | gibi's follow does look like an improvement. | 20:25 |
efried | good call cdent. I've commented accordingly in gibi's patch. | 20:26 |
* cdent isn't sure what he called | 20:26 | |
cdent | i've been on the hook this week for a bunch of internal bug handling, and omg, i can't even | 20:27 |
cdent | everything is horrible, everywhere | 20:27 |
cdent | i had a nice afternoon fishing, though | 20:27 |
efried | like, fishing in the water for fish? | 20:27 |
efried | or something job-related that's virtually like fishing? | 20:28 |
efried | (i.e. excruciatingly boring and unrewarding) | 20:28 |
cdent | https://tank-binaries.s3.amazonaws.com/08e47f8678ed462d95e5a273d927c77a.jpe | 20:30 |
cdent | sister's sister's family down for the week, invited for some deep sea fishing | 20:30 |
cdent | that was my dinner | 20:30 |
*** dklyle has joined #openstack-nova | 20:31 | |
*** pcaruana has quit IRC | 20:31 | |
*** igordc has joined #openstack-nova | 20:32 | |
melwitt | efried: sorry, I missed your earlier message bc I guess my znc server disconnected.. I was referring to the wording like, "replaces the fixed_ip attribute when you specify it in the request body" which I took to mean it will replace fixed_ip if you specify it in the body but will not erase the fixed_ip if the field is not specified in the request body | 20:34 |
*** BjoernT_ has quit IRC | 20:39 | |
*** whoami-rajat has quit IRC | 20:48 | |
openstackgerrit | Eric Fried proposed openstack/os-resource-classes master: Propose FPGA and PGPU resource classes https://review.opendev.org/657464 | 20:56 |
*** hamzy has quit IRC | 20:56 | |
*** eharney has quit IRC | 20:57 | |
efried | melwitt: okay, cool, thanks for pointing that out. | 21:01 |
*** altlogbot_2 has joined #openstack-nova | 21:01 | |
efried | ...though that makes it by no means obvious that similar behavior applies to the whole API. | 21:02 |
melwitt | yeah, I find the doc not comprehensive. was just guessing based on those bits | 21:03 |
melwitt | also, I'm not advocating guessing. was just thinking aloud | 21:03 |
*** xek has quit IRC | 21:04 | |
efried | Ima open a doc bug for that | 21:04 |
efried | I just skimmed the front matter too, and there doesn't appear to be anything there. | 21:05 |
*** altlogbot_2 has quit IRC | 21:05 | |
openstackgerrit | Dustin Cowles proposed openstack/nova master: Introduces SDK to IronicDriver and uses for node.get https://review.opendev.org/642899 | 21:07 |
openstackgerrit | Dustin Cowles proposed openstack/nova master: Use SDK instead of ironicclient for node.list https://review.opendev.org/656027 | 21:07 |
openstackgerrit | Dustin Cowles proposed openstack/nova master: Use SDK instead of ironicclient for validating instance and node https://review.opendev.org/656028 | 21:07 |
openstackgerrit | Dustin Cowles proposed openstack/nova master: Use SDK instead of ironicclient for setting instance id https://review.opendev.org/659690 | 21:07 |
openstackgerrit | Dustin Cowles proposed openstack/nova master: Use SDK instead of ironicclient for add/remove instance info from node https://review.opendev.org/659691 | 21:07 |
openstackgerrit | Dustin Cowles proposed openstack/nova master: Use SDK instead of ironicclient for getting network metadata from node https://review.opendev.org/670213 | 21:07 |
*** dklyle has quit IRC | 21:10 | |
*** _erlon_ has quit IRC | 21:12 | |
*** derekh has joined #openstack-nova | 21:13 | |
*** derekh has quit IRC | 21:13 | |
*** hongbin has quit IRC | 21:16 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add functional test for resize crash compute restart revert https://review.opendev.org/670393 | 21:18 |
mriedem | artom: sean-k-mooney: ^ weee | 21:18 |
efried | melwitt, mriedem, cdent: FYI https://bugs.launchpad.net/neutron/+bug/1836263 | 21:23 |
openstack | Launchpad bug 1836263 in neutron "doc: PUT /ports/{port_id} updates selectively" [Undecided,New] | 21:23 |
*** irclogbot_2 has joined #openstack-nova | 21:23 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Convert nova-next to a zuul v3 job https://review.opendev.org/670196 | 21:24 |
* cdent leaves a totally useless comment for no other reason than truculence | 21:24 | |
*** irclogbot_2 has quit IRC | 21:26 | |
* mriedem mows | 21:26 | |
*** mriedem has quit IRC | 21:26 | |
cdent | I read that as mowes, as in I'm gonna mowe some tasty chicken | 21:27 |
*** mlavalle has joined #openstack-nova | 21:29 | |
*** irclogbot_0 has joined #openstack-nova | 21:29 | |
*** irclogbot_0 has quit IRC | 21:32 | |
*** cdent has quit IRC | 21:34 | |
*** takashin has joined #openstack-nova | 21:47 | |
*** tbachman has quit IRC | 21:50 | |
*** tbachman has joined #openstack-nova | 22:06 | |
*** hamzy has joined #openstack-nova | 22:07 | |
*** altlogbot_3 has joined #openstack-nova | 22:19 | |
*** irclogbot_3 has joined #openstack-nova | 22:19 | |
*** tbachman has quit IRC | 22:20 | |
*** altlogbot_3 has quit IRC | 22:23 | |
*** irclogbot_3 has quit IRC | 22:24 | |
*** betherly has joined #openstack-nova | 22:29 | |
*** betherly has quit IRC | 22:34 | |
*** luksky11 has quit IRC | 22:37 | |
*** tkajinam has joined #openstack-nova | 22:52 | |
*** lbragstad has quit IRC | 22:52 | |
*** slaweq has quit IRC | 22:56 | |
*** altlogbot_1 has joined #openstack-nova | 22:57 | |
*** altlogbot_1 has quit IRC | 22:59 | |
*** irclogbot_2 has joined #openstack-nova | 23:01 | |
*** mlavalle has quit IRC | 23:03 | |
*** _mlavalle_2 has joined #openstack-nova | 23:04 | |
*** irclogbot_2 has quit IRC | 23:06 | |
*** slaweq has joined #openstack-nova | 23:08 | |
*** irclogbot_2 has joined #openstack-nova | 23:09 | |
*** slaweq has quit IRC | 23:12 | |
*** rcernin has joined #openstack-nova | 23:13 | |
*** irclogbot_2 has quit IRC | 23:16 | |
*** betherly has joined #openstack-nova | 23:23 | |
*** betherly has quit IRC | 23:28 | |
*** _mlavalle_2 has quit IRC | 23:37 | |
*** betherly has joined #openstack-nova | 23:44 | |
*** betherly has quit IRC | 23:49 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!