Monday, 2018-12-17

*** slaweq has joined #openstack-nova00:11
*** slaweq has quit IRC00:15
*** ivve has quit IRC00:23
*** wolverineav has joined #openstack-nova00:29
*** tetsuro has joined #openstack-nova00:30
*** tetsuro has quit IRC00:32
*** tetsuro_ has joined #openstack-nova00:32
*** wolverineav has quit IRC00:33
*** ivve has joined #openstack-nova00:35
openstackgerritMerged openstack/nova master: Remove the final user of utils.execute() from virt.images  https://review.openstack.org/62000700:39
*** brinzhang has joined #openstack-nova00:40
*** tetsuro_ has quit IRC00:40
*** tetsuro has joined #openstack-nova00:53
openstackgerritTakashi NATSUME proposed openstack/nova master: Follow up for "Add API ref guideline for body text"  https://review.openstack.org/62545401:05
*** tiendc has joined #openstack-nova01:33
*** bhagyashris has joined #openstack-nova01:34
openstackgerritTakashi NATSUME proposed openstack/os-resource-classes master: Update author-email in setup.cfg  https://review.openstack.org/62488501:38
*** wolverineav has joined #openstack-nova01:48
*** Dinesh_Bhor has joined #openstack-nova01:52
openstackgerrityuanliu proposed openstack/nova master: bug fix:when ironic instance's vm_state is error, the instance can not be rebuided  https://review.openstack.org/62545801:56
*** oanson has quit IRC01:59
*** dave-mccowan has joined #openstack-nova02:08
*** Dinesh_Bhor has quit IRC02:10
*** slaweq has joined #openstack-nova02:11
*** hongbin has joined #openstack-nova02:11
*** slaweq has quit IRC02:16
*** wolverineav has quit IRC02:18
*** Dinesh_Bhor has joined #openstack-nova02:21
*** mhen has quit IRC02:24
*** wolverineav has joined #openstack-nova02:25
*** wolverineav has quit IRC02:25
*** mhen has joined #openstack-nova02:25
*** wolverineav has joined #openstack-nova02:25
*** hongbin has quit IRC02:28
*** dave-mccowan has quit IRC02:47
*** hongbin has joined #openstack-nova02:50
*** psachin has joined #openstack-nova02:59
*** mschuppert has joined #openstack-nova02:59
*** mrsoul has quit IRC03:02
*** dklyle has joined #openstack-nova03:20
*** lbragstad has joined #openstack-nova03:26
*** tetsuro has quit IRC03:30
*** udesale has joined #openstack-nova03:49
*** Dinesh_Bhor has quit IRC03:51
*** Dinesh_Bhor has joined #openstack-nova03:52
*** itlinux has quit IRC03:59
*** slaweq has joined #openstack-nova04:11
*** slaweq has quit IRC04:16
*** sridharg has joined #openstack-nova04:21
*** tetsuro has joined #openstack-nova04:25
*** itlinux has joined #openstack-nova04:29
*** itlinux has quit IRC04:30
*** hongbin has quit IRC04:37
*** ratailor has joined #openstack-nova04:48
*** ShilpaSD has joined #openstack-nova04:53
openstackgerritTakashi NATSUME proposed openstack/nova master: Fix broken links in pci-passthrough doc  https://review.openstack.org/62548104:55
*** bhagyashris has quit IRC05:02
*** brault has quit IRC05:06
*** dklyle has quit IRC05:16
*** wolverineav has quit IRC05:24
*** wolverineav has joined #openstack-nova05:25
*** itlinux has joined #openstack-nova05:32
*** wolverineav has quit IRC05:35
*** janki has joined #openstack-nova05:36
*** tetsuro has quit IRC05:36
*** rcernin has joined #openstack-nova05:46
*** markvoelker has joined #openstack-nova05:47
*** rcernin has quit IRC05:47
*** markvoelker has quit IRC05:51
openstackgerritTakashi NATSUME proposed openstack/nova master: Fix the link to the Placement API Version History  https://review.openstack.org/62548606:04
*** Dinesh_Bhor has quit IRC06:06
*** rcernin has joined #openstack-nova06:09
*** rcernin has quit IRC06:09
*** rcernin has joined #openstack-nova06:09
*** rcernin has quit IRC06:09
*** slaweq has joined #openstack-nova06:11
*** slaweq has quit IRC06:16
*** bhagyashris has joined #openstack-nova06:17
*** threestrands has quit IRC06:21
*** pooja_jadhav has joined #openstack-nova06:23
*** wolverineav has joined #openstack-nova06:35
*** wolverineav has quit IRC06:40
*** poojajadhav has joined #openstack-nova06:40
*** Dinesh_Bhor has joined #openstack-nova06:41
*** bhagyashris has quit IRC06:43
*** pooja_jadhav has quit IRC06:43
openstackgerritTakashi NATSUME proposed openstack/nova master: api-ref: Add descriptions for vol-backed snapshots  https://review.openstack.org/61508406:51
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in libvirt/test_driver.py (7)  https://review.openstack.org/57199206:51
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in libvirt/test_driver.py (8)  https://review.openstack.org/57199306:52
openstackgerritTakashi NATSUME proposed openstack/nova stable/queens: Add description of custom resource classes  https://review.openstack.org/61912506:52
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in virt/test_block_device.py  https://review.openstack.org/56615306:52
openstackgerritTakashi NATSUME proposed openstack/nova master: Use oslo_db.sqlalchemy.test_fixtures  https://review.openstack.org/60935206:53
*** tetsuro has joined #openstack-nova06:53
openstackgerritTakashi NATSUME proposed openstack/nova master: Fix best_match() deprecation warning  https://review.openstack.org/61120406:53
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (3)  https://review.openstack.org/57410406:53
*** itlinux has quit IRC07:09
*** Luzi has joined #openstack-nova07:23
*** itlinux has joined #openstack-nova07:24
*** dpawlik has joined #openstack-nova07:26
*** Dinesh_Bhor has quit IRC07:29
*** tetsuro has quit IRC07:33
*** oanson has joined #openstack-nova07:34
*** Dinesh_Bhor has joined #openstack-nova07:35
*** slaweq has joined #openstack-nova07:37
*** slaweq has quit IRC07:40
*** slaweq has joined #openstack-nova07:44
*** markvoelker has joined #openstack-nova07:48
*** rodolof has joined #openstack-nova07:55
*** Dinesh_Bhor has quit IRC07:57
*** helenafm has joined #openstack-nova08:06
*** pcaruana has joined #openstack-nova08:18
*** izza_ has joined #openstack-nova08:19
izza_hi guys,,,08:19
izza_can you please help us on openstack helm rocky08:19
izza_encounetered issue : {2} tempest.api.identity.admin.v3.test_list_users.UsersV3TestJSON.test_list_users [0.110978s] ... FAILED08:26
izza_in single node openstack helm08:26
*** kashyap has quit IRC08:30
*** sahid has joined #openstack-nova08:30
*** takashin has left #openstack-nova08:31
*** ralonsoh has joined #openstack-nova08:37
*** bhagyashris has joined #openstack-nova08:41
*** ccamacho has quit IRC08:42
*** yan0s has joined #openstack-nova08:44
*** alexchadin has joined #openstack-nova08:46
*** gibi has joined #openstack-nova08:52
*** lpetrut has joined #openstack-nova09:09
*** k_mouza has joined #openstack-nova09:12
*** poojajadhav has quit IRC09:14
*** pjjadhav has joined #openstack-nova09:14
*** Dinesh_Bhor has joined #openstack-nova09:17
*** owalsh_ is now known as owalsh09:24
*** k_mouza has quit IRC09:27
*** k_mouza has joined #openstack-nova09:28
*** ccamacho has joined #openstack-nova09:31
*** ttsiouts has joined #openstack-nova09:34
gmannizza_: you can ping this on openstack-qa channel. i can help you on failure09:46
*** izza_ has quit IRC09:50
*** rtjure has quit IRC09:52
*** Dinesh_Bhor has quit IRC09:56
*** derekh has joined #openstack-nova09:58
*** maciejjozefczyk has quit IRC10:01
*** maciejjozefczyk has joined #openstack-nova10:03
*** bhagyashris has quit IRC10:04
*** lbragstad has quit IRC10:10
*** xek has joined #openstack-nova10:16
*** jarodwl has quit IRC10:20
*** yan0s has quit IRC10:30
*** derekh has quit IRC10:46
*** derekh has joined #openstack-nova10:47
*** k_mouza_ has joined #openstack-nova10:49
*** yan0s has joined #openstack-nova10:50
*** k_mouza has quit IRC10:51
openstackgerritMerged openstack/nova master: Replace ThreadPoolExecutor with GreenThreadPoolExecutor  https://review.openstack.org/62474011:07
*** cdent has joined #openstack-nova11:07
*** udesale has quit IRC11:10
*** pjjadhav has quit IRC11:26
*** jaypipes has joined #openstack-nova11:33
*** tiendc has quit IRC11:45
*** rtjure has joined #openstack-nova11:53
*** helenafm has quit IRC11:57
*** brinzhang has quit IRC12:15
*** diga has joined #openstack-nova12:20
*** maciejjozefczyk has quit IRC12:24
*** maciejjozefczyk has joined #openstack-nova12:26
*** maciejjozefczyk has quit IRC12:30
*** janki has quit IRC12:31
*** udesale has joined #openstack-nova12:39
*** ratailor has quit IRC12:45
*** rodolof has quit IRC12:47
*** rodolof has joined #openstack-nova12:47
*** lpetrut has quit IRC12:51
*** janki has joined #openstack-nova12:59
*** maciejjozefczyk has joined #openstack-nova12:59
*** markvoelker has quit IRC13:05
*** maciejjozefczyk has joined #openstack-nova13:09
*** Bhujay has joined #openstack-nova13:15
openstackgerritLee Yarwood proposed openstack/nova master: compute: Reject migration requests when source is down  https://review.openstack.org/62348913:16
*** sapd1__ has joined #openstack-nova13:17
*** helenafm has joined #openstack-nova13:22
*** dave-mccowan has joined #openstack-nova13:24
*** alexchadin has quit IRC13:24
*** k_mouza has joined #openstack-nova13:26
openstackgerritChris Dent proposed openstack/nova master: Correct lower-constraints.txt and the related tox job  https://review.openstack.org/62297213:27
*** k_mouza_ has quit IRC13:29
*** Bhujay has quit IRC13:33
lyarwoodcoreycb: https://review.openstack.org/#/c/579004/ - are you working on this btw? I have some time today to address the comments otherwise.13:38
coreycblyarwood: I'm not actively working on it. seyeongkim had taken it over for me. he appears to not be in here.13:40
*** cfriesen has joined #openstack-nova13:41
lyarwoodcoreycb: ack np, I'll respin now in that case.13:41
coreycblyarwood: i asked him to join. i think we'd both not be opposed to your help :)13:42
coreycblyarwood: thanks13:42
*** dave-mccowan has quit IRC13:42
*** seyeongkim has joined #openstack-nova13:45
stephenfinmelwitt: Think this is something you could look at, when you're about? https://review.openstack.org/#/c/611088/13:45
*** mvkr has quit IRC13:46
*** pcaruana has quit IRC13:50
cdentscheduler/placement meeting in #openstack-meeting-alt in 5 minutes if people want one13:54
*** lbragstad has joined #openstack-nova13:58
*** lbragstad has quit IRC13:59
*** ttsiouts has quit IRC14:00
*** ttsiouts has joined #openstack-nova14:00
*** takashin has joined #openstack-nova14:01
mgariepyanyone is aware of an issue with pci passthrough i created the vms  with pike and upgraded the cluster to queens, when i restart the vms i loose all the pci devices. the instances boot without them.14:02
*** spatel has joined #openstack-nova14:03
spatelsean-k-mooney: morning14:03
*** ttsiouts has quit IRC14:04
*** ttsiouts has joined #openstack-nova14:04
spatelsean-k-mooney: any input here?  https://bugs.launchpad.net/nova/+bug/180873814:04
openstackLaunchpad bug 1808738 in OpenStack Compute (nova) "No net device was found for VF" [Undecided,New]14:04
*** lbragstad has joined #openstack-nova14:04
*** pcaruana has joined #openstack-nova14:05
*** dave-mccowan has joined #openstack-nova14:06
*** mriedem has joined #openstack-nova14:08
*** takashin has left #openstack-nova14:08
*** maciejjozefczyk has joined #openstack-nova14:09
sean-k-mooneyright so basically i think that happens if your VF is bound to vfio-pci14:09
sean-k-mooneyspatel: ^14:09
spatelhmm! how do i check that?14:10
spatelsean-k-mooney: ^14:10
sean-k-mooneyas a result there is not netdev created for the VF and you get that warning14:10
sean-k-mooneyyou coudl check in sysfs what driver one of the vfs e.g. 03:09.4  is boudn too14:10
spatellet me check14:11
*** dave-mccowan has quit IRC14:11
*** mchlumsky has joined #openstack-nova14:11
spatel /sys/bus/pci/devices/0000\:03\:09.4/  which dir i should check here for that?14:12
spatelI think this one? cat /sys/bus/pci/devices/0000\:03\:09.4/driver/bind14:13
sean-k-mooneyls -al /sys/devices/pci0000\:00/0000\:03\:09.4/14:13
sean-k-mooneythe driver director should be a symlink14:13
sean-k-mooneyit will look something like this driver -> ../../../bus/pci/drivers/e1000e14:14
spateloh! yes its  /sys/bus/pci/devices/0000:03:09.4/driver -> ../../../../bus/pci/drivers/vfio-pci14:14
sean-k-mooneyif you checked ls -al /sys/devices/pci0000\:00/0000\:03\:09.4/net it either would not exist or be empty is my guess14:15
sean-k-mooneyso ya the warning is expected14:15
spatelyes /sys/bus/pci/devices/0000:03:09.4/net: No such file or directory14:16
*** psachin has quit IRC14:17
sean-k-mooneyright so the PF has virtual functions that are bount to vfio-pci which does not create netdevs for the VFs14:17
spatelhmm!14:18
spatelso no way we reduce that logging except filter in syslog right?14:18
spatelits just filling my disk with that warning :)14:18
sean-k-mooneyyou can filter in nova14:18
spatelhow?14:18
sean-k-mooneyill get the config option one sec14:19
sean-k-mooneyhttps://docs.openstack.org/nova/latest/configuration/config.html#DEFAULT.default_log_levels14:20
spatelreading...14:20
*** moshele has joined #openstack-nova14:20
sean-k-mooneyyou should be able to add nova.pci.utils=ERROR14:21
spatelwow! that would be amazing :)14:21
spateli didn't know you can filter log by nova applicatoon14:21
sean-k-mooneynot you will have to set all the default too14:21
spatelapplication*14:21
sean-k-mooney*note14:21
*** mmethot has joined #openstack-nova14:22
sean-k-mooneywe use pythongs loggin framework so you can filter logs by module14:22
spatelso i have to set all default list in nova.conf including nova.pci.utils=ERROR  right?14:22
*** mvkr has joined #openstack-nova14:22
sean-k-mooneyi think so that said i have never tried to limit logs from nova its self but i think that will work14:23
spateli will give it a try on lab :)14:23
spatelthanks for the tip :)14:23
spatelsean-k-mooney: check this out https://bugs.launchpad.net/horizon/+bug/180725114:24
openstackLaunchpad bug 1807251 in OpenStack Dashboard (Horizon) "Horizon Overview summary showing wrong numbers " [Undecided,Incomplete]14:24
*** k_mouza_ has joined #openstack-nova14:26
spatelsean-k-mooney: you can close this issue with your comments https://bugs.launchpad.net/nova/+bug/180873814:26
openstackLaunchpad bug 1808738 in OpenStack Compute (nova) "No net device was found for VF" [Undecided,New]14:26
openstackgerritJack Ding proposed openstack/nova master: Improve libvirt image and snapshot handling  https://review.openstack.org/61669214:27
sean-k-mooneyim triaging it currently as low as the wraning is noisy as you said and does not explain why it happens.14:28
sean-k-mooneybut it can fill your disk which is annoying.14:28
*** k_mouza has quit IRC14:29
spatelsean-k-mooney: it would be good if adjust code to understand behavior and don't sent WARNING14:29
openstackgerritJack Ding proposed openstack/nova master: Correct instance port binding for rebuilds/reboots  https://review.openstack.org/60384414:29
sean-k-mooneyspatel: i was thinking of bumping it down to debug14:31
sean-k-mooneyspatel: ther freatre that need the netdev to exist but none that are critical14:31
sean-k-mooneythe main one being nic feature based schduling which is only half implemnted14:32
sean-k-mooneyso its not very usfull currently since it does not work14:32
sean-k-mooneyyou may also be unable to use vnic_type=macvtap14:33
mriedemgibi: we have a runways queue spot open https://etherpad.openstack.org/p/nova-runways-stein but i'm not sure if we should put your 2nd mention of https://blueprints.launchpad.net/nova/+spec/bandwidth-resource-provider in there or just assume it will be covered by the existing entry?14:37
mriedemthey are all in a series so i'm not sure why you had that in the etherpad twice14:37
*** spatel has quit IRC14:45
*** Luzi has quit IRC14:46
*** pjjadhav has joined #openstack-nova14:49
lyarwoodmriedem: https://review.openstack.org/#/c/579004/6/nova/virt/block_device.py - I'm trying to follow up on your comments here, quick question if you have a second. In the case where the BDM doesn't have an attachment_id can we just create one or do we still need to use the v2 APIs?14:49
lyarwoodcinderv2 is deprecated but I'm not sure if the intention here was to always assume that we had access to cinderv3 when updating the connection_info here or not.14:50
mriedemcinder v3.0 is backward compatible with v2 apis14:50
mriedemso if we have a legacy attachment (no attachment_id in the bdm) we can use the old initialize_connection flow14:51
*** mlavalle has joined #openstack-nova14:51
mriedemconverting legacy attachments to "new style" attachments in refresh_connection_info is an interesting thought,14:52
mriedembut since this is something that needs to be backported, i would avoid that in this change14:52
mriedemwe definitely do need to get code in to start migrating the old style attachments ( https://review.openstack.org/#/c/541420/ https://review.openstack.org/#/c/549130/ )14:53
mriedemotherwise we'll never be able to drop those old flows14:53
lyarwoodack yeah thanks just had to remind myself about the v2/v3 compat, that somehow slipped my mind.14:54
lyarwoodand yeah this is getting backported if it ever lands14:54
lyarwoodso converting isn't helpful here yet14:55
lyarwoodmaybe in a follow up, unless you're already doing that in the above changes14:55
* lyarwood clicks14:55
*** toabctl has quit IRC14:57
*** toabctl has joined #openstack-nova14:57
*** poojajadhav has joined #openstack-nova14:58
*** munimeha1 has joined #openstack-nova14:59
*** beekneemech is now known as bnemec15:00
*** pjjadhav has quit IRC15:01
mriedemi'm not15:01
mriedemwe really have two things that need to be done: 1. bfv where nova-compute creates new volumes needs to use the new flow, that's the first patch above,15:02
mriedem2. migrate existing attachments, which can only be done on the compute b/c we need the host connector15:02
mriedemthat's the 2nd patch15:02
mriedemit does that on n-cpu startup in a separate thread on each compute using a specialized db query to try and make this as targeted as possible, because i think that's what we talked about doing in dublin,15:02
mriedembut in berlin there were suggestions of just migrating on first access of a legacy attachment, like maybe during move operations or reboot (like refresh_connection_info),15:03
mriedemso idk where we are on migrating existing attachments15:03
*** moshele has quit IRC15:03
*** spatel has joined #openstack-nova15:03
gibimriedem: regarding runways. You are correct, everything related to bandwidth is in a single chain of commits. I just finished the second set of commits _after_ the first set was already in the queue15:03
mriedemwe need to have some kind of data migration though otherwise we can't ever drop the old code paths15:04
gibimriedem: and I did not want to change an item in the queue15:04
*** alexchadin has joined #openstack-nova15:04
spatelsean-k-mooney: sorry i was in meeting my IRC client kick me out15:04
mriedemgibi: ok. fwiw when i'm looking at the runways queues i'm just going through the series until i can't go anymore15:04
mriedembut maybe you're just trying to chunk these up since it's a lot of changes15:04
lyarwoodmriedem: yeah I'd be in favor of the original 2 tbh, otherwise who knows when the attachments would be migrated if ever.15:04
sean-k-mooneyspatel: i triaged https://bugs.launchpad.net/nova/+bug/180873815:05
openstackLaunchpad bug 1808738 in OpenStack Compute (nova) "No net device was found for VF" [Low,Triaged]15:05
gibimriedem: I'm OK to merge the two bwm entry into a single one15:05
mriedemgibi: also, ftr, one of my goals this week (before i'm out next week) is to get through your bw provider series; i'm re-reading the spec now15:05
sean-k-mooneyspatel: the horizon bug seams to be waiting on there responce after you followed up15:05
gibimriedem: it will be a looong one15:05
mriedemgibi: ok i merged them in15:05
gibimriedem: thanks15:06
mriedemgibi: are you around this week?15:06
gibimriedem: I'm available until end of Thursday15:06
*** brandor5 has joined #openstack-nova15:06
*** efried has joined #openstack-nova15:06
brandor5hello everyone: Is there a cli command to list the # of instances on a host?15:06
mriedemok, that works. i have to get my end of year appraisal stuff done by eow too. :(15:06
sean-k-mooneybrandor5: yes i belive so one sec15:07
gibimriedem: on Friday  I start my vacation and I will be back on 7th15:07
brandor5sean-k-mooney: cool, thank you very much15:07
sean-k-mooneybrandor5: openstack server list --host <hostname>15:07
sean-k-mooneybrandor5: you will need to be an admin i think to run that15:08
mriedembrandor5: i assume you're more looking for something like this https://docs.openstack.org/python-novaclient/latest/cli/nova.html#nova-hypervisor-show15:08
gibimriedem: tomorrow I will be on and off during my afternoon but I will prioritize the bandwidth stuff if any15:08
brandor5sean-k-mooney: that one I knew about, sorry I should have been more clear... print list of hypervisors with the # of instacnes they have running on them15:08
sean-k-mooneybrandor5:actully you will need to add --all-projects  "openstack server list --all-projects --host <hostname>"15:09
mriedembrandor5: https://docs.openstack.org/python-novaclient/latest/cli/nova.html#nova-hypervisor-stats15:09
sean-k-mooneyoh yes there is ^15:09
*** sridharg has quit IRC15:09
sean-k-mooneyyou can run "openstack hypervisor stats show"15:09
mriedemthat doesn't break it down by vm's per hypervisor15:10
brandor5ha, we're getting close... is it possible to get it broken out?15:10
*** tbachman has joined #openstack-nova15:10
mriedemis it possible for you to just run two commands?15:10
sean-k-mooneymriedem: it has a running instace count right15:10
brandor5 defintely, just trying to make sure I'm using the right commands... my google-fu has failed me15:10
mriedemhypervisors-list dumps a list of all hypervisors,15:12
mriedemand for each one, there is a 'running_vms' entry15:12
mriedemwhich is the number of vms on each hypervisor - looking at the code, they don't have to be 'running'15:12
brandor5that would work15:12
mriedemhttps://developer.openstack.org/api-ref/compute/?expanded=list-hypervisors-details-detail#list-hypervisors-details15:12
sean-k-mooney isnt that waht https://docs.openstack.org/python-openstackclient/latest/cli/command-objects/hypervisor-stats.html#hypervisor-stats-show does15:13
sean-k-mooneythe docs are terible for that command by the way15:13
mriedemhttps://developer.openstack.org/api-ref/compute/#show-hypervisor-statistics15:13
sean-k-mooneyi taught it printed a table with all hyperviros but i dont have a running openstack to test15:14
mriedemreport an osc docs bug to provide more details and/or an example output15:14
mriedemi wish the osc docs have example output in all of the commands15:14
spatelI always having issue to find list of vms running on host machine so this is what i did to get work around :)15:14
spatelThis is the command... give me what i need :)15:15
spatelmysql -h 172.28.1.183 -u nova --password=1bfa5ea99241c7195ba697f nova -e "select hostname,vm_state,node,availability_zone,vcpus,memory_mb,root_gb from instances WHERE (vm_state='active' OR vm_state='stopped');"15:15
sean-k-mooney ya i should really go do that..15:15
spatelthat mysql command it much easier than running API call :)15:15
sean-k-mooneymriedem: brandor5 we have an example here https://docs.openstack.org/nova/pike/admin/common/nova-show-usage-statistics-for-hosts-instances.html15:16
sean-k-mooneymriedem: brandor5 never mind we dont15:16
spatelbrandor5: you should read this too https://www.sebastien-han.fr/blog/2012/12/20/where-does-my-instance-run/15:16
brandor5spatel: thanks, will do15:17
*** dpawlik has quit IRC15:17
spatelsean-k-mooney: why does nova-manage command not available these days?15:17
*** dpawlik has joined #openstack-nova15:18
*** dpawlik has quit IRC15:18
spateli have google it and didn't find clue to install it15:18
mriedemspatel: you mean this? https://docs.openstack.org/nova/latest/cli/15:18
sean-k-mooneyactully this bug has an example https://bugs.launchpad.net/nova/+bug/176731515:19
openstackLaunchpad bug 1767315 in OpenStack Compute (nova) ""openstack hypervisor stats show" shows wrong memory information" [Undecided,Confirmed] - Assigned to jichenjc (jichenjc)15:19
gibimriedem: FYI I sneaked in one more patch to the bandwidth runway slot (handling detach interface) and added a note that the rest of the patches in the series are part of a not completed subfeature15:19
sean-k-mooneymriedem: also i think i should close that bug ^15:19
spatelsean-k-mooney: yes but i didn't find any packet which provide nova-manager command15:20
sean-k-mooneyspatel: nova-manage should generally not be used unless you are upgrading15:20
sean-k-mooneythere are a few maintance ops15:21
mriedemor installing...15:21
mriedemspatel: where you get the cli is up to the packages/distro you're using15:21
spatelunless is upgrading?15:21
mriedemthat's not really a nova question15:21
sean-k-mooneywell yes installing too but it should not be used for debuging15:21
* mriedem goes to do other things15:22
sean-k-mooneyspatel: oh sorry i taught we were still taking about vm count15:22
spatelyes.. its not nova question but i was just wonder all documents pointing to use nova-manager and i didn't find that command anywhere or any openstack deployment..15:22
sean-k-mooneyspatel: it should be installed when you install nova15:22
sean-k-mooneyspatel: its a console-script that is generated by setuptools/pbr https://github.com/openstack/nova/blob/master/setup.cfg#L6615:23
spatelits no there.. i have installed all nova utility tools but didn't find that tool15:24
*** derekh has quit IRC15:24
sean-k-mooneyspatel: on what distro?15:24
spatelCentOS 7.515:24
spatelInstallation method is Openstack-ansible15:24
sean-k-mooneyopenstack ansible installs form source right?15:25
sean-k-mooneyor are you using nova form the distro rpms15:25
spatelyes they use source15:25
sean-k-mooneythen when osa did pip install nova it should have been genreated15:25
spatelopenstack-ansible use source from git repo, they don't use RPM15:25
sean-k-mooneyspatel: without it they would not have been able to create the nova db and could not run the db migrations15:26
spatelLet me ask openstack-ansible channel and see if they offer any suggestion15:26
odyssey4mespatel nova-manage is in the nova venv, as with all the openstack packages we build15:27
spatelthere you are!!15:27
odyssey4meso it'll be /openstack/venvs/nova-<tag>/bin/nova-manage ...15:27
*** derekh has joined #openstack-nova15:27
spatelodyssey4me: so that command won't be available in utility container right?15:28
odyssey4mespatel nope, it'll only be on hosts where the nova service is installed15:28
spatelodyssey4me: thank for clarification15:29
odyssey4meit requires database access, so best is to use it from the control plane hosts - compute may not have the db connection string in nova.conf15:29
mriedemgibi: in reading the spec, it looks like we need to handle cleaning up bw allocations when a port is detached - do you have code for that up yet?15:29
mriedemgibi: because it seems we'd want that code in place first, which would be a noop until the server create code lands, right?15:29
gibimriedem: that is the patch I've just sneak into the list15:29
*** pcaruana has quit IRC15:29
odyssey4mespatel no problem - happy to assist :)15:29
gibimriedem: hm regarding the ordering you are right15:30
mriedemalso, why aren't the "reject ports with qos" patches first in the series?15:30
gibimriedem: so this https://review.openstack.org/#/c/622421/6 needs to be earlier in the stack15:30
mriedemi'm just trying to think of the order in which this rolls out,15:31
mriedemwhere the groundwork is done first so that when the scheduler bits are turned "on" the rest of it is in place15:31
mriedemsort of like how we handle adding new api features which require changes to compute15:31
mriedemwe start from the bottom up15:31
* gibi is thinking15:33
gibimriedem: the API bit here is the neturon API extension that adds the resource_request field to the port15:33
mriedemas of https://review.openstack.org/#/c/567268/ will we be allocating bw resources during server create?15:33
gibimriedem: if that field is not there then nothing happens in nova15:34
mriedemthis right? https://review.openstack.org/#/c/567268/36/nova/network/neutronv2/api.py15:34
openstackgerritJack Ding proposed openstack/nova master: Preserve UEFI NVRAM variable store  https://review.openstack.org/62164615:35
mriedemyeah and that's used here https://review.openstack.org/#/c/567268/36/nova/scheduler/utils.py15:36
gibimriedem: yes. and that data ends up in the RequestSpec here https://review.openstack.org/#/c/567268/36/nova/compute/api.py@884 which leads to bandwidth allocations15:36
mriedemto build the resource request to allocation candidates15:36
gibimriedem: yes15:36
*** tbachman has quit IRC15:37
mriedemso if we were to merge the first patch in the series, we'd be allocating these things on server create, but not handling them for moves, or port detach15:37
yan0sif I want to have the same set of flavors in two Regions15:38
mriedemgibi: i kind of see two options, neither of which is probably great for you:15:38
yan0sdo I need to duplicate them in both Regions?15:38
yan0sor is there another solution for them to exist in just one place?15:38
mriedem1. re-order the series so the bottom-up changes (nova-compute) happens first and we build to the top where the api transfers the port request to the scheduler15:38
mriedem2. we don't merge the bottom changes in the series until we're happy with the whole thing, at which point we approve it all and hope it merges in the same day/week15:39
gibimriedem: there is one catch. Unitl https://review.openstack.org/#/c/590363/27/neutron/services/qos/qos_plugin.py@128 merges there is no resource_request field in the neutron ports. And after that patch merges there is still a manual step to enable the neutron port extension to turn on the whole feature15:40
mriedemyan0s: does nova-api span regions?15:40
*** itlinux has quit IRC15:40
mriedemgibi: is there a nova change which depends on that neutron change?15:41
yan0sI'm still just in theory about it15:41
mriedemi would think https://review.openstack.org/#/c/567268/ should depend on https://review.openstack.org/#/c/590363/15:41
gibimriedem: no direct dependency as if there is no code that fails if the resource_request is missing15:41
mriedemsure, but it's a functional dependency15:41
yan0sWhat do you mean by that?15:41
yan0sHA deployment of nova-api?15:42
mriedemyan0s: your question depends on if you have separate nova deployments (separate api endpoints) per region15:42
yan0sover the 2 regions?15:42
gibimriedem: the neutron api extension that introduces resource_request is lik a feature flag for the whole bandwidth series15:42
gibimriedem: I can make a depends-on to the neutron patch, that is easy15:42
mriedemif you have separate compute api endpoints per region, using isolated dbs, then yes you'd need to duplicate across regions (i think that's what project kingbird is for)15:42
gibimriedem: what I'd like to achive is to consider the neutron api extension as a feature flag15:43
mriedemgibi: so what do you think about the 1 or 2 options above?15:43
mriedempersonally i'd like to merge some stuff to see it continue moving, but i probably won't do that while the control-plane changes are coming before the backend nova-compute changes to handle cleaning up15:43
mriedemwhich just means you'd be dealing with merge conflicts longer...15:44
gibimriedem: I'd like to propose 3.: the neutron api extension is marked experimental till a good set of usecases are covered by the code merges.15:44
yan0sI think, since my regions are going to be in the same DC, the best option will be to have one nova-api15:45
gibimriedem: if that doesn't work for you, then I can move the reject cases and the detach case to the front of the series15:45
gibimriedem: detach might not work when moved to the front so I might need to reject detach until some create logic merges15:45
mriedemgibi: it might work. i'll just finish reading the spec again, start going through the nova changes and +1 if i'm cool with a change and we'll see where it goes from there once i have the whole thing in my head15:46
*** brandor5 has left #openstack-nova15:46
yan0scould you point to me some documentation on same nova-api region deployment?15:46
gibimriedem: I will run an experiment locally to see how hard is the re-arrange15:47
gibimriedem: will not push anyting before we sync15:47
mriedemyan0s: i'm aware of https://docs.openstack.org/operations-guide/ops-capacity-planning-scaling.html#segregating-your-cloud but it's old15:50
mriedemhttps://wiki.openstack.org/wiki/Kingbird15:50
*** jobewan has joined #openstack-nova15:51
mriedemyan0s: note the cells mention in that ops guide is about cells v1, which is deprecated and replaced with cells v2 in nova which is not experimental nor optional - all nova deployments since ocata are by default a cells v2 cell of 115:51
*** pcaruana has joined #openstack-nova15:51
yan0smriedem: thanks!15:53
*** slaweq has quit IRC15:54
yan0sso shared nova-api means using cells instead of regions15:55
yan0scorrect15:55
yan0s?15:55
mriedemyes15:55
*** udesale has quit IRC15:57
*** jobewan has quit IRC15:58
*** dklyle has joined #openstack-nova15:59
*** brault_ has joined #openstack-nova16:00
mriedemhttps://storyboard.openstack.org/#!/story/2004625 if anyone wants to cleanup the 'cells' reference in the old ops scaling guide16:01
*** slaweq has joined #openstack-nova16:01
gibimriedem: if we want to go with good order that means either I cannot allow booting an instance with bandwidth until nova supports migrate, evacuate, unshelve for that instance, or reject migrate, evacuate, unshelve, for that instance16:01
yan0sSo choosing in which region to launch a VM is a matter of using this regions API16:02
gibimriedem: neither looks really good to me :/16:02
yan0show do I specify in which cell to launch a VM?16:02
mriedemyan0s: cells are not exposed out of the rest api, so if you want a vm to go to a specific cell, you pick a host (or az) that's in that cell16:03
*** alexchadin has quit IRC16:04
mriedemgibi: realistically we shouldn't be supporting creating servers with qos-enabled ports today anyway right? since we don't honor the actual qos request.16:04
mriedemand that's why it's all disabled in neutron16:04
yan0sok got it, thanks again!16:05
mriedemi know during the spec review we talked about this sort of like with multiattach volumes, which you could always use before nova actually supported them for attaching to at most 1 server16:05
gibimriedem: yeah, in nova we cannot really support qos requests unilt we merge a _lot_ of code16:05
*** janki has quit IRC16:05
mriedemgibi: yeah, which is why i said i guess we could just +1 our way to a point where we think it's ready to merge and then try to merge it all as a big chunk16:06
mriedemrather than try to merge effectively noop pieces from the bottom up16:06
mriedemthe former is more like a feature branch16:06
gibimriedem: that will be at least 20 patches (I have 15 already without any server move)16:06
gibimriedem: we can consider evey nova patch no-op while the neutron api extension is disabled :)16:07
mriedemgibi: given it's 5pm for you, how about i just continue reviewing this today and you not worry about it for a bit :)16:07
gibimriedem: sure16:07
gibi:)16:07
mriedemwe likely can't merge anything until the first week of january anyway...16:08
gibimriedem: yeah, but if we can agree on re-arranging the things then I can work on that this week16:08
* gibi stop worrying :)16:09
mriedemok i'll get a better idea of that when i go through the series16:09
gibisure16:09
mriedemlike you said, maybe we just say it's all on neutron and turning it on there via policy16:09
*** gyee has joined #openstack-nova16:10
gibimriedem: I would like that ^^16:10
mriedemi bet you would :)16:11
mriedemnow go have some goulash16:11
gibiyes, sir :)16:11
*** diga has quit IRC16:12
* gibi got hungry16:13
*** Bhujay has joined #openstack-nova16:16
*** rodolof has quit IRC16:17
*** yan0s has quit IRC16:17
*** tbachman has joined #openstack-nova16:19
*** ccamacho has quit IRC16:19
*** ccamacho has joined #openstack-nova16:21
*** N3l1x has joined #openstack-nova16:23
*** N3l1x_ has joined #openstack-nova16:23
*** awaugama has joined #openstack-nova16:26
*** pcaruana has quit IRC16:28
*** tbachman has quit IRC16:30
*** awaugama has quit IRC16:31
*** tbachman has joined #openstack-nova16:35
openstackgerritMerged openstack/nova master: Add python 3.7 unit and functional tox jobs  https://review.openstack.org/62405516:36
openstackgerritMerged openstack/nova master: api-ref: sort parameters for limits, quotas and quota classes  https://review.openstack.org/52878616:36
openstackgerritMerged openstack/nova master: Mention size limit on user data in docs  https://review.openstack.org/62070016:36
openstackgerritMerged openstack/nova master: Restore nova-consoleauth to install docs  https://review.openstack.org/60515416:36
*** macza has joined #openstack-nova16:38
*** tbachman has quit IRC16:40
*** _alastor_ has joined #openstack-nova16:40
*** itlinux has joined #openstack-nova16:40
*** awaugama has joined #openstack-nova16:44
*** tbachman has joined #openstack-nova16:47
*** kaliya has joined #openstack-nova16:52
*** cdent has quit IRC16:54
*** ttsiouts has quit IRC16:56
*** Bhujay has quit IRC16:56
*** ttsiouts has joined #openstack-nova16:56
*** kaliya has quit IRC16:56
*** ttsiouts has quit IRC17:01
*** efried has quit IRC17:01
*** helenafm has quit IRC17:02
openstackgerritMerged openstack/nova stable/rocky: Remove GROUP BY clause from CellMapping.get_by_project_id  https://review.openstack.org/62537717:14
*** tbachman has quit IRC17:17
*** derekh has quit IRC17:21
*** sapd1__ has quit IRC17:29
openstackgerritMerged openstack/nova master: Add py36/py37 functional jobs to the experimental queue  https://review.openstack.org/62482617:39
*** poojajadhav has quit IRC17:40
*** k_mouza_ has quit IRC17:48
mriedemgibi: ok comments in https://review.openstack.org/#/c/567268/ when you're up again17:57
*** _alastor_ has quit IRC17:57
mriedemnothing major, just lots of comments for lots of code17:57
*** _alastor_ has joined #openstack-nova17:59
*** wolverineav has joined #openstack-nova18:21
*** imacdonn has quit IRC18:24
*** imacdonn has joined #openstack-nova18:24
*** _alastor_ has quit IRC18:31
*** _alastor_ has joined #openstack-nova18:32
*** dpawlik has joined #openstack-nova18:32
*** wolverineav has quit IRC18:34
*** wolverineav has joined #openstack-nova18:35
*** ralonsoh has quit IRC18:36
*** wolverineav has quit IRC18:38
*** wolverineav has joined #openstack-nova18:38
*** mvkr has quit IRC18:44
*** mriedem has quit IRC18:48
*** mriedem has joined #openstack-nova18:51
*** dpawlik has quit IRC19:01
*** tbachman has joined #openstack-nova19:01
*** dpawlik has joined #openstack-nova19:01
*** _alastor_ has quit IRC19:08
*** mchlumsky has quit IRC19:09
*** sahid has quit IRC19:14
*** mvkr has joined #openstack-nova19:20
*** tbachman has quit IRC19:28
*** _alastor_ has joined #openstack-nova19:28
*** tbachman has joined #openstack-nova19:30
mriedemmelwitt: did you want to push this into the queens release? https://review.openstack.org/#/c/611945/19:40
*** macza has quit IRC19:42
*** macza has joined #openstack-nova19:43
*** macza has quit IRC19:47
*** N3l1x has quit IRC19:53
*** _alastor_ has quit IRC19:53
*** _alastor_ has joined #openstack-nova19:55
*** spatel has quit IRC20:01
*** rodolof has joined #openstack-nova20:02
*** spatel has joined #openstack-nova20:02
openstackgerritMatt Riedemann proposed openstack/nova master: Drop request spec migration code  https://review.openstack.org/61426520:21
openstackgerritMatt Riedemann proposed openstack/nova master: Remove legacy request spec compat code from API  https://review.openstack.org/61430920:21
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Pass request_spec from compute to cell conductor on reschedule  https://review.openstack.org/58241720:21
openstackgerritMatt Riedemann proposed openstack/nova master: Remove legacy RequestSpec compat code from live migrate task  https://review.openstack.org/62570520:21
openstackgerritMatt Riedemann proposed openstack/nova master: Remove legacy RequestSpec compat from conductor unshelve_instance  https://review.openstack.org/62570620:21
openstackgerritMatt Riedemann proposed openstack/nova master: Remove legacy RequestSpec compat from conductor rebuild_instance  https://review.openstack.org/62570720:21
mriedembauzas: would be nice to remove this crufty ass old request spec compat code from api/conductor after all these years ^20:22
*** wolverineav has quit IRC20:22
melwittmriedem: yeah, sorry need to re-review20:24
*** erlon_ has quit IRC20:25
mriedemi've got stable release requests up for rocky, queens and pike20:26
mriedemsince those likely need to be done today or tomorrow if they are going to be done this week20:26
melwittk, good call20:27
*** macza has joined #openstack-nova20:33
*** rodolof has quit IRC20:36
*** rodolof has joined #openstack-nova20:36
*** rodolof has quit IRC20:37
*** _alastor_ has quit IRC20:37
*** rodolof has joined #openstack-nova20:37
*** rodolof has quit IRC20:38
*** rodolof has joined #openstack-nova20:38
*** rodolof has quit IRC20:39
*** rodolof has joined #openstack-nova20:39
*** _alastor_ has joined #openstack-nova20:42
*** wolverineav has joined #openstack-nova20:49
*** awaugama has quit IRC20:52
*** wolverineav has quit IRC20:54
*** wolverineav has joined #openstack-nova21:00
mriedemeasy code motion patch to get nova to use the oslo.upgradecheck library framework https://review.openstack.org/#/c/603499/21:01
*** wolverineav has quit IRC21:02
*** liuyulong has joined #openstack-nova21:04
*** wolverineav has joined #openstack-nova21:04
*** wolverineav has quit IRC21:05
*** wolverineav has joined #openstack-nova21:06
*** gouthamr has quit IRC21:06
openstackgerritMerged openstack/nova master: Remove utils.execute() from the hyperv driver.  https://review.openstack.org/62000821:06
openstackgerritMerged openstack/nova master: Remove utils.execute() from virt.disk.api.  https://review.openstack.org/62000921:07
*** rodolof has quit IRC21:12
*** rodolof has joined #openstack-nova21:13
*** _alastor_ has quit IRC21:16
*** gouthamr has joined #openstack-nova21:17
*** _alastor_ has joined #openstack-nova21:17
*** k_mouza has joined #openstack-nova21:20
*** k_mouza has quit IRC21:24
*** rcernin has joined #openstack-nova21:28
*** gouthamr_ has joined #openstack-nova21:30
*** slaweq has quit IRC21:30
mriedemjaypipes: are you around this week?21:32
*** mlavalle has quit IRC21:33
mriedemjaypipes: if you are, you were +2 on the amd sev spec at PS12, I'm +2 now at PS16: https://review.openstack.org/#/c/609779/ - if you can take another pass at it21:33
mriedemuber detailed21:33
*** gouthamr_ has quit IRC21:37
*** gouthamr_ has joined #openstack-nova21:41
jaypipesmriedem: will do.21:42
jaypipesmriedem: and yes, I'm around this week.21:43
*** xek has quit IRC21:44
*** gouthamr_ has quit IRC21:46
*** slaweq has joined #openstack-nova21:46
*** dpawlik has quit IRC21:50
*** slaweq has quit IRC21:51
*** gouthamr_ has joined #openstack-nova21:51
*** wolverineav has quit IRC21:54
*** wolverineav has joined #openstack-nova21:54
*** gouthamr_ has quit IRC21:56
openstackgerritMatt Riedemann proposed openstack/nova master: Default zero disk flavor to RULE_ADMIN_API in Stein  https://review.openstack.org/60391021:59
*** igordc has joined #openstack-nova22:00
*** _alastor_ has quit IRC22:04
*** _alastor_ has joined #openstack-nova22:05
*** belmoreira has joined #openstack-nova22:07
*** belmoreira has quit IRC22:07
*** slaweq has joined #openstack-nova22:08
manjeetsHi folks I have iommu = on and when boot an instance using direct sriov port it ends in error22:13
manjeetsfrom n-cpu logs I see libvirtError: unsupported configuration: host doesn't support passthro22:13
manjeetsugh of host PCI devices22:13
manjeetsERROR nova.compute.manager [instance: cd91ad4f-2a94-483b-818c-740386975f88]22:13
manjeets22:13
manjeetsI see VF's on that NIC though, for what other reason this error can happen ?22:14
manjeetsnsupported configuration: host doesn't support passthro22:14
manjeetsugh of host PCI devices22:14
*** slaweq has quit IRC22:20
*** rodolof has quit IRC22:23
*** spatel has quit IRC22:28
*** itlinux has quit IRC22:42
mriedemmanjeets: you're likely going to need to paste the stacktrace into a paste and link that here for any helpful debug22:48
mriedemhttp://paste.openstack.org/22:48
manjeetshttp://paste.openstack.org/show/737514/22:51
manjeetsmriedem, ^22:51
openstackgerritMatt Riedemann proposed openstack/nova master: Properly log request headers in metadata API  https://review.openstack.org/62573122:52
openstackgerritMatt Riedemann proposed openstack/nova master: Properly log request headers in metadata API  https://review.openstack.org/62573122:54
*** macza has quit IRC22:54
*** rodolof has joined #openstack-nova22:55
mriedemmanjeets: have you gone through https://docs.openstack.org/neutron/latest/admin/config-sriov.html ?22:56
mriedemor https://docs.openstack.org/nova/latest/admin/pci-passthrough.html22:57
*** macza has joined #openstack-nova22:57
manjeetsI built devstack using https://docs.openstack.org/neutron/latest/admin/config-sriov.html22:57
*** mlavalle has joined #openstack-nova23:06
*** munimeha1 has quit IRC23:20
*** _alastor_ has quit IRC23:20
openstackgerritMerged openstack/nova master: Migrate upgrade checks to oslo.upgradecheck  https://review.openstack.org/60349923:23
*** mlavalle has quit IRC23:27
*** _alastor_ has joined #openstack-nova23:31
*** itlinux has joined #openstack-nova23:34
*** mriedem has quit IRC23:40
*** _alastor_ has quit IRC23:54
*** rodolof has quit IRC23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!