Friday, 2018-09-21

*** dpawlik has quit IRC00:03
*** tbachman has joined #openstack-nova00:06
*** med_ has quit IRC00:17
openstackgerritMerged openstack/nova stable/pike: Filter out instances without a host when populating AZ  https://review.openstack.org/59418400:21
openstackgerritMerged openstack/nova stable/ocata: Make ResourceTracker.stats node-specific  https://review.openstack.org/58807700:21
*** med_ has joined #openstack-nova00:33
*** mriedem_away has quit IRC00:40
openstackgerritMohammed Naser proposed openstack/nova master: Default zero disk flavor to RULE_ADMIN_API in Stein  https://review.openstack.org/60391000:41
*** med_ has quit IRC00:48
*** erlon has quit IRC01:09
*** imacdonn has quit IRC01:15
*** imacdonn has joined #openstack-nova01:16
*** mhen has quit IRC01:17
*** mhen has joined #openstack-nova01:20
*** erlon has joined #openstack-nova01:21
*** mschuppert has quit IRC01:27
*** erlon has quit IRC01:27
*** mrsoul has quit IRC01:27
*** tiendc has joined #openstack-nova01:36
*** tiendc has quit IRC01:36
openstackgerritTao Li proposed openstack/python-novaclient master: Remove the unused instance-name  https://review.openstack.org/60252001:40
*** tetsuro has quit IRC01:43
*** Dinesh_Bhor has joined #openstack-nova01:50
*** hongbin has joined #openstack-nova01:58
*** efried1 has joined #openstack-nova02:02
*** efried has quit IRC02:04
*** efried1 is now known as efried02:04
gmannmnaser: yeah, there can be more instance like that. as matt mentioned i can add this in my API improvement spec. exact number of fields always in response is better API even with empty value02:07
*** dpawlik has joined #openstack-nova02:12
*** dpawlik has quit IRC02:17
*** Dinesh_Bhor has quit IRC02:26
*** Dinesh_Bhor has joined #openstack-nova02:38
openstackgerrithuanhongda proposed openstack/nova master: Fix instance delete stuck in deleting task_state  https://review.openstack.org/59808402:41
*** cfriesen has quit IRC02:47
*** hoonetorg has quit IRC02:48
*** Bhujay has joined #openstack-nova03:01
*** hoonetorg has joined #openstack-nova03:01
*** jiaopengju has quit IRC03:19
*** jiaopengju has joined #openstack-nova03:20
*** tiendc has joined #openstack-nova03:26
*** vivsoni has quit IRC03:26
*** vivsoni has joined #openstack-nova03:27
*** gcb_ has joined #openstack-nova03:27
*** sdake has quit IRC03:38
*** moshele has joined #openstack-nova03:42
*** sdake has joined #openstack-nova03:43
*** rcernin has quit IRC03:48
*** rcernin has joined #openstack-nova03:49
*** alaski has quit IRC03:56
*** edmondsw has quit IRC03:56
*** Bhujay has quit IRC03:58
*** moshele has quit IRC03:58
*** Dinesh_Bhor has quit IRC03:58
*** sambetts|afk has quit IRC04:08
*** sambetts_ has joined #openstack-nova04:10
*** brinzhang has quit IRC04:26
*** brinzhang has joined #openstack-nova04:26
*** udesale has joined #openstack-nova04:29
*** jhesketh_ has joined #openstack-nova04:32
*** vivsoni has quit IRC04:33
*** vivsoni has joined #openstack-nova04:33
*** Dinesh_Bhor has joined #openstack-nova04:34
*** d34dh0r53 has quit IRC04:34
*** d34dh0r53 has joined #openstack-nova04:34
openstackgerritOpenStack Proposal Bot proposed openstack/nova stable/rocky: Imported Translations from Zanata  https://review.openstack.org/60426004:35
*** jhesketh has quit IRC04:36
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata  https://review.openstack.org/60104704:42
*** hongbin has quit IRC04:45
*** hshiina has joined #openstack-nova04:58
*** swamireddy has joined #openstack-nova05:08
*** swamireddy has quit IRC05:08
*** swamireddy has joined #openstack-nova05:08
*** ratailor has joined #openstack-nova05:11
*** Dinesh_Bhor has quit IRC05:12
*** Dinesh_Bhor has joined #openstack-nova05:16
*** Bhujay has joined #openstack-nova05:18
*** hoangcx has quit IRC05:21
*** hoangcx has joined #openstack-nova05:21
*** jhesketh_ is now known as jhesketh05:25
*** hoangcx has quit IRC05:32
*** tiendc has quit IRC05:32
*** hoangcx has joined #openstack-nova05:32
*** sridharg has joined #openstack-nova05:47
*** icey has quit IRC05:52
*** icey has joined #openstack-nova05:52
openstackgerritNaichuan Sun proposed openstack/nova master: os-xenapi(n-rp)(WIP): add traits for vgpu n-rp  https://review.openstack.org/60426906:03
*** janki has joined #openstack-nova06:04
*** mschuppert has joined #openstack-nova06:08
*** dpawlik has joined #openstack-nova06:11
openstackgerritTao Li proposed openstack/nova master: Rollback instance vm_state to original where instance claims failed  https://review.openstack.org/59225206:17
*** slaweq has joined #openstack-nova06:35
*** litao__ has joined #openstack-nova06:36
*** litao__ has quit IRC06:38
*** litao_ has joined #openstack-nova06:39
openstackgerritYI-JIE,SYU proposed openstack/nova master: Because nova-consoleauth had deprecated since version 18.0.0, fix verify operation documentation file context.  https://review.openstack.org/60427706:42
*** belmoreira has joined #openstack-nova06:43
*** sambetts_ has quit IRC06:53
*** sambetts_ has joined #openstack-nova06:55
*** rcernin has quit IRC07:02
*** tssurya has joined #openstack-nova07:04
gibiefried: thanks for the fup on the cleanup I've +A-d it07:05
*** sahid has joined #openstack-nova07:08
openstackgerritOpenStack Proposal Bot proposed openstack/nova stable/rocky: Imported Translations from Zanata  https://review.openstack.org/60426007:13
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata  https://review.openstack.org/60104707:23
*** ejat has joined #openstack-nova07:24
*** holser_ has joined #openstack-nova07:34
*** jpena|off is now known as jpena07:48
*** ralonsoh has joined #openstack-nova07:50
openstackgerritTakashi NATSUME proposed openstack/nova master: Add API ref guideline for examples  https://review.openstack.org/60406007:53
*** janki has quit IRC07:53
*** hshiina has quit IRC08:00
*** helenafm has joined #openstack-nova08:04
*** dims has quit IRC08:11
*** dims has joined #openstack-nova08:12
*** tssurya has quit IRC08:16
*** gcb_ has quit IRC08:18
*** alexchadin has joined #openstack-nova08:22
*** alexchadin has quit IRC08:26
*** alexchadin has joined #openstack-nova08:28
*** s10 has joined #openstack-nova08:33
openstackgerritRodolfo Alonso Hernandez proposed openstack/os-vif master: Add abstract OVSDB API  https://review.openstack.org/47661208:35
openstackgerritVlad Gusev proposed openstack/nova stable/queens: libvirt: Use os.stat and os.path.getsize for RAW disk inspection  https://review.openstack.org/60429508:37
*** belmoreira has quit IRC08:37
*** Dinesh_Bhor has quit IRC08:37
*** derekh has joined #openstack-nova08:39
*** belmoreira has joined #openstack-nova08:46
*** Dinesh_Bhor has joined #openstack-nova08:55
openstackgerritBrin Zhang proposed openstack/nova master: Specifies the storage backend to boot instance  https://review.openstack.org/57936008:57
*** sapd1 has quit IRC09:00
*** sapd1_ has joined #openstack-nova09:01
*** dpawlik has quit IRC09:02
*** mdbooth has joined #openstack-nova09:02
*** dpawlik has joined #openstack-nova09:04
*** hoonetorg has quit IRC09:08
*** jaosorior is now known as jaosorior_lunch09:09
*** dillaman has joined #openstack-nova09:09
*** jdillaman has quit IRC09:11
*** tssurya has joined #openstack-nova09:15
*** Dinesh_Bhor has quit IRC09:16
openstackgerritMerged openstack/nova stable/rocky: Fix image-defined numa claims during evacuate  https://review.openstack.org/59906209:19
openstackgerritMerged openstack/nova stable/rocky: Configure placement DB context manager for nova-manage/status  https://review.openstack.org/60046409:20
openstackgerritMerged openstack/nova stable/rocky: Document unset/reset wrinkle for *_allocation_ratio options  https://review.openstack.org/59967309:20
openstackgerritNaichuan Sun proposed openstack/nova master: os-xenapi(n-rp)(WIP): add traits for vgpu n-rp  https://review.openstack.org/60426909:22
openstackgerritNaichuan Sun proposed openstack/nova master: os-xenapi(n-rp)(WIP): add traits for vgpu n-rp  https://review.openstack.org/60426909:23
*** Luzi has joined #openstack-nova09:23
*** hoonetorg has joined #openstack-nova09:25
*** vabada has joined #openstack-nova09:26
*** sambetts_ is now known as sambetts09:31
openstackgerritRodolfo Alonso Hernandez proposed openstack/os-vif master: Add abstract OVSDB API  https://review.openstack.org/47661209:33
*** takashin has left #openstack-nova09:34
*** mdbooth has quit IRC09:40
*** mdbooth has joined #openstack-nova09:40
openstackgerritNaichuan Sun proposed openstack/nova master: os-xenapi(n-rp)(WIP): add traits for vgpu n-rp  https://review.openstack.org/60426909:42
openstackgerritMerged openstack/os-traits master: clean up CUDA traits  https://review.openstack.org/59717009:46
*** hoangcx has quit IRC09:48
*** alexchadin has quit IRC09:51
openstackgerritNaichuan Sun proposed openstack/nova master: os-xenapi(n-rp): add traits for vgpu n-rp  https://review.openstack.org/60426909:52
*** tssurya has quit IRC09:54
*** alexchadin has joined #openstack-nova09:56
*** Dinesh_Bhor has joined #openstack-nova09:56
openstackgerritRodolfo Alonso Hernandez proposed openstack/os-vif master: Add abstract OVSDB API  https://review.openstack.org/47661210:13
openstackgerritYI-JIE,SYU proposed openstack/nova master: Remove deprecated nova-consoleauth reference from doc  https://review.openstack.org/60427710:14
*** cdent has joined #openstack-nova10:17
openstackgerritStephen Finucane proposed openstack/nova master: Remove deprecated nova-consoleauth reference from doc  https://review.openstack.org/60427710:18
*** vivsoni has quit IRC10:19
*** Dinesh_Bhor has quit IRC10:20
openstackgerritRodolfo Alonso Hernandez proposed openstack/os-vif master: Add abstract OVSDB API  https://review.openstack.org/47661210:26
*** eandersson has quit IRC10:30
*** jiteka has quit IRC10:30
*** alexchadin has quit IRC10:35
*** alexchadin has joined #openstack-nova10:36
*** alexchadin has quit IRC10:36
*** alexchadin has joined #openstack-nova10:36
*** alexchadin has quit IRC10:37
*** alexchadin has joined #openstack-nova10:37
*** alexchadin has quit IRC10:37
*** alexchadin has joined #openstack-nova10:38
*** alexchadin has quit IRC10:38
*** tbachman has quit IRC10:44
*** erlon has joined #openstack-nova10:47
openstackgerritLee Yarwood proposed openstack/nova master: Add regression for bug 1787606  https://review.openstack.org/59307310:52
openstackbug 1787606 in OpenStack Compute (nova) "Multi instance creation rescheduling fails due to a lack of alternates" [Medium,In progress] https://launchpad.net/bugs/1787606 - Assigned to Lee Yarwood (lyarwood)10:52
openstackgerritLee Yarwood proposed openstack/nova master: scheduler: Increase alternate count in smaller environments  https://review.openstack.org/59307410:52
openstackgerritLee Yarwood proposed openstack/nova master: fixtures: Track volume attachments within CinderFixtureNewAttachFlow  https://review.openstack.org/58701310:52
openstackgerritLee Yarwood proposed openstack/nova master: Add regression test for bug#1784353  https://review.openstack.org/58701410:52
openstackgerritLee Yarwood proposed openstack/nova master: conductor: Recreate volume attachments during a reschedule  https://review.openstack.org/58707110:52
s10Please review backports for the https://bugs.launchpad.net/nova/+bug/178582710:55
openstackLaunchpad bug 1785827 in OpenStack Compute (nova) "Performance regression in libvirt get_available_resource()" [Undecided,Fix released] - Assigned to Lee Yarwood (lyarwood)10:55
s10https://review.openstack.org/#/q/topic:bug/1785827+(status:open+OR+status:merged)10:55
*** dpawlik has quit IRC11:02
*** dpawlik has joined #openstack-nova11:03
*** udesale has quit IRC11:05
*** helenafm has quit IRC11:08
*** cdent has quit IRC11:12
*** udesale has joined #openstack-nova11:13
*** alexchadin has joined #openstack-nova11:15
*** alexchadin has quit IRC11:20
*** jpena is now known as jpena|lunch11:23
*** alex_xu has quit IRC11:23
*** mschuppert is now known as mschuppert|lunch11:24
*** janki has joined #openstack-nova11:28
openstackgerritBrin Zhang proposed openstack/nova master: Specifies the storage backend to boot instance  https://review.openstack.org/57936011:32
*** litao_ has quit IRC11:33
*** udesale has quit IRC11:34
*** udesale has joined #openstack-nova11:34
*** alexchadin has joined #openstack-nova11:37
s10Please reopen bug https://bugs.launchpad.net/nova/+bug/1209101 , it was reintroduced in https://github.com/openstack/nova/commit/2a81337a#diff-46d9a1430ccd8406e9dae8eee9e1f699R8111:38
openstackLaunchpad bug 1209101 in OpenStack Compute (nova) "Non-public flavor cannot be used in created tenant" [High,Fix released] - Assigned to Sumanth Nagadavalli (sumanth-nagadavalli)11:38
*** brinzhang has quit IRC11:43
*** cdent has joined #openstack-nova11:44
openstackgerritMerged openstack/nova master: Resource retrieving: add changes-before filter  https://review.openstack.org/59927611:48
*** mschuppert|lunch is now known as mschuppert12:00
openstackgerritMerged openstack/nova stable/pike: Add unshelve instance error info to fault table  https://review.openstack.org/58342612:01
openstackgerritMerged openstack/nova stable/rocky: Delete instance_group_member records from API DB during archive  https://review.openstack.org/59895312:01
openstackgerritMerged openstack/nova stable/queens: Remove noisy DEBUG log  https://review.openstack.org/60037212:01
openstackgerritMerged openstack/nova master: Optimize AZ lookup during schedule_and_build_instances  https://review.openstack.org/58866512:10
*** tssurya has joined #openstack-nova12:10
*** jaosorior_lunch is now known as jaosorior12:11
*** tbachman has joined #openstack-nova12:15
*** gibi is now known as giblet12:17
gibletstephenfin: rubasov published the blogpost about the bandwidth demo https://rubasov.github.io/2018/09/21/openstack-qos-min-bw-demo.html12:17
*** tssurya has quit IRC12:21
*** jpena|lunch is now known as jpena12:26
*** udesale has quit IRC12:26
*** tbachman has quit IRC12:32
cdent+many on that blog post12:33
*** ratailor has quit IRC12:34
*** alexchadin has quit IRC12:43
openstackgerritBalazs Gibizer proposed openstack/nova master: Consumer gen support for delete instance allocations  https://review.openstack.org/59159712:43
*** panda|off is now known as panda12:53
openstackgerritMerged openstack/nova master: libvirt: Drop MIN_LIBVIRT_PF_WITH_NO_VFS_CAP_VERSION  https://review.openstack.org/56551712:59
openstackgerritMerged openstack/nova master: Filter deleted computes from get_all_by_uuids()  https://review.openstack.org/60410812:59
openstackgerritMerged openstack/nova master: Delete instance_id_mappings record in instance_destroy  https://review.openstack.org/59155812:59
*** tbachman has joined #openstack-nova13:00
openstackgerritMerged openstack/nova master: Remove an unnecessary comment  https://review.openstack.org/60392413:00
openstackgerritMerged openstack/nova master: Imported Translations from Zanata  https://review.openstack.org/60104713:00
*** cdent has quit IRC13:02
*** liuyulong has joined #openstack-nova13:02
*** jaypipes-ooo has quit IRC13:25
*** jaypipes has joined #openstack-nova13:25
mdboothOh, fun. LVM encryption is useless :)13:27
* johnthetubaguy is very curious now13:27
mdboothjohnthetubaguy: Just writing up a detailed response to that bug13:28
lyarwoodwhich bug?13:28
mdboothhttps://bugs.launchpad.net/nova/+bug/179315913:28
openstackLaunchpad bug 1793159 in OpenStack Compute (nova) "no signature check for cached images" [Undecided,New]13:28
*** jaypipes is now known as leakypipes13:28
*** mriedem has joined #openstack-nova13:29
*** cdent has joined #openstack-nova13:30
mdboothjohnthetubaguy: A para from the wip response:13:30
mdboothUnfortunately, 'encrypted' LVM as currently implemented is similarly vulnerable. When starting the instance we first created an LV for the disk which will store encrypted data. However, we then create a dm-crypt device which we initialise with the key we obtained from Barbican. This presents an unencrypted block device to the host, which we then present to the instance. Any attacker needs only use the dm-crypt device rather than the13:30
mdboothunderlying device, both of which have the same access. The dm-crypt device is only removed if the instance is deleted, or implicitly if the compute host is rebooted.13:30
*** jistr is now known as jistr|call13:31
mdboothlyarwood: Native ephemeral encryption would improve ^^^13:31
johnthetubaguywell, I still think once you have root on the hypervisor its game over, any which way13:32
*** s10 has quit IRC13:32
mdboothjohnthetubaguy: Right. I'm addressing that, too.13:32
* mdbooth is probably spending too much time on this13:33
johnthetubaguyI think they were thinking about an external storage system being compromised, and providing some protection against that13:33
*** belmoreira has quit IRC13:33
mriedemdansmith: i'll update the stable release patches once maya gets off to school. everything is merged that was approved except for https://review.openstack.org/#/c/592310/ but that's super latent anyway so i won't hold for it.13:33
*** sridharg has quit IRC13:33
dansmithsweet13:33
lyarwoodmdbooth: yeah on my list for T overall, might try to get to rbd in S13:34
mdboothjohnthetubaguy lyarwood: https://bugs.launchpad.net/nova/+bug/179315913:40
openstackLaunchpad bug 1793159 in OpenStack Compute (nova) "no signature check for cached images" [Undecided,New]13:40
mdboothCommented13:40
*** burt has joined #openstack-nova13:40
openstackgerritBalazs Gibizer proposed openstack/nova master: Consumer gen support for put allocations  https://review.openstack.org/59164713:46
mdboothjohnthetubaguy: So the point about being hosed if you have root on the hypervisor is obviously valid, but there's real-world practical gain to be had by requiring the admin to reconfigure the system first, as you have a chance to put additional controls around that. It'll also stop pretty much all 'innocent curiosity'.13:47
openstackgerritMohammed Naser proposed openstack/nova stable/rocky: Filter deleted computes from get_all_by_uuids()  https://review.openstack.org/60436713:47
*** stephenfin is now known as finucannot13:48
finucannotgiblet: Sweet, cheers13:48
*** efried is now known as fried_rice13:49
*** dansmith is now known as SteelyDan13:50
mdboothSteelyDan: I think DonSmith might be more appropriate :D13:50
SteelyDaneh?13:50
SteelyDanWho is Don Smith?13:50
mdboothA mafioso, obviously13:51
openstackgerritMerged openstack/nova master: Making instance/migration listing skipping down cells configurable  https://review.openstack.org/59242813:53
mriedemnova stable releases https://review.openstack.org/#/q/topic:nova-stable-releases-sept-2018+(status:open+OR+status:merged)13:54
SteelyDanmriedem: thanks for doing that13:55
lyarwoodabout to jump on a call but I can take a look afterwards, thanks mriedem13:55
SteelyDanmriedem: do we bug dims and smcginnis to look at those?13:58
openstackgerritMerged openstack/nova master: Add get_by_cell_and_project() method to InstanceMappingList  https://review.openstack.org/59165613:58
openstackgerritMerged openstack/nova master: Fix missing specifying doctrees directory  https://review.openstack.org/60406813:58
smcginnisI looked at a couple. I can keep going if it helps.13:58
openstackgerritMerged openstack/nova master: Remove mox in test_compute_api.py (4)  https://review.openstack.org/56846213:58
openstackgerritMerged openstack/nova master: Remove deprecated hide_server_address_states option  https://review.openstack.org/60383113:58
openstackgerritMerged openstack/nova master: Remove mox in libvirt/test_driver.py (6)  https://review.openstack.org/57133013:59
SteelyDansmcginnis: we haven't had releases in a while and there are like a hundred important pending fixes14:01
SteelyDanso yeah it would be good if you can14:01
smcginnisSteelyDan: Cool, I can spend a little time this morning going through there then.14:02
SteelyDanthanks14:02
smcginnisNo problem14:02
*** openstackgerrit has quit IRC14:07
*** mchlumsky has quit IRC14:09
mriedemSteelyDan: i'm confused by tssurya's change here https://review.openstack.org/#/c/567785/ which looks like it adds the new microversion handling, but the microversion isn't actually introduced in that change, it's spread throughout several other patches after that14:10
mriedemis the idea that none of this works until the end of the series?14:11
SteelyDanyeah, that's generally how we do this right?14:11
mriedemwell,14:12
mriedemwe generally plumb the lower layers with flags and such,14:12
mriedembut that change is actually checking the version the user passed in is 2.66 and if so, does something14:12
mriedemi just don't know if that would actually work yet until the MAX_VERSION is updated later14:13
mriedemthe risk is that 2.66 is already approved in another change14:13
mriedemiow, normally the change that introduces the actual microversion is at the end14:13
mriedemi think i'm going to procedurally -2 this until the rest of the series is +W14:13
SteelyDanright, that's what I asked for earlier .. is that no tthis?14:14
* SteelyDan is in a meeting and distracted14:14
mriedemi left comments and a -2, can discuss with tssurya later14:16
*** cfriesen has joined #openstack-nova14:16
*** openstackgerrit has joined #openstack-nova14:18
openstackgerritMatt Riedemann proposed openstack/nova stable/rocky: Delete instance_id_mappings record in instance_destroy  https://review.openstack.org/60437314:18
*** mchlumsky has joined #openstack-nova14:18
mriedemjroll: we should probably make this VirtDriverNotReady thing for ironic a warning yeah? http://logs.openstack.org/27/602127/2/check/ironic-tempest-dsvm-ipa-wholedisk-bios-agent_ipmitool-tinyipa/4238d0f/controller/logs/screen-n-cpu.txt.gz?level=TRACE#_Sep_20_21_52_03_58743614:20
mriedemor info?14:20
mriedemit's just a case of n-cpu starting up before ironic api right?14:21
mriedemand it's self-healing?14:21
mriedemgmann: i'm going to pull https://blueprints.launchpad.net/nova/+spec/api-extensions-merge-stein out of the runway slot since there are no open changes14:23
*** lbragstad is now known as elbragstad14:24
*** munimeha1 has joined #openstack-nova14:28
*** alex_xu has joined #openstack-nova14:30
*** janki has quit IRC14:33
*** dpawlik has quit IRC14:33
*** maciejjozefczyk has quit IRC14:34
openstackgerritMerged openstack/nova-specs master: Placement: any traits in allocation_candidate query  https://review.openstack.org/56573014:36
*** Bhujay has quit IRC14:38
openstackgerritMerged openstack/nova-specs master: Placement: support mixing required traits with any traits  https://review.openstack.org/56574114:38
openstackgerritRodolfo Alonso Hernandez proposed openstack/os-vif master: Add abstract OVSDB API  https://review.openstack.org/47661214:39
*** mchlumsky has quit IRC14:40
*** mrjk has quit IRC14:40
*** mchlumsky has joined #openstack-nova14:41
*** mrjk has joined #openstack-nova14:41
*** Bhujay has joined #openstack-nova14:41
*** pmannidi has joined #openstack-nova14:42
*** Luzi has quit IRC14:42
cdentHow disabled is a compute node that's been administratively disabled (compute service disable...)? Can an admin stil force a migration there?14:47
cdentSteelyDan, mriedem ^ ?14:47
mriedemi think they can14:47
mriedemb/c a force would bypass the ComputeFilter14:47
*** mlavalle has joined #openstack-nova14:48
openstackgerritMatt Riedemann proposed openstack/nova master: Ignore VirtDriverNotReady in _sync_power_states periodic task  https://review.openstack.org/60437614:49
mriedemjroll: ^14:49
cdentmriedem: is my understanding correct that there are two different kinds of force? one checks that the destination has the required resourcdes (and thus uses the sheduler/placement) and the other does not?14:49
mriedemwell,14:49
mriedemthere are a few ways to confuse 'force' here,14:50
mriedemdepends on the microversion used in the live migration api14:50
mriedemhttps://developer.openstack.org/api-ref/compute/#live-migrate-server-os-migratelive-action14:50
cdentanytime someone says "well" i want to run and hide14:50
mriedemso before microversion 2.30, specifying the host bypasses the scheduler and forces it,14:50
mriedemafter microversion 2.30, if you specify a host but not force=true, the scheduler validates the host,14:51
mriedem>=2.30 + host + force=true means bypass the scheduler14:51
mriedemyes, it's terrible; mordred can attest when i explained this when he fixed it in the sdk14:51
mriedemand it's also the reason i was -5 on adding force to cold migration14:51
mriedemamong other reasons14:51
* cdent attempts to digest this information14:52
mriedemif it doesn't matter, always pass host=None14:52
mriedemso the scheduler always picks14:52
mriedemotheriwse use microversion >=2.30 so the scheduler validates the specified host14:52
mordredyeah. I really didn't enjoy this one14:53
cdentso: in >=  2.30 if i want to target a disabled compute node I can host + force = true and really truly force. That's the thing I'm after in this case.14:53
mriedemyes i think so14:53
mriedemthere are big red warnings in the api ref about it too14:53
cdentcool, thank you very much. I think I've just learned a lot in a very short space of time, which is pleasing.14:54
mordredcdent: http://git.openstack.org/cgit/openstack/openstacksdk/tree/openstack/compute/v2/server.py#n366 if you want to see it all in python14:54
* mriedem grabs dull knife14:54
* cdent calls ... someone14:55
mriedemghostbusters?14:55
mriedemi guess that would actually be bad for their business14:55
openstackgerritMatt Riedemann proposed openstack/nova stable/rocky: Optimize AZ lookup during schedule_and_build_instances  https://review.openstack.org/60437814:57
mriedemSteelyDan: lyarwood: when you get a chance, could use reviews on these simple backports to run tempest-slow in queens and pike https://review.openstack.org/#/q/topic:nova-slow+(status:open+OR+status:merged)14:58
mriedemb/c we merged a change in tempest to move several tests from tempest-full to tempest-slow so we should make sure we still have the test coverage on stable14:59
*** swamireddy has quit IRC15:01
*** dpawlik has joined #openstack-nova15:03
lyarwoodmriedem: ack looking now15:04
mriedemalex_xu: have you talked with the cyborg devs at all about your nvdimm stuff to see if that could work with cyborg as a generic way to model those devices and integrate with nova for the plug/unplug that's needed via the os-acc library?15:07
*** dpawlik has quit IRC15:07
mriedemalex_xu: in general, i think we could really use someone that knows how nova works helping the cyborg team directly; fried_rice has been doing that but is also really busy with other stuff too.15:08
lyarwoodmriedem: remind me, nova-next is the cellsv2 job right?15:09
mriedemlyarwood: in the olden times nova-next was cells v2 and placement while those were optional (in newton yeah)15:09
SteelyDanall jobs should be cellsv2 with superconductor these days no?15:09
mriedemyes15:09
lyarwoodyeah I just couldn't recall what we used it for now15:09
mriedemthat's why we don't run nova-next on ocata/pike15:09
mriedemit's also the only job that runs our post-test scripts15:10
mriedemthe job description in .zuul.yaml explains what it runs15:10
mriedemit runs the tls console proxy code since queens15:10
mriedemand the service user token stuff since pike15:10
mriedemso it's a smorgasbord of optional nova things not tested elsewhere15:11
lyarwoodcool, thanks15:11
*** jistr|call is now known as jistr15:11
openstackgerritMichal Arbet proposed openstack/nova master: Add check if api_database.connection is set.  https://review.openstack.org/60438815:20
*** rpittau has quit IRC15:21
*** bnemec is now known as beekneemech15:21
openstackgerritMichal Arbet proposed openstack/nova master: Add check if api_database.connection is set.  https://review.openstack.org/60438815:25
*** sapd1 has joined #openstack-nova15:27
mriedemgiblet: i have a few questions in https://review.openstack.org/#/c/591597/15:27
mriedemi think it's OK for the most part, except we could be leaking a 500 response in the DELETE /servers/{server_id} API15:28
cdentfried_rice, giblet : besides this topic https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/use-nested-allocation-candidates is there other "make nested work" stuff in progress?15:29
fried_riceheh, probably.15:30
fried_riceI assume you mean besides the stuff that consumes it (e.g. vgpu)15:30
cdent(yes to second question) I figured, and I'll endeavor to find it, but thought I'd check for a quickref first15:31
alex_xumriedem: I'm thinking nova first since I think it is memory device. but actually, I never thing about how to integrate with cyborg15:31
alex_xumriedem: I didn't contribute too much for cyborg spec, but Sundar used to catch me discuss something15:32
*** tbachman has quit IRC15:35
mriedemif it could work with cyborg, then it would be a win-win if you worked on it that way since they need someone that understands nova to help them integrate i think15:35
mriedemobviously not on your friday night15:35
alex_xumriedem: got it, i will take a look at that15:37
*** med_ has joined #openstack-nova15:40
*** pmannidi has quit IRC15:41
openstackgerritMatt Riedemann proposed openstack/nova master: Add volume-backed evacuate test  https://review.openstack.org/60439715:46
openstackgerritRodolfo Alonso Hernandez proposed openstack/os-vif master: Add native implementation OVSDB API  https://review.openstack.org/48222615:47
*** Bhujay has quit IRC15:48
openstackgerritMatt Riedemann proposed openstack/nova master: Run evacuate tests with local/lvm and shared/rbd storage  https://review.openstack.org/60440015:50
mriedemmdbooth: ^ those two additional changes should give a pretty healthy evacuate integration test coverage15:50
*** med_ has quit IRC15:50
mriedemlocal/lvm and shared/rbd15:50
*** sapd1 has quit IRC15:51
mriedemimage-backed and volume-backed15:51
openstackgerritMatt Riedemann proposed openstack/nova master: Add volume-backed evacuate test  https://review.openstack.org/60439715:54
openstackgerritMatt Riedemann proposed openstack/nova master: Run evacuate tests with local/lvm and shared/rbd storage  https://review.openstack.org/60440015:54
*** cdent has quit IRC15:59
*** tbachman has joined #openstack-nova15:59
mdboothmriedem: Looking now, thanks16:02
openstackgerritMichal Arbet proposed openstack/nova master: Add check if api_database.connection is set.  https://review.openstack.org/60438816:02
sean-k-mooneymriedem: hi i meant to ask you at the ptg but can you take a look at https://review.openstack.org/#/c/587615/ and comment if you want us to squash this and the next change into one or if this is ok. melwitt and finucannot wanted your input before merging for backport reasons16:02
*** sahid has quit IRC16:03
*** med_ has joined #openstack-nova16:03
mriedemsean-k-mooney: without looking at details i'd squash them,16:05
mriedemwe normally only do the 2-change dance for a regression test when it's a much larger functional regression test that is actually hitting the api and such and shows a regression16:05
mriedemotherwise if it's just unit tests, removing the code fix should show the test fails16:05
*** ShilpaSD has quit IRC16:14
*** ralonsoh has quit IRC16:18
*** holser_ has quit IRC16:18
*** fried_rice is now known as fried_rolls16:18
sean-k-mooneymriedem: ya that was thw main question. i know the two step thing is normally only dont for functional test. ill squash them16:19
sean-k-mooneymriedem: it will make finucannot happy anyway16:19
mdboothmriedem: How about testing NFS/LVM ;) https://bugs.launchpad.net/nova/+bug/1793159/comments/916:22
openstackLaunchpad bug 1793159 in OpenStack Compute (nova) "no signature check for cached images" [Undecided,New]16:22
mriedemlvm will be tested by the last change in that series now,16:22
mriedemor do you mean lvm as the image backend, not volume-based?16:22
mriedemwe have an lvm job in the experimental queue i think but it's not multinode16:23
mriedemsame for nfs16:23
mdboothmriedem: I wasn't being serious, but I was suggesting instances on NFS and image backend=lvm16:23
mriedemwell, we could do those if we made the jobs multinode16:23
mdboothAs that was the scenario described in that bug16:23
* mdbooth had never previously considered it16:23
mriedemi seem to remember having a todo to investigate integrating lvm into some other job of ours for additional coverage, related to something lyarwood was fixing awhile back16:24
mriedemi'd have to dig that up16:24
*** janki has joined #openstack-nova16:25
mdboothmriedem: Incidentally, afaik there's absolutely no reason to ever use that configuration.16:25
mriedemimagebackend=lvm?16:26
mriedemwindriver loved it until recently16:26
mdboothmriedem: Combined with instances on nfs16:26
mriedemoh16:26
mdboothIt seems like the worst of everything16:26
mdboothYeah, lvm is a thing. I wonder what the performance advantage over raw files is, though. Bet it's minimal.16:28
mriedemi guess i was thinking of this https://review.openstack.org/#/c/567860/ maybe16:28
mriedemconfig drive with vfat16:28
mriedembecause of https://bugs.launchpad.net/nova/+bug/177170016:29
openstackLaunchpad bug 1771700 in nova (Ubuntu Bionic) "nova-lvm tempest job failing with InvalidDiskInfo" [High,Fix committed]16:29
mriedemhttp://paste.openstack.org/show/730550/16:30
mriedemtl;dr: "so we could get images_type live migration coverage for qcow2, raw and rbd image types, with and without config drive, and with config drive vfat and iso9660."16:30
mriedemright now our live migration jobs only test qcow2/rbd and without config drive ever16:31
mdboothIt's quite a matrix :/16:32
mdboothmriedem: Add in with/without kernel/ramdisk16:32
mriedemno one cares about those16:32
mdboothHehe, they were a bug in my evacuate patch, though :)16:32
mdboothThe fake imageservice was non-deterministically returning an image with kernel/ramdisk, which caused a failure in my functional test. The bug was real.16:34
mdboothmriedem: How much of test_evacuate.sh is boilerplate, btw?16:35
mriedemas in virt agnostic?16:35
mdboothAs in copied almost verbatim from another well-tested script16:35
mriedem016:36
mdboothk16:36
mriedemi wrote it while at the ptg last week16:36
mriedemin between bouts of yelling "argh" at people16:36
mriedemyou were my muse you know16:36
mdboothYou must have typed quickly in those gaps16:36
mriedemheh16:36
mriedembtw, assuming these evacuate test patches pass, we should run your fix on top of them,16:37
mriedemcould probably do that without rebasing16:37
mriedemif you put a change on top of your fix that depends-on my stack16:37
mdboothmriedem: ack. I'll add a Depends-on to it now16:37
mriedemdon't put the depends-on your fix directly,16:37
mriedemput it on a DNM patch on top of yours16:37
mdboothOh, ok. Got it.16:37
mdboothI'll have to leave the detailed review for Monday now, though. I need to be somewhere in 50 minutes, and I need to both get home, eat, and travel there first.16:38
mriedemyup, sure16:38
mriedemttyl16:38
mriedemSteelyDan: stacking up a new devstack atm to test your placement db copy script thing, should hopefully be able to start writing grenade changes this afternoon16:39
SteelyDanmriedem: ack.. did the projects thing for the grenade job get resolved?16:40
SteelyDanI haven't really been paying attention16:40
mriedemdon't know16:40
*** dtantsur is now known as dtantsur|afk16:41
*** derekh has quit IRC16:48
*** jpena is now known as jpena|off16:54
openstackgerritMatthew Booth proposed openstack/nova master: Add regression test for bug 1550919  https://review.openstack.org/59173316:55
openstackbug 1550919 in OpenStack Compute (nova) "[Libvirt]Evacuate fail may cause disk image be deleted" [Medium,In progress] https://launchpad.net/bugs/1550919 - Assigned to Matthew Booth (mbooth-9)16:55
openstackgerritMatthew Booth proposed openstack/nova master: Don't delete disks on shared storage during evacuate  https://review.openstack.org/57884616:55
openstackgerritMatthew Booth proposed openstack/nova master: DNM: Test against mdbooth's evacuate patch  https://review.openstack.org/60442316:55
*** sambetts is now known as sambetts|afk16:56
*** gyee has joined #openstack-nova17:01
*** mdbooth has quit IRC17:02
kashyapmriedem: Shall I bump the MIN_VERSION_* to the advertized NEXT_MIN_* here: https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L23017:03
*** nicolasbock_ has joined #openstack-nova17:03
kashyap(Will get to it on Monday; but just wanted to double-check here.)17:03
*** spsurya has quit IRC17:05
openstackgerritMerged openstack/nova stable/queens: Add tempest-slow job to run the tempest slow tests  https://review.openstack.org/60413417:06
*** maciejjozefczyk has joined #openstack-nova17:12
*** med_ has quit IRC17:12
*** maciejjozefczyk has quit IRC17:14
*** maciejjozefczyk has joined #openstack-nova17:14
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in libvirt/test_driver.py (7)  https://review.openstack.org/57199217:17
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in libvirt/test_driver.py (8)  https://review.openstack.org/57199317:17
*** med_ has joined #openstack-nova17:18
*** maciejjozefczyk has quit IRC17:19
openstackgerritMerged openstack/nova stable/pike: Add tempest-slow job to run the tempest slow tests  https://review.openstack.org/60413817:21
openstackgerritMerged openstack/nova master: Remove deprecated nova-consoleauth reference from doc  https://review.openstack.org/60427717:21
openstackgerritMerged openstack/nova master: ironic: stop hammering ironic API in power sync loop  https://review.openstack.org/60212717:24
kashyapmriedem: When you're around, I should we should update it.  Since we advertized them as the NEXT_MIN.17:25
kashyap(That means, some more tedious, but necessary work, about selecting the NEXT_MIN_* for 'T' release.)17:26
* kashyap --> home17:26
*** manjeets has joined #openstack-nova17:26
openstackgerritsean mooney proposed openstack/nova master: libvirt: fix disk_bus handling for root disk  https://review.openstack.org/58499917:31
*** etp has quit IRC17:41
*** etp has joined #openstack-nova17:44
*** med_ has quit IRC17:54
*** etp has quit IRC17:55
*** etp has joined #openstack-nova17:56
*** janki has quit IRC17:57
openstackgerritMerged openstack/os-vif master: Fix upper-constraints link in tox file  https://review.openstack.org/60415817:59
*** panda has quit IRC18:08
*** panda has joined #openstack-nova18:10
*** nicolasbock_ has quit IRC18:12
openstackgerritMohammed Naser proposed openstack/nova stable/queens: Filter deleted computes from get_all_by_uuids()  https://review.openstack.org/60444818:47
openstackgerritMohammed Naser proposed openstack/nova stable/pike: Filter deleted computes from get_all_by_uuids()  https://review.openstack.org/60444918:48
openstackgerritMohammed Naser proposed openstack/nova stable/ocata: Filter deleted computes from get_all_by_uuids()  https://review.openstack.org/60445118:52
*** dave-mccowan has quit IRC19:03
*** dave-mccowan has joined #openstack-nova19:14
*** erlon has quit IRC19:25
*** maciejjozefczyk has joined #openstack-nova19:28
*** dpawlik has joined #openstack-nova19:33
cfriesenis there an API equivalent to "nova-manage cell_v2 discover_hosts"?19:37
*** dpawlik has quit IRC19:38
mriedemcfriesen: no19:38
mriedemthere is a config option to run it periodically in the scheduler19:39
*** med_ has joined #openstack-nova19:45
*** slaweq has quit IRC19:54
*** slaweq has joined #openstack-nova19:57
openstackgerritMatt Riedemann proposed openstack/nova master: Add volume-backed evacuate test  https://review.openstack.org/60439720:00
openstackgerritMatt Riedemann proposed openstack/nova master: Run evacuate tests with local/lvm and shared/rbd storage  https://review.openstack.org/60440020:00
*** mdbooth has joined #openstack-nova20:10
imacdonnmriedem: can I ask a "dumb" question or two about upgrade checks?20:18
mriedemyes20:18
imacdonnso ... my understanding of "nova-status upgrade check" is that it's something that would be run *after* upgrading (db sync, etc), to check that everything is OK to proceed20:19
imacdonnnow it sounds like you want to do checks for things that should be done BEFORE the upgrade in there20:19
imacdonnwhich is it?20:19
mriedemit's meant to be run before starting new code20:22
mriedembut that's not really a hard and fast rule20:22
imacdonnbut ... before or after upgrading the database ?20:22
*** mdbooth has quit IRC20:22
mriedemi.e. you can also run the nova-status upgrade check as a post-install step for a fresh install20:22
imacdonn(databases)20:22
mriedemafter20:22
imacdonnOK, so then ... it seems like it's not the right place for pre-upgrade checks20:23
*** med_ has quit IRC20:23
imacdonnthere could be things you'd want to check before you try to upgrade the databases20:23
mriedemwell, depends on what your db upgrades are doing20:23
mriedemare they doing data migrations during db sync?20:23
mriedemb/c they really shouldn't20:24
imacdonnhmm, I guess I don't know enough about the db internals ... I kinda thought that that's what db sync does20:24
imacdonnif not where, where should the migrations happen? on first startup after upgrade ?20:25
mriedemnova's db sync routines which lay down schema are primarily only for additive schema changes, like adding tables, columns and indexes/constraints20:25
mriedemnot for things that involve data migrations20:25
mriedemduring runtime20:25
mriedeme.g. if you need to change the format for some value stored in the db, check on read and update on write20:26
mriedemnova has moved several things from the 'cell' db to the api db, and during that process our routine is to read from the api db first, if not there, read from the cell db, and then migrate20:26
mriedemwe also have commands for performing those data migration in batches20:26
mriedemnova-manage db online_data_migrations20:26
imacdonnhmmm ... that's probably documented somewhere, but I haven't run across it yet ... is there a good description of the right sequence of events for upgrades somewhere?20:28
mriedemhave you read through https://docs.openstack.org/nova/latest/reference/upgrade-checks.html ?20:28
imacdonndon't think I'd seen that one ... will study it20:29
mriedemso having said that, this is how nova does upgrades,20:30
imacdonnbut back to the checks ... I think it may be a good idea, especially if you're trying to make this a generic framework, so have places for pre- and post-upgrade checking20:30
mriedemwhich isn't going to be how everyone does it20:30
mriedemwell, pre and post upgrade are pretty fuzzy,20:30
mriedemthe general rule i try to follow is how idempotent can i write the check such that anyone can run it at anytime20:30
mriedembe that before the db sync with new code, after that but before new code starts running, after new code is running, etc20:31
mriedemi know that doesn't help you much here...20:31
mriedemit makes more sense when you have something you actually need to write a check for,20:31
mriedeme.g. if your release notes say, "make sure you do x before upgrading to stein" then that's a pretty obvious thing to check (if you can)20:32
imacdonnI can sortof see that ... but it seems that what constitutes "OK to start the upgrade" vs. "the upgrade did everything it was supposed to, and you can start services now" may be different20:32
imacdonnLooking at the output of 'nova-status upgrade check', I see one of the items is "Request Spec Migration"20:38
imacdonnhaven't looked to see exactly what that is, but if it's a migration, and migrations don't happen during sync, and you're supposed to do the upgrade check before running the new code ..............20:38
mriedemso the story on that one is,20:39
mriedemnova added this thing called a request spec in newton,20:39
mriedemand has compatibility code all over the place for instances created before newton that don't have a related request spec record in the db,20:40
mriedemwe have an online data migration that operators can run to create records for old instances,20:40
mriedemthe upgrade check was added because i want to drop that compatibility code in stein,20:40
mriedemwhich means, before you get to stein and restart services with stein code (which could have dropped that compatibility), you can run that check and see, oh i better finish my homework - it's been due for 2 years20:41
imacdonnso ... if we're running this check after doing the db sync with the stein code, but before we can start up the services with the new code, can we still do the online migration ?20:42
mriedemso the way upgrades work in grenade for nova is: lay down new code, sync the db schema for the new models, run the online data migrations, restart the services20:43
mriedem*with nova-status upgrade check in between those last 220:43
mriedemsure you can20:43
mriedemthe online data migrations CLI in nova just needs access to the config and db20:43
mriedemnone of that goes over rpc or rest api20:44
*** munimeha1 has quit IRC20:44
mriedemotherwise you can't FFU20:44
imacdonnso "online" means that it's OK to do online, not that it has to be done online? or am I completely misunderstanding what "online" means ?20:45
mriedemthe 'online_data_migrations' name might be a bad name20:46
mriedemit just means,20:47
mriedemnot offline like during a db sync when the controller is down20:47
mriedemlike how data migrations were done during db sync in the long ago20:47
mriedemwhich meant operators could have substantial downtime in the control plane20:47
imacdonnok20:48
mriedemwhich project are you looking to do the upgrade checks for btw?20:49
imacdonnso I need to digest the whole upgrade flow a bit more (maybe after I digest lunch) .... but I still think it's worth at least considering pre/post-upgrade checks in general20:49
imacdonnI'm trying to be a good citizen and 'do the right thing' for all projects .. or all of the ones that I uses, which is mostly the core ones20:50
imacdonnbased on your ML posts a while back, I added 'nova-status upgrade check', but it's not quite right, as I'm running it after starting the services20:51
imacdonnmaybe mostly because currently placement is considered a nova service, at least in my deployment mechanism20:52
imacdonnI may try hacking in sometihng to start placement individually before doing the upgrade check, then start the rest of the (nova) services20:53
imacdonnor maybe I'll worry about that for stein20:53
mriedem"I added 'nova-status upgrade check', but it's not quite right, as I'm running it after starting the services" - as i said, that's also acceptable in the case of nova and it's even in our install docs: https://docs.openstack.org/nova/latest/install/verify.html20:54
mriedemfor a fresh install i mean20:54
mriedemflexibility and idempotency are kind of the key things here20:55
imacdonnWell, the description does say "Performs a release-specific readiness check before restarting services with new code"20:55
imacdonnhttps://docs.openstack.org/nova/latest/cli/nova-status.html20:56
imacdonnbut yeah ... I was basically using it as a validation that "everything went OK with the nova upgrade"20:56
openstackgerritMatt Riedemann proposed openstack/nova master: DNM: Test against mdbooth's evacuate patch  https://review.openstack.org/60442320:56
imacdonnre fresh install vs upgrade, I basically perform the same steps in both cases (that idempotence thing)20:58
mriedemyeah some of the wording is a bit dated and was written when the initial change in ocata was really for before the new code was started up21:01
mriedembut that's still how we do it in grenade21:02
imacdonnwondering if there might be a case where you really do want to check for something before starting the new code, because otherwise the new code might try to do something that would turn out to be catastrophic21:03
mriedemwell, yes, you want to run it after starting new code21:04
mriedemguh, sorry, typo21:05
mriedembefore starting new code21:05
mriedemthat's the idea21:05
mriedemput it in a venv or container and run it21:05
*** sambetts|afk has quit IRC21:12
*** sambetts_ has joined #openstack-nova21:15
*** mchlumsky has quit IRC21:30
*** med_ has joined #openstack-nova21:31
*** ivve has quit IRC21:38
*** med_ has quit IRC21:44
openstackgerritMatt Riedemann proposed openstack/nova master: Add some more docs for upgrade checkers  https://review.openstack.org/60448621:47
*** dave-mccowan has quit IRC22:04
*** mriedem is now known as mriedem_away22:09
imacdonnmriedem_away: On a slightly related note; is there a reason that this do like .where(compute_nodes.c.deleted==0) ? https://github.com/openstack/nova/blob/master/nova/cmd/status.py#L111-L13022:26
imacdonnerm, I mean; ... that this doesn't* do like .....22:29
imacdonnsee also https://bugs.launchpad.net/nova/+bug/175720722:32
openstackLaunchpad bug 1757207 in OpenStack Compute (nova) "compute resource providers not equal to compute nodes in deployment" [Undecided,Incomplete]22:32
*** tbachman has quit IRC22:55
*** mrjk has quit IRC22:56
*** mrjk has joined #openstack-nova22:57
*** janki has joined #openstack-nova23:13
*** janki has quit IRC23:28
*** tbachman has joined #openstack-nova23:29
*** maciejjozefczyk has quit IRC23:31
*** dpawlik has joined #openstack-nova23:34
*** tbachman has quit IRC23:34
*** mschuppert has quit IRC23:35
*** tbachman has joined #openstack-nova23:37
*** dpawlik has quit IRC23:38
*** medberry has joined #openstack-nova23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!