*** baoli has quit IRC | 00:00 | |
*** Swami has quit IRC | 00:01 | |
*** smatzek has quit IRC | 00:01 | |
*** baoli has joined #openstack-nova | 00:01 | |
*** penick has quit IRC | 00:04 | |
*** catintheroof has quit IRC | 00:06 | |
*** mingyu has quit IRC | 00:11 | |
*** mingyu has joined #openstack-nova | 00:14 | |
*** gbarros has joined #openstack-nova | 00:15 | |
*** thorst has quit IRC | 00:15 | |
*** gbarros has quit IRC | 00:17 | |
*** yangyapeng has joined #openstack-nova | 00:18 | |
*** yangyapeng has quit IRC | 00:23 | |
*** alex_xu has joined #openstack-nova | 00:25 | |
*** alex_xu has quit IRC | 00:25 | |
*** alex_xu has joined #openstack-nova | 00:25 | |
*** yingjun has joined #openstack-nova | 00:26 | |
*** thorst has joined #openstack-nova | 00:26 | |
*** gbarros has joined #openstack-nova | 00:28 | |
*** rcernin has quit IRC | 00:29 | |
sean-k-mooney | dansmith: qq im setting up the live migration environmnet for the multi port binding work | 00:30 |
---|---|---|
sean-k-mooney | devstack complete sucessfully but i dont think i registerd the hyperviors correctly in the toplevel api db http://paste.openstack.org/show/622233/ | 00:30 |
sean-k-mooney | do you know where the doc for how to fix that are i think i have to run a nova-manage command but i cant remember | 00:31 |
sean-k-mooney | i think i need to run nova-manage cell_v2 discover_hosts? | 00:32 |
dansmith | sean-k-mooney: discover-hosts? | 00:33 |
sean-k-mooney | nova-manage cell_v2 list_cells | 00:33 |
dansmith | nova-manage cell_v2 discover_hosts --verbose | 00:33 |
sean-k-mooney | nova-manage cell_v2 discover_hosts --verbose | 00:33 |
sean-k-mooney | wronge terminal | 00:33 |
dansmith | heh | 00:33 |
dansmith | er, I mean: | 00:33 |
dansmith | Password: | 00:34 |
sean-k-mooney | hehe | 00:34 |
sean-k-mooney | ya that fixed it | 00:34 |
dansmith | cool | 00:34 |
sean-k-mooney | am i guess this might be a bug in devstack then. | 00:34 |
dansmith | sean-k-mooney: it's just because you have multiple nodes | 00:35 |
dansmith | devstack-gate does the final discover after both are done in that case | 00:35 |
sean-k-mooney | yes though i would have expected this to be part the n-cpu service install | 00:35 |
dansmith | well, | 00:36 |
dansmith | in our multi-node setups, the second node can't see the database on purpose, so it can't do that | 00:36 |
dansmith | but I guess you could make it conditional in devstack so it was graceful | 00:36 |
sean-k-mooney | oh ya right so it has to run on the controler | 00:36 |
dansmith | yeah | 00:36 |
sean-k-mooney | ok that makes sense well i know for the future havent done multi node with devstack in a while | 00:37 |
sean-k-mooney | thanks for the help | 00:37 |
*** zhurong has joined #openstack-nova | 00:38 | |
*** itlinux has joined #openstack-nova | 00:38 | |
*** smatzek has joined #openstack-nova | 00:38 | |
*** thorst has quit IRC | 00:40 | |
*** smatzek has quit IRC | 00:41 | |
*** yingjun has quit IRC | 00:43 | |
dansmith | np | 00:46 |
*** thorst has joined #openstack-nova | 00:47 | |
*** thorst has quit IRC | 00:51 | |
*** erlon has quit IRC | 00:53 | |
*** thorst has joined #openstack-nova | 00:58 | |
*** thorst has quit IRC | 01:00 | |
*** thorst has joined #openstack-nova | 01:00 | |
*** thorst_ has joined #openstack-nova | 01:01 | |
*** swebster_ has joined #openstack-nova | 01:01 | |
*** swebster has quit IRC | 01:02 | |
*** huanxie has joined #openstack-nova | 01:04 | |
*** thorst has quit IRC | 01:04 | |
*** crushil has joined #openstack-nova | 01:04 | |
*** thorst_ has quit IRC | 01:05 | |
*** TuanLA has joined #openstack-nova | 01:06 | |
*** phuongnh has joined #openstack-nova | 01:08 | |
*** mriedem_dinner is now known as mriedem | 01:11 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: List/show all server migration types (1/2) https://review.openstack.org/430608 | 01:14 |
*** coreywright has quit IRC | 01:14 | |
*** chyka has joined #openstack-nova | 01:17 | |
*** yangyape_ has joined #openstack-nova | 01:17 | |
openstackgerrit | Naichuan Sun proposed openstack/nova master: xenapi: Support live migration in pooled multi-nodes environment https://review.openstack.org/489451 | 01:18 |
*** gjayavelu has quit IRC | 01:19 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: List/show all server migration types (1/2) https://review.openstack.org/430608 | 01:19 |
*** gbarros has quit IRC | 01:22 | |
*** Apoorva has quit IRC | 01:25 | |
*** litao__ has joined #openstack-nova | 01:25 | |
*** Shunli has joined #openstack-nova | 01:27 | |
*** sbezverk has joined #openstack-nova | 01:31 | |
*** Sukhdev has quit IRC | 01:31 | |
*** coreywright has joined #openstack-nova | 01:33 | |
*** zhouyaguo has joined #openstack-nova | 01:35 | |
*** yamamoto has joined #openstack-nova | 01:36 | |
*** markvoelker has joined #openstack-nova | 01:38 | |
*** itlinux has quit IRC | 01:39 | |
*** yamamoto has quit IRC | 01:44 | |
*** zhurong has quit IRC | 01:50 | |
*** zhurong has joined #openstack-nova | 01:59 | |
*** thorst has joined #openstack-nova | 02:02 | |
*** gyee has quit IRC | 02:09 | |
*** hongbin has joined #openstack-nova | 02:13 | |
*** markvoelker has quit IRC | 02:13 | |
*** dave-mcc_ has quit IRC | 02:13 | |
*** ijw has quit IRC | 02:16 | |
*** ijw has joined #openstack-nova | 02:16 | |
*** ijw has quit IRC | 02:17 | |
*** hongbin_ has joined #openstack-nova | 02:19 | |
*** rcernin has joined #openstack-nova | 02:20 | |
*** hongbin has quit IRC | 02:21 | |
*** Tom has joined #openstack-nova | 02:23 | |
*** itlinux has joined #openstack-nova | 02:24 | |
*** chyka has quit IRC | 02:25 | |
*** spotz has quit IRC | 02:29 | |
*** lbragstad has joined #openstack-nova | 02:31 | |
*** zhouyaguo has quit IRC | 02:33 | |
*** zhouyaguo has joined #openstack-nova | 02:33 | |
*** yamamoto has joined #openstack-nova | 02:36 | |
*** spotz has joined #openstack-nova | 02:37 | |
*** mingyu has quit IRC | 02:44 | |
*** mingyu has joined #openstack-nova | 02:47 | |
*** esberglu has joined #openstack-nova | 02:49 | |
*** itlinux has quit IRC | 02:50 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: List/show all server migration types (2/2) https://review.openstack.org/459483 | 02:52 |
*** esberglu has quit IRC | 02:53 | |
*** armax has quit IRC | 03:04 | |
*** markvoelker has joined #openstack-nova | 03:10 | |
openstackgerrit | Takashi NATSUME proposed openstack/python-novaclient master: Microversion 2.54 - List/Show all server migration types https://review.openstack.org/430839 | 03:10 |
*** zhurong has quit IRC | 03:12 | |
*** baoli has quit IRC | 03:26 | |
*** hongbin_ has quit IRC | 03:28 | |
*** markvoelker has quit IRC | 03:42 | |
openstackgerrit | Philip Choi proposed openstack/nova master: Add warning message for cache_utils connection failure https://review.openstack.org/501928 | 03:47 |
*** cfriesen has quit IRC | 03:48 | |
*** udesale has joined #openstack-nova | 03:48 | |
*** mdnadeem has joined #openstack-nova | 03:50 | |
*** lbragstad has quit IRC | 04:00 | |
*** links has joined #openstack-nova | 04:02 | |
*** zhurong has joined #openstack-nova | 04:21 | |
*** zhouyaguo has quit IRC | 04:26 | |
*** zhouyaguo has joined #openstack-nova | 04:26 | |
*** hieulq has quit IRC | 04:27 | |
*** trungnv has quit IRC | 04:27 | |
*** TuanLA has quit IRC | 04:27 | |
*** trungnv has joined #openstack-nova | 04:28 | |
*** TuanLA has joined #openstack-nova | 04:28 | |
*** hieulq has joined #openstack-nova | 04:28 | |
*** yangyape_ has quit IRC | 04:33 | |
*** yangyapeng has joined #openstack-nova | 04:33 | |
*** esberglu has joined #openstack-nova | 04:37 | |
*** markvoelker has joined #openstack-nova | 04:39 | |
*** esberglu has quit IRC | 04:42 | |
*** Sukhdev has joined #openstack-nova | 04:43 | |
openstackgerrit | zhangyangyang proposed openstack/nova master: Move libvirts qemu-img support to privsep https://review.openstack.org/507848 | 04:55 |
*** psachin has joined #openstack-nova | 04:56 | |
*** sridharg has joined #openstack-nova | 05:03 | |
*** markvoelker has quit IRC | 05:12 | |
*** ratailor has joined #openstack-nova | 05:14 | |
*** Shunli has quit IRC | 05:15 | |
*** rcernin has quit IRC | 05:15 | |
*** zhouyaguo has quit IRC | 05:18 | |
*** zhouyaguo has joined #openstack-nova | 05:18 | |
*** armax has joined #openstack-nova | 05:23 | |
*** pcaruana has joined #openstack-nova | 05:24 | |
*** stvnoyes has quit IRC | 05:26 | |
*** yangyapeng has quit IRC | 05:27 | |
*** yangyapeng has joined #openstack-nova | 05:27 | |
*** takashin has left #openstack-nova | 05:27 | |
*** stvnoyes has joined #openstack-nova | 05:29 | |
*** pcaruana has quit IRC | 05:29 | |
*** vishwana_ has joined #openstack-nova | 05:35 | |
*** lpetrut has joined #openstack-nova | 05:35 | |
*** vishwan__ has joined #openstack-nova | 05:36 | |
*** zhouyaguo has quit IRC | 05:36 | |
*** zhouyaguo has joined #openstack-nova | 05:37 | |
*** vishwanathj has quit IRC | 05:37 | |
*** Sukhdev has quit IRC | 05:37 | |
*** vishwana_ has quit IRC | 05:39 | |
*** yangyapeng has quit IRC | 05:39 | |
*** yangyapeng has joined #openstack-nova | 05:41 | |
*** yangyape_ has joined #openstack-nova | 05:44 | |
*** yangyapeng has quit IRC | 05:44 | |
*** Tom has quit IRC | 05:44 | |
*** Tom has joined #openstack-nova | 05:45 | |
*** moshele has joined #openstack-nova | 05:51 | |
*** artom has joined #openstack-nova | 05:52 | |
*** rcernin has joined #openstack-nova | 05:52 | |
*** artom has quit IRC | 05:52 | |
*** artom has joined #openstack-nova | 05:53 | |
*** yamamoto_ has joined #openstack-nova | 05:53 | |
*** yangyape_ has quit IRC | 05:53 | |
*** artom has quit IRC | 05:53 | |
*** artom has joined #openstack-nova | 05:54 | |
*** artom has quit IRC | 05:54 | |
*** artom has joined #openstack-nova | 05:55 | |
*** artom has quit IRC | 05:55 | |
*** artom has joined #openstack-nova | 05:56 | |
*** artom has quit IRC | 05:56 | |
*** yamamoto has quit IRC | 05:57 | |
*** artom has joined #openstack-nova | 05:57 | |
*** josecastroleon has quit IRC | 06:00 | |
*** yangyapeng has joined #openstack-nova | 06:01 | |
*** yangyape_ has joined #openstack-nova | 06:02 | |
*** lpetrut has quit IRC | 06:02 | |
*** sahid has joined #openstack-nova | 06:04 | |
*** yangyapeng has quit IRC | 06:06 | |
*** ratailor is now known as rtailor | 06:06 | |
*** lpetrut has joined #openstack-nova | 06:07 | |
*** markvoelker has joined #openstack-nova | 06:09 | |
*** Oku_OS-away is now known as Oku_OS | 06:14 | |
*** masber has joined #openstack-nova | 06:15 | |
*** crushil has quit IRC | 06:19 | |
*** jmlowe has quit IRC | 06:20 | |
*** esberglu has joined #openstack-nova | 06:25 | |
*** andreas_s has joined #openstack-nova | 06:29 | |
*** esberglu has quit IRC | 06:29 | |
*** mdnadeem has quit IRC | 06:30 | |
*** lpetrut has quit IRC | 06:38 | |
*** artom has quit IRC | 06:42 | |
*** markvoelker has quit IRC | 06:43 | |
*** artom has joined #openstack-nova | 06:43 | |
*** artom has quit IRC | 06:44 | |
*** artom has joined #openstack-nova | 06:45 | |
*** artom has quit IRC | 06:45 | |
*** mdnadeem has joined #openstack-nova | 06:45 | |
*** artom has joined #openstack-nova | 06:46 | |
*** avolkov has joined #openstack-nova | 06:48 | |
*** mdnadeem_ has joined #openstack-nova | 06:48 | |
*** yangyape_ has quit IRC | 06:51 | |
*** mdnadeem has quit IRC | 06:51 | |
*** yingjun has joined #openstack-nova | 06:51 | |
*** yangyapeng has joined #openstack-nova | 06:51 | |
*** pcaruana has joined #openstack-nova | 07:04 | |
*** lpetrut has joined #openstack-nova | 07:11 | |
*** yangyapeng has quit IRC | 07:13 | |
*** yangyapeng has joined #openstack-nova | 07:14 | |
*** yangyape_ has joined #openstack-nova | 07:24 | |
*** lpetrut has quit IRC | 07:27 | |
*** yangyapeng has quit IRC | 07:27 | |
*** lpetrut has joined #openstack-nova | 07:27 | |
*** phuongnh has quit IRC | 07:31 | |
*** TuanLA has quit IRC | 07:31 | |
*** masber has quit IRC | 07:31 | |
*** TuanLA has joined #openstack-nova | 07:32 | |
*** phuongnh has joined #openstack-nova | 07:32 | |
*** tssurya has joined #openstack-nova | 07:32 | |
*** yangyapeng has joined #openstack-nova | 07:32 | |
*** yangyap__ has joined #openstack-nova | 07:34 | |
*** yangyapeng has quit IRC | 07:34 | |
*** yangyape_ has quit IRC | 07:35 | |
*** lpetrut has quit IRC | 07:39 | |
*** jpena|off is now known as jpena | 07:39 | |
*** markvoelker has joined #openstack-nova | 07:40 | |
*** Guest93 has quit IRC | 07:42 | |
*** yangyapeng has joined #openstack-nova | 07:44 | |
*** yangyap__ has quit IRC | 07:44 | |
*** yangyapeng has quit IRC | 07:44 | |
*** yangyapeng has joined #openstack-nova | 07:45 | |
*** yangyape_ has joined #openstack-nova | 07:49 | |
*** yangyapeng has quit IRC | 07:49 | |
*** armax has quit IRC | 07:57 | |
*** mdnadeem_ has quit IRC | 08:00 | |
*** hferenc has joined #openstack-nova | 08:01 | |
*** moshele has quit IRC | 08:03 | |
*** phuongnh has quit IRC | 08:03 | |
*** TuanLA has quit IRC | 08:03 | |
*** TuanLA has joined #openstack-nova | 08:04 | |
*** phuongnh has joined #openstack-nova | 08:04 | |
*** yangyapeng has joined #openstack-nova | 08:07 | |
*** yangyape_ has quit IRC | 08:09 | |
openstackgerrit | melanie witt proposed openstack/nova master: WIP Improve the CellDatabases test fixture and usage https://review.openstack.org/508432 | 08:09 |
*** markvoelker has quit IRC | 08:12 | |
*** esberglu has joined #openstack-nova | 08:13 | |
*** esberglu has quit IRC | 08:18 | |
*** zhouyaguo has quit IRC | 08:23 | |
*** ralonsoh has joined #openstack-nova | 08:25 | |
*** zhouyaguo has joined #openstack-nova | 08:30 | |
*** yangyapeng has quit IRC | 08:36 | |
*** yangyapeng has joined #openstack-nova | 08:36 | |
*** jaosorior has joined #openstack-nova | 08:37 | |
*** alexchadin has joined #openstack-nova | 08:37 | |
*** belmoreira has joined #openstack-nova | 08:38 | |
*** sbezverk has quit IRC | 08:38 | |
*** trinaths has joined #openstack-nova | 08:49 | |
*** sapcc-bot has joined #openstack-nova | 08:50 | |
*** dgonzalez_ has joined #openstack-nova | 08:50 | |
*** mkoderer_ has joined #openstack-nova | 08:50 | |
*** carthaca_ has joined #openstack-nova | 08:50 | |
*** david_1 has joined #openstack-nova | 08:50 | |
*** carthaca_ has quit IRC | 08:52 | |
*** mkoderer_ has quit IRC | 08:52 | |
*** dgonzalez_ has quit IRC | 08:52 | |
*** david_1 has quit IRC | 08:52 | |
*** chyka has joined #openstack-nova | 08:55 | |
*** chyka has quit IRC | 09:00 | |
*** mriedem has quit IRC | 09:01 | |
*** yamamoto_ has quit IRC | 09:01 | |
*** andreas_s_ has joined #openstack-nova | 09:01 | |
*** andreas_s has quit IRC | 09:05 | |
*** markvoelker has joined #openstack-nova | 09:09 | |
*** Tom has quit IRC | 09:15 | |
*** Tom has joined #openstack-nova | 09:16 | |
*** Tom has quit IRC | 09:21 | |
*** yamamoto has joined #openstack-nova | 09:29 | |
*** mingyu_ has joined #openstack-nova | 09:29 | |
*** mingyu has quit IRC | 09:32 | |
*** yamamoto has quit IRC | 09:32 | |
*** mingyu has joined #openstack-nova | 09:32 | |
*** mingyu_ has quit IRC | 09:36 | |
*** mingyu_ has joined #openstack-nova | 09:38 | |
*** yamamoto has joined #openstack-nova | 09:40 | |
*** mingyu has quit IRC | 09:42 | |
*** udesale has quit IRC | 09:42 | |
*** sambetts|afk is now known as sambetts | 09:42 | |
*** markvoelker has quit IRC | 09:43 | |
*** mingyu_ has quit IRC | 09:45 | |
*** alexchadin has quit IRC | 09:47 | |
*** alexchadin has joined #openstack-nova | 09:48 | |
*** cdent has joined #openstack-nova | 09:48 | |
*** yingjun has quit IRC | 09:52 | |
*** yamamoto has quit IRC | 09:54 | |
*** mingyu has joined #openstack-nova | 09:58 | |
*** esberglu has joined #openstack-nova | 10:01 | |
*** yamamoto has joined #openstack-nova | 10:01 | |
*** avolkov has quit IRC | 10:02 | |
*** avolkov has joined #openstack-nova | 10:02 | |
*** flanders_ has joined #openstack-nova | 10:04 | |
*** trungnv has quit IRC | 10:05 | |
*** esberglu has quit IRC | 10:06 | |
*** jgriffith has quit IRC | 10:08 | |
* stephenfin would like dansmith to know that he still has dibs on 'nova/conf/network.py' when nova-net goes. dansmith can have _evvvverything_ else :) | 10:10 | |
*** jgriffith has joined #openstack-nova | 10:14 | |
*** derekh has joined #openstack-nova | 10:22 | |
*** trinaths has left #openstack-nova | 10:23 | |
openstackgerrit | Stephen Finucane proposed openstack/nova master: setup.cfg: Explicitly set [build_sphinx] builders https://review.openstack.org/508483 | 10:24 |
*** hieulq has quit IRC | 10:24 | |
*** mingyu has quit IRC | 10:24 | |
*** Tom has joined #openstack-nova | 10:24 | |
*** TuanLA has quit IRC | 10:27 | |
*** masber has joined #openstack-nova | 10:28 | |
*** Tom has quit IRC | 10:29 | |
*** mingyu has joined #openstack-nova | 10:29 | |
*** masber has quit IRC | 10:32 | |
*** moshele has joined #openstack-nova | 10:32 | |
*** mingyu has quit IRC | 10:34 | |
*** mingyu has joined #openstack-nova | 10:34 | |
openstackgerrit | John Garbutt proposed openstack/nova-specs master: Support traits in the Ironic driver https://review.openstack.org/507052 | 10:35 |
*** yangyapeng has quit IRC | 10:36 | |
*** zhurong has quit IRC | 10:36 | |
*** phuongnh has quit IRC | 10:37 | |
*** yangyapeng has joined #openstack-nova | 10:37 | |
*** yangyapeng has quit IRC | 10:38 | |
*** mingyu has quit IRC | 10:38 | |
*** mingyu has joined #openstack-nova | 10:38 | |
*** markvoelker has joined #openstack-nova | 10:40 | |
*** mingyu has quit IRC | 10:40 | |
*** alexchadin has quit IRC | 10:41 | |
*** mingyu has joined #openstack-nova | 10:42 | |
*** mingyu has quit IRC | 10:46 | |
*** mingyu has joined #openstack-nova | 10:46 | |
*** mingyu_ has joined #openstack-nova | 10:48 | |
*** mingyu has quit IRC | 10:51 | |
cdent | gibi: in the nova meeting last night it was mentioned that you need somewhere to host some burndown stuff. I’ve got some space that could work | 10:55 |
gibi | cdent: hi! thanks for the offer. | 11:02 |
*** mingyu_ has quit IRC | 11:03 | |
gibi | cdent: the burndown is basically a static html + js and a python script called from cron to generate some data that the js code draws | 11:03 |
gibi | cdent: https://github.com/gibizer/nova-versioned-notification-transformation-burndown | 11:03 |
gibi | it was run on OpenShift 2.0 but that is retired and 3.0 does not support cron jobs in the free tier any more | 11:04 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: conf: Fix indentation of database options https://review.openstack.org/443097 | 11:04 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: conf: Resolve TODOs in 'database' https://review.openstack.org/393695 | 11:04 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: conf: Remove 'db_driver' config opt https://review.openstack.org/508487 | 11:04 |
stephenfin | bauzas: Easy +W here (it's a typo fix) https://review.openstack.org/#/c/489028/ | 11:05 |
* cdent looks at the repo | 11:05 | |
gibi | cdent: I'm happy to rework the code to fitt it to your env if needed | 11:06 |
cdent | it looks pretty straightforward, let me do a quick poke | 11:08 |
*** alexchadin has joined #openstack-nova | 11:10 | |
*** markvoelker has quit IRC | 11:12 | |
*** andreas_s_ has quit IRC | 11:12 | |
cdent | gibi: http://burndown.peermore.com/nova-notification/ | 11:14 |
cdent | how often should the cron job run? | 11:14 |
gibi | until now it run hourly | 11:17 |
*** sapd_ has quit IRC | 11:17 | |
*** sapd_ has joined #openstack-nova | 11:17 | |
*** sapd_ has quit IRC | 11:17 | |
gibi | so if that not a problem for you then let's do it that way | 11:17 |
gibi | thanks for moving it to your server | 11:17 |
gibi | :) | 11:17 |
*** sapd_ has joined #openstack-nova | 11:18 | |
cdent | yeah, hourly is fine with me | 11:18 |
gibi | cdent: I really appreciate your hosting. It saved me at least couple of days of work finding another free hosting and adapting to it. | 11:19 |
cdent | my pleasure, it’s easy enough to do, you already have all the necessary bits in the repo, very simply put together | 11:20 |
cdent | should update every hour on the hour now | 11:20 |
gibi | cdent: sometimes I have to update the to_be_transformed file in the repo (mostly due to decisions not to transform someting). So I will let you know if you need to pull from github | 11:20 |
cdent | cool, i’ve got it set up so that a pull is all that’s need | 11:21 |
gibi | awesome | 11:21 |
gibi | thanks again | 11:21 |
*** edmondsw has quit IRC | 11:21 | |
cdent | could probably even cron that too I suppose | 11:21 |
cdent | but for now let’s just do it manually by you telling me | 11:22 |
gibi | sure, that totall works for me | 11:22 |
* cdent gets VC funding for burndown as a service | 11:22 | |
*** adisky has quit IRC | 11:23 | |
*** sapd_ has quit IRC | 11:23 | |
*** sapd_ has joined #openstack-nova | 11:24 | |
*** alexchadin has quit IRC | 11:24 | |
*** Tom__ has joined #openstack-nova | 11:25 | |
*** smatzek has joined #openstack-nova | 11:27 | |
*** Tom__ has quit IRC | 11:30 | |
*** alexchadin has joined #openstack-nova | 11:30 | |
*** hferenc has quit IRC | 11:32 | |
*** zhouyaguo has quit IRC | 11:35 | |
*** yangyapeng has joined #openstack-nova | 11:35 | |
*** yangyapeng has quit IRC | 11:36 | |
*** yangyapeng has joined #openstack-nova | 11:36 | |
*** sri_ has joined #openstack-nova | 11:37 | |
sri_ | hey folks: is there any solution for take instance snapshot if instance created form volume ? | 11:38 |
*** mingyu has joined #openstack-nova | 11:40 | |
*** alexchadin has quit IRC | 11:42 | |
*** alexchadin has joined #openstack-nova | 11:43 | |
*** mnestratov has joined #openstack-nova | 11:43 | |
*** jpena is now known as jpena|lunch | 11:43 | |
openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/os-vif master: Move 'ips' field from Subnet object to VIF object https://review.openstack.org/508498 | 11:45 |
*** huanxie has quit IRC | 11:47 | |
*** chyka has joined #openstack-nova | 11:49 | |
*** tylerderosagrund has joined #openstack-nova | 11:51 | |
*** alexchadin has quit IRC | 11:52 | |
*** litao__ has quit IRC | 11:52 | |
*** baoli has joined #openstack-nova | 11:53 | |
*** armax has joined #openstack-nova | 11:53 | |
*** chyka has quit IRC | 11:54 | |
*** mingyu has quit IRC | 11:57 | |
*** liverpooler has joined #openstack-nova | 11:58 | |
*** thorst has quit IRC | 12:00 | |
*** thorst has joined #openstack-nova | 12:00 | |
*** manasm has joined #openstack-nova | 12:01 | |
*** sapd__ has joined #openstack-nova | 12:03 | |
*** sapd__ has quit IRC | 12:03 | |
*** sapd_ has quit IRC | 12:03 | |
*** sapd__ has joined #openstack-nova | 12:04 | |
*** esberglu has joined #openstack-nova | 12:09 | |
*** markvoelker has joined #openstack-nova | 12:09 | |
*** baoli has quit IRC | 12:10 | |
*** alexchadin has joined #openstack-nova | 12:10 | |
gibi | cdent: I have a question and a nit in https://review.openstack.org/#/c/485209 | 12:10 |
*** edmondsw has joined #openstack-nova | 12:13 | |
*** rtailor has quit IRC | 12:13 | |
* cdent looks | 12:16 | |
*** MVenesio has joined #openstack-nova | 12:20 | |
*** edleafe is now known as figleaf | 12:21 | |
johnthetubaguy | figleaf: I asked an upgrade question on your spec, I missed it last time :( | 12:25 |
*** tylerderosagrund has quit IRC | 12:25 | |
johnthetubaguy | figleaf: its not a hard question, and I left the answer... but we usually require that to be described in the spec. | 12:25 |
*** mingyu has joined #openstack-nova | 12:27 | |
*** markvoelker has quit IRC | 12:29 | |
* cdent goes on a coffee journey | 12:29 | |
*** markvoelker has joined #openstack-nova | 12:29 | |
*** cdent has quit IRC | 12:29 | |
*** 07IAA8DSW has joined #openstack-nova | 12:29 | |
*** 5EXAACMRJ has joined #openstack-nova | 12:29 | |
*** 07IAA8DSW has quit IRC | 12:33 | |
*** 5EXAACMRJ has quit IRC | 12:34 | |
*** jmlowe has joined #openstack-nova | 12:35 | |
*** hemna_ has joined #openstack-nova | 12:35 | |
*** hoonetorg has joined #openstack-nova | 12:35 | |
*** hferenc has joined #openstack-nova | 12:36 | |
*** tonygunk has joined #openstack-nova | 12:41 | |
*** manasm has quit IRC | 12:42 | |
*** pchavva has joined #openstack-nova | 12:44 | |
johnthetubaguy | cdent: is that what happens you have *lots* of coffee and everything in the world seems fixable? | 12:44 |
openstackgerrit | Elod Illes proposed openstack/nova master: WIP: Transform scheduler.select_destinations notification https://review.openstack.org/508506 | 12:45 |
figleaf | johnthetubaguy: reading and replying now | 12:45 |
*** jpena|lunch is now known as jpena | 12:47 | |
*** smatzek has quit IRC | 12:48 | |
*** jaypipes has joined #openstack-nova | 12:48 | |
*** bnemec has joined #openstack-nova | 12:50 | |
*** armax has quit IRC | 12:54 | |
*** smatzek has joined #openstack-nova | 12:55 | |
*** MVenesio has quit IRC | 12:55 | |
*** lyan has joined #openstack-nova | 12:56 | |
*** baoli has joined #openstack-nova | 12:56 | |
*** mriedem has joined #openstack-nova | 12:57 | |
*** mgariepy has quit IRC | 12:59 | |
*** mgariepy has joined #openstack-nova | 13:01 | |
*** ralonsoh_ has joined #openstack-nova | 13:02 | |
openstackgerrit | John Garbutt proposed openstack/nova master: WIP: possible extra debug info for ironic problem https://review.openstack.org/508508 | 13:02 |
johnthetubaguy | jaypipes: been double checking the ironic resource provider, its current the ComputeNode uuid as the uuid and the Ironic Node uuid and the name | 13:03 |
*** catintheroof has joined #openstack-nova | 13:03 | |
*** jaypipes is now known as leakypipes | 13:04 | |
johnthetubaguy | leakypipes: I think that's why things change when ironic does its rebalance, the uuid changes, but the name stays the same | 13:04 |
leakypipes | johnthetubaguy: on a calll, gimme a few :) | 13:04 |
*** cdent has joined #openstack-nova | 13:05 | |
*** ralonsoh has quit IRC | 13:05 | |
johnthetubaguy | leakypipes: no problems, catch you in a bit | 13:05 |
*** smatzek has quit IRC | 13:06 | |
*** ralonsoh has joined #openstack-nova | 13:07 | |
*** ralonsoh_ has quit IRC | 13:08 | |
mriedem | johnthetubaguy: "its current the ComputeNode uuid as the uuid and the Ironic Node uuid and the name" | 13:09 |
mriedem | that's generic from the resource tracker i think, | 13:09 |
mriedem | but good point | 13:09 |
mriedem | because it's just using the hypervisor_hostname for the RP name for the other drivers, which is the same as the hostname | 13:09 |
mriedem | but for ironic it's the uuid | 13:09 |
johnthetubaguy | yeah, I think its always hypervisor hostname (which can be ironic uuid) | 13:09 |
johnthetubaguy | yeah, +1 | 13:09 |
johnthetubaguy | so this bug is probably more important than I first thought: | 13:09 |
johnthetubaguy | https://bugs.launchpad.net/nova/+bug/1714248 | 13:10 |
openstack | Launchpad bug 1714248 in OpenStack Compute (nova) "Compute node HA for ironic doesn't work due to the name duplication of Resource Provider " [High,Confirmed] | 13:10 |
mriedem | we could put another field in the response from the get_inventory method that includes an optional rp_uuid field or something | 13:10 |
mriedem | to tell the RT what to use | 13:10 |
mriedem | although, | 13:10 |
mriedem | that might break how scheduling works | 13:10 |
johnthetubaguy | but then we will fail looking up the correct rabbit queue I presume? | 13:10 |
mriedem | because the scheduler will lookup a compute node from placement's response by uuid | 13:10 |
mriedem | this has nothing to do with mq | 13:11 |
mriedem | are you thinking the cell mapping stuff? | 13:11 |
johnthetubaguy | well the mapping from the placement object, to the compute node you build the instance on | 13:11 |
cdent | leakypipes: are the slides from your scheduler wars presentations on teh internets somewhere (not the video) | 13:11 |
mriedem | cdent: the slides would also be on the summit video site | 13:11 |
cdent | hmmm | 13:12 |
* cdent tries harder | 13:12 | |
mriedem | or not | 13:12 |
mriedem | https://www.openstack.org/videos/boston-2017/scheduler-wars-a-new-hope | 13:12 |
mriedem | you'll have to get the licensed version from the author :) | 13:12 |
cdent | yeah, that’s where I starte4d | 13:13 |
*** lbragstad has joined #openstack-nova | 13:15 | |
*** smatzek has joined #openstack-nova | 13:17 | |
*** efried is now known as fried_rice | 13:21 | |
*** eharney has joined #openstack-nova | 13:22 | |
*** jamesdenton has quit IRC | 13:25 | |
*** smatzek has quit IRC | 13:27 | |
*** smatzek has joined #openstack-nova | 13:28 | |
johnthetubaguy | fried_rice: added more details on that ironic rebalance bug from my findings this morning https://bugs.launchpad.net/nova/+bug/1714248: | 13:28 |
openstack | Launchpad bug 1714248 in OpenStack Compute (nova) "Compute node HA for ironic doesn't work due to the name duplication of Resource Provider " [High,Confirmed] | 13:28 |
* fried_rice looks... | 13:28 | |
johnthetubaguy | added a patch with some comments in to make it clear where I believe the error occurs | 13:29 |
openstackgerrit | Elod Illes proposed openstack/nova stable/ocata: WIP: Functional test for regression bug #1713783 https://review.openstack.org/505160 | 13:30 |
openstack | bug 1713783 in OpenStack Compute (nova) ocata "After failed evacuation the recovered source compute tries to delete the instance" [High,Triaged] https://launchpad.net/bugs/1713783 | 13:30 |
*** slaweq has quit IRC | 13:30 | |
*** stephenfin is now known as finucannot | 13:30 | |
fried_rice | johnthetubaguy Okay, haven't dug in fully, but... | 13:32 |
*** burt has joined #openstack-nova | 13:32 | |
fried_rice | johnthetubaguy It is legal to rename a RP. | 13:32 |
fried_rice | Would that solve it, or do you actually need to change the RP's UUID too? | 13:32 |
johnthetubaguy | name is the same, uuid is different | 13:32 |
cdent | mriedem: in case you missed it before gibi and I got http://burndown.peermore.com/nova-notification/ going | 13:32 |
fried_rice | boo | 13:32 |
*** smatzek has quit IRC | 13:32 | |
johnthetubaguy | yeah :( | 13:32 |
cdent | using his little framework would be easy to burn lots of other things down | 13:32 |
fried_rice | johnthetubaguy And the original UUID comes from where? | 13:33 |
johnthetubaguy | fried_rice: ComputeNode.uuid | 13:33 |
fried_rice | Which makes sense, I suppose. | 13:33 |
johnthetubaguy | ish, yeah | 13:33 |
fried_rice | johnthetubaguy Is there an entity in this world that stays the same on this failover deal? | 13:34 |
*** dansmith is now known as superdan | 13:34 | |
superdan | finucannot: ack, I'll allow you to retain rights to conf/network | 13:35 |
johnthetubaguy | fried_rice: ironic node uuid, i.e. ComputeNode.hypervisor_hostname and ResourceProvider.name | 13:35 |
*** psachin has quit IRC | 13:36 | |
fried_rice | johnthetubaguy Ohh, so hang on, it really *doesn't* make much sense for the RP UUID to be the compute host UUID. Or at least, it would make just as much sense for it to be the ironic node UUID. | 13:37 |
fried_rice | Though tbh, I'm a tad confused as to why those aren't the same thing. | 13:37 |
johnthetubaguy | fried_rice: except when get the thing back, the uuid, we want it to always be the same thing, in our case a ComputeNode | 13:37 |
*** ijw has joined #openstack-nova | 13:37 | |
johnthetubaguy | I am not 100% sure at this point | 13:38 |
fried_rice | Dangit, I've slept since we started this conversation, need to get the model straight in my head again. | 13:38 |
fried_rice | Hardware-wise, there's a set of machines. These are called "ironic nodes". | 13:38 |
johnthetubaguy | oh wait, that could be the answer, for ironic, we could mess with the ComputeNode.uuid | 13:38 |
fried_rice | Each "ironic node" gets modeled as a separate RP, right? | 13:39 |
johnthetubaguy | fried_rice: https://developer.openstack.org/api-ref/baremetal/#list-nodes | 13:39 |
johnthetubaguy | yeah | 13:39 |
*** links has quit IRC | 13:39 | |
mriedem | cdent: nice | 13:39 |
fried_rice | And the nova-compute process runs... where? On a totally separate machine? | 13:39 |
cdent | mriedem: runs on a cron job every hour. took an _entire five minutes_ to set up | 13:40 |
* cdent is exhausted | 13:40 | |
mriedem | take a break | 13:40 |
*** kenperkins has joined #openstack-nova | 13:40 | |
johnthetubaguy | fried_rice: yeah, noramlly on some controller node | 13:41 |
fried_rice | johnthetubaguy Which is called ComputeNode? | 13:41 |
johnthetubaguy | not really | 13:42 |
johnthetubaguy | ComputeNode is the Nova DB table | 13:42 |
johnthetubaguy | there is one entry for each ironic node | 13:42 |
openstackgerrit | Ed Leafe proposed openstack/nova-specs master: Return Alternate Hosts https://review.openstack.org/504275 | 13:42 |
johnthetubaguy | i.e. one n-cpu Service has one or more compute nodes | 13:43 |
fried_rice | johnthetubaguy So why isn't the ComputeNode.uuid the same as the ironic node UUID, if they represent the same thing? | 13:43 |
johnthetubaguy | fried_rice: I think just history, I am just looking at how hard that would be right now | 13:43 |
superdan | because computenode is a nova structure | 13:44 |
superdan | which is used for everything else too, | 13:44 |
superdan | and because you could have generated those uuids from the existing records when things were offline during a save or forced migration | 13:44 |
*** gouthamr has joined #openstack-nova | 13:44 | |
johnthetubaguy | superdan: agreed | 13:45 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove old compat code from servers ViewBuilder._get_metadata https://review.openstack.org/508326 | 13:45 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Stop joining on system_metadata when listing instances https://review.openstack.org/508335 | 13:45 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove system_metadata loading in Instance._load_flavor https://review.openstack.org/508357 | 13:45 |
johnthetubaguy | superdan: it could be the simplest fix, but all the fixes seem terrible | 13:46 |
superdan | I wasn't following what the problem was | 13:46 |
johnthetubaguy | https://bugs.launchpad.net/nova/+bug/1714248 | 13:46 |
openstack | Launchpad bug 1714248 in OpenStack Compute (nova) "Compute node HA for ironic doesn't work due to the name duplication of Resource Provider " [High,Confirmed] | 13:46 |
mriedem | the rp uuid isn't the ironic node uuid | 13:46 |
mriedem | it's the compute node uuid | 13:46 |
johnthetubaguy | actually, that fix isn't simple in the upgrade case, naturally | 13:46 |
mriedem | johnthetubaguy: was going to say, | 13:46 |
mriedem | existing computes... | 13:46 |
mriedem | you could change the compute node uuid...but not sure what weirdness would happen from that | 13:47 |
superdan | that's hard | 13:47 |
superdan | I don't think changing the uuid of an existing provider, especially with allocations makes sense | 13:47 |
*** gbarros has joined #openstack-nova | 13:47 | |
*** Dinesh_Bhor has quit IRC | 13:48 | |
superdan | the ironic driver probably needs to figure this out some way to avoid having to re-do the allocations | 13:48 |
johnthetubaguy | problem is the allocation is on the ComputeNode.uuid | 13:48 |
superdan | otherwise we have a race I think | 13:48 |
johnthetubaguy | yeah, the race is horrible | 13:48 |
superdan | right I know | 13:48 |
* johnthetubaguy just realises the ironic driver hashring feature means you can't aggregate a multiple ironic deploys in a single region any more, boo | 13:50 | |
superdan | I'm not sure what that means | 13:50 |
superdan | so one thing we could do, | 13:50 |
leakypipes | johnthetubaguy: nova host aggs never worked with ironic nodes, though. | 13:51 |
superdan | is make sure that the RP name is the uuid of the ironic node | 13:51 |
leakypipes | johnthetubaguy: just got off the call, btw, reading back | 13:51 |
superdan | which would be a path for the ironic driver getting the node to find out the uuid of the matching provider | 13:51 |
fried_rice | Can we do a fake migration, using the "migration_uuid" thingy, to avoid the race? | 13:51 |
johnthetubaguy | that is true today | 13:51 |
superdan | fried_rice: doesn't really help | 13:51 |
mriedem | right the ironic rp name is the ironic node uuid today | 13:52 |
johnthetubaguy | oh, you mean when we create the new compute node, we use the existing uuid, so we just rename the compute node? | 13:52 |
mriedem | since the rp.name == compute_node.hypervisor_hostname == ironic node.uuid | 13:52 |
superdan | mriedem: is it? | 13:52 |
mriedem | yar | 13:52 |
johnthetubaguy | yeah, thats correct | 13:52 |
superdan | well in that case, we can just look it up and reparent the compute node object then | 13:52 |
superdan | computenode.host = self.host | 13:52 |
superdan | done | 13:52 |
johnthetubaguy | yeah, instead of add a new one | 13:52 |
johnthetubaguy | that's what I just attempted to say, badly | 13:53 |
superdan | I was going to suggest that we set it so we could do that once it was, but if it's already done we should be able to do that right away | 13:53 |
johnthetubaguy | I will take a look at doing that | 13:54 |
johnthetubaguy | in the ironic driver, or where we create the compute nodes already? | 13:54 |
superdan | um | 13:54 |
*** awaugama has joined #openstack-nova | 13:54 | |
superdan | I'd have to go look at that.. I guess there's a bit of a layering violation in there some where | 13:54 |
superdan | maybe we can just make compute manager check for this situation and do the re-homing | 13:55 |
*** cfriesen has joined #openstack-nova | 13:56 | |
johnthetubaguy | yeah, I just worry about hostname clashes | 13:56 |
johnthetubaguy | in none ironic cases | 13:56 |
*** takedakn has joined #openstack-nova | 13:56 | |
superdan | well, | 13:56 |
superdan | the hostnames have to be unique today or nothing works anyway | 13:56 |
superdan | but you could also is_uuid_like() on it for a total hack :) | 13:57 |
johnthetubaguy | good point, placement has that constraint now, hence the bug in the first place | 13:57 |
superdan | or set some capability attribute on the driver: CAN_REBALANCE_NODES | 13:57 |
superdan | LIKES_TO_SHARE=True | 13:57 |
johnthetubaguy | heh | 13:57 |
superdan | PLAYS_WELL_WITH_OTHERS=True | 13:57 |
johnthetubaguy | that doesn't sound right... | 13:57 |
*** hongbin has joined #openstack-nova | 13:57 | |
superdan | we have to have unique hostnames for rpc to work anyway | 13:58 |
superdan | maybe not hypervisor_hostname I guess, but they should be the same for non-ironic ones anyway right? | 13:58 |
johnthetubaguy | isn't that one on the service, but yeah thats the same for regular virt | 13:58 |
johnthetubaguy | OK, I am convinced, will give that a whirl | 13:58 |
*** sbezverk has joined #openstack-nova | 13:59 | |
superdan | yes it's service.host that has to be unique but should be the same for virt systems | 13:59 |
*** smatzek has joined #openstack-nova | 14:00 | |
johnthetubaguy | cool, just making sure, keep getting it all twisted | 14:00 |
*** ralonsoh_ has joined #openstack-nova | 14:02 | |
*** crushil has joined #openstack-nova | 14:03 | |
cdent | register headline: OpenStack switches back to twisted | 14:03 |
*** takedakn has quit IRC | 14:03 | |
superdan | mriedem: I hadn't seen your second flavor sysmeta patch.. I didn't test with it applied as well | 14:06 |
*** ralonsoh has quit IRC | 14:06 | |
*** sapcc-bot has quit IRC | 14:06 | |
johnthetubaguy | cdent: heh | 14:06 |
*** sapcc-bot has joined #openstack-nova | 14:06 | |
mriedem | superdan: that shouldn't make a difference during instance list | 14:07 |
*** dgonzalez_ has joined #openstack-nova | 14:07 | |
*** tpatzig_ has joined #openstack-nova | 14:07 | |
*** mkoderer_ has joined #openstack-nova | 14:07 | |
*** david_ has joined #openstack-nova | 14:07 | |
*** seife_ has joined #openstack-nova | 14:07 | |
*** carthaca_ has joined #openstack-nova | 14:07 | |
mriedem | since it's just used during (1) save and (2) lazy-loading of flavor i think | 14:07 |
superdan | mriedem: well, unless we started lazy-loading it, but yeah, I was checking for that in the logs anyway | 14:07 |
*** dgonzalez_ has quit IRC | 14:09 | |
*** tpatzig_ has quit IRC | 14:09 | |
*** mkoderer_ has quit IRC | 14:09 | |
*** david_ has quit IRC | 14:09 | |
*** seife_ has quit IRC | 14:09 | |
*** carthaca_ has quit IRC | 14:09 | |
*** alexchadin has quit IRC | 14:09 | |
figleaf | cdent: heh, I remember the discussions that led to the switch from twisted to eventlet | 14:11 |
openstackgerrit | Merged openstack/nova-specs master: Update a URL https://review.openstack.org/489028 | 14:13 |
*** hemna_ has quit IRC | 14:15 | |
*** mriedem1 has joined #openstack-nova | 14:20 | |
*** tonygunk has quit IRC | 14:21 | |
*** tonygunk has joined #openstack-nova | 14:21 | |
*** kfarr has joined #openstack-nova | 14:22 | |
*** mriedem has quit IRC | 14:23 | |
bauzas | superdan: https://review.openstack.org/#/c/498948/10/nova/compute/manager.py@3640 I'm not super expert of all the migration states but I guess a migration revert is not having an 'in-progress state' ? | 14:25 |
bauzas | I just want to make sure that we don't do the math if we're at the middle of a revert | 14:25 |
bauzas | wait | 14:26 |
bauzas | if we get allocations, we know we have nothing to do | 14:26 |
*** Yikun__ has joined #openstack-nova | 14:26 | |
bauzas | so we shouldn't care of the migration state then ? | 14:26 |
*** moshele has quit IRC | 14:29 | |
superdan | bauzas: right that's just a short-circuit | 14:29 |
*** takedakn has joined #openstack-nova | 14:31 | |
*** flanders_ has quit IRC | 14:32 | |
*** jaosorior has quit IRC | 14:33 | |
*** takedakn has quit IRC | 14:34 | |
*** mriedem1 is now known as mriedem | 14:43 | |
openstackgerrit | priyaduggirala proposed openstack/nova master: Rename arguments in call() of nova/image/glance.py https://review.openstack.org/508533 | 14:48 |
*** chyka has joined #openstack-nova | 14:48 | |
bauzas | superdan: corrolary question, if we are reverting and if we have allocations related to the migration, we of course don't remove them. But then, we will remove them once it's calling finish_revert_resize() right? | 14:50 |
leakypipes | cdent: I presume you found the scheduler presentation links? the links to the presentations are http://bit.ly/scheduler-wars-a-new-hope and http://bit.ly/scheduler-wars-revenge-of-the-split | 14:50 |
bauzas | superdan: nevermind, just saw https://review.openstack.org/#/c/498949/11/nova/compute/manager.py | 14:50 |
bauzas | okay, so +W | 14:50 |
cdent | leakypipes: i did not, thank you | 14:50 |
superdan | bauzas: check out the functional tests.. unless you find a gap, they're pretty obsessive about the allocations at all the steps | 14:51 |
bauzas | cool with me | 14:51 |
leakypipes | cdent: BTW, thanks again for continuing your resource provider update emails. they really are very helpful. | 14:51 |
leakypipes | cdent: also, nice use of the word "passel" | 14:52 |
cdent | leakypipes: you’re welcome. I decided this week I’d go short and focused, in part because that seemed like good timing, but also because sometimes I’m so far behind myself that I haven’t got time to do the big version. we are moving a _ton_ of code these days | 14:52 |
*** tonygunk has quit IRC | 14:56 | |
*** tonygunk has joined #openstack-nova | 14:57 | |
*** Tom___ has joined #openstack-nova | 14:58 | |
melwitt | superdan: I dunno if you saw this but I think I found a bug with the get_instance_object_sorted when there are faults. I explained it here https://review.openstack.org/#/c/505417/7/nova/tests/functional/compute/test_instance_list.py@453 | 14:58 |
superdan | melwitt: so we're not going to merge the patch that pre-joins faults | 14:59 |
superdan | so that test can go away | 14:59 |
superdan | is there actually a problem based on how the API works now, or just that that test failed? | 15:00 |
melwitt | superdan: it's that _from_db_object doesn't accept pre-joined attrs, i.e. it won't set them. so even after you pre-join it lazy-loads it. and with an untargeted _context, it won't be able to and will get a None fault | 15:01 |
*** rcernin has quit IRC | 15:01 | |
superdan | and that test was intentionally not 3 cells (see mriedem's comment above) but only because it wasn't really needed | 15:01 |
superdan | melwitt: okay but the api isn't asking for fault to be joined | 15:01 |
*** baoli has quit IRC | 15:01 | |
superdan | melwitt: the api loads the faults it wants in a batch after having collected the full list | 15:02 |
melwitt | superdan: you mean nova-api? | 15:02 |
superdan | compute/api and above but yeah | 15:02 |
melwitt | okay | 15:02 |
*** baoli has joined #openstack-nova | 15:02 | |
superdan | so you can delete that test if you want and I can re-add it if I make the fault-joining patch work better | 15:02 |
*** baoli has quit IRC | 15:02 | |
*** Tom___ has quit IRC | 15:02 | |
superdan | melwitt: this is out of the stack at the moment: https://review.openstack.org/#/c/505456/10 | 15:03 |
*** tonygunk has quit IRC | 15:03 | |
melwitt | superdan: okay, so you're saying get_instance_object_sorted won't ever be used the way it is in that test | 15:03 |
superdan | not until I fix the above patch yeah | 15:04 |
melwitt | okay. yeah, I guess the only thing to look out for is if you want lazy-loads to work on the resulting cross-cell list, you'll have to make sure each of their _context are targeted to their cell | 15:05 |
superdan | yeah I'm not sure why they wouldn't be in this case, but it's not a scenario we request at the moment anyway | 15:05 |
melwitt | I think each Instance object is inited with the same untargeted context | 15:06 |
superdan | you could make the test use 3 cells and make it an xfail with a comment and I can come back to it when I work on the patch if you want | 15:06 |
melwitt | so lazy-loads wouldn't work | 15:06 |
superdan | melwitt: but it should be initialized with the context that scatter_gather_all_cells gave to the ... | 15:06 |
superdan | ohhh | 15:06 |
superdan | I see | 15:06 |
superdan | yep, I get it | 15:06 |
melwitt | k | 15:06 |
superdan | anyway, feel free to disable or remove that test for your immediate purposes and I'll circle back to it when I try to optimize the fault bit | 15:07 |
openstackgerrit | Chris Dent proposed openstack/nova master: [placement] gabbi tests for shared custom resource class https://review.openstack.org/485209 | 15:07 |
*** baoli has joined #openstack-nova | 15:08 | |
*** hemna_ has joined #openstack-nova | 15:08 | |
mriedem | for anyone that cares, the change to get this legacy nnet job out of nova is here https://review.openstack.org/#/c/508519/ | 15:09 |
mriedem | we're blocked until then | 15:09 |
*** coreywright has quit IRC | 15:10 | |
superdan | bummer | 15:10 |
*** Oku_OS is now known as Oku_OS-away | 15:11 | |
mriedem | superdan: btw, i was going to propose a forum session to brainstorm ideas for some automated perf testing like what was done this week, for a few reasons, | 15:11 |
mriedem | like automating it, but also find out what other projects have done, if anything, | 15:11 |
superdan | mriedem: we've discussed that a few times, and in boston even | 15:12 |
melwitt | some other projects use rally for that | 15:12 |
superdan | always comes back to not having stable enough stuff | 15:12 |
mriedem | and because there are several work group sessions, like the public cloud one, where they are talking about "what features do we want?!" and i want to say "what scale testing do we need?!" | 15:12 |
mriedem | this wouldn't be voting | 15:12 |
superdan | it's just a matter of having useful data, and as you saw, it's hard to compare two runs | 15:13 |
superdan | even if not voting, if you can't actually draw conclusions... | 15:13 |
mriedem | was thinking experimental queue so it's on-demand for things we know might impact performance | 15:13 |
superdan | you can compare normalized metrics like number of db queries or something, but runtime and cpu usage are not really doable without dedicated hardware | 15:13 |
mriedem | my thought was the job pulls master, runs some baselines, then applies the change, runs the same tests and compares for the relative difference | 15:13 |
superdan | noisy neighbor problems will still skew those | 15:14 |
*** belmoreira has quit IRC | 15:14 | |
superdan | the window is smaller, granted, but.. | 15:14 |
mriedem | ok, so maybe a requirement is it runs on baremetal? | 15:14 |
superdan | that would be better yeah | 15:14 |
mriedem | point being, | 15:14 |
mriedem | there is an obvious need, | 15:14 |
superdan | they could be done on virt, but only if salt is applied to the result | 15:14 |
mriedem | so if we had requirements to start, we could maybe do something | 15:14 |
mriedem | i'm thinking super simple to start | 15:15 |
superdan | are you saying my box can't satisfy all of nova's perf testing needs? | 15:15 |
mriedem | sure, if you want to become the request inbox for every time we need that | 15:15 |
superdan | heh | 15:15 |
*** penick has joined #openstack-nova | 15:16 | |
mriedem | melwitt: re the rally job, i'd be interested to know if (1) it still works and (2) if so, what does it do? like what benchmark does it compare against? | 15:16 |
melwitt | mriedem: fwiw, I was thinking the same thing recently. if we had some basic perf tests that timed instance list, delete, boot. the main things | 15:16 |
mriedem | andreykurilin: ^ maybe you can answer that | 15:16 |
*** vvargaszte has joined #openstack-nova | 15:17 | |
*** yamamoto has quit IRC | 15:18 | |
andreykurilin | mriedem: hi! what is the question? :) | 15:18 |
andreykurilin | melwitt, mrieden: rally has a bunch of scenarios related to nova | 15:19 |
melwitt | mriedem: I don't know much about it other than I know some projects use it to have some monitor of perf. lemme see if I can find something real quick | 15:19 |
mriedem | andreykurilin: "re the rally job, i'd be interested to know if (1) it still works and (2) if so, what does it do? like what benchmark does it compare against?" | 15:20 |
andreykurilin | mriedem: so rally job can be used to check that things are working under some load and in concurrency mode. Also, you can specify SLAs for a single actions, like neutron job did https://github.com/openstack/neutron/blob/master/rally-jobs/neutron-neutron.yaml#L20-L21 | 15:21 |
melwitt | mriedem: found one with cinder, example patch https://review.openstack.org/#/c/501478 and the job http://logs.openstack.org/78/501478/1/check/gate-rally-dsvm-cinder-ubuntu-xenial-nv/e0eb0eb/ | 15:21 |
*** mingyu has quit IRC | 15:21 | |
*** dave-mccowan has joined #openstack-nova | 15:22 | |
*** mingyu has joined #openstack-nova | 15:22 | |
andreykurilin | melwitt: neutron has voting rally job for a year I think | 15:22 |
melwitt | okay, so neutron and cinder were the projects I was probably thinking of | 15:22 |
andreykurilin | cinder has non-voting job for years | 15:22 |
andreykurilin | manila has the rally job too | 15:23 |
*** coreywright has joined #openstack-nova | 15:23 | |
mriedem | gibi: is this a co-worker of yours? http://forumtopics.openstack.org/cfp/details/50 | 15:23 |
mriedem | andreykurilin: that limit has to be pretty high doesn't it if the rally jobs are running on vms with probably wild variance | 15:24 |
mriedem | that was always the reason we didn't have a voting rally job in nova | 15:24 |
mriedem | and if the limit is really high, then the only things your catching are something that's really crazy and has gone off the rails.... | 15:25 |
andreykurilin | mriedem: `that was always the reason we didn't have a voting rally job in nova` it is wrong. There were several guys who dislike rally from the beggining (I do not want to name them) and blocked everything related | 15:26 |
mriedem | cdent: are you one of the people that are responsible for filtering these forum session proposals? | 15:26 |
cdent | no sir | 15:26 |
mriedem | andreykurilin: ok, personal vendettas aside, i think the general reason was the variance between runs | 15:27 |
cdent | but I was reading them anyway, so I thought I’d express an opinion, because why not? | 15:27 |
sean-k-mooney | leakypipes: sahid: sahid i do not want to top post over latest responce to vgpu implementation but can your responded to http://lists.openstack.org/pipermail/openstack-dev/2017-September/122702.html where i pointed out that any vgpu support we introduce cannot rely on mdev as amd do not use mdevs they use sriov | 15:28 |
bauzas | oh man, I now need to learn the Zuul language | 15:28 |
mriedem | mdev or bust | 15:28 |
sean-k-mooney | leakypipes: sahid we can use mdev but we have to also support sriov | 15:29 |
bauzas | mriedem: man, you don't imagine | 15:29 |
leakypipes | sean-k-mooney: I don't think anyone's saying we would *only* support mdev. | 15:29 |
andreykurilin | mriedem: about metrics and their processing. The SLA is a pluggable thing and you can use it in different ways. (90% percentiles, median...). But I agree that the results can look random due to the hardware, but anyway it can show bad trends, like it was in June - http://andreykurilin.me/trends/trends_gate-rally-dsvm-neutron-rally-ubuntu-xenial.html#/NeutronNetworks.list_agents | 15:30 |
leakypipes | sean-k-mooney: I think everyone's in agreement that we should enable multiple device management APIs, not tie us to one or another. | 15:30 |
andreykurilin | mriedem: also, the reason of making rally job voting in neutron was an ability to check the concurrency issues | 15:30 |
sean-k-mooney | leakypipes: yes | 15:31 |
sahid | sean-k-mooney: yes really, since the beginning the point was that, vgpus can be exposed with sriov or mdev | 15:31 |
cdent | sean-k-mooney: while you’re around, can you have a look at https://review.openstack.org/#/c/504540/ you were one of the people who had some ideas on how to do allocation candidate limiting, and there now lots of ideas on that spec, but some confusion on what things we are trying to optimize | 15:31 |
sean-k-mooney | cdent: sure opening it now | 15:31 |
cdent | thanks | 15:32 |
bauzas | leakypipes: sean-k-mooney: that's one of the reasons why the vGPU spec is saying we will only pass GPU resource classes | 15:32 |
bauzas | if libvirt uses mdev, then meh | 15:32 |
bauzas | if xen is using anything else, then meh | 15:32 |
sean-k-mooney | bauzas: its nto a libvirt vs xen thing | 15:32 |
bauzas | we shouldn't just leak out the technical details | 15:32 |
sahid | it's not libvirt who is using mdev, it's the hardware driver... | 15:32 |
sean-k-mooney | at the hardware level amd uses hardware based partitioning of the gpu via sriov | 15:33 |
bauzas | whatever the solution is, the interface with the compute manager is just a resource class | 15:33 |
sean-k-mooney | intel and nvidia do it via the diriver with mdevs | 15:33 |
bauzas | for the moment, libvirt supports virtual GPUs by mdevs but that's just a temporary thing AFAICU | 15:33 |
andreykurilin | mriedem: I agree that it is difficult to compare the results from different hardware(which we have in infra), but it is not a good time for openstack and I do not know the company who are ready to give reserved hardware for a performance ci | 15:33 |
bauzas | sean-k-mooney: yeah that's the driver which provides mdev types, libvirt just gets them | 15:34 |
sean-k-mooney | bauzas: the hypervisror did nto need modifcation to work with vgpus with sriov | 15:34 |
bauzas | sean-k-mooney: not sure I get your point :) | 15:34 |
sean-k-mooney | my point is that libvirt works with amd vgpus also | 15:35 |
sean-k-mooney | you just to a pci passthough of the sriov vf | 15:35 |
bauzas | ah okay, and amd driver uses SR-IOV for that? | 15:35 |
bauzas | the AMD driver isn't using mdevs ? | 15:35 |
sean-k-mooney | yes they do the virtualisation in hardware | 15:36 |
bauzas | I see | 15:36 |
sean-k-mooney | they do not use mdevs | 15:36 |
bauzas | so, the thing is | 15:36 |
bauzas | I see baby steps here | 15:36 |
bauzas | step 1/ make sure we have something workable without adding more tech deby | 15:36 |
bauzas | step 2/ work on the generic thingy from efried and "do the work" (c) | 15:37 |
*** cdent has quit IRC | 15:37 | |
bauzas | step 3/ migrate how we track PCI devices from the old world to the new world | 15:37 |
fried_rice | ++ | 15:38 |
bauzas | hah, Friday! | 15:38 |
bauzas | holy shit, I said many times I need a ZNC bot for me | 15:38 |
*** bauzas is now known as bauwser | 15:38 | |
mriedem | andreykurilin: http://forumtopics.openstack.org/cfp/details/55 | 15:38 |
mriedem | superdan: melwitt: ^ | 15:38 |
melwitt | cool | 15:39 |
sean-k-mooney | bauwser: makes sense, my concern is coming for interop side in that i would hope at the api level we will not need to expose if it is an mdev or sriov based vgpu | 15:40 |
bauwser | sean-k-mooney: that's where I'm pretty firm in my mind | 15:40 |
bauwser | sean-k-mooney: outside the virt driver, we shouldn't leak out the details | 15:41 |
sean-k-mooney | bauwser: we may need to expose a vender in some form for guest driver reasons but other then that how we virtualise should be internal to nova | 15:41 |
bauwser | the virt driver will just report inventories | 15:41 |
bauwser | how those inventories will be populated will be different based on the driver | 15:41 |
bauwser | but that will be consistent | 15:41 |
openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Use ksa adapter for cinder client https://review.openstack.org/508345 | 15:42 |
sean-k-mooney | sure and i think we can use traits on the provider to hanel the "i only have a nvida driver in my vm image" problem | 15:42 |
fried_rice | mordred ^ would you mind checking that I did my version discovery sanely here? | 15:42 |
bauwser | so that a flavor asking for an amount of 2 of the VGPU resource class and a trait of 'K800' will get 2 K800 vGPUs | 15:43 |
bauwser | that's where the API is | 15:43 |
bauwser | actually a good call for trying to fit the fried_rice's model with vGPUs | 15:43 |
*** burt has quit IRC | 15:44 | |
sean-k-mooney | bauwser: perhaps yes or as image metadata where i say i can support x,y,z and the and flavor say i want y and we compare to make sure its compatible | 15:44 |
bauwser | sean-k-mooney: mmm | 15:45 |
bauwser | sean-k-mooney: I wonder if that wouldn't be just a filter for the image metadata | 15:45 |
bauwser | like, I can find all the hosts that can support y (if y is asked by the flavor) | 15:45 |
sean-k-mooney | im thinking we can add traits to the image metadata | 15:45 |
bauwser | that is a placement thing | 15:45 |
bauwser | well | 15:46 |
bauwser | honestly that's a thought | 15:46 |
*** ctrath has joined #openstack-nova | 15:46 | |
*** tonygunk has joined #openstack-nova | 15:46 | |
mordred | fried_rice: looks good on quick glance - but I haven't ooked deeply yet | 15:47 |
fried_rice | mordred Cool, thanks. | 15:47 |
bauwser | well, I need to call it a day, actually | 15:48 |
mriedem | fried_rice: let's let mordred deal with the infra fire that's raging | 15:48 |
mriedem | :) | 15:48 |
fried_rice | mriedem mordred Sorry, didn't smell the smoke. | 15:49 |
mriedem | #openstack-infra | 15:49 |
sean-k-mooney | leakypipes: am qq. is there a way we can retrive the compute node resocue provide by the hostid? and if not would you be against adding one. it could just be a trait | 15:49 |
leakypipes | sean-k-mooney: each resource provider has a name attribute. | 15:50 |
leakypipes | sean-k-mooney: that is set to hypervisor_hostname value | 15:50 |
leakypipes | sean-k-mooney: so yeah, you can already do that. | 15:50 |
leakypipes | sean-k-mooney: and that name is unique BTW | 15:50 |
sean-k-mooney | leakypipes: yes i know we require that all hostnames be unique in the openstack cloud | 15:51 |
sean-k-mooney | leakypipes: the issue is the get resouce provider api to day i think need you to pass the uuid | 15:51 |
mriedem | sean-k-mooney: you can find the compute node by hostname, and from the compute node uuid look up the RP | 15:51 |
mriedem | that's what our functional tests do | 15:51 |
sean-k-mooney | i dont know if we have a rest api call to get it by name | 15:51 |
* fried_rice confirms: GET /resource_providers?name={hostname} works | 15:52 | |
leakypipes | sean-k-mooney: no, I mean when resource providers are added by the compute node, the resource provider's name attribute is set to the hypervisor_hostname | 15:52 |
sean-k-mooney | fried_rice: cool if GET /resource_providers?name={hostname} works that perferct | 15:52 |
leakypipes | sean-k-mooney: GET /resource_providers?name=$hypervisor_hostname | 15:52 |
*** derekh has quit IRC | 15:52 | |
leakypipes | sean-k-mooney: sorry, yeah, fried_rice beat me to it. | 15:52 |
fried_rice | Yeah, to be technically correct, in case $hypervisor_hostname isn't the same as `hostname` | 15:52 |
leakypipes | he's a wily coyote, that fried_rice | 15:52 |
leakypipes | fried_rice: which is the case for Ironic nodes :) | 15:53 |
fried_rice | right | 15:53 |
sean-k-mooney | the reason i was asking is for the neutron placement work. when nested provider are added we will need to find the computenode provider for the current host hence question | 15:53 |
fried_rice | So as long as you know how virt is reporting the hypervisor hostname, you're golden. | 15:54 |
sean-k-mooney | in neutron i belive we have the host id in a config that must be set to match the one used by nova | 15:54 |
leakypipes | right | 15:55 |
fried_rice | # Hostname to be used by the Neutron server, agents and services running on | 15:55 |
fried_rice | # this machine. All the agents and services running on this machine must use | 15:55 |
fried_rice | # the same host value. (unknown value) | 15:55 |
fried_rice | #host = example.domain | 15:55 |
fried_rice | in neutron.conf ? | 15:55 |
leakypipes | device_id == hostname, right? | 15:55 |
leakypipes | sean-k-mooney: ^\ | 15:55 |
*** Tom___ has joined #openstack-nova | 15:55 | |
sean-k-mooney | device_id? | 15:55 |
*** ctrath has left #openstack-nova | 15:56 | |
leakypipes | sean-k-mooney: in neutron port response... | 15:56 |
leakypipes | sean-k-mooney: never mind. | 15:57 |
sean-k-mooney | oh binding:host_id is | 15:57 |
mriedem | superdan: http://forumtopics.openstack.org/cfp/details/60 | 15:57 |
mriedem | melwitt: tssurya: ^ | 15:57 |
*** zzzeek has quit IRC | 15:58 | |
* tssurya looking | 15:58 | |
superdan | mriedem: hmm, did the gate just get dumped? | 15:59 |
mriedem | idk | 15:59 |
sean-k-mooney | binding:host_id is set by nova when the port is bound by the compute node | 15:59 |
sean-k-mooney | leakypipes: but thanks that answers my question ill let rodolfo know | 15:59 |
*** zzzeek has joined #openstack-nova | 15:59 | |
sean-k-mooney | and thank fried_rice too | 16:00 |
melwitt | I thought I saw something in #openstack-infra that said they were gonna stop zuul v3 | 16:00 |
superdan | s'empty | 16:00 |
*** Tom___ has quit IRC | 16:00 | |
melwitt | but I wasn't sure if I read it right | 16:00 |
*** xyang1 has joined #openstack-nova | 16:00 | |
fried_rice | I just got a weird merge conflict | 16:00 |
superdan | well, I had to fix the unit test patch anyway, so I'll push up some fresh in a minute | 16:00 |
*** huanxie has joined #openstack-nova | 16:01 | |
openstackgerrit | Dan Smith proposed openstack/nova master: Move cell0 marker test to Cellsv1DeprecatedTestMixIn https://review.openstack.org/508314 | 16:02 |
openstackgerrit | Dan Smith proposed openstack/nova master: Use improved instance_list module in compute API https://review.openstack.org/505418 | 16:02 |
openstackgerrit | Dan Smith proposed openstack/nova master: Fix CellDatabases fixture swallowing exceptions https://review.openstack.org/506312 | 16:02 |
openstackgerrit | Dan Smith proposed openstack/nova master: Fix minor input items from previous patches https://review.openstack.org/506416 | 16:02 |
*** smatzek has quit IRC | 16:03 | |
superdan | mriedem: did you want me to do something with those session proposals or just headupping me? | 16:03 |
*** smatzek has joined #openstack-nova | 16:03 | |
mriedem | just fyi | 16:03 |
superdan | ack | 16:03 |
*** sbezverk has quit IRC | 16:04 | |
*** sambetts is now known as sambetts|afk | 16:05 | |
melwitt | mriedem: are you going to propose an install/upgrade one or shall I? you didn't mention one in your ML post but I wanted to double check | 16:05 |
*** smatzek has quit IRC | 16:06 | |
*** smatzek has joined #openstack-nova | 16:06 | |
*** mingyu has quit IRC | 16:08 | |
*** smatzek has quit IRC | 16:08 | |
*** smatzek has joined #openstack-nova | 16:09 | |
*** owalsh_ has joined #openstack-nova | 16:09 | |
mriedem | melwitt: i wasn't planning on proposing a specific nova upgrades one no, i figured some of that will be covered in cells/placement sessions on what happened in pike and the focus for queens | 16:09 |
mriedem | feel free though | 16:09 |
openstackgerrit | John Garbutt proposed openstack/nova master: Re-use existing ComputeNode on ironic rebalance https://review.openstack.org/508555 | 16:10 |
superdan | so, | 16:10 |
superdan | since we don't get to prioritize these (right?) I'd hate to lose one of these important sessions for an upgrade one that we've hit many times before | 16:10 |
superdan | if we have space, it's always good to have one of those, | 16:10 |
superdan | but if the TC is picking, I don't want them to choose that over, say, the cells or placement one | 16:10 |
*** mingyu has joined #openstack-nova | 16:11 | |
superdan | could we maybe indicate a preferred ordering somehow? comments? | 16:11 |
*** owalsh has quit IRC | 16:11 | |
mriedem | comments are about all you get | 16:11 |
mriedem | NOVA PRIORITY: 5 | 16:11 |
johnthetubaguy | did you make the placement one sound cross project-ey? | 16:11 |
johnthetubaguy | that might be a good way to keep a good session | 16:11 |
mriedem | i didn't propose a placement one because of http://forumtopics.openstack.org/cfp/details/50 | 16:11 |
mriedem | ^ is both generic and too specific | 16:12 |
mriedem | what i think that is, is talking about how nested resource providers and custom resource classes will let you do all kinds of external scheduling things | 16:12 |
johnthetubaguy | yeah, it is. | 16:12 |
mriedem | which is not what i was going to propose | 16:12 |
mriedem | i guess i'll just propose my own | 16:13 |
johnthetubaguy | I would tempted to add a good one, and note its a duplicate? | 16:13 |
melwitt | okay. my thinking was if ppl are recently having trouble installing or upgrading nova, that was important and I wanted to gather action items on whether we need to improve docs, relnotes, nova-manage commands, etc | 16:13 |
*** owalsh_ has quit IRC | 16:14 | |
mriedem | melwitt: bauwser has one for docs and relnotes specifically | 16:14 |
mriedem | i see your point | 16:14 |
mriedem | are people recently having trouble beyond ocata? | 16:15 |
mriedem | i know ocata was tough for some people | 16:15 |
melwitt | yeah, I saw that. docs and relnotes generic session without a target like install/upgrade I'm not sure what will come out of that | 16:15 |
mriedem | "the release notes don't have enough information!" | 16:16 |
mriedem | "the release notes have too much information" | 16:16 |
mriedem | that's what will come out of that | 16:16 |
superdan | yep | 16:16 |
superdan | and what will come of the upgrade one is much of the same we've heard before I think, which is why I care less about it than the other things | 16:17 |
melwitt | but I understand everyone's point. I really wish I knew if operators were suffering on newton/ocata/pike and what we could do to ease that. I don't remember discussing that span of releases in a session but I do remember a lot of ppl coming into our channel with issues | 16:17 |
superdan | if we have space for it, then I'm certainly happy to have it | 16:17 |
*** vvargaszte has quit IRC | 16:17 | |
*** yamamoto has joined #openstack-nova | 16:18 | |
melwitt | we responded to the issues and improved our docs and nova-manage commands. and now it's our best assumption that everything is okay but I wasn't sure if it is since we haven't had anyone tell us. it's more like lack of complaint | 16:18 |
*** owalsh has joined #openstack-nova | 16:19 | |
melwitt | just thinking aloud mostly | 16:19 |
melwitt | how can we tell if we have space for more proposals? we can't right? | 16:20 |
*** jmlowe has quit IRC | 16:20 | |
mriedem | melwitt: we can't | 16:20 |
mriedem | there is a fast forward upgrades session | 16:21 |
mriedem | so my guess would be a nova-specific upgrade session would be asking for FF upgrades | 16:21 |
mriedem | ttx: how many slots are there for forum topics? | 16:21 |
mriedem | s/topics/sessions/ | 16:21 |
mriedem | i would also love feedback on where we've sucked it up perf-wise, | 16:22 |
mriedem | but, | 16:22 |
mriedem | ... | 16:23 |
*** itlinux has joined #openstack-nova | 16:23 | |
melwitt | yeah. this is weird that we can't control what we have sessions about and have to worry that some sessions would bump others out | 16:23 |
*** yamamoto has quit IRC | 16:24 | |
mriedem | and as a result we don't propose as many | 16:24 |
mriedem | meanwhile there are like 4+ overlapping sessions about HPC and NFV | 16:24 |
itlinux | hello all.. I have a docker image that I installed the clients on and I have the endpoints running on HTTPS.. when I do nova list on that box I get an error.. if I use my virtualbox with openstack installed I can query my remote openstack with the nova list just fine.. any tips? | 16:25 |
openstackgerrit | Dan Smith proposed openstack/nova master: Fix minor input items from previous patches https://review.openstack.org/506416 | 16:25 |
superdan | mriedem: so, in my fixing of your fields thing in ^ | 16:25 |
superdan | I found another place we were implicitly querying for a ton of extra stuff when all we want was metadata | 16:26 |
*** pcaruana has quit IRC | 16:26 | |
*** shewless has joined #openstack-nova | 16:26 | |
johnthetubaguy | fried_rice: leakypipes: superdan: thanks for your help with the ironic placement bug, fix up for review, not had chance to test it yet, something for next week: https://review.openstack.org/#/c/508555 | 16:26 |
superdan | "ton" being "four" instead of "one" | 16:26 |
superdan | you know, apply my normal exaggeration descaling filter | 16:26 |
superdan | johnthetubaguy: cool | 16:28 |
ttx | mriedem: not sure, maybe thingee or flaper87 know | 16:29 |
*** gbarros has quit IRC | 16:29 | |
* ttx is not on the organization group this time | 16:29 | |
mriedem | johnthetubaguy: superdan: leakypipes: cdent: figleaf: fyi http://forumtopics.openstack.org/cfp/details/60 | 16:30 |
superdan | mriedem: you posted that on the cells one, did you mean to do it on a placement one? | 16:31 |
*** huanxie has quit IRC | 16:31 | |
leakypipes | ack, will do johnthetubaguy | 16:31 |
mriedem | superdan: you mean this? https://review.openstack.org/#/c/506416/13/nova/compute/api.py@3755 | 16:32 |
mriedem | crap yes | 16:32 |
superdan | mriedem: yes that | 16:32 |
mriedem | superdan: have you seen https://review.openstack.org/#/c/508299/ | 16:33 |
superdan | mriedem: there's a test that failed if we don't pass something to that now that we're doing the fields calculation early, but it means we stop taking the obvious default | 16:33 |
superdan | mriedem: heh, okay, well, I need it for the change in that patch | 16:33 |
superdan | mriedem: so whichever one wins the race I guess | 16:33 |
*** sahid has quit IRC | 16:33 | |
mriedem | there is an issue with yours | 16:34 |
mriedem | maybe we should slide https://review.openstack.org/#/c/508299/ in underneath? | 16:34 |
superdan | ah, I didn't see that it called that | 16:36 |
*** Yikun__ has quit IRC | 16:36 | |
superdan | let's just try to get yours in so I don't have to intertwine those two series | 16:36 |
superdan | still no jenkins run on that one.. is it worth rechecking now or no? | 16:36 |
mriedem | no idea | 16:37 |
mriedem | i don't see it queued up | 16:37 |
mriedem | i'm going to lunch | 16:37 |
*** edmondsw has quit IRC | 16:37 | |
*** cdent has joined #openstack-nova | 16:39 | |
openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Use ksa adapter for cinder client https://review.openstack.org/508345 | 16:43 |
*** itlinux has quit IRC | 16:44 | |
*** gyee has joined #openstack-nova | 16:45 | |
*** Tom has joined #openstack-nova | 16:45 | |
*** lnxnut_ has joined #openstack-nova | 16:46 | |
*** itlinux has joined #openstack-nova | 16:47 | |
*** rtjure has quit IRC | 16:49 | |
*** Tom has quit IRC | 16:50 | |
openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Use ksa adapter for cinder client https://review.openstack.org/508345 | 16:50 |
cdent | mriedem: you aware of this interoperability tag thingie for nova? it wants your +1: https://review.openstack.org/#/c/506255/ | 16:54 |
*** shaner has quit IRC | 16:54 | |
*** Swami has joined #openstack-nova | 17:02 | |
*** itlinux has quit IRC | 17:02 | |
*** ralonsoh_ has quit IRC | 17:02 | |
*** mingyu_ has joined #openstack-nova | 17:03 | |
*** mingyu_ has quit IRC | 17:03 | |
*** mingyu_ has joined #openstack-nova | 17:04 | |
*** mingyu has quit IRC | 17:04 | |
*** gouthamr has quit IRC | 17:10 | |
*** avolkov has quit IRC | 17:11 | |
cdent | leakypipes: if you’ve got a chance this (shared rp fix from alex) probably wants your eyes: https://review.openstack.org/#/c/480379/ | 17:15 |
*** jpena is now known as jpena|off | 17:16 | |
*** yamamoto has joined #openstack-nova | 17:20 | |
*** mingyu_ has quit IRC | 17:21 | |
*** mingyu has joined #openstack-nova | 17:21 | |
*** sri_ has quit IRC | 17:21 | |
leakypipes | cdent: ah, yes, thanks for the reminder | 17:23 |
cdent | ✔ | 17:23 |
*** yamamoto has quit IRC | 17:25 | |
*** burt has joined #openstack-nova | 17:30 | |
*** huanxie has joined #openstack-nova | 17:31 | |
*** gouthamr has joined #openstack-nova | 17:33 | |
*** tssurya has quit IRC | 17:36 | |
*** Tom_ has joined #openstack-nova | 17:36 | |
*** edmondsw has joined #openstack-nova | 17:37 | |
*** esberglu has quit IRC | 17:40 | |
*** mingyu_ has joined #openstack-nova | 17:40 | |
*** esberglu has joined #openstack-nova | 17:40 | |
*** esberglu has quit IRC | 17:41 | |
*** esberglu has joined #openstack-nova | 17:41 | |
*** dave-mccowan has quit IRC | 17:41 | |
*** jmlowe has joined #openstack-nova | 17:41 | |
*** esberglu has quit IRC | 17:42 | |
*** esberglu has joined #openstack-nova | 17:42 | |
*** esberglu has quit IRC | 17:42 | |
*** esberglu has joined #openstack-nova | 17:42 | |
*** pino has joined #openstack-nova | 17:43 | |
*** mingyu has quit IRC | 17:44 | |
*** thorst has quit IRC | 17:45 | |
pino | penick: mriedem: (and Jay Pipes, can't find his handle) a few days ago I asked about injecting dynamically generated SSH certificates into the host. You pointed me to vendordata, cloud-init (and the novajoin example). I've played with it and have some more questions/issues. Do you have a few minutes? | 17:46 |
leakypipes | pino: I'm leakypipes on Fridays :) | 17:47 |
pino | Specifically, I'm worried about the SSH host certificate. | 17:47 |
*** esberglu has quit IRC | 17:47 | |
pino | leakypipes: :-) | 17:47 |
pino | So, the problem with the host certificate is that you need to pass the host public key to the Host CA signing service to generate the certificate, then inject it back. | 17:48 |
pino | But vendor data doesn't take any arguments, so you're forced to either generate the host keys off the instance, or you need to expose a service directly to the instance. | 17:49 |
pino | Both are problematic: exposing the signing service to the instance means the instance has to be able to authenticate itself to the service (chicken-and-egg problem). | 17:50 |
mriedem | interop tag?! | 17:50 |
pino | Is that comment for me? | 17:50 |
mriedem | no | 17:51 |
mriedem | sorry | 17:51 |
*** cdent has quit IRC | 17:51 | |
pino | Maybe an e-mail would be more effective... | 17:53 |
*** rtjure has joined #openstack-nova | 17:53 | |
pino | I'll write it all up and send to the mailing list instead. | 17:53 |
mriedem | pino: to the openstack-dev mailing yeah, probably | 17:53 |
*** lnxnut_ has left #openstack-nova | 17:55 | |
*** david-lyle has quit IRC | 17:56 | |
*** david-lyle has joined #openstack-nova | 17:56 | |
*** gjayavelu has joined #openstack-nova | 17:57 | |
*** kenperkins has quit IRC | 17:58 | |
*** mnestratov has quit IRC | 18:00 | |
*** huanxie has quit IRC | 18:01 | |
mriedem | leakypipes: the explanations for https://review.openstack.org/#/c/506093/ are in the commit message | 18:02 |
mriedem | the functional test fails without those changes to the fake virt driver | 18:02 |
leakypipes | mriedem: I still couldn't understand the explanation. | 18:02 |
leakypipes | mriedem: which is what I said in the comment../. | 18:02 |
mriedem | if you do live migration with block_migration=auto, | 18:02 |
mriedem | that passes block_migration=None, | 18:02 |
mriedem | which you can't set on MigrateData b/c it's not a nullable=True field | 18:02 |
cburgess | Do we have a supported/approved method for purge deleted instances from the DB? | 18:03 |
mriedem | and we have to return migrate_data from the other method otherwise it doesn't come out during post_live_migration, and we can't set the status on the migration object to 'completed', which is what the functional test is waiting for | 18:03 |
mriedem | cburgess: we don't | 18:03 |
cburgess | mriedem Wow still really? | 18:03 |
mriedem | we had a spec a few releases ago | 18:03 |
mriedem | and a patch at one point | 18:03 |
cburgess | *sad panda* | 18:04 |
cburgess | My life just got a lot more complicated. | 18:05 |
mriedem | did you find out you're pregnant? | 18:05 |
cburgess | No the lack of purge support... | 18:05 |
mriedem | oh, that | 18:05 |
melwitt | I thought archived_deleted_rows mostly worked now | 18:05 |
mriedem | https://specs.openstack.org/openstack/nova-specs/specs/mitaka/approved/purge-deleted-instances-cmd.html | 18:05 |
mriedem | archive != purge | 18:06 |
cburgess | Wait.. | 18:06 |
cburgess | OK.. | 18:06 |
superdan | archive should be a lot better now yeah | 18:06 |
cburgess | So whats archived_deleted_rows | 18:06 |
mriedem | archive means, put some shit in the storage room but don't delete it | 18:06 |
cburgess | ? | 18:06 |
mriedem | moves things to shadow tables | 18:06 |
*** hoonetorg has quit IRC | 18:06 | |
superdan | and then you can dump the storage room after each thing | 18:06 |
mriedem | deleted things | 18:06 |
superdan | easily | 18:06 |
melwitt | it deletes it from the main tables | 18:06 |
superdan | without constraints | 18:06 |
cburgess | Oh.. | 18:06 |
cburgess | That would do what I needed. | 18:06 |
mriedem | cburgess: nova-manage db archive_deleted_rows --verbose --until-complete | 18:06 |
cburgess | Cool. I'll look into it. Thanks. | 18:07 |
cburgess | Oh this.. https://blueprints.launchpad.net/nova/+spec/archive-deleted-rows-all | 18:07 |
superdan | mriedem: wanna peek behind my curtain? | 18:07 |
mriedem | it's not multicell aware, but you're on folsom so that doesn't matter for you | 18:07 |
cburgess | Looks like melwitt Worked on it. | 18:07 |
cburgess | I'm not on folsom.. god.. | 18:07 |
cburgess | We never used Folsom. | 18:07 |
mriedem | superdan: which curtain? | 18:07 |
superdan | mriedem: this one over here.. the one that hides my current git tree | 18:07 |
melwitt | yeah, there might be some issues if you keep the archived data indefinitely. recently I learned primary keys can be reused after a DB restart with innodb, so archive can fail if there are dupes | 18:08 |
superdan | melwitt: cburgess wants to dump the shadow tables immediately though, so no problem | 18:08 |
melwitt | yep +1 | 18:08 |
cburgess | Yeah cool. | 18:08 |
cburgess | I will investigate this feature. Thanks team! | 18:08 |
melwitt | just sharing my recent revelation, just in case | 18:08 |
superdan | mriedem: | 18:09 |
superdan | % gsl HEAD^.. | 18:09 |
superdan | a3d7d30 Merge build requests into the sortmaster 9000 | 18:09 |
superdan | mriedem: you may ooh and ahh now | 18:09 |
mriedem | i don't know what you're talking about | 18:10 |
mriedem | oh | 18:10 |
superdan | bah | 18:10 |
mriedem | now i get it | 18:10 |
mriedem | jesus, is there anything the sortmaster 9000 can't do? | 18:11 |
mriedem | oh i know | 18:11 |
mriedem | RFE: please make the sortmaster 9000 allow me to pass a volume type during boot from volume | 18:11 |
mriedem | oh btw | 18:12 |
mriedem | if you're looking for queued stuff | 18:13 |
mriedem | http://zuulv3.openstack.org/ | 18:13 |
*** rmart04 has joined #openstack-nova | 18:13 | |
*** rmart04 has quit IRC | 18:13 | |
mriedem | this pike regression fix needs another +2 https://review.openstack.org/#/c/507938/ | 18:14 |
mriedem | the zuul failure is the nnet job | 18:14 |
superdan | which hasn't merged yet right? | 18:15 |
superdan | the nnet fix? | 18:15 |
mriedem | i'm watching it | 18:15 |
mriedem | but no | 18:16 |
*** boris_42_ has joined #openstack-nova | 18:16 | |
melwitt | I have a tox.ini patch up for adding stderr/stdout capture and test timeout to the functional and api_sample_tests https://review.openstack.org/#/c/507976 | 18:16 |
melwitt | if anyone wants to help get stdout capturing back | 18:17 |
mriedem | melwitt: commented, | 18:19 |
mriedem | there might be a way to avoid the duplication | 18:19 |
melwitt | thanks | 18:20 |
*** yamamoto has joined #openstack-nova | 18:22 | |
*** lpetrut has joined #openstack-nova | 18:26 | |
*** yamamoto has quit IRC | 18:26 | |
mriedem | ok i think these nnet zuul job changes are all passing | 18:36 |
mriedem | so i'll bug infra after that | 18:36 |
*** tonygunk has quit IRC | 18:38 | |
*** nikhil has joined #openstack-nova | 18:39 | |
cburgess | mriedem melwitt Is there a minimum reliable version that supported the archive thing (as in not before liberty etc)? Looks like the command first went in for grizzly. | 18:44 |
cburgess | superdan too | 18:44 |
mriedem | looking | 18:44 |
mriedem | you want the --until-complete thing | 18:44 |
cburgess | OK. | 18:44 |
cburgess | I can figure out when that went in then. | 18:44 |
mriedem | i want to say ocata | 18:44 |
cburgess | Prior to that it didn't work at all or... it was just inefficient? | 18:45 |
mriedem | https://review.openstack.org/#/c/378718/ | 18:45 |
mriedem | yeah ocata | 18:45 |
superdan | didn't work at all really | 18:45 |
mriedem | before that i think there were some random foreign key constraints that could mess it up for totally completing | 18:45 |
*** thorst has joined #openstack-nova | 18:45 | |
mriedem | plus you had to always specify the batch number | 18:45 |
cburgess | RAD... | 18:46 |
cburgess | So.. not as sad a panda as I was before, still work for me to do. Thanks. | 18:46 |
*** cdent has joined #openstack-nova | 18:47 | |
mriedem | also https://review.openstack.org/#/q/I77255c77780f0c2b99d59a9c20adecc85335bb18 | 18:47 |
mriedem | so going back to mitaka i think you can delete everything in batches | 18:47 |
mriedem | per dan's fix | 18:47 |
cburgess | Cool. | 18:48 |
cburgess | I doubt I'm going to enjoy backporting this to Icehouse. *sigh* | 18:49 |
*** cdent has quit IRC | 18:49 | |
melwitt | icehouse? ouch | 18:49 |
cburgess | melwitt Don't judge.... ok well judge. | 18:49 |
melwitt | not judging, just imagining the pain | 18:50 |
*** thorst has quit IRC | 18:50 | |
mriedem | cburgess: i expect it's actually not bad | 18:50 |
mriedem | since that code is isolated | 18:50 |
mriedem | and not a lot of changes over time | 18:50 |
melwitt | that reminds me, I wanted to resurrect my old patch to turn on FK constraint enforcement to sqlite | 18:50 |
cburgess | melwitt My world is pain.. nothing but pain. I'm a purveyor of fine vintage clouds (actually I purvey new ones, but I have to support vintage ones). | 18:50 |
melwitt | hah | 18:50 |
openstackgerrit | melanie witt proposed openstack/nova master: Make setenv consistent for functional and api_samples https://review.openstack.org/507976 | 18:52 |
openstackgerrit | melanie witt proposed openstack/nova master: Make setenv consistent for functional and api-samples https://review.openstack.org/507976 | 18:54 |
openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Add a regression test for bug 1718455 https://review.openstack.org/508590 | 18:57 |
openstack | bug 1718455 in OpenStack Compute (nova) "[pike] Nova host disable and Live Migrate all instances fail." [Medium,In progress] https://launchpad.net/bugs/1718455 - Assigned to Matt Riedemann (mriedem) | 18:57 |
openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Ensure instance can migrate when launched concurrently https://review.openstack.org/508591 | 18:57 |
*** pino has quit IRC | 19:03 | |
*** lbragstad has quit IRC | 19:03 | |
*** smatzek has quit IRC | 19:04 | |
*** smatzek has joined #openstack-nova | 19:06 | |
*** smatzek has quit IRC | 19:06 | |
*** lbragstad has joined #openstack-nova | 19:07 | |
*** pino has joined #openstack-nova | 19:07 | |
*** penick has quit IRC | 19:08 | |
mriedem | superdan: dead code now right? https://github.com/openstack/nova/blob/ae4b5d0147cb3e345bf57034221e9c8fedf3cad2/nova/conductor/manager.py#L261 | 19:09 |
mriedem | oh nvm | 19:09 |
mriedem | we're at 1.17 | 19:09 |
superdan | right | 19:09 |
superdan | we never bumped | 19:09 |
mriedem | we should remember to do that this release, across the board | 19:10 |
mriedem | we're due | 19:10 |
mriedem | and by we i mean you, because i'd just mess it up | 19:10 |
superdan | heh | 19:11 |
*** esberglu has joined #openstack-nova | 19:12 | |
*** esberglu has quit IRC | 19:12 | |
*** esberglu has joined #openstack-nova | 19:13 | |
*** smatzek has joined #openstack-nova | 19:14 | |
openstackgerrit | Dan Smith proposed openstack/nova master: Merge build requests into the sortmaster 9000 https://review.openstack.org/508595 | 19:16 |
superdan | mriedem: ^ probably needs a few more test cases, but you love pointing those out so I'll indulge you | 19:16 |
superdan | I'm trying to decide if I should parallelize fetching the buildrequests as well, to try to further lower the latency | 19:17 |
superdan | it'd be hard to prove that is worth it though, since it's hard to have many instances in that state for long without bugs | 19:17 |
*** esberglu has quit IRC | 19:17 | |
mriedem | i'm currently doing a review of https://review.openstack.org/#/c/498948/ before it merges | 19:18 |
superdan | another favorite pasttime of yours | 19:18 |
mriedem | yeah the only way to do that really is via fixtures, to hold up the build requests | 19:18 |
superdan | well, I meant in a devstack type environment, but yeah | 19:18 |
*** sridharg has quit IRC | 19:19 | |
mriedem | yeah i'm not sure how you'd reliably test that | 19:19 |
superdan | that's my point yeah | 19:19 |
mriedem | unless you booted so many at once, and scheduling was slow enough, that you could see a difference | 19:19 |
superdan | and probably not much gain for people | 19:19 |
mriedem | single node devstack is probably not going to work there | 19:19 |
mriedem | you'd have to fake out like 1000 computes or something | 19:19 |
mriedem | something that placement has to chew on | 19:19 |
*** catintheroof has quit IRC | 19:20 | |
superdan | nah, just shut down scheduler so we block on making that decision and then try to list before the timeout | 19:20 |
superdan | but still, not great | 19:20 |
*** catintheroof has joined #openstack-nova | 19:20 | |
*** ijw has quit IRC | 19:21 | |
mriedem | true, set the rpc timeout to 10 minutes :) | 19:21 |
superdan | the problem is, because we don't have real threads, we're already pegging the cpu just processing the results from the DBs as it is, so, not likely the even smaller overlap of operations is really going to help | 19:22 |
melwitt | how can we get real threads | 19:22 |
superdan | I'm not sure eventlet is threadsafe, so I'm not sure we can without bigger changes | 19:23 |
*** yamamoto has joined #openstack-nova | 19:23 | |
superdan | that was the problem with us using real threads for db workers ages ago, and it was never fixed, AFAIK, we just worked around it by moving to an all-python db driver | 19:23 |
superdan | in aggregate it's not as big of a deal because multiple requests will be running at once in our workers, so more overall work gets done with more cores, just not in a single-request sort of environment | 19:24 |
*** catintheroof has quit IRC | 19:24 | |
superdan | any environment that only has one concurrent request ever is either (a) dan's test box or (b) probably not worried about listing thousands of instances at a time :) | 19:25 |
melwitt | heh | 19:25 |
*** yamamoto has quit IRC | 19:28 | |
mriedem | superdan: some comments/questions in https://review.openstack.org/#/c/498948/ | 19:29 |
openstackgerrit | priyaduggirala proposed openstack/nova master: Rename parameters in call() of nova/image/glance.py https://review.openstack.org/508533 | 19:29 |
mriedem | not trying to block, just want to make sure i know what's going on with this stuff before it merges and i'm lost later | 19:29 |
superdan | mriedem: I thought we didn't do _LI( but we don't do _( at all anymore? | 19:31 |
mriedem | we don't translate log messages at all anymore | 19:32 |
superdan | really thought I was getting pep8 fails | 19:32 |
superdan | christ, I can never keep it straight | 19:32 |
mriedem | https://docs.openstack.org/oslo.i18n/latest/user/guidelines.html | 19:33 |
mriedem | i think that top paragraph is the new guideline | 19:34 |
*** crushil has quit IRC | 19:34 | |
mriedem | and https://docs.openstack.org/oslo.i18n/latest/user/guidelines.html#log-translation | 19:34 |
*** thorst has joined #openstack-nova | 19:35 | |
superdan | I believe you, I just can't keep track of it | 19:37 |
mriedem | i had to look it up too, wasn't sure about _() when you asked but was pretty sure | 19:37 |
superdan | I figure if I just pick some behavior I'll be right 20% of the time when we've circled back to that as the preferred one | 19:38 |
mriedem | depends on the current ibm corporate wide software guidelines at the time | 19:39 |
superdan | mriedem: so, this isn't in the gate yet so do you want me to fix the bottom patch or tack on to the end? this set is pretty fragile so if I do the bottom it'll likely percolate awesomeness up the stack pretty good | 19:39 |
superdan | and by "awesomeness" I mean "my tears" | 19:39 |
mriedem | was there anything major? the translation markers and simple logging stuff, plus docstring or whatever can all be done at the end | 19:40 |
mriedem | there was the one conditional block that i thought was dead code | 19:40 |
superdan | the else? | 19:40 |
superdan | the comment was just incorrect | 19:40 |
mriedem | oh | 19:40 |
mriedem | the bottom 2 are approved so i'd say just take a fixup change at the end of the series | 19:41 |
superdan | I really should just remove "on the source" from that one since it'll be used any time we need to revert the allocation regardless of why/where | 19:41 |
mriedem | the thing i wanted to be cautious of was overusing it like remove_provider_from_instance_allocation in the scheduler report client, | 19:42 |
mriedem | because remove_provider_from_instance_allocation was written really for cold migrate / resize + resize to same host, | 19:42 |
mriedem | but we've used it for other move operations, and there are some assumptions in there which don't always work for other move operatoins | 19:42 |
mriedem | i.e. | 19:42 |
mriedem | # NOTE(danms): We are in a resize to same host scenario. Since we | 19:42 |
mriedem | # are the only provider then we need to merge back in the doubled | 19:42 |
mriedem | # allocation with our part subtracted | 19:42 |
superdan | well, this really should apply to all of the types once we get it done because same/different, cold/live, they're all the same process since we don't have to worry about clashes since the migration uuid holds things | 19:43 |
mriedem | if so, | 19:43 |
mriedem | then heed my warning about assuming migration.source_node is set | 19:43 |
mriedem | HEED IT | 19:43 |
mriedem | because we don't even attempt to set that shit for live migration | 19:43 |
superdan | yeah, I saw, I need to go look | 19:43 |
mriedem | since there is no claim | 19:43 |
superdan | because I thought it was set there too | 19:43 |
*** penick has joined #openstack-nova | 19:44 | |
mriedem | _live_migrate in conductor task manager | 19:44 |
mriedem | we set the compute attributes, but not the node ones | 19:44 |
mriedem | was just looking at using those yesterday for something else | 19:44 |
mriedem | if those do get set, it would happen later in the compute probably | 19:44 |
superdan | oh the hosts I see | 19:44 |
superdan | well, I expect that just means we don't have coverage for live migrations failing in a way that will result in this getting called, | 19:46 |
superdan | and/or I wasn't consistent in that patch at the top, | 19:46 |
superdan | but I haven't really gone over that one in as much detail | 19:46 |
penick | pino: There's a couple ways to do this, one is to completely generate a ssh host key and sign it, then stuff it into the instance through vendordata. Another is.. more complex. | 19:46 |
superdan | keeping these two sets straight has been hard | 19:47 |
mriedem | superdan: i bet | 19:47 |
mriedem | don't forget about evacuate and unshelve | 19:47 |
mriedem | oh yeah, plus the migration object has dest_compute, dest_host, and dest_node, where one of those is the hostname and one is the host IP | 19:47 |
mriedem | yay! | 19:47 |
penick | pino: the more complex version means running a whole AuthNG infrastructure to handle trusted boot of an instance and giving it one-time credentials which allow it to bootstrap on boot and get its key signed. Heavy to implement, useful long term for secure infrastructure. Probably way heavier than you need | 19:48 |
superdan | mriedem: not sure unshelve is a thing here.. once you're offloaded we shouldn't keep an allocation for you | 19:48 |
mriedem | oh right | 19:49 |
mriedem | yeah | 19:49 |
superdan | and for evacuate, we don't need to keep a claim on the old host, so ... also not sure that's a thing | 19:49 |
superdan | I originally had them on my radar, but thinking more I'm not sure that's the right thing to do | 19:49 |
* superdan sighs looking at the gate | 19:52 | |
*** mingyu_ has quit IRC | 19:58 | |
*** mingyu has joined #openstack-nova | 19:58 | |
*** smatzek has quit IRC | 19:59 | |
*** smatzek has joined #openstack-nova | 20:00 | |
*** huanxie has joined #openstack-nova | 20:00 | |
*** MikeG451 has quit IRC | 20:01 | |
dims | mriedem : if i can get to the browser based vnc for a nova vm ... is there a way to attach a real vncviewer instead of the browser? (is there enough information in the browser url?) | 20:02 |
*** chyka_ has joined #openstack-nova | 20:02 | |
superdan | dims: you need a websocket client proxy | 20:03 |
superdan | dims: the browser client isn't connecting to the vnc server, but getting the stream over a websocket | 20:03 |
dims | superdan : i see, i have to find a vnc client that supports that .. | 20:04 |
dims | thanks superdan. will look | 20:04 |
superdan | dims: it's called novnc :P | 20:04 |
dims | which is browser based :) | 20:04 |
*** smatzek_ has joined #openstack-nova | 20:04 | |
superdan | right | 20:04 |
superdan | I expect you won't find another, but .. good luck :) | 20:05 |
*** smatzek has quit IRC | 20:05 | |
superdan | you could build a ws proxy that listens on a tcp port | 20:05 |
superdan | client->proxy->proxy->server | 20:05 |
*** chyka has quit IRC | 20:05 | |
dims | hmm, i might just stick to the browser :) | 20:07 |
superdan | good plan :) | 20:07 |
*** esberglu has joined #openstack-nova | 20:07 | |
*** tonygunk has joined #openstack-nova | 20:08 | |
*** smatzek_ has quit IRC | 20:09 | |
*** xyang1 has quit IRC | 20:11 | |
*** esberglu has quit IRC | 20:11 | |
mriedem | dims: are you trying to circumvent zones | 20:12 |
dims | mriedem : not really, i can use the browser on my mac already, its just not very convenient for long use | 20:13 |
mriedem | s/*/i can use my mac already, it's just not very convenient/ | 20:14 |
dims | mriedem : bad regex? :) | 20:15 |
mriedem | yeah maybe | 20:15 |
superdan | dims: vnc consoles are for disaster recovery and windows boxes, neither of which should be prolonged use | 20:16 |
dims | right superdan. there's just no other way to get to these vm(s) currently (multi-level protected zones) | 20:17 |
superdan | ouch | 20:17 |
dims | y sigh | 20:17 |
*** syjulian has quit IRC | 20:17 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add hints to what the Migration attribute values are https://review.openstack.org/508603 | 20:21 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Refactor duplicate code for looking up the compute node name https://review.openstack.org/508604 | 20:21 |
*** mnestratov has joined #openstack-nova | 20:22 | |
*** yamamoto has joined #openstack-nova | 20:24 | |
cfriesen | not strictly a nova question, but hoping someone knows. If I monkey_patch the world with eventlet, will threading.Thread() actually give me a real thread or will it give me a greenthread? | 20:25 |
superdan | a greenthread | 20:27 |
*** tonygunk has quit IRC | 20:27 | |
*** yamamoto has quit IRC | 20:29 | |
cfriesen | thanks. I was expecting a real thread and couldn't figure out why I didn't see it on the system. | 20:29 |
*** huanxie has quit IRC | 20:30 | |
cfriesen | do Condition and RLock and friends all work properly with the greenthread? | 20:32 |
superdan | yes | 20:32 |
*** syjulian has joined #openstack-nova | 20:36 | |
*** gjayavelu has quit IRC | 20:36 | |
*** MikeG451 has joined #openstack-nova | 20:36 | |
openstackgerrit | Ed Leafe proposed openstack/nova-specs master: Return Alternate Hosts https://review.openstack.org/504275 | 20:43 |
*** slaweq has joined #openstack-nova | 20:47 | |
*** nikhil has quit IRC | 20:49 | |
*** Sukhdev has joined #openstack-nova | 20:49 | |
*** jmlowe has quit IRC | 20:50 | |
*** bnemec has quit IRC | 20:51 | |
*** vladikr has quit IRC | 20:55 | |
*** armax has joined #openstack-nova | 21:00 | |
mriedem | what was the big reason why baremetal needs to have reschedules again? came up in boston and the ironic multinode jobs rely on reschedules right now - is it something with node contention? or was it also something with just failed hardware builds? | 21:04 |
superdan | flakiness of the management controllers | 21:05 |
*** mnestratov has quit IRC | 21:05 | |
superdan | before claims in the scheduler, it was also that only one instance can ever be there, | 21:05 |
superdan | so if we race for resources with virt, there is a possibility that both instances can fit, but that never happens with bm | 21:06 |
*** awaugama has quit IRC | 21:06 | |
*** mingyu has quit IRC | 21:09 | |
*** penick has quit IRC | 21:10 | |
*** thorst has quit IRC | 21:10 | |
*** wxy has quit IRC | 21:13 | |
*** jamesdenton has joined #openstack-nova | 21:17 | |
*** dgonzalez_ has joined #openstack-nova | 21:19 | |
*** sapcc-bot has quit IRC | 21:19 | |
*** gjayavelu has joined #openstack-nova | 21:19 | |
*** sapcc-bot1 has joined #openstack-nova | 21:19 | |
*** edmondsw has quit IRC | 21:20 | |
*** jpena|off has quit IRC | 21:21 | |
*** dgonzalez_ has quit IRC | 21:21 | |
mriedem | figleaf: some comments inline https://review.openstack.org/#/c/504275/7 | 21:24 |
mriedem | but overall good | 21:24 |
mriedem | superdan: ok, that was something i mentioned in ^ as a missing use case | 21:24 |
mriedem | since it seemed like a pretty critical issue for ironic | 21:24 |
*** ltomasbo has quit IRC | 21:24 | |
*** yamamoto has joined #openstack-nova | 21:25 | |
*** slaweq has quit IRC | 21:26 | |
*** slaweq has joined #openstack-nova | 21:26 | |
*** ltomasbo has joined #openstack-nova | 21:28 | |
*** jpena|off has joined #openstack-nova | 21:29 | |
openstackgerrit | ayoung proposed openstack/nova master: Admin API Policy contingent on is_admin_project https://review.openstack.org/384148 | 21:29 |
*** thorst has joined #openstack-nova | 21:30 | |
*** slaweq has quit IRC | 21:31 | |
*** yamamoto has quit IRC | 21:31 | |
*** slaweq has joined #openstack-nova | 21:34 | |
*** baoli has quit IRC | 21:35 | |
*** thorst has quit IRC | 21:35 | |
*** hemna_ has quit IRC | 21:38 | |
mriedem | leakypipes: fried_rice: is there a reason why the traits parameter in alex's spec for GET /allocation_candidates is just called "required" rather than "required_traits"? | 21:41 |
mriedem | "Is the 'required' parameter required? No, it's optional. OK?" | 21:41 |
figleaf | mriedem: thanks | 21:43 |
figleaf | mriedem: and I wasn't at Boston, but I remember it from Atlanta | 21:45 |
mriedem | ok | 21:45 |
mriedem | let's combine our forgetfulness | 21:45 |
mriedem | for max recollection | 21:45 |
figleaf | It was in Austin!! | 21:46 |
*** sapcc-bot1 has quit IRC | 21:47 | |
*** sapcc-bot has joined #openstack-nova | 21:47 | |
*** hoonetorg has joined #openstack-nova | 21:50 | |
*** huanxie has joined #openstack-nova | 21:50 | |
*** esberglu has joined #openstack-nova | 21:50 | |
mriedem | leakypipes: figleaf: superdan: johnthetubaguy: fried_rice: left some comments in the traits spec https://review.openstack.org/#/c/497713/ - two things i don't like, but i'm assuming have been discussed to death already | 21:50 |
superdan | I won't get back to it until monday | 21:51 |
superdan | but... cool | 21:51 |
figleaf | mriedem: I don't like 'required' or 'requires' either | 21:51 |
superdan | required= is the only way to go, IMHO | 21:52 |
*** thorst has joined #openstack-nova | 21:52 | |
figleaf | mriedem: heading out soon; will comment by Monday | 21:52 |
*** pchavva has quit IRC | 21:54 | |
*** esberglu has quit IRC | 21:56 | |
*** figleaf is now known as edleafe | 21:56 | |
*** thorst has quit IRC | 21:56 | |
*** lpetrut has quit IRC | 21:58 | |
*** shaner has joined #openstack-nova | 21:58 | |
mriedem | ?required_foobars | 21:58 |
*** ijw has joined #openstack-nova | 22:01 | |
*** Swami has quit IRC | 22:01 | |
*** ijw has quit IRC | 22:02 | |
mriedem | ok seeing the bike shedding on this in the previous comments | 22:05 |
*** lyan has quit IRC | 22:06 | |
fried_rice | mriedem I abstain. I'd be fine with whatever y'all land on wrt those two points. | 22:06 |
*** slaweq has quit IRC | 22:08 | |
*** slaweq has joined #openstack-nova | 22:15 | |
*** huanxie has quit IRC | 22:20 | |
*** armax has quit IRC | 22:26 | |
*** yamamoto has joined #openstack-nova | 22:27 | |
mriedem | tested out GET /servers?status='' | 22:28 |
mriedem | it definitely has a behavior change from what the spec is proposing | 22:28 |
mriedem | it applies that as the filter, which means you don't get any instances back that have a vm_state set | 22:28 |
*** gouthamr has quit IRC | 22:29 | |
*** ijw has joined #openstack-nova | 22:31 | |
*** baoli has joined #openstack-nova | 22:32 | |
*** yamamoto has quit IRC | 22:32 | |
*** baoli_ has joined #openstack-nova | 22:34 | |
*** baoli has quit IRC | 22:37 | |
fried_rice | mriedem But does status= take a list? | 22:41 |
fried_rice | It doesn't appear to, in my trials. | 22:41 |
fried_rice | mriedem Which makes it apples:oranges compared to traits. | 22:41 |
thingee | mriedem: there are 69 total forum sessions | 22:44 |
thingee | mriedem: was waiting all day for that answer myself :) | 22:44 |
*** esberglu has joined #openstack-nova | 22:45 | |
mriedem | ok and 73 proposed | 22:45 |
mriedem | so i guess chances are good to get stuff in, especially since there are some duplicates | 22:46 |
thingee | hey I'll cheers my beer to that | 22:46 |
*** slaweq has quit IRC | 22:48 | |
*** esberglu has quit IRC | 22:50 | |
*** thorst has joined #openstack-nova | 22:53 | |
*** pino has quit IRC | 23:04 | |
*** slaweq has joined #openstack-nova | 23:04 | |
*** chyka_ has quit IRC | 23:05 | |
*** hongbin has quit IRC | 23:09 | |
*** huanxie has joined #openstack-nova | 23:20 | |
openstackgerrit | Eric Fried proposed openstack/nova master: Use ksa adapter for cinder client https://review.openstack.org/508345 | 23:21 |
fried_rice | mriedem Since you're the cinder guy? ^ | 23:22 |
*** sapcc-bot has quit IRC | 23:23 | |
*** sapcc-bot has joined #openstack-nova | 23:23 | |
*** yamamoto has joined #openstack-nova | 23:29 | |
*** yamamoto has quit IRC | 23:35 | |
*** lbragstad has quit IRC | 23:35 | |
*** slaweq has quit IRC | 23:36 | |
superdan | mriedem: they just restarted zuul with some fixes including one that makes it not do the thing your patch was trying to avoid | 23:37 |
superdan | so we might be unblocked | 23:37 |
*** esberglu has joined #openstack-nova | 23:39 | |
*** fried_rice is now known as efried_thbagh | 23:40 | |
*** esberglu has quit IRC | 23:44 | |
*** slaweq has joined #openstack-nova | 23:50 | |
superdan | mriedem: strike that. | 23:51 |
*** zhurong has joined #openstack-nova | 23:52 | |
*** huanxie has quit IRC | 23:53 | |
*** gyee has quit IRC | 23:53 | |
*** Sukhdev has quit IRC | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!