*** thorst has quit IRC | 00:00 | |
*** dtp has quit IRC | 00:01 | |
*** yingjun has joined #openstack-nova | 00:03 | |
*** bkopilov_ has quit IRC | 00:04 | |
*** kbaegis has joined #openstack-nova | 00:08 | |
*** ijw has joined #openstack-nova | 00:10 | |
*** Apoorva_ has quit IRC | 00:12 | |
*** itlinux has quit IRC | 00:12 | |
*** Apoorva has joined #openstack-nova | 00:13 | |
*** yamamoto has quit IRC | 00:14 | |
*** gbarros has quit IRC | 00:14 | |
*** gmann has quit IRC | 00:15 | |
*** itlinux has joined #openstack-nova | 00:15 | |
*** gmann has joined #openstack-nova | 00:15 | |
*** yamamoto has joined #openstack-nova | 00:15 | |
*** annegentle has joined #openstack-nova | 00:16 | |
*** zz9pzza has joined #openstack-nova | 00:17 | |
*** bkopilov_ has joined #openstack-nova | 00:17 | |
*** itlinux has quit IRC | 00:18 | |
*** yamamoto has quit IRC | 00:20 | |
*** myteron has joined #openstack-nova | 00:20 | |
*** myteron has left #openstack-nova | 00:21 | |
*** zz9pzza has quit IRC | 00:21 | |
*** rajathagasthya has joined #openstack-nova | 00:26 | |
openstackgerrit | Dan Smith proposed openstack/nova master: claim resources in placement API during schedule() https://review.openstack.org/483566 | 00:26 |
---|---|---|
openstackgerrit | Dan Smith proposed openstack/nova master: placement: account for move operations in claim https://review.openstack.org/487589 | 00:26 |
*** kiennt has joined #openstack-nova | 00:33 | |
*** marst has quit IRC | 00:34 | |
*** masber has joined #openstack-nova | 00:35 | |
openstackgerrit | Michael Still proposed openstack/nova master: Avoid chowning console logs in libvirt https://review.openstack.org/472229 | 00:36 |
openstackgerrit | Michael Still proposed openstack/nova master: First attempt at adding a privsep user to nova itself. https://review.openstack.org/459166 | 00:36 |
openstackgerrit | Michael Still proposed openstack/nova master: Move libvirt usages of chown to privsep. https://review.openstack.org/471972 | 00:36 |
openstackgerrit | Michael Still proposed openstack/nova master: rootwrap.d cleanup mislabeled files https://review.openstack.org/486831 | 00:36 |
*** cfriesen_ has joined #openstack-nova | 00:36 | |
*** psachin has joined #openstack-nova | 00:36 | |
*** tbachman has quit IRC | 00:40 | |
*** bkopilov_ has quit IRC | 00:47 | |
*** yamamoto has joined #openstack-nova | 00:48 | |
*** licanwei has joined #openstack-nova | 00:48 | |
*** iceyao has joined #openstack-nova | 00:52 | |
*** liusheng has quit IRC | 00:52 | |
*** boris_42 has joined #openstack-nova | 00:54 | |
*** masber has quit IRC | 00:54 | |
jgriffith | mriedem_afk smcginnis ildikov I guess I'll have to accept defeat :( | 00:55 |
*** iceyao has quit IRC | 00:56 | |
jgriffith | mriedem_afk smcginnis ildikov I updated the comments in the review but there's something bigger going on it looks like, inparticular instances going to error state and libvirt failing to clean them up | 00:56 |
jgriffith | http://logs.openstack.org/85/330285/106/check/gate-tempest-dsvm-py35-ubuntu-xenial/40072bb/logs/screen-n-cpu.txt.gz?level=TRACE#_Jul_26_09_34_33_062305 | 00:56 |
openstackgerrit | Dan Smith proposed openstack/nova master: claim resources in placement API during schedule() https://review.openstack.org/483566 | 00:56 |
openstackgerrit | Dan Smith proposed openstack/nova master: placement: account for move operations in claim https://review.openstack.org/487589 | 00:56 |
*** catintheroof has quit IRC | 00:57 | |
*** litao__ has joined #openstack-nova | 00:57 | |
*** liusheng has joined #openstack-nova | 00:57 | |
jgriffith | mriedem_afk smcginnis ildikov the compute host not found error is kinda concerning, wondering if we need a rebase again? | 00:57 |
jgriffith | anyway | 00:57 |
jgriffith | I'm heading home, catch ya'll later | 00:58 |
*** bkopilov_ has joined #openstack-nova | 01:00 | |
*** chyka_ has joined #openstack-nova | 01:00 | |
*** rajathagasthya has quit IRC | 01:02 | |
*** phuongnh has joined #openstack-nova | 01:03 | |
*** chyka has quit IRC | 01:04 | |
* dims peeks | 01:05 | |
*** chyka_ has quit IRC | 01:05 | |
*** tbachman has joined #openstack-nova | 01:06 | |
*** masber has joined #openstack-nova | 01:08 | |
*** harlowja has quit IRC | 01:10 | |
*** hongbin has joined #openstack-nova | 01:11 | |
*** zz9pzza has joined #openstack-nova | 01:11 | |
*** iceyao has joined #openstack-nova | 01:12 | |
*** zz9pzza has quit IRC | 01:16 | |
*** iceyao has quit IRC | 01:17 | |
*** catintheroof has joined #openstack-nova | 01:18 | |
*** iceyao has joined #openstack-nova | 01:24 | |
*** catintheroof has quit IRC | 01:25 | |
*** edmondsw has joined #openstack-nova | 01:25 | |
*** baoli has quit IRC | 01:27 | |
*** baoli has joined #openstack-nova | 01:28 | |
*** penick has quit IRC | 01:30 | |
*** edmondsw has quit IRC | 01:30 | |
*** ijw has quit IRC | 01:32 | |
*** gouthamr has quit IRC | 01:33 | |
*** kbaegis has quit IRC | 01:35 | |
*** cfriesen_ has quit IRC | 01:38 | |
*** esberglu has quit IRC | 01:42 | |
*** tbachman has quit IRC | 01:43 | |
*** iceyao has quit IRC | 01:44 | |
*** masber has quit IRC | 01:50 | |
*** saphi has joined #openstack-nova | 01:51 | |
*** iceyao has joined #openstack-nova | 01:52 | |
*** masber has joined #openstack-nova | 01:52 | |
*** larainema has quit IRC | 01:52 | |
zul | mikal: I sent a patch to unbreak nova-lxd btw | 01:53 |
*** yamamoto has quit IRC | 01:53 | |
dims | mriedem_afk : which devstack-gate change reset stuff today? https://review.openstack.org/#/q/project:openstack-infra/devstack-gate+status:merged | 01:53 |
dims | the "Set up stable/pike" one? mriedem_afk | 01:54 |
*** iceyao has quit IRC | 01:56 | |
*** thorst has joined #openstack-nova | 01:57 | |
dansmith | dims: no, just a sec | 01:59 |
dansmith | dims: it was devstack, and this is the revert: https://review.openstack.org/#/c/488201/ | 01:59 |
dansmith | which has a link to the original | 02:00 |
dims | gotcha. thanks dansmith | 02:00 |
dansmith | dims: that merged and we're waiting for the two nova patches that got kicked out to merge before I update the tag | 02:00 |
*** iceyao has joined #openstack-nova | 02:01 | |
dansmith | dims: this and the one below: https://review.openstack.org/#/c/483566 | 02:01 |
*** itlinux has joined #openstack-nova | 02:01 | |
*** thorst has quit IRC | 02:02 | |
dims | dansmith : looks like it will take another 2 hours at least | 02:03 |
dansmith | dims: at least | 02:03 |
*** itlinux has quit IRC | 02:03 | |
dansmith | dims: I'm watching it though and will update the tag commit when it lands | 02:03 |
dansmith | a thrilling thursday evening | 02:03 |
dims | sounds good dansmith. i'll take care of it when i wake up if ttx hasn't already | 02:04 |
dansmith | cool, thanks | 02:04 |
*** jmlowe has joined #openstack-nova | 02:04 | |
*** iceyao has quit IRC | 02:05 | |
*** acormier has quit IRC | 02:05 | |
*** zz9pzza has joined #openstack-nova | 02:05 | |
*** acormier has joined #openstack-nova | 02:06 | |
*** acormier has quit IRC | 02:07 | |
*** acormier has joined #openstack-nova | 02:07 | |
*** zz9pzza has quit IRC | 02:10 | |
*** esberglu has joined #openstack-nova | 02:11 | |
*** acormier has quit IRC | 02:12 | |
*** yamahata has quit IRC | 02:15 | |
*** esberglu has quit IRC | 02:16 | |
*** chyka has joined #openstack-nova | 02:16 | |
*** phuongnh has quit IRC | 02:19 | |
*** chyka has quit IRC | 02:20 | |
*** Apoorva_ has joined #openstack-nova | 02:23 | |
*** annegentle has quit IRC | 02:23 | |
*** penick has joined #openstack-nova | 02:25 | |
*** saphi has quit IRC | 02:26 | |
*** itlinux has joined #openstack-nova | 02:26 | |
*** Apoorva has quit IRC | 02:27 | |
*** lbragstad has joined #openstack-nova | 02:27 | |
*** Apoorva_ has quit IRC | 02:27 | |
*** lbragstad has quit IRC | 02:29 | |
*** zhurong has joined #openstack-nova | 02:30 | |
*** penick has quit IRC | 02:40 | |
*** penick has joined #openstack-nova | 02:41 | |
*** tbachman has joined #openstack-nova | 02:44 | |
*** saphi has joined #openstack-nova | 02:44 | |
*** markvoelker has quit IRC | 02:50 | |
*** phuongnh has joined #openstack-nova | 02:58 | |
smcginnis | jgriffith: Thanks for digging in to it. Maybe collect notes in an etherpad or something to see if anyone else has more ideas? | 02:58 |
*** acormier has joined #openstack-nova | 02:58 | |
*** zz9pzza has joined #openstack-nova | 03:00 | |
*** acormier has quit IRC | 03:02 | |
*** zz9pzza has quit IRC | 03:04 | |
*** mtanino has joined #openstack-nova | 03:06 | |
*** iceyao has joined #openstack-nova | 03:06 | |
*** saphi has quit IRC | 03:10 | |
*** iceyao has quit IRC | 03:11 | |
*** masber has quit IRC | 03:13 | |
*** edmondsw has joined #openstack-nova | 03:13 | |
openstackgerrit | Takashi NATSUME proposed openstack/python-novaclient master: Update URLs in docs, comments and setup.cfg https://review.openstack.org/488271 | 03:17 |
*** baoli has quit IRC | 03:18 | |
*** edmondsw has quit IRC | 03:18 | |
*** chyka has joined #openstack-nova | 03:19 | |
jgriffith | smcginnis roger dodger | 03:19 |
*** gouthamr has joined #openstack-nova | 03:22 | |
*** thorst has joined #openstack-nova | 03:23 | |
*** chyka has quit IRC | 03:23 | |
*** saphi has joined #openstack-nova | 03:23 | |
*** armax has quit IRC | 03:27 | |
*** coreywright has quit IRC | 03:27 | |
mriedem_afk | jgriffith: the compute host not found warnings at the start of the n-cpu logs are 'normal' right now | 03:29 |
*** mriedem_afk is now known as mriedem | 03:29 | |
jgriffith | mriedem noted | 03:29 |
*** iceyao has joined #openstack-nova | 03:29 | |
*** zhurong has quit IRC | 03:31 | |
*** iceyao has quit IRC | 03:34 | |
*** armax has joined #openstack-nova | 03:36 | |
*** mtanino has quit IRC | 03:37 | |
*** thorst has quit IRC | 03:37 | |
*** udesale has joined #openstack-nova | 03:38 | |
*** hongbin has quit IRC | 03:41 | |
mriedem | dansmith: #2 in the gate, i can take over if you want | 03:42 |
*** boris_42 has quit IRC | 03:43 | |
dansmith | I'm watchin' | 03:43 |
*** armax has quit IRC | 03:43 | |
dansmith | you got to sleep | 03:43 |
dansmith | s/got/go/ | 03:43 |
*** armax has joined #openstack-nova | 03:43 | |
*** armax has quit IRC | 03:44 | |
openstackgerrit | Takashi NATSUME proposed openstack/python-novaclient master: Remove run_tests.sh https://review.openstack.org/488276 | 03:44 |
*** armax has joined #openstack-nova | 03:44 | |
*** armax has quit IRC | 03:44 | |
*** coreywright has joined #openstack-nova | 03:46 | |
*** gouthamr has quit IRC | 03:46 | |
*** yamamoto has joined #openstack-nova | 03:48 | |
*** masber has joined #openstack-nova | 03:48 | |
*** tiendc has joined #openstack-nova | 03:50 | |
*** yamamoto_ has joined #openstack-nova | 03:51 | |
*** iceyao has joined #openstack-nova | 03:51 | |
*** mamandle has joined #openstack-nova | 03:52 | |
*** yamamoto has quit IRC | 03:53 | |
mriedem | i don't sleep | 03:53 |
*** zz9pzza has joined #openstack-nova | 03:54 | |
dansmith | hah | 03:54 |
*** iceyao has quit IRC | 03:56 | |
*** yamamoto has joined #openstack-nova | 03:58 | |
*** yamamoto_ has quit IRC | 03:58 | |
*** zz9pzza has quit IRC | 03:59 | |
dansmith | 10 minutes | 03:59 |
*** gouthamr has joined #openstack-nova | 03:59 | |
dansmith | ooh, 1 minute | 03:59 |
jgriffith | mriedem smcginnis https://etherpad.openstack.org/p/cinder-v3-attach-nova-traces | 04:01 |
jgriffith | I can add more as I go here and maybe even send a request out to the ML tomorrow if there might be anybody interested | 04:02 |
jgriffith | My brain has turned a bit mushy after waking through all the bdm stuff all day over and over | 04:02 |
jgriffith | One thing I left out... I have a system I reproduced this on that the /dev/sdd device is in fact there and the connection is still valid, but that periodic query against it still fails... I didn't go down that rabbit hole yet though | 04:03 |
mriedem | jgriffith: ok, adding to our other etherpad tracking blueprints | 04:03 |
jgriffith | mriedem thanks | 04:03 |
jgriffith | mriedem and I guess you're call earlier was indeed the right one | 04:04 |
jgriffith | mriedem sorry if I wasn't quite as easy going about it as I should've been | 04:04 |
mriedem | not a problem | 04:04 |
*** tbachman has quit IRC | 04:07 | |
*** itlinux has quit IRC | 04:07 | |
mriedem | py3 job passed tests, | 04:08 |
mriedem | collecting logs | 04:08 |
*** nicolasbock has joined #openstack-nova | 04:08 | |
dansmith | yep | 04:08 |
mriedem | you're also watching over telnet? | 04:08 |
dansmith | off and on to make sure it's not stuck | 04:08 |
openstackgerrit | Merged openstack/nova master: placement: account for move operations in claim https://review.openstack.org/487589 | 04:08 |
dansmith | hmm, I pulled and got the commit but no merge commit yet | 04:09 |
dansmith | for the first one | 04:10 |
mriedem | much like the line for the carousel tonight, you must have patience | 04:11 |
dansmith | heh | 04:11 |
mriedem | and a high tolerance for carney folk | 04:11 |
openstackgerrit | Merged openstack/nova master: claim resources in placement API during schedule() https://review.openstack.org/483566 | 04:12 |
mriedem | duh duh duh | 04:13 |
dansmith | got that one but still no merge commits | 04:13 |
mriedem | don't we just need 23c4eb34380bdf3eece11abbe0f6ccb68c060f47 ? | 04:13 |
dansmith | you list the merge commit in the release thing right? | 04:14 |
dansmith | not the actual commit | 04:14 |
mriedem | no, | 04:14 |
mriedem | tip of master | 04:14 |
dansmith | your WIP patch is a merge commit | 04:14 |
mriedem | that was just tip of master at the time | 04:14 |
dansmith | erm, okay | 04:14 |
dansmith | so maybe zuul does a ff merge if it's clean or something? I thought it always did merge commits | 04:14 |
mriedem | you want to update the release patch since you've watched this all night? | 04:15 |
dansmith | just did | 04:15 |
mriedem | well touche | 04:15 |
dansmith | both of the other milestones were merge commits | 04:16 |
mriedem | not intentionally | 04:16 |
*** yamamoto_ has joined #openstack-nova | 04:16 | |
dansmith | hrm, I don't understand, but whatever :) | 04:17 |
*** yamamoto has quit IRC | 04:17 | |
dansmith | glad you were here to tell me that | 04:17 |
dansmith | so I didn't wait all night | 04:17 |
mriedem | ha | 04:17 |
mriedem | would have to ask dhellmann tomorrow if there is magic behind the scenes | 04:17 |
mriedem | now that that's done, i suppose no one is around to actually merge and tag the damn thing | 04:18 |
dansmith | several I checked from ocata just now were merge commits too | 04:18 |
dansmith | mriedem: dims said he'd get it in the morning if ttx didn't first | 04:18 |
mriedem | yeah doug said they'd do it by the 10am CT release meeting | 04:18 |
dansmith | aye | 04:19 |
mriedem | alright, well f yeah, i'm going to watch some much deserved garbage tv and then go to bed | 04:20 |
dansmith | enjoy | 04:20 |
mriedem | thanks for shepharding | 04:20 |
*** links has joined #openstack-nova | 04:20 | |
mriedem | *shepherding? | 04:20 |
dansmith | np, g'nite | 04:20 |
*** mriedem has quit IRC | 04:20 | |
*** vishwana_ has joined #openstack-nova | 04:23 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-novaclient master: Updated from global requirements https://review.openstack.org/488283 | 04:25 |
*** vishwanathj has quit IRC | 04:26 | |
*** gouthamr has quit IRC | 04:30 | |
*** harlowja has joined #openstack-nova | 04:32 | |
*** sridharg has joined #openstack-nova | 04:38 | |
*** rajathagasthya has joined #openstack-nova | 04:40 | |
*** yamamoto has joined #openstack-nova | 04:40 | |
*** yamamoto_ has quit IRC | 04:41 | |
*** zz9pzza has joined #openstack-nova | 04:48 | |
*** sree_ has joined #openstack-nova | 04:49 | |
*** sree_ is now known as Guest91518 | 04:49 | |
*** psachin has quit IRC | 04:50 | |
*** yamamoto has quit IRC | 04:51 | |
*** markvoelker has joined #openstack-nova | 04:51 | |
*** zz9pzza has quit IRC | 04:52 | |
*** yamamoto has joined #openstack-nova | 04:53 | |
*** iceyao has joined #openstack-nova | 04:58 | |
*** yamamoto has quit IRC | 05:01 | |
*** edmondsw has joined #openstack-nova | 05:02 | |
*** iceyao has quit IRC | 05:03 | |
*** edmondsw has quit IRC | 05:06 | |
*** psachin has joined #openstack-nova | 05:08 | |
*** hshiina has joined #openstack-nova | 05:11 | |
*** mamandle has quit IRC | 05:13 | |
*** gyee has quit IRC | 05:13 | |
*** vishwana_ has quit IRC | 05:16 | |
*** vishwanathj has joined #openstack-nova | 05:17 | |
*** iceyao has joined #openstack-nova | 05:17 | |
*** ratailor has joined #openstack-nova | 05:19 | |
*** iceyao has quit IRC | 05:22 | |
*** iceyao has joined #openstack-nova | 05:23 | |
*** yassine has quit IRC | 05:23 | |
*** yassine has joined #openstack-nova | 05:24 | |
*** iceyao has quit IRC | 05:24 | |
*** markvoelker has quit IRC | 05:25 | |
*** _pewp_ has quit IRC | 05:25 | |
*** iceyao has joined #openstack-nova | 05:25 | |
*** _pewp_ has joined #openstack-nova | 05:28 | |
*** harlowja has quit IRC | 05:28 | |
*** iceyao has quit IRC | 05:30 | |
*** zhurong has joined #openstack-nova | 05:30 | |
*** vishwana_ has joined #openstack-nova | 05:31 | |
*** vishwanathj has quit IRC | 05:34 | |
*** iceyao has joined #openstack-nova | 05:39 | |
*** harlowja has joined #openstack-nova | 05:41 | |
*** zz9pzza has joined #openstack-nova | 05:42 | |
*** penick has quit IRC | 05:42 | |
*** kiennt has quit IRC | 05:44 | |
*** iceyao has quit IRC | 05:44 | |
*** kiennt has joined #openstack-nova | 05:44 | |
*** zz9pzza has quit IRC | 05:47 | |
*** cfriesen_ has joined #openstack-nova | 05:47 | |
*** kiennt has quit IRC | 05:50 | |
*** karthiks has joined #openstack-nova | 05:55 | |
*** rajathagasthya has quit IRC | 05:56 | |
*** mamandle has joined #openstack-nova | 05:59 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove unnecesary code https://review.openstack.org/488299 | 06:00 |
*** thorst has joined #openstack-nova | 06:00 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove unnecessary code https://review.openstack.org/488299 | 06:01 |
*** trinaths has joined #openstack-nova | 06:02 | |
*** iceyao has joined #openstack-nova | 06:02 | |
*** oomichi has quit IRC | 06:05 | |
*** kiennt has joined #openstack-nova | 06:05 | |
*** oomichi has joined #openstack-nova | 06:06 | |
*** thorst has quit IRC | 06:06 | |
*** iceyao has quit IRC | 06:06 | |
*** sridharg has quit IRC | 06:07 | |
*** oomichi has quit IRC | 06:10 | |
*** oomichi has joined #openstack-nova | 06:11 | |
*** rcernin has joined #openstack-nova | 06:15 | |
*** markvoelker has joined #openstack-nova | 06:22 | |
*** iceyao has joined #openstack-nova | 06:23 | |
*** jjung has joined #openstack-nova | 06:28 | |
*** esberglu has joined #openstack-nova | 06:31 | |
*** phuongnh has quit IRC | 06:32 | |
*** phuongnh has joined #openstack-nova | 06:33 | |
*** mamandle has quit IRC | 06:33 | |
*** esberglu has quit IRC | 06:36 | |
*** yamamoto has joined #openstack-nova | 06:36 | |
*** zz9pzza has joined #openstack-nova | 06:36 | |
*** sridharg has joined #openstack-nova | 06:37 | |
*** zz9pzza has quit IRC | 06:41 | |
*** yamamoto has quit IRC | 06:44 | |
*** yamamoto has joined #openstack-nova | 06:45 | |
*** harlowja has quit IRC | 06:48 | |
*** edmondsw has joined #openstack-nova | 06:50 | |
*** csuttles_ has quit IRC | 06:50 | |
*** dtantsur|afk is now known as dtantsur | 06:51 | |
*** edmondsw has quit IRC | 06:54 | |
*** markvoelker has quit IRC | 06:55 | |
*** damien_r has quit IRC | 06:55 | |
*** damien_r has joined #openstack-nova | 06:56 | |
*** cfriesen_ has quit IRC | 06:56 | |
*** chyka has joined #openstack-nova | 06:59 | |
*** vvargaszte has quit IRC | 07:01 | |
*** chyka has quit IRC | 07:03 | |
*** oomichi has quit IRC | 07:05 | |
*** oomichi has joined #openstack-nova | 07:06 | |
*** adisky__ has quit IRC | 07:06 | |
*** masber has quit IRC | 07:13 | |
*** vvargaszte has joined #openstack-nova | 07:19 | |
*** masber has joined #openstack-nova | 07:20 | |
*** kaisers has quit IRC | 07:20 | |
*** bhagyashris has quit IRC | 07:21 | |
*** phuongnh has quit IRC | 07:22 | |
*** bhagyashris has joined #openstack-nova | 07:22 | |
*** zz9pzza has joined #openstack-nova | 07:24 | |
*** yamamoto has quit IRC | 07:25 | |
*** yamamoto has joined #openstack-nova | 07:27 | |
*** kaisers has joined #openstack-nova | 07:29 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Amend uuid4 hacking rule https://review.openstack.org/488315 | 07:33 |
*** kaisers has quit IRC | 07:37 | |
*** masber has quit IRC | 07:38 | |
*** cristicalin has joined #openstack-nova | 07:41 | |
*** kaisers1 has joined #openstack-nova | 07:42 | |
*** ralonsoh has joined #openstack-nova | 07:44 | |
*** markvoelker has joined #openstack-nova | 07:52 | |
*** yamamoto has quit IRC | 07:58 | |
*** yamamoto has joined #openstack-nova | 07:59 | |
*** claudiub has joined #openstack-nova | 07:59 | |
*** ralonsoh has quit IRC | 07:59 | |
*** cristicalin has quit IRC | 08:00 | |
*** ralonsoh has joined #openstack-nova | 08:00 | |
*** takashin has left #openstack-nova | 08:01 | |
*** thorst has joined #openstack-nova | 08:03 | |
*** strigazi_ is now known as strigazi | 08:04 | |
openstackgerrit | longxingmiao proposed openstack/nova master: test review https://review.openstack.org/488328 | 08:07 |
*** thorst has quit IRC | 08:07 | |
*** yamamoto_ has joined #openstack-nova | 08:13 | |
*** adisky__ has joined #openstack-nova | 08:14 | |
*** yamamoto has quit IRC | 08:16 | |
*** zz9pzza has quit IRC | 08:17 | |
*** openstackgerrit has quit IRC | 08:18 | |
*** esberglu has joined #openstack-nova | 08:19 | |
*** derekh has joined #openstack-nova | 08:20 | |
*** sambetts|afk is now known as sambetts | 08:23 | |
*** esberglu has quit IRC | 08:23 | |
*** saphi_ has joined #openstack-nova | 08:24 | |
*** openstackgerrit has joined #openstack-nova | 08:24 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Test resize with placement api https://review.openstack.org/487958 | 08:24 |
*** sridharg has quit IRC | 08:24 | |
*** lucas-afk is now known as lucasagomes | 08:25 | |
*** sridharg has joined #openstack-nova | 08:25 | |
*** alexchadin has joined #openstack-nova | 08:25 | |
*** rmart04 has joined #openstack-nova | 08:25 | |
*** markvoelker has quit IRC | 08:26 | |
*** zz9pzza has joined #openstack-nova | 08:29 | |
openstackgerrit | jichenjc proposed openstack/nova master: refactory some code on get_password https://review.openstack.org/449458 | 08:31 |
*** efoley has joined #openstack-nova | 08:33 | |
*** BlackDex_ is now known as BlackDex | 08:33 | |
openstackgerrit | jichenjc proposed openstack/nova master: add cert when send keystone request https://review.openstack.org/485121 | 08:35 |
*** mvk has quit IRC | 08:36 | |
openstackgerrit | jichenjc proposed openstack/nova master: Add quiesce and unquiesce in support matrix https://review.openstack.org/482390 | 08:37 |
*** andreas_s has joined #openstack-nova | 08:41 | |
*** tuanluong has joined #openstack-nova | 08:45 | |
*** tinwood has joined #openstack-nova | 08:52 | |
bhagyashris | gibi: Hi, I have resolved my yesterday's issue there was some problem to restart the nfs server and for locking thing through nfs required statd service to enable. | 09:04 |
*** zenoway has joined #openstack-nova | 09:06 | |
*** rha has quit IRC | 09:06 | |
gibi | bhagyashris: good to hear that | 09:09 |
bhagyashris | gibi: Now everything is working fine to test the shared resource provider thing. I have just tested one scenario simply created instance as as mentioned in http://paste.openstack.org/show/616724/ but in my observation the root gb of created flavor has been considered in the allocations table against the compute resource provider and CUSTOM_DISK resource against "shared_resource" resource provider. | 09:11 |
bhagyashris | gibi: IMO, As i am creating the nfc backed instance so it should take the RAM and VCPU from the computes resource provider and DISK from the "shared_resource" provider | 09:12 |
bhagyashris | s/nfc/nfs | 09:13 |
gibi | bhagyashris: I don't know how can you tell nova that you want to consume DISK_GB not from the compute provider but from the shared one | 09:22 |
gibi | bhagyashris: this is why I suggested to use CUSTOM_DISK in the shared and then add CUSTOM_DISK to the flavor | 09:23 |
gibi | bhagyashris: that way I sure that the instance will consume from your shared provider | 09:23 |
*** SteveR_ has joined #openstack-nova | 09:23 | |
*** markvoelker has joined #openstack-nova | 09:23 | |
*** SteveR_ is now known as Guest80478 | 09:23 | |
gibi | bhagyashris: I hope others can help with this specific issue | 09:23 |
*** Guest80478 is now known as SteveRUKC | 09:23 | |
*** slaweq has joined #openstack-nova | 09:26 | |
*** cristicalin has joined #openstack-nova | 09:26 | |
bhagyashris | gibi: ohk. thank you. | 09:29 |
*** licanwei has quit IRC | 09:32 | |
*** cristicalin has quit IRC | 09:37 | |
SteveRUKC | hey all, quick question to which im struggling to find an answer. Is disk_allocation_ratio taken into account on live/cold migrations. As we have an allocation ratio of 6 set, but are having issues with migrations failing with a disk instance too large for target message. | 09:39 |
SteveRUKC | also, hypervisor_stats is showing a negative number for least_free | 09:39 |
SteveRUKC | if anyone has any ideas it would be most appreciated | 09:39 |
*** saphi_ has quit IRC | 09:42 | |
*** rha has joined #openstack-nova | 09:46 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: DNM: trying to turn on periodic tasks https://review.openstack.org/488352 | 09:48 |
openstackgerrit | Chris Dent proposed openstack/nova master: Optional separate database for placement API https://review.openstack.org/362766 | 09:53 |
*** gcb has quit IRC | 09:53 | |
*** chyka has joined #openstack-nova | 09:55 | |
*** markvoelker has quit IRC | 09:57 | |
*** chyka has quit IRC | 10:00 | |
*** prateek has joined #openstack-nova | 10:01 | |
*** zenoway has quit IRC | 10:03 | |
*** zenoway has joined #openstack-nova | 10:03 | |
*** thorst has joined #openstack-nova | 10:04 | |
*** slaweq has quit IRC | 10:04 | |
*** esberglu has joined #openstack-nova | 10:07 | |
*** thorst has quit IRC | 10:09 | |
dims | dansmith : looks like ttx took care of it 3 hours ago. w00t | 10:09 |
*** damien_r has left #openstack-nova | 10:10 | |
*** yingjun has quit IRC | 10:10 | |
*** cdent has joined #openstack-nova | 10:12 | |
*** esberglu has quit IRC | 10:12 | |
cdent | gibi: I did some similar periodic job fiddling last night and ran into the same confusion with the computes getting weird | 10:14 |
cdent | I’m guessing the fixture (or the the service) is not happy being in the same process with another version of itself? | 10:15 |
*** gszasz has joined #openstack-nova | 10:15 | |
*** iceyao has quit IRC | 10:17 | |
*** zenoway has quit IRC | 10:18 | |
*** zenoway has joined #openstack-nova | 10:19 | |
*** edmondsw has joined #openstack-nova | 10:26 | |
*** Guest91518 has quit IRC | 10:27 | |
*** sree_ has joined #openstack-nova | 10:28 | |
*** sree_ is now known as Guest51809 | 10:28 | |
*** tiendc has quit IRC | 10:29 | |
bhagyashris | cdent: Hi, Hi, I have resolved my yesterday's issue there was some problem to restart the nfs server and for locking thing through nfs required statd service to enable. | 10:29 |
openstackgerrit | Chris Dent proposed openstack/nova master: [placement] quash unicode warning with shared provider https://review.openstack.org/488363 | 10:29 |
cdent | bhagyashris: ah, cool, glad you were able to make it work | 10:30 |
*** kiennt has quit IRC | 10:30 | |
bhagyashris | cdent: Now everything is working fine to test the shared resource provider thing. I have just tested one scenario simply created instance as as mentioned in http://paste.openstack.org/show/616724/ but in my observation the root gb of created flavor has been considered in the allocations table against the compute resource provider and CUSTOM_DISK resource against "shared_resource" resource provider. | 10:30 |
*** edmondsw has quit IRC | 10:30 | |
bhagyashris | cdent: IMO, As i am creating the nfs backed instance so it should take the RAM and VCPU from the computes resource provider and DISK from the "shared_resource" provider. | 10:31 |
kashyap | mdbooth: Thanks for the review! | 10:31 |
*** tuanluong has quit IRC | 10:31 | |
kashyap | And also to dansmith (About: https://review.openstack.org/#/c/485752/, but not for the "summary" remark :P) | 10:31 |
cdent | bhagyashris: you can address that (at least in part) by using DISK_GB instead of CUSTOM_DISK for the nfs shared resource provider | 10:32 |
kashyap | johnthetubaguy: Maybe when you have a minute to ACK this straightforward change: https://review.openstack.org/#/c/485752/ | 10:32 |
*** zz9pzza has quit IRC | 10:32 | |
*** Guest51809 has quit IRC | 10:32 | |
cdent | the thing that will be missing is that there’s nothing currently in place to manage the allocation of disk on the shared resource provider, but that’s in progress with the claim in the scheduler stuff that is being worked on this week | 10:33 |
*** iceyao has joined #openstack-nova | 10:33 | |
bhagyashris | cdent: ohk Means instead of creating the "CUSTOM_DISK" resource class and then creating the inventory for that I need to update the inventory against "DISK_GB" resource class right. | 10:36 |
*** iceyao has quit IRC | 10:37 | |
cdent | bhagyashris: well basically the general rule is that if you can use a standard resource class (because it maps to the unit of resource a provider is providing) you may as well | 10:37 |
bhagyashris | cdent: ohk. checking... | 10:39 |
*** yamamoto_ has quit IRC | 10:40 | |
*** kornicameister has quit IRC | 10:45 | |
*** kornicameister has joined #openstack-nova | 10:46 | |
*** tbachman has joined #openstack-nova | 10:46 | |
s-dean | Hello, could someone point me in the right direction to debug this nova.exception.NeutronAdminCredentialConfigurationInvalid' ? | 10:48 |
*** karthiks has quit IRC | 10:49 | |
s-dean | nevermind | 10:50 |
*** iceyao has joined #openstack-nova | 10:50 | |
*** sridharg has quit IRC | 10:51 | |
*** zhurong has quit IRC | 10:53 | |
bhagyashris | cdent: I have updated the inventory using DISK_GB resource class against the nfs shared resource provider but in that case after booting the instance it's not using shared_storage provider. | 10:53 |
bhagyashris | cdent: It address the disk used against compute node resource provider. | 10:54 |
*** iceyao has quit IRC | 10:54 | |
*** markvoelker has joined #openstack-nova | 10:55 | |
*** sdague has joined #openstack-nova | 10:55 | |
*** trungnv has quit IRC | 10:56 | |
vdrok | good morning everyone! | 10:58 |
vdrok | sdague: small request, if you have some time :) https://review.openstack.org/480624 | 10:58 |
vdrok | thanks! | 11:00 |
cdent | bhagyashris: ah, right, because the compue is reporting it’s own disk too, so is considered a valid target for all the resources. /me thinks | 11:01 |
*** iceyao has joined #openstack-nova | 11:01 | |
cdent | bhagyashris: are you working from today’s master or something earlier? | 11:01 |
*** trinaths has left #openstack-nova | 11:02 | |
bhagyashris | cdent: yeah. I am working from todays master commit-id: 23c4eb34380bdf3eece11abbe0f6ccb68c060f47 "claim resources in placement API during schedule()" | 11:02 |
*** kornicameister has quit IRC | 11:03 | |
*** masber has joined #openstack-nova | 11:04 | |
*** slaweq has joined #openstack-nova | 11:05 | |
*** iceyao has quit IRC | 11:05 | |
*** slaweq has quit IRC | 11:06 | |
cdent | bhagyashris: do you have the log of it making the PUT /allocations requests? It might be that the scheduler is claimng one set of allocations, but later (in the periodic update) the resource tracker is changing things. if you’re going to be using the CUSTOM_DISK resource class you need to make sure your flavor doesn’t indicate any requests for disk_gb | 11:07 |
cdent | I think over the next few days things are likely to be quite unstable with claims, and there will be a few more changes coming | 11:07 |
*** saphi has quit IRC | 11:08 | |
bhagyashris | cdent: ohk. | 11:09 |
cdent | bhagyashris: it’s great that you’re doing this investigating, but right now is going to be a chaotic time | 11:10 |
cdent | bauzas: if this still alive? https://review.openstack.org/#/c/427200/ | 11:13 |
bauzas | cdent: looking | 11:13 |
bauzas | cdent: well, maybe we should discuss with matt | 11:13 |
bauzas | I can rebase it | 11:13 |
bauzas | meanwhile | 11:14 |
*** udesale has quit IRC | 11:14 | |
cdent | k, thanks | 11:14 |
*** cristicalin has joined #openstack-nova | 11:15 | |
bhagyashris | cdent: ohk. Just to inform you I have checked the allocations table entries and in that I saw the disk_gb reported against the compute node resource provider and not the shared resource provider. | 11:16 |
bhagyashris | cdent: Thank you for your time :) | 11:16 |
cdent | yeah, in the case where you have two different provider of DISK_GB it is likely that the non-shared provider will be picked when there are multiple options. | 11:17 |
*** iceyao has joined #openstack-nova | 11:18 | |
*** yamamoto has joined #openstack-nova | 11:19 | |
*** cristicalin has quit IRC | 11:20 | |
*** jjung has quit IRC | 11:21 | |
*** iceyao has quit IRC | 11:22 | |
bhagyashris | cdent: ohk. | 11:24 |
*** zenoway has quit IRC | 11:25 | |
*** zenoway has joined #openstack-nova | 11:25 | |
openstackgerrit | Sean Dague proposed openstack/nova master: always show urls in list_cells https://review.openstack.org/487860 | 11:25 |
*** markvoelker has quit IRC | 11:27 | |
*** yamamoto has quit IRC | 11:29 | |
*** zenoway has quit IRC | 11:29 | |
*** markus_z has quit IRC | 11:31 | |
*** zenoway has joined #openstack-nova | 11:34 | |
*** iceyao has joined #openstack-nova | 11:35 | |
gibi | cdent: yes, I have the same feeling about the host name confusion | 11:36 |
gibi | cdent: but I cannot spend more time on it today. I will continue looking into it on Monday | 11:36 |
cdent | gibi: I also left a comment on your test about another thing worth looking into | 11:36 |
cdent | if I have time today I may experiment some more, but not sure I’ll have time | 11:36 |
cdent | thanks for messing with it | 11:37 |
gibi | thanks for thelping | 11:37 |
*** jjung has joined #openstack-nova | 11:37 | |
*** prateek_ has joined #openstack-nova | 11:37 | |
gibi | if you make some progress still today then do not hesistate to update any of my reviews | 11:38 |
*** thorst has joined #openstack-nova | 11:40 | |
*** prateek has quit IRC | 11:40 | |
*** iceyao has quit IRC | 11:40 | |
*** zenoway has quit IRC | 11:43 | |
openstackgerrit | Sylvain Bauza proposed openstack/nova master: Add a status check for enabled filters https://review.openstack.org/427200 | 11:43 |
bauzas | cdent: ^ | 11:44 |
*** thorst has quit IRC | 11:44 | |
cdent | ✔ | 11:44 |
bauzas | after reviewing it, I think it's important to merge it | 11:44 |
bauzas | for Pike | 11:44 |
openstackgerrit | Chris Dent proposed openstack/nova master: Add functional test for two-cell scheduler behaviors https://review.openstack.org/452006 | 11:46 |
*** catintheroof has joined #openstack-nova | 11:48 | |
openstackgerrit | Chris Dent proposed openstack/nova master: [placement] gabbi tests for shared custom resource class https://review.openstack.org/485209 | 11:49 |
cdent | bauzas: there’s quite a lot of small things that either fix minor bugs, cover areas not previously covered, or document things. all of which would be nice for pike. update 30 will be ready in a few minutes. If you and others can get to some of the things in the “other” section that would be very useful. | 11:50 |
bauzas | cdent: sorry, I don't understand you | 11:51 |
bauzas | cdent: you want me to do what ? review ? | 11:51 |
*** yamamoto has joined #openstack-nova | 11:51 | |
cdent | bauzas: a) I’m agree with hou on the import to merge 427200 and b) saying there’s lots of similar things, which will be listed in the # Other section rp update 30 coming out soon, which will need review and ought to be merged | 11:52 |
bauzas | ah, yes, agreed on that | 11:52 |
bauzas | we need to make sure we use those two weeks correctly, ie. not for features but rather bugs and/or docs | 11:53 |
bauzas | tbc, I'll mostly do bug triage next week | 11:53 |
bauzas | and the rest of my time will be for reviewing | 11:53 |
*** acormier has joined #openstack-nova | 11:53 | |
*** lucasagomes is now known as lucas-hungry | 11:54 | |
*** rcernin has quit IRC | 11:55 | |
*** esberglu has joined #openstack-nova | 11:55 | |
*** yingjun has joined #openstack-nova | 11:57 | |
*** yingjun has quit IRC | 11:58 | |
*** zenoway has joined #openstack-nova | 11:58 | |
*** litao__ has quit IRC | 11:59 | |
*** zenoway has quit IRC | 11:59 | |
*** zenoway has joined #openstack-nova | 12:00 | |
*** esberglu has quit IRC | 12:00 | |
*** chyka has joined #openstack-nova | 12:00 | |
*** Dinesh_Bhor is now known as Dinesh_Bhor|afk | 12:01 | |
*** Dinesh_Bhor|afk is now known as Dinesh_Bhor | 12:02 | |
*** iceyao has joined #openstack-nova | 12:02 | |
sdague | cdent / bauzas / jay - just an FYI of something I closed as won't fix - https://bugs.launchpad.net/nova/+bug/1707085 - in case you have other opinions | 12:03 |
openstack | Launchpad bug 1707085 in OpenStack Compute (nova) "Max_unit should account for allocation_ratio" [Undecided,Won't fix] | 12:03 |
*** iceyao has quit IRC | 12:07 | |
*** chyka has quit IRC | 12:08 | |
cdent | sdague: your response makes sense to me, and max_unit is being set as it for the reasons you describe | 12:09 |
*** acormier has quit IRC | 12:10 | |
*** acormier has joined #openstack-nova | 12:11 | |
*** edmondsw has joined #openstack-nova | 12:13 | |
*** catintheroof has quit IRC | 12:14 | |
*** dosaboy has quit IRC | 12:14 | |
*** rcernin has joined #openstack-nova | 12:16 | |
*** thorst has joined #openstack-nova | 12:16 | |
*** ratailor has quit IRC | 12:19 | |
*** khushbu_ has joined #openstack-nova | 12:19 | |
*** VAhl_ has joined #openstack-nova | 12:19 | |
*** VAhl_ has quit IRC | 12:19 | |
*** strigazi is now known as strigazi_AFK | 12:20 | |
*** iceyao has joined #openstack-nova | 12:20 | |
*** jaypipes has joined #openstack-nova | 12:23 | |
*** jaypipes is now known as leakypipes | 12:23 | |
cdent | edleafe: left a comment on https://review.openstack.org/#/c/487954/ Just trying to make your life harder (as usual) | 12:23 |
*** markus_z has joined #openstack-nova | 12:23 | |
*** vladikr has joined #openstack-nova | 12:23 | |
*** vladikr has quit IRC | 12:24 | |
edleafe | cdent: saw it. I'm not sure that any instance on an ironic node would ever have any other custom resource class. I mean, that's the point, right? | 12:24 |
*** markvoelker has joined #openstack-nova | 12:24 | |
*** vladikr has joined #openstack-nova | 12:24 | |
cdent | edleafe: dunno | 12:24 |
cdent | it’s the internet. if it is possible to do something, people will | 12:25 |
edleafe | cdent: what I *do* know is that operators can change the CRC of a node | 12:25 |
edleafe | cdent: and like you said, if they can, they will :) | 12:25 |
*** markvoelker has quit IRC | 12:25 | |
*** jangutter has quit IRC | 12:26 | |
*** jangutter has joined #openstack-nova | 12:26 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata https://review.openstack.org/477091 | 12:26 |
openstackgerrit | Doug Hellmann proposed openstack/nova master: add a redirect for the old cells landing page https://review.openstack.org/487932 | 12:27 |
*** smatzek has joined #openstack-nova | 12:28 | |
*** markvoelker has joined #openstack-nova | 12:29 | |
*** pwiltsey has quit IRC | 12:31 | |
*** liverpooler has joined #openstack-nova | 12:31 | |
*** pchavva has joined #openstack-nova | 12:38 | |
*** sree has joined #openstack-nova | 12:40 | |
*** gbarros has joined #openstack-nova | 12:40 | |
*** cristicalin has joined #openstack-nova | 12:42 | |
*** prateek_ has quit IRC | 12:43 | |
*** sree has quit IRC | 12:44 | |
*** kfarr has joined #openstack-nova | 12:47 | |
sdague | cdent: is this still a thing? https://bugs.launchpad.net/nova/+bug/1659647 | 12:48 |
openstack | Launchpad bug 1659647 in OpenStack Compute (nova) "The resource tracker clears the tracked_instances dictionary on every periodic job" [Undecided,New] | 12:48 |
* cdent reads | 12:48 | |
*** lyan has joined #openstack-nova | 12:49 | |
*** slaweq has joined #openstack-nova | 12:49 | |
*** gbarros_ has joined #openstack-nova | 12:49 | |
*** sridharg has joined #openstack-nova | 12:49 | |
cdent | sdague: yeah, that came up in the hangout last night | 12:49 |
cdent | fixing it as described there would break “healing” but it’s now no longer clear that perfect healing is what we want | 12:49 |
cdent | it did get brought up in atlanta, but unresolved. will probably need to come up again in denver | 12:50 |
* cdent puts it on the etherpad | 12:50 | |
*** catintheroof has joined #openstack-nova | 12:50 | |
s-dean | Hi there, in the nova_cell0 database is the instanaces tables supposed to be populated? | 12:50 |
efried | s-dean As I understand it, that table only houses instances that failed to be scheduled. | 12:51 |
*** gbarros has quit IRC | 12:51 | |
efried | s-dean I learned that from https://review.openstack.org/#/c/487183/ | 12:51 |
s-dean | ok thanks, im trying to track down why i can list my instances with openstack server list | 12:52 |
sdague | cdent: ok, so I'm going to close it as Opinion Wishlist then, as it's one of those notes to self that's getting tracked in other ways (like via the etherpad) | 12:52 |
cdent | sdague: seems fair | 12:52 |
*** cristicalin has quit IRC | 12:53 | |
*** gbarros_ has quit IRC | 12:53 | |
efried | s-dean There's a whole thing I don't understand about deleted instances not really being deleted, some kind of "soft" delete. | 12:53 |
s-dean | No i haven't deleted the instances yet, the command is hanging and not returning anything however the API server is returning 200 OK | 12:54 |
*** annegentle has joined #openstack-nova | 12:55 | |
*** esberglu has joined #openstack-nova | 12:55 | |
*** esberglu has quit IRC | 12:55 | |
efried | s-dean does `nova list` work? | 12:56 |
*** esberglu has joined #openstack-nova | 12:56 | |
*** dosaboy has joined #openstack-nova | 12:57 | |
s-dean | also in the instances table(nova DB), the cell_name filed is NULL | 12:57 |
s-dean | nope | 12:57 |
*** alexchadin has quit IRC | 12:57 | |
s-dean | that is also hanging, its like it cant access the database; | 12:57 |
*** gbarros has joined #openstack-nova | 12:58 | |
*** acormier_ has joined #openstack-nova | 12:59 | |
*** annegentle has quit IRC | 12:59 | |
*** artom has quit IRC | 12:59 | |
*** artom has joined #openstack-nova | 12:59 | |
*** artom has quit IRC | 13:00 | |
s-dean | also there is no response | 13:00 |
*** esberglu has quit IRC | 13:01 | |
*** acormier has quit IRC | 13:02 | |
*** lucas-hungry is now known as lucasagomes | 13:03 | |
*** jaosorior has quit IRC | 13:04 | |
*** lbragstad has joined #openstack-nova | 13:04 | |
*** yamamoto has quit IRC | 13:05 | |
*** xyang1 has joined #openstack-nova | 13:06 | |
bauzas | sdague: looking up bugs ? I'm about to do that too | 13:07 |
sdague | bauzas: yeh, I've been trying to burn the New list down | 13:08 |
sdague | getting close | 13:08 |
bauzas | k | 13:08 |
bauzas | I'll also look at the in-progress bugs | 13:09 |
bauzas | to make sure we won't miss any important one | 13:09 |
*** sree has joined #openstack-nova | 13:13 | |
*** acormier_ has quit IRC | 13:13 | |
*** acormier has joined #openstack-nova | 13:14 | |
*** eharney has joined #openstack-nova | 13:14 | |
*** esberglu has joined #openstack-nova | 13:16 | |
*** links has quit IRC | 13:16 | |
*** prateek has joined #openstack-nova | 13:16 | |
*** khushbu_ has quit IRC | 13:17 | |
*** acormier has quit IRC | 13:18 | |
*** jangutter has quit IRC | 13:22 | |
*** jangutter has joined #openstack-nova | 13:23 | |
*** mriedem has joined #openstack-nova | 13:28 | |
*** tbachman has quit IRC | 13:28 | |
mriedem | pike-3 tag is in https://review.openstack.org/#/c/488218/ | 13:29 |
*** yamamoto has joined #openstack-nova | 13:29 | |
*** rajathagasthya has joined #openstack-nova | 13:33 | |
*** baoli has joined #openstack-nova | 13:34 | |
*** baoli has quit IRC | 13:34 | |
*** tbachman has joined #openstack-nova | 13:35 | |
*** psachin has quit IRC | 13:35 | |
*** baoli has joined #openstack-nova | 13:35 | |
*** acormier has joined #openstack-nova | 13:35 | |
*** tbachman has quit IRC | 13:35 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Sanity check delete_allocation_for_instance https://review.openstack.org/488187 | 13:35 |
*** SteveRUKC has quit IRC | 13:36 | |
cdent | mriedem: can you summarize what you leared while doing that ^? | 13:36 |
*** iceyao has quit IRC | 13:37 | |
*** iceyao has joined #openstack-nova | 13:37 | |
mriedem | cdent: well it does two things | 13:37 |
*** prateek has quit IRC | 13:37 | |
mriedem | 1. when the RT (source node during a migration) untracks it's instances and attempts to delete allocations, we get the current allocations for the instance for all providers and if the source node rp uuid isn't in the current list of allocations, it noops | 13:38 |
*** rcernin has quit IRC | 13:38 | |
mriedem | 2. if the source node rp uuid is in the list of current allocations but there is also at least one other VCPU resource provider, it logs a message before deleting the allocations | 13:38 |
mriedem | i have seen #2 in the live migration CI runs, | 13:38 |
mriedem | i haven't seen #1 | 13:38 |
mriedem | http://logs.openstack.org/87/488187/2/check/gate-tempest-dsvm-multinode-live-migration-ubuntu-xenial/107a810/logs/subnode-2/screen-n-cpu.txt.gz#_Jul_27_22_21_14_766229 | 13:39 |
dansmith | yeah so #2 will get reported as a bug and tell us that we need to skip instead of log and continue there | 13:39 |
mriedem | i really just pushed this to see if things were really bad, like if we hit #1 a lot | 13:39 |
*** acormier has quit IRC | 13:40 | |
dansmith | mriedem: you could try setting the heal interval really small so it runs more often during the few migrations we actually do | 13:40 |
cdent | do you feel better or worse? | 13:40 |
mriedem | i feel better | 13:41 |
mriedem | #1 would be a scarier race imo | 13:41 |
mriedem | and could still happen, but chances are slim - at least in our CI env which isn't that load intensive | 13:41 |
mriedem | #1 happens after the source node RT pulls the allocations for it's own uuid, | 13:41 |
mriedem | so to hit #1, that means the allocations are gone for that node between the time it pulls them and the time it processes it's list of untracked instances | 13:42 |
mriedem | i think #2 is fixed by making the RT check the vm_state of the instance before trying to delete it's allocations | 13:42 |
mriedem | which is something jay was working on yesterday | 13:42 |
leakypipes | for the record, guys, I should be done with my patch shortly. | 13:42 |
bauzas | mriedem: yup, saw the pike-3 change this morning | 13:43 |
leakypipes | just working on unit tests now | 13:43 |
bauzas | it was already merged | 13:43 |
dansmith | mriedem: insert some artificial rpc delay into the periodic and see if #1 happens | 13:43 |
mriedem | i can do that | 13:43 |
mriedem | cdent: bauzas: also https://bugs.launchpad.net/nova/+bug/1707071 if you haven't seen that yet | 13:44 |
openstack | Launchpad bug 1707071 in OpenStack Compute (nova) ocata "Compute nodes will fight over allocations during migration" [Medium,Confirmed] | 13:44 |
bauzas | not yet indeed | 13:44 |
bauzas | mriedem: dansmith: leakypipes: I thought about something this night | 13:44 |
bauzas | cdent: ^ | 13:45 |
leakypipes | dansmith: you need to change your clothes. | 13:45 |
*** jistr is now known as jistr|mtg | 13:45 | |
bauzas | what if we should just get the current allocations before deleting them by the scheduler, so in case we know we have a problem, we could put them again ? | 13:45 |
dansmith | heh | 13:45 |
*** dansmith is now known as superdan | 13:45 | |
bauzas | oh snap, FF | 13:45 |
*** bauzas is now known as bauwser | 13:45 | |
cdent | thanks mriedem | 13:46 |
superdan | bauwser: get + check is just as safe as get + delete + re-put, except you never have to delete | 13:46 |
superdan | not sure why we would do the latter | 13:46 |
*** artom has joined #openstack-nova | 13:46 | |
*** jjung has quit IRC | 13:47 | |
bauwser | mriedem: superdan: leakypipes: oh, and me and cdent just discussed about https://review.openstack.org/#/c/427200/ : it could be important for operators | 13:47 |
*** andreas_s has quit IRC | 13:47 | |
*** cfriesen_ has joined #openstack-nova | 13:47 | |
bauwser | superdan: sure, was just wondering if it was simplier than just trying to get two allocations for both source and target when moving | 13:47 |
bauwser | I know it's the consensus | 13:48 |
superdan | I don't see how it helps | 13:48 |
mriedem | bauwser: yes there is an odd scenario in there which i commented on | 13:48 |
bauwser | and I totally agree with it | 13:48 |
superdan | without two allocations we're not accounting for the resources used by a moving instance | 13:48 |
bauwser | but I do wonder if we could simplify the problem | 13:48 |
bauwser | at least for the races we know of | 13:48 |
superdan | well, the double allocation. there's still only one allocation for the instance | 13:48 |
bauwser | the problem here is that we have 3 different services looking at placement when moving : #1 scheduler, #2 source compute, #3 target compute | 13:49 |
superdan | that's kindof the point of placement right? | 13:49 |
bauwser | yeah, I know, but that means we have like shared information | 13:49 |
mriedem | that's the point | 13:49 |
bauwser | but I think we discussed that yesterday | 13:49 |
mriedem | the global view | 13:49 |
superdan | yeah, that's the whole thing | 13:50 |
bauwser | anyway, I don't want to nitpick | 13:50 |
mriedem | but yes that means old code that assumes it's all local and owns everything at any given time has to change | 13:50 |
superdan | it's not the shared state/view/responsibility that concerns me, it's that the current RT was designed for a different model | 13:50 |
bauwser | I'm just trying to see how to help with the problems we know about multiple services taking the same allocations | 13:50 |
leakypipes | hopefully my new patch's code comments explain the situation well enough. | 13:51 |
bauwser | ideally, eventually, I'm not sure we need resouretrackers for computes | 13:51 |
bauwser | if allocations would only be done by schedulers | 13:52 |
superdan | bauwser: we don't in the long run | 13:52 |
superdan | we still need some of that code on the computes, | 13:52 |
superdan | but not the full RT | 13:52 |
bauwser | I'd see RTs just *deleting* allocations if something goes mad | 13:52 |
superdan | that's what I was saying yesterday | 13:52 |
bauwser | superdan: yeah, I know | 13:52 |
bauwser | I'm just thinking out loud to try to identify how we could simplify | 13:52 |
superdan | so.... :) | 13:52 |
superdan | okay :) | 13:52 |
bauwser | but I agree with you, using the existing RT means tech deby | 13:53 |
*** ratailor has joined #openstack-nova | 13:53 | |
superdan | Tech Deby.. that's like the host of a kids show about computers? | 13:53 |
bauwser | :) | 13:54 |
*** gouthamr has joined #openstack-nova | 13:54 | |
*** weshay is now known as weshay_interview | 13:54 | |
bauwser | my keyboard is AZERYT :p | 13:54 |
*** prateek has joined #openstack-nova | 13:55 | |
superdan | T and Y are together on both | 13:55 |
superdan | I thought it was AZERTY? | 13:55 |
* bauwser is just using mittens when typing /o\ | 13:56 | |
bauwser | rather, yting | 13:56 |
*** kfarr_ has joined #openstack-nova | 13:57 | |
*** kfarr_ has quit IRC | 13:57 | |
*** strigazi_AFK is now known as strigazi_OFF | 13:58 | |
cdent | can someone merge this https://review.openstack.org/#/c/488363/ looking at that warning is getting tiresome | 13:59 |
*** rcernin has joined #openstack-nova | 14:01 | |
*** tbachman has joined #openstack-nova | 14:04 | |
*** hshiina has quit IRC | 14:04 | |
kashyap | superdan: Thanks for the review on this: https://review.openstack.org/#/c/485752/ | 14:05 |
kashyap | superdan: And thanks for the little snark, too :P | 14:05 |
superdan | heh | 14:06 |
kashyap | Can anyone +W it? I can also backport it to the revlevant upstream branches | 14:06 |
*** prateek has quit IRC | 14:08 | |
superdan | kashyap: sdague loves +Wing patches like that | 14:09 |
kashyap | :-) I thought of pinging him explicitly, but refrained in the spirit of being a good citizen as I shouldn't specifically nag people | 14:10 |
kashyap | And just ask the generic "ether", that is the channel :-) | 14:10 |
superdan | kashyap: sdague owes us all a beer after yesterday, so I think today it's uniquely okay to ask him directly :P | 14:10 |
*** crushil has joined #openstack-nova | 14:10 | |
*** rmart04 has quit IRC | 14:10 | |
kashyap | sdague: If you are listening in, it's a straight-forward perf issue fixed by calling a simple "please set cache mode" method. And the reporter has even confirmed the fix works -- https://review.openstack.org/#/c/485752/ | 14:11 |
superdan | cdent: fix mriedem's comment and I'll fast approve | 14:11 |
kashyap | superdan: What happened yesterday that bestows this windfall on the rest? | 14:11 |
superdan | kashyap: oh nothing.. just a good-faith-gone-awry sort of deal | 14:11 |
kashyap | :D | 14:11 |
*** yamamoto has quit IRC | 14:12 | |
*** dfisher has joined #openstack-nova | 14:12 | |
*** dfisher has left #openstack-nova | 14:12 | |
*** yamamoto has joined #openstack-nova | 14:12 | |
*** vishwana_ has quit IRC | 14:13 | |
*** vishwanathj has joined #openstack-nova | 14:13 | |
openstackgerrit | Chris Dent proposed openstack/nova master: [placement] quash unicode warning with shared provider https://review.openstack.org/488363 | 14:13 |
cdent | superdan: done ^. tvm | 14:14 |
superdan | cdent: doneski | 14:14 |
cdent | rawkin or something | 14:14 |
*** liverpooler has quit IRC | 14:15 | |
*** liverpooler has joined #openstack-nova | 14:15 | |
*** iceyao has quit IRC | 14:16 | |
*** slaweq has quit IRC | 14:17 | |
bauwser | mriedem: cdent: FYI https://review.openstack.org/#/c/488363/1/nova/objects/resource_provider.py@741 | 14:17 |
*** iceyao has joined #openstack-nova | 14:17 | |
bauwser | I'm not a SQLA expert, but I know that you need all your strings to be unicode (and UTF-8) if you want to use SQLA | 14:17 |
cdent | bauwser: I think the relevant point here is that os_traits is _not_ which might be a surprise to some (it was to me) | 14:18 |
bauwser | cdent: ostraits is a python lib | 14:18 |
bauwser | cdent: so it really just gives us what python gives us | 14:18 |
*** gyee has joined #openstack-nova | 14:19 | |
bauwser | there is no contract about what it returns | 14:19 |
cdent | yes, I know that, but no, it has a choice of how it constructs the values | 14:19 |
*** AlexeyAbashkin has joined #openstack-nova | 14:19 | |
bauwser | and a shit ton of 3rd-party libs behave the same | 14:19 |
cdent | it could have don them as unicdoe | 14:19 |
bauwser | the point is just, SQLA by default expects unicode, so in general you explicitely convert | 14:19 |
bauwser | cdent: that reminds me | 14:20 |
cdent | yes, and? | 14:20 |
bauwser | cdent: I'm not sure that if we create a trait like CUSTOM_mé | 14:20 |
bauwser | it will correctly work | 14:20 |
bauwser | because we won't define the charset | 14:20 |
*** sbezverk has quit IRC | 14:22 | |
*** mtanino has joined #openstack-nova | 14:22 | |
cdent | "pattern": "^CUSTOM\_[A-Z0-9_]+$", | 14:22 |
*** larainema has joined #openstack-nova | 14:22 | |
cdent | so it is moot on that front | 14:22 |
cdent | none of this changes that matt’s right that a comment is helpful | 14:22 |
cdent | it’s been done, it’s merged. | 14:22 |
bauwser | cdent: oh correct, we only accept ASCII | 14:25 |
bauwser | even less | 14:25 |
bauwser | so that's not a big deal | 14:25 |
*** armax has joined #openstack-nova | 14:26 | |
*** acormier has joined #openstack-nova | 14:26 | |
kashyap | mriedem: Thanks for the merge! | 14:31 |
kashyap | (For this https://review.openstack.org/#/c/485752/) | 14:31 |
*** baoli has quit IRC | 14:33 | |
*** marst has joined #openstack-nova | 14:34 | |
*** pwiltsey has joined #openstack-nova | 14:36 | |
*** efried is now known as fried_rice | 14:36 | |
fried_rice | sdague You got a minute? | 14:37 |
*** edleafe is now known as figleaf | 14:37 | |
*** hongbin has joined #openstack-nova | 14:38 | |
openstackgerrit | Alex Szarka proposed openstack/nova master: fix test_rebuild_server_exc instability https://review.openstack.org/487382 | 14:39 |
*** ratailor has quit IRC | 14:41 | |
kashyap | People, are simple performance fixes acceptable for "Phase-2" support (Newton)? | 14:42 |
*** crushil has quit IRC | 14:42 | |
*** crushil has joined #openstack-nova | 14:43 | |
lyarwood | kashyap: your cache change is just a bugfix IMHO, not a perf fix, it just happens to help with the latter. | 14:43 |
mriedem | omg we have a wild lyarwood sighting | 14:43 |
* superdan throws a net over him | 14:43 | |
* lyarwood goes back into hiding | 14:43 | |
kashyap | LOL | 14:43 |
kashyap | lyarwood: Noted. Just in case you're wondering: if I'm masquereding something to "smuggle" a fix in, no, I wasn't :-) | 14:44 |
superdan | just yesterday I warned another manager that we were taking lyarwood back by force, if necessary, at the end of his side contract | 14:44 |
*** iceyao has quit IRC | 14:45 | |
*** jistr|mtg is now known as jistr | 14:46 | |
lyarwood | superdan: not helped by my `yeah sure I can help with that` follow up ;) | 14:46 |
*** Dinesh_Bhor has quit IRC | 14:46 | |
kashyap | lyarwood: When you craw out of your cave, your comment isn't clear - does that mean, as a stable maint, do you find it acceptable to backport to Newton, or not? | 14:46 |
*** masber has quit IRC | 14:46 | |
superdan | lyarwood: yeah :/ | 14:46 |
mriedem | lyarwood: you're the new tonyb | 14:46 |
mriedem | kashyap: bug fixes to newton are ok | 14:46 |
kashyap | mriedem: Okido, thanks | 14:46 |
lyarwood | mriedem: what did you do to the old tonyb? | 14:47 |
* kashyap will be on PTO from 01-Aug, just not want to leave at least "finishable" things hanging in the air | 14:47 | |
mriedem | lyarwood: tonyb signs up to help with everything | 14:47 |
sdague | fried_rice: I'm about to lose power here as they move our power to another pole | 14:48 |
sdague | so... poke me later | 14:48 |
fried_rice | sdague Sweet. I think I may have figured it out. Thanks. | 14:48 |
*** annegentle has joined #openstack-nova | 14:48 | |
*** sbezverk has joined #openstack-nova | 14:50 | |
*** harlowja has joined #openstack-nova | 14:51 | |
*** sdague has quit IRC | 14:53 | |
*** trinaths has joined #openstack-nova | 14:53 | |
mriedem | superdan: looking over my old todo list, i had a note about online data migrations for multiple cells, | 14:55 |
*** aarefiev is now known as aarefiev_afk | 14:55 | |
mriedem | e.g. object code looks in the api db first and if not found, looks in the 'cell' db for looking things up | 14:55 |
mriedem | but with multiple cells, you wouldn't know which cell db to lookup from | 14:55 |
mriedem | so that probably goes in our list of things you have to do before you can do multi cell | 14:56 |
superdan | depends on the migration I guess | 14:56 |
superdan | mriedem: but you could use multiple configs to handle that today | 14:56 |
superdan | mriedem: i.e. use the config for one of the cell conductors you have if it doesn't hit the api db, and if it does, just add creds for the api db and the one cell you're looking at | 14:57 |
*** ijw has joined #openstack-nova | 14:57 | |
superdan | but yeah I'd have to think about the best way to test those things | 14:57 |
*** Drankis has joined #openstack-nova | 14:58 | |
*** kbaegis has joined #openstack-nova | 14:59 | |
mriedem | ok i was just thinking about like migrating quotas, we look in api, then look in cell, but really if we did it like the api code, we'd iterate the cells to find the quota limit - although something like quota limits in multiple cells would be wonky - it could be default in a new cell but custom in an old cell | 14:59 |
mriedem | probably just best to say, make sure your online data migrations are done before attempting adding a new cell | 15:00 |
superdan | yeah | 15:00 |
mriedem | i should also get this cleaned up https://review.openstack.org/#/c/460377/ | 15:00 |
*** danpawlik has quit IRC | 15:01 | |
superdan | ugh yeah | 15:02 |
openstackgerrit | Ed Leafe proposed openstack/nova master: Handle hash ring rebalancing in ironic flavor migration https://review.openstack.org/487954 | 15:03 |
*** edmondsw has quit IRC | 15:06 | |
*** crushil has quit IRC | 15:07 | |
*** claudiub has quit IRC | 15:09 | |
*** zenoway has quit IRC | 15:09 | |
*** baoli has joined #openstack-nova | 15:11 | |
*** gszasz has quit IRC | 15:12 | |
mriedem | bauwser: going to update the reno in https://review.openstack.org/#/c/484828/ per cdent's comment? | 15:12 |
*** rcernin has quit IRC | 15:13 | |
bauwser | mriedem: sure, can do | 15:13 |
bauwser | mriedem: I'm just going to end up my work week prematurely because of corporate network requirements that require major upgrades for me | 15:14 |
*** zenoway has joined #openstack-nova | 15:14 | |
mriedem | bauwser: you know how when i asked if you were talking to your dog when in boston and i said the dog said 'le woof' and you looked like that doesn't make sense/ | 15:15 |
mriedem | ? | 15:15 |
*** weshay_interview is now known as weshay | 15:15 | |
mriedem | i said the same thing to my wife, who knows a little french, and she did the same, and said, "that doesn't make sense, it would be la woof" | 15:15 |
mriedem | i can't win | 15:16 |
bauwser | mriedem: heh | 15:16 |
bauwser | mriedem: I was litterally about to show my dog yesterday on the hangout as it was bugging me | 15:16 |
*** crushil has joined #openstack-nova | 15:16 | |
bauwser | anyway, my internal network connection is about to blow out in a few, so \o | 15:17 |
* cdent is intrigued by bauwser’s network | 15:19 | |
*** penick has joined #openstack-nova | 15:19 | |
*** edmondsw has joined #openstack-nova | 15:19 | |
bauwser | cdent: one tuple (openvpn 2.4, fedora 23) | 15:20 |
*** awaugama has joined #openstack-nova | 15:20 | |
*** imacdonn has quit IRC | 15:22 | |
*** imacdonn has joined #openstack-nova | 15:22 | |
*** links has joined #openstack-nova | 15:23 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: DNM: simulate rpc delay when cleaning up allocations from source node https://review.openstack.org/488500 | 15:27 |
mriedem | superdan: ^ like this? | 15:30 |
superdan | mriedem: yeah exactly | 15:30 |
*** damien_r has joined #openstack-nova | 15:31 | |
*** damien_r has quit IRC | 15:32 | |
mriedem | leakypipes: i'm going to close out the placement-claims bp | 15:32 |
mriedem | the main bits are done for pike, rest can be something else in queens | 15:32 |
leakypipes | k | 15:32 |
leakypipes | superdan: what was that bug number again? I remember it was a palindrome but my scrollback is too little to grab it.. | 15:37 |
leakypipes | 1707071? | 15:37 |
superdan | yep | 15:37 |
leakypipes | got it, thanks | 15:38 |
*** tbachman has quit IRC | 15:39 | |
*** penick has quit IRC | 15:40 | |
*** itlinux has joined #openstack-nova | 15:40 | |
*** chyka has joined #openstack-nova | 15:40 | |
*** Drankis has quit IRC | 15:43 | |
*** trinaths has left #openstack-nova | 15:45 | |
*** trinaths has joined #openstack-nova | 15:45 | |
*** itlinux has quit IRC | 15:48 | |
*** VAhl has quit IRC | 15:49 | |
*** mtanin___ has joined #openstack-nova | 15:50 | |
*** jjung has joined #openstack-nova | 15:50 | |
*** marst_ has joined #openstack-nova | 15:50 | |
*** marst has quit IRC | 15:50 | |
*** harlowja has quit IRC | 15:51 | |
*** mtanino has quit IRC | 15:51 | |
*** jmlowe has quit IRC | 15:51 | |
*** chyka_ has joined #openstack-nova | 15:52 | |
*** chyka has quit IRC | 15:55 | |
s-dean | Hi could somebody tell me what, this command queries | 15:56 |
s-dean | curl -g -i --cacert "/etc/keystone/tls/ca-cert.pem" -X GET https://10.30.0.2:8774/v2.1/servers/detail -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}3ac08c79ab47c87d8050040c8a18d0774c326933" | 15:56 |
s-dean | obviously the nova-api | 15:57 |
mriedem | list servers for that tenant with details | 15:57 |
s-dean | but what does the servers detail part look at | 15:57 |
mriedem | https://developer.openstack.org/api-ref/compute/#list-servers-detailed | 15:57 |
s-dean | because its not returning anything | 15:57 |
*** markus_z has quit IRC | 15:57 | |
s-dean | i never get a response back | 15:57 |
mriedem | it hangs? | 15:58 |
s-dean | yeah | 15:58 |
mriedem | or you get an empty body? | 15:58 |
s-dean | no response | 15:58 |
mriedem | the response should timeout either way | 15:58 |
s-dean | mhh | 15:58 |
mriedem | there should be a request id you can trace through the nova-api logs | 15:58 |
mriedem | look for the GET /servers/detail request in the nova-api debug logs | 15:59 |
mriedem | there is a req-<uuid> thing | 15:59 |
*** Apoorva has joined #openstack-nova | 15:59 | |
s-dean | nova.osapi_compute.wsgi.server [req-b884b02e-e9c0-4845-9dd8-1f4cd1a6215a 2456405c5d3547e5aeece36828578f99 be5ea0b1031d4949ab94107522f305b4 - default default] 10.30.0.2 "GET /v2.1/servers/detail HTTP/1.1" status: 500 len: 566 time: 600.7115021 | 15:59 |
mriedem | you can follow that through the logs | 15:59 |
mriedem | req-b884b02e-e9c0-4845-9dd8-1f4cd1a6215a | 15:59 |
*** yamamoto has quit IRC | 15:59 | |
mriedem | yeah | 15:59 |
mriedem | so something exploded | 15:59 |
mriedem | 500 error | 15:59 |
*** yamamoto has joined #openstack-nova | 15:59 | |
mriedem | look for errors | 15:59 |
*** yamamoto has quit IRC | 15:59 | |
*** kfarr has quit IRC | 15:59 | |
s-dean | DBError: Can't reconnect until invalid transaction is rolled back | 15:59 |
mriedem | huh, don't know what that is | 16:00 |
s-dean | its asking me to report a bug | 16:00 |
mriedem | s-dean: are you hand-rolling all this stuff or using some deployment tooling? | 16:00 |
s-dean | hand-rolling baby | 16:00 |
s-dean | haha | 16:00 |
mriedem | misconfiguration of the db wouldn't be a nova bug | 16:00 |
s-dean | probably a config error again | 16:00 |
mriedem | may i suggest using a deployment tool | 16:00 |
*** ralonsoh has quit IRC | 16:01 | |
s-dean | yeah but which oone | 16:01 |
mriedem | like openstack-ansible or kolla | 16:01 |
mriedem | ^ are the ones i'd look at | 16:01 |
s-dean | i was looking into kolla | 16:01 |
*** saphi has joined #openstack-nova | 16:01 | |
s-dean | deploys it onto docker right | 16:01 |
*** thorst_ has joined #openstack-nova | 16:02 | |
mriedem | yeah | 16:02 |
mriedem | openstack-ansible deploys into lxc containers | 16:02 |
leakypipes | builds openstack as docker images is what you mean, but yeah. | 16:02 |
s-dean | ive just spent so much time learning how to deploy to bare metal | 16:03 |
s-dean | 3 node setup | 16:03 |
s-dean | i dont even now how all that stuff ties into my backend network | 16:03 |
s-dean | i wanted to deploy a self service network with overlay network provider and management hence why ive been doing it by hand | 16:04 |
s-dean | been one heck of a learning experience i'm glad its the weekend though hahaha | 16:05 |
*** thorst has quit IRC | 16:05 | |
*** lucasagomes is now known as lucas-afk | 16:06 | |
*** sree has quit IRC | 16:09 | |
*** sree has joined #openstack-nova | 16:09 | |
openstackgerrit | Jay Pipes proposed openstack/nova master: remove source provider allocs in confirm_resize() https://review.openstack.org/488510 | 16:10 |
*** zenoway has quit IRC | 16:11 | |
leakypipes | mriedem, superdan, bauwser, cdent, figleaf: ^^ | 16:11 |
* leakypipes wishes we had functional tests for migration... | 16:12 | |
leakypipes | that didn't mock everything out.. | 16:12 |
mriedem | leakypipes: we do-ish | 16:12 |
*** sdague has joined #openstack-nova | 16:12 | |
leakypipes | mriedem: see my qualifying statement above :) | 16:12 |
*** jmlowe has joined #openstack-nova | 16:12 | |
mriedem | like what? | 16:12 |
mriedem | we mock out cinder/glance/neutron yeah | 16:13 |
mriedem | but we don't really need those for testing this | 16:13 |
mriedem | e.g https://review.openstack.org/#/c/487958/ | 16:13 |
*** sree has quit IRC | 16:14 | |
*** david-lyle has quit IRC | 16:14 | |
openstackgerrit | Merged openstack/nova master: libvirt: Post-migration, set cache value for Cinder volume(s) https://review.openstack.org/485752 | 16:15 |
leakypipes | mriedem: yeah, that's a good start. thanks for the link. | 16:15 |
leakypipes | mriedem: still no way to test the kinds of timing issues that superdan was bringing up on the call yesterday though... emulating a long MQ interaction on the destination for instance and ensuring that the source host does the right thing... | 16:16 |
leakypipes | anyway, I'm just bitching. it's Friday, deal with it :P | 16:16 |
mriedem | leakypipes: you're about as sassy as that gd sax | 16:16 |
*** david-lyle has joined #openstack-nova | 16:16 | |
melwitt | *sniff* my precious blueprint | 16:17 |
mriedem | sorry | 16:17 |
melwitt | s'okay :) | 16:18 |
mriedem | tell your bp to have a kick grass summer and you'll see it in the fall | 16:18 |
mriedem | in it's yearbook of course | 16:18 |
melwitt | haha | 16:19 |
mriedem | ps bobby flynn is soooo cute! | 16:19 |
melwitt | "Stay cool!" | 16:19 |
*** esberglu is now known as esberglu_lunch | 16:21 | |
*** armax has quit IRC | 16:21 | |
*** david-lyle has quit IRC | 16:22 | |
*** gbarros has quit IRC | 16:23 | |
*** ijw has quit IRC | 16:23 | |
*** ijw has joined #openstack-nova | 16:24 | |
*** lyan has quit IRC | 16:25 | |
leakypipes | mriedem: grr, shitbuckets. | 16:27 |
leakypipes | mriedem: we forgot about resize to same host. :( | 16:27 |
mriedem | literally? | 16:27 |
*** armax has joined #openstack-nova | 16:28 | |
leakypipes | mriedem: so when doing a resize same host, we'll end up deleting the entire allocation except for the shared providers in the patch I just put up. | 16:28 |
*** saphi_ has joined #openstack-nova | 16:28 | |
cdent | yeehaw | 16:28 |
mriedem | just check instance.host == CONF.host? | 16:28 |
*** saphi_ has quit IRC | 16:28 | |
leakypipes | mriedem: yeah. though... in the thing we added for scheduler claiming a double-up allocation, did we account for resize to same host? :( | 16:29 |
*** gbarros has joined #openstack-nova | 16:29 | |
mriedem | yes | 16:29 |
mriedem | it comares the rp uuid right? | 16:29 |
mriedem | does a set difference | 16:29 |
mriedem | pretty sure i thought about that when reviewing and came to the conclusion it's handled by the set difference on rp uuid | 16:30 |
cdent | yeah, but isn’t the point that you still need a doubling and since the rp uuid is the same, you need to double within the allocation, not adjacent to | 16:30 |
mriedem | no | 16:30 |
leakypipes | mriedem: yeah, but the issue is that we need to create an allocation for the *same provider* but the resource amounts are added together (old and new amount) | 16:30 |
mriedem | the double is for the source and target | 16:30 |
superdan | yes | 16:30 |
mriedem | so you don't lose the source when putting allocations for the target | 16:30 |
superdan | but if resize to same host, you still have two copies | 16:30 |
superdan | so you need twice the allocation | 16:30 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements https://review.openstack.org/488034 | 16:31 |
mriedem | i guess you do need to account for the resize up flavor resource class stuff | 16:31 |
leakypipes | superdan: well, not twice the allocation, but the new amount of resources added to the old amount of resources, but on the same resource provider. :( | 16:31 |
*** larainema has quit IRC | 16:31 | |
leakypipes | I hate my life. | 16:31 |
superdan | leakypipes: yes, I mean the sum of the allocations of course :) | 16:31 |
mriedem | so is it just that we aren't doing the correct 'new' flavor allocation when resize to same host? | 16:31 |
superdan | leakypipes: I've been using "doubled up" to mean "the sum" | 16:31 |
mriedem | is it sum? | 16:31 |
mriedem | for resize to same host i mean | 16:32 |
leakypipes | superdan: understood. | 16:32 |
superdan | it's definitely sum for disk, but I don't think we should distinguish, we should just sum everything | 16:32 |
mriedem | ok | 16:32 |
leakypipes | mriedem: yeah, it's sum | 16:32 |
mriedem | so let's open a bug? | 16:32 |
mriedem | tag it with pike-rc-potential | 16:32 |
superdan | if you're resizing to a new flavor with more disk, but fewer cpu/mem, you have to protect the older larger amount of resource | 16:32 |
mriedem | superdan: good point | 16:32 |
cdent | leakypipes: on the resourcce tracker side, when the resize confirm wants to delete everything on itself, would it be safe/okay to let that happen, and then immediately call into the _update routines so it would then write a new allocation for the correct size? | 16:33 |
leakypipes | ffs, we're just going to end up porting all the craziness and conditionals from the resource_tracker.py module into the scheduler report client for this stuff :( | 16:33 |
leakypipes | cdent: might be, yes... need to think through it. | 16:34 |
mriedem | cdent: _update only updates inventory | 16:35 |
mriedem | if you're talking about ResourceTracker._update | 16:35 |
mriedem | maybe we should rename that :) | 16:35 |
cdent | I don’t mean _update specifically say _update_* perhaps | 16:35 |
mriedem | heh | 16:35 |
cdent | wherever the regular allocations happens | 16:35 |
*** d9k has quit IRC | 16:35 | |
mriedem | _update_something_for_instance_maybe | 16:35 |
cdent | anyway, there’s another wrinkle near this that I wanted to ask about: are those regular allocation update shared providers aware yet? | 16:36 |
mriedem | don't think so | 16:36 |
figleaf | cdent: no, but they won't delete the shared provider allocation, right? | 16:36 |
mriedem | https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L919 | 16:36 |
mriedem | https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L1024 | 16:37 |
*** liuyulong has joined #openstack-nova | 16:37 | |
cdent | figleaf: if we write any allocation at all, it will replace. so it depends on what we’re creating, to write | 16:38 |
figleaf | leakypipes: sorry, but the nuns beat that stuff into me | 16:38 |
leakypipes | mriedem: right, and the idea was to not have to call put_allocations() once the placement-claims stuff was done. | 16:38 |
cdent | I’m thinking in terms of these vaunted “heals” we love. Is a heal going to be correct in the face of a shared provider | 16:38 |
figleaf | cdent: OIC what you're getting at | 16:38 |
figleaf | cdent: yeah, that would only work if allocations were consumer/rp specific | 16:39 |
mriedem | leakypipes: yeah, and my original understanding from 4+ months ago was we'd put code into the computes that wouldn't do anything with allocations if they were already created by the scheduler, and we'd not do claims in the scheduler until all computes had that code | 16:39 |
mriedem | but then that went away | 16:39 |
* figleaf gets this feeling that we will end up persisting the allocation_request with the instance | 16:40 | |
superdan | mriedem: that code _is_ in the computes though | 16:41 |
superdan | well, part of it | 16:41 |
mriedem | superdan: the diff thing in the report client you mean right? | 16:41 |
mriedem | my_allocations vs current_allocations | 16:41 |
mriedem | ? | 16:41 |
superdan | yes, but the thing is, | 16:41 |
mriedem | my_allocations doesn't account for shared storage | 16:41 |
mriedem | right? | 16:41 |
superdan | we still have to have the healing from the compute node side regardless | 16:41 |
*** openstackstatus has quit IRC | 16:41 | |
*** openstack has joined #openstack-nova | 16:44 | |
*** links has quit IRC | 16:44 | |
leakypipes | mriedem: if you create a bug, I'll get to work on a fix. | 16:44 |
*** sridharg has quit IRC | 16:44 | |
mriedem | which bug are we talking about? the fact we don't sum allocations when resize to same host in scheduler? | 16:45 |
mriedem | sounds like multiple bugs | 16:45 |
mriedem | because of the self-heal issue, or is that the one from yesterday? | 16:45 |
leakypipes | mriedem: no, sorry, I was referring to addressing the TODOs left by cdent around the shared providers (the links you pasted above to the report.py module) | 16:46 |
cfriesen_ | leakypipes: you could always just stop supporting resize-to-same-host and let all the users scream. /s | 16:46 |
leakypipes | cfriesen_: cool with me. | 16:46 |
*** d9k has joined #openstack-nova | 16:46 | |
melwitt | yeah really. especially since they complain that it doesn't mean "force resize to same host" | 16:47 |
mriedem | leakypipes: ok, but we also have a bug for the resize to same host wrt the scheduler double fudge goodness right? | 16:47 |
mriedem | let's call it double fudge now | 16:47 |
leakypipes | mriedem: yeah :) | 16:47 |
leakypipes | two different bugs | 16:47 |
mriedem | ok | 16:47 |
mriedem | will do in a bit | 16:47 |
cdent | leakypipes: could you please remind me what the _provider_aggregate_map in in the report client was destined for? | 16:49 |
leakypipes | mriedem: thanks Matt | 16:49 |
leakypipes | cdent: precisely the case for determining if the compute node was associated to providers of shared resources. | 16:50 |
cdent | so is it of use in one of these two bugs? | 16:50 |
*** jjung has quit IRC | 16:50 | |
*** abalutoiu has joined #openstack-nova | 16:51 | |
mriedem | leakypipes: bug the first https://bugs.launchpad.net/nova/+bug/1707252 | 16:51 |
openstack | Launchpad bug 1707252 in OpenStack Compute (nova) "Claims in the scheduler does not account for doubling allocations on resize to same host" [Medium,Confirmed] | 16:51 |
mriedem | superdan: ^ make sure i made sense in there | 16:51 |
superdan | hang on, I'm reviewing leakypipes' other patch | 16:52 |
*** efoley has quit IRC | 16:54 | |
*** randomhack has joined #openstack-nova | 16:54 | |
*** catinthe_ has joined #openstack-nova | 16:54 | |
*** lyan has joined #openstack-nova | 16:54 | |
*** harlowja has joined #openstack-nova | 16:54 | |
*** crushil has quit IRC | 16:54 | |
mriedem | even with the fake rpc sleep thing in https://review.openstack.org/#/c/488500/ i'm not seeing the case that the source node is not in the allocations when it goes to delete the allocations for the instance | 16:55 |
*** derekh has quit IRC | 16:55 | |
*** harlowja_ has joined #openstack-nova | 16:55 | |
superdan | mriedem: but we know it can happen | 16:57 |
*** Apoorva_ has joined #openstack-nova | 16:57 | |
superdan | so I guess if you want to just leave it, then that's fine, but it'll be super hard to track down if it really happens | 16:57 |
*** dtantsur is now known as dtantsur|afk | 16:57 | |
*** catintheroof has quit IRC | 16:58 | |
superdan | mriedem: yes I think your bug text makes sense | 16:58 |
openstackgerrit | Sean Dague proposed openstack/nova master: Add cinder keystone client opts to config reference https://review.openstack.org/488530 | 16:58 |
*** harlowja has quit IRC | 16:59 | |
mriedem | superdan: leave what? the part of my patch that returns if the source node isn't in the current allocations? | 16:59 |
mriedem | the point was really just safe guarding against that and providing logging in case it happens | 16:59 |
superdan | mriedem: leave it like not apply your patch | 16:59 |
mriedem | oh | 16:59 |
mriedem | yeah | 16:59 |
mriedem | i figured we'd sort that out later | 16:59 |
superdan | you said this morning something indicating you might want to not commit this patch | 17:00 |
superdan | I think we should but... | 17:00 |
*** yamamoto has joined #openstack-nova | 17:00 | |
mriedem | i think it would be ok to do it - it's not going to impact performance by pulling the allocations again, because this code only runs from the compute periodic | 17:00 |
mriedem | i intentionally didn't pass the rp uuid in from the scheduler so the scheduler won't double check | 17:00 |
*** Apoorva has quit IRC | 17:00 | |
superdan | okay | 17:01 |
*** crushil has joined #openstack-nova | 17:01 | |
mriedem | leakypipes: superdan: cdent: here is the other bug https://bugs.launchpad.net/nova/+bug/1707256 | 17:03 |
openstack | Launchpad bug 1707256 in OpenStack Compute (nova) "Scheduler report client is not account for shared resource providers" [High,Confirmed] | 17:03 |
*** sambetts is now known as sambetts|afk | 17:03 | |
mriedem | omg me fail english | 17:04 |
superdan | is not account? | 17:04 |
superdan | oh | 17:04 |
superdan | mah | 17:04 |
superdan | god | 17:04 |
superdan | one for the record books kids | 17:04 |
* cdent is infectious | 17:04 | |
*** abalutoiu has quit IRC | 17:04 | |
superdan | let it be known henceforth that mriedem is not perfect | 17:04 |
mriedem | i was surrounded by a whirlwind of 6 year old in pink | 17:04 |
mriedem | rattled me | 17:04 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove compatibility code for flavors https://review.openstack.org/460377 | 17:05 |
*** randomhack has quit IRC | 17:05 | |
*** dillaman has quit IRC | 17:06 | |
*** slaweq has joined #openstack-nova | 17:06 | |
cdent | you reall do have my disease mriedem : “compute node things it needs” | 17:08 |
*** slaweq has quit IRC | 17:09 | |
sdague | mriedem: for one glorious moment, 0 bugs in New state - https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New | 17:09 |
mriedem | o.O | 17:09 |
mriedem | sdague: did you just invalidate everything? :) | 17:09 |
cdent | leakypipes: [t 3rxI] [t 3edk] | 17:09 |
purplerbot | <leakypipes> cdent: precisely the case for determining if the compute node was associated to providers of shared resources. [2017-07-28 16:50:19.034601] [n 3rxI] | 17:09 |
purplerbot | <cdent> so is it of use in one of these two bugs? [2017-07-28 16:50:43.278883] [n 3edk] | 17:09 |
sdague | I read every new bug, moved a bunch of them to Incomplete with specific questions, found all the ones that really were going to need specs and linked them to the specs process and put them in Opinion | 17:10 |
sdague | duped a few | 17:10 |
leakypipes | cdent: yes, the latter. | 17:10 |
sdague | found some that had been fixed | 17:10 |
mriedem | sdague: thanks | 17:10 |
sdague | so, it's mostly a legit cleaning of the New state | 17:10 |
* mriedem goes to lunch and other things for awhile | 17:10 | |
*** yamamoto has quit IRC | 17:10 | |
*** mriedem is now known as mriedem_afk | 17:10 | |
cdent | cool, thanks leakypipes, I figured as much but wanted to be sure | 17:11 |
sdague | also... evacuate bugs... zomg | 17:11 |
melwitt | sdague: you are a champion | 17:11 |
*** ijw has quit IRC | 17:12 | |
cdent | gerrit hates me | 17:12 |
*** esberglu_lunch is now known as esberglu | 17:12 | |
-openstackstatus- NOTICE: The Gerrit service on review.openstack.org is being taken offline for roughly 5 minutes to perform a database backup and reconfiguration | 17:13 | |
cdent | voila | 17:13 |
superdan | cdent: hates everyone apparently | 17:13 |
superdan | *it hates | 17:13 |
cdent | s/:// | 17:13 |
superdan | well, I suspected, but | 17:13 |
melwitt | yeah, gerrit hates us all. it's not you | 17:13 |
*** itlinux has joined #openstack-nova | 17:14 | |
*** junbo has quit IRC | 17:15 | |
cfriesen_ | review.openstack.org is down? | 17:15 |
cfriesen_ | never mind, just saw the note | 17:15 |
*** slaweq has joined #openstack-nova | 17:16 | |
*** yamahata has joined #openstack-nova | 17:16 | |
*** swebster has quit IRC | 17:16 | |
*** pwiltsey has quit IRC | 17:16 | |
*** trinaths has left #openstack-nova | 17:17 | |
cfriesen_ | sdague: arguably bug 1669054 is not opinion...if CONF.allow_resize_to_same_host is False and we do a resize then a subsequent rebuild/evacuate, it will continue to ignore the original host. | 17:19 |
openstack | bug 1669054 in OpenStack Compute (nova) "RequestSpec.ignore_hosts from resize is reused in subsequent evacuate" [Undecided,Opinion] https://launchpad.net/bugs/1669054 | 17:19 |
cfriesen_ | sdague: the only "might" is around exactly where to do the fix | 17:20 |
*** gyee has quit IRC | 17:23 | |
openstackgerrit | Peter Hamilton proposed openstack/nova-specs master: Add support for certificate validation https://review.openstack.org/488541 | 17:23 |
*** gyee has joined #openstack-nova | 17:25 | |
openstackgerrit | melanie witt proposed openstack/nova master: Detach device from live domain even if not found on persistent https://review.openstack.org/488545 | 17:26 |
*** openstackgerrit has quit IRC | 17:33 | |
*** openstackgerrit has joined #openstack-nova | 17:34 | |
openstackgerrit | Peter Hamilton proposed openstack/nova-specs master: Add support for certificate validation https://review.openstack.org/488541 | 17:34 |
*** saphi has quit IRC | 17:36 | |
*** slaweq has quit IRC | 17:38 | |
openstackgerrit | Chris Dent proposed openstack/nova master: Optional separate database for placement API https://review.openstack.org/362766 | 17:40 |
*** tbachman has joined #openstack-nova | 17:41 | |
*** Swami has joined #openstack-nova | 17:42 | |
openstackgerrit | Dan Smith proposed openstack/nova master: Add some more cellsv2 doc goodness https://review.openstack.org/487183 | 17:54 |
*** larainema has joined #openstack-nova | 17:55 | |
sdague | cfriesen_: Opinion often means bring it back in via the specs process. Did I not do that with this one? | 17:59 |
*** acormier has quit IRC | 17:59 | |
sdague | cfriesen_: if you want it confirmed / medium, that's fine as well, but that ends up being kind of a different black hole. | 18:00 |
*** acormier has joined #openstack-nova | 18:00 | |
sdague | cfriesen_: trying to make every open bug actionable | 18:00 |
sdague | might and may are not really actionable | 18:01 |
openstackgerrit | Jay Pipes proposed openstack/nova master: remove source provider allocs in confirm_resize() https://review.openstack.org/488510 | 18:01 |
*** crushil has quit IRC | 18:01 | |
leakypipes | superdan, figleaf: updated & | 18:01 |
leakypipes | ^^ | 18:01 |
openstackgerrit | Dan Smith proposed openstack/nova master: Add some more cellsv2 doc goodness https://review.openstack.org/487183 | 18:02 |
superdan | leakypipes: fixed ^ | 18:02 |
*** gyee has quit IRC | 18:03 | |
leakypipes | superdan: +2 | 18:04 |
superdan | tys | 18:04 |
*** acormier has quit IRC | 18:04 | |
*** acormier has joined #openstack-nova | 18:04 | |
*** gyee has joined #openstack-nova | 18:06 | |
*** catinthe_ has quit IRC | 18:08 | |
*** ijw has joined #openstack-nova | 18:08 | |
*** crushil has joined #openstack-nova | 18:09 | |
*** acormier has quit IRC | 18:09 | |
*** catintheroof has joined #openstack-nova | 18:10 | |
cdent | ah buckets, dan gets in the revision while I’m reviewing the cellsv2 doc goodness | 18:10 |
melwitt | superdan: thanks for writing that up, complete with diagrams! since I've been thinking about consoles, I'm thinking maybe I can add onto that with mention of nova-consoleauth and the websocketproxies similar to "Neutron Metadata API proxy"? | 18:11 |
*** esberglu has quit IRC | 18:11 | |
*** openstackstatus has quit IRC | 18:11 | |
*** openstack has joined #openstack-nova | 18:13 | |
*** Apoorva_ has quit IRC | 18:14 | |
*** Apoorva has joined #openstack-nova | 18:14 | |
*** esberglu has quit IRC | 18:15 | |
*** gyee has quit IRC | 18:15 | |
*** ihrachys has joined #openstack-nova | 18:15 | |
*** dillaman has quit IRC | 18:26 | |
*** dillaman has joined #openstack-nova | 18:27 | |
*** amotoki is now known as amotoki__ | 18:28 | |
*** ijw has quit IRC | 18:29 | |
*** rajathagasthya has quit IRC | 18:30 | |
*** jamesdenton has quit IRC | 18:32 | |
*** jamesdenton has joined #openstack-nova | 18:32 | |
*** cdent has quit IRC | 18:33 | |
*** ijw has joined #openstack-nova | 18:35 | |
*** ijw has quit IRC | 18:36 | |
*** ijw has joined #openstack-nova | 18:37 | |
*** dave-mccowan has joined #openstack-nova | 18:38 | |
*** kbaegis has quit IRC | 18:39 | |
*** dillaman has quit IRC | 18:41 | |
*** esberglu has joined #openstack-nova | 18:41 | |
*** openstackstatus has quit IRC | 18:42 | |
*** openstack has joined #openstack-nova | 18:44 | |
*** rajathagasthya has joined #openstack-nova | 18:46 | |
*** tbachman has quit IRC | 18:47 | |
*** tbachman has joined #openstack-nova | 18:51 | |
cfriesen_ | jaypipes: would https://review.openstack.org/#/c/339715 still be an issue with the new placement/allocations stuff? (i.e should I bother refreshing it or will it be handled already?) | 18:54 |
cfriesen_ | sdague: in this case the "might" was for a possibly way to fix it. The bug exists, that is not in question. | 18:55 |
*** acormier has joined #openstack-nova | 18:56 | |
*** rtjure has quit IRC | 18:58 | |
leakypipes | cfriesen_: no, I don't think so. different issue. | 19:00 |
*** kbaegis has joined #openstack-nova | 19:00 | |
leakypipes | cfriesen_: I think you can revamp that patch, address the comments from Matt. | 19:00 |
*** yassine has quit IRC | 19:04 | |
*** dillaman has quit IRC | 19:05 | |
*** dave-mccowan has quit IRC | 19:05 | |
*** dillaman has joined #openstack-nova | 19:07 | |
*** crushil has quit IRC | 19:11 | |
openstackgerrit | Ed Leafe proposed openstack/nova master: Handle hash ring rebalancing in ironic flavor migration https://review.openstack.org/487954 | 19:12 |
*** tbachman has quit IRC | 19:12 | |
*** nicolasbock has quit IRC | 19:12 | |
*** pwiltsey has joined #openstack-nova | 19:13 | |
openstackgerrit | Eric Fried proposed openstack/nova master: nova.utils.get_endpoint_data() https://review.openstack.org/488137 | 19:14 |
*** acormier has quit IRC | 19:15 | |
*** acormier has joined #openstack-nova | 19:16 | |
*** kbaegis has quit IRC | 19:17 | |
*** rtjure has joined #openstack-nova | 19:17 | |
*** crushil has joined #openstack-nova | 19:18 | |
*** rtjure has quit IRC | 19:19 | |
*** rtjure has joined #openstack-nova | 19:19 | |
*** rtjure has quit IRC | 19:19 | |
*** rtjure has joined #openstack-nova | 19:20 | |
*** rtjure has quit IRC | 19:21 | |
*** rtjure has joined #openstack-nova | 19:21 | |
*** rtjure has quit IRC | 19:23 | |
*** rtjure has joined #openstack-nova | 19:24 | |
*** rtjure has quit IRC | 19:26 | |
*** rtjure has joined #openstack-nova | 19:27 | |
*** rtjure_ has joined #openstack-nova | 19:27 | |
*** rtjure has quit IRC | 19:29 | |
*** liverpooler has quit IRC | 19:29 | |
*** rtjure has joined #openstack-nova | 19:29 | |
*** rtjure_ has quit IRC | 19:29 | |
*** rtjure has quit IRC | 19:29 | |
*** mriedem_afk is now known as mriedem | 19:33 | |
fried_rice | mriedem https://review.openstack.org/#/c/488034/ (g-r bump) is verified now. | 19:34 |
*** kfarr has joined #openstack-nova | 19:35 | |
*** tbachman has joined #openstack-nova | 19:37 | |
*** gbarros has quit IRC | 19:38 | |
*** Apoorva has quit IRC | 19:39 | |
*** Apoorva has joined #openstack-nova | 19:40 | |
mriedem | mgagne: https://bugs.launchpad.net/nova/+bug/1707284 | 19:41 |
openstack | Launchpad bug 1707284 in OpenStack Compute (nova) "Extend attached volume fails with "VolumePathsNotFound: Could not find any paths for the volume." in os-brick iscsi connector" [Medium,Confirmed] | 19:41 |
mgagne | mriedem: hi | 19:41 |
*** lyan has quit IRC | 19:44 | |
*** Apoorva has quit IRC | 19:45 | |
*** liusheng has quit IRC | 19:45 | |
*** mriedem has quit IRC | 19:46 | |
*** liusheng has joined #openstack-nova | 19:46 | |
mgagne | mriedem: could it be a redheering ? I'm not familiar with os-bricks and friends but right above, you can read "iscsiadm: No active sessions" and u'target_discovered': False in the bdm dump. that's what I found at first glance | 19:47 |
*** _pewp_ has quit IRC | 19:48 | |
*** _pewp_ has joined #openstack-nova | 19:48 | |
*** mriedem has joined #openstack-nova | 19:50 | |
hongbin | hi folks, i want to confirm that if i create an instance with an existing port and a security group, the security group should be added to the existing port or not? | 19:53 |
hongbin | or the security group should override the port's security group? | 19:55 |
*** lyan has joined #openstack-nova | 19:56 | |
*** Apoorva has joined #openstack-nova | 20:00 | |
mgagne | mriedem: I'm having a hard time debugging the logic, there are missing debug logs from os-brick, especially around calls to _iterate_all_targets from _get_potential_volume_paths in os_brick/initiator/connectors/iscsi.py | 20:03 |
openstackgerrit | Jay Pipes proposed openstack/nova master: placement: don't allocate on compute nodes https://review.openstack.org/488595 | 20:05 |
leakypipes | mriedem, superdan, figleaf, bauwser: mind blown.... ^ | 20:06 |
leakypipes | mriedem: and that takes care of https://bugs.launchpad.net/nova/+bug/1707256 actually. :) | 20:06 |
openstack | Launchpad bug 1707256 in OpenStack Compute (nova) "Scheduler report client does not account for shared resource providers" [High,Confirmed] - Assigned to Jay Pipes (jaypipes) | 20:06 |
superdan | leakypipes: um, what? | 20:07 |
superdan | leakypipes: who un-doubles the move allocation? | 20:07 |
*** randomhack has joined #openstack-nova | 20:07 | |
leakypipes | mriedem: by removing the compute node/resource tracker from all allocation operations, we kind of just remove the whole "is this shared or not" problem on the compute node. | 20:07 |
leakypipes | superdan: that's done in the dependent patch. | 20:07 |
leakypipes | superdan: https://review.openstack.org/#/c/488510/3 | 20:07 |
* superdan doesn't get it | 20:08 | |
leakypipes | superdan: so that's the only place on the compute node that will update allocations. | 20:08 |
*** catintheroof has quit IRC | 20:08 | |
superdan | ...okay | 20:08 |
superdan | leakypipes: so while we're upgrading, | 20:09 |
superdan | ocata computes will alter/delete the scheduler allocation, and we'll never heal it on pike computes, right? so how do we ensure it heals if it gets damaged? | 20:09 |
leakypipes | superdan: "mind blown" was referring to my own mind being blown. :) Basically, the patch makes the resource tracker look like what I wanted it to look like once placement-claims was complete. i.e. don't have it mucking with claims/allocations at all. | 20:09 |
superdan | yeah, I got it | 20:10 |
superdan | still not sure we can go that far yet | 20:10 |
superdan | maybe we should hangout to discuss? | 20:11 |
leakypipes | superdan: still haven't gotten that far in mind yet :) I could go for a hangout walkthrough of ideas. that last patch was more a "let's see what happens" patch than anything else :) | 20:11 |
openstackgerrit | Hongbin Lu proposed openstack/nova master: Handle exception on adding secgroup https://review.openstack.org/465173 | 20:11 |
superdan | oh okay, I thought you were suggesting that we do that for pike to eliminate these problems | 20:11 |
leakypipes | superdan: nah | 20:11 |
superdan | "let's see what happens in the gate" isn't going to convince me | 20:11 |
superdan | okay | 20:11 |
leakypipes | superdan: in any case, I would be good for a hangout. | 20:12 |
leakypipes | would be useful to talk through some of this. | 20:12 |
*** randomhack has quit IRC | 20:12 | |
mgagne | mriedem: ok, I think there is a bug in os-brick. When retrieve the iscsi sessions here: https://github.com/openstack/os-brick/blob/1.15.1/os_brick/initiator/connectors/iscsi.py#L247 | 20:15 |
mgagne | The returned value should look like so: ['10.0.1.24:3260'] | 20:15 |
mgagne | Below, it tries to do something I don't fully understand. But iscsi_portals_with_sessions will end up with the value ['.'] | 20:15 |
mgagne | So I'm not sure how this value is useful for the logic below which compares the bdm target_portal against the above value. In the end, you will always end up with an empty host_devices list. | 20:15 |
mgagne | That's my hypothesis on what's happening. | 20:15 |
mgagne | I think it got broken by this refactor despite the comment in the commit "It's worth mentioning that this patch does not touch the extend operation.": https://github.com/openstack/os-brick/commit/56c8665d3d342ce90f5d9433966c0f244063b4c1 | 20:18 |
*** boris_42 has joined #openstack-nova | 20:20 | |
*** acormier has quit IRC | 20:25 | |
*** acormier has joined #openstack-nova | 20:25 | |
*** smatzek has quit IRC | 20:30 | |
*** acormier has quit IRC | 20:30 | |
hongbin | hi, if i create a vm with an existing neutron port and a security group, the security group is ignored, i wonder why not populating the port with the specified sg? | 20:32 |
*** pchavva has quit IRC | 20:33 | |
*** penick has joined #openstack-nova | 20:36 | |
*** leakypipes has quit IRC | 20:36 | |
*** baoli has quit IRC | 20:37 | |
*** sdague has quit IRC | 20:37 | |
*** jmlowe has quit IRC | 20:39 | |
*** dillaman has quit IRC | 20:41 | |
openstackgerrit | Merged openstack/nova master: Provide original fault message when BFV fails https://review.openstack.org/467715 | 20:43 |
*** kfarr has quit IRC | 20:44 | |
*** crushil has quit IRC | 20:44 | |
*** dillaman has joined #openstack-nova | 20:46 | |
*** weshay is now known as weshay_pto | 20:53 | |
*** dillaman has quit IRC | 21:01 | |
*** marst has joined #openstack-nova | 21:03 | |
openstackgerrit | OpenStack Release Bot proposed openstack/os-vif master: Update reno for stable/pike https://review.openstack.org/488671 | 21:04 |
openstackgerrit | Merged openstack/nova master: Updated from global requirements https://review.openstack.org/488034 | 21:05 |
*** marst_ has quit IRC | 21:05 | |
openstackgerrit | OpenStack Release Bot proposed openstack/python-novaclient master: Update reno for stable/pike https://review.openstack.org/488799 | 21:07 |
*** yamamoto has joined #openstack-nova | 21:08 | |
*** thorst_ has quit IRC | 21:09 | |
*** sree_ has joined #openstack-nova | 21:10 | |
*** sree_ is now known as Guest688 | 21:10 | |
*** yamamoto has quit IRC | 21:12 | |
*** slaweq has joined #openstack-nova | 21:13 | |
*** Guest688 has quit IRC | 21:14 | |
*** vishwanathj has quit IRC | 21:15 | |
*** yamamoto has joined #openstack-nova | 21:16 | |
*** yamamoto has quit IRC | 21:20 | |
*** awaugama has quit IRC | 21:20 | |
*** edmondsw has quit IRC | 21:23 | |
*** edmondsw has joined #openstack-nova | 21:24 | |
*** gouthamr has quit IRC | 21:24 | |
*** edmondsw has quit IRC | 21:28 | |
*** david-lyle has joined #openstack-nova | 21:30 | |
*** esberglu has quit IRC | 21:34 | |
*** acormier_ has joined #openstack-nova | 21:35 | |
*** gouthamr has joined #openstack-nova | 21:36 | |
*** acormier_ has quit IRC | 21:36 | |
*** dillaman has joined #openstack-nova | 21:42 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements https://review.openstack.org/488865 | 21:43 |
*** david-lyle has quit IRC | 21:48 | |
*** slaweq has quit IRC | 21:49 | |
openstackgerrit | Ed Leafe proposed openstack/nova master: Clarifying node_uuid usage in ironic driver. https://review.openstack.org/485803 | 21:51 |
*** annegentle has quit IRC | 21:52 | |
*** yamamoto has joined #openstack-nova | 21:55 | |
openstackgerrit | Merged openstack/nova master: [placement] quash unicode warning with shared provider https://review.openstack.org/488363 | 21:56 |
*** thorst has joined #openstack-nova | 22:01 | |
*** slaweq has joined #openstack-nova | 22:02 | |
*** thorst has quit IRC | 22:05 | |
*** itlinux has quit IRC | 22:05 | |
*** esberglu has joined #openstack-nova | 22:07 | |
*** slaweq has quit IRC | 22:08 | |
*** esberglu has quit IRC | 22:11 | |
*** yamamoto has quit IRC | 22:12 | |
*** jmlowe has joined #openstack-nova | 22:18 | |
*** slaweq has joined #openstack-nova | 22:21 | |
openstackgerrit | Eric Fried proposed openstack/nova master: nova.utils.get_endpoint_data() https://review.openstack.org/488137 | 22:25 |
*** slaweq has quit IRC | 22:27 | |
*** thorst has joined #openstack-nova | 22:31 | |
*** lyan has quit IRC | 22:36 | |
*** fried_rice is now known as efried_zzz | 22:36 | |
*** figleaf is now known as edleafe | 22:37 | |
*** marst has quit IRC | 22:48 | |
*** yamahata has quit IRC | 22:54 | |
*** pwiltsey has quit IRC | 23:01 | |
*** rajathagasthya has quit IRC | 23:02 | |
*** randomhack has joined #openstack-nova | 23:09 | |
*** yamamoto has joined #openstack-nova | 23:13 | |
*** randomhack has quit IRC | 23:13 | |
*** acormier has joined #openstack-nova | 23:19 | |
*** yamamoto has quit IRC | 23:21 | |
*** acormier has quit IRC | 23:23 | |
*** slaweq has joined #openstack-nova | 23:24 | |
*** hongbin has quit IRC | 23:30 | |
*** chyka_ has quit IRC | 23:30 | |
*** rajathagasthya has joined #openstack-nova | 23:31 | |
*** rtjure has joined #openstack-nova | 23:32 | |
*** mtanin___ has quit IRC | 23:39 | |
*** dillaman has quit IRC | 23:41 | |
*** slaweq has quit IRC | 23:43 | |
*** acormier has joined #openstack-nova | 23:47 | |
*** markvoelker has quit IRC | 23:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!