Friday, 2017-08-11

*** thingee_ has quit IRC00:00
*** yassine has quit IRC00:06
*** itlinux has quit IRC00:06
*** thorst has quit IRC00:09
*** thorst has joined #openstack-nova00:10
*** thorst has quit IRC00:11
*** yassine has joined #openstack-nova00:14
*** priteau has joined #openstack-nova00:16
*** k2so is now known as sdake00:16
*** Sukhdev has quit IRC00:16
*** edmondsw has joined #openstack-nova00:17
*** yangyapeng has quit IRC00:18
*** priteau has quit IRC00:20
*** sbezverk has quit IRC00:21
*** edmondsw has quit IRC00:22
*** rajathagasthya has joined #openstack-nova00:24
*** slaweq has joined #openstack-nova00:25
*** smatzek has joined #openstack-nova00:27
*** slaweq has quit IRC00:29
openstackgerritTakashi NATSUME proposed openstack/nova-specs master: List/show all server migration types  https://review.openstack.org/48902900:32
openstackgerritTakashi NATSUME proposed openstack/nova-specs master: Enable cold migration with target host  https://review.openstack.org/48903100:33
openstackgerritTakashi NATSUME proposed openstack/nova-specs master: Update a URL  https://review.openstack.org/48902800:33
*** suresh12 has joined #openstack-nova00:42
*** suresh12 has quit IRC00:46
*** suresh12 has joined #openstack-nova00:48
*** jichen has joined #openstack-nova00:49
*** zhurong has joined #openstack-nova00:51
*** esberglu has joined #openstack-nova00:58
*** esberglu has quit IRC01:02
*** phuongnh has joined #openstack-nova01:03
*** markvoelker has joined #openstack-nova01:03
*** itlinux has joined #openstack-nova01:04
* alex_xu is sick, probably off the whole day01:04
*** Shunli has joined #openstack-nova01:04
*** litao__ has joined #openstack-nova01:09
*** Apoorva_ has quit IRC01:09
*** thorst has joined #openstack-nova01:11
*** gyee has quit IRC01:14
*** gyee has joined #openstack-nova01:14
*** rajathagasthya has quit IRC01:16
*** thorst has quit IRC01:17
*** yangyapeng has joined #openstack-nova01:21
*** slaweq has joined #openstack-nova01:27
dimsalex_xu : hope you feel better01:29
dimssoon :)01:29
*** jpena|off is now known as jpena01:30
*** yamahata has quit IRC01:31
*** slaweq has quit IRC01:31
*** PsionTheory has quit IRC01:35
*** hongbin has joined #openstack-nova01:38
*** jpena is now known as jpena|off01:38
*** mingyu has joined #openstack-nova01:39
openstackgerritjichenjc proposed openstack/nova master: Remove RamFilter and DiskFilter in default filter  https://review.openstack.org/49276501:52
*** suresh12 has quit IRC02:03
*** edmondsw has joined #openstack-nova02:06
*** edmondsw has quit IRC02:10
*** sree has joined #openstack-nova02:10
*** tiantian has joined #openstack-nova02:10
*** hemna__ has joined #openstack-nova02:11
*** zsli_ has joined #openstack-nova02:11
*** yangyape_ has joined #openstack-nova02:11
*** hongbin_ has joined #openstack-nova02:11
*** hemna_ has quit IRC02:11
*** thorst has joined #openstack-nova02:12
*** jichen_ has joined #openstack-nova02:12
*** sree has quit IRC02:14
*** coreywright_ has joined #openstack-nova02:14
*** rdo has joined #openstack-nova02:15
*** priteau has joined #openstack-nova02:17
*** gongysh has joined #openstack-nova02:17
*** thorst has quit IRC02:17
*** hongbin has quit IRC02:18
*** yangyapeng has quit IRC02:18
*** coreywright has quit IRC02:18
*** huangtianhua has quit IRC02:18
*** Shunli has quit IRC02:18
*** jichen has quit IRC02:18
*** jistr has quit IRC02:18
*** rdo_ has quit IRC02:18
*** clayton has quit IRC02:18
*** aloga has quit IRC02:18
*** edleafe has quit IRC02:18
*** jichen_ is now known as jichen02:19
*** clayton has joined #openstack-nova02:19
*** john51 has quit IRC02:20
*** openstackgerrit has quit IRC02:21
*** armax has quit IRC02:21
*** lifeless_ has joined #openstack-nova02:21
*** john51 has joined #openstack-nova02:21
*** armax has joined #openstack-nova02:21
*** priteau has quit IRC02:22
*** jistr has joined #openstack-nova02:23
*** chyka has joined #openstack-nova02:24
*** suresh12 has joined #openstack-nova02:24
*** edleafe has joined #openstack-nova02:24
*** gbarros has quit IRC02:26
*** tojuvone has quit IRC02:28
*** lifeless has quit IRC02:28
*** yamahata has joined #openstack-nova02:28
*** slaweq has joined #openstack-nova02:28
*** suresh12 has quit IRC02:28
*** chyka has quit IRC02:28
*** tojuvone has joined #openstack-nova02:28
*** openstackgerrit has joined #openstack-nova02:29
openstackgerritMerged openstack/nova master: Remove provider allocs in confirm/revert resize  https://review.openstack.org/48851002:29
*** ekhugen has quit IRC02:30
*** coreywright_ has quit IRC02:30
*** gbarros has joined #openstack-nova02:31
*** slaweq has quit IRC02:32
*** kristian__ has joined #openstack-nova02:33
*** ekhugen has joined #openstack-nova02:33
*** hongbin_ has quit IRC02:43
*** suresh12 has joined #openstack-nova02:47
*** coreywright_ has joined #openstack-nova02:49
*** yamamoto has quit IRC02:52
*** yamamoto has joined #openstack-nova02:53
*** hongbin has joined #openstack-nova02:55
*** suresh12 has quit IRC02:57
*** dave-mccowan has quit IRC03:06
*** kiennt has joined #openstack-nova03:11
*** thorst has joined #openstack-nova03:13
*** jichen has quit IRC03:13
*** smatzek has quit IRC03:20
*** nicolasbock has joined #openstack-nova03:21
*** thorst has quit IRC03:21
*** mriedem has quit IRC03:22
*** sbezverk has joined #openstack-nova03:24
*** mriedem has joined #openstack-nova03:27
*** mingyu has quit IRC03:28
*** slaweq has joined #openstack-nova03:29
*** slaweq has quit IRC03:34
*** gongysh has quit IRC03:34
*** psachin has joined #openstack-nova03:41
*** udesale has joined #openstack-nova03:41
*** rajathagasthya has joined #openstack-nova03:43
*** psachin has quit IRC03:43
*** itlinux_ has joined #openstack-nova03:44
*** gmann has joined #openstack-nova03:44
*** jichen has joined #openstack-nova03:47
*** psachin has joined #openstack-nova03:51
*** yangyape_ has quit IRC03:51
*** gbarros has quit IRC03:53
*** edmondsw has joined #openstack-nova03:54
*** hongbin has quit IRC03:56
*** mvk has joined #openstack-nova03:57
*** SamYaple has quit IRC03:57
*** edmondsw has quit IRC03:58
*** zhouyaguo has left #openstack-nova04:03
*** itlinux_ has quit IRC04:03
*** sbezverk has quit IRC04:07
*** kristian__ has quit IRC04:07
*** itlinux_ has joined #openstack-nova04:16
*** thorst has joined #openstack-nova04:17
*** jichen_ has joined #openstack-nova04:17
*** priteau has joined #openstack-nova04:18
*** hamzy has joined #openstack-nova04:18
*** itlinux_ has quit IRC04:19
*** itlinux_ has joined #openstack-nova04:19
*** hareesh has joined #openstack-nova04:21
*** jichen has quit IRC04:21
*** jichen_ is now known as jichen04:21
*** thorst has quit IRC04:22
*** priteau has quit IRC04:22
*** itlinux_ has quit IRC04:23
*** suresh12 has joined #openstack-nova04:27
*** kristian__ has joined #openstack-nova04:28
*** adisky__ has joined #openstack-nova04:31
openstackgerritMichael Still proposed openstack/nova master: Avoid chowning console logs in libvirt  https://review.openstack.org/47222904:31
openstackgerritMichael Still proposed openstack/nova master: First attempt at adding a privsep user to nova itself.  https://review.openstack.org/45916604:31
openstackgerritMichael Still proposed openstack/nova master: Move execs of touch to privsep.  https://review.openstack.org/48919004:31
openstackgerritMichael Still proposed openstack/nova master: Move libvirts dmcrypt support to privsep.  https://review.openstack.org/49073704:31
openstackgerritMichael Still proposed openstack/nova master: Move execs of tee to privsep.  https://review.openstack.org/48943804:31
openstackgerritMichael Still proposed openstack/nova master: Don't shell out to mkdir, use ensure_tree()  https://review.openstack.org/49232604:31
openstackgerritMichael Still proposed openstack/nova master: Move libvirt usages of chown to privsep.  https://review.openstack.org/47197204:31
openstackgerritMichael Still proposed openstack/nova master: Move ploop commands to privsep.  https://review.openstack.org/49232504:31
openstackgerritMichael Still proposed openstack/nova master: Read from console ptys using privsep.  https://review.openstack.org/48948604:31
openstackgerritMichael Still proposed openstack/nova master: Refactor libvirt.utils.execute() away.  https://review.openstack.org/48981604:31
*** jogo has quit IRC04:31
*** kristian__ has quit IRC04:32
*** mingyu has joined #openstack-nova04:39
*** mingyu has quit IRC04:45
*** rajathagasthya has quit IRC04:48
*** gyee has quit IRC04:50
*** tbachman has quit IRC04:50
*** jogo has joined #openstack-nova04:56
*** tbachman has joined #openstack-nova04:59
*** yamamoto has quit IRC05:03
*** yamamoto has joined #openstack-nova05:04
*** ratailor has joined #openstack-nova05:06
*** claudiub has joined #openstack-nova05:09
*** sree has joined #openstack-nova05:10
*** yamamoto has quit IRC05:11
*** sree has quit IRC05:15
*** shan has joined #openstack-nova05:16
*** thorst has joined #openstack-nova05:17
*** thorst has quit IRC05:22
*** vks1 has joined #openstack-nova05:30
*** slaweq has joined #openstack-nova05:31
*** sapcc-bot has joined #openstack-nova05:33
*** kristian__ has joined #openstack-nova05:34
*** slaweq has quit IRC05:35
*** sapcc-bot1 has quit IRC05:37
*** kristian__ has quit IRC05:38
*** claudiub has quit IRC05:38
*** edmondsw has joined #openstack-nova05:42
*** gongysh has joined #openstack-nova05:43
*** edmondsw has quit IRC05:46
*** suresh12 has quit IRC05:48
*** kiennt has quit IRC05:50
*** armax has quit IRC05:51
*** lpetrut has joined #openstack-nova05:52
*** armax has joined #openstack-nova05:52
*** armax has quit IRC05:52
*** armax has joined #openstack-nova05:52
*** armax has quit IRC05:53
*** armax has joined #openstack-nova05:53
*** armax has quit IRC05:54
*** armax has joined #openstack-nova05:54
*** armax has quit IRC05:54
*** itlinux has quit IRC05:55
*** armax has joined #openstack-nova05:55
*** armax has quit IRC05:55
*** armax has joined #openstack-nova05:56
*** armax has quit IRC05:56
*** armax has joined #openstack-nova05:57
*** armax has quit IRC05:57
*** itlinux has joined #openstack-nova05:57
*** armax has joined #openstack-nova05:57
*** armax has quit IRC05:58
*** gmann has quit IRC06:01
*** slaweq has joined #openstack-nova06:04
*** kiennt has joined #openstack-nova06:08
*** rajathagasthya has joined #openstack-nova06:10
*** Oku_OS-away is now known as Oku_OS06:11
*** _pewp_ has quit IRC06:13
*** diga has joined #openstack-nova06:14
*** _pewp_ has joined #openstack-nova06:14
*** tesseract has joined #openstack-nova06:16
*** thorst has joined #openstack-nova06:18
*** priteau has joined #openstack-nova06:18
*** yamamoto has joined #openstack-nova06:19
*** Sukhdev has joined #openstack-nova06:22
*** kiennt has quit IRC06:22
*** rcernin has joined #openstack-nova06:22
*** kiennt has joined #openstack-nova06:23
*** thorst has quit IRC06:23
*** priteau has quit IRC06:23
*** yamamoto has quit IRC06:24
*** itlinux has quit IRC06:28
*** phuongnh has quit IRC06:28
*** phuongnh has joined #openstack-nova06:29
*** rtjure has joined #openstack-nova06:32
*** kristian__ has joined #openstack-nova06:33
*** Sukhdev has quit IRC06:34
*** kristian__ has quit IRC06:34
*** mingyu has joined #openstack-nova06:35
*** libin_ has joined #openstack-nova06:43
*** sahid has joined #openstack-nova06:44
*** phuongnh has quit IRC06:45
*** lpetrut has quit IRC06:52
*** yamamoto has joined #openstack-nova06:52
*** amotoki has joined #openstack-nova06:57
*** Swami has quit IRC06:59
*** kristian__ has joined #openstack-nova07:00
*** jaosorior has quit IRC07:03
openstackgerritMerged openstack/nova master: Resource tracker compatibility with Ocata and Pike  https://review.openstack.org/49101207:06
*** yamamoto has quit IRC07:07
*** aarefiev_afk is now known as aarefiev07:08
*** moshele has joined #openstack-nova07:11
*** rajathagasthya has quit IRC07:12
*** saphi has joined #openstack-nova07:13
*** jaosorior has joined #openstack-nova07:15
*** markus_z has joined #openstack-nova07:16
*** ioggstream has joined #openstack-nova07:17
*** aloga has joined #openstack-nova07:19
*** thorst has joined #openstack-nova07:19
*** gmann has joined #openstack-nova07:21
*** thorst has quit IRC07:23
*** kristian__ has quit IRC07:23
*** gmann has quit IRC07:28
*** slaweq has quit IRC07:28
*** slaweq has joined #openstack-nova07:29
*** gmann has joined #openstack-nova07:37
*** sree has joined #openstack-nova07:40
*** kristian__ has joined #openstack-nova07:41
*** ralonsoh has joined #openstack-nova07:41
*** aloga has quit IRC07:43
*** aloga has joined #openstack-nova07:43
*** slaweq has quit IRC07:47
openstackgerritjichenjc proposed openstack/nova master: refactory some code on get_password  https://review.openstack.org/44945807:50
openstackgerritMarkus Zoeller (markus_z) proposed openstack/nova master: docs: Explain the flow of the "serial console" feature  https://review.openstack.org/47618807:51
*** kristia__ has joined #openstack-nova07:51
*** kristian__ has quit IRC07:53
*** karthiks has joined #openstack-nova07:57
*** phuoc_ has joined #openstack-nova07:57
*** alexchadin has joined #openstack-nova07:58
*** openstackgerrit has quit IRC08:02
*** sridharg has joined #openstack-nova08:04
*** yamamoto has joined #openstack-nova08:04
*** gmann has quit IRC08:07
*** diga has quit IRC08:08
*** mvk has quit IRC08:14
*** derekh has joined #openstack-nova08:14
*** diga has joined #openstack-nova08:15
*** priteau has joined #openstack-nova08:16
*** yamamoto has quit IRC08:17
*** mvk has joined #openstack-nova08:21
*** openstackgerrit has joined #openstack-nova08:24
openstackgerritIlya Popov proposed openstack/nova master: Tests: Add cleanup of 'instances' directory  https://review.openstack.org/49158908:24
*** yangyapeng has joined #openstack-nova08:30
*** moshele has quit IRC08:34
*** sahid has quit IRC08:43
*** yamamoto has joined #openstack-nova08:44
*** sahid has joined #openstack-nova08:47
*** mingyu has quit IRC08:48
*** lucas-afk is now known as lucasagomes08:49
*** dtantsur|afk is now known as dtantsur08:54
*** yamamoto has quit IRC08:56
*** priteau has quit IRC08:58
*** shan is now known as shan|afk09:01
*** sambetts|afk is now known as sambetts09:02
*** yangyapeng has quit IRC09:03
*** cdent has joined #openstack-nova09:05
*** priteau has joined #openstack-nova09:08
*** alexchadin has quit IRC09:09
*** diga_ has joined #openstack-nova09:17
*** markvoelker has quit IRC09:17
*** diga has quit IRC09:18
*** phuoc_ has left #openstack-nova09:20
*** thorst has joined #openstack-nova09:21
*** yamamoto has joined #openstack-nova09:24
*** thorst has quit IRC09:25
openstackgerrityfzhao proposed openstack/python-novaclient master: Fix wrong links  https://review.openstack.org/49292109:27
*** mriedem has quit IRC09:30
*** priteau has quit IRC09:33
gibigood morning09:34
*** yamamoto has quit IRC09:35
*** zsli_ has quit IRC09:37
*** jichen has quit IRC09:38
bauzasgibi: good lunch :p09:39
gibibauzas: the day started earlier a bit but I was occupied with internal meetings09:41
gibibauzas: but yes, a lunch is about to happen too09:42
gibibauzas: did Matt cut rc1 last night?09:42
bauzasgibi: no09:43
bauzasgibi: https://review.openstack.org/#/c/492788/209:43
bauzashe was waiting for the merge IIRC09:43
bauzasgibi: now, the main problem is about the Ironic job09:43
bauzasdtantsur: around ?09:43
bauzasdtantsur: context is https://review.openstack.org/#/c/487954/1409:44
openstackgerritBalazs Gibizer proposed openstack/nova master: replace chance with filter scheduler in func tests  https://review.openstack.org/49152909:44
bauzasdtantsur: that change is atm a RC1 blocker but I don't see the Ironic job providing the log saying that the flavor is modified09:44
gibibauzas: thanks for the info09:45
bauzasdtantsur: if we cut RC1 without ^, that could possibly be an upgrade problem for Queens09:45
bauzasso I would appreciate any ironic folks support now :)09:45
bauzasTheJulia: around too ?09:46
*** vks11 has joined #openstack-nova09:46
*** vks1 has quit IRC09:47
smcginnisbauzas: Do you need to hold that RC request?09:47
*** mingyu has joined #openstack-nova09:48
smcginnisbauzas: Oh, nevermind. Now I see your comment there.09:49
bauzassmcginnis: yeah, I'd like to discuss with matt about whether we cut RC1 without the change I provided in my comment09:50
bauzassmcginnis: do you accept that ? is it possible to cut RC1 only on Friday?09:50
bauzasI mean, it's also a branch09:50
smcginnisbauzas: I think we're probably fine waiting until Monday if we have to.09:50
smcginnisbauzas: You're just waiting on one patch, right?09:50
bauzassmcginnis: yup, I just rebased the releases tag with the merge sha109:51
bauzassmcginnis: so if we just cut the tag without the above change, a +W would only be needed09:51
bauzasthe only blocker for us is https://review.openstack.org/#/c/487954/09:51
bauzasother bugs would be treated in other RCs09:52
bauzasHTH09:52
smcginnisbauzas: Cool, I think we're fine waiting a little then.09:52
*** mingyu has quit IRC09:53
*** ratailor has quit IRC09:54
*** priteau has joined #openstack-nova09:54
dtantsurmorning bauzas09:55
dtantsurI'll start looking in it in a few minutes09:55
*** priteau has quit IRC09:59
openstackgerritBalazs Gibizer proposed openstack/nova master: test server evacuation with placement  https://review.openstack.org/49254810:00
*** sdague has joined #openstack-nova10:00
*** kiennt has quit IRC10:01
*** egonzalez has joined #openstack-nova10:03
bauzasdtantsur: FWIW, I'm forging a DNM patch for adding more voerbosity10:03
*** trungnv has quit IRC10:03
*** priteau has joined #openstack-nova10:04
*** yangyapeng has joined #openstack-nova10:04
dtantsurcool10:04
*** gmann has joined #openstack-nova10:04
*** sapd has joined #openstack-nova10:06
*** ociuhandu has quit IRC10:08
*** yangyapeng has quit IRC10:09
*** mingyu has joined #openstack-nova10:09
*** ratailor has joined #openstack-nova10:13
*** mingyu has quit IRC10:14
*** mingyu has joined #openstack-nova10:14
*** Drankis has joined #openstack-nova10:16
*** Drankis has quit IRC10:16
*** Drankis has joined #openstack-nova10:16
openstackgerritSylvain Bauza proposed openstack/nova master: Make compute log less verbose with allocs autocorrection  https://review.openstack.org/49257110:16
*** markvoelker has joined #openstack-nova10:18
dtantsurbauzas: I don't really understand the CI failure there.. it seems unrelated to me10:18
bauzasdtantsur: hence me logging more10:19
bauzasdtantsur: I'm even not sure we run the thread10:19
bauzasgiven it's in a conditional10:19
dtantsurwe should not, it only runs for nodes with resource_class != None10:20
dtantsurbauzas: I can make https://review.openstack.org/#/c/491777/ depends-on this patch, to see how it behaves with resource_classes. wdyt?10:21
*** thorst has joined #openstack-nova10:22
bauzasdtantsur: sure10:22
* dtantsur doing10:22
*** psachin has quit IRC10:22
bauzasdtantsur: if that doesn't trample you waiting for devstack patch being merged10:22
bauzasdtantsur: I mean, if you can wait for that devstack patch to be merged, that's fine to me10:23
dtantsurwe need to make sure it won't blow up after merging the both changes :)10:23
bauzasyeah10:23
*** markvoelker has quit IRC10:23
bauzasanyway, just doing an urgent internal bug thingy and then I'm back to the DNM patch10:23
dtantsurack10:23
*** sree has quit IRC10:24
*** thorst has quit IRC10:26
dtantsurok, both patches updated, waiting for the CI10:27
*** yamamoto has joined #openstack-nova10:32
*** psachin has joined #openstack-nova10:35
*** markvoelker has joined #openstack-nova10:39
openstackgerritDmitry Tantsur proposed openstack/nova master: Deprecate bare metal filters  https://review.openstack.org/49256310:41
*** vks11 has quit IRC10:41
dtantsurbauzas: meanwhile, do you think we can also get ^^ in?10:42
*** markvoelker_ has joined #openstack-nova10:44
*** markvoelker has quit IRC10:44
*** markvoelker_ has quit IRC10:44
*** markvoelker has joined #openstack-nova10:45
*** yamamoto has quit IRC10:48
*** suresh12 has joined #openstack-nova10:48
*** suresh12 has quit IRC10:53
bauzasdtantsur: looks to me hard for RC110:53
bauzasdtantsur: even if we haven't yet merged it10:53
bauzastagged it, sorry10:53
dtantsurok, that's fine. I just have an ironic docs patch depending on it, I may need to split it10:53
bauzasdtantsur: we're already past the deadline but I leave matt make the hard call :)10:53
dtantsurvdrok: first of all, please review https://review.openstack.org/#/c/487954/10:54
vdrokdtantsur: looking10:54
dtantsurvdrok: it fails the ironic CI for some reason. I see network connection problems between various services, so it is not necessary related to the patch itself10:56
vdrokdtantsur: yup, there is some socket error in the vbmc log as well10:56
dtantsurI've rechecked it, let's see10:56
dtantsurvdrok: our next step would be to make https://review.openstack.org/491777 and https://review.openstack.org/476968 pass the CI - reviews welcome there too10:57
bauzasdtantsur: I'm more concerned by the fact I don't see the logs mentioning the flavor update rather than the Ironic job giving us -1 :)10:57
bauzasdtantsur: in other words, I feel brave enough to +2 some ironic change if I'm sure the job issues are unrelated10:57
dtantsurbauzas: why should we see any updates, given that the nodes don't have resource classes yet?10:58
bauzasoh f****10:58
* bauzas facepalms10:58
bauzasdtantsur: you killed me :p10:59
dtantsurbear metal powerzzz!10:59
bauzasdtantsur: those ironic nodes aren't having resource classes10:59
bauzas?10:59
*** saphi has quit IRC10:59
bauzasyet, I mean ?10:59
*** vks1 has joined #openstack-nova11:00
dtantsurbauzas: yep. your logging line should show up in https://review.openstack.org/491777 instead - hence I made it depends-on the nova patch11:00
*** zhurong has quit IRC11:00
bauzasdtantsur: oh snap https://review.openstack.org/#/c/491777/9/devstack/lib/ironic@1821 right?11:01
bauzasuntil that devstack change, the gate nodes aren't yet correctly having resource classes11:01
bauzasI thought it was already the case11:01
bauzasdtantsur: IMHO, we should invert the depends-on11:02
dtantsurhah, sorry for not figuring out the confusion earlier11:02
bauzasdtantsur: why would you make the devstack change dependent on the nova change ?11:02
dtantsurbauzas: yeah, good call probably. wanna me drop the depends-on from my patch?11:02
bauzasif the nova change uses what's provided by the devstack one ?11:03
dtantsurI wanted one of them to depend on the other, I don't care which exactly :)11:03
* dtantsur updates11:03
bauzasdtantsur: yeah, please remove the depends-on on the devstack one11:03
bauzasdtantsur: and then I'll update https://review.openstack.org/#/c/487954/ to include devstack11:03
dtantsurbauzas: done11:04
*** priteau has quit IRC11:04
bauzasdtantsur: I have to apologize, I wasn't having a full view of the situation11:04
vdrokdtantsur: so, for that code to be triggered, we have to have an active instance booted with old flavor, and afterwards being updated with resource class right?11:04
bauzasdtantsur: okay, I'm on https://review.openstack.org/#/c/487954/11:04
vdrokcode in https://review.openstack.org/#/c/487954/14 I mean11:04
dtantsurbauzas: no problem, thanks for helping us with this stuff anyway11:04
bauzasvdrok: for the nova code to be triggered, you have to set resource classes for ironic nodes firsrt11:05
*** mingyu has quit IRC11:05
bauzasvdrok: that would be done by devstack in the job we discuss11:05
*** mingyu has joined #openstack-nova11:05
*** yangyapeng has joined #openstack-nova11:05
dtantsurvdrok: I think vdrok's point is that we still won't see the log message, because it needs the resource_class to not be present initially..11:06
vdrokdtantsur: bauzas exactly11:06
openstackgerritSylvain Bauza proposed openstack/nova master: Handle addition of new nodes/instances in ironic flavor migration  https://review.openstack.org/48795411:06
dtantsurso I wonder if the only option to test it is to actually get a devstack locally, and try it11:06
*** mriedem has joined #openstack-nova11:07
bauzasdtantsur: done ^11:07
bauzasdtantsur: just to make it clear, I'm just updating it but just for testing purposes11:07
dtantsurvdrok: in any case, could you please review https://review.openstack.org/#/c/491777/ ? this is something we must get in today to not block nova further11:07
*** hieulq has quit IRC11:07
bauzasdtantsur: once we're sure the flavor is correctly updated, I feel fine to just revert it to PS14 and +W it since melwitt already gave her +211:08
vdrokdtantsur: yeah that one looks fine to me11:08
*** ratailor has quit IRC11:08
*** edmondsw has joined #openstack-nova11:10
mriedembauzas: you know you could have pushed a change on top that depended on https://review.openstack.org/#/c/491777/11:10
*** yangyapeng has quit IRC11:10
bauzasmriedem: snap, my bad11:10
mriedemnow you have to run https://review.openstack.org/#/c/487954/ back through twice11:10
*** slaweq has joined #openstack-nova11:10
mriedemi'm already tagging rc111:10
bauzasmriedem: yeah, good point11:10
bauzasmriedem: I just updated the RC1 patch11:11
bauzasmriedem: with the latest merge sha111:11
bauzasmriedem: I can revert back to PS14 so we won't need to run yet again jenkins11:11
bauzasand I'll do what you say11:11
vdrokdtantsur: I'll just test this locally now I think. and then we'll try to make the grenade do this resource class setting to see the whole process11:11
bauzasmriedem: ack ?11:11
mriedembauzas: i think https://review.openstack.org/#/c/492788/ is ready to go11:12
dtantsurvdrok: cool, thanks!11:12
*** chyka has joined #openstack-nova11:12
mriedemthe ironic stuff is rc211:12
dtantsurthat will require backporting to stable/pike, right?11:13
dtantsuralso morning mriedem11:13
mriedemdtantsur: yes11:13
bauzasmriedem: okay, I'm fine then11:13
dtantsurack11:13
bauzasmriedem: removing my -111:13
bauzassmcginnis: ^11:13
mriedembut that's just because we don't have milestone-proposed anymore11:13
*** sapd has quit IRC11:14
openstackgerritSylvain Bauza proposed openstack/nova master: Handle addition of new nodes/instances in ironic flavor migration  https://review.openstack.org/48795411:16
mriedemdtantsur: i was not sure what to make of http://logs.openstack.org/68/476968/12/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/02053cf/logs/screen-n-sch.txt.gz#_Aug_09_20_35_41_53362111:16
mriedemdtantsur: when i dug through those logs,11:16
mriedemthe ironic driver wasn't populating inventory in placement,11:16
mriedemwhich would have auto-created the custom resource class11:16
mriedemi'm not sure if we have some chicken and egg issue11:17
* TheJulia reads11:17
dtantsurmriedem: it seems to be that it tries to proceed, and actually fails on http://logs.openstack.org/68/476968/12/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/02053cf/logs/screen-n-sch.txt.gz#_Aug_09_20_35_41_58827211:17
dtantsurI'm not sure it's expected or not11:17
*** chyka has quit IRC11:17
dtantsurif it is, then I'm pretty sure we have a chicked and egg situation11:17
mriedemdtantsur: i think that's a side effect11:17
*** gongysh has quit IRC11:17
mriedemthere is a periodic task in the compute service that pulls inventory from ironic https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L77511:18
mriedem^ includes any custom resource class on the node11:18
mriedemthe resource tracker in the compute service calls that from here https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L83411:18
*** udesale has quit IRC11:18
mriedemand if there is a custom resource class in that inventory, it would auto-create it in placement here https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L77511:19
mriedemwhen i was looking at the logs on that failed job, i never saw _update_inventory get called11:19
mriedemso with my limited understanding of how the ironic driver works, when does the node cache in the driver actually have something show up here? https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L73511:20
vdrokdtantsur: locally, I see "The flavor extra_specs for Ironic instance 0b8460b1-2211:20
vdrok57-44dc-8b96-4c17182a9a64 have been updated for custom resource class 'baremetal'."11:20
cdentmriedem, bauzas any pending crises that need attention?11:20
mriedemcdent: not really, just trying to sort out https://review.openstack.org/#/c/487954/111:20
mriedemhttps://review.openstack.org/#/c/487954/ i mean11:20
vdrokdtantsur: mriedem http://paste.openstack.org/show/618160/11:21
mriedemand this http://logs.openstack.org/68/476968/12/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/02053cf/logs/screen-n-sch.txt.gz#_Aug_09_20_35_41_53362111:21
vdrokso same thing as you see I guess11:21
openstackgerritSylvain Bauza proposed openstack/nova master: DNM: Add more logging + hook devstack  https://review.openstack.org/49295711:21
bauzascdent: nothing really critical11:22
bauzascdent: ironic flavor migration is hold for RC211:22
mriedem"Unable to allocate inventory for resource provider 68d57495-2daa-46b3-8e2c-f2f0a19dbaf8: No such resource class CUSTOM_BAREMETAL."11:22
bauzascdent: and RC1 is on its way11:22
bauzasmriedem: dtantsur: https://review.openstack.org/492957 HTH11:22
*** thorst has joined #openstack-nova11:22
dtantsurmriedem: I guess it does it once in 2 minutes. this may be the cause of the problem: we may need to wait for Placement to get it. Do we have any CLI for placement so far?11:22
mriedemdtantsur: there is a series of unmerged osc changes11:23
* bauzas drops for a a couple of minutes11:23
bauzas(lunch)11:23
mriedemhttps://blueprints.launchpad.net/nova/+spec/placement-osc-plugin11:23
*** priteau has joined #openstack-nova11:23
*** shan|afk is now known as shan11:23
vdrokdtantsur: don't think there is a problem with waiting, I still see the same error after 4 minutes11:23
*** priteau has quit IRC11:24
dtantsuroh11:24
dtantsurthanks vdrok. this does look like a problem to me now11:24
*** egonzalez has quit IRC11:24
*** cdent has quit IRC11:24
*** sridharg has quit IRC11:24
*** kristia__ has quit IRC11:24
*** aloga has quit IRC11:24
*** tojuvone has quit IRC11:24
*** yamahata has quit IRC11:24
mriedemthis is really weird11:25
mriedemAug 11 11:18:56 ubuntu nova-compute[7647]: INFO nova.scheduler.client.report [None req-267b8c81-5ea5-4e13-9ea8-02354628c37f None None] Compute node 68d57495-2daa-46b3-8e2c-f2f0a19dbaf8  reported no inventory but previous inventory was detected. Deleting existing inventory records.11:25
mriedem^ is if the get_inventory method in the driver reported some inventory at one point, but now it doesn't11:26
*** hareesh has quit IRC11:26
* dtantsur is confused11:26
mriedemwas the node disabled?11:26
dtantsurvdrok: ^^^ what was your testing scenario?11:27
mriedemhttps://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L74111:27
*** ratailor has joined #openstack-nova11:27
*** thorst has quit IRC11:27
*** sapd has joined #openstack-nova11:28
vdrokdtantsur: mriedem I had an instance booted yesterday, devstack setup also from yesterday, with no custom non-merged patches. then I updated nova code with this flavor migration change, restarted n-cpu, updated the resource class of the node the instance was on from None to baremetal11:28
dtantsurmriedem: oh. it seems that we don't report inventory for ACTIVE nodes11:29
dtantsurhttps://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L324-L32911:29
mriedemvdrok: ok and we see that get picked up here11:29
mriedemAug 11 11:18:56 ubuntu nova-compute[7647]: DEBUG nova.virt.ironic.driver [None req-267b8c81-5ea5-4e13-9ea8-02354628c37f None None] The flavor extra_specs for Ironic instance 0b8460b1-22 57-44dc-8b96-4c17182a9a64 have been updated for custom resource class 'baremetal'. {{(pid=7647) _pike_flavor_migration /opt/stack/nova/nova/virt/ironic/driver.py:561}}11:29
vdrokyup11:29
dtantsurwhich is... wrong?11:29
mriedemdtantsur: ACTIVE?11:30
mriedemhttps://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L17611:30
mriedemthat state checking seems fine11:30
mriedemif it's not available, don't say it is11:30
dtantsurstates.ACTIVE is not in good state11:30
dtantsurwhich is the state we have when we have an instance provisioned11:30
*** yamahata has joined #openstack-nova11:31
dtantsuryeah, but should we return an empty inventory for nodes with an instance? actually, I guess, we should, right11:31
mriedemno idea11:31
dtantsurbut maybe instead of an empty dict we should return all values with zeroes?11:31
*** sridharg has joined #openstack-nova11:31
dtantsurmriedem: ^^^11:31
dtantsurlike CUSTOM_FOOBAR=0, VCPU=0, etc?11:31
mriedemwe can't report 0 inventory to placement11:32
mriedemhttps://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L75211:32
mriedemmin_unit is minimum of 111:32
dtantsurhmmm11:32
dtantsurthen the placement indeed has no idea about the new resource class11:33
dtantsurwe never return it from virt/ironic11:33
mriedemhttps://github.com/openstack/nova/blob/master/nova/api/openstack/placement/handlers/inventory.py#L3911:33
mriedemyeah inventory total has to be at least 111:33
dtantsurbut wait, cannot a hypervisor have 0 free memory, for example?11:33
mriedemdtantsur: is that the chicken and egg?11:33
*** tojuvone has joined #openstack-nova11:33
dtantsur(please pardon my ignorance)11:33
*** aloga has joined #openstack-nova11:34
dtantsurbut yes, I suspect we cannot create resource classes for such nodes, because we don't report them back ever11:34
* mriedem wishes jaypipes were around11:34
*** brault has quit IRC11:35
mriedemok so the node has the resource_class set after there is an instance associated and that's how we migrate the flavor extra spec,11:35
* dtantsur wonders if we should call to Placement from within the ironic driver every time we encounter a new node.resource_class11:35
mriedembut once the instance is associated, the node is in an ACTIVE state which means we don't report inventory for it?11:35
dtantsurcorrect11:35
mriedemand thus can't auto-create the newly added resource class11:35
*** yamamoto has joined #openstack-nova11:35
*** cdent has joined #openstack-nova11:36
mriedemand that instance <> node is what's already consuming the existing vcpu/memory_mb/disk_gb inventory that we can't delete now11:36
mriedemAug 11 11:18:56 ubuntu nova-compute[7647]: WARNING nova.scheduler.client.report [None req-267b8c81-5ea5-4e13-9ea8-02354628c37f None None] [req-27dbace7-c527-4f8f-add8-d732047d7382] We c annot delete inventory 'VCPU, MEMORY_MB, DISK_GB' for resource provider 68d57495-2daa-46b3-8e2c-f2f0a19dbaf8 because the inventory is in use.11:36
dtantsuralso correct11:36
mriedemheh, yeah, that warning shows up all the time in an ironic ci job run11:37
mriedemhttp://logs.openstack.org/54/487954/12/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv/041c03a/logs/screen-n-cpu.txt.gz#_Aug_09_19_31_21_25212711:38
mriedemi'll open a bug for this since i think it's something we haven't considered, obviously11:38
dtantsuryes please11:38
dtantsurmriedem: can we create resource classes in Placement from the ironic driver each time we encounter a new resource_class?11:39
dtantsuror is it a crazy idea for some reason?11:39
mriedemwell,11:39
*** mdbooth has quit IRC11:39
mriedemi suppose the idea we return 0 inventory in this case is because there is an instance consuming the node,11:39
cdenti seem to have been disconnected briefly so going back in the log, saw some discussion about trying to report 0 inventory for a ironic node with an instance on it11:39
cdentthis is bad11:40
mriedemso we don't want to have the scheduler think there is a node available11:40
mriedemfor building a new instance11:40
dtantsurright11:40
mriedemas the node is wholly consumed11:40
cdentthe inventory should be whatever the capacity is, and then allocations to cover the instance11:40
dtantsurright, and we cannot return VCPU=011:40
* dtantsur does not understand why we have min_unit, to be honest11:41
*** sbezverk has joined #openstack-nova11:42
*** mdbooth has joined #openstack-nova11:42
dtantsurcdent: I tend to agree, I'm not sure why we do it11:42
*** slaweq has quit IRC11:42
cdentit’s not a question of tend to agree. if you’re doing that, it violates the principles of how placement is supposed to work...11:43
cdentmin_unit in the ironic case doesn’t make a lot of sense11:43
cdentbut for vms where you don’t want to allow people to slice up the host into lots of tiny pieces, it is meaningful11:43
dtantsurcdent: I used "tend to agree" to designate that I do not know Nova well enough, not to question your findings11:44
cdentI didn’t think you were questioning, I was just reinforcing the point: sounds like weird stuff afoot11:44
*** shan has quit IRC11:44
dtantsurok11:45
dtantsurso11:45
*** liverpooler has joined #openstack-nova11:45
dtantsurshould we just fix it to remove min_unit and always return the correct inventory?11:45
dtantsurs/correct/complete/11:45
dtantsuroh, I think I know why it was done11:46
* cdent needs to read the backlog a bit more11:46
cdentone sec11:46
vdrokso _refresh_cache is called in the driver.get_available_nodes from compute manager's update_available_resource periodic, and we migrate the flavor there. then we  call the update_available_resource, which calls get_available_resource. we still include the resoruce_class in the return dict in https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L335.11:47
dtantsurcdent: this is mimicking the old behavior with bare metal nodes. if we always report the complete inventory, e.g. 2Gi of RAM. and there is an instance with 1Gi of RAM. the Placement will think that 1Gi of RAM is still free11:47
vdrokdtantsur: so do you propose to call the placement to create resource class right during the update_available_resource?11:47
dtantsurvdrok: something like that.. but let's figure out the inventory problem first11:47
mriedemhttps://bugs.launchpad.net/nova/+bug/171014111:48
openstackLaunchpad bug 1710141 in OpenStack Compute (nova) "Continual warnings in n-cpu logs about being unable to delete inventory for an ironic node with an instance on it" [High,Triaged]11:48
mriedemcdent: dtantsur: vdrok: ^11:48
dtantsurthanks mriedem11:48
*** yamamoto has quit IRC11:48
*** sapd has quit IRC11:48
*** yamamoto has joined #openstack-nova11:48
dtantsuranyway, cdent, mriedem, wdyt about returning the custom resource class in the inventory *always*, even for occupied nodes?11:49
vdrokdtantsur: I think the reason of having min_unit=0 is because if the resource provider can provide 0 of some resource, it;s not really that resource's provider :)11:49
vdrokerr, min_unit=111:49
*** dikonoor has joined #openstack-nova11:49
vdrokif that's what you're talking about11:49
cdentdtantsur: are you talking about the get_inventory call in the virt driver?11:50
*** sbezverk has quit IRC11:50
*** boolman has joined #openstack-nova11:50
dtantsurcdent: yes. maybe I should make a DNM patch showing it..11:50
cdentif the physical hardware hasn’t changed, that should always return the same thing, without regard to presence of an instance11:50
*** kristian__ has joined #openstack-nova11:51
cdentso I think the answer to your question is "yes"11:51
mriedemas cdent pointed out, it seems we should be reporting the inventory regardless of what's allocated on that provider, and let the allocation consume the inventory so the scheduler will ignore it11:51
mriedemi.e. this node has 1 VCPU and that 1 VCPU is consumed, so it's not eligible for building another instance11:51
*** yuchenghui has joined #openstack-nova11:52
boolmanhi peeps, Can I disable local disk on hypervisors? eg: openstack server create --image xenial --security-group default --key-name emil --network backend --flavor smallish demo -- currently this creates the instance on local disk on the hypervisors11:52
mriedemboolman: you'd have to use a volume11:52
boolmansince I'm using ceph rbd storage i want to force that11:52
openstackgerritDmitry Tantsur proposed openstack/nova master: DNM PoC for fixing ironic with resource classes  https://review.openstack.org/49296411:52
dtantsurcdent, mriedem, something like ^^^11:52
mriedemboolman: boot from volume that deletes on termination11:52
openstackgerritChris Dent proposed openstack/nova master: Optional separate database for placement API  https://review.openstack.org/36276611:52
*** priteau has joined #openstack-nova11:53
*** priteau has quit IRC11:53
boolmanmriedem: so I can't actually disable local disk? the user have to create a volume to use when creating the instance?11:53
*** vks1 has quit IRC11:53
mriedemdtantsur: i'm not sure that will work, i'd expect the PUT /resource_providers/uuid/inventories to fail to remove the inventory for the vcpu/memory_mb/disk_gb because it's already being used11:54
mriedemit would auto-create the custom resource class though,11:54
mriedemif that's your aim11:54
*** lucasagomes is now known as lucas-hungry11:54
dtantsurmriedem: it already fails at removing the inventory. I'm trying to fix auto-creation for now11:54
mriedemboolman: you could use the rbd imagebackend on the compute so your computes are shared a ceph pool of disk11:54
mriedemif you don't want local being used11:54
mriedem*sharing11:54
*** yamamoto has quit IRC11:55
mriedemdtantsur: yeah, this is just probably not the way to do this i don't think11:55
boolmanmriedem: you mean by modifying the pool in virsh?11:55
mriedemit's super tightly coupled to knowing exactly how the inventory is used by the RT and the report client11:55
mriedemboolman: see http://lists.openstack.org/pipermail/openstack-dev/2017-May/117012.html11:56
dtantsurmriedem: but isn't it the correct thing to do? I mean, always return the inventory of this custom resource class?11:56
*** yamamoto has joined #openstack-nova11:57
dtantsur(given that we will remove the hacks around VCPU and friends in Queens)11:57
mriedemsdague: docs migration annoyance of the day,11:57
mriedemwhen i search for things in the nova docs now, they search all of docs.o.o11:57
cdentdtantsur: the issue is that if there is already inventory in use that is based on vcpus, then you won’t be able to change the inventory11:57
mriedemnot just the nova docs11:57
dtantsurcdent: why should I?11:57
cdentas I read that code you are trying to replace existin inventory, but maybe I’m not understanding?11:58
dtantsurokay, we're trying to solve two problems at the same time:11:58
mriedemboolman: no i'm talking about this https://github.com/openstack/nova/blob/master/nova/conf/libvirt.py#L63111:58
dtantsur1. broken ironic scheduling with custom resource classes11:58
vdrokdtantsur: you mean something like http://paste.openstack.org/show/618161/11:58
vdrok?11:58
*** yuchenghui has quit IRC11:58
dtantsur2. warning on trying to delete the inventory, because we stop reporting it correctly11:58
dtantsurI'm trying to fix #1 first, as it's a hard blocker for this work11:58
mriedemhttps://github.com/openstack/nova/blob/master/nova/virt/libvirt/imagebackend.py#L78811:58
dtantsurvdrok: yes, see the DNM patch I posted above11:59
cdentokay, let’s dismiss #2 entirely for a moment11:59
boolmanmriedem: ok thanks, will try that11:59
vdrokdtantsur: ah, right, /me is slow :)11:59
dtantsurcdent: so, I think we all agree that our get_inventory is incorrect. We cannot fix it at once, because of the nature of bare metal nodes. we can fix reporting the custom resource class, and just wait for VCPU handling to be removed in Queens completely. Does it make more sense?12:00
cdentdtantsur: can’t you point me at some irc or test logs where the #1 problem is explained or demonstrated?12:00
mriedemcdent: that's in https://bugs.launchpad.net/nova/+bug/171014112:01
openstackLaunchpad bug 1710141 in OpenStack Compute (nova) "Continual warnings in n-cpu logs about being unable to delete inventory for an ironic node with an instance on it" [High,Triaged]12:01
cdentdtantsur: your dnm code is create an entire new inventory, with just the resource class set12:01
cdentthanks mriedem12:01
*** sapd has joined #openstack-nova12:01
dtantsurI think this bug is about #2, not #112:01
mriedemthey are related12:01
*** yuchenghui has joined #openstack-nova12:01
mriedemcdent: dtantsur has a patch up in ironic to set a custom resource class on the node and then create an instance on that node, but that's failing here http://logs.openstack.org/68/476968/12/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/02053cf/logs/screen-n-sch.txt.gz#_Aug_09_20_35_41_53362112:02
mriedemduring scheduling, because the custom resource class doesn't exist, and nova never creates it12:02
mriedemnova never gets inventory off the node12:02
mriedemdtantsur: that does confuse me though, are we racing?12:02
mriedemwouldn't nova-compute need to report the node before the scheduler could use it anyway?12:02
dtantsurmriedem: this is during a migration from resource_class=None to resource_class=something12:03
dtantsurso the resource class was never reported12:03
mriedemdtantsur: yeah but in that log ^ there was never an instance created yet i don't tihnk12:03
dtantsurok, so we have 3 problems :)12:03
cdent:)12:03
mriedembasically, when does the driver report that there are available nodes?12:03
mriedemb/c once it does, then we pull inventory from those nodes and put that in placement12:04
mriedemwhich the scheduler will use to create an instance12:04
dtantsurit polls ironic once in IIRC 2 minutes12:04
dtantsurso there is some space for a race indeed12:04
* dtantsur thinks of getting an etherpad with all the findings12:04
mriedembut how would this not fail all of the ironic ci jobs that use nova to create instances?12:04
aarefievdtantsur: but we report empty inventory, right  https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L74112:05
mriedemregardless of the resource class stuff12:05
dtantsurmriedem: we used to wait for 'nova hypervisor-stats' to show available CPUS > 012:05
mriedemdtantsur: and you're not now?12:05
*** egonzalez has joined #openstack-nova12:05
dtantsurmriedem: that patch tries not reporting VCPU any more12:05
dtantsurmaybe it's a bit premature12:06
mriedemok, so we don't wait for the compute node to be registered in nova-compute,12:06
mriedemand try to create the instance,12:06
mriedemand since we didn't wait, we don't have the resource class created yet12:06
mriedemand we NoValidHost12:06
mriedemlike a champ12:06
dtantsurright, maybe a wait loop until we get something in placement (hence my question about its CLI) solves it12:06
sdaguemriedem: yes, not just all of docs.o.o, also ask.o.o12:06
sdaguemriedem: that's definitely an issue12:07
*** ioggstream has quit IRC12:07
sdaguemriedem: going to have to be brought up at PTG I think12:07
cdentdtantsur: placement is so easy to curl that no one has bothered yet12:07
*** yuchenghui has quit IRC12:07
mriedemsdague: complaining in -doc12:07
mriedemcdent: there have been unmerged patches12:08
mriedemcdent: https://review.openstack.org/#/q/project:openstack/osc-placement12:08
cdentmriedem: yes, I know12:08
mriedemok12:08
cdenti’m one of the few reviewers on those patches, and mentioned them for several months on the rp update weekly messages and finally stopped when  no one was reviewing12:08
cdentbecause I assumed nobody cared12:08
mriedem:(12:08
*** thorst has joined #openstack-nova12:08
cdent:( is right12:08
mriedemonce we want to start integrating them into CI, people will care12:09
mriedemwell, dev people12:09
*** markvoelker_ has joined #openstack-nova12:10
cdentdtantsur, mriedem: so do you think you’ve gotten past at least a first hurdle with the conceptual wait loop? If so, once that’s cleared out, I’d like eventually to come back to this issue of reporting or not report inventory for nodes that have instances on them12:10
dtantsurfolks, I've dumped my/our findings on https://etherpad.openstack.org/p/nova-ironic-resource-class-migration12:10
dtantsurI cannot keep so much in my head :)12:10
cdentgood idea12:10
cdentif we merge this those silly html error responses (in the pastes there) will go away: https://review.openstack.org/#/c/489772/12:11
*** ratailor has quit IRC12:13
mriedemso like this http://logs.openstack.org/72/489772/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv/655a0b3/logs/screen-n-cpu.txt.gz?level=TRACE#_Aug_02_12_12_16_58494612:13
*** markvoelker has quit IRC12:13
cdentmriedem: yeah, no line feeds...12:14
*** dikonoor has quit IRC12:15
*** dikonoor has joined #openstack-nova12:16
*** phealy has joined #openstack-nova12:16
mriedemlike this http://logs.openstack.org/85/490085/7/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv/5835515/logs/screen-n-cpu.txt.gz?level=TRACE#_Aug_03_15_47_53_68369412:16
cdentright12:16
*** mwhahaha has quit IRC12:19
*** zioproto has quit IRC12:19
*** TheJulia has quit IRC12:19
*** betherly has quit IRC12:19
*** TheJulia has joined #openstack-nova12:19
*** gouthamr has joined #openstack-nova12:19
*** zioproto has joined #openstack-nova12:19
*** betherly has joined #openstack-nova12:20
*** mwhahaha has joined #openstack-nova12:20
*** gongysh has joined #openstack-nova12:20
*** gongysh has quit IRC12:20
*** clayton has quit IRC12:21
*** lpetrut has joined #openstack-nova12:22
*** rtjure has quit IRC12:23
*** efried is now known as fried_rice12:23
cdentdtantsur: so currently plan is is wait and see how https://review.openstack.org/#/c/476968/ turns out?12:23
*** clayton has joined #openstack-nova12:24
mriedemsdague: http://lists.openstack.org/pipermail/openstack-dev/2017-August/121042.html12:24
dtantsurcdent: this is the plan for #1. for #2 and #3, I can try fixing get_inventory indeed.12:24
*** dave-mccowan has joined #openstack-nova12:25
cdentdtantsur: let me know if there’s something I can help with12:25
dtantsursure, thanks!12:25
*** libin_ has quit IRC12:25
*** rtjure has joined #openstack-nova12:26
*** libin_ has joined #openstack-nova12:26
* bauzas back 12:26
*** baoli has quit IRC12:27
*** xyang1 has joined #openstack-nova12:29
openstackgerritOpenStack Release Bot proposed openstack/nova master: Update reno for stable/pike  https://review.openstack.org/49298212:29
*** catintheroof has joined #openstack-nova12:30
openstackgerritDmitry Tantsur proposed openstack/nova master: DNM PoC for fixing ironic with resource classes  https://review.openstack.org/49296412:32
dtantsurcdent: something like ^^^?12:32
dtantsurmriedem: ^^12:33
* cdent looks12:34
boolmanmriedem: ok I got it to work now, thanks12:34
*** gongysh has joined #openstack-nova12:35
*** lyan has joined #openstack-nova12:37
dtantsurvdrok: mind testing again with my patch above?12:37
cdentdtantsur: yes. Was there some additional thing to do to make sure that get_inventory gets called often enough? I’m guessing (giving the log messages) that that’s not a problem?12:38
vdrokdtantsur: ok, will do12:38
dtantsurcdent: I'm not sure, let's see how it looks for vdrok12:38
vdrokyeah, after instance deletion we'll have some time window when the resources reported by placement will be incorrect12:38
cdent12:38
*** kylek3h has joined #openstack-nova12:38
* cdent gazes in wide wonder at the miracle of rc112:40
sdaguemriedem: I'll see if I can hack around it12:40
dtantsuronce we get custom resource classes to work with ironic, we can ask operators to upgrade. then they won't see issues with VCPU reporting..12:41
*** mingyu has quit IRC12:43
cdentbiab12:44
*** cdent has quit IRC12:44
bauzasmriedem: dtantsur: could you please tl;dr the issues with ironic ?12:46
bauzasand how I could help ?12:46
bauzastons of channel logs :)12:47
*** ioggstream has joined #openstack-nova12:47
dtantsurbauzas: this is the tl;dr https://etherpad.openstack.org/p/nova-ironic-resource-class-migration12:48
bauzasexcellent, thanks12:48
*** ioggstream has quit IRC12:52
*** edleafe is now known as figleaf12:53
vdrokdtantsur: see comment12:54
vdrokright now requests to placement fail12:54
vdrokbecause of max_unit=012:54
*** jpena|off is now known as jpena12:54
dtantsurugh, right12:54
openstackgerritDmitry Tantsur proposed openstack/nova master: PoC for fixing ironic with resource classes  https://review.openstack.org/49296412:55
dtantsurvdrok: please try ^^^12:55
vdrokyup12:55
* dtantsur gets food, brb12:56
*** jaypipes has joined #openstack-nova12:57
*** ioggstream has joined #openstack-nova12:57
*** gbarros has joined #openstack-nova12:59
*** jaypipes has quit IRC13:00
*** jaypipes has joined #openstack-nova13:00
*** mpaolino has joined #openstack-nova13:03
*** lucas-hungry is now known as lucasagomes13:05
*** yangyapeng has joined #openstack-nova13:07
*** lyan has quit IRC13:07
*** MVenesio has joined #openstack-nova13:07
*** iogg has joined #openstack-nova13:08
*** ioggstream has quit IRC13:08
*** sbezverk has joined #openstack-nova13:10
vdrokdtantsur: mriedem with https://review.openstack.org/492964 seems to work fine http://paste.openstack.org/show/618171/13:10
vdrokwill now look at what's in the nova_api db13:10
*** dikonoo has joined #openstack-nova13:11
*** yangyapeng has quit IRC13:11
figleafwow, it usually takes me 5 minutes to read the overnight scrollback. Today it was more like 2013:13
*** egonzalez has quit IRC13:13
*** MVenesio has quit IRC13:13
*** MVenesio has joined #openstack-nova13:13
figleafso... anything I can pitch in and help with right now?13:14
*** josecastroleon has joined #openstack-nova13:15
*** dikonoor has quit IRC13:15
*** lyan has joined #openstack-nova13:15
mriedemvdrok: yeah i suppose that's why we get here now13:16
mriedemAug 11 13:07:03 ubuntu nova-compute[11924]: DEBUG nova.scheduler.client.report [None req-b88f01be-3920-4bc0-8708-b96b4f9e8aa7 None None] Updated inventory for 935678ef-67b2-440d-8190-875fb6dea1c6 at generation 3 {{(pid=11924) _update_inventory_attempt /opt/stack/nova/nova/scheduler/client/report.py:652}}13:16
mriedemfigleaf: https://etherpad.openstack.org/p/nova-ironic-resource-class-migration13:16
*** egonzalez has joined #openstack-nova13:16
vdrokdtantsur: mriedem what's in nova_api seems to be correct, instance_extra.flavor too, but see this http://paste.openstack.org/show/618173/13:16
figleafmriedem: yeah, got that open already13:16
vdroknamely, negative free values in compute_nodes13:16
mriedemvdrok: that might be a latent problem?13:16
mriedemi never look at hypervisor-stats, especially for ironic13:17
vdrokmriedem: might be yeah13:17
vdrokI'll try to boot another instance13:17
mriedemvdrok: https://bugs.launchpad.net/nova/+bug/1699947 ?13:17
openstackLaunchpad bug 1699947 in OpenStack Compute (nova) "nova hypervisor-stats/hypervisor-show shows wrong resource usage for baremetal node" [Low,Confirmed]13:17
vdrokyup, that is an old one :)13:17
*** mingyu has joined #openstack-nova13:18
*** baoli has joined #openstack-nova13:18
*** mingyu has quit IRC13:18
*** cdent has joined #openstack-nova13:18
*** randomhack has joined #openstack-nova13:18
vdrokok, scheduling seems to work fine too13:18
*** oanson has quit IRC13:19
*** mingyu has joined #openstack-nova13:19
*** mingyu has quit IRC13:19
*** oanson has joined #openstack-nova13:19
dtantsursweet! thanks for testing vdrok :)13:20
dtantsurso, what are the next steps? wait for the CI, check that the warning is gone, then write some unit tests and merge?13:21
*** lyan has quit IRC13:21
*** bhagyashris has quit IRC13:22
dtantsurmriedem: do you think it will still try to delete the allocation?13:23
*** randomhack has quit IRC13:23
*** randomhack has joined #openstack-nova13:23
openstackgerritMatt Riedemann proposed openstack/nova master: doc: add another up-call caveat for cells v2 for xenapi aggregates  https://review.openstack.org/49300613:25
openstackgerritMatt Riedemann proposed openstack/nova master: doc: add superconductor up-call caveat for cross_az_attach=False  https://review.openstack.org/49300713:25
mriedemdansmith: melwitt: ^ superconductor up-call limitations for the docs - i found another one today13:25
mriedemdtantsur: you mean the inventory?13:25
dtantsurmriedem: yes. sorry, tired already :)13:25
*** awaugama has joined #openstack-nova13:25
dtantsurFriday is not the best day to debug Nova :)13:26
mriedemdtantsur: no because inv_data will not be empty https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L77913:26
dtantsurmriedem: right, so the warning should be gone, no? we won't try to delete it, just update?13:26
mriedemdtantsur: i'd expect to get a 409 response from placement here https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L56613:27
mriedemdtantsur: plus, that doesn't really fix the bug that exists in ocata already, because your fix would only bypass the delete_inventory path iff there is a node.resource_class set13:27
mriedemdtantsur: in other words, i think there are two bugs13:27
dtantsurthe 4th problems \o/13:28
dtantsurshould I mark it as Related-Bug then?13:28
mriedemthe one i reported about the warnings is latent, and exists in ocata13:28
mriedemdtantsur: that would be ok probably13:28
mriedemi.e. in ocata, if i've got a baremetal env, i'm going to see these warnings in n-cpu every 60 seconds for all nodes13:28
mriedemfor all *consumed* nodes13:28
mriedemwhich is annoying13:28
dtantsurmriedem: wait, why? we no longer return an empty inventory for valid nodes. we return an inventory with s/vcpus/vcpus_used/. I think we can backport it to Ocata even13:29
* dtantsur sees jaypipes lurking13:30
dtantsurjaypipes: hi, you may want to join the party :)13:30
mriedemoh i see13:30
mriedemi hadn't seen the latest patch https://review.openstack.org/#/c/492964/3/nova/virt/ironic/driver.py13:30
*** udesale has joined #openstack-nova13:30
dtantsurah!13:30
jaypipesdtantsur: what kind of party? ;)13:30
dtantsurjaypipes: an ironic party!13:30
*** jaypipes is now known as leakypipes13:30
dtantsurleakypipes: https://etherpad.openstack.org/p/nova-ironic-resource-class-migration13:31
mriedemdtantsur: yeah that might just work13:32
dtantsurokay, let's wait for Jenkins13:32
*** esberglu has joined #openstack-nova13:33
mriedemok so the *_used values for inventory will/should match in placement what we have consumed for allocations on that node provider13:34
mriedemso we shouldn't try to remove any inventory, and thus avoid the 409,13:34
mriedemand create the custom resource class when it's added to the node,13:34
cdentthat’s the hoe13:34
mriedemand take the node out of scheduling decisions since inventory == allocation13:34
cdenthope13:34
*** suresh12 has joined #openstack-nova13:34
mriedemwho you callin a ho13:34
mriedem?!13:34
dtantsurLOOOL13:34
cdenthoe for capitalism13:35
dtantsurbut yeah, this is the plan13:35
*** vladikr has quit IRC13:36
*** suresh12 has quit IRC13:40
*** diga_ has quit IRC13:41
cdentgibi is an evolved tool user. on https://review.openstack.org/#/c/491529/ are you saying you think you found a bug in shelve/unshelve itself, or in the tests?13:42
*** weshay is now known as weshay_doc13:43
*** hongbin has joined #openstack-nova13:44
* dtantsur wonders why "tox -epy27 -- -r ironic" does not work for nova..13:44
cdentdtantsur: because it has been shortcutted: tox -epy27 ironic13:44
gibicdent: I think it is in the shelve/unshelve13:45
gibicdent: but I'm still busy with the evacuation fix13:45
cdentgibi: go you. your powers are strong.13:45
dtantsurawesome, thanks cdent13:45
gibicdent: after I pushed the evac fix I can create a shelve/unshelve test13:46
* cdent writes a short rp update 13:46
*** takedakn has joined #openstack-nova13:46
cdentthere’s loads of random code floating around13:46
*** jmlowe_ has joined #openstack-nova13:47
*** jpena is now known as jpena|off13:48
*** jmlowe has quit IRC13:49
mriedemafk for a bit13:49
*** lyan has joined #openstack-nova13:49
*** lyan has quit IRC13:51
*** _pewp_ has quit IRC13:52
*** markvoelker_ has quit IRC13:52
*** suresh12 has joined #openstack-nova13:53
*** lucasxu has joined #openstack-nova13:54
*** felipemonteiro has joined #openstack-nova13:55
*** _pewp_ has joined #openstack-nova13:55
*** Oku_OS is now known as Oku_OS-away13:56
*** randomhack has quit IRC14:00
*** lyan has joined #openstack-nova14:03
*** trinaths has joined #openstack-nova14:03
*** mvk_ has joined #openstack-nova14:06
*** pchavva has joined #openstack-nova14:07
*** yangyapeng has joined #openstack-nova14:08
*** mvk has quit IRC14:08
*** yangyapeng has quit IRC14:12
openstackgerritDmitry Tantsur proposed openstack/nova master: Fix reporting inventory for the Ironic driver  https://review.openstack.org/49296414:12
dtantsurcdent, mriedem, bauzas, cleaned up version of my patch ^^^14:12
* cdent reads14:12
dtantsuraaaaand the patch using resource classes has passed CI: https://review.openstack.org/#/c/476968/14:13
dtantsurbauzas: you may want to check it for logging ^^^14:13
* cdent recommends today’s google doodle as a nice break from today’s chaos14:17
*** sambetts is now known as sambetts|afk14:21
*** psachin has quit IRC14:24
openstackgerritEric Fried proposed openstack/nova master: Use ksa adapter for placement conf & requests  https://review.openstack.org/49224714:25
*** mdavidson has quit IRC14:26
bauzasdtantsur: cdent: mriedem: sorry in an internal meeting atm14:26
bauzassdague: I could have a stupid question but worth asking14:27
bauzassdague: if someone reports an issue only appearing with an old microversion, I guess we still have to fix it ?14:27
bauzassdague: the context being that if using a recent microversion, the flag that was creating that bug is no longer supported14:28
sdaguebauzas: it depends14:29
dansmithmriedem: is the az not available to compute via the requestspec or something like that?14:29
dansmithmriedem: if not, that would be a simpler fix than the moving of things to conductor14:29
sdaguebauzas: can you be more specific with the bug14:29
*** Drankis has quit IRC14:30
bauzassdague: related point, while novaclient tries to use the latest microversion the server can support (capped by its own max version), it seems OSC just tries to use v2.114:30
bauzassdague: that's an internal BZ that was popped up14:30
sdagueyes, osc does work differently14:30
*** armax has joined #openstack-nova14:31
sdagueI don't know the current status of osc microversion support14:31
bauzassdague: but tl,dr: since 2.25 we are now no longer accepting disk_over_commit, which is generating some HTTP400 if you use it with older versions14:31
*** takedakn has quit IRC14:32
leakypipesdansmith: I thought you were vacationing, superdan? :)14:32
sdaguebauzas: you are really going to have to get a bug filed14:32
dansmithleakypipes: inlaw visits are not vacation14:32
leakypipesah14:32
leakypipestru nuf14:32
bauzassdague: yeah will do14:32
sdaguebecause is that a regression?14:33
bauzassdague: but needs to check the internal bug with novaclient first14:33
bauzassdague: that's a mitaka bug from waht I know14:33
bauzassdague: but I need to do more coverage before filling the buig14:33
*** itlinux has joined #openstack-nova14:34
dansmithmriedem: +2 on both of those doc patches14:34
sdagueyeh, I mean, clearly mitaka is no longer upstream supported, so there is that. But the point is if there is a regression, a regression should be fixed. But if it was always that way, and new microversions make it fine, I'd err on the side that we don't touch it14:34
* dansmith feels like he made himself useful14:34
*** mdavidson has joined #openstack-nova14:35
*** udesale has quit IRC14:37
*** vks1 has joined #openstack-nova14:38
cfriesendoes anyone know if libvirt/qemu supports block live migration with a config drive but with instance storage on a ceph volume?14:41
bauzassdague: sure, that's why I need to do further tests against master before filling the bug14:43
*** coreywright_ has quit IRC14:44
*** yangyapeng has joined #openstack-nova14:44
*** kristian__ has quit IRC14:46
mriedemdansmith: during boot from volume it might be14:48
mriedembut,14:48
mriedemnot really sure, as the az for the host wouldn't be known until we know the host, and i don't know if we update the request spec after that14:49
mriedemthat's a bauzas question14:49
mriedemdansmith: btw, good morning sleepy head!14:49
*** zhouyaguo has joined #openstack-nova14:51
cfriesenquestion....if a compute node is using RBD for instance disks, would we expect it to use RBD for the config drive as well?14:53
*** crushil has joined #openstack-nova14:54
*** sbezverk has quit IRC14:54
*** felipemonteiro_ has joined #openstack-nova14:55
*** felipemonteiro has quit IRC14:55
*** sbezverk has joined #openstack-nova14:55
*** rcernin has quit IRC14:57
*** coreywright_ has joined #openstack-nova14:57
dansmithmriedem: lol14:58
*** thingee_ has joined #openstack-nova14:58
leakypipescfriesen: I don't think so. I think config drives are always iso9660, no? and local to the compute node?14:58
dansmithleakypipes: no14:58
dansmithleakypipes: can be vfat14:58
leakypipesdansmith: no?14:58
leakypipesah14:58
dansmithand can also be on ceph I think14:58
leakypipesoh, well, cfriesen I don't know anything then :)14:58
* leakypipes slinks away, suitably humbled.14:59
dansmithI just came here to humble leakypipes14:59
leakypipesMission Accomplished. :P14:59
fried_ricemtreinish About to restack - any update?15:00
*** dikonoo has quit IRC15:02
mriedemdansmith: leakypipes: don't forget the config drive can be on scaleio and is then 8GB15:04
dansmithmriedem: right that's how I know :)15:04
mtreinishfried_rice: not really, I'm still hitting the same issue15:04
bauzasmriedem: dansmith: in a meeting atm, how can I help ?15:04
mtreinishfried_rice: I've got another devstack setup locally and I'm trying different config permutations. I feel like I've gone back 2 months because I was debugging the same thing back when we originally added glance support15:05
fried_ricemtreinish You're not needing to restack every time, right?  Just muck with some confs, restart some services, and try the image create again?15:06
openstackgerritBalazs Gibizer proposed openstack/nova master: test server evacuation with placement  https://review.openstack.org/49254815:06
openstackgerritBalazs Gibizer proposed openstack/nova master: delete allocation of evacuated instance  https://review.openstack.org/49303715:06
mtreinishfried_rice: yeah15:07
fried_ricecool15:07
fried_ricemtreinish Let me know if there's anything I can do to help.15:07
*** claudiub has joined #openstack-nova15:09
*** mpaolino has quit IRC15:09
*** bswartz has joined #openstack-nova15:09
mtreinishfried_rice: well I at least figured out why I thought it worked before. The config I have up there now drops the chunked data on the floor. (when you talk to uwsgi directly instead of going through the proxy)15:12
mtreinishso the request gets a good response, but the data isn't actually used15:13
fried_ricemtreinish Hah, so I would get a zero-size image, or better yet, a full-sized image full of zeros?15:13
mtreinishheh, it's a zero size image15:13
mtreinishI think the 502s from apache are it realizes the request isn't being properly handled and bails out15:14
*** annegentle has joined #openstack-nova15:14
*** Dinesh_Bhor has quit IRC15:15
*** dklyle has joined #openstack-nova15:15
*** david-lyle has quit IRC15:15
openstackgerritGhanshyam Mann proposed openstack/nova master: Update api doc with latest updates in api framework  https://review.openstack.org/49304115:18
vdroksdague: mriedem could you also take a look at https://review.openstack.org/492579 if you have a bit of time? This is fixing https://bugs.launchpad.net/nova/ocata/+bug/1706772 we are seeing sometimes on the ocata grenade job, as placement start triggers reload of apache, so keystone becomes inaccessible and n-cpu fails to start15:21
openstackLaunchpad bug 1706772 in OpenStack Compute (nova) ocata "InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver" [Medium,In progress] - Assigned to Matt Riedemann (mriedem)15:21
*** karthiks has quit IRC15:23
*** mvk has joined #openstack-nova15:24
openstackgerritMerged openstack/nova master: Deprecate bare metal filters  https://review.openstack.org/49256315:24
sdaguevdrok: ok, as a backport15:25
*** mvk_ has quit IRC15:25
vdroksdague: yup, thanks!15:26
*** jaosorior has quit IRC15:27
openstackgerritMerged openstack/nova master: Update reno for stable/pike  https://review.openstack.org/49298215:27
*** baoli has quit IRC15:28
*** dikonoo has joined #openstack-nova15:29
*** mvk has quit IRC15:29
*** mvk has joined #openstack-nova15:29
*** gyee has joined #openstack-nova15:30
*** baoli has joined #openstack-nova15:30
dtantsurmriedem: can/should I request a backport for https://review.openstack.org/492563 now?15:33
*** dikonoo has quit IRC15:33
*** ociuhandu has joined #openstack-nova15:34
bauzasfolks, time to hang up for a couple of weeks15:36
cdentenjoy the time bauzas15:36
bauzasgentle reminder, I'll be back on 31st of August15:36
figleafbauzas: thanks for helping with https://review.openstack.org/487954 overnight15:36
dtantsurbauzas: enjoy!15:36
figleafbauzas: and have a great holiday!15:36
*** chyka has joined #openstack-nova15:37
bauzasfigleaf: dtantsur: cdent: appreciated, both your warm comments and your help during that very difficult release15:37
bauzassee ya15:37
*** bauzas is now known as bauzas_afk15:37
bauzas_afkfigleaf: uh, actually, thanks for the reminder, will remove my -W now15:38
*** sahid has quit IRC15:39
*** chyka_ has joined #openstack-nova15:41
*** dikonoo has joined #openstack-nova15:42
figleafbauzas_afk: thx15:42
*** chyka has quit IRC15:43
*** chyka has joined #openstack-nova15:45
*** itlinux has quit IRC15:46
*** chyka_ has quit IRC15:46
*** aarefiev is now known as aarefiev_afk15:47
*** dtp has joined #openstack-nova15:48
openstackgerritMerged openstack/nova master: doc: add another up-call caveat for cells v2 for xenapi aggregates  https://review.openstack.org/49300615:49
openstackgerritMerged openstack/nova master: doc: add superconductor up-call caveat for cross_az_attach=False  https://review.openstack.org/49300715:50
mriedemdtantsur: to stable/pike?15:51
dtantsurmriedem: yeah15:51
mriedemum, idk15:51
mriedemdidn't realize that merged15:52
dtantsurthe problem is that these filters will be unusable with ironic in Queens15:52
dtantsurso deprecating them in Pike is IMO fair15:53
dtantsurI've proposed the backport in https://review.openstack.org/#/c/493052/ and will leave it up to you15:53
mriedemdtantsur: i see in the ironic release notes that resource_class can't be changed on an active node https://docs.openstack.org/releasenotes/ironic/unreleased.html15:54
mriedembut don't see anything saying resource_class is required15:54
dtantsurmriedem: it's on the way: https://review.openstack.org/49177315:55
mriedemand wouldn't setting a resource_class be required for compute scheduling? or maybe that's just a requirement on the nova side, and not for standalone ironic15:55
mriedemah15:55
*** suresh12 has quit IRC15:57
*** Apoorva has joined #openstack-nova15:58
*** yassine has quit IRC15:58
*** dikonoo has quit IRC15:59
*** yassine has joined #openstack-nova16:01
*** tbachman has quit IRC16:01
openstackgerritGhanshyam Mann proposed openstack/nova master: Update api doc with latest updates in api framework  https://review.openstack.org/49304116:01
openstackgerritBalazs Gibizer proposed openstack/nova master: test shelve and shelve offload with placement  https://review.openstack.org/49306216:04
*** armax has quit IRC16:04
*** sbezverk has quit IRC16:05
gibicdent: bug for the shelve offload problem: https://bugs.launchpad.net/nova/+bug/171024916:06
openstackLaunchpad bug 1710249 in OpenStack Compute (nova) "nova doesn't clean up the resources after shelve offload" [Undecided,New]16:06
gibicdent: also pushed a regression test for it https://review.openstack.org/#/c/493062/16:06
* cdent wants whatever gibi is taking16:06
*** lucasxu has quit IRC16:07
gibicdent: just regular caffeine :)16:07
gibibut now it is time to leave for the weekend. See you on Monday16:08
* cdent waveas16:08
* gibi waves back16:09
*** sridharg has quit IRC16:09
*** ociuhandu has quit IRC16:10
*** egonzalez has quit IRC16:12
*** dikonoo has joined #openstack-nova16:17
*** lpetrut has quit IRC16:18
*** gongysh has quit IRC16:19
*** dtantsur is now known as dtantsur|afk16:20
*** markvoelker has joined #openstack-nova16:25
openstackgerritRodolfo Alonso Hernandez proposed openstack/os-vif master: Add ``HostPortProfileInfo`` class  https://review.openstack.org/44159016:27
mriedemsdague: i'm going to grind through stable branch reviews today before i'm out for a week, can you hit this series? https://review.openstack.org/#/q/topic:bug/1686116+branch:stable/ocata16:28
*** tbachman has joined #openstack-nova16:29
*** lyan has quit IRC16:29
*** amotoki is now known as amotoki__away16:30
mriedemanother stable/ocata one that needs another stable core to push through https://review.openstack.org/#/c/475902/16:32
mriedemclaudiub: ^?16:32
*** itlinux has joined #openstack-nova16:33
*** jogo has quit IRC16:34
*** jmlowe_ has quit IRC16:34
*** derekh has quit IRC16:35
mriedemanother one that needs final +2 https://review.openstack.org/#/q/topic:bug/1607714+branch:stable/ocata16:35
*** tbachman has quit IRC16:36
*** psachin has joined #openstack-nova16:36
*** tbachman has joined #openstack-nova16:38
*** iogg has quit IRC16:38
*** tesseract has quit IRC16:41
*** lucasagomes is now known as lucas-afk16:41
openstackgerritMatt Riedemann proposed openstack/nova master: Skip test_rebuild_server_in_error_state for cells v1  https://review.openstack.org/49307616:43
*** dklyle has quit IRC16:44
*** dklyle has joined #openstack-nova16:45
*** egonzalez has joined #openstack-nova16:46
*** rajathagasthya has joined #openstack-nova16:46
*** trinaths has left #openstack-nova16:46
openstackgerritGhanshyam Mann proposed openstack/nova master: Update api doc with latest updates in api framework  https://review.openstack.org/49304116:50
mriedemcdent: fun catch on that one https://review.openstack.org/#/c/492477/16:52
mriedemwould be a reasonable thing if they changed it into a policy rule16:52
mriedemand did it on master16:53
cdentmriedem: I’m guess they just don’t know the process16:53
mriedemyeah probably not16:53
mriedemhttps://docs.openstack.org/project-team-guide/stable-branches.html#appropriate-fixes huzzah16:54
mriedemi'll link that in there16:54
openstackgerritRodolfo Alonso Hernandez proposed openstack/os-vif master: Add __str__ method to Host* objects  https://review.openstack.org/49308216:54
*** vks1 has quit IRC16:55
*** jmlowe has joined #openstack-nova16:56
*** suresh12 has joined #openstack-nova16:58
*** jogo has joined #openstack-nova16:59
*** markvoelker has quit IRC16:59
*** markus_z has quit IRC17:00
*** Apoorva_ has joined #openstack-nova17:01
*** mdrabe is now known as mdrabe_afk17:02
*** Apoorva has quit IRC17:04
*** cdent has quit IRC17:08
*** psachin has quit IRC17:08
gmannmriedem: sdague alex_xu can you check this. API doc updated with new routing things  -https://review.openstack.org/#/c/493041/17:10
mriedemi think oomichi said he wanted to review that17:10
mriedemas my proxy17:11
gmannafter this i will merge api_v2.rst into api.rst17:11
*** lyan has joined #openstack-nova17:12
*** lyan has quit IRC17:12
*** felipemonteiro_ has quit IRC17:14
*** lyan has joined #openstack-nova17:15
*** lyan has quit IRC17:16
*** mvk has quit IRC17:17
*** lyan has joined #openstack-nova17:17
*** lyan has quit IRC17:18
*** dikonoor has joined #openstack-nova17:21
*** dikonoo has quit IRC17:24
*** lyan has joined #openstack-nova17:28
*** annegentle has quit IRC17:33
*** simondodsley has joined #openstack-nova17:33
*** pchavva has quit IRC17:35
*** tosika has quit IRC17:37
*** gjayavelu has joined #openstack-nova17:37
*** Swami has joined #openstack-nova17:38
*** crushil has quit IRC17:39
*** yamamoto has quit IRC17:43
*** ralonsoh has quit IRC17:45
*** yamahata has quit IRC17:53
*** markvoelker has joined #openstack-nova17:55
*** egonzalez has quit IRC17:56
*** Apoorva_ has quit IRC18:03
*** crushil has joined #openstack-nova18:03
*** Apoorva has joined #openstack-nova18:03
*** egonzalez has joined #openstack-nova18:04
*** gbarros has quit IRC18:05
*** annegentle has joined #openstack-nova18:05
*** trinaths has joined #openstack-nova18:05
*** thingee_ has quit IRC18:07
*** egonzalez has quit IRC18:08
*** esberglu has quit IRC18:16
*** esberglu has joined #openstack-nova18:16
*** sdague has quit IRC18:17
*** sdague has joined #openstack-nova18:17
*** esberglu has quit IRC18:21
*** tosika has joined #openstack-nova18:22
*** inara has quit IRC18:23
*** yamahata has joined #openstack-nova18:25
*** inara has joined #openstack-nova18:25
*** priteau has joined #openstack-nova18:25
*** gmann has quit IRC18:25
*** markvoelker has quit IRC18:29
*** baoli has quit IRC18:30
*** lyan has quit IRC18:30
*** lyan has joined #openstack-nova18:31
*** baoli has joined #openstack-nova18:31
*** gjayavelu has quit IRC18:41
*** Sukhdev has joined #openstack-nova18:43
*** nicolasbock has quit IRC18:43
*** yamamoto has joined #openstack-nova18:44
*** kylek3h has quit IRC18:48
*** yamamoto has quit IRC18:49
*** annabelleB has joined #openstack-nova18:51
annabelleBhey Nova team—Anne Bertucio from the Foundation here. We’re trying to confirm some features that the Community Roadmap team had highlighted for Pike. Did the allowing multiple cells v2 feature land in Pike?18:52
*** mdrabe_afk is now known as mdrabe18:58
*** annegentle has quit IRC19:00
mriedemannabelleB: i need to get back to your email don't i :)19:02
*** dtp has quit IRC19:02
mriedemannabelleB: the prelude to the pike rc1 release notes has the major stuff https://docs.openstack.org/releasenotes/nova/pike.html19:02
mriedemmulti-cell support landed but with caveats19:02
mriedemdocumented here https://docs.openstack.org/nova/latest/user/cellsv2_layout.html#caveats-of-a-multi-cell-deployment19:03
annabelleBmriedem: hehe, there was a lot of excitement around this, so wanted to make sure I got it in :)19:03
annabelleBmriedem: perfect; I’ll read that! thank you!19:03
*** crushil has quit IRC19:04
mriedemplacement is a more confusing and less well documented story probably19:04
*** crushil has joined #openstack-nova19:12
*** annegentle has joined #openstack-nova19:17
*** avolkov has quit IRC19:21
*** lpetrut has joined #openstack-nova19:25
*** markvoelker has joined #openstack-nova19:27
*** trinaths has quit IRC19:32
*** Apoorva has quit IRC19:32
sdaguemriedem: I'm going to drop off before too long, anything else you need me to look at or do before then?19:34
mriedemi've just been going through stable/newton now19:36
mriedemthere are several ready for +W19:36
mriedemhttps://review.openstack.org/#/q/status:open+project:openstack/nova+branch:stable/newton19:36
*** suresh12 has quit IRC19:37
*** adisky__ has quit IRC19:39
*** tbachman has quit IRC19:40
*** baoli has quit IRC19:41
*** fried_rice has quit IRC19:41
*** baoli has joined #openstack-nova19:41
sdaguemriedem: https://review.openstack.org/#/c/487536/ doesn't really hurt anything to bring it back19:42
*** baoli has quit IRC19:42
mriedemit's specifically for another change that needs to be put on top of it19:42
mriedemwhich still needs work in ocata19:42
mriedemi didn't -1 it, just no reason to merge it yet19:42
sdagueyeh, it just seems fine to merge it as it doesn't hurt anything, and just makes other fixes potentially easier to pull back19:43
*** baoli has joined #openstack-nova19:43
sdaguehttps://review.openstack.org/#/c/470347 and stack seems pretty extensive for newton19:45
mriedemit wasn't 6 months ago19:45
mriedemwell,19:45
mriedemso that's for re-enabling a tempest test19:46
sdaguejun 219:46
mriedemhttps://review.openstack.org/#/c/349011/19:46
sdagueok19:46
mriedemyeah, i started backporting that to newton once it was fixed in ocata and passing https://review.openstack.org/#/c/349011/19:46
mriedemso we can't do https://review.openstack.org/#/c/349011/ w/o it being fixed in all branches19:46
*** yamamoto has joined #openstack-nova19:46
sdagueah19:47
sdagueok, I guess you sold me19:47
mriedemyeah, been working on that since i was at ibm public cloud :)19:47
mriedemwhich was last summer19:47
sdagueheh19:49
*** egonzalez has joined #openstack-nova19:51
*** fried_rice has joined #openstack-nova19:53
*** yamamoto has quit IRC19:55
*** dtp has joined #openstack-nova19:58
*** markvoelker has quit IRC19:59
*** lpetrut has quit IRC20:01
*** lpetrut has joined #openstack-nova20:02
*** priteau has quit IRC20:06
*** tbachman has joined #openstack-nova20:08
*** suresh12 has joined #openstack-nova20:13
*** gouthamr has quit IRC20:14
*** MVenesio has quit IRC20:14
*** slagle has quit IRC20:15
*** suresh12 has quit IRC20:15
*** suresh12 has joined #openstack-nova20:15
*** catintheroof has quit IRC20:15
*** Apoorva has joined #openstack-nova20:16
*** suresh12_ has joined #openstack-nova20:17
*** suresh12 has quit IRC20:17
*** suresh12_ has quit IRC20:17
mriedemvdrok: do we have a good ci run for ironic + resource classes with https://review.openstack.org/#/c/492964/ ?20:18
vdrokmriedem: not sure if dtantsur|afk made a test patch with depends on. Can do in ~an hour when I get to keyboard20:21
*** annabelleB has quit IRC20:22
mriedemi think it's probably https://review.openstack.org/#/c/476968/ ?20:27
*** annabelleB has joined #openstack-nova20:28
*** tbachman_ has joined #openstack-nova20:28
*** tbachman has quit IRC20:30
*** tbachman_ is now known as tbachman20:30
openstackgerritMatt Riedemann proposed openstack/nova master: DNM: Add more logging + hook devstack  https://review.openstack.org/49295720:30
mriedemvdrok: fyi i think ^ will hit the entire thing20:30
mriedemthe flavor migration + dtantsur|afk's inventory fix + the ironic+devstack changes to use resource classes20:31
vdrokmriedem: yes, but the actual flavor migration won't happen, as we can only see it in grenade I think20:32
*** gouthamr has joined #openstack-nova20:32
mriedemah because the node doesn't have the resource_class set to migrate20:32
*** suresh12 has joined #openstack-nova20:33
vdrokmriedem: Ive done this one I1ac1b8501cbed901941e7c89fc55c5b9bea0cb4f but it does not seem to work yet20:33
oomichitoabctl: commented on https://review.openstack.org/#/c/39830820:33
vdrokmriedem: with that, we'd have one instance created by Nova in resource create phase, and we'd update it's resource class20:34
vdrok*Its node's class20:34
mriedemok i've approved the flavor migration patch anyway20:35
mriedemi think you guys have shown we're good there20:35
vdrokThanks!20:35
mriedemthe remaining issue was the scheduling piece with the custom resource class missing, which is dtantsur|afk's patch20:35
figleaf\o/20:36
*** weshay_doc is now known as weshay20:39
openstackgerritMatt Riedemann proposed openstack/nova master: Handle addition of new nodes/instances in ironic flavor migration  https://review.openstack.org/48795420:42
mriedemwhoa wt20:43
mriedemoh gdi20:43
mriedemwe don't have git review setup yet20:43
mriedemon stable/pike20:43
*** jmlowe has quit IRC20:45
openstackgerritMatt Riedemann proposed openstack/nova master: Handle addition of new nodes/instances in ironic flavor migration  https://review.openstack.org/48795420:45
*** avolkov has joined #openstack-nova20:46
*** itlinux has quit IRC20:46
*** annegentle has quit IRC20:47
*** jmlowe has joined #openstack-nova20:47
*** awaugama has quit IRC20:48
mriedemok here we go https://review.openstack.org/#/c/493227/20:49
*** dikonoor has quit IRC20:51
*** thorst has quit IRC20:52
*** baoli has quit IRC20:52
sdaguemriedem: I approved the patch, it just hasn't landed yet20:54
sdaguehttps://review.openstack.org/#/c/492980/20:55
*** tosika has quit IRC20:55
*** jmlowe has quit IRC20:56
*** markvoelker has joined #openstack-nova20:56
mriedemyup20:56
mriedemi backported on top of that series20:56
*** gjayavelu has joined #openstack-nova20:59
mriedemok i've sent the todo list to dansmith publicly in the ML20:59
mriedemi will now retire with a bag of chips to my basement to prepare for vacation21:00
*** Apoorva_ has joined #openstack-nova21:00
*** rajathagasthya has quit IRC21:00
*** edmondsw has quit IRC21:01
*** jistr is now known as jistr|off21:02
*** gyee has quit IRC21:02
*** rajathagasthya has joined #openstack-nova21:02
*** Apoorva has quit IRC21:04
sdagueheh21:04
sdaguemriedem: go find yourself a saspirila21:04
mriedemi do have a bottle of fancy root beer in the fridge21:05
*** crushil has quit IRC21:06
*** egonzalez has quit IRC21:11
*** dave-mccowan has quit IRC21:12
mriedemmelwitt: can you hit the two bottom changes here? https://review.openstack.org/#/c/450105/ - just small placement api-ref changes, then we'll have the job running21:13
melwittmriedem: sure thing21:13
mriedemthanks21:13
*** crushil has joined #openstack-nova21:14
*** rajathagasthya has quit IRC21:15
*** priteau has joined #openstack-nova21:21
*** priteau has quit IRC21:24
*** gyee has joined #openstack-nova21:29
*** markvoelker has quit IRC21:30
*** MVenesio has joined #openstack-nova21:33
openstackgerritEric Fried proposed openstack/nova master: Use ksa adapter for placement conf & requests  https://review.openstack.org/49224721:33
openstackgerritEric Fried proposed openstack/nova master: nova.utils.get_ksa_adapter()  https://review.openstack.org/48813721:33
*** rajathagasthya has joined #openstack-nova21:34
*** Apoorva_ has quit IRC21:38
*** Apoorva has joined #openstack-nova21:38
*** thorst has joined #openstack-nova21:44
*** thorst has quit IRC21:48
mtreinishfried_rice: I pushed a new rev on: https://review.openstack.org/#/c/492651/3 which now has a depends on for: https://review.openstack.org/#/c/493231/221:48
mtreinishif you wanted to give it a try21:49
fried_ricemtreinish Ack, looking...21:49
fried_ricemtreinish I have a nice stable (mod_wsgi) stack at the moment, so...21:49
mtreinishfried_rice: hmm, well if you don't want to rock the boat. I'm still testing things locally21:51
fried_ricergr21:51
fried_ricemtreinish Storing the whole image in memory... doesn't sound like it'll fly.21:51
mtreinishit definitely works when I talk to the uwsgi server directly, but it looks like the apache config still needs some tweaking because I'm getting a 502 going through the proxy21:52
fried_ricemtreinish Here's where it would be nice to be able to use a fifo, where glance can suck it down in parallel with the send.21:52
fried_ricemtreinish swhat we do in the powervm driver when populating a boot disk *from* glance.21:53
mtreinishyeah, I'm still trying to figure out the best way to handle that. I was just basing that middleware on what I found in the eventlet code21:53
mtreinishand I still ahven't figured out how eventlet is doing it21:54
*** xyang1 has quit IRC21:54
mtreinishfried_rice: the trick here is to make the data look like what webob is expecting after calling uwsgi.chunked_read() but not putting it all in memory21:54
fried_ricemtreinish Can you point me to the source for chunked_read?21:55
*** annegentle has joined #openstack-nova21:55
mtreinishsure, one sec21:55
fried_riceCould it be this? https://github.com/unbit/uwsgi/blob/master/core/chunked.c#L8621:56
mtreinishyeah that's the inner c function21:57
mtreinishthe python interface is defined here: https://github.com/unbit/uwsgi/blob/master/plugins/python/uwsgi_pymodule.c#L1185-L120021:57
*** markvoelker has joined #openstack-nova22:10
*** gbarros has joined #openstack-nova22:12
*** lbragstad has quit IRC22:17
*** MVenesio_ has joined #openstack-nova22:18
*** figleaf is now known as edleafe22:20
*** MVenesio has quit IRC22:22
*** lpetrut has quit IRC22:23
*** cfriesen has quit IRC22:27
*** cfriesen has joined #openstack-nova22:27
*** cfriesen has quit IRC22:31
*** dtp has quit IRC22:33
*** markvoelker has quit IRC22:33
*** avolkov has quit IRC22:37
*** annegentle has quit IRC22:50
*** MVenesio_ has quit IRC22:51
fried_ricesdague / leakypipes still around?23:03
*** claudiub has quit IRC23:04
*** Sukhdev has quit IRC23:04
*** sdague has quit IRC23:09
*** annabelleB has quit IRC23:12
*** hongbin has quit IRC23:12
*** lyan has quit IRC23:13
*** esberglu has joined #openstack-nova23:17
*** clayton has quit IRC23:18
*** clayton has joined #openstack-nova23:18
*** krtaylor has quit IRC23:21
*** esberglu has quit IRC23:21
*** suresh12_ has joined #openstack-nova23:24
*** suresh12 has quit IRC23:28
*** rajathagasthya has quit IRC23:32
*** zzzeek has quit IRC23:43
*** zzzeek has joined #openstack-nova23:44
*** Apoorva_ has joined #openstack-nova23:50
*** Apoorva has quit IRC23:54
*** suresh12_ has quit IRC23:54
*** Apoorva_ has quit IRC23:55
*** baoli has joined #openstack-nova23:57
*** chyka has quit IRC23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!