Wednesday, 2019-05-15

*** dklyle has joined #openstack-placement00:30
*** mriedem has quit IRC00:41
*** bhagyashris has joined #openstack-placement00:58
*** ttsiouts has joined #openstack-placement01:29
*** tetsuro has joined #openstack-placement01:49
openstackgerritTetsuro Nakamura proposed openstack/placement stable/stein: Skip _exclude_nested_providers() if not nested  https://review.opendev.org/65920002:00
*** ttsiouts has quit IRC02:02
*** tetsuro_ has joined #openstack-placement02:37
*** tetsuro has quit IRC02:39
*** tetsuro has joined #openstack-placement02:42
*** tetsuro_ has quit IRC02:46
*** tetsuro has quit IRC03:50
*** tetsuro has joined #openstack-placement03:52
*** alex_xu has joined #openstack-placement03:53
*** ttsiouts has joined #openstack-placement03:59
*** ttsiouts has quit IRC04:31
*** tetsuro has quit IRC04:37
*** e0ne has joined #openstack-placement05:05
*** e0ne has quit IRC05:08
*** alex_xu has quit IRC05:26
*** ttsiouts has joined #openstack-placement06:29
*** e0ne has joined #openstack-placement06:35
*** alex_xu has joined #openstack-placement06:53
*** ttsiouts has quit IRC07:02
*** alex_xu has quit IRC07:05
*** alex_xu has joined #openstack-placement07:06
*** tssurya has joined #openstack-placement07:07
*** helenafm has joined #openstack-placement07:18
*** ttsiouts has joined #openstack-placement07:30
*** ttsiouts has quit IRC08:34
*** bhagyashris has quit IRC09:56
*** ttsiouts has joined #openstack-placement10:31
*** ttsiouts has quit IRC11:04
*** cdent has joined #openstack-placement12:16
*** mriedem has joined #openstack-placement12:23
tssuryacdent: around ?12:49
cdentyes, hello12:49
tssuryaremember http://lists.openstack.org/pipermail/openstack-discuss/2019-May/005897.html ?12:49
tssuryawe talked about making the consumer type "unknown" or something by default12:50
tssuryain the consumers table12:50
* cdent nods12:50
tssuryawhen I was updateing the spec I realaised the way placement usually maps coulmns is through ids12:50
tssuryaso what I was initially proposing was that the consumer_type_id is what would be in the consumers table12:51
tssuryalike most of the placement tables12:51
* cdent nods12:51
tssuryabut for the sake of the default value in this case it would the actual key that goes in12:51
tssuryaunless we define an "unknown" consumer type12:51
tssuryaexplicitly12:51
cdentwhy's that? wouldn't you create... yeah that12:51
tssuryaoh so the later okay ?12:52
cdentI think so, yes12:52
tssuryacool then :)12:52
cdent:)12:52
tssuryasorry to keep bothering you with the petty details12:52
cdentno problem at all, I think it is better that we talk this stuff out as much as required12:52
*** ttsiouts has joined #openstack-placement13:01
*** artom has quit IRC13:14
*** ttsiouts has quit IRC13:35
cdentmriedem, efried, edleafe: based on all this hullabaloo about os-traits at the moment, I'm thinking it probably makes sense to have some additional cores on os-traits and os-resource-classes in the class of "I care about names and I also know about hardware". I do not consider myself in that class and would like to have some delegates14:08
edleafecdent: I care about names, but know next to nothing about hardware14:09
cdentthat's a start14:09
cdentand I would think enough of one14:09
cdentsean-k-mooney and kashyap clearly care about this sort of stuff too14:10
efriedcdent: I don't mind adding cores, but I'm not sure it would further the issues we're facing right now.14:11
efrieddocumentation would do a better job14:11
efriedbut that would entail "architects" sitting down and deciding what we do and do not want standard traits/RCs to be.14:11
sean-k-mooneyi do care about os-traits. and os-resource classes to a degree also14:12
cdentefried: I'm not saying it would help with the issues, rather that the existence of the issues points out need for multiple voices in the discussion14:12
sean-k-mooneybut im missing context so ill read back14:12
sean-k-mooneyoh this is in relation to the trait for the vulnerablities and cpu feature14:13
mriedemcdent: is there not a separate core team for os-traits? because dansmith is who i'd delegate to about traits14:14
mriedemok i guess it's just placement-core https://review.opendev.org/#/admin/projects/openstack/os-traits,access14:15
cdentmriedem: not at the moment, but I'm thinking there should be14:15
cdentsean-k-mooney: that discussion inspired the idea, but isn't the whole deal14:15
mriedemi haven't really been following said hullabaloo14:16
mriedemi agree with dansmith though that it's not nova's job to report that kind of information14:16
mriedemi.e. you've patched your system or whatever14:16
sean-k-mooneywe have stated as a mater of policy in the past that this was out of scope14:16
mriedemexternal tooling can detect and tack on a custom trait if that's something you care about monitoring in your cloud14:17
sean-k-mooneyit came up the first time i suggsted adding tratis for secure boot14:17
sean-k-mooneyin that we decied it was not nova job to report if the sytem used secure boot or not14:17
sean-k-mooneyin that case we pointed to https://github.com/openstack/nova/blob/c6218428e9b29a2c52808ec7d27b4b21aadc0299/doc/source/contributor/policies.rst#metrics-gathering vaguly as the basis for that14:19
sean-k-mooneyin that we consider reporting if secure boot was enabled on the host to be a similar plathfor confugration metric/feature that was out of scope of nova to report/expose14:20
sean-k-mooneyi think the vulnerablits fall into the same catagory14:20
efriedsecure boot and metrics don't seem like related issues at all. I think the objection to metrics was that we don't want traits used to track "state". At least for certain values of "state" that tend to be very dynamic...14:23
efriedIMO secure boot seems like a perfectly reasonable thing to use a trait for.14:24
sean-k-mooneyefried: they dont but that specifc policy was cited in the firt ptg in denver as to why it was out of socpe to do it14:24
sean-k-mooneyi remember because i also taught it was unrelated at the time14:24
efriedIt's been something of a religious war the whole time. I'm on the liberal side personally.14:25
sean-k-mooneybut i think the meaning was there were external things that could track that and more over jay did not want to see state tracked as tratis in placement14:25
sean-k-mooneyso supprot secure boot was fine14:25
sean-k-mooneysucure boot was enable which was the second half was not14:25
openstackgerritSurya Seetharaman proposed openstack/placement master: Spec: Support Consumer Types  https://review.opendev.org/65479914:26
sean-k-mooneythe socund half was the metrics/monitor tie in in that nova was monitoring th econfiguration of the system on agent start to determin if it was configerd14:26
*** artom has joined #openstack-placement14:27
sean-k-mooneyefried: and yes support uefi secure boot is a preferctly resonable ting to have as a trait14:27
openstackgerritSurya Seetharaman proposed openstack/placement master: Spec: Support Consumer Types  https://review.opendev.org/65479914:28
efriedTraits are cheap, and the API is robust, so we should use them anywhere it makes sense to identify a characteristic of a resource provider.14:28
efriedIMO it still doesn't make sense to track very dynamic things (core temps or whatever), but that's because API traffic and rtt makes it impractical for things that need to be close to "realtime", not because there's some architectural or ethical problem with that being done with a trait.14:28
efriedSo I have no problem with a trait for "metrics gathering enabled". But I don't think it makes sense to be storing the metrics themselves in placement in any form.14:29
efriedcdent: At what scale do you think trait profusion would actually become problematic for the infrastructure?14:29
sean-k-mooneyya i felt similar in that thing that only change when you reboot like bios options were ok but the issue with that is if you had feature X enabled. schulded a vms that required it and then your in troble if you disabel it again14:30
openstackgerritSurya Seetharaman proposed openstack/placement master: Spec: Support Consumer Types  https://review.opendev.org/65479914:30
efriedI have to imagine it would be tens or hundreds of thousands at least.14:30
* cdent catches up14:30
efriedperhaps the issue is more with the usability side. Humans doing rp trait list on the CLI don't want to see pages and pages of them? Not sure how much I care about that aspect tbh. That's what grep is for.14:31
cdentI agree that tens or hundreds of thousands ought to be workable14:32
cdenti think that boundary of what is or isn't a trait is essentially "this would be better as a key value pair"14:32
sean-k-mooneyefried: well if you model state in placement via tratis and then you have a vme that requries State X if that change to state Y all allocation that required State X are now invalid14:32
cdentso TEMP_HOT is easier to consider than TEMP_10014:33
sean-k-mooneyyes but even with TEMP_HOT14:33
cdentbut because TEMP_100 is not a good idea, it influences the sense that TEMP_HOT is also not a good idea14:33
sean-k-mooneywhat do you do if you have a vm the has trait:TEMP_HOT=forbidin14:33
sean-k-mooneydo you migrate it off the compute node14:33
efriedI could see that being a future feature.14:34
efriedprobably not something nova should orchestrate14:34
cdenta vm would not have a trait, its host would...14:34
sean-k-mooneyauto migration based on chagnes in tratis14:34
cdent(to be pedantic)14:34
sean-k-mooneyisnt that how kuberntes lables work kind of14:34
efriedcdent: I think sean-k-mooney is saying the VM's db record has, in its flavor/image/whatever, a trait:TEMP_HOT=forbidden14:35
sean-k-mooneyif you add or remvoe k8s lables to node it will schudler/evict workload based on there requirements14:35
sean-k-mooneyefried: yes14:35
sean-k-mooneyif the vm has14:35
efriedAnyway, the fact that it's not appropriate for nova to orchestrate that flow doesn't mean we should disallow it from being a standard trait.14:35
sean-k-mooneytrait:TEMP_HOT=forbidden in the flaovr or image and after it has been booted the virt driver or what ever adds it technically that would cause rebuild to fail14:36
sean-k-mooneyyes but you could also have CUSTOM_VULNERABLITY_MAGIC_UNICORN that that external CVE monitoring tool applies and that a poloicy engen then takes corrective action on14:37
* edleafe reads back after emerging from meetings14:49
edleafeI think that there is a big difference between what is appropriate in os-traits, and what any individual deployment might want to do14:49
edleafeIf someone wants to create CUSTOM_TEMP_100, that's up to them14:50
edleafeBut I wouldn't want to see anything like that added to os-traits14:50
sean-k-mooneyyep although i would praobly model termal domain via aggrate rather then traits but we have CUSTOM_ traits for usecases like this14:51
sean-k-mooneythat said i also dont think we should avoid add new standard traits if they are generaly reusable14:52
sean-k-mooneyactully when i have considerd modeling termal domain as aggrate in the past it was more this set of host is on one cooling system that is idepend fo this other set of host14:54
sean-k-mooneye.g. modeling the fault domains14:54
sean-k-mooneyrather then this thign is hot14:54
sean-k-mooneyby the way modeling power as capasity as a sharing resouce provide with traits for if tis is ups back or desile backed is a usecase that came up in the past that i dont think we ever tracked as a futrue use of placemetn14:59
cdentsounds workable15:04
cdentalthough with all these dynamic power consumption tools, placement's relatively static approach may not reflect reality well15:04
sean-k-mooneyyes perhaps although the usecase was based aroudn the idea of worst case power useage and fault tolerance so haveing  rough metric of 3W per core and a static allocaiton in the falvor for that worst case vaule was suffient for this usecase15:12
sean-k-mooneythis was a converstion i had almost 2 years ago at this point and we recommend modeling the falut domains as nova AZs and left teh capasity based scudling as an open questoin at that time15:14
sean-k-mooneya static aproach like we do for bandwith based scudling can get you a long way15:14
cdentif strict adherence to reality doesn't matter, then it ought to work just fine15:14
cdentjinxish15:14
sean-k-mooney:)15:14
cdentbauzas, sean-k-mooney : I recall one or both of you talking about devstack not cleaning up after itself properly and thus making placement-api (amongst other things) appear to not start. Did either of you ever make a patch or bug to devstack?15:17
sean-k-mooneycdent: no i didnt15:17
bauzascdent: well, it was coming from an upgrade15:18
bauzasAFAIR15:18
sean-k-mooneyand its still a thing15:18
sean-k-mooneyit comes from switch branchs15:18
bauzasAFAIR, apache files were remaining15:18
cdentyes, that's what I recall too15:18
sean-k-mooneyif you deploy an older barnch e.g. rocky and then change to master we change the name of the wsgi script15:18
sean-k-mooneybut we did not regenerate teh apache config to point to the new one15:18
sean-k-mooneyso we should basically always nuke the virtual host config for palcement on each stack and generate it cleanly15:19
sean-k-mooneyi belive the current code only create the file if it does not exist or somthing like that15:19
sean-k-mooneythat said this would seam to imply that is what it would do15:21
*** cdent has quit IRC15:28
sean-k-mooneylooking at the devstack code i think it should be clean up after iteself but the issue might be that we are not restrating apache or somthing similar15:28
*** cdent has joined #openstack-placement15:29
sean-k-mooneyso this https://github.com/openstack/devstack/blob/a5176e6f921f0aaa1493e146fee31f28bf6bdd64/lib/placement#L156-L162 might be the issue15:29
cdentsean-k-mooney: I think it is more that https://github.com/openstack/devstack/blob/a5176e6f921f0aaa1493e146fee31f28bf6bdd64/lib/placement#L64 either never gets called, or if it does, needs to remove nova-placement-api.conf15:30
sean-k-mooneyi think we do somting weird in devstack where we still use apache for tls termination then delegate to uwsgi15:30
sean-k-mooneyhum its called in clean but not in unstack15:31
sean-k-mooneybut even so i think we shoudl be updating the file correctly on stack but we dont restart apatch so it never picks it up if we are usign uwsgi15:31
cdentrun_process, when uwsgi is involved, sets up the systemd unit file and the necessary apache config. what the code you're pointing at is for when uwsgi is not used (which you have to try really hard to accomplish and isn't advise)15:32
*** ttsiouts has joined #openstack-placement15:32
cdentthe error I've seen more recently is that nova-placement-api.conf isn't removed and taked precedence15:32
cdentanyway, I think there are multiple fixups that could happen15:33
*** helenafm has quit IRC15:33
sean-k-mooneyya i think so too15:33
*** cdent has quit IRC15:35
openstackgerritMerged openstack/placement stable/stein: Skip _exclude_nested_providers() if not nested  https://review.opendev.org/65920015:36
*** cdent has joined #openstack-placement15:41
efriedcdent: I'm asking Draven if she would be willing to draw an openstack-themed Australian magpie garçon15:47
cdentwoot!15:47
efriedcdent: But I thought openstack had someone who did that for us15:48
efriedLike, when we did the powervm one, we found an image on google (of a real silverback) and sent it over, and they did the rest.15:49
*** ttsiouts has quit IRC15:50
*** e0ne has quit IRC15:50
*** e0ne has joined #openstack-placement15:50
cdentwhen I've asked about I get directed to existing stickers15:51
cdentso I figured ask around15:51
efriedhmph16:12
sean-k-mooneyplacement project sticker/logo?16:26
sean-k-mooney or something else16:26
*** dklyle has quit IRC16:31
*** dklyle has joined #openstack-placement16:37
*** e0ne has quit IRC17:07
*** dklyle has quit IRC17:29
openstackgerritMerged openstack/os-resource-classes master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65851917:32
*** ttsiouts has joined #openstack-placement17:35
*** tssurya has quit IRC17:47
*** dklyle has joined #openstack-placement17:49
*** dklyle has quit IRC17:56
*** e0ne has joined #openstack-placement18:10
*** e0ne has quit IRC18:13
*** dklyle has joined #openstack-placement18:20
openstackgerritMatt Riedemann proposed openstack/osc-placement stable/queens: Migrate legacy-osc-placement-dsvm-functional job in-tree  https://review.opendev.org/55663518:27
*** ttsiouts has quit IRC18:27
*** ttsiouts has joined #openstack-placement18:43
*** ttsiouts has quit IRC18:48
*** dklyle has quit IRC19:01
*** cdent has quit IRC19:02
*** tssurya has joined #openstack-placement19:02
*** e0ne has joined #openstack-placement19:17
efriedsean-k-mooney: yeah, placement project sticker/mascot/logo, see ML.19:40
*** e0ne has quit IRC19:56
*** e0ne has joined #openstack-placement19:59
*** e0ne has quit IRC20:28
*** dklyle has joined #openstack-placement20:39
*** ttsiouts has joined #openstack-placement20:45
*** dklyle has quit IRC21:14
*** ttsiouts has quit IRC21:16
*** dklyle has joined #openstack-placement21:29
*** dklyle has quit IRC22:00
*** takashin has joined #openstack-placement22:01
*** artom has quit IRC22:11
*** ttsiouts has joined #openstack-placement22:32
*** mriedem has quit IRC22:51
*** ttsiouts has quit IRC23:06
*** tssurya has quit IRC23:32

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!