*** tetsuro has joined #openstack-placement | 00:17 | |
*** e0ne has joined #openstack-placement | 04:53 | |
*** e0ne has quit IRC | 04:56 | |
*** e0ne has joined #openstack-placement | 05:21 | |
*** e0ne has quit IRC | 05:25 | |
*** prometheanfire has joined #openstack-placement | 05:59 | |
prometheanfire | so... do I need to do anything to migrate from nova_placement to standalone placement (rocky -> stein) | 05:59 |
---|---|---|
prometheanfire | found docs | 06:01 |
prometheanfire | I notice that there's no way to migrate postgres? | 06:18 |
*** vdrok has quit IRC | 06:28 | |
*** belmoreira has joined #openstack-placement | 06:31 | |
*** belmoreira has quit IRC | 06:56 | |
*** vdrok has joined #openstack-placement | 06:58 | |
*** belmoreira has joined #openstack-placement | 06:58 | |
*** belmoreira has quit IRC | 06:58 | |
*** belmoreira has joined #openstack-placement | 07:00 | |
prometheanfire | dumped nova-api and imported one at a time, a note that would have been nice to know is to not run the db_sync on initial install if migrating | 07:00 |
*** e0ne has joined #openstack-placement | 07:06 | |
*** e0ne has quit IRC | 07:09 | |
*** e0ne has joined #openstack-placement | 07:16 | |
*** tssurya has joined #openstack-placement | 07:29 | |
*** helenafm has joined #openstack-placement | 07:40 | |
*** e0ne has quit IRC | 07:52 | |
*** e0ne has joined #openstack-placement | 07:58 | |
*** e0ne has quit IRC | 07:59 | |
*** e0ne has joined #openstack-placement | 08:10 | |
*** ttsiouts has joined #openstack-placement | 08:21 | |
openstackgerrit | Pawel Baclawski proposed openstack/osc-placement master: Add support for 1.22 microversion https://review.openstack.org/651783 | 08:32 |
*** belmoreira has quit IRC | 08:41 | |
*** belmoreira has joined #openstack-placement | 08:43 | |
bauzas | mmm, silly question maybe but do we have a way in placement to say 'preferred trait' and not required ? | 09:23 |
bauzas | https://developer.openstack.org/api-ref/placement/?expanded=list-allocation-candidates-detail#list-allocation-candidates | 09:23 |
bauzas | I only see 'required' but I wasn't really paying attention whether someone worked on the preferred trait thing | 09:24 |
bauzas | nevermind | 09:29 |
bauzas | http://specs.openstack.org/openstack/nova-specs/specs/stein/approved/placement-mixing-required-traits-with-any-traits.html gives me what I want | 09:29 |
*** ttsiouts has quit IRC | 10:23 | |
*** ttsiouts has joined #openstack-placement | 10:24 | |
*** ttsiouts has quit IRC | 10:28 | |
*** belmoreira has quit IRC | 10:35 | |
*** cdent has joined #openstack-placement | 10:39 | |
*** belmoreira has joined #openstack-placement | 10:51 | |
*** ttsiouts has joined #openstack-placement | 11:02 | |
*** tetsuro has quit IRC | 11:37 | |
*** belmoreira has quit IRC | 11:41 | |
*** cdent has quit IRC | 11:42 | |
*** belmoreira has joined #openstack-placement | 11:43 | |
*** nguyenhai has joined #openstack-placement | 11:47 | |
*** nguyenhai has quit IRC | 11:52 | |
*** cdent has joined #openstack-placement | 12:23 | |
*** belmoreira has quit IRC | 12:28 | |
*** belmoreira has joined #openstack-placement | 12:33 | |
*** belmoreira has quit IRC | 12:59 | |
*** mriedem has joined #openstack-placement | 13:21 | |
*** egonzalez has quit IRC | 13:30 | |
*** egonzalez has joined #openstack-placement | 13:30 | |
*** efried_pto is now known as efried | 13:31 | |
efried | cdent: Did you see stuff from prometheanfire ~7.5h ago? | 13:32 |
efried | prometheanfire: If your experience suggests improvements to the docs, please do propose same. | 13:32 |
cdent | efried: i did not no | 13:33 |
* cdent looks at logs | 13:33 | |
cdent | hmm, interesting | 13:34 |
cdent | [t cNNb] | 13:34 |
purplerbot | <prometheanfire> I notice that there's no way to migrate postgres? [2019-04-16 06:18:46.671440] [n cNNb] | 13:34 |
cdent | postgres is mentioned in https://docs.openstack.org/placement/latest/upgrade/to-stein.html | 13:35 |
*** belmoreira has joined #openstack-placement | 13:35 | |
cdent | prometheanfire: if/when you come back, a bit more detail on where things went wrong would be most welcome | 13:36 |
cdent | If I'm not here, a storyboard story in openstack/placement would also be welcome | 13:37 |
openstackgerrit | sean mooney proposed openstack/os-traits master: add libvirt image metadata traits https://review.openstack.org/652996 | 13:43 |
sean-k-mooney | im not sure if i have everting right in terms of tracking in ^ | 13:44 |
sean-k-mooney | but its on the correct topic branch for the nova spec/bluprint and i have the os-tratis story and task added | 13:45 |
cdent | sean-k-mooney: If it's not right, someone will notice and say so and it will get fixed eventually, nbd | 13:45 |
sean-k-mooney | i just noticed os-tratis apprently has unit tests? do you alway need to add test for new traits? i assume not | 13:46 |
cdent | sean-k-mooney: they can be useful as a sanity check, but we've not been strict about requiring them | 13:54 |
sean-k-mooney | ok the new traits i was defiening are just constants so i was wondering wny they were needed beyond a generic set | 13:55 |
cdent | sean-k-mooney: see: https://review.openstack.org/#/c/648147/ where the first patch, had it unit tests, would have caught the problem that I caught in review | 13:58 |
cdent | however, I did catch it in review, so not a serious issue | 13:59 |
* cdent will be back later | 14:01 | |
sean-k-mooney | ok if people are ok with the general name im chossing i can add some. it would be nice if there was a test or a tox env to print all the traits jsut so you can do a visual inspection simpely | 14:01 |
cdent | that's a good idea | 14:01 |
*** cdent has quit IRC | 14:01 | |
sean-k-mooney | i might write one | 14:01 |
sean-k-mooney | like the nova/oslo object tests | 14:02 |
sean-k-mooney | then when you add a new trait just adde it to the expect set | 14:02 |
sean-k-mooney | and that way you can be sure the name is correct | 14:02 |
*** amodi has joined #openstack-placement | 14:05 | |
*** belmoreira has quit IRC | 14:13 | |
*** belmoreira has joined #openstack-placement | 14:16 | |
*** ttsiouts has quit IRC | 14:23 | |
*** ttsiouts has joined #openstack-placement | 14:24 | |
*** ttsiouts has quit IRC | 14:27 | |
*** ttsiouts has joined #openstack-placement | 14:28 | |
*** dklyle has quit IRC | 14:49 | |
*** dklyle has joined #openstack-placement | 14:50 | |
*** helenafm has quit IRC | 14:57 | |
*** cdent has joined #openstack-placement | 15:05 | |
*** e0ne has quit IRC | 15:31 | |
*** belmoreira has quit IRC | 15:35 | |
cdent | dansmith, melwitt: Since you've both expressed some interest/concern in the topic of partitioning placement in various ways, if you get a chance to comment in the threads starting at http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004721.html and http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004720.html that would be extra good | 15:51 |
melwitt | cdent: ack, been meaning to reply but haven't gotten around to it yet | 15:52 |
cdent | cool, thank | 15:52 |
cdent | s | 15:52 |
*** ttsiouts has quit IRC | 15:59 | |
*** ttsiouts has joined #openstack-placement | 15:59 | |
*** ttsiouts has quit IRC | 16:04 | |
dansmith | cdent: done | 16:23 |
cdent | thanks | 16:23 |
*** tssurya has quit IRC | 16:47 | |
*** e0ne has joined #openstack-placement | 17:32 | |
*** dklyle has quit IRC | 17:45 | |
*** e0ne has quit IRC | 17:49 | |
cdent | dansmith: thanks for staying on that allocation/consumer-type stuff. I can probalby come up with more to say but I'm going to wait on jaypipes to weigh in with whatever opinions he's got. generall, yeah, seems alright | 17:58 |
dansmith | ack | 17:58 |
prometheanfire | cdent: I missed that link ( https://git.openstack.org/cgit/openstack/placement/plain/tools/postgresql-migrate-db.sh ), heh, hope I migrated fine by hand (I initialized the placement DB then dumped the nova_api DB, only importing the tables found in the placement DB from the dump) | 18:10 |
cdent | prometheanfire: that ought to work just fine, assuming services were down | 18:10 |
cdent | is there a place where we can make things more clear? | 18:10 |
prometheanfire | cdent: I don't think so, it was just late late night so I didn't ctrl+f on the page | 18:11 |
cdent | I know how that can be | 18:11 |
jaypipes | cdent: I'm on board with dansmith's opinions. | 18:12 |
jaypipes | dansmith: excellent point about the migrations. I totally forgot about that. | 18:13 |
prometheanfire | decided to start upgrade/installing stein at about midnight, finished at about 2AM | 18:13 |
cdent | jaypipes: the main question I had was with regard to different deployments of nova using different consumer types. that feels potentially icky | 18:13 |
prometheanfire | there was one column missing in a placement db table that was in a nova_api one though | 18:13 |
cdent | prometheanfire: which one was that? | 18:14 |
jaypipes | cdent: are you asking whether I think we should define a set list of consumer types or leave it as a free-form text field? :) | 18:17 |
prometheanfire | and since I initialized the placement db I had to delete some defaults that were diferent in nova_api | 18:18 |
cdent | jaypipes: that is the root yes | 18:18 |
prometheanfire | lookin up, forget offhand | 18:18 |
jaypipes | cdent: my general preference is for cleanliness and consistency, so I would prefer a set list of consumer types. that said, I can understand dansmith's trepidation about encoding such things early on. | 18:18 |
jaypipes | I'm torn :) | 18:19 |
cdent | jaypipes: or from a different if the concept of an 'instance' type consumer is independent of "nova" | 18:19 |
dansmith | jaypipes: yeah, I know, but I'm thinking about how we end up with open-ended resource classes in ironic, which makes me hesitate to go the enum route | 18:19 |
jaypipes | dansmith: ack | 18:19 |
dansmith | cdent: since nova already has two of its own types, I would say nova != instance | 18:20 |
jaypipes | dansmith: as in "ironic instance" and "VM instance" or do you mean "instance" vs. "migration"? | 18:20 |
dansmith | also, nova's resources for an instance, and ironic's accounting of things it has promised to nova (which could be used for an instance or not) would be different | 18:20 |
cdent | dansmith: that's not quite what I meant. it's more can two different things (a nova and something else): create an "instance" | 18:21 |
dansmith | jaypipes: in the nova case I mean instance vs migration | 18:21 |
prometheanfire | cdent: can_host column in resource_providers | 18:21 |
cdent | prometheanfire: ah yeah, that's an orphan that just sort of got aged out | 18:21 |
dansmith | cdent: well, if I'm using bifrost and I want to call it an instance, it's very very similar to what nova calls an instance | 18:21 |
prometheanfire | yep, this is an OLD install | 18:21 |
jaypipes | prometheanfire: heh, yeah, you can ignore that. | 18:21 |
jaypipes | prometheanfire: that's edleafe's fav field. | 18:22 |
prometheanfire | lol | 18:22 |
prometheanfire | I did ignore it | 18:22 |
cdent | dansmith: yes, but if it is about controlling quota does overlap matter? there were questions along those lines earlier in the thread | 18:22 |
dansmith | cdent: well, assuming the owner is doing the quota enforcement, I think it's up to that service | 18:23 |
dansmith | cdent: it's why I think it's important for the provider sharding to be different | 18:23 |
cdent | (as in, why do we even care if this vcpu is a nova instance or not, if the user has vcpu quota, isn't that global) | 18:23 |
dansmith | cdent: because they would almost definitely have different quota for nova-provided vcpu quota than something else, | 18:24 |
dansmith | like if something like oVirt was also using placement to track basically the same type of thing, | 18:24 |
dansmith | but the cost (and thus quota) is very different | 18:24 |
dansmith | same thing for PCPU provided by nova vs. ironic | 18:24 |
cdent | so if keystone is a limits provider, it has to know about consumer types too? | 18:25 |
dansmith | no? | 18:25 |
cdent | why not? | 18:25 |
dansmith | the limits are interpreted by the services | 18:25 |
prometheanfire | my only suggestion for the migration docs is to note that you should not initialize the placement db before running them (as it sets up defaults which have to be manually cleared before the tables import) | 18:25 |
dansmith | not every quota limit maps directly (or even indirectly) to a resource in placement | 18:26 |
cdent | dansmith: but we're saying there are different limits for different types | 18:26 |
dansmith | (nor should it) | 18:26 |
dansmith | cdent: right, but they're translated through a service between keystone and placement | 18:26 |
cdent | dansmith: I know, I'm asking "how would the that intermediate service distinguish?" | 18:26 |
dansmith | those limits are scoped by region right? | 18:27 |
cdent | prometheanfire: would fantabulous if you could create a story in https://storyboard.openstack.org/#!/project/openstack/placement and tag it docs | 18:27 |
cdent | so we're saying you have to be in a different region to have two different types of vcpu limit? | 18:28 |
cdent | (which maybe is fine) | 18:28 |
dansmith | for two distinct novas you *would* be a different region by definition, so .. yeah I think so | 18:28 |
prometheanfire | cdent: k, I'll do so | 18:28 |
dansmith | but even still, I'd say how the service decides to count the quotas based on usage within its shard of placement is it's deal | 18:29 |
cdent | prometheanfire: thanks very much | 18:29 |
cdent | dansmith: yeah, the scenario I'm trying to understand more fully or if it even is a scenario is one shard with N>1 services that want to count similar (or even) the same thing | 18:31 |
dansmith | to be in the same shard, I think they'd need to be collaborative and non-overlapping, like nova+neutron+cinder+ironic | 18:33 |
cdent | wfm. I'm just trying to be sure we don't walk it an "oh damn we forgot ... " corner | 18:34 |
*** irclogbot_0 has quit IRC | 18:39 | |
*** irclogbot_0 has joined #openstack-placement | 18:41 | |
prometheanfire | cdent: https://storyboard.openstack.org/#!/story/2005465 there you go, a bug based on my bad memory of being up too late | 18:41 |
cdent | awesome, thanks | 18:41 |
melwitt | cdent: your reply "In any given deployment, collaborating services (like nova, neutron, ironic, cinder) would need to agree on how they are not overlapping." makes the idea of having enums in somewhere in placement more appealing | 19:25 |
cdent | melwitt: I thought it might | 19:25 |
cdent | but I was trying to reflect the above chat with dansmith as close as possible | 19:25 |
melwitt | on the ability to specify more than one consumer type for a /usages query, yes please for quotas. or in the rollup response to have different consumer types differentiated would work too | 19:26 |
dansmith | I'm replying about that right now | 19:26 |
cdent | please feel free to join the thread, I'm going to disappear from irc pretty soon and we've got plenty of time to flesh things out | 19:26 |
melwitt | cdent: yeah, I think you did. just saying when I read it I was like "oh" | 19:26 |
cdent | (I've moved on to the rp sharing thread and then need to be more engaged at home) | 19:27 |
melwitt | will do | 19:27 |
dansmith | melwitt: if placement codifies that enum, it just means that any new arrangement of services has to be "blessed" by placement, unless we want yet another magic CUSTOM_ prefix namespace | 19:27 |
melwitt | yeah. guess there's some downsides either way | 19:28 |
*** dklyle has joined #openstack-placement | 19:58 | |
*** ttsiouts has joined #openstack-placement | 20:44 | |
* cdent waves | 20:50 | |
*** cdent has quit IRC | 20:50 | |
*** ttsiouts has quit IRC | 22:10 | |
*** ttsiouts has joined #openstack-placement | 22:11 | |
*** ttsiouts has quit IRC | 22:12 | |
prometheanfire | well, nova is having problems with the new placement it looks like, not sure if I should post here or there | 23:36 |
prometheanfire | https://gist.githubusercontent.com/prometheanfire/9f93f8fa09d78e1335f993d98ca4110c/raw/d7734baf057e106c72a7abf0242e8e9c9873af7c/gistfile1.txt | 23:36 |
prometheanfire | 2019-04-16 18:38:51.253 15418 INFO placement.requestlog [req-ab04a65e-c2b0-49dc-a3e0-40954257b351 e589d5a63cf245f381869ee8cb7ca092 48ddb9bf27c342e8a9640fe4e526519f - default default] 10.10.2.3 "PUT /traits/COMPUTE_NET_ATTACH_INTERFACE" status: 400 len: 402 microversion: 1.6 | 23:39 |
prometheanfire | bottom section, maybe missing traits for stein? https://docs.openstack.org/nova/latest/admin/configuration/schedulers.html | 23:42 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!