Wednesday, 2020-04-15

*** threestrands has joined #openstack-rally00:00
*** anilvenkata has joined #openstack-rally04:52
*** tobberydberg has joined #openstack-rally05:46
*** threestrands has quit IRC05:54
*** tosky has joined #openstack-rally07:23
openstackgerritMerged openstack/rally-openstack master: [ci] Move osresources script under ci roles  https://review.opendev.org/71845207:56
marosghello andreykurilin are you around?11:23
andreykurilinmarosg: hi! yes11:23
andreykurilinmarosg: how things are going?11:23
marosgI would need an advice - I am working on designate+VM scenario where VM tries to resolve its own name against existing (not rally created) designate11:24
marosgit works fine, but there is one thing - when you have several users in one tenant and they are executed in parallel, they all try to change domain for their rally vreated network11:25
marosgthey would each have different domain, but one network, so that cannot work11:25
marosgquestion is if I can say there is a constraint of just one user per tenant11:26
marosgand if it is possible to enforce it via decorator when checking requirements11:26
marosgmaybe a little better explanation - scenario creates a zone and changes rally created network to use this zone11:27
marosgcode like this11:29
marosghttps://paste.ubuntu.com/p/THRYvRp67n/11:29
andreykurilinmarosg: first of all, I'm not familiar with designate at all, so I need more details before trying to help :) how designate works with neutron/nova? docs of designate says that it has integration with neutron and nova, i.e designate can create records in auto mode. If it so, no matter how many parallel calls for a new vm, it should create separate records. It sounds like a bug for mew, if it doesn't work11:41
marosgno, not a bug. look at the code I posted. you have to modify tenant network to be aware of the zone which designate is using. then whenever there is a VM created within that zone, its IP will be automatically populated to designate11:43
andreykurilinok, I see11:43
andreykurilinso there is can be only one zone for network or for subnet?11:44
marosgand if this is onvoked in parallel for three VMs in the same tenant, they will each create new zone and update network with their zone, verwriting what others did11:44
andreykurilini guess for a network11:44
marosgyes11:44
marosgnetwork11:44
andreykurilinmore generic question: what you are trying to check?:) I mean do you really need to create a new zone each time or zone can be attached to the network before workload execution as a preparation step(i.e at contexts)?11:46
marosgthat is openstack zone thing - only owner of the zone can change it (or admin) so if zone is created before rally, only owner and admin can write to it, there is no tenant shared zone yet11:47
marosghm, context, interesting, I am not familiar with that much11:48
andreykurilinmarosg: ok, let's talk about contexts :)11:48
marosglol11:48
andreykurilinit sounds for me as something you actually need11:48
marosgmaybe11:49
andreykurilinwe are talking about rally task, right?11:49
marosgyes11:49
andreykurilingood11:49
marosgahhh, there is zones context11:55
andreykurilinrally task samples are written using task format v1 that I should deprecate at some point...eh.. v2 format is much better, i'll use links to it for further explanations. rally task consists of subtasks (https://github.com/openstack/rally-openstack/blob/master/rally-jobs/nova.yaml#L10). Each subtask consists of workloads(https://github.com/openstack/rally-openstack/blob/master/rally-jobs/nova.yaml#L26). For simplification of subt11:57
andreykurilinask format, if it contains only one worload, workload configuration can be written at top of subtask section itself(https://github.com/openstack/rally-openstack/blob/master/rally-jobs/nova.yaml#L12-L23). A workload itself is described by scenario, runner, contexts and sla. SLA describes how results of execution should be treated. scenario describes what a single iteration should do. Runner runs iterations (actual workload to API11:57
andreykurilin). Contexts - the thing that includes pre step that is executed before all iterations and post step that is executed after all iterations are complited. We are using contexts to create temporary users, images, networks, etc. It is helpful to limit scenario to actual workload we want to check11:57
marosgsure, I use contexts in rally.yaml when invoking task11:59
andreykurilinso you can use(write a new since old one is designate v1 only) context plugin that will create a zone an attach to network12:00
andreykurilinso each network will have only one zone12:01
marosgI was afraid you would say I have to write new one instead of using existing ;)12:05
andreykurilin1) it is simple :) lol12:05
andreykurilin2) I guess the old one can be modified12:05
marosgandreykurilin: I am looking at rally-openstack/rally_openstack/task/contexts/designate/zones.py12:06
marosgthere is no mention of network12:07
marosgso if I want to modify network to be aware of the zone, I have to do it in scenario or can I do it somehow in contect?12:08
marosg*context12:09
andreykurilinif you are ok to the next workflow:  create a single designate zone and attach to a network, use the network in paraller. yes, context is what you need12:10
andreykurilinas for the current zones contexts - yeah, it looks useless. i.e. only precreates zones. For checking zones.list?!12:10
marosglets say I modify context. I will create one zone per tenant. But how do I modify network at this point? how do I know some is even created? can I influenece order of contexts?12:14
andreykurilinsee last argument here - https://github.com/openstack/rally-openstack/blob/master/rally_openstack/task/contexts/designate/zones.py#L2412:14
andreykurilinhttps://github.com/openstack/rally-openstack/blob/master/rally_openstack/task/contexts/network/networks.py#L31 <- networks context is executed earlier12:15
marosgahhh, nice12:16
marosgthank you. I am sure you will hear from me again :)12:16
andreykurilinalso, it would be nice to get rid of zones_per_tenant. it sounds redundant. if we want to attach zones to networks, we should have number of zones equal to number of networks, not the number of tenants12:18
marosgbut that could break some tests12:28
marosgif someone uses designate tests...12:28
andreykurilinAre they working?12:28
marosgsome12:28
andreykurilinheh, ok12:28
andreykurilinI need to try to restore designate CI job. it was broken for a while..12:29
marosgandreykurilin: I think I could modify zones context to keep existing functionality plus modify first netwrok using first zone. that would be new boolean parameter which would be False if not provided12:35
andreykurilingreat12:35
openstackgerritAndrey Kurilin proposed openstack/rally master: Update password for dockehub account  https://review.opendev.org/72019813:11
openstackgerritAndrey Kurilin proposed openstack/rally-openstack master: wip: add regular pushes to dockerhub  https://review.opendev.org/72019913:17
openstackgerritAndrey Kurilin proposed openstack/rally-openstack master: wip: add regular pushes to dockerhub  https://review.opendev.org/72019913:21
openstackgerritAndrey Kurilin proposed openstack/rally-openstack master: wip: add regular pushes to dockerhub  https://review.opendev.org/72019913:30
*** rcernin has quit IRC13:37
openstackgerritAndrey Kurilin proposed openstack/rally master: Update password for dockehub account  https://review.opendev.org/72019813:57
openstackgerritAndrey Kurilin proposed openstack/rally-openstack master: wip: add regular pushes to dockerhub  https://review.opendev.org/72019913:59
openstackgerritAndrey Kurilin proposed openstack/rally-openstack master: WIP: try to restore designate CI  https://review.opendev.org/55682514:04
openstackgerritAndrey Kurilin proposed openstack/rally master: Update password for dockehub account  https://review.opendev.org/72019814:26
openstackgerritAndrey Kurilin proposed openstack/rally-openstack master: WIP: try to restore designate CI  https://review.opendev.org/55682515:31
andreykurilinmarosg: wow - https://4d6809932811773c27c6-87320f1b85511885c71f0c1fb804eba8.ssl.cf2.rackcdn.com/556825/8/check/rally-task-designate/967c5c2/results/report.html as part of  https://review.opendev.org/#/c/556825/ . I thought our code works only for designate v1... but it looks like something works for v2 as well16:33
marosgyes, bits and pieces. for example when you create zone, it is V2 call. but cleanup tries to remove domain, which was deprecated and is only in v1. it finishes with success but you can see traceback16:34
marosgthat I already solved in my current code16:34
andreykurilinnice16:35
andreykurilinI think we can remove v1 support, since designateclient doesn't support it actually :)16:35
andreykurilinmarosg: am I right that doman, record, server are resources of V1 and zone&recordset are v2?16:38
marosgdomain for sure is v1, not sure about record and server16:40
marosgand zone+recordset is v2, yes16:41
marosgplease don't change designate stuff now :)16:45
andreykurilinmarosg: okay...16:45
andreykurilinmarosg: Are you working on enabling CI for designate?16:46
andreykurilinPS: I did not plan to change code related to designate, just tried to get some knowledge of the current state of plugins for it.16:47
marosgandreykurilin: we had our own code which created network, router etc, then I it generated vm scenario yaml and ran rally, cleanup afterwards. Now i am trying to offload all that overhead to rally16:47
andreykurilingood16:47
marosgit will be very similar to manila - do some stuff, create vm, call a script (which will use dig to resolve name)16:48
andreykurilinso you are not modifying https://github.com/openstack/rally-openstack/blob/master/tests/ci/playbooks/roles/list-os-resources/library/osresources.py and I can finish https://review.opendev.org/#/c/556825/ so we will have a CI job for the time you will push a change16:49
marosgandreykurilin: no, I am not touching any of that16:49
openstackgerritAndrey Kurilin proposed openstack/rally-openstack master: Restore designate CI  https://review.opendev.org/55682516:54
openstackgerritAndrey Kurilin proposed openstack/rally-openstack master: wip: add regular pushes to dockerhub  https://review.opendev.org/72019916:55
*** anilvenkata has quit IRC17:00
openstackgerritAndrey Kurilin proposed openstack/rally-openstack master: wip: add regular pushes to dockerhub  https://review.opendev.org/72019917:01
openstackgerritAndrey Kurilin proposed openstack/rally-openstack master: Restore designate CI  https://review.opendev.org/55682518:20
marosgandreykurilin: stupid thing - how can I access neutron utils from zone context?18:34
marosgsomething similar to self.clients("neutron").update_subnet(subnet_id, body) in scenario18:34
andreykurilinmarosg: https://github.com/openstack/rally-openstack/blob/master/rally_openstack/task/contexts/network/routers.py#L100-L10218:35
marosgandreykurilin: that is some serious woodoo. I would never come up with that. thank you18:49
andreykurilinoh...someday I'll have enough time to update docs...18:50
openstackgerritMerged openstack/rally-openstack master: Restore designate CI  https://review.opendev.org/55682521:21
*** rcernin has joined #openstack-rally22:45
*** tosky has quit IRC23:39

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!