nitesh | Hi All, i've few queries on Barbican-tempest-plugin, can some one help me on this | 05:29 |
---|---|---|
opendevreview | Soniya Murlidhar Vyas proposed openstack/tempest master: Need to add netstat logging in the background https://review.opendev.org/c/openstack/tempest/+/813590 | 07:35 |
opendevreview | Soniya Murlidhar Vyas proposed openstack/tempest master: This patch creates the network v2.0 floating-ips-port-forwarding client. https://review.opendev.org/c/openstack/tempest/+/810015 | 07:48 |
frickler | nitesh: just leave your questions here and wait for someone to reply | 08:30 |
nitesh | I don't have an L3 agent in my setup and when i try to run Barbican-tempest-plugin all the testcases are failing. When i see the tempest code at https://github.com/openstack/tempest/blob/25.0.0/tempest/lib/common/dynamic_creds.py#L343 , i see the router creation is happening. Is it Mandatory to have L3 agent? My tempest.conf is https://paste.openstack.org/show/809908/ let me know if i miss any configuration | 09:10 |
frickler | kopecmartin: gmann: ^^ I seem to remember that there was some discussion about this use case some time ago already, do you happen to know more details? | 09:25 |
*** pojadhav is now known as pojadhav|brb | 11:27 | |
*** pojadhav|brb is now known as pojadhav | 12:34 | |
*** thelounge94 is now known as redrobot | 13:02 | |
*** redrobot is now known as thelounge94 | 13:04 | |
*** thelounge94 is now known as redrobot | 13:04 | |
kopecmartin | nitesh: what traceback does it fail with? | 13:23 |
kopecmartin | did it fail during router creation? | 13:23 |
kopecmartin | are you asking whether the router creation is required? | 13:23 |
frickler | kopecmartin: aiui, yes, there are deployments that are not able to create routers, they only use provider networks | 13:29 |
nitesh | kopemartin, the traceback error is https://paste.openstack.org/show/809922/ | 13:35 |
nitesh | i've some 13 testcases, For every test case it is going to https://github.com/openstack/tempest/blob/25.0.0/tempest/lib/common/dynamic_creds.py#L343 and failing as L3 is not present in my setup | 13:36 |
frickler | nitesh: ah, that code references the option that you'll likely need: auth.create_isolated_networks=false | 13:40 |
kopecmartin | yeah: https://opendev.org/openstack/tempest/src/branch/master/tempest/config.py#L71 | 13:41 |
frickler | see also the last paragraph in https://docs.openstack.org/tempest/latest/configuration.html#with-dynamic-credentials | 13:42 |
frickler | btw., I think one should remove the mention of nova-network in that section? | 13:42 |
gmann | frickler: nitesh kopecmartin as of now tempest create all network resource including router if neutron service is enabled or create_isolated_networks is enabled as frickler mentioned | 13:45 |
gmann | but create_isolated_networks false means you will rely on default network in your env. | 13:46 |
nitesh | Thank you guys. So conclusion is that if i " auth.create_isolated_networks=false" in my tempest.conf. It will solve my issue right ? | 13:52 |
gmann | nitesh: if your env has single network otherwise server creation can fail with 'multiple network' issue. | 13:54 |
gmann | you can try | 13:54 |
gmann | what this option does is 1. stop tempest to create any network resource 2. rely on existing network in testing env to be used for server creation | 13:55 |
kopecmartin | #startmeeting qa | 14:00 |
opendevmeet | Meeting started Tue Oct 12 14:00:11 2021 UTC and is due to finish in 60 minutes. The chair is kopecmartin. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
opendevmeet | The meeting name has been set to 'qa' | 14:00 |
kopecmartin | #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours | 14:00 |
kopecmartin | the agenda ^^^ | 14:00 |
soniya29 | hello | 14:00 |
kopecmartin | hi soniya29 | 14:01 |
kopecmartin | let's start | 14:02 |
kopecmartin | #topic Announcement and Action Item (Optional) | 14:02 |
yoctozepto | o/ | 14:02 |
kopecmartin | PTG is gonna be the next week, but we'll talk about that in a minute | 14:02 |
kopecmartin | hi yoctozepto | 14:02 |
kopecmartin | #topic Xena Priority Items progress | 14:02 |
kopecmartin | #link https://etherpad.opendev.org/p/qa-xena-priority | 14:02 |
kopecmartin | any progress on this front? | 14:03 |
kopecmartin | nothing from my side unfortunately | 14:03 |
gmann | o/ | 14:03 |
gmann | nothing from me | 14:03 |
kopecmartin | #topic OpenStack Events Updates and Planning | 14:04 |
kopecmartin | #link https://etherpad.opendev.org/p/qa-yoga-ptg | 14:04 |
kopecmartin | PTG is next week | 14:04 |
kopecmartin | if you haven't proposed any topic yet, feel free to do so, rather sooner than later | 14:05 |
kopecmartin | a reminder: | 14:05 |
kopecmartin | we have booked the following slots: 13-15 UTC October 18th and 15-17 UTC October 19th | 14:05 |
soniya29 | kopecmartin, sure | 14:05 |
kopecmartin | speaking about the PTG, the QA office hour next week is cancelled due to PTG | 14:06 |
gmann | +1 | 14:06 |
kopecmartin | we can talk in qa sessions :) | 14:06 |
kopecmartin | moving on | 14:06 |
kopecmartin | #topic Gate Status Checks | 14:06 |
kopecmartin | #link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade+OR+project:openstack/hacking) | 14:07 |
kopecmartin | any issues to bring up? | 14:07 |
kopecmartin | I don't see any urgent patches | 14:07 |
gmann | I think it seems green. | 14:07 |
kopecmartin | that's great | 14:07 |
kopecmartin | #topic Periodic jobs Status Checks | 14:07 |
kopecmartin | #link https://zuul.openstack.org/builds?job_name=tempest-full-victoria-py3&job_name=tempest-full-ussuri-py3&job_name=tempest-full-train-py3&pipeline=periodic-stable | 14:07 |
kopecmartin | #link https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic | 14:07 |
kopecmartin | all green too it seems (one failure, although that seems to be random) | 14:08 |
kopecmartin | #topic Sub Teams highlights | 14:08 |
kopecmartin | any updates, highlights we need to discuss today ? | 14:08 |
kopecmartin | Changes with Review-Priority == +1 | 14:09 |
kopecmartin | #link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade+OR+project:openstack/hacking) | 14:09 |
kopecmartin | there are none | 14:09 |
kopecmartin | #topic Open Discussion | 14:11 |
gmann | one issue nitesh brought before meeting about env not having L3 network and how to run tests as router cannot be created without L3 | 14:11 |
gmann | answer is to stop the network resource creation and rely on env existing network | 14:11 |
gmann | slaweq ^^ is this right approach from neutron perspective right? | 14:12 |
kopecmartin | this is the option in tempest btw: https://opendev.org/openstack/tempest/src/commit/a7bcabc8976e6e646d5e4379e3289b43586261c1/tempest/config.py#L71 | 14:12 |
slaweq | gmann: if You have provider network configured, You can plug vms directly to that network | 14:13 |
slaweq | and then they should be accessible using fixed ips directly | 14:13 |
gmann | yeah, that is Tempest expecation and tempest do not create any network resource | 14:13 |
frickler | wow, you are fast. I wanted to bring up the issue of pip installs failing with latest setuptools | 14:13 |
frickler | this is hidden in CI by our use of pre-built, cached wheels | 14:13 |
frickler | but an increasing number of people show up failing to install devstack locally because of that | 14:14 |
gmann | slaweq: thanks for confirmation | 14:14 |
slaweq | yw | 14:14 |
frickler | it also affects running unit tests | 14:14 |
gmann | frickler: we are facing that on stable right? | 14:14 |
frickler | no, on master too | 14:14 |
frickler | or especially there | 14:15 |
frickler | I made a requirements job withour our ci-built wheels | 14:15 |
kopecmartin | is it this bug? | 14:15 |
kopecmartin | #link https://bugs.launchpad.net/devstack/+bug/1942396 | 14:15 |
frickler | https://review.opendev.org/c/openstack/requirements/+/813292 | 14:15 |
frickler | yes, that bug | 14:16 |
frickler | ehm, no | 14:16 |
frickler | https://bugs.launchpad.net/cinder/+bug/1946340 | 14:16 |
frickler | it is mostly an issue with oslo.vmware and designate | 14:17 |
frickler | but also some further uninstallable libs I listed in https://review.opendev.org/c/openstack/requirements/+/813302 | 14:18 |
frickler | for stable branches, capping setuptools and possibly pip might be a solution | 14:18 |
gmann | yeah, | 14:18 |
frickler | for master, we need to replace the outdated libs | 14:18 |
frickler | for suds-jurko, there is a suds-community fork, which will hopefully release 1.0.0 with a fix soon | 14:19 |
frickler | for the other libs, I don't know a solution yet | 14:19 |
frickler | I'm also thinking we should do a periodic devstack job than runs without prebuilt wheels, so that we can detect this situation | 14:20 |
gmann | +1 on job | 14:20 |
kopecmartin | that is a good idea | 14:20 |
kopecmartin | maybe we could detect these kind of things sooner | 14:21 |
gmann | but if it does and on replacement (like current siutaiton) what we do? ask projects/requirement team to remove the deps? | 14:21 |
gmann | *no replacement | 14:21 |
kopecmartin | there isn't other option than waiting until the libs will make their code compatible with newer setuptools/pip, is there? | 14:22 |
frickler | those libs mostly seem to be abandoned | 14:22 |
kopecmartin | oh | 14:22 |
frickler | like suds-jurko hasn't been updated in some years | 14:22 |
gmann | yeah | 14:22 |
frickler | which makes them good candidates for replacement anyway, yes | 14:22 |
gmann | seems 8 project using it https://codesearch.opendev.org/?q=suds-jurko&i=nope&literal=nope&files=&excludeFiles=&repos= | 14:24 |
gmann | I think adding such job and then notify requirement/projects team to start thinking about replacement/remove-deps can be good way forward | 14:25 |
kopecmartin | yup, i agree | 14:25 |
gmann | and reply on prebuilt wheels until then but it does not solve the local devstack issue | 14:25 |
gmann | rely | 14:26 |
gmann | in that case we can add var to in the setuptool/pip for local env. frickler ? | 14:26 |
gmann | * to pin the setuptool/pip | 14:26 |
frickler | hmm, I think the mirrors are accessible from the outside, but not sure if we want to point people to that | 14:27 |
frickler | in the current case, just removing oslo.vmware from nova/cinder/designate reqs is enough | 14:27 |
frickler | because most deployments don't actually use it | 14:27 |
gmann | but we need to disable corresponding tests too right? | 14:28 |
gmann | and it might be hard to find all unit/functional tests corresponding to vmware driver in nova until we see all failing one | 14:29 |
frickler | I didn't check that, just verified that devstack installation finishes | 14:29 |
frickler | I can try to build that job later and maybe also a corresponding tox job | 14:30 |
frickler | then we can see in nova what actually is failing | 14:30 |
gmann | frickler: if we remove it from requirement repo then we have nova.cinder unit test jobs | 14:30 |
gmann | yah | 14:30 |
gmann | functional too | 14:30 |
kopecmartin | anything else to add? | 14:33 |
kopecmartin | anything else for the open discussion? | 14:33 |
gmann | nothing from me | 14:34 |
kopecmartin | #topic Bug Triage | 14:35 |
kopecmartin | #link https://etherpad.opendev.org/p/qa-bug-triage-xena | 14:35 |
kopecmartin | i recorded the numbers as always ^^ | 14:35 |
kopecmartin | i have 2 bugs to bring up | 14:35 |
kopecmartin | #link https://bugs.launchpad.net/tempest/+bug/1946321 | 14:35 |
kopecmartin | 'jsonschema' has no attribute 'compat' | 14:35 |
kopecmartin | we have a fix for master | 14:35 |
kopecmartin | #link https://review.opendev.org/c/openstack/tempest/+/812804 | 14:35 |
kopecmartin | what will we do with older releases? we can't modify tempest there :/ | 14:36 |
gmann | that is fixed by this #link https://review.opendev.org/c/openstack/devstack/+/812092 | 14:36 |
gmann | we need to use the latest compatible version on stable branches where we use old tempest | 14:36 |
kopecmartin | that makes sense | 14:37 |
kopecmartin | ok then, gmann please review this when you have a moment | 14:38 |
gmann | we have a set of compatible tempest version for any stable branch so using any version from that range works | 14:38 |
kopecmartin | #link https://review.opendev.org/c/openstack/tempest/+/812804 | 14:38 |
gmann | ah sure, i thought I did :) will re-review | 14:38 |
kopecmartin | thanks | 14:38 |
kopecmartin | another bug is this one: | 14:39 |
kopecmartin | #link https://bugs.launchpad.net/tempest/+bug/1945495 | 14:39 |
kopecmartin | test_rebuild_server fails with mismatch - fixed and floating ip type after rebuild | 14:39 |
gmann | done | 14:39 |
kopecmartin | there is a race condition in the test | 14:39 |
kopecmartin | i'm not sure how to approach that | 14:39 |
kopecmartin | we don't have any waiter for a floating ip to wait until it's attached to a vm | 14:39 |
kopecmartin | as mentioned in the comments , there is a possibility that the ip doesn't get assigned between lines 193 and 214 and that will result in the mismatch | 14:43 |
kopecmartin | #link https://opendev.org/openstack/tempest/src/commit/669900f622ce46c62260910d2cf9fa1d32216191/tempest/api/compute/servers/test_server_actions.py#L193 | 14:43 |
kopecmartin | #link https://opendev.org/openstack/tempest/src/commit/669900f622ce46c62260910d2cf9fa1d32216191/tempest/api/compute/servers/test_server_actions.py#L214 | 14:43 |
gmann | may be we can use os-interface nova APi to poll that? | 14:44 |
gmann | #link https://docs.openstack.org/api-ref/compute/?expanded=show-port-interface-details-detail | 14:44 |
kopecmartin | so basically to create a waiter - whenever the server has a floating ip attached before the rebuild, wait until the floating ip is attached after the rebuild and then continue | 14:46 |
gmann | yeah, if this is race on FIP attachment. but i have not checked the log | 14:47 |
kopecmartin | that's the only way i can image we could get to the mismatch error | 14:48 |
kopecmartin | ok ,i'll try to create that waiter and let's see | 14:49 |
kopecmartin | thanks for the consult | 14:49 |
kopecmartin | this all from my side | 14:49 |
kopecmartin | if there isn't anything else, i think we can close today's office hour | 14:50 |
gmann | nothing from me, we can close | 14:50 |
kopecmartin | thank you all and see you at the PTG next week o/ | 14:50 |
gmann | thanks kopecmartin | 14:50 |
kopecmartin | #endmeeting | 14:50 |
opendevmeet | Meeting ended Tue Oct 12 14:50:52 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:50 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/qa/2021/qa.2021-10-12-14.00.html | 14:50 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/qa/2021/qa.2021-10-12-14.00.txt | 14:50 |
opendevmeet | Log: https://meetings.opendev.org/meetings/qa/2021/qa.2021-10-12-14.00.log.html | 14:50 |
*** poojajadhav is now known as pojadhav | 15:31 | |
opendevreview | Merged openstack/whitebox-tempest-plugin master: test_volume_encryption: Correctly lookup the rbd user from XML https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/813056 | 15:49 |
opendevreview | Sophie Huang proposed openstack/tempest master: Set compute API microversion in volume API testing https://review.opendev.org/c/openstack/tempest/+/813676 | 17:15 |
opendevreview | Merged openstack/devstack master: Fix updating setuptools in Centos https://review.opendev.org/c/openstack/devstack/+/797069 | 20:43 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!