| *** rpittau|afk is now known as rpittau | 07:07 | |
| opendevreview | lkk proposed openstack/tempest master: API for list group types by parameter limit/sort https://review.opendev.org/c/openstack/tempest/+/801432 | 09:24 |
|---|---|---|
| opendevreview | Martin Kopec proposed openstack/devstack stable/wallaby: libvirt: Stop installing python bindings from pip https://review.opendev.org/c/openstack/devstack/+/801434 | 09:45 |
| opendevreview | Martin Kopec proposed openstack/devstack stable/victoria: libvirt: Stop installing python bindings from pip https://review.opendev.org/c/openstack/devstack/+/801435 | 09:46 |
| kopecmartin | #startmeeting qa | 14:00 |
| opendevmeet | Meeting started Tue Jul 20 14:00:30 2021 UTC and is due to finish in 60 minutes. The chair is kopecmartin. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| opendevmeet | The meeting name has been set to 'qa' | 14:00 |
| kopecmartin | #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours | 14:00 |
| kopecmartin | agenda ^^ | 14:00 |
| gmann | o/ | 14:00 |
| yoctozepto | \o/ | 14:00 |
| kopecmartin | let's start | 14:01 |
| kopecmartin | hi all | 14:01 |
| kopecmartin | #topic Announcement and Action Item | 14:01 |
| kopecmartin | no announcements from my side | 14:02 |
| gmann | one for Tempest | 14:02 |
| kopecmartin | oh, yeah | 14:02 |
| kopecmartin | sorry :D | 14:02 |
| gmann | we have train end of support release coming up 28.0.0 | 14:02 |
| gmann | oh we did | 14:02 |
| gmann | so patch is merged and 28.0.0 is available now | 14:02 |
| kopecmartin | yup, shall we merge the revert for tox.ini changes? | 14:03 |
| gmann | ok not yet, we need approval on #link https://review.opendev.org/c/openstack/releases/+/801133 | 14:03 |
| gmann | kopecmartin: yeah, we need to do that, patch is up for merge #link https://review.opendev.org/c/openstack/tempest/+/801174 | 14:03 |
| gmann | release patch can merge without issue and we can revert tox update. | 14:04 |
| gmann | we should have merge it at same time we merged the tox constraint | 14:04 |
| kopecmartin | +A | 14:04 |
| gmann | luckily wallaby constraints did not break gate so we did not see failure. at least in tempest and devstack gate | 14:04 |
| gmann | thanks | 14:05 |
| gmann | that is all from me | 14:05 |
| kopecmartin | #topic Xena Priority Items progress | 14:05 |
| kopecmartin | any updates? | 14:05 |
| kopecmartin | none from my side unfortunately :/ | 14:05 |
| gmann | I have marked run-tempest one completed | 14:06 |
| kopecmartin | #link https://etherpad.opendev.org/p/qa-xena-priority | 14:06 |
| gmann | this week or next I will continue work on installing tempest master for plugins testing. | 14:06 |
| kopecmartin | great! | 14:06 |
| gmann | I remembered it worked with requirement update but need to recheck and get fresh log/memory | 14:07 |
| kopecmartin | i have an update actually - Remove/migrate the .testr.conf to .stestr effort | 14:07 |
| gmann | for system scope support, can we merge these patches? #link https://review.opendev.org/c/openstack/devstack/+/778945/2 | 14:07 |
| kopecmartin | it would consider that done - the migration effort | 14:07 |
| gmann | #link https://review.opendev.org/c/openstack/devstack/+/779085/1 | 14:07 |
| * kopecmartin looking | 14:07 | |
| gmann | kopecmartin: +1 | 14:08 |
| gmann | kopecmartin: you are +2 but holding for anotehr company reviewer | 14:08 |
| gmann | we do not actually have such rule in Devstack as most of you are form redhat :) | 14:08 |
| kopecmartin | :) ok then | 14:08 |
| gmann | frickler_pto: yoctozepto correct me if I am wrong | 14:08 |
| yoctozepto | I am not from redhat :-) | 14:09 |
| gmann | kopecmartin: and I remember rule in other project is author + all reviewer should not be from same company | 14:09 |
| gmann | kopecmartin: and I am too not form redhat unless you hire me :P | 14:09 |
| yoctozepto | yeah, we should try to avoid one-company merges | 14:09 |
| gmann | yeah if author + both reviewer are from same company. | 14:10 |
| kopecmartin | i already gave +a .. but yoctozepto go ahead and put your vote too | 14:10 |
| gmann | thanks | 14:10 |
| gmann | that's all on Xena priority from me | 14:11 |
| yoctozepto | kopecmartin: this is fine as gmann is not redhat | 14:11 |
| kopecmartin | yoctozepto: ack | 14:11 |
| kopecmartin | gmann: thanks | 14:11 |
| kopecmartin | anyone else? | 14:11 |
| kopecmartin | #topic OpenStack Events Updates and Planning | 14:12 |
| kopecmartin | based on the doodle | 14:12 |
| kopecmartin | #link https://doodle.com/poll/a8gakx4ca6zvtuem?utm_source=poll&utm_medium=link | 14:12 |
| kopecmartin | i booked icehouse for monday and tuesday between 3pm - 5 pm | 14:13 |
| kopecmartin | #link https://ethercalc.openstack.org/8tum5yl1bx43 | 14:13 |
| kopecmartin | for next PTG | 14:13 |
| kopecmartin | if anyone has any topic for the PTG discussion, feel free to write it here: | 14:13 |
| kopecmartin | #link https://etherpad.opendev.org/p/qa-yoga-ptg | 14:13 |
| gmann | so 2 slot of 2 hours right ? | 14:14 |
| kopecmartin | 2 slots on monday and 2 slots on tuesday , each slot is one hour | 14:14 |
| kopecmartin | right | 14:14 |
| gmann | +1, sounds good. | 14:15 |
| gmann | these should be enough but in case we will have more topic we can extend later but if really needed | 14:15 |
| kopecmartin | do we have a preference on the name of the room? havana , cactus , diablo would work as well | 14:16 |
| kopecmartin | gmann: exactly | 14:16 |
| gmann | room is fine as all are virtual :) | 14:16 |
| kopecmartin | #topic Gate Status Checks | 14:16 |
| kopecmartin | any issues? | 14:17 |
| kopecmartin | #topic Periodic jobs Status Checks | 14:18 |
| kopecmartin | #link https://zuul.openstack.org/builds?job_name=tempest-full-victoria-py3&job_name=tempest-full-ussuri-py3&job_name=tempest-full-train-py3&pipeline=periodic-stable | 14:18 |
| kopecmartin | #link https://zuul.openstack.org/builds?job_name=tempest-all&job_name=tempest-full-oslo-master&pipeline=periodic | 14:18 |
| kopecmartin | all green \o. | 14:18 |
| kopecmartin | \o/ | 14:18 |
| gmann | one is worth to mentioned about glance unified limit in devstack which is enabled now by default and if any job need different image size then it can be changed via GLANCE_LIMIT_IMAGE_SIZE_TOTAL - https://review.opendev.org/c/openstack/devstack/+/801360/2/doc/source/configuration.rst | 14:18 |
| gmann | ironic gate was broken on this for centos image. if anyone else from 3rd party complain on their large image then this ^^ is solution | 14:19 |
| kopecmartin | good to know | 14:19 |
| kopecmartin | perfect, thanks gmann for pointing that out! | 14:20 |
| kopecmartin | #link https://review.opendev.org/c/openstack/devstack/+/801360/2/doc/source/configuration.rst | 14:20 |
| gmann | also, yoctozepto what you think of making centos-8-stream as voting ? | 14:20 |
| gmann | I think that is stable enough | 14:21 |
| yoctozepto | we don't really have voting platform jobs, do we? | 14:21 |
| gmann | ubuntu one are voting via normal jobs | 14:22 |
| gmann | but it seems not so stable #link https://zuul.openstack.org/builds?job_name=devstack-platform-centos-8-stream | 14:22 |
| kopecmartin | uff | 14:23 |
| gmann | anyways let's leave than | 14:23 |
| gmann | at least for now | 14:23 |
| yoctozepto | ++ | 14:23 |
| yoctozepto | I am open to changing our policy on that | 14:23 |
| yoctozepto | but yeah, it needs more stability to persuade me | 14:23 |
| gmann | yeah | 14:24 |
| kopecmartin | #topic Sub Teams highlights | 14:25 |
| kopecmartin | #link https://review.openstack.org/#/q/project:openstack/tempest+status:open | 14:25 |
| kopecmartin | #link https://review.openstack.org/#/q/project:openstack/patrole+status:open | 14:25 |
| kopecmartin | #link https://review.openstack.org/#/q/project:openstack/devstack+status:open | 14:25 |
| kopecmartin | #link https://review.openstack.org/#/q/project:openstack/grenade+status:open | 14:25 |
| kopecmartin | #link https://review.opendev.org/#/q/project:openstack/hacking+status:open | 14:25 |
| kopecmartin | any updates from any subteam? | 14:25 |
| kopecmartin | patrole still broken .. | 14:25 |
| gmann | one patch in Tempest which will help me to debug system scope testing #link https://review.opendev.org/c/openstack/tempest/+/801132 | 14:25 |
| kopecmartin | anyway, the skips helped, so at least we know what tests to focus on | 14:25 |
| kopecmartin | #link https://review.opendev.org/c/openstack/patrole/+/660120 | 14:25 |
| gmann | yeah, did not get chance to fix patrole and that is why holding train-last tag for it | 14:26 |
| * kopecmartin checking | 14:26 | |
| kopecmartin | I'll review, we can merge new patches only after the one reverting tox.ini is merged, right? | 14:27 |
| gmann | kopecmartin: we can merge anytime, as wallaby constraints work fine | 14:27 |
| kopecmartin | ack | 14:27 |
| gmann | and on same line, I am releasing train-last for tempest plugins also so that they are compatible with Tempest train-last tag #link https://review.opendev.org/q/topic:%22train-last%22+(status:open%20OR%20status:merged) | 14:28 |
| kopecmartin | good, i'll check those later | 14:29 |
| kopecmartin | moving on, i don't see any patches with priority +1 nor +2 | 14:30 |
| kopecmartin | #link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade+OR+project:openstack/hacking) | 14:30 |
| kopecmartin | #link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade+OR+project:openstack/hacking) | 14:30 |
| kopecmartin | #topic Open Discussion | 14:30 |
| kopecmartin | anything from anyone? | 14:30 |
| gmann | nothing from me, need to hurry for internal meeting. | 14:30 |
| kopecmartin | #topic Bug Triage | 14:31 |
| kopecmartin | #link https://etherpad.opendev.org/p/qa-bug-triage-xena | 14:31 |
| kopecmartin | numbers are recorded as always | 14:31 |
| kopecmartin | i don't have any specific bug to discuss | 14:31 |
| kopecmartin | so if no one else has something to bring up, i think we're at the end of the today's meeting | 14:32 |
| kopecmartin | thank you everyone | 14:33 |
| kopecmartin | #endmeeting | 14:33 |
| opendevmeet | Meeting ended Tue Jul 20 14:33:04 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:33 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/qa/2021/qa.2021-07-20-14.00.html | 14:33 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/qa/2021/qa.2021-07-20-14.00.txt | 14:33 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/qa/2021/qa.2021-07-20-14.00.log.html | 14:33 |
| *** dviroel is now known as dviroel|lunch | 14:54 | |
| *** dviroel|lunch is now known as dviroel | 16:00 | |
| opendevreview | Merged openstack/tempest master: Switch back the tox constraint to master https://review.opendev.org/c/openstack/tempest/+/801174 | 16:42 |
| opendevreview | Merged openstack/devstack master: Add enforce_scope setting support for Cinder https://review.opendev.org/c/openstack/devstack/+/779085 | 16:42 |
| opendevreview | Merged openstack/devstack master: Add enforce_scope setting support for Glance https://review.opendev.org/c/openstack/devstack/+/778945 | 16:42 |
| *** rpittau is now known as rpittau|afk | 16:45 | |
| opendevreview | Arkady Shtempler proposed openstack/tempest master: Add missing tempest client for "QoS Limit Bandwidth" APIs + testing https://review.opendev.org/c/openstack/tempest/+/801521 | 17:54 |
| rosmaita | anyone have any ideas about these recent tempest-slow-py3 zuul job failures? https://zuul.opendev.org/t/openstack/builds?job_name=tempest-slow-py3 ... looks like a failure during create_neutron_initial_network during devstack setup | 20:03 |
| gmann | rosmaita: seems like other jobs also tempest-full-py3 also started failing since 2 hrs or so | 20:52 |
| gmann | nothing merged on devstack side related to this | 20:52 |
| rosmaita | yeah, i didn't see anything in neutron, either | 20:52 |
| rosmaita | i wonder if it's a config problem or something | 20:52 |
| rosmaita | because tempest-integrated-storage doesn't seem to be affected | 20:52 |
| rosmaita | it's hitting our cinder-plugin-ceph-tempest job too | 20:53 |
| rosmaita | same problem creating the private network, but that job isn't showing the " Task Push the CA certificate failed running on host compute1" failure that you see on tempest-slow-py3 | 20:54 |
| gmann | tempest-ipv6-only is passing | 20:55 |
| gmann | k | 20:55 |
| slaweq | rosmaita: gmann hi, I see some errors in neutron server log in that job | 21:16 |
| slaweq | I will check as first thing tomorrow morning as now I really don't have any more power to do that | 21:17 |
| rosmaita | slaweq: ack, thanks for looking, tomorrow is fine! | 21:17 |
| gmann | slaweq: this one right? https://zuul.opendev.org/t/openstack/build/334c725ac7c24f6399a4963f51b533c1/log/controller/logs/screen-q-svc.txt#2083 | 21:18 |
| gmann | slaweq: yeah tomorrow is fine. | 21:18 |
| slaweq | yes, that one | 21:18 |
| gmann | rosmaita: slaweq I am really confused between how tempest-integrated-storage|compute passing as they are same cofig | 21:18 |
| gmann | config | 21:18 |
| rosmaita | me too! | 21:19 |
| gmann | let's wait for slaweq tomorrow or if amotoki figure out something in our night time. | 21:20 |
| slaweq | I don't know it too | 21:22 |
| slaweq | but good thing is that is started failing just few hours ago | 21:23 |
| slaweq | we had 4 patches merged in neutron today | 21:23 |
| gmann | ok | 21:23 |
| slaweq | I will quickly propose revert of each of them so I should hopefully have culprit tomorrow morning | 21:23 |
| slaweq | :) | 21:23 |
| slaweq | I also opened bug https://bugs.launchpad.net/neutron/+bug/1936983 | 21:23 |
| gmann | +1, good idea | 21:23 |
| rosmaita | thanks, slaweq | 21:26 |
| slaweq | ok, for DNM reverts proposed - lets wait for results now | 21:26 |
| slaweq | and good night for today :) | 21:27 |
| gmann | slaweq: good night and thanks | 21:30 |
| opendevreview | Ghanshyam proposed openstack/tempest master: DNM: testing for bug#1936983 https://review.opendev.org/c/openstack/tempest/+/801537 | 21:33 |
| gmann | slaweq: rosmaita ^^ testing with the revert, will update depends-on one by one | 21:33 |
| rosmaita | gmann: ty, i am signing off for the day | 21:34 |
| gmann | I think neutron does not run with tempest-full/slow job, not sure if other neutron job also failing | 21:34 |
| gmann | have a good night | 21:34 |
| clarkb | gmann: coul dthat issue be due to external changes like ovs package updates or similar? | 22:14 |
| amotoki | gmann: hi, I just saw your mail on -discuss list. | 22:49 |
| gmann | clarkb: amotoki i could not find the exact reason. if that is due to external changes or neutron | 22:50 |
| amotoki | gmann: looking at local.conf in the log in https://bugs.launchpad.net/neutron/+bug/1936983, ovn backend is used. | 22:51 |
| amotoki | on the other hand, looking at a neutron review, for example https://review.opendev.org/c/openstack/neutron/+/776701 (which was one of changed merged today/yesterday), | 22:51 |
| amotoki | we have two tempest-slow job; neutron-ovs-tempest-slow and neutron-ovn-tempest-slow | 22:52 |
| amotoki | the former is voting and the latter is non-voting | 22:52 |
| amotoki | I am afraid tempest-slow in tempest is same as neutron-ovn-tempest-slow from POV of devstack configuration | 22:53 |
| gmann | amotoki: not sure if that is happening in neutron job or not, like tempest-integrated-storage|compute jobs are not failing even same config | 22:53 |
| gmann | that is big confusion | 22:53 |
| amotoki | gmann: could you look at the last log from the check queue of https://review.opendev.org/c/openstack/neutron/+/776701 ? | 22:54 |
| amotoki | gmann: neutron-ovn-tempest-slow https://zuul.opendev.org/t/openstack/build/5344d9bdec9346738499114c10a81aff : FAILURE in 30m 53s (non-voting) | 22:54 |
| amotoki | gmann: I see the same error in q-svc here. | 22:54 |
| gmann | amotoki: ah yeah same error | 22:54 |
| gmann | amotoki so 776701 is the cause, as this job passing in its revert https://zuul.opendev.org/t/openstack/build/1e92d8f927cd46ee8c79e67a982a846c | 22:57 |
| amotoki | gmann: I haven't checked others. I first check it because this change added the code which raised an exception. | 22:59 |
| amotoki | gmann: https://review.opendev.org/c/openstack/neutron/+/776701 looks like the cause | 23:00 |
| opendevreview | Ghanshyam proposed openstack/tempest master: DNM: testing for bug#1936983 https://review.opendev.org/c/openstack/tempest/+/801537 | 23:01 |
| gmann | amotoki: yeah, other seems not related and 779310 is on top of 776701 | 23:01 |
| amotoki | gmann: in the last two changes merged into neutron master, neutron-ovn-tempest-slow in the check queue of these changes succeeded, but the job in the above change failed. | 23:01 |
| gmann | yeah | 23:02 |
| amotoki | so 776701 is a parent of 779310, so we need to revert these two | 23:03 |
| amotoki | the reason we hit this is due to the mismatch in configurations between tempest jobs used globally and neutron tempest job.... | 23:04 |
| gmann | amotoki: do we need to revert 779310 ? | 23:05 |
| gmann | or 776701 enough as job passing in its revert | 23:05 |
| amotoki | gmann: haven't checked the dependency yet.... but 776701 passes ovn-tempest-slow | 23:06 |
| gmann | seems so | 23:06 |
| gmann | amotoki: logging off for today, can you please update on ML about revert or so ? | 23:07 |
| amotoki | gmann: sure | 23:07 |
| gmann | amotoki: thanks | 23:07 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!