| *** mriedem has quit IRC | 00:01 | |
| *** tosky has quit IRC | 00:55 | |
| *** brinzhang has joined #openstack-qa | 01:08 | |
| *** dave-mccowan has joined #openstack-qa | 01:17 | |
| gmann | frickler: thanks, not sure how that got in even it did not fail when tox cover template was added. | 02:08 |
|---|---|---|
| openstackgerrit | Merged openstack-dev/hacking master: Fix coverage job https://review.openstack.org/624699 | 02:10 |
| *** dave-mccowan has quit IRC | 02:14 | |
| *** yamamoto has quit IRC | 02:21 | |
| *** cshen has joined #openstack-qa | 02:36 | |
| *** cshen has quit IRC | 02:40 | |
| *** hongbin has joined #openstack-qa | 02:45 | |
| openstackgerrit | Brin Zhang proposed openstack/tempest master: Add unittest for types_client https://review.openstack.org/622955 | 02:53 |
| *** yamamoto has joined #openstack-qa | 02:59 | |
| openstackgerrit | Ian Wienand proposed openstack-dev/devstack master: [wip] install bindep packages https://review.openstack.org/624852 | 03:06 |
| *** brinzhang has quit IRC | 03:28 | |
| openstackgerrit | Merged openstack/tempest master: Add irrelevant-files for grenade-py3 job https://review.openstack.org/624590 | 03:32 |
| openstackgerrit | Ian Wienand proposed openstack-dev/devstack master: [wip] install bindep packages https://review.openstack.org/624852 | 03:33 |
| *** hongbin has quit IRC | 04:20 | |
| *** mguiney has quit IRC | 04:23 | |
| *** sridharg has joined #openstack-qa | 04:24 | |
| *** yamamoto has quit IRC | 04:35 | |
| openstackgerrit | Ian Wienand proposed openstack-dev/devstack master: [wip] install bindep packages https://review.openstack.org/624852 | 05:10 |
| *** gcheresh_ has joined #openstack-qa | 05:18 | |
| *** yamamoto has joined #openstack-qa | 05:32 | |
| *** gcheresh_ has quit IRC | 05:44 | |
| *** cshen has joined #openstack-qa | 05:51 | |
| *** cshen has quit IRC | 05:56 | |
| *** gcheresh_ has joined #openstack-qa | 06:38 | |
| *** ccamposr has joined #openstack-qa | 06:51 | |
| *** slaweq has joined #openstack-qa | 06:57 | |
| *** rcernin has quit IRC | 07:09 | |
| *** pcaruana has joined #openstack-qa | 07:12 | |
| openstackgerrit | Brin Zhang proposed openstack/tempest master: Add unittest for types_client https://review.openstack.org/622955 | 07:13 |
| *** yamamoto has quit IRC | 07:14 | |
| *** cshen has joined #openstack-qa | 07:22 | |
| *** artom has quit IRC | 07:29 | |
| *** artom has joined #openstack-qa | 07:31 | |
| *** artom has quit IRC | 07:31 | |
| *** artom has joined #openstack-qa | 07:32 | |
| *** Luzi has joined #openstack-qa | 07:33 | |
| *** kopecmartin|off is now known as kopecmartin | 07:35 | |
| *** aojea has joined #openstack-qa | 07:42 | |
| *** shardy has joined #openstack-qa | 07:55 | |
| *** gfidente has joined #openstack-qa | 07:55 | |
| *** gfidente is now known as gfidente|off | 07:56 | |
| *** rossella_s has joined #openstack-qa | 08:00 | |
| *** yamamoto has joined #openstack-qa | 08:30 | |
| openstackgerrit | xulei proposed openstack-dev/grenade master: Delete invalid URL. https://review.openstack.org/624290 | 08:38 |
| *** brinzhang has joined #openstack-qa | 08:45 | |
| openstackgerrit | Yang Youseok proposed openstack/os-testr master: Add --failing option to run only failed testcases https://review.openstack.org/624893 | 08:46 |
| openstackgerrit | xulei proposed openstack-dev/grenade master: Modify invalid URL. https://review.openstack.org/624289 | 08:47 |
| *** yamamoto has quit IRC | 08:47 | |
| *** brinzh has joined #openstack-qa | 08:48 | |
| *** brinzhang has quit IRC | 08:50 | |
| gmann | QA office hour time | 09:00 |
| gmann | #startmeeting qa | 09:00 |
| openstack | Meeting started Thu Dec 13 09:00:40 2018 UTC and is due to finish in 60 minutes. The chair is gmann. Information about MeetBot at http://wiki.debian.org/MeetBot. | 09:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 09:00 |
| *** openstack changes topic to " (Meeting topic: qa)" | 09:00 | |
| openstack | The meeting name has been set to 'qa' | 09:00 |
| gmann | who all here today ? | 09:00 |
| mbindlish | hi | 09:01 |
| *** jpena|off is now known as jpena | 09:04 | |
| gmann | mbindlish: hi | 09:05 |
| gmann | let's start | 09:05 |
| gmann | #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours | 09:05 |
| gmann | ^^ updated the agenda | 09:05 |
| gmann | #topic Announcement and Action Item (Optional) | 09:05 |
| *** openstack changes topic to "Announcement and Action Item (Optional) (Meeting topic: qa)" | 09:05 | |
| *** cshen has quit IRC | 09:06 | |
| gmann | announcement is about moving the devstack/tempest base jobs to Bionic. patches are merged and till now it is running smoothly | 09:06 |
| *** cshen has joined #openstack-qa | 09:06 | |
| gmann | at least we have not heard any issue due to bionic | 09:06 |
| gmann | #topic Stein Priority Items progress | 09:07 |
| mbindlish | +1 | 09:07 |
| *** openstack changes topic to "Stein Priority Items progress (Meeting topic: qa)" | 09:07 | |
| gmann | #link https://etherpad.openstack.org/p/qa-stein-priority | 09:07 |
| gmann | 1. Planning for Patrole Stable release - felipemonteiro, gmann | 09:07 |
| gmann | i need to check the items pending for that and check with felipe on those. | 09:08 |
| gmann | 2. Zuul v3 native jobs - tosky | 09:08 |
| gmann | devstack patch is merged for this. last i talk to tosky, he will continue on this once he finish his priority sahara work. | 09:09 |
| gmann | i am jumping to 6 directly as i did not see any updates on others | 09:10 |
| gmann | 6. Tempest CLI unit tests improvement - mguiney, mbindlish | 09:10 |
| gmann | mbindlish: what is status and what all pending on this ? | 09:10 |
| mbindlish | currently working on account generator, already finished for tempest workspace and tempest run | 09:11 |
| gmann | did we finish all the scenario for tempest workspace and run ? | 09:11 |
| mbindlish | let me check for tempest run..90% are completed...but completed for workspace | 09:12 |
| openstackgerrit | Yang Youseok proposed openstack/os-testr master: Add --failing option to run only failed testcases https://review.openstack.org/624893 | 09:12 |
| gmann | all the scenario i mean all possible combination of all possible param of those CLI in term of positive and negative behaviour | 09:12 |
| mbindlish | I think i have done. but will check again all items, if found anything miss, will add them | 09:13 |
| gmann | ok, thanks | 09:13 |
| gmann | mbindlish: also, are you topicing all your CLI test changes to this BP - https://review.openstack.org/#/q/topic:bp/tempest-cli-unit-test-coverage+(status:open+OR+status:merged) | 09:14 |
| gmann | i am seeing only 3 patch ^^ | 09:14 |
| mbindlish | @gmann https://blueprints.launchpad.net/tempest/+spec/tempest-cli-unit-test-coverage | 09:15 |
| mbindlish | Anything else need to add somewhere | 09:15 |
| mbindlish | In this link, mentioned all the pushed patches | 09:15 |
| gmann | ok | 09:16 |
| gmann | 7. Proper handling of interface/volume/pci devece attach/detach hotplug/unplug in tempest - afazekas | 09:16 |
| gmann | i think this is done. afazekas ? | 09:16 |
| gmann | 11 Migration from Launchpad to storyboard - gmann | 09:16 |
| gmann | i have added the story for required itesm | 09:17 |
| gmann | - Response Scema validation for other component like cinder -zhufl | 09:17 |
| gmann | she has good progress on this but we are holding that till we hear form interop team | 09:17 |
| gmann | i will ping interop team to respond on this after mark reply | 09:18 |
| gmann | that's all from stein tracking | 09:18 |
| gmann | #topic OpenStack Events Updates and Planning | 09:18 |
| *** openstack changes topic to "OpenStack Events Updates and Planning (Meeting topic: qa)" | 09:18 | |
| gmann | next will be Denver summit and PTG in April end 2019. so we have time so skipping that as of now | 09:19 |
| gmann | #topic Sub Teams highlights (Sub Teams means individual projects under QA program) | 09:19 |
| *** openstack changes topic to "Sub Teams highlights (Sub Teams means individual projects under QA program) (Meeting topic: qa)" | 09:19 | |
| gmann | Tempest | 09:19 |
| gmann | #link https://review.openstack.org/#/q/project:openstack/tempest+status:open | 09:19 |
| gmann | open reviews | 09:20 |
| gmann | patrole | 09:20 |
| gmann | mbindlish: anything you following in patrole ? | 09:20 |
| mbindlish | not yet in patrole | 09:20 |
| gmann | ok, did you start the patrole coverage for neutron ? | 09:20 |
| mbindlish | currently focusing in tempest cli | 09:21 |
| gmann | k | 09:21 |
| mbindlish | have to start for patrole | 09:21 |
| gmann | #topic Bug Triage | 09:21 |
| *** openstack changes topic to "Bug Triage (Meeting topic: qa)" | 09:21 | |
| gmann | mbindlish: your turn | 09:22 |
| mbindlish | https://etherpad.openstack.org/p/QA-Stein-Bug-Triage | 09:22 |
| mbindlish | First 4 we already discussed | 09:22 |
| mbindlish | 5th was also discussed but you have to add some concluded comment on that | 09:23 |
| gmann | mbindlish: progress on L9 is of this week ? | 09:23 |
| mbindlish | new bugs reduced to 32 from 34 | 09:24 |
| gmann | and is it whole QA or just tempest ? | 09:24 |
| mbindlish | this is tempest | 09:24 |
| mbindlish | I have to add for complete QA, I forgot | 09:25 |
| mbindlish | will add in next week's report for complete QA | 09:25 |
| gmann | i need to find out what all sub project you can add but at least tempest, devstack, grenade, patrole etc | 09:26 |
| *** yamamoto has joined #openstack-qa | 09:26 | |
| gmann | mbindlish: go ahead | 09:27 |
| mbindlish | sure, i will add these | 09:27 |
| mbindlish | https://bugs.launchpad.net/tempest/+bug/1708550 | 09:27 |
| openstack | Launchpad bug 1708550 in tempest "Some network tests do not use preprovisioned networks" [Undecided,New] | 09:27 |
| mbindlish | you need to add concluded comment on this | 09:27 |
| mbindlish | from last week discussion | 09:27 |
| gmann | ok. | 09:28 |
| mbindlish | next is: | 09:29 |
| mbindlish | https://bugs.launchpad.net/tempest/+bug/1710845 | 09:29 |
| openstack | Launchpad bug 1710845 in tempest "Sometimes tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops fail via port in state Down" [Undecided,New] - Assigned to Sofiia Andriichenko (sandriichenko) | 09:29 |
| mbindlish | seems no progress on this | 09:29 |
| mbindlish | assigned to Sofiia | 09:30 |
| gmann | mbindlish: what is on this? i saw many patches and comement on this | 09:30 |
| gmann | mbindlish: is it confirmed ? | 09:31 |
| mbindlish | When I tried, no problem was occured | 09:32 |
| mbindlish | but seems some times this issue occur due to time | 09:32 |
| gmann | you are saying it is not reproducible ? | 09:32 |
| mbindlish | may be not always, sometimes it can occur | 09:33 |
| gmann | means it is reproducible. then did you find what is issue on this ? | 09:33 |
| mbindlish | so need to try its run multiple times | 09:33 |
| gmann | any investigation | 09:33 |
| gmann | because asking author might not get much response. i feel triage more like doing complete investigation from our side and if anything needed then, mark it as incomplete | 09:34 |
| mbindlish | let me try it more 2-3 times | 09:34 |
| mbindlish | will confirm the neccasry action for confirm or incomplete | 09:35 |
| gmann | also check from those patches - what there were fixing, what comments from reviewer, why they got abandon | 09:35 |
| *** noama has joined #openstack-qa | 09:35 | |
| mbindlish | fine | 09:36 |
| gmann | let's move next to bug | 09:36 |
| mbindlish | https://bugs.launchpad.net/tempest/+bug/1726462 | 09:37 |
| openstack | Launchpad bug 1726462 in neutron "Various gate jobs time out waiting for vol available" [Undecided,Confirmed] | 09:37 |
| *** sshnaidm has quit IRC | 09:37 | |
| *** tosky has joined #openstack-qa | 09:37 | |
| mbindlish | no assignee of this | 09:38 |
| gmann | but is it triaged ? which side issue is ? | 09:38 |
| mbindlish | harbott confirm, this issue is hitting | 09:38 |
| gmann | yeah, i see cinder, neutron and tempest. | 09:39 |
| mbindlish | currently not investigated by me, which side it belongs too | 09:40 |
| gmann | k, let's check what is issue, is it service side or test side | 09:40 |
| mbindlish | but as per harbott..it is related to neutron | 09:40 |
| *** e0ne has joined #openstack-qa | 09:41 | |
| gmann | ok, slaweq can check ^^ | 09:41 |
| gmann | description says it is vol availability but i have not checked the details | 09:41 |
| slaweq | gmann: hi, what I should check? | 09:41 |
| gmann | slaweq: this one https://bugs.launchpad.net/tempest/+bug/1726462 | 09:42 |
| openstack | Launchpad bug 1726462 in neutron "Various gate jobs time out waiting for vol available" [Undecided,Confirmed] | 09:42 |
| gmann | it is marked confirmed on neutron. | 09:43 |
| slaweq | yes, I saw it from time to time in neutron jobs | 09:43 |
| gmann | same doubt as frickler mentioned, why neutron is confrmed on this | 09:43 |
| slaweq | but I don't have any specific examples now | 09:43 |
| slaweq | I don't know TBH :) | 09:44 |
| gmann | i think cinder bug | 09:44 |
| gmann | slaweq: ok. can you mark neutron triage accordingly. because it is confusing otherwise :) | 09:44 |
| slaweq | yes, for me it's clearly cinder issue | 09:44 |
| gmann | yeah me too | 09:44 |
| slaweq | done | 09:44 |
| gmann | slaweq: thanks. | 09:44 |
| openstackgerrit | Brin Zhang proposed openstack/tempest master: Add unittest for types_client https://review.openstack.org/622955 | 09:45 |
| mbindlish | moving to next | 09:45 |
| mbindlish | https://bugs.launchpad.net/tempest/+bug/1728886 | 09:45 |
| openstack | Launchpad bug 1728886 in tempest "test_port_security_macspoofing_port doesn't work when l2pop and arpresponding are enabled" [Undecided,New] | 09:45 |
| gmann | slaweq: you marked Triaged ? or invalid | 09:45 |
| slaweq | triaged as You said | 09:45 |
| *** markvoelker has joined #openstack-qa | 09:46 | |
| gmann | triaged i means mark to real state, invalid, incomplete, confirmed etc | 09:46 |
| slaweq | ahh, ok | 09:46 |
| slaweq | sorry | 09:46 |
| gmann | not as Triaged state :) it is confusign | 09:46 |
| slaweq | ok, set to invalid | 09:47 |
| gmann | slaweq: thanks again | 09:47 |
| slaweq | yw | 09:47 |
| gmann | mbindlish: next one | 09:47 |
| mbindlish | https://bugs.launchpad.net/tempest/+bug/1728886 | 09:47 |
| openstack | Launchpad bug 1728886 in tempest "test_port_security_macspoofing_port doesn't work when l2pop and arpresponding are enabled" [Undecided,New] | 09:47 |
| gmann | slaweq: again for you to get more input ^^, but not now when ever you have time | 09:48 |
| gmann | next | 09:50 |
| mbindlish | moving to next | 09:50 |
| mbindlish | https://bugs.launchpad.net/tempest/+bug/1733498 | 09:50 |
| openstack | Launchpad bug 1733498 in tempest "image.v1.test_image_members failed for “The success code is different than the expected one“" [Undecided,New] - Assigned to Ghanshyam Mann (ghanshyammann) | 09:50 |
| gmann | yeah this one i think i remember, I need to add the v1 tests on separate job | 09:51 |
| gmann | i will check the state of that patch | 09:51 |
| mbindlish | ok | 09:52 |
| gmann | i think few tests were failing for v1 but i did not check the state later | 09:52 |
| mbindlish | next: https://bugs.launchpad.net/tempest/+bug/1741373 | 09:53 |
| openstack | Launchpad bug 1741373 in tempest "create network resource crashes with dynmaic creds" [Undecided,New] | 09:53 |
| mbindlish | there is no update on this from long time | 09:54 |
| gmann | mbindlish: same thing, is this happening on gate or were you able reproduce locally ? | 09:54 |
| mbindlish | I personaly not tried to reproduce this issue, i will check this in this week | 09:55 |
| gmann | k | 09:56 |
| mbindlish | next: https://bugs.launchpad.net/tempest/+bug/1756262 | 09:56 |
| openstack | Launchpad bug 1756262 in tempest "auth_method is not getting set during tempest run using stestr" [Undecided,New] | 09:56 |
| mbindlish | I treid to reproduce it, but not reproducible | 09:56 |
| gmann | yeah, we take auth_method in considration and only keypair is supported as of now | 10:00 |
| gmann | i will also comment on that | 10:00 |
| gmann | time is up seem | 10:00 |
| mbindlish | yeah | 10:00 |
| gmann | mbindlish: thanks, let's work on bug things as we discussed today | 10:00 |
| gmann | #topic Critical Reviews | 10:00 |
| *** openstack changes topic to "Critical Reviews (Meeting topic: qa)" | 10:00 | |
| mbindlish | sure | 10:00 |
| gmann | any critical review ? | 10:00 |
| mbindlish | not from my side | 10:01 |
| gmann | #topic Open Discussion | 10:01 |
| *** openstack changes topic to "Open Discussion (Meeting topic: qa)" | 10:01 | |
| gmann | one bug is listed there- | 10:01 |
| gmann | This bug https://bugs.launchpad.net/tempest/+bug/1783369 is not seen with Swift but affects testing Ceph RGW; anybody willing to look into it? [gfidente] | 10:01 |
| openstack | Launchpad bug 1783369 in tempest "Some ojectstorage tests use skip_path() and assume swift is deployed on the /" [Undecided,Confirmed] | 10:01 |
| gmann | need to investigate this first, nothing to discuss as of now i think | 10:02 |
| gmann | thanks for joining, that's it form today office hour | 10:02 |
| gmann | #endmeeting | 10:02 |
| *** openstack changes topic to "Discussion of OpenStack Quality Assurance Projects (tempest, devstack, grenade, and friends) | docs https://wiki.openstack.org/wiki/QA | specs https://review.openstack.org/#/q/project:openstack/qa-specs | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-qa/" | 10:02 | |
| openstack | Meeting ended Thu Dec 13 10:02:54 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 10:02 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/qa/2018/qa.2018-12-13-09.00.html | 10:02 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/qa/2018/qa.2018-12-13-09.00.txt | 10:02 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/qa/2018/qa.2018-12-13-09.00.log.html | 10:02 |
| *** gfidente|off has quit IRC | 10:03 | |
| *** gfidente has joined #openstack-qa | 10:07 | |
| *** sshnaidm has joined #openstack-qa | 10:20 | |
| *** mvkr has quit IRC | 10:24 | |
| afazekas | gmann: Not all volume case handled yet | 10:26 |
| gmann | afazekas: ok. | 10:37 |
| *** sshnaidm has quit IRC | 10:50 | |
| *** dtantsur|afk is now known as dtantsur | 10:53 | |
| *** mvkr has joined #openstack-qa | 10:56 | |
| openstackgerrit | Jens Harbott (frickler) proposed openstack-dev/devstack master: Update cirros version https://review.openstack.org/624716 | 11:12 |
| *** yamamoto has quit IRC | 11:13 | |
| *** mvkr has quit IRC | 11:16 | |
| frickler | clarkb: ^^ smoser prepared a new cirros version 0.3.6 that contains just the fix to provide more space on /run. I think we should merge this one and tackle moving to 0.4.0 early next year | 11:16 |
| *** mvkr has joined #openstack-qa | 11:16 | |
| gmann | frickler: after re-analysis i added comment in this bug which is different than what i agreed on last office hour - https://bugs.launchpad.net/tempest/+bug/1708550 | 11:26 |
| openstack | Launchpad bug 1708550 in tempest "Some network tests do not use preprovisioned networks" [Undecided,New] | 11:26 |
| frickler | gmann: hmm, I kind of agree, but maybe the NetworksTest class could be split up into tests that can run against a pre-existing network, like test_(list|show)*, and others that create/delete something https://github.com/openstack/tempest/blob/16.1.0/tempest/api/network/test_networks.py#L147 | 11:36 |
| frickler | that would simplify things for people wanting to run against pre-provisioned ressources only | 11:36 |
| frickler | but maybe wait for a comment from the bug reporter whether it fits with his expectations | 11:37 |
| gmann | sure. | 11:39 |
| *** yamamoto has joined #openstack-qa | 11:51 | |
| *** yamamoto has quit IRC | 11:51 | |
| *** yamamoto has joined #openstack-qa | 11:52 | |
| *** yamamoto has quit IRC | 11:56 | |
| *** yamamoto has joined #openstack-qa | 12:04 | |
| *** raildo has joined #openstack-qa | 12:08 | |
| *** sshnaidm has joined #openstack-qa | 12:12 | |
| *** shrasool has joined #openstack-qa | 12:14 | |
| openstackgerrit | Tetsuro Nakamura proposed openstack-dev/grenade master: Create config file before database migrate https://review.openstack.org/620485 | 12:18 |
| *** markvoelker has quit IRC | 12:24 | |
| *** brinzh has quit IRC | 12:32 | |
| *** lewo has joined #openstack-qa | 12:41 | |
| *** mriedem has joined #openstack-qa | 12:42 | |
| *** yamamoto has quit IRC | 12:49 | |
| *** e0ne has quit IRC | 12:51 | |
| *** yamamoto has joined #openstack-qa | 12:51 | |
| *** jpena is now known as jpena|lunch | 13:01 | |
| openstackgerrit | Jens Harbott (frickler) proposed openstack-dev/devstack master: Set proxy-initial-not-pooled to 1 https://review.openstack.org/624986 | 13:05 |
| *** rh-jelabarre has quit IRC | 13:05 | |
| frickler | clarkb: mriedem: ^^ I think we might need this for the mod_proxy errors | 13:06 |
| mriedem | heh yeah i guess so https://serverfault.com/questions/206738/intermittent-error-when-using-mod-proxy-to-do-reverse-proxy-to-soap-service | 13:10 |
| mriedem | if only the actual docs would mention that http://httpd.apache.org/docs/2.2/mod/mod_proxy_http.html | 13:10 |
| *** markvoelker has joined #openstack-qa | 13:10 | |
| mriedem | https://stackoverflow.com/questions/169453/bad-gateway-502-error-with-apache-mod-proxy-and-tomcat also suggests setting "SetEnv proxy-nokeepalive 1" | 13:12 |
| mriedem | but i guess we already do that https://review.openstack.org/#/c/624986/1/lib/tls@542 | 13:13 |
| frickler | mriedem: no, clarkb's version was just "SetEnv proxy-nokeepalive" which seeing the continued hits on logstash I assume is not enough | 13:15 |
| mriedem | you mean proxy-initial-not-pooled | 13:15 |
| frickler | ah, wait, that's a different option | 13:15 |
| mriedem | but yeah | 13:15 |
| mriedem | right i'm thinking about this other latent issue we still hit a lot http://status.openstack.org/elastic-recheck/#1763070 | 13:16 |
| mriedem | that was added with https://review.openstack.org/#/c/433738/ | 13:16 |
| mriedem | but looking at http://httpd.apache.org/docs/2.2/mod/mod_proxy_http.html, that should be "SetEnv proxy-nokeepalive 1" i would think? | 13:17 |
| frickler | I think we can add that, too. maybe not at the same time though, better wait a day or so in between so that we can better judge the effect of each change | 13:20 |
| mriedem | agree | 13:20 |
| openstackgerrit | Matt Riedemann proposed openstack-dev/devstack master: docs: cleanup install docs https://review.openstack.org/624992 | 13:35 |
| *** e0ne has joined #openstack-qa | 13:35 | |
| mriedem | frickler: see my comment here https://review.openstack.org/#/c/624986/1/lib/tls@509 | 13:48 |
| mriedem | i think we might not even be using this code... | 13:48 |
| mriedem | yeah i don't see "start_tls_proxy nova" in the devstack logs | 13:49 |
| *** e0ne has quit IRC | 13:49 | |
| mriedem | looks like keystone, swift, glance and neutron use it, but not nova or cinder | 13:50 |
| *** irclogbot_2 has quit IRC | 13:50 | |
| frickler | mriedem: oh, indeed that would also be a good reason to not see any improvement | 13:51 |
| openstackgerrit | Eric Harney proposed openstack/devstack-plugin-ceph master: Test attach encrypted volume on stable branches https://review.openstack.org/624423 | 13:51 |
| *** tosky has quit IRC | 13:56 | |
| *** e0ne has joined #openstack-qa | 13:57 | |
| *** yamamoto has quit IRC | 13:59 | |
| *** yamamoto has joined #openstack-qa | 14:00 | |
| *** tosky has joined #openstack-qa | 14:00 | |
| openstackgerrit | Merged openstack/devstack-plugin-ceph master: Test attach encrypted volume https://review.openstack.org/570015 | 14:00 |
| frickler | mriedem: o.k., so nova-api and nova-api-meta get deployed as uwsgi services directly, which means we shouldn't be seeing mod_proxy timeouts for these. or do you have logs showing the opposite? | 14:02 |
| *** markvoelker has quit IRC | 14:03 | |
| mriedem | haven't dug into it yet, but what i've seen is glance api issues | 14:03 |
| mriedem | which is running with mod_wsgi | 14:03 |
| *** yamamoto has quit IRC | 14:05 | |
| *** irclogbot_2 has joined #openstack-qa | 14:09 | |
| *** irclogbot_2 has quit IRC | 14:19 | |
| *** irclogbot_2 has joined #openstack-qa | 14:32 | |
| *** markvoelker has joined #openstack-qa | 14:36 | |
| *** yamamoto has joined #openstack-qa | 14:44 | |
| *** awaugama has joined #openstack-qa | 14:48 | |
| *** ondrejme has quit IRC | 14:50 | |
| *** cshen has quit IRC | 14:51 | |
| frickler | slaweq: gmann: fyi, neutron-tempest-plugin-dvr-multinode-scenario-queens is now running on bionic and fails, will make a patch to pin to xenial | 14:55 |
| frickler | gmann: also nodepool jobs are failing on bionic, one of the "niche" projects that didn't get tested. but easy fix to pin to xenial, too: https://review.openstack.org/624855 | 14:56 |
| slaweq | frickler: thx, please pin also rocky version to xenial | 14:58 |
| *** rh-jelabarre has joined #openstack-qa | 15:04 | |
| gmann | frickler: neutron-tempest-plugin-dvr-multinode-scenario-queens make sense to run on xenial | 15:10 |
| gmann | but nodepool also ? | 15:10 |
| frickler | gmann: nodepool needs a zypper pkgs in order to build suse images and that seems not to be available in bionic (yet?) | 15:13 |
| frickler | gmann: see https://review.openstack.org/614216 for the neutron-tempest-plugin change | 15:13 |
| gmann | yeah, neutron plugin is the only one i think which test stable jobs on master gate like tempest | 15:14 |
| frickler | lennyb: do you happen to be on centos with mysql 5.6? I found https://stackoverflow.com/questions/1814532/1071-specified-key-was-too-long-max-key-length-is-767-bytes | 15:16 |
| frickler | lennyb: in fact, that's where I saw this: http://logs.openstack.org/86/624986/1/check/devstack-platform-centos-7/893f067/job-output.txt.gz#_2018-12-13_13_43_54_348189 | 15:17 |
| frickler | ianw: ^^ you might be interested in this, too. looks like cinder may have broken themselves on centos-7 by this? | 15:18 |
| *** gcheresh_ has quit IRC | 15:24 | |
| *** sridharg has quit IRC | 15:25 | |
| *** cshen has joined #openstack-qa | 15:32 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck master: Identify DLRN builds fail intermittently (network errors) https://review.openstack.org/620950 | 15:35 |
| *** cshen has quit IRC | 15:36 | |
| *** cshen has joined #openstack-qa | 15:37 | |
| *** markvoelker has quit IRC | 15:38 | |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/elastic-recheck master: Query: [primary] Waiting on logger https://review.openstack.org/622210 | 15:42 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/elastic-recheck master: Query: [primary] Waiting on logger https://review.openstack.org/622210 | 15:42 |
| *** Luzi has quit IRC | 15:52 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck master: Identify DLRN builds fail intermittently (network errors) https://review.openstack.org/620950 | 16:03 |
| *** jpena|lunch is now known as jpena | 16:08 | |
| openstackgerrit | Matt Riedemann proposed openstack-dev/devstack stable/rocky: Make sure nova-compute is not configured with database access https://review.openstack.org/625039 | 16:09 |
| *** morgan is now known as kmalloc | 16:09 | |
| openstackgerrit | Dan Smith proposed openstack-dev/devstack stable/rocky: Make sure nova-compute is not configured with database access https://review.openstack.org/625039 | 16:12 |
| dansmith | gah | 16:12 |
| dansmith | wait, what | 16:13 |
| dansmith | mriedem: gerrit de-duped our backports? | 16:13 |
| dansmith | mriedem: well, sorry, I overwrote your change, so you might want to resubmit with your bug reference | 16:14 |
| openstackgerrit | Matt Riedemann proposed openstack-dev/devstack stable/rocky: Make sure nova-compute is not configured with database access https://review.openstack.org/625039 | 16:14 |
| mriedem | you pushed from local didn't you | 16:14 |
| dansmith | yes | 16:16 |
| clarkb | frickler: mriedem tge one I debugged was glance which is proxied | 16:16 |
| mriedem | clarkb: frickler: yeah i think what i've noticed is proxy failures from glance via nova, | 16:17 |
| mriedem | for things like creating a server snapshot | 16:17 |
| mriedem | so that makes sense | 16:17 |
| clarkb | also is nova using ssl directly if not proxied or did we break nova api + ssl? | 16:20 |
| *** noama has quit IRC | 16:24 | |
| *** e0ne has quit IRC | 16:30 | |
| *** e0ne has joined #openstack-qa | 16:30 | |
| mriedem | clarkb: you mean when nova goes through glanceclient? | 16:33 |
| clarkb | no for the nova and cinder apis you said they dont use tls proxy | 16:33 |
| clarkb | whoch implies to me we dont deploy them with tls/ssl in devstack anymore? | 16:34 |
| mriedem | devstack isn't using that start_tls_proxy function for nova/cinder right | 16:34 |
| mriedem | it's using uwsgi | 16:34 |
| mriedem | we aren't configuring nova to talk to other services over ssl either | 16:35 |
| clarkb | ya when we fisrt set this up we ran tls proxy for all services and proxied to uwsgi | 16:35 |
| clarkb | so this is a pretty big regression imo if we've undone that | 16:35 |
| clarkb | or is nova uwsgi terminating ssl itself? | 16:36 |
| clarkb | if so that should be fine | 16:36 |
| frickler | clarkb: iiuc, apache listens on port 443, terminates the ssl and proxies to nova uwsgi via a unix socket. or maybe proxies to itself on port 80 and proxies to nova there, I'm not sure on that yet | 16:40 |
| *** tosky has quit IRC | 16:43 | |
| *** tosky has joined #openstack-qa | 16:44 | |
| *** shrasool has quit IRC | 16:45 | |
| clarkb | frickler: mriedem looking at http://logs.openstack.org/84/623284/4/check/tempest-full-py3/da5f856/controller/logs/apache_config/ I think mriedem is right we don't seem to tls those services anymore | 16:55 |
| clarkb | (not like I had remembed at least) | 16:55 |
| clarkb | but as frickler says http://logs.openstack.org/84/623284/4/check/tempest-full-py3/da5f856/controller/logs/apache_config/http-services-tls-proxy_conf.txt.gz listens on 443 and redirects to 80 then the uwsgi unix socket should get that at /compute | 16:55 |
| clarkb | so I think as long as services are hitting localhost:443/compute it will go through the proxy, but if they hit some uwsgi port directly they wont | 16:56 |
| *** cshen has quit IRC | 17:01 | |
| *** cshen has joined #openstack-qa | 17:02 | |
| *** ccamposr has quit IRC | 17:03 | |
| *** ramishra has quit IRC | 17:06 | |
| *** dtantsur is now known as dtantsur|afk | 17:27 | |
| clarkb | frickler: I +2'd https://review.openstack.org/#/c/624716/2 but left a note about how we cache images on the infra test nodes. Meaning we may want to approve that later on friday so that we can build new images over hte weekend | 17:41 |
| clarkb | gmann: ^ maybe you can review that too. I do think we want to get it in to fix the config drive issues we have been having since we have basically not been testing that properly I don't think | 17:42 |
| *** aojea has quit IRC | 17:42 | |
| *** gfidente is now known as gfidente|afk | 17:48 | |
| *** mnaser has joined #openstack-qa | 17:50 | |
| mnaser | mtreinish: around? we've ran into this thing in stestr in OSA where since adding the --subunit flag, we get a 0 exit code even if the tests fail | 17:51 |
| *** sshnaidm is now known as sshnaidm|off | 18:01 | |
| *** kopecmartin is now known as kopecmartin|off | 18:01 | |
| *** e0ne has quit IRC | 18:11 | |
| *** e0ne has joined #openstack-qa | 18:15 | |
| *** e0ne has quit IRC | 18:16 | |
| *** jpena is now known as jpena|off | 18:38 | |
| *** mvkr has quit IRC | 18:40 | |
| frickler | clarkb: thx, I did set w-1 for now, can merge saturday morning before new images are built | 18:42 |
| *** shardy has quit IRC | 18:46 | |
| openstackgerrit | Nicolas Helgeson proposed openstack/tempest master: Immutable user source: test_users_negative https://review.openstack.org/588395 | 18:55 |
| openstackgerrit | Nicolas Helgeson proposed openstack/tempest master: Immutable user source: test_credentials https://review.openstack.org/587878 | 18:55 |
| openstackgerrit | Nicolas Helgeson proposed openstack/tempest master: Immutable user source: test_default_project_id https://review.openstack.org/588393 | 18:55 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/elastic-recheck master: Include query results in graph https://review.openstack.org/260188 | 19:00 |
| *** mvkr has joined #openstack-qa | 19:21 | |
| *** gcheresh_ has joined #openstack-qa | 19:24 | |
| *** cshen has quit IRC | 19:43 | |
| *** pcaruana has quit IRC | 19:47 | |
| *** cshen has joined #openstack-qa | 19:49 | |
| *** e0ne has joined #openstack-qa | 19:53 | |
| *** shrasool has joined #openstack-qa | 19:54 | |
| *** tosky has quit IRC | 19:56 | |
| *** tosky has joined #openstack-qa | 19:57 | |
| *** e0ne has quit IRC | 19:58 | |
| *** gcheresh_ has quit IRC | 20:14 | |
| *** cshen has quit IRC | 21:02 | |
| *** mriedem has quit IRC | 21:02 | |
| *** markvoelker has joined #openstack-qa | 21:11 | |
| *** raildo has quit IRC | 21:21 | |
| *** cshen has joined #openstack-qa | 21:24 | |
| *** mriedem has joined #openstack-qa | 21:26 | |
| *** rh-jelabarre has quit IRC | 21:35 | |
| openstackgerrit | melanie witt proposed openstack-dev/devstack master: Run nova-consoleauth only if cells v1 is enabled https://review.openstack.org/607070 | 21:40 |
| openstackgerrit | melanie witt proposed openstack-dev/devstack master: Run nova-consoleauth only if cells v1 is enabled https://review.openstack.org/607070 | 21:41 |
| *** markvoelker has quit IRC | 22:06 | |
| *** shrasool has quit IRC | 22:18 | |
| *** rcernin has joined #openstack-qa | 22:21 | |
| *** lbragstad has quit IRC | 22:37 | |
| openstackgerrit | Eric Harney proposed openstack/devstack-plugin-ceph master: Remove slow tests from blacklist https://review.openstack.org/625130 | 22:48 |
| *** cshen has quit IRC | 22:57 | |
| *** cshen has joined #openstack-qa | 23:00 | |
| *** cshen has quit IRC | 23:08 | |
| openstackgerrit | Matt Riedemann proposed openstack-dev/devstack stable/queens: Make sure nova-compute is not configured with database access https://review.openstack.org/625131 | 23:19 |
| *** tosky has quit IRC | 23:27 | |
| *** Sasikiran has joined #openstack-qa | 23:38 | |
| *** slaweq has quit IRC | 23:40 | |
| *** mriedem has quit IRC | 23:41 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!