Thursday, 2018-01-04

*** sdague has quit IRC00:18
mriedemmtreinish: what do you think might be the max number of active instances on a host at one time in a single-node job? 10?00:25
clarkbmriedem: we run tempest at num cpus / 2 which is 4 for all our current clouds so ya 10 is probably a decent guess00:26
clarkbI would expect it to be closer to 4 but iirc tempest cleanups hppen less synchronously?00:26
mtreinishclarkb, mriedem: there is one test that launches 3 guests at the same time00:27
mtreinishand if we've got 4 workers I think 10 is probably a safe max to assume00:27
mtreinishI think it realistically won't really go over 6, but there might be tests with 2 also00:28
mriedemok, we have this NumInstancesFilter in nova that defaults to 50 instances max per host,00:29
mriedemi was able to tease out a race condition in it https://review.openstack.org/#/q/topic:num-instances-filter+(status:open+OR+status:merged)00:29
mriedemso was thinking about dropping that down to 10 in the devstack test patch to see if things could fial00:29
mriedem*fail00:29
mriedemhttp://logs.openstack.org/67/529867/1/check/legacy-tempest-dsvm-neutron-multinode-full/35b6e42/logs/screen-n-sch.txt.gz#_Dec_22_18_32_11_24866200:30
mriedemReported number of instances (0) does not match the tracked number of instances (3).00:30
mtreinishmriedem: as a permanent thing or just to test?00:32
mriedemjust to test00:32
mriedemthis isn't a default filter00:32
mriedemseems like a crappy filter anyway - since number of instances on a host should matter less than the sizes of those instances00:33
mriedemunless you're doing it per aggregate and those aggregates are tied to specific flavor00:33
mriedem*flavors00:33
mtreinishyeah, it seems like a weird use case00:34
mtreinishnumber of servers doesn't really give you enough information to optimize something on00:35
mriedemidk, added by rax back in 201200:35
mriedemmaybe it was just a rate limiting thing00:35
mtreinishyeah I was thinking that, or some kind of legal thing where you can't share a host with more than few servers00:36
clarkbiirc hpcloud did the specific hosts per flavor thing00:36
mtreinishmriedem: we also can bump the concurrency if it's just to test00:45
mriedemwell, doesn't matter too much, i'm able to see the race, which is what matters. i don't understand the root cause, and likely won't spend time trying to figure it out00:50
mriedemsince it involves some of the worst parts of nova00:51
jrollmriedem: mtreinish: if you're curious, that flavor has something to do with windows licenses, I believe. something about max number of windows machines on a single hyp01:02
jroller, s/flavor/filter/01:02
mtreinishjroll: ah, that makes sense. So it was more of a legal thing01:05
jrollyep01:07
openstackgerritJames E. Blair proposed openstack/tempest master: Only run tempest-full on the master branch  https://review.openstack.org/53104601:26
*** smcginnis has quit IRC02:13
*** rfolco has quit IRC02:29
openstackgerritLiang Hao proposed openstack/tempest master: Add a negative test about server attach a volume which is in use  https://review.openstack.org/45962302:33
*** janzian has quit IRC02:56
*** kiennt26 has joined #openstack-qa03:10
*** mriedem has quit IRC03:48
*** lbragstad has quit IRC04:11
*** armax has quit IRC04:32
*** armax has joined #openstack-qa04:33
*** armax has quit IRC04:33
*** armax has joined #openstack-qa04:33
*** armax has quit IRC04:34
*** armax has joined #openstack-qa04:34
*** armax has quit IRC04:34
*** armax has joined #openstack-qa04:35
*** armax has quit IRC04:35
*** udesale has joined #openstack-qa04:37
*** ramishra has joined #openstack-qa05:03
*** ramishra has quit IRC05:20
*** zhufl has joined #openstack-qa05:37
*** ramishra has joined #openstack-qa05:39
*** armaan has quit IRC06:21
*** hongbin has joined #openstack-qa06:22
*** hongbin has quit IRC06:22
*** 07EAAP3JW has joined #openstack-qa06:42
*** 07EAAP3JW has quit IRC06:43
*** hongbin has joined #openstack-qa06:43
openstackgerritzhufl proposed openstack/tempest master: Use tenant_network if any in testcases after microversion v2.37  https://review.openstack.org/53108606:52
openstackgerritzhufl proposed openstack/tempest master: Default to using networks_client in get_tenant_network  https://review.openstack.org/53109407:09
*** ramishra has quit IRC07:10
*** ramishra has joined #openstack-qa07:12
*** agurenko has joined #openstack-qa07:19
*** agurenko has quit IRC07:29
*** agurenko has joined #openstack-qa07:32
*** pcaruana has joined #openstack-qa07:32
openstackgerritzhufl proposed openstack/tempest master: Wait for server to be active in test_device_tagging  https://review.openstack.org/53110007:34
*** AJaeger has quit IRC07:44
*** zhufl has quit IRC07:46
*** markvoelker has quit IRC07:55
openstackgerritzhufl proposed openstack/tempest master: Wait for server to be active in test_device_tagging  https://review.openstack.org/53110008:02
*** rcernin has quit IRC08:04
*** zhufl has joined #openstack-qa08:04
chandankumarmasayukig: andreaf today we have office hour in another an hour.08:06
zhuflBoth masayukig and gmann are on vacation:)08:12
openstackgerritLiang Hao proposed openstack/tempest master: Add reset_attach_status test for volume in scenario  https://review.openstack.org/51722808:14
*** shardy has joined #openstack-qa08:16
chandankumarzhufl: thanks :-) I think just we are available :-)08:16
zhuflYeah,maybe:)08:17
*** sshnaidm|afk is now known as sshnaidm08:28
*** ramishra has quit IRC08:38
openstackgerritLiang Hao proposed openstack/tempest master: Add a negative test about server attach a volume which is in use  https://review.openstack.org/45962308:41
*** jamemcc has quit IRC08:48
*** dtantsur|afk is now known as dtantsur08:49
*** lucas-afk is now known as lucasagomes08:49
openstackgerritzhufl proposed openstack/tempest master: Default to using networks_client in get_tenant_network  https://review.openstack.org/53109409:01
chandankumarIt's time now for Office hour :-)09:01
chandankumar#startmeeting QA Office Hours09:02
openstackMeeting started Thu Jan  4 09:02:09 2018 UTC and is due to finish in 60 minutes.  The chair is chandankumar. Information about MeetBot at http://wiki.debian.org/MeetBot.09:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.09:02
*** openstack changes topic to " (Meeting topic: QA Office Hours)"09:02
openstackThe meeting name has been set to 'qa_office_hours'09:02
chandankumarFirst of all Happy New Year All!09:02
chandankumarIt is our first office hour of 201809:02
chandankumarWho all are around?09:02
*** larainema has quit IRC09:03
chandankumarzhufl: afazekas andreaf Office Hour Time09:03
*** hongbin has quit IRC09:03
chandankumarWe are going to do bug traiging of bugs which got changed in last 14 days09:03
chandankumar#link http://paste.openstack.org/show/637638/ -> Link to last 14 days changed bugs09:03
chandankumarFeel free to pick one and go ahead09:04
*** e0ne has joined #openstack-qa09:05
chandankumar#link https://bugs.launchpad.net/devstack/+bug/174019409:05
openstackLaunchpad bug 1740194 in devstack "Apache2 unable to start as 2 MPM modules enabled on Fedora 27" [Undecided,New]09:05
chandankumarCurrently devstack does not work on fedora 27 there is already patch for the same https://review.openstack.org/#/c/527048/09:05
chandankumarMaking it to confirmed with review link09:07
chandankumarzhufl: andreaf afazekas can you please have a look at this bug https://bugs.launchpad.net/devstack/+bug/174048009:08
openstackLaunchpad bug 1740480 in devstack "502 Proxy Error" [Undecided,New]09:08
chandankumarMoving to next bug09:11
chandankumar#link https://bugs.launchpad.net/devstack/+bug/174092009:11
openstackLaunchpad bug 1740920 in devstack "stable/newton branch does not work because keystone does not have stable/newton branch" [Undecided,New]09:11
chandankumarMarking the above as invalid as Newton release is already EOL09:15
chandankumarMoving to next one09:15
chandankumar#link https://bugs.launchpad.net/devstack/+bug/174109709:15
openstackLaunchpad bug 1741097 in devstack "Installing pip fails on RHEL 7.4 with SSL error" [Undecided,In progress] - Assigned to Jim Rollenhagen (jim-rollenhagen)09:15
chandankumarThere is a fix already in place for the same https://review.openstack.org/#/c/530991/09:17
chandankumarso not to worry about09:17
chandankumarMoving to next bug09:19
chandankumar#link https://bugs.launchpad.net/tempest/+bug/174054409:21
openstackLaunchpad bug 1740544 in tempest "Volume retype fails when migration occurs" [Medium,Triaged]09:22
chandankumarAs per the last comment It may be linked with https://bugs.launchpad.net/tempest/+bug/1698224 which is already fixed09:22
openstackLaunchpad bug 1698224 in tempest "test_volume_migrate_attached fails because of policy os_compute_api:os-volumes-attachments:update 403" [Undecided,Fix released] - Assigned to Matt Riedemann (mriedem)09:22
chandankumarBut as per 2nd last comment It reqires one more test to add, marking it as a confirmed09:24
chandankumarMoving to next one09:26
chandankumarhttps://bugs.launchpad.net/tempest/+bug/173982909:27
openstackLaunchpad bug 1739829 in tempest "tempest-full job failing in stable/pike with 404 from keystone during tempest verify-config" [Undecided,Confirmed]09:27
chandankumar#link https://bugs.launchpad.net/tempest/+bug/173982909:27
chandankumarpatch for running https://review.openstack.org/#/c/530915/ full tempest for stable branches needs to be backported09:28
chandankumarMoving to last one09:30
chandankumar#link https://bugs.launchpad.net/tempest/+bug/174025809:30
openstackLaunchpad bug 1740258 in tempest "[scenario]/img_dir is deprecated but required" [Undecided,New]09:30
chandankumarmtreinish: andreaf: zhufl https://bugs.launchpad.net/tempest/+bug/1740258 please have a look at this what to do this one? do we need to un deprecate it till we complete the refactoring https://bugs.launchpad.net/tempest/+bug/139388109:33
openstackLaunchpad bug 1740258 in tempest "[scenario]/img_dir is deprecated but required" [Undecided,New]09:33
openstackLaunchpad bug 1393881 in tempest "Recofigure image loading path for scenario tests" [Medium,In progress] - Assigned to Matthew Treinish (treinish)09:33
chandankumarThat's it from today from the bug triage09:33
chandankumarSince nobody is aroun, I am going to close the meeting09:34
chandankumarmtreinish: andreaf need help on this bug for triaging https://bugs.launchpad.net/devstack/+bug/174048009:34
openstackLaunchpad bug 1740480 in devstack "502 Proxy Error" [Undecided,New]09:34
chandankumar#endmeeting09:35
*** openstack changes topic to "Discussion of OpenStack Quality Assurance Projects (tempest, devstack, grenade, and friends) | docs https://wiki.openstack.org/wiki/QA | specs https://review.openstack.org/#/q/project:openstack/qa-specs | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-qa/"09:35
openstackMeeting ended Thu Jan  4 09:35:01 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)09:35
openstackMinutes:        http://eavesdrop.openstack.org/meetings/qa_office_hours/2018/qa_office_hours.2018-01-04-09.02.html09:35
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/qa_office_hours/2018/qa_office_hours.2018-01-04-09.02.txt09:35
openstackLog:            http://eavesdrop.openstack.org/meetings/qa_office_hours/2018/qa_office_hours.2018-01-04-09.02.log.html09:35
*** tosky has joined #openstack-qa09:37
*** kiennt26 has quit IRC09:49
*** markvoelker has joined #openstack-qa09:56
afazekaschandankumar, https://bugs.launchpad.net/tempest/+bug/1739829  this issue sounds like blocking stable/pike  gates, it might be considered critical09:57
openstackLaunchpad bug 1739829 in tempest "tempest-full job failing in stable/pike with 404 from keystone during tempest verify-config" [Undecided,Confirmed]09:57
*** sshnaidm is now known as sshnaidm|afk10:00
fricklerafazekas: chandankumar: iiuc the fix is not to run tempest-full on stable branches, let me check the patch for that10:12
afazekasfrickler, yes, looks like on master it is non-voting and most checks has defined legacy job10:13
fricklerafazekas: https://review.openstack.org/531046 is what tempest needs to merge as a solution I think10:14
*** toabctl has quit IRC10:16
fricklerdevstack stable cores: these two patches will fix docs build for the stable branches https://review.openstack.org/530859 https://review.openstack.org/530940 , cherry-picked from mordred's fix in master10:17
afazekasfrickler, https://github.com/openstack-infra/project-config/blob/master/zuul.d/projects.yaml  also has tempest-full specified10:20
fricklerafazekas: iiuc the branch restriction will be inherited from the job definition10:21
*** toabctl has joined #openstack-qa10:23
afazekas+2 we will see10:25
*** markvoelker has quit IRC10:30
afazekasmasayukig, https://review.openstack.org/#/c/531046/10:31
afazekaszhufl: ^10:33
chandankumarafazekas: masayukig is on holiday10:33
chandankumarafazekas: frickler thanks for looking into the bug10:33
chandankumarafazekas: what to do this one?10:35
chandankumarafazekas: https://bugs.launchpad.net/tempest/+bug/174025810:35
openstackLaunchpad bug 1740258 in tempest "[scenario]/img_dir is deprecated but required" [Undecided,New]10:35
chandankumarandreaf: we have more than 100 open bugs what to do with those? Since one month 1 left for Queens release10:36
afazekaschandankumar, Do we really want to remove those options, if yes we cannot undepreacte  , if no we can close the other bug ;-)10:53
*** larainema has joined #openstack-qa10:57
openstackgerritSam Betts proposed openstack-infra/devstack-gate master: Move location of devstack-gate unstack to post-tempest  https://review.openstack.org/53072611:01
afazekaschandankumar, This https://bugs.launchpad.net/tempest/+bug/1613819 has very huge heat11:06
openstackLaunchpad bug 1613819 in tempest "v3 credentials client does not honour the configured domain" [Medium,Confirmed]11:06
*** kopecmartin has joined #openstack-qa11:26
*** markvoelker has joined #openstack-qa11:27
-openstackstatus- NOTICE: zuul seems to have gotten stuck and will probably need a restart, please be patient11:27
*** openstackstatus has quit IRC11:28
*** openstack has quit IRC11:28
*** openstack has joined #openstack-qa13:07
*** ChanServ sets mode: +o openstack13:07
*** openstackstatus has joined #openstack-qa13:10
*** ChanServ sets mode: +v openstackstatus13:10
*** lucas-hungry is now known as lucasagomes13:32
*** dtantsur is now known as dtantsur|brb13:49
*** sshnaidm|afk is now known as sshnaidm|mtg13:58
afazekasandreaf, mtreinish: https://review.openstack.org/#/c/531046/14:18
*** jokke_ has quit IRC14:21
*** dtantsur|brb is now known as dtantsur14:22
*** dansmith has quit IRC14:25
*** cliffparsons has quit IRC14:25
*** sapcc-bot1 has quit IRC14:26
*** dgonzalez_5 has quit IRC14:27
*** mkoderer_ has quit IRC14:27
*** dgonzalez_3 has quit IRC14:28
*** hongbin_ has joined #openstack-qa14:29
*** mriedem has joined #openstack-qa14:29
*** hongbin_ has quit IRC14:29
*** hongbin has joined #openstack-qa14:30
*** esberglu has joined #openstack-qa14:39
*** yamamoto has quit IRC14:43
-openstackstatus- NOTICE: zuul has been restarted, all queues have been reset. please recheck your patches when appropriate14:47
*** janzian has joined #openstack-qa14:55
*** ramishra has joined #openstack-qa14:56
*** esberglu has quit IRC14:57
*** yamamoto has joined #openstack-qa15:01
*** agurenko has quit IRC15:11
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck master: Add query for cinder CapacityFilter fail bug 1741275  https://review.openstack.org/53117515:25
openstackbug 1741275 in Cinder "CapacityFilter intermittently fails in the gate due to insufficient virtual space on the host" [Undecided,Confirmed] https://launchpad.net/bugs/174127515:25
openstackgerritHongbin Lu proposed openstack/tempest master: Add test for IP substring filtering  https://review.openstack.org/52530815:32
openstackgerritMerged openstack-infra/elastic-recheck master: Add query for cinder CapacityFilter fail bug 1741275  https://review.openstack.org/53117515:50
openstackbug 1741275 in Cinder "CapacityFilter intermittently fails in the gate due to insufficient virtual space on the host" [Undecided,Confirmed] https://launchpad.net/bugs/174127515:50
*** openstackrecheck has quit IRC15:54
*** armax has joined #openstack-qa15:56
openstackgerritMatthew Treinish proposed openstack/tempest master: Remove deprecated AMI image file opts  https://review.openstack.org/33837716:01
*** udesale has joined #openstack-qa16:01
*** udesale has quit IRC16:14
*** edmondsw has joined #openstack-qa16:15
*** kopecmartin has quit IRC16:16
*** e0ne has quit IRC16:36
*** dtantsur is now known as dtantsur|afk16:41
*** ramishra has quit IRC16:45
*** ChanServ sets mode: -r 16:50
*** syjulian has joined #openstack-qa16:50
*** jamemcc has joined #openstack-qa16:50
*** pcaruana has quit IRC16:52
*** sdague has joined #openstack-qa16:56
openstackgerritMerged openstack-infra/devstack-gate master: Remove run-tests and py3-run-tests  https://review.openstack.org/52881716:59
*** esberglu has joined #openstack-qa17:03
openstackgerritMatt Riedemann proposed openstack-dev/devstack master: tempest: set compute-feature-enabled.volume_multiattach  https://review.openstack.org/26663317:17
*** spzala has joined #openstack-qa17:18
*** spzala has quit IRC17:18
openstackgerritMatt Riedemann proposed openstack-dev/devstack master: tempest: set compute-feature-enabled.volume_multiattach  https://review.openstack.org/26663317:19
*** raildo has joined #openstack-qa17:42
*** lucasagomes is now known as lucas-afk17:46
*** aojea has joined #openstack-qa17:49
*** armax has quit IRC17:50
*** armax has joined #openstack-qa17:50
*** sshnaidm|mtg is now known as sshnaidm17:51
*** aojea has quit IRC17:52
*** aojea has joined #openstack-qa17:52
*** aojea has quit IRC17:54
*** aojea has joined #openstack-qa17:55
*** Apoorva has joined #openstack-qa17:59
*** aojea has quit IRC18:05
openstackgerritHongbin Lu proposed openstack/tempest master: Add test for IP substring filtering  https://review.openstack.org/52530818:06
*** aojea has joined #openstack-qa18:12
*** aojea has quit IRC18:14
openstackgerritClark Boylan proposed openstack-dev/devstack master: Gzip openstack service logs  https://review.openstack.org/53120818:18
*** gkadam has joined #openstack-qa18:23
*** aojea has joined #openstack-qa18:24
*** shardy has quit IRC18:25
*** aojea has quit IRC18:26
*** yamamoto has quit IRC18:29
*** yamamoto has joined #openstack-qa18:33
*** yamamoto has quit IRC18:37
*** pcrews has joined #openstack-qa19:01
openstackgerritMatthew Treinish proposed openstack/tempest master: Remove deprecated AMI image file opts  https://review.openstack.org/33837719:03
openstackgerritMatt Riedemann proposed openstack-dev/devstack master: DNM: Test nova with the CachingScheduler  https://review.openstack.org/53102019:24
*** yamamoto has joined #openstack-qa19:35
*** gcheresh has joined #openstack-qa19:37
*** armax has quit IRC19:40
*** yamamoto has quit IRC19:42
*** gcheresh has quit IRC19:44
*** gkadam has quit IRC19:49
*** sshnaidm is now known as sshnaidm|off19:53
*** spzala has joined #openstack-qa20:04
*** gcheresh has joined #openstack-qa20:14
*** raildo has quit IRC20:14
*** gcheresh has quit IRC20:20
*** gcheresh has joined #openstack-qa20:20
*** raildo has joined #openstack-qa20:26
*** gcheresh has quit IRC20:33
*** edmondsw has quit IRC20:54
openstackgerritKen'ichi Ohmichi proposed openstack/tempest master: Add NOTE related to 'on-demand' migration  https://review.openstack.org/53124520:56
*** raildo has quit IRC20:56
*** edmondsw has joined #openstack-qa21:19
*** smcginnis has joined #openstack-qa21:27
openstackgerritMatthew Treinish proposed openstack-dev/devstack stable/newton: Differentiate between DEFAULT_IMAGE_NAME and filename  https://review.openstack.org/53124821:38
*** dmellado has quit IRC21:43
openstackgerritMatthew Treinish proposed openstack-dev/devstack stable/ocata: Differentiate between DEFAULT_IMAGE_NAME and filename  https://review.openstack.org/53125021:46
*** dmellado has joined #openstack-qa21:46
openstackgerritMatthew Treinish proposed openstack-dev/devstack stable/newton: Differentiate between DEFAULT_IMAGE_NAME and filename  https://review.openstack.org/53124821:47
openstackgerritMatthew Treinish proposed openstack/tempest master: Remove deprecated AMI image file opts  https://review.openstack.org/33837721:48
*** esberglu has quit IRC21:54
*** jose-phillips has quit IRC22:05
*** esberglu has joined #openstack-qa22:06
openstackgerritCliff Parsons proposed openstack/tempest master: Remove force_tenant_isolation from Cinder tests  https://review.openstack.org/52324122:07
*** jose-phillips has joined #openstack-qa22:09
*** rcernin has joined #openstack-qa22:12
*** jose-phillips has quit IRC22:22
*** jose-phillips has joined #openstack-qa22:29
*** cliffparsons has joined #openstack-qa22:36
*** Apoorva has quit IRC22:38
*** Apoorva has joined #openstack-qa22:39
*** armax has joined #openstack-qa22:47
*** jose-phillips has quit IRC22:51
*** jose-phillips has joined #openstack-qa22:53
*** edmondsw has quit IRC22:56
*** edmondsw has joined #openstack-qa22:57
*** edmondsw has quit IRC23:01
*** mvk has joined #openstack-qa23:05
*** dave-mccowan has joined #openstack-qa23:08
*** hongbin has quit IRC23:18
*** dave-mccowan has quit IRC23:31
*** tosky has quit IRC23:39
*** mtreinish has quit IRC23:39
*** mtreinish has joined #openstack-qa23:42

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!