Friday, 2013-11-22

*** denis_makogon has quit IRC00:01
*** johnthetubaguy has quit IRC00:01
*** michchap_ has joined #openstack-infra00:01
openstackgerritClark Boylan proposed a change to openstack-infra/config: Convert subunit v1 log results to v2 format.  https://review.openstack.org/5779800:01
clarkblifeless: that is basically what we had before, does it look sane to you?00:02
clarkbjeblair: I think we should get that change in asap00:02
*** dangers is now known as danger_fo_away00:03
*** michchap has quit IRC00:03
*** mrodden1 has joined #openstack-infra00:04
*** mrodden has quit IRC00:06
jeblairclarkb: lgtm00:07
clarkbit was working at one point but got lost in the shuffle of moving scripts around00:07
openstackgerritMonty Taylor proposed a change to openstack-dev/pbr: Enable wheel processing in the tests  https://review.openstack.org/5681700:10
openstackgerritMonty Taylor proposed a change to openstack-dev/pbr: Clean up integration script  https://review.openstack.org/5681600:10
openstackgerritMonty Taylor proposed a change to openstack-dev/pbr: Serve local mirror using apache  https://review.openstack.org/5675200:10
openstackgerritMonty Taylor proposed a change to openstack-dev/pbr: Use wheels for installation  https://review.openstack.org/4880300:10
clarkbjeblair: I am going to put that through, I will keep an eye on tests and revert it really quick if it causes problems, but I am pretty confident in it as we had it before00:10
*** sarob has joined #openstack-infra00:10
*** loq_mac has joined #openstack-infra00:11
*** johnthetubaguy has joined #openstack-infra00:12
*** johnthetubaguy has quit IRC00:12
jog0so by my calculations the check jobs were failing at a rate of about 87%00:14
clarkbjog0: that change I just approved to run-unittests.sh should make the neutron unittests finish much quicker00:14
jog0clarkb: woot00:15
clarkbso we probably don't need to worry about the timeout on that job once it gets in00:15
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Remove jeepyb from the requirements gate  https://review.openstack.org/5676400:15
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Create and upload wheels  https://review.openstack.org/5676000:15
*** hogepodge has quit IRC00:16
*** hogepodge has joined #openstack-infra00:17
*** crank has quit IRC00:19
*** atiwari has quit IRC00:19
*** crank has joined #openstack-infra00:19
*** lchen has joined #openstack-infra00:20
openstackgerritA change was merged to openstack-infra/config: Convert subunit v1 log results to v2 format.  https://review.openstack.org/5779800:22
*** mrodden1 has quit IRC00:23
*** mriedem1 has quit IRC00:24
*** loq_mac has quit IRC00:27
*** wenlock has quit IRC00:29
*** sarob has quit IRC00:29
*** sarob has joined #openstack-infra00:30
*** sarob has quit IRC00:35
jog0lifeless: ping00:35
jog0tesr question00:35
jog0testr00:35
clarkbI can attempt to answer maybe00:35
lifelessjog0: shoot00:36
jog0so it came to our attention that testr runs the tests in a deterministic order the first time its run00:36
jog0can we make that random00:36
lifelessyou are misinformed.00:37
jog0good00:37
lifelesstestr doesn't run tests.00:37
jog0it has a scheduler though right?00:37
lifelessIt schedules tests; the first time schedule has no timing data so is entirely round robin.00:37
lifelessThats set based, so will be wildly different on different Python versions and architectures.00:37
lifelessHowever00:38
jog0so instead of roudn robin can we do random?00:38
lifelesstesttools.run sorts tests always at OpenStacks request :)00:38
*** MarkAtwood has quit IRC00:38
*** sarob has joined #openstack-infra00:38
jog0so we can undo that00:39
lifelessjog0: perhaps we can talk about the big picture00:39
jog0or sort randomly or something00:39
clarkbyou don't want to undo that, it makes test bisection harder00:39
lifelessjog0: rather than the proposed solution00:39
sdagueso the issue is, we're doing post mortem on the grenade fail00:40
sdagueand the problem is, the grenade job was completely stable when it merged00:40
sdaguegrenade job == using parallel tempest at the end of grenade00:40
sdaguethen 1 new tempest test landed00:41
sdagueso the deterministic ordering of all the tests became a new deterministic ordering, which had the possibility of an out of memory race00:41
lifelessok, so you want to find out about such pain earlier?00:42
sdagueyes00:42
sdagueand more often00:42
sdagueso that we'd get more data from our multiple tempest runs on each job, instead of them all running the tests in the same order00:43
*** yamahata_ has joined #openstack-infra00:43
lifelessok, so for clarity: there are two layers here: testr scheduling to backends, and backends running tests.00:44
sdagueyep00:44
lifelessIf we testresources in place as I want to, ordering w/in a backend will be fixed00:44
lifelessbecause it's an optimising ordering00:44
sdaguelifeless: but how would that work in the gate, where it's fresh guest each time00:44
lifelessand the long term plan for exporting that data to testr to get optimising scheduling from testr too00:44
*** mrodden has joined #openstack-infra00:45
sdaguewe have nothing to optimize with00:45
lifelesstestresources has metadata in the suite about the costs of bringing up fixtures00:45
lifelessit's how it works00:45
lifelessit builds a graph of all the resource transitions needed and generates a least cost approximate walk through it (using simulated annealing)00:45
*** mrodden1 has joined #openstack-infra00:46
lifelessI'm very surprised that you were seeing consistent partitioning from testr00:46
sdaguelifeless: why?00:46
lifelessbut I'd be delighted to add randomness in there00:47
sdagueit's like random num generator with a fixed seed00:47
*** changbl has quit IRC00:47
lifelesssdague: sure00:48
sdagueanyway, we're running off here for a bit. Just an idea.00:48
*** mrodden has quit IRC00:49
lifelessso, low hanging fruit - submit a bug to make testr perturbate the round robin allocation it does.00:49
clarkboh thats right you guys are all together in berkely00:49
lifelessHappy to have that.00:49
lifelesstesttools is more concerning - we filed and fixed it upstream in Python00:49
lifelessand I'm not sure that our medium term plan for tempest optimisation is compatible with randomness within a backend00:50
lifelesss/bug/patch/00:50
lifelessI have to pop out for a little myself00:50
clarkbwoot https://jenkins02.openstack.org/job/gate-cinder-python26/2901/console subunit format conversion seems fine00:55
*** michchap_ has quit IRC00:56
*** xeyed4good has joined #openstack-infra00:58
*** michchap has joined #openstack-infra00:59
clarkbnow I need a guinea pig neutron change00:59
*** ^d has quit IRC00:59
mordredclarkb: https://review.openstack.org/#/c/55805/00:59
mordredit's one of mine that's broken right now00:59
mordredyou could recheck it01:00
clarkbcool thanks01:00
mordredwithout confusing anyone01:00
*** nati_ueno has quit IRC01:01
*** nati_ueno has joined #openstack-infra01:01
*** colinmcnamara has joined #openstack-infra01:03
*** xeyed4good has left #openstack-infra01:05
clarkbbtw zuul is going to do a massive set of merges in a little bit \o/01:05
*** hogepodge has quit IRC01:06
*** colinmcnamara has quit IRC01:06
mordredw00t!01:07
clarkbcurrently up to ~23 changes01:08
clarkbalmost half the pipeline01:08
*** reed has joined #openstack-infra01:16
*** rongze has joined #openstack-infra01:23
*** rongze has quit IRC01:27
*** nati_uen_ has joined #openstack-infra01:31
*** nati_uen_ has quit IRC01:31
*** nati_uen_ has joined #openstack-infra01:31
*** nati_ueno has quit IRC01:32
clarkb:( the rsyslog stuff for the slaves conflicts with different rsyslog stuff in puppet01:35
*** boris-42 has joined #openstack-infra01:36
*** markwash has quit IRC01:37
*** nosnos has joined #openstack-infra01:40
*** nosnos has quit IRC01:40
*** sarob_ has joined #openstack-infra01:40
*** nosnos has joined #openstack-infra01:41
openstackgerritClark Boylan proposed a change to openstack-infra/config: Handle multiple rsyslog service defs.  https://review.openstack.org/5780701:42
clarkbthat is a bit of a hackish workaround but should allow puppet to run on the slaves again01:42
*** sarob has quit IRC01:44
clarkbran it on precise23 to double check it works and seems to be happy01:45
*** sarob_ has quit IRC01:45
*** nati_uen_ has quit IRC01:46
*** boris-42 has quit IRC01:55
*** boris-42 has joined #openstack-infra01:56
*** boris-42 has quit IRC01:58
*** bingbu has joined #openstack-infra01:59
*** yamahata_ has quit IRC02:02
*** dcramer_ has joined #openstack-infra02:02
*** rongze has joined #openstack-infra02:03
*** ljjjustin has joined #openstack-infra02:10
*** jhesketh has joined #openstack-infra02:12
*** yaguang has joined #openstack-infra02:16
*** boris-42 has joined #openstack-infra02:17
*** mriedem has joined #openstack-infra02:18
*** dstanek has quit IRC02:20
*** jhesketh__ has joined #openstack-infra02:22
*** sjing has joined #openstack-infra02:36
*** dcramer_ has quit IRC02:37
openstackgerritA change was merged to openstack-infra/reviewstats: Fix disagreement percentage calculation  https://review.openstack.org/5760602:46
*** sarob has joined #openstack-infra02:52
*** markwash has joined #openstack-infra02:53
openstackgerritA change was merged to openstack-infra/devstack-gate: Add stable/havana to devstack-gate  https://review.openstack.org/5243702:53
*** nati_ueno has joined #openstack-infra02:55
*** boris-42 has quit IRC02:57
*** sarob has quit IRC02:58
*** sarob has joined #openstack-infra02:59
*** sarob has quit IRC02:59
*** sarob has joined #openstack-infra02:59
*** wenlock has joined #openstack-infra03:02
*** sarob has quit IRC03:06
*** sarob has joined #openstack-infra03:07
*** lchen has quit IRC03:07
*** sarob has quit IRC03:11
*** dstanek has joined #openstack-infra03:13
*** pcrews has quit IRC03:14
*** sarob has joined #openstack-infra03:16
*** jgrimm has joined #openstack-infra03:18
*** ljjjustin has quit IRC03:23
*** lchen has joined #openstack-infra03:23
*** reed has quit IRC03:25
*** CaptTofu_ has quit IRC03:26
*** krtaylor has joined #openstack-infra03:26
*** CaptTofu has joined #openstack-infra03:26
*** gyee has quit IRC03:45
*** nati_ueno has quit IRC03:47
*** sarob has quit IRC03:51
*** sarob_ has joined #openstack-infra03:51
*** nati_ueno has joined #openstack-infra04:07
*** dkliban_ has joined #openstack-infra04:12
mikaljog0: you still around?04:12
*** julim has joined #openstack-infra04:13
*** nati_ueno has quit IRC04:17
*** nati_ueno has joined #openstack-infra04:18
*** jgrimm has quit IRC04:18
*** dcramer_ has joined #openstack-infra04:20
*** julim has quit IRC04:23
*** mriedem has quit IRC04:24
*** markmcclain has joined #openstack-infra04:25
*** cody-somerville has quit IRC04:27
*** cody-somerville has joined #openstack-infra04:42
*** SergeyLukjanov has joined #openstack-infra04:43
*** nati_uen_ has joined #openstack-infra04:45
cyeohjog0: FWIW the v3 enable patch is now passing grenade. https://review.openstack.org/#/c/57589/04:46
*** nati_ueno has quit IRC04:48
*** colinmcn_ has joined #openstack-infra04:51
*** chandankumar has joined #openstack-infra04:53
*** rongze has quit IRC04:53
*** colinmcn_ has quit IRC04:58
*** sandywalsh has quit IRC04:58
*** changbl has joined #openstack-infra05:02
*** sarob_ is now known as sarob05:05
*** matsuhashi has joined #openstack-infra05:06
*** ljjjustin has joined #openstack-infra05:09
*** markmcclain has quit IRC05:13
*** markmcclain has joined #openstack-infra05:15
*** matsuhashi has quit IRC05:16
*** sarob has quit IRC05:17
*** sandywalsh has joined #openstack-infra05:18
*** SergeyLukjanov has quit IRC05:21
*** matsuhashi has joined #openstack-infra05:23
*** rongze has joined #openstack-infra05:24
*** sarob has joined #openstack-infra05:29
*** rpodolyaka1 has joined #openstack-infra05:31
*** rongze has quit IRC05:33
*** sarob has quit IRC05:34
*** sarob has joined #openstack-infra05:37
*** michchap has quit IRC05:40
*** michchap has joined #openstack-infra05:40
clarkbthe failures in http://logs.openstack.org/74/57774/2/gate/gate-tempest-devstack-vm-full/e592961/console.html appear to be the next round of bugs that will need sorting for sanity05:40
clarkbif they aren't in e-r tomorrow I will take a stab at adding them05:41
clarkbI have seen a handful of cases today though05:41
*** sarob has quit IRC05:41
portanteme too05:41
clarkbcyeoh: were the API v3 tests failing due to a bug related to the API tests or just falling victim to all of the other bugs05:41
portanteis there a bug opened for those SSH protocol errors?05:42
clarkbportante: I am not sure, I just noticed them now05:42
clarkbthe volume thing was the one I had seen before05:42
* clarkb looks at tempest bugs05:42
cyeohclarkb: the v3 api tests were causing 1251920 to occur a lot more than with them disabled05:43
clarkbcyeoh: interesting05:43
clarkboh the teardownclass volume thing is related to the ssh test failing first, I should look at these more closely05:44
cyeohclarkb: I'd guess it was just the higher probability of having the m1.small instances running at the same time as the v2 tests were05:45
clarkbportante: I don't see a bug yet, I will submit one really quickly05:46
portantek thx05:46
*** jhesketh has quit IRC05:47
*** jhesketh has joined #openstack-infra05:47
*** nati_uen_ has quit IRC05:49
*** mihgen has joined #openstack-infra05:50
clarkbportante: https://bugs.launchpad.net/tempest/+bug/1253896 with some quick analysis of the bug included05:53
uvirtbotLaunchpad bug 1253896 in tempest "test_minimum_basic_scenario fails with SSHException: Error reading SSH protocol banner" [Undecided,New]05:53
* portante looks05:53
portantegreat, that will be helpful to match it up when we encounter those kinds of failures05:54
*** markmcclain has quit IRC06:00
*** melwitt has quit IRC06:02
*** nati_ueno has joined #openstack-infra06:10
*** michchap has quit IRC06:19
*** bingbu has quit IRC06:20
clarkbthinking about the various failures, would it help to try and run more tools like radon and provide that information in check tests?06:24
clarkbI am not sure how closely tests are examined if they pass and radon wouldn't really be able to give us a sane pass fail data set06:24
*** michchap has joined #openstack-infra06:26
portantefor swift, it would be nice to have tools that detect 503s returned by the API, and highlight Tracebacks (though python-keystoneclient middleware emits Tracebacks all the time as part of its debug logging)06:27
*** bingbu has joined #openstack-infra06:31
torgomaticdouble bonus points for logging the txid from the headers in the 503 response; txids make *excellent* logstash queries06:32
*** rongze has joined #openstack-infra06:37
*** matsuhashi has quit IRC06:44
*** nicedice has quit IRC06:48
*** matsuhas_ has joined #openstack-infra06:49
*** nsaje has joined #openstack-infra06:50
*** rpodolyaka1 has quit IRC06:51
*** yolanda has joined #openstack-infra06:54
*** matsuhas_ has quit IRC06:56
*** lchen has quit IRC06:57
*** yolanda has quit IRC06:57
*** lchen has joined #openstack-infra06:59
*** amotoki_zzz is now known as amotoki07:00
*** nati_ueno has quit IRC07:01
*** matsuhashi has joined #openstack-infra07:03
*** nati_ueno has joined #openstack-infra07:03
*** nati_ueno has quit IRC07:04
*** nati_uen_ has joined #openstack-infra07:04
*** sjing has quit IRC07:05
*** sjing has joined #openstack-infra07:07
openstackgerritChmouel Boudjnah proposed a change to openstack-infra/config: Add minimal checks for swift-bench.  https://review.openstack.org/5784507:08
*** sdake_ has quit IRC07:08
*** bingbu has quit IRC07:17
*** yolanda has joined #openstack-infra07:29
*** bingbu has joined #openstack-infra07:29
*** nicedice has joined #openstack-infra07:37
*** nati_uen_ has quit IRC07:38
*** mihgen has quit IRC07:41
*** jhesketh has quit IRC07:51
*** nati_ueno has joined #openstack-infra08:01
*** nati_ueno has quit IRC08:02
*** nati_ueno has joined #openstack-infra08:02
*** hdd has joined #openstack-infra08:02
*** amotoki has quit IRC08:10
*** dstanek has quit IRC08:13
jog0mikal: no, and cyeoh lets wait another day just to be safe08:19
*** yamahata_ has joined #openstack-infra08:19
*** mihgen has joined #openstack-infra08:19
jog0portante: if you don't see a big feel free to file one and an elastic-search query here http://git.openstack.org/cgit/openstack-infra/elastic-recheck/tree/queries.yaml08:20
jog0cyeoh: gate is still a little wobbly wnat to not rock the boat08:20
jog0clarkb: if you are feeling sleepless I added some more things I want to mention in the email (https://etherpad.openstack.org/p/critical-patches-gatecrash-November-2013)08:21
* jog0 goes to bed08:21
*** flaper87|afk is now known as flaper8708:22
*** nosnos_ has joined #openstack-infra08:31
*** nosnos has quit IRC08:35
*** denis_makogon has joined #openstack-infra08:36
*** lchen has quit IRC08:37
*** lchen has joined #openstack-infra08:37
*** sjing has quit IRC08:37
*** cody-somerville has quit IRC08:44
*** cody-somerville has joined #openstack-infra08:45
*** osanchez has joined #openstack-infra08:47
*** Loquacity has quit IRC08:48
*** yamahata_ has quit IRC09:00
*** Loquacity has joined #openstack-infra09:01
*** jpich has joined #openstack-infra09:01
*** nosnos_ has quit IRC09:04
*** nosnos has joined #openstack-infra09:05
*** mkerrin has joined #openstack-infra09:05
*** fbo_away is now known as fbo09:07
*** nati_ueno has quit IRC09:07
*** dizquierdo has joined #openstack-infra09:08
*** nati_ueno has joined #openstack-infra09:09
*** bingbu has quit IRC09:10
*** nati_ueno has quit IRC09:10
*** derekh has joined #openstack-infra09:15
*** marun has joined #openstack-infra09:16
*** yassine has joined #openstack-infra09:16
openstackgerritRoman Prykhodchenko proposed a change to openstack-infra/config: Adds devstack-gate tests for Ironic  https://review.openstack.org/5391709:17
*** johnthetubaguy has joined #openstack-infra09:18
*** marun has quit IRC09:22
*** marun has joined #openstack-infra09:23
*** johnthetubaguy1 has joined #openstack-infra09:26
*** johnthetubaguy has quit IRC09:26
*** ljjjustin has quit IRC09:29
*** boris-42 has joined #openstack-infra09:29
*** matsuhashi has quit IRC09:29
*** matsuhashi has joined #openstack-infra09:30
*** dizquierdo has quit IRC09:33
*** boris-42 has quit IRC09:34
*** dstanek has joined #openstack-infra09:41
*** Loquacity has quit IRC09:44
*** Loquacity has joined #openstack-infra09:45
*** dstanek has quit IRC09:46
*** SergeyLukjanov has joined #openstack-infra09:47
openstackgerritA change was merged to openstack-dev/pbr: Base python 2.7 skip list on parsed names  https://review.openstack.org/5415209:55
*** denis_makogon has quit IRC09:59
openstackgerritA change was merged to openstack-infra/devstack-gate: Remove duplicate entries  https://review.openstack.org/5692010:03
*** DinaBelova has joined #openstack-infra10:08
*** ace05__ has quit IRC10:09
*** pblaho has joined #openstack-infra10:11
ttxfungi, mordred: please see https://review.openstack.org/#/c/57441/ -- kinda need those pages up asap10:14
*** simonmcc has quit IRC10:40
*** simonmcc has joined #openstack-infra10:40
*** simonmcc has quit IRC10:41
*** simonmcc has joined #openstack-infra10:42
*** DinaBelova has quit IRC10:45
*** marun has quit IRC10:45
*** cody-somerville has quit IRC10:46
*** marun has joined #openstack-infra10:47
*** cody-somerville has joined #openstack-infra10:48
*** pblaho has quit IRC10:52
*** fbo is now known as fbo_away10:52
*** marun has quit IRC10:56
*** marun has joined #openstack-infra10:56
openstackgerritLiang Chen proposed a change to openstack-dev/pbr: Make sphinx builders configurable in LocalBuildDoc  https://review.openstack.org/5789210:57
*** marun has quit IRC10:58
sorenHow about some love for https://review.openstack.org/#/c/55519/ ?10:59
*** yaguang has quit IRC10:59
openstackgerritThierry Carrez proposed a change to openstack-infra/config: Add openstack/oslo.rootwrap project  https://review.openstack.org/5789611:01
*** cody-somerville has quit IRC11:02
*** nati_ueno has joined #openstack-infra11:07
*** cody-somerville has joined #openstack-infra11:07
*** nati_uen_ has joined #openstack-infra11:10
*** pcm_ has joined #openstack-infra11:12
*** nati_ueno has quit IRC11:13
*** wenlock has quit IRC11:14
*** lcestari has joined #openstack-infra11:15
*** pcm_ has quit IRC11:19
*** pcm_ has joined #openstack-infra11:20
*** rfolco has joined #openstack-infra11:21
*** Loquacity has quit IRC11:29
*** dkliban_ has quit IRC11:30
*** Loquacity has joined #openstack-infra11:32
*** SergeyLukjanov has quit IRC11:33
*** DinaBelova has joined #openstack-infra11:36
*** fbo_away is now known as fbo11:42
*** dstanek has joined #openstack-infra11:42
*** SergeyLukjanov has joined #openstack-infra11:45
*** dstanek has quit IRC11:47
*** nsaje has quit IRC11:53
*** nsaje has joined #openstack-infra11:54
*** cody-somerville has quit IRC11:58
*** nsaje has quit IRC11:59
*** nati_uen_ has quit IRC12:05
*** matsuhashi has quit IRC12:09
*** matsuhashi has joined #openstack-infra12:10
*** DinaBelova has quit IRC12:13
*** matsuhashi has quit IRC12:15
*** xeyed4good has joined #openstack-infra12:20
*** michchap has quit IRC12:23
*** michchap has joined #openstack-infra12:23
*** CaptTofu has quit IRC12:28
*** CaptTofu has joined #openstack-infra12:28
portantejog0: thanks12:29
portantenotmyname: see above ^^^ link yaml thinky12:29
*** SergeyLukjanov is now known as _SergeyLukjanov12:30
*** nsaje has joined #openstack-infra12:33
*** lchen has quit IRC12:36
*** nati_ueno has joined #openstack-infra12:36
*** nsaje has quit IRC12:38
*** lchen has joined #openstack-infra12:40
*** xeyed4good has quit IRC12:41
*** DinaBelova has joined #openstack-infra12:42
*** dolphm has joined #openstack-infra12:44
*** michchap has quit IRC12:45
*** michchap has joined #openstack-infra12:46
*** marun has joined #openstack-infra13:00
*** CaptTofu has quit IRC13:02
*** nati_ueno has quit IRC13:02
*** nati_ueno has joined #openstack-infra13:03
*** CaptTofu has joined #openstack-infra13:03
*** dkliban_ has joined #openstack-infra13:07
*** nati_ueno has quit IRC13:09
*** DinaBelova has quit IRC13:11
*** SergeyLukjanov has joined #openstack-infra13:12
*** DinaBelova has joined #openstack-infra13:14
*** dcramer_ has quit IRC13:17
*** dizquierdo has joined #openstack-infra13:21
dolphmthis is probably a dumb question- does pbr behave differently if you do setup.py develop vs setup.py install?13:24
dolphmor setuptools13:24
dolphmother than where things happen13:24
*** zul has quit IRC13:27
*** oubiwann has joined #openstack-infra13:27
*** zul has joined #openstack-infra13:27
*** dkranz has joined #openstack-infra13:29
*** basic` has quit IRC13:29
*** pblaho has joined #openstack-infra13:33
*** basic` has joined #openstack-infra13:34
*** basic` has quit IRC13:35
*** basic` has joined #openstack-infra13:35
dolphmi'm running into the same issue described here- https://bitbucket.org/pypa/setuptools/issue/73/13:35
*** nosnos has quit IRC13:38
*** DinaBelova has quit IRC13:40
*** xeyed4good has joined #openstack-infra13:42
*** thomasem has joined #openstack-infra13:42
dolphmbah, i give up. pip install -e works13:44
*** SergeyLukjanov has quit IRC13:45
*** julim has joined #openstack-infra13:47
openstackgerritJaroslav Henner proposed a change to openstack-infra/jenkins-job-builder: Add properties testing.  https://review.openstack.org/5765413:49
*** DinaBelova has joined #openstack-infra13:49
*** ArxCruz has quit IRC13:49
*** ArxCruz has joined #openstack-infra13:51
openstackgerritJaroslav Henner proposed a change to openstack-infra/jenkins-job-builder: Add batch_tasks support.  https://review.openstack.org/5746913:51
openstackgerritJaroslav Henner proposed a change to openstack-infra/jenkins-job-builder: Add seealso to batch_tasks from promoted_build.  https://review.openstack.org/5747313:51
*** CaptTofu has quit IRC13:53
*** CaptTofu has joined #openstack-infra13:53
*** bpokorny has joined #openstack-infra13:53
*** ArxCruz has quit IRC13:54
*** ArxCruz has joined #openstack-infra13:54
*** dprince has joined #openstack-infra13:55
anteaya1 in the gate - it appears we have caught up13:55
anteayaw00t!13:55
anteayayay team13:55
*** mihgen has quit IRC13:56
*** marun has quit IRC13:57
*** marun has joined #openstack-infra13:58
*** michchap has quit IRC13:58
*** michchap has joined #openstack-infra14:01
*** sandywalsh has quit IRC14:01
*** mihgen has joined #openstack-infra14:09
*** alcabrera has joined #openstack-infra14:09
*** ryanpetrello has joined #openstack-infra14:10
*** mfer has joined #openstack-infra14:11
*** SergeyLukjanov has joined #openstack-infra14:11
*** boris-42 has joined #openstack-infra14:13
*** julim has quit IRC14:13
*** michchap has quit IRC14:14
*** michchap has joined #openstack-infra14:14
*** rnirmal has joined #openstack-infra14:14
*** sandywalsh has joined #openstack-infra14:17
*** mriedem has joined #openstack-infra14:17
*** julim has joined #openstack-infra14:20
*** nicedice has quit IRC14:21
*** nicedice has joined #openstack-infra14:21
*** yaguang has joined #openstack-infra14:23
dkehnclarkb: curious for nodes that run the testing (e.g. py27) how much memory to they have? just curious, for me on my servers to perform test what took 4GB now won't stay out of swap space, had to bump to 8GB14:28
dkehnclarkb: neutron related14:28
*** ArxCruz has quit IRC14:30
*** herndon has joined #openstack-infra14:31
*** boris-42 has quit IRC14:32
*** boris-42_ has joined #openstack-infra14:32
*** eharney has joined #openstack-infra14:33
*** cody-somerville has joined #openstack-infra14:34
*** cody-somerville has quit IRC14:34
*** cody-somerville has joined #openstack-infra14:34
*** xeyed4good has left #openstack-infra14:34
fungittx: looking14:34
openstackgerritA change was merged to openstack-infra/config: Track icehouse development in releasestatus  https://review.openstack.org/5744114:37
fungidkehn: we use 8gb flavors for those14:39
dkehnfungi: thx, yepper that'll do it14:39
sorenCould someone throw some love at https://review.openstack.org/#/c/55519/ , please?14:39
*** zoresvit has quit IRC14:41
anteayacoming back again to my desire to have a conversation about testing resources14:44
anteayaso that developers know in advance what is required14:44
anteayaand we have a sense as a group what those resources are, so they don't keep ballooning14:44
*** bnemec is now known as beekneemech14:53
*** dansmith is now known as damnsmith14:54
*** SergeyLukjanov has quit IRC14:55
*** dstanek has joined #openstack-infra14:55
*** boris-42_ has quit IRC14:58
*** russellb is now known as rustlebee14:59
*** dkliban_ is now known as dkliban14:59
*** dizquierdo has quit IRC15:00
*** ArxCruz has joined #openstack-infra15:00
*** dizquierdo has joined #openstack-infra15:01
*** alaski is now known as lascii15:02
notmynameportante: I didn't see yaml15:03
*** pblaho has quit IRC15:06
*** SergeyLukjanov has joined #openstack-infra15:07
*** markmcclain has joined #openstack-infra15:08
*** marun has quit IRC15:08
*** marun has joined #openstack-infra15:09
*** dcramer_ has joined #openstack-infra15:15
*** ruhe has joined #openstack-infra15:18
dstaneki think my review got stuck; review.openstack.org/54210 says gate jobs started a few days ago15:21
dstanekis there anything i can do to kick it?15:21
fungidstanek: it probably got dumped the first time we cleared the gate to try and push through fixes for the various nondeterministic bugs, and we didn't requeue those as far as i know. just leave a review comment on it which says "reverify no bug" and it should get added into the gate15:26
dstanekfungi: great thanks15:26
*** marun has quit IRC15:29
dkranzfungi: I followed a link in a recent build to http://logs.openstack.org/periodic/periodic-tempest-devstack-vm-stress/302442d/ but get Not Found15:30
dkranzfungi: Is this supposed to work?15:30
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Enable #storyboard IRC channel logging  https://review.openstack.org/5795215:30
dkranzfungi: The link was from https://jenkins02.openstack.org/job/periodic-tempest-devstack-vm-stress/50/console15:30
openstackgerritAlex Gaynor proposed a change to openstack-infra/config: Run the cinderclient tests under PyPy in gate and check  https://review.openstack.org/5795315:31
*** rcleere has joined #openstack-infra15:31
fungidkranz: i suspect those links are being built incorrectly. may not have been updated since we started adding an extra directory level15:31
* fungi tries something15:31
*** pblaho has joined #openstack-infra15:32
fungidkranz: seems it ended up in http://logs.openstack.org/periodic/periodic-tempest-devstack-vm-stress/devstack-precise-hpcloud-az2-663888/50/15:35
fungii suspect we didn't really mean to be using the slave name for that path component15:35
*** mrodden has joined #openstack-infra15:35
fungii'll add to my queue trying to figure out why it's doing that15:36
dkranzfungi: ok thanks. Is there a general rule I can follow to do what you did to find it?15:36
*** herndon has quit IRC15:36
dkranzfungi: Until the issue is fixed?15:36
*** wenlock has joined #openstack-infra15:36
fungidkranz: note the name of the slave where the job ran, mentioned in the top-right corner on the status page for that job... https://jenkins02.openstack.org/job/periodic-tempest-devstack-vm-stress/50/15:37
*** mrodden1 has quit IRC15:37
dkranzfungi: ok, thanks. GOt it.15:37
fungiand then the /50 comes from the run number15:37
*** datsun180b has joined #openstack-infra15:38
*** senk has joined #openstack-infra15:38
*** ArxCruz has quit IRC15:40
*** ArxCruz has joined #openstack-infra15:43
*** rongze has quit IRC15:45
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Alphabetize projects.yaml again  https://review.openstack.org/5795915:48
openstackgerritA change was merged to openstack-infra/os-loganalyze: Support Setting The Path Using an ENV Variable  https://review.openstack.org/5778315:57
*** wenlock_ has joined #openstack-infra15:57
*** dstanek has quit IRC15:58
*** ruhe has quit IRC16:00
anteayadprince: this page http://smokestack.openstack.org/ 404s16:02
dprinceanteaya: https://smokestack.openstack.org/16:02
dprincessl, albeit an unsigned one...16:03
*** ericw has joined #openstack-infra16:04
*** ericw is now known as ewindisch16:04
*** rongze has joined #openstack-infra16:04
*** danger_fo_away is now known as dangers16:04
*** SergeyLukjanov has quit IRC16:05
*** UtahDave has joined #openstack-infra16:06
*** atiwari has joined #openstack-infra16:08
anteayadprince: what do you want to do about the link using http:// on http://ci.openstack.org/third_party.html ?16:10
fungithat can be updated in openstack-infra/config doc/source/third_party.rst i believe16:11
anteayaI ask because http://lists.openstack.org/pipermail/openstack-dev/2013-November/019219.html16:11
anteayawhich requires all neutron plugins to have third party testing by i-216:11
anteayaso there are many new folks popping up asking how to imipliment16:12
dprinceanteaya: I can fix the link I guess. I thought I had them all fixed...16:12
anteayaas the first and best example of third party testing, I am pointing them to your code dprince16:13
dprinceanteaya: and they will likely hate me because I did things w/ Ruby. But that is fine.16:13
*** DinaBelova has quit IRC16:13
anteayabut the broken link is a trip hazzard16:14
openstackgerritDan Prince proposed a change to openstack-infra/config: Fix SmokeStack link to be the ssl version.  https://review.openstack.org/5796416:14
dprinceanteaya: ^^16:14
*** ewindisch has quit IRC16:15
*** ewindisch has joined #openstack-infra16:15
mordredmorning all16:15
krtaylormorning mordred16:16
dprincemordred: late start for an east coaster now hey16:17
mordreddprince: heh. well, it's an early start when you're on the west coast16:17
*** misterpink has joined #openstack-infra16:18
dprincemordred: well then, I see you adjust nicely16:18
*** senk has quit IRC16:29
*** wenlock has quit IRC16:29
*** misterpink has quit IRC16:30
*** datsun180b_ has joined #openstack-infra16:30
*** misterpink has joined #openstack-infra16:30
*** wenlock has joined #openstack-infra16:32
*** rongze_ has joined #openstack-infra16:32
*** rongze has quit IRC16:32
*** datsun180b_ has quit IRC16:33
*** datsun180b_ has joined #openstack-infra16:33
*** datsun180b has quit IRC16:34
*** datsun180b_ is now known as datsun180b16:34
* fungi disappears to get some lunch... bbiab16:39
zuldoes pbr have anything to do with sphinx?16:40
*** mihgen has quit IRC16:40
*** yassine has quit IRC16:41
*** fifieldt has quit IRC16:42
*** yaguang has quit IRC16:44
*** chandankumar has left #openstack-infra16:44
*** chandankumar has joined #openstack-infra16:44
chandankumarHello16:45
chandankumari have to edit the wiki page of stackalytics16:46
chandankumarfor that i am creating the account on openstack wiki page16:46
*** reed has joined #openstack-infra16:46
chandankumarfor that i requires secret word, as word (secret)  i am entering isnot acceptable while creating the account.16:47
chandankumarwhat is that secret word?16:47
*** DinaBelova has joined #openstack-infra16:53
jeblairzul: i think it does touch it a little; i think it has an option to auto-generate api docs16:53
zuljeblair:  because im seeing newer versions of sphinx fail on kestone and noa16:54
mordredzul: there is a newer version of sphinx that is broken16:57
mordredzul: which is why we have it pinned, iirc16:57
zulmordred:  yeah yeah ;)16:57
mordredzul: I do not believe the breakage is pbr related16:58
mordredhowever - it's entirely possible that something new has arisen16:58
*** Hefeweizen has quit IRC16:58
*** jgriffith has quit IRC16:59
*** jgriffith has joined #openstack-infra16:59
*** Hefeweizen has joined #openstack-infra16:59
*** dkehn has quit IRC16:59
*** derekh has quit IRC17:00
*** dkehn has joined #openstack-infra17:00
openstackgerritCyril Roelandt proposed a change to openstack/requirements: Add sphinxcontrib-docbookrestapi  https://review.openstack.org/5797817:00
*** ewindisch has quit IRC17:02
*** julim has quit IRC17:05
openstackgerritA change was merged to openstack/requirements: Update python-troveclient version  https://review.openstack.org/5213717:05
*** julim has joined #openstack-infra17:06
*** rfolco has quit IRC17:07
*** herndon has joined #openstack-infra17:07
*** med_ has quit IRC17:11
*** rpodolyaka has quit IRC17:12
*** ewindisch has joined #openstack-infra17:16
*** atiwari has quit IRC17:16
portantenotmyname: http://git.openstack.org/cgit/openstack-infra/elastic-recheck/tree/queries.yaml17:20
*** jpich has quit IRC17:20
*** pblaho has quit IRC17:20
*** mrodden has quit IRC17:23
*** hogepodge has joined #openstack-infra17:25
openstackgerritA change was merged to openstack-infra/zuul: test: support voluptuous 7.0+  https://review.openstack.org/5469617:29
zarofungi: can we reverify on a change that has been approved but not  merged?17:30
mgagnezaro: reverify no bug ?17:31
mgagnezaro: unless you have a bug associated with it17:32
zaromgagne: yes, https://review.openstack.org/#/c/5639717:32
mgagnezaro: make sure there is no dependencies17:32
mgagnezaro: cloverphp publisher is a dependency17:32
mgagnezaro: it needs to be approved for this one to get merged17:32
zaromgagne: ahh forgot. i see why it didn't go thru now.17:33
zaromgagne: would still like to get this one merged if you can take another look, https://review.openstack.org/#/c/5671517:33
openstackgerritValeriy Ponomaryov proposed a change to openstack-infra/config: Add gate-manila-devstack job  https://review.openstack.org/5798717:34
mgagnezaro: I was able to build a python project on my windows slave. Jenkins looks to work fine on Windows 2012, just a PITA to setup...17:34
zaromgagne: what type of connection?17:35
jeblairclarkb: bug in https://review.openstack.org/#/c/52689/ :(17:35
mgagnezaro: using javaws to start the slave. it's using JNLP. again, it's a PITA with a firewalled setup, you have to assign a static port for JNLP on the master.17:35
*** mrodden has joined #openstack-infra17:36
pabelangerYay, voluptuous patch landed!17:36
*** johnthetubaguy1 has quit IRC17:36
zaromgagne: yeah. don't like JNLP either.  did you try ssh?17:37
*** markwash has quit IRC17:37
*** sarob has joined #openstack-infra17:39
mgagnezaro: no, this would require further more setup on the windows image and I wanted it to work asap. But it would probably worth it, our git repositories require ssh keys anyway.17:39
mgagnezaro: I just don't know yet how I'm gonna puppetize that thing. Installing packages/dependencies on Windows is such a pain...17:40
zaromgagne: yeah. don't like JNLP either.  did you try ssh?17:47
mgagnezaro: no, have any documentation I can read?17:48
zaromgagne: opps, mean how about custom image with ssh?17:48
*** ^d has joined #openstack-infra17:48
*** ^d has joined #openstack-infra17:48
*** misterpink has quit IRC17:48
*** dizquierdo has quit IRC17:51
openstackgerritKhai Do proposed a change to openstack-infra/jenkins-job-builder: update doc and add new JJB unit tests  https://review.openstack.org/5671517:51
mgagnezaro: here is the trick: the build I'm doing (on this windows slave) will support builds of Windows images I'm working on (which for various reasons shouldn't have ssh installed). I'm actually using a half-baked Windows image to setup my jenkins slave and then use it to build tools used to improve my windows images. Long story short: I'm dog fooding my windows images.17:51
*** datsun180b_ has joined #openstack-infra17:52
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Raise an exception on an invalid reporter  https://review.openstack.org/5799617:53
mgagnezaro: One thing I could do is add support for Windows in DIB so I could add tools to my base image and then use it for my slaves.17:53
*** hogepodge has quit IRC17:54
*** datsun180b has quit IRC17:55
*** datsun180b_ is now known as datsun180b17:55
notmynamejog0: any response to clayg on https://review.openstack.org/#/c/57334/ ? if that can't be merged, then we'll need to merge https://review.openstack.org/#/c/56712/ ins wift17:56
*** che-arne has quit IRC17:57
openstackgerritA change was merged to openstack-infra/zuul: register reporters on test config  https://review.openstack.org/5518417:57
*** rongze has joined #openstack-infra17:57
jeblairnotmyname: a quick glance at the comment suggests that clayg may be under the impression that "except Exception:" is not allowed by the rule, but in reality it is17:59
jeblairnotmyname: dhellmann made some fairly compelling arguments that 'except:' is almost never what you want and 'except Exception:' is the best way to "catch 'em all"18:00
*** hogepodge has joined #openstack-infra18:00
notmynamejeblair: the point is that we specifically do not want a requirement for "except Exception". we want to be able to have bare excepts18:00
jeblairnotmyname: (an approach i am also strongly in favor of)18:00
notmynameright, and I agree in general. but there are exceptions18:00
*** sarob has quit IRC18:01
*** rongze_ has quit IRC18:01
jeblairnotmyname: okay -- so i fist just wanted to make sure that the discussion wasn't 'except something:' versus 'except:', so that's cool.18:01
notmynamejeblair: and I'd prefer to have a mechanism to say "no this is really what I mean" rather than turning the check off18:01
jeblairugh, so we talked about this at the summit: https://etherpad.openstack.org/p/icehouse-oslo-hacking-updates18:02
notmynamejeblair: we currently have 2 patches that will fail flake 8 because they each have "except:" (as they should). similarly, we had a period of time during havana when we weren't really deployable for a while because a bare except got changed to "except Exception"18:02
jeblairand unfortunately, the only thing that got recorded in the etherpad was that everyone in the room seemed convinced that "except Exception" is the way to go, even though many of us wanted to remove the check18:03
notmynamejeblair: end result being that either the flake8 patch needs to land, or we'll turn off bare except checking in swift18:03
*** ^d has quit IRC18:03
hub_capwasnt there a wiki article for setting up your own nodepool (so i can test the image cache changes) ?18:03
*** ^d has joined #openstack-infra18:03
*** ^d has quit IRC18:03
jeblairand while everyone thought that the docs should be updated to include more _reasoning_ about these things, the reasoning about "except Exception" stated at the time wasn't recorded18:03
*** ^d has joined #openstack-infra18:03
*** SergeyLukjanov has joined #openstack-infra18:04
clarkbjeblair:  :(18:04
clarkbalso good morning (really late start for me today :( )18:04
notmynamejeblair: nobody is arguing that for the vast majority of the time you don't want to have bare excepts. this is similar to having "reverify no bug" ;-)18:04
notmynamebad idea most of the time, but sometimes needed18:04
jeblairand i only remember it had something to do with the fact that _very low level_ exceptions are the only ones that don't derive from Exception, and they are ones that you never really want to catch18:04
notmynamejeblair: eventlet timeouts do not derive from exception18:05
jeblairnotmyname: !!?18:05
notmynamefor good reason (and I'm curious how other projects handle that)18:05
notmynameeventlet.Timeout derives from BaseException18:05
notmynameso eg in Swift we have a lot of "except (Exception, Timeout):"18:06
notmynamewhich is good18:07
jeblairnotmyname: i'm not in a position to argue the point, so i don't want to waste any more of your time (i am not opposed to the noqa flag certainly); you should probably talk to jog0 and dhellmann18:07
notmynamejeblair: ok :-)18:07
notmynameand I'm not trying to argue anything either. I'd prefer to see noqa for bare excepts supported, but there are (less optimal) ways to do the same thing18:08
notmynamejog0: dhellmann: you have been summoned18:09
*** UtahDave has quit IRC18:09
jeblairnotmyname: oh sorry, just to set the tone of my last remark -- i meant it more in the sense of "i don't have all the facts at my disposal to have a productive conversation"; however, i am very interested in the conversation as I think i have some things to learn18:10
notmynamejeblair: no worries :-)18:10
reedfungi, thanks signing my key18:14
clarkbjeblair: for the bug in 52689, would caching the git config values in merger.Repo and checking if they have changed then updating them work?18:14
clarkbjeblair: if I understand correctly we just need to be able to update those values if they change in the config18:15
reedfungi, too bad your messages only confirmed the incredibly very sad state of encryption tools :(18:15
jeblairclarkb: yes, but they also need to update on a fresh start (if you shut down zuul, reconfig, then start), so you might need to handle that18:15
jeblairclarkb: basically, that's why there was an _initialized flag18:15
*** sarob has joined #openstack-infra18:16
*** SergeyLukjanov has quit IRC18:17
*** melwitt has joined #openstack-infra18:18
*** markwash has joined #openstack-infra18:18
*** fungi has left #openstack-infra18:19
*** pafuent has joined #openstack-infra18:19
*** mrmartin has joined #openstack-infra18:21
*** sarob has quit IRC18:22
clarkbjeblair: was this bug preexisting? I don't see how merger.email and merger._initialized could be updated after the initial clone with the old code18:22
clarkbjeblair: except for on a zuul restart18:22
clarkbis that the cause that you are talking about?18:22
clarkb* case18:23
*** david-lyle is now known as david-lyle_afk18:24
jeblairclarkb: right -- before zuul never expected to reclone after it started, so it's correct that case wasn't handled (it couldn't be).  but it could handle a config change across a restart18:24
clarkbgotcha18:24
*** DinaBelova has quit IRC18:25
*** sarob has joined #openstack-infra18:29
*** flaper87 is now known as flaper87|afk18:30
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Add the possibility to pass the zuul url  https://review.openstack.org/5419618:31
*** SergeyLukjanov has joined #openstack-infra18:31
*** chuck__ has joined #openstack-infra18:31
*** sarob_ has joined #openstack-infra18:32
clarkbjeblair: I think I have a simple fix18:32
clarkbrunning tox over it now18:32
*** sarob has quit IRC18:32
reedjeblair, mordred: see my email to the i18n team18:35
pafuentHi, I submitted my first patch to Openstack, and I'm not sure if Jenkins must run the merge with the actual status of the review (I got an Approved). Someone could check the status of the review and tell me if I need to do something else? (https://review.openstack.org/#/c/57001/)18:35
reednot urgent18:36
reedpafuent, welcome! :)18:36
pafuentreed: Thanks18:36
mroddenso this seems interesting http://logs.openstack.org/74/57774/2/gate/gate-tempest-devstack-vm-full/e592961/testr_results.html.gz18:37
jeblairreed: i'm very opposed to us paying for 'enterprise features' of transifex18:37
jeblairreed: i never thought that was what we decided at hk18:37
mroddentempest.scenario.test_minimum_basic.TestMinimumBasicScenario failed with SSHException: Error reading SSH protocol banner18:37
*** fungi has joined #openstack-infra18:37
*** sarob_ has quit IRC18:38
*** hogepodge has quit IRC18:39
*** osanchez has quit IRC18:39
*** sarob has joined #openstack-infra18:39
jeblairreed: i even double checked https://etherpad.openstack.org/p/icehouse-summit-translation-tools-and-scripts18:39
jeblairreed: "ask for a quote for enterprise services" was not an action item18:39
*** rfolco has joined #openstack-infra18:40
clarkbpafuent: it has not merged, under status it says review in progress which will switch to merged when it does merge18:41
*** sarob has quit IRC18:41
*** Ryan_Lane has quit IRC18:41
*** SergeyLukjanov has quit IRC18:41
clarkbpafuent: I think that change probably got lost in the great gate upheaval of november 201318:41
*** sarob has joined #openstack-infra18:42
clarkbpafuent: the current fix to that problem is 'reverify no bug' but reverify may(did we make a decision on this yet) be going away in the near future18:42
*** rongze has quit IRC18:42
mroddenclarkb: all of reverify  or just no bug?18:43
openstackgerritClark Boylan proposed a change to openstack-infra/zuul: GC git.Repo objects in merger.Repo operations.  https://review.openstack.org/5594318:43
openstackgerritClark Boylan proposed a change to openstack-infra/zuul: Clone repo if it is not on disk  https://review.openstack.org/5268918:43
clarkbmrodden: I would like all of reverify to go away, but I think I may lose that argument :)18:43
clarkbjeblair: ^ fixes for zuul18:43
mroddenwhat would be used instead18:43
harlowjajd__ yt18:43
clarkbmrodden: core reviewers can leave a new comment with +1 approved18:43
pafuentclarkb: So, I need to add a comment with 'reverify no bug'?18:44
mroddenok18:44
clarkbpafuent: yes18:44
pafuentclarkb: Ok, thanks so much18:44
fungiclarkb: pafuent: yes, looks like zuul probably did not see that approval. it was likely timed while zuul was down or otherwise not watching the gerrit event stream while we were working through gate issues. i al;ready added a reverify comment on it a few minutes ago and it's in the gate now18:44
clarkbfungi: cool thanks18:44
SpamapSdoes this need to be re-queued somehow? https://review.openstack.org/#/c/51685/ ?18:44
SpamapSI don't see it listed on zuul.openstack.org18:44
* jd__ stares at harlowja 18:45
clarkbSpamapS: I think you have the same problem as pafuent, give it a 'reverify no bug'18:45
SpamapSclarkb: ty18:45
pafuentclarkb: Thanks again18:45
harlowjajd__ i and a few others were wondering about https://etherpad.openstack.org/p/icehouse-oslo-service-synchronization (i think u did this session) anything we can help out with there?18:45
fungiclarkb: SpamapS: though that one does look like it had started gating back on wednesday, so it was probably actually in the gate when we dumped it18:46
jd__harlowja: we need https://review.openstack.org/#/c/56927/ approved so Yassine can start sending patches18:46
harlowjainteresting, tooz18:47
harlowjathat will be the name, neat, haha18:47
jd__yeah :-)18:47
harlowjawell it has my +1 now to ;)18:47
harlowjawonder if someone from here can approve it ;)18:48
jd__maybe we can stare at someone18:48
fungireed: i assume you refer to the need to unfortunate need to import and publish the signature? note that uses a trick of cryptography... i can encrypt the signature for each uid and send them independently to their respective addresses, but only if you both have control of the decryption key and control of that e-mail address will it be possible for you to decrypt and publish the sig on a given uid18:49
harlowjajd__ what were your thoughts on having a locking api in that also, still service 'liveness' releated18:49
clarkbO_O standalone python libvirt on pypi for version 0.9.11 is possible18:49
clarkbnow I really want to get cloud archive going again18:49
harlowjajd__ https://wiki.openstack.org/wiki/StructuredWorkflowLocks (stares at that, haha)18:49
clarkbjd__: what is the status on using ubuntu cloud archive on the test slaves?18:49
jd__harlowja: I think it's a good idea, that could be another featureset of a driver -- in the case some driver don't support that part, and vice-versa18:50
reedfungi, not that, it's the fact that Thunderbird Enigmail fails to see the attachment... I still haven't found time to import them :(18:50
fungireed: really? weird18:50
harlowjajd__ sure, taskflow itself would love such a library :)18:50
jd__harlowja: I read -- I can't stare the wiki for too long, it always wins, it scares me.18:50
clarkbfungi: jeblair: mordred: until https://review.openstack.org/#/c/57807/ (or something like it) puppet won't run on the precise slaves18:50
reedjeblair, the Enterprise quote was implicit in the needs of the i18n team18:50
jeblairreed: no it wasn't.18:51
clarkbit runs ok in the d-g image build because those image builds don't use server.pp as a base18:51
jeblairreed: "Talk to Transifex, let them know how we feel about their change of course"18:51
harlowjajd__ :) scary wikis18:51
jeblairreed: that was the action item18:51
jeblairreed: nothing about quotes or extending our use of transifex18:51
reedjeblair, that was done18:51
jog0notmyname: sorry haven't had a chance to review it18:51
reedthere were also other questions for them in the discussions18:51
clarkbfungi: jeblair: an alternative to my proposed fix would be to rework where we make the rsyslog changes for d-g slaves18:51
*** wenlock has quit IRC18:52
notmynamejog0: ok. I know there's been a lot going on. just wanted to alert you on it again :-)18:52
reedjeblair, there are needs from the TX team stated18:52
jd__clarkb: there's a patch to make them use cloud archive there https://review.openstack.org/#/c/48226/18:52
jeblairreed: we decided to move from transifex to another platform, and to work with the communities of the other platforms on those needs18:52
harlowjajd__ well let me know if u need any help (taskflow peoples are in #openstack-state-management) - defintely interseted in helping this18:52
jd__clarkb: I left a comment with the status (from what I know) today18:52
*** Ryan_Lane has joined #openstack-infra18:53
reedjeblair, the i18n team doesn't agree that that was the decision... the decision for them was that for the time being we stay on TX18:53
jog0notmyname: the short of it, is I am fine with adding a noqa to almost anything18:53
jeblairreed: says who?18:53
notmynamejog0: great! merge it! ;-)18:53
jog0I am blindly trusting you on there is a good reason for this18:53
reedjeblair, says Daisy, the team lead18:53
jeblairreed: where?18:53
jog0notmyname: but I am a stickler for commit messages :)18:53
clarkbjd__: thanks, looking at that now18:53
jd__harlowja: awesome, yassine's working on it right now with some guidance, and he'll push things as soon as repo is up -- I'll tell you when the show begins18:53
reedjeblair, not on a mlist :)18:53
jeblairreed: the decision is to stay on transifex while we work on moving to another platform carefully18:53
jog0notmyname: oh and testing is magic docstring tests18:53
jeblairreed: then it didn't happen.  :)18:53
notmynamejog0: well, it's not too blind there are references to current requirements for it :-)18:53
reedjeblair, there, you said that too18:54
clarkbjd__: lgtm hoping jeblair and fungi will take a look too https://review.openstack.org/#/c/48226/18:54
jog0notmyname: I didn't say everyone is blindly trusting you, just that I am.18:54
reedso, while we stay on TX, the i18n team needs to function18:54
jeblairreed: yeah, 'stay on platform while we work on the move' doesn't mean 'buy new enterprise features'18:54
jog0as I have no reason to doubt you on this18:54
jog0and I am *not* a python expert like dhellmann or others18:54
jeblairreed: if tx is already less functional than pootle, perhaps we should go ahead and move18:54
reedjeblair, there is no decision to buy anything, just to get a quote18:54
reedjeblair, it's not, unfortunately18:55
harlowjajd__ great18:55
reedpootle and the others have more limitations than TX, that was the result of the discussion in HK18:55
reedand of the evaluation done before18:55
jog0notmyname: you hit a E901 in the test18:55
jog0http://logs.openstack.org/34/57334/1/check/gate-hacking-python26/2d8b364/console.html#_2013-11-19_22_46_29_42918:55
jog0which is why its failing18:55
jog0 so fix that and cut and paste some of that comment into the commit message and +2 from me it is18:56
jog0then we have to cut a hacking 0.8.1, which is trivial enough18:56
jeblairreed: sure, they all have problems; my point is that we decided to move, and therefore, we should spend effort there and not on transifex.18:57
*** sarob has quit IRC18:57
reedfeel free to reply to my email to the i18n team so we get to the same page...18:57
*** zul has quit IRC18:57
*** sarob has joined #openstack-infra18:58
jeblairreed: (i'm not sure that others have more limitations than tx; all tools have some gaps)18:58
reedjeblair, indeed, they all do but we have here a social problem mostly, not a tech one18:58
*** hogepodge has joined #openstack-infra18:58
clarkbjog0: was there something specific on the etherpad you wanted me to look at? I am reading it and not seeing much of a diff18:58
jog0clarkb: I added some notes at the bottom of things I want to have written down somewhere18:59
reedjeblair, the social issue is that the i18n team doesn't want to change tool, they are already familiar with TX which they perceive as the "best"18:59
*** david-lyle_afk is now known as david-lyle18:59
jeblairreed: then they should have said that in hk18:59
reedjeblair, whatever else we try to give them they will not like18:59
jeblairreed: but instead they agreed to change to a new tool18:59
jog0clarkb: in part, explain the new flow for debugging gate18:59
jog0as I have seen people try to help and not really sure how18:59
reedjeblair, one can argue they didn't agree to "changing", quite the contrary ...19:00
*** hogepodge has quit IRC19:00
jog0clarkb: under items to cover19:00
fungireed: should we consider privatizing the translations entirely since they're going to be done using proprietary tools now?19:00
clarkbjog0: thansk reading those now19:01
jeblairreed: wow, that's really disingenuous if that's what they're saying19:01
notmynamejog0: I'm not sure I know how to read that log error. (and it's clayg's patch)19:01
reedfungi, my opinion counts very little, I don't 'manage' them, I have little authority19:01
fungireed: it doesn't sound like there's any intent for them to be part of openstack, the free software project any longer19:01
jeblairreed: you don't fly out to a summit, get together for a conversation, come to an agreement, and then say "oh, well i didn't technically agree to that"19:01
jog0notmyname: 'incorrectly found E901'19:01
*** wenlock has joined #openstack-infra19:02
jog0clarkb: I am thinking maybe we add a doc to e-r saying how we do things19:02
jog0I started one19:02
clarkbjog0: ++19:02
*** mfer has quit IRC19:02
fungireed: this takes them into the realm of o'reilly press editing our manuals with proprietary tools. that effort isn't part of open stack, but rather a separate project which we happen to receive the end results from19:02
jog0clarkb: https://review.openstack.org/#/q/status:open+project:openstack-infra/elastic-recheck+branch:master+topic:queries,n,z19:02
jog0by start I mean add a few lines19:02
jog0but its a start19:02
reedfungi, good point19:02
jog0that what in the email we can say, if you want to help read x19:02
openstackgerritA change was merged to openstack-infra/jenkins-job-builder: update doc and add new JJB unit tests  https://review.openstack.org/5671519:03
*** sarob has quit IRC19:03
*** sarob has joined #openstack-infra19:03
*** sandywalsh has quit IRC19:04
fungijd__: clarkb: i'm -1 on that patch for the moment. i'd like to see nova weigh in on the efficacy of that new libvirt package, since they have an open task on the bug19:04
*** sarob has quit IRC19:05
mordredreed: I agree with jeblair19:05
*** sarob has joined #openstack-infra19:05
clarkbfungi: nova cores are proposing we stop supporting libvirt older than 0.9.11 (precise is 0.9.8) because we can have pip installable python bindings with 0.9.1119:05
mordredI feel that we decided that we would investigate the options more fully so that we could understand what a migration plan would look like19:05
clarkbfungi: do we need to merge a discussion somehwere?19:06
*** hogepodge has joined #openstack-infra19:06
mordredreed: we under no circumstances did anything that would imply that we would pay tx money for anyting or move to an enterprise version of anything19:06
fungiclarkb: potentially, i think it's not reflected in either the proposed change or the bug. even just a hyperlink in the bug to the ml thread might help?19:06
clarkbfungi: sure, have a bug number? I will grab a link to the ml thread19:07
fungiclarkb: i'm more concerned with knowing that the 1.1.1 they've added to cloud archive is known to fix bug 122897719:07
uvirtbotLaunchpad bug 1228977 in nova "n-cpu seems to crash when running with libvirt 1.0.6 from ubuntu cloud archive" [High,Confirmed] https://launchpad.net/bugs/122897719:07
*** Ryan_Lane has quit IRC19:08
clarkbfungi: ok, I will leave notes on the bug about the ml discussion19:08
fungiclarkb: the last comment, from the package maintainer, just said "here's a new version, please test"19:08
mordredin fact, I find the o'reilly thing pretty repulsive, but am willing to deal with it because annegentle is really awesome19:08
*** Ryan_Lane has joined #openstack-infra19:08
fungiwanting to make sure that the "test" isn't us adding cloud archive back to all our slaves19:08
clarkbjog0: left notes on the etherpad19:09
clarkbfungi: gotcha19:09
jeblairmordred: to be fair, they keep saying things like "we want to figure out how to work with your process".  maybe monday's meeting will get us somewhere since we won't be on a time crunch.19:09
*** sarob has quit IRC19:09
jeblairmordred: and that's all i'm going to say on that, because, indeed, they have had a while to figure it out and haven't yet.  :/19:10
*** sdake_ has joined #openstack-infra19:10
*** sdake_ has quit IRC19:10
*** sdake_ has joined #openstack-infra19:10
fungii take responsibility for a lot of the previous call outcome with o'reilly. they had something like 2 days to start editing and wanted a conference call to talk about process, but i was the only infra core who was available to make the call on such short notice19:10
jeblairfungi: well, it wasn't much different than the call before that.  and probably the call before that too.  but hey, maybe this time it'll be different.  :)19:11
* fungi hopes19:11
*** DinaBelova has joined #openstack-infra19:11
jeblairreed, mordred, fungi: i have sent what i hope is a very clear message to the i18n list19:11
mordredso going19:11
mordredjeblair: awesome19:11
jeblairin particular, if people don't think what i said we agreed to is what we agreed to, then we have a problem.  :)19:12
mordredI agree19:12
*** oubiwann has quit IRC19:12
mordredalso, I'd like to just go on the record as saying that if hte problem is "transifex has gone closed-source" the solution to that problem is not "buy a commercial subscription"19:13
mordredI'd also like to say that, while I apprecite the feedback from our users on their opinions of the tool we're going to use, ultimately we have not made any tooling decisions based on popularity contests19:13
mordredbut instead we have based them on actual technical needs19:13
mordredand we have pissed off many sets of people in the short term due to that19:14
jeblairmordred: that is quite true, and in turn have made a lot more people happy in the long run.19:14
mordredso I'd like to be clear that we're kind of going out of our way to work with people on a decision we're pretty sure will have impact on them here19:14
mordredjeblair: exactly19:14
clarkbfungi: bug updated, any chance you can read what I have and the ML threads and perhaps send a response to merge the threads?19:14
jog0clarkb: thanks19:15
mordredopenstack running key parts of its process on closed-source is not and never has been acceptable19:15
fungiclarkb: just saw the bug update--thanks! i'll loop back around on the ml19:15
clarkbfungi: I am trying to catch up on that bug too and may try to reproduce with 1.1.1 myself (though probably not today as I would need to spin up a proper tempest test bed, unless I hold a d-g node...)19:16
clarkbfungi: actually I think that isn't a half bad idea, we could hold an arbitrary d-g node, wait for tests to finish, add cloud archive and upgrade, then run tempest again19:16
jeblairreed: so, ah, thanks for the heads up.  :)19:17
fungiclarkb: i spin up devstack-tempest slaves pretty regularly to run tests. i can just add cloud-archive in the same manner that puppet change would and try a tempest-full on it19:18
fungii'll try it out here in a bit (i hope)19:18
clarkbfungi: woot that would be super helpful thanks19:18
clarkb(I forget that you are probably the person that know how to do that best)19:18
clarkbwell you and ttx19:18
*** sandywalsh has joined #openstack-infra19:19
*** sarob has joined #openstack-infra19:23
reedjeblair, thank you for the reply. It's good to keep the conversation going19:24
reedI'll reach out to the translatewiki, zanata and pootle folks19:25
*** pabelanger has quit IRC19:26
reedand I learned about another tool yesterday, weblate19:27
*** pabelanger has joined #openstack-infra19:27
*** hashar has joined #openstack-infra19:28
fungiclarkb: maybe i'm misreading http://lists.openstack.org/pipermail/openstack-dev/2013-November/020117.html but does it sound to you like they're asking for us to run tests on machines with vt-d? i was mostly finished drafting a response to point them at the third-party testing doc, but figure a second set of eyes on their request would be good first19:29
*** herndon has quit IRC19:33
openstackgerritSoren Hansen proposed a change to openstack-infra/config: Add BasicDB to stackforge  https://review.openstack.org/5551919:33
portantehave folks seen this behavior before with grenade? https://bugs.launchpad.net/tempest/+bug/125414219:36
clarkbfungi: yes test nodes with vtd is how I read that19:36
uvirtbotLaunchpad bug 1254142 in tempest "check grenade job failed with "fatal: The remote end hung up unexpectedly"" [Undecided,New]19:36
portantehttp://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiZmF0YWw6IFRoZSByZW1vdGUgZW5kIGh1bmcgdXAgdW5leHBlY3RlZGx5XCIgQU5EIGZpbGVuYW1lOmNvbnNvbGUuaHRtbCIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiYWxsIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTM4NTE0ODcxODUzNH0=19:36
clarkbthey will need third party testing because kvm passthrough doesn't seem to work well or be on our cloud provider radars19:36
fungiclarkb: okay, firing reply then. thanks@19:36
clarkbfungi: lifeless may have opinions on using the tripleo cloud19:36
fungiclarkb: no doubt, once it's ready19:37
*** rfolco has quit IRC19:37
sorenclarkb: Are you sure kvm passthrough would even suffice? They're specifically asking for not just VT-D (which I don't believe kvm passthrough offers) as well as some device that provides SR-IOV.19:37
*** rpodolyaka has joined #openstack-infra19:38
*** SergeyLukjanov has joined #openstack-infra19:38
*** mrmartin has quit IRC19:39
*** SergeyLukjanov has quit IRC19:39
clarkbsoren: I actually don't19:40
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for bug 1177134  https://review.openstack.org/5801419:40
uvirtbotLaunchpad bug 1177134 in devstack "[ERROR] /opt/stack/new/devstack/exercises/bundle.sh:61 Image ami-00000001 not available within 15 seconds" [Medium,Triaged] https://launchpad.net/bugs/117713419:40
clarkbsoren: does kvm passthrough only do vtx?19:40
*** pafuent has left #openstack-infra19:41
sorenclarkb: Last I checked.19:41
sorenclarkb: Which arguably was a couple of years ago.19:41
*** ArxCruz has quit IRC19:42
clarkbgoogle doesn't return any "it works!" results so may still be the case19:43
*** rongze has joined #openstack-infra19:43
*** SergeyLukjanov has joined #openstack-infra19:44
*** rongze has quit IRC19:48
*** dprince has quit IRC19:52
jog0clarkb: ping19:54
*** rpodolyaka has quit IRC19:55
jog0so for the 18 hour number, that may have been true, but that doesn't reflect how long it would take to flush the queue19:55
jog0if nothing merges it would take 145 hours for 145 patches to go through19:55
jog0clarkb: for the graphite graph19:55
jog0my html /js is weak19:55
sorenclarkb: I'm not surprised. It's a lot of work with no reasonable real world use cases.19:56
*** mrmartin has joined #openstack-infra19:58
*** herndon has joined #openstack-infra20:01
*** mrmartin has quit IRC20:03
clarkbjog0: gotcha. my html/js is weak too :)20:05
*** mrmartin has joined #openstack-infra20:05
clarkbjog: I would copy pasta from the zuul status page20:05
clarkbit uses a grahpite js lib20:05
jog0ohh thats what that was20:06
*** reed has quit IRC20:06
jog0I just used an image20:06
jog0http://paste.openstack.org/show/5383420:06
*** flaper87|afk is now known as flaper8720:06
*** _david_ has joined #openstack-infra20:09
*** lcestari has quit IRC20:09
*** MarkAtwood has joined #openstack-infra20:09
*** mrmartin has quit IRC20:10
dkranzclarkb: Can you give your thoughts on my last comment in https://bugs.launchpad.net/tempest/+bug/1253896 ?20:10
uvirtbotLaunchpad bug 1253896 in tempest "test_minimum_basic_scenario fails with SSHException: Error reading SSH protocol banner" [Undecided,New]20:10
dkranzclarkb: This is a little outside my area.20:10
clarkbdkranz: interesting, I think you may be on to something20:12
dkranzclarkb: ok, good. But I'm not sure how to test the fix.20:13
*** dolphm has quit IRC20:13
dkranzclarkb: I can put up a patch and run it a bunch of times20:13
clarkbqemu is really slow. cirros is very lightweight but start 4 of them and we may bog down. I think relaxing timeouts if possible might be worth trying also catching exceptions where necessary20:13
dkranzclarkb: We have to catch for this one becuause the timeout is hard-wired in paramiko20:13
clarkbya testing this stuff is hard because it may be related to the underlying hypervisors load too20:14
dkranzclarkb: But we could increase the console log wait time20:14
dkranzclarkb: I'll give it a try20:14
clarkbcool let me know how it goes20:14
*** mfer has joined #openstack-infra20:15
jeblairdkranz: i think since the "Banner:" debug line doesn't show up, it's probably the 15 second timeout for the first line it's hitting.20:18
dkranzjeblair: Makes sense. I am going to just catch all SSHException so it won't matter20:18
*** nsaje has joined #openstack-infra20:19
*** nsaje has quit IRC20:19
*** chuck__ has quit IRC20:20
*** mrmartin has joined #openstack-infra20:22
openstackgerritJoe Gordon proposed a change to openstack-infra/config: Add graphite graph of gate failure rates to e-r page  https://review.openstack.org/5801920:23
jog0clarkb jeblair ^20:23
jog0I'm sure I got osmething wrong on that20:23
jog0being I wasn't sure how to locally test that out20:23
clarkbyou should be able to just open the page locally. the other graphs will 404 but the graphite thing should render20:26
*** dstanek has joined #openstack-infra20:26
jog0hmm it tried hittinh localhost instead of the proper graphite server20:27
jog0digging20:27
*** hogepodge has quit IRC20:27
clarkbyou might need to put it behind python simple http server but I doubt it20:27
jog0clarkb: woot got it working20:28
jog0was missing a line20:28
jog0urL:20:28
*** sarob has quit IRC20:29
jog0hmm the image is too small20:29
clarkbyou can give dimensions to graphite20:29
jog0clarkb: the image is big the page is rendering it small20:30
openstackgerritA change was merged to openstack-infra/zuul: Doc: enhance gating reference with diagrams  https://review.openstack.org/5464820:30
*** gyee has joined #openstack-infra20:31
*** dkliban has quit IRC20:31
*** thomasem has quit IRC20:31
*** hogepodge has joined #openstack-infra20:32
jog0its somet css stuff20:32
chmouelif you guys aren't too busy to review this (add gates tests to swift-bench) https://review.openstack.org/#/c/57845/20:33
chmouelso we can have our first commit merging there20:33
jog0clarkb: fixed20:38
_david_clarkb, jeblair gerit-2.8-rc3 was released today. GA is going to be released in one or two weeks, ...20:38
openstackgerritJoe Gordon proposed a change to openstack-infra/config: Add graphite graph of gate failure rates to e-r page  https://review.openstack.org/5801920:38
clarkb_david_ spearce -2'd zaros patch so it won't get in will it?20:39
clarkbzaro ^20:39
_david_recently we had a discussion to set up testing environment for it and prepare the migration?20:39
_david_clarkb, zaro's patch is on master, we are talking about 2.8 final20:40
clarkbright we can't upgrade until we have that feature20:41
_david_if and when zaro's patch is going to be approved, it can be only available in the next major, i. e. 2.920:41
clarkbor an equivalent thing20:41
_david_clarkb, yeah, we need still core change anyway for WIP plugin to work, so, we would apply zaro's patch too20:42
jeblairwow, uh, the 2.8 ui has changed a lot.20:43
_david_jeblair, the new change screen really rocks ;-)20:43
jeblair_david_: did you write it?20:43
_david_even more cooler is the master now, with related changes tabs20:43
_david_jeblair, Nope, wop wrote it, at least the first version, i contributed a lot to the new change screen20:44
_david_s/wop/sop20:44
jeblair_david_: it doesn't fit on my 1280x1024 screen20:45
openstackgerritA change was merged to openstack/requirements: Bump to using SQLAlchemy migrate 0.8.2.  https://review.openstack.org/5666220:45
_david_jeblair, really? https://gerrit-review.googlesource.com/#/c/51996/20:45
*** alcabrera has quit IRC20:46
jeblair_david_: that one is fine, zaro's has more tabs... screenshot coming20:46
jeblairhttps://gerrit-review.googlesource.com/#/c/48254/20:46
openstackgerritA change was merged to openstack-dev/pbr: Bump the development status classifier.  https://review.openstack.org/5727220:46
_david_jeblair, that's true!20:46
_david_jeblair, there are 4 tabs: 1/ dependencies, /2 same topic /3 conflicting changes with the curent change /4 cerry picked20:47
_david_jeblair, those tabs are conditions, if they are empty, then they are hidden., ...20:47
_david_on zaro's patch they are full, and shown20:47
jeblairhttp://imgur.com/WdrYFzB20:47
*** dolphm has joined #openstack-infra20:47
*** chuck__ has joined #openstack-infra20:48
jeblair_david_: also same topic says "400 Unsupported query:Owner"  why is that?20:48
_david_Is that on gerrit-review?20:49
jeblair_david_: yes20:49
jeblair_david_: on https://gerrit-review.googlesource.com/#/c/48254/2820:49
_david_jeblair, unbelievable ;-)20:49
_david_jeblair, since Gerrit 2.8 there is secondary index = Lucene or Solr bilt in in Gerrit20:49
_david_so that all new and shiny queries are working only if secondary index is enabled20:50
_david_something was broken there ,-)20:51
_david_jeblair, on my 15" wide screen laptop all is fine with the screen and all 4 tabs are visible20:51
jeblair_david_: yes, i can obviously make the window wider; the question is whether it's a good idea from a UI perspective to _require_ that people have widescreen displays in order to use gerrit20:52
*** sarob has joined #openstack-infra20:53
*** miqui has quit IRC20:53
*** dkliban has joined #openstack-infra20:53
*** sarob has joined #openstack-infra20:53
_david_jeblair, yes they should ;-) Today each and every one has 15" wide screen laptop + 30" desktop display20:53
jeblair_david_: i think UIs that can reflow to accomodate various widths are best, but if you're going to assume you're on a desktop, assuming a width of 1024 is nice, or 1280 as a max.20:53
openstackgerritA change was merged to openstack-infra/config: Switch gate-tempest-devstack-vm-neutron-large-ops to a voting job  https://review.openstack.org/5662920:54
_david_jeblair, sop added only one tab: related changes20:54
_david_jeblair, the other 3 was added recently ...20:54
* fungi runs his browser on a 1080x1920 (portrait) display, shrinks the font and still has to scroll gerrit horizontally. horrible ui choice20:55
*** DinaBelova has quit IRC20:55
openstackgerritArmando Migliaccio proposed a change to openstack-infra/config: Avoid false positives for python27 UT gate job  https://review.openstack.org/5802220:55
jeblair_david_: i don't think it's a good assumption to make that everyone has a display like that.  because it's clearly not true.20:55
fungii also sometimes use it from a wearable with a 640x480 display and wow. scrolltastic20:55
*** sarob_ has joined #openstack-infra20:55
openstackgerritKhai Do proposed a change to openstack-infra/config: Setup a private gerrit instance for security reviews  https://review.openstack.org/4793720:56
*** sarob has quit IRC20:56
zarofungi: ^20:56
jeblair_david_: and moreover, there's a huge amount of space wasted if you expand the window to hold all 4 tabs -- fully 25% of the space under them is wasted since the rest of the page isn't that wide.20:56
openstackgerritChmouel Boudjnah proposed a change to openstack-infra/config: Add minimal checks for swift-bench.  https://review.openstack.org/5784520:56
portanteclarkb: grenade failed because pip could not be downloaded, should I file a bug, or just recheck the job?20:57
jeblair_david_: my display is actually 2560x1024 wide, but it spans two monitors.  that means i can have gerrit in one and some terminals and an email client in another.20:58
fungiportante: i think we need a bug for that if there isn't one already. we shouldn't be trying to download pip directly from pypi.python.org during tests20:58
jeblair_david_: and even when i'm on a widescreen laptop, i only expand my browser to about 1024 wide so that i can fit some terminals beside it...20:58
portantefungi: k20:58
jeblair_david_: all of that is to say that people have different ways of working, with different display systems...20:58
portantefiling ...20:58
jeblair_david_: and it's nice to try to accomodate them by not requiring that they run an app in full screen mode20:59
_david_jeblair, can you remember as we have very vital discussion on #gerrit with mfick about third columnon old change screen?20:59
fungias soon as i can get this displayport mst hub to work better under linux, i'll be able to run both my portrait displays in 1440x2560, and then maybe the browser one will be wide enough to not have to scroll gerrit21:00
portantefungi: it was trying to download from pypi.openstack.org, though21:00
portanteError <urlopen error timed out> while getting http://pypi.openstack.org/openstack/pip/pip-1.4.1.tar.gz (from http://pypi.openstack.org/openstack/pip/)21:00
_david_jeblair, we wanted to put there verification status table, and he was against it, exactly for these reasons, ...21:00
fungiportante: oh, that's definitely weird21:00
portantethat is a 40421:00
zarofungi: talked to clarkb and came up with the config in the rst file.21:00
fungiportante: definitely weird to get a 404 there... it certainly is a valid url and i can download from it just fine21:01
fungizaro: awesome!21:01
_david_jeblair, but beside screen question: are we going to setup a test gerrit installation for 2.8 in the near future?21:01
portanteI get a 404 hitting it right now21:02
portanteoopps21:02
portanteno, it is ithere21:02
jeblair_david_: i never thought it had to make it wider; our gerrit 2.4 only uses a little less than 2/3 of the width at 1280 (a little more than 2/3 at 1024); plenty of room for a 3rd column, and of course it could wrap if needed21:02
*** yolanda has quit IRC21:02
openstackgerritJoe Gordon proposed a change to openstack-infra/elastic-recheck: Swap in better query for 1239856  https://review.openstack.org/5802421:02
jeblair_david_: and lots of room to the right of the reviewer table which takes < 1/2 the width21:02
portantemust have been a simple service distruption21:02
jeblair_david_: right, anyway.  :)21:03
portanteis it really worth a bug for that, fungi?21:03
jeblair_david_, clarkb, zaro: i think we wanted to hold off on setting it up until the patch at least landed in master21:03
portanteor perhaps file a bug so that we have a handle to recheck on?21:03
jog0jeblair: glance-bugs is not open21:03
jog0I got me a critical21:03
jog0markwash: ^21:03
jog0https://bugs.launchpad.net/glance/+bug/123985621:03
fungiportante: i think so. i'd like to check the apache logs on static.o.o where that's hosted21:03
uvirtbotLaunchpad bug 1239856 in glance "Registry client request GET /images/UUID raised ClientConnectionError" [Undecided,Confirmed]21:03
portantek, filing21:04
jeblair_david_, clarkb, zaro: and with a -2 on that patch (even though it looks like it's for fixable things, which might even be fixed) i'm still worried21:04
portantetempest?21:04
zarogetting a patch to land in upstream gerrit is an exercise in frustration!21:04
_david_jeblair, anyway, because we are going to make a really big jump from 2.4 to 2.8 there is a lot to do with configuration upgrade, database migration, tests21:04
fungiportante: so having timestamps will help me there21:04
fungiportante: openstack-ci21:04
portantek21:04
_david_zaro, if i can give you advice: take it easy, really, there is no difference at all, if the change is landed today or in two months21:05
zarojeblair, _david_, clarkb : i have sent out another email to spearce to take another look.  i think that's the third time.21:05
_david_jeblair, i don't understand how installation setup depends on landing or not of zaro's change21:06
jeblair_david_: we can't even be remotely certain that the change will land.21:06
_david_zaro, that was wrong, please don't send and don't ask, that makes the thing only worse, believe me21:06
zarojeblair, _david_, clarkb : i also asked everybody that have reviewed it to re-review.21:06
portantefungi: https://bugs.launchpad.net/openstack-ci/+bug/125416721:06
uvirtbotLaunchpad bug 1254167 in openstack-ci "pip fails to install, timeout fetching from pypi.openstack.org" [Undecided,New]21:06
fungiportante: thanks!21:07
zaro_david_: good to know.  mfick told me that spearce doesn't mind being reminded21:08
_david_jeblair, but for WIP plugin to work we still need to patch core, so who care, that we patch it twice,21:08
_david_well the only difference between WIP core change and zaro's change that zaro's change touch database21:08
jeblair_david_: we don't want to run a fork, we want to run upstream.  if these patches land, i think we're okay running a patched version because we know we won't have to work to carry the patch in the future21:09
portantefungi: i rechecked that job so we can see if it will repeat readily21:09
jeblair_david_: but until it's certan that they will land, we don't want to take the risk.21:09
jeblair_david_: that's how we ended up running the fork we're running today, which we want to stop doing.  :)21:09
_david_jeblair, may be i am missing something, but what about that guy: https://gerrit-review.googlesource.com/#/c/50250/ ?21:10
jeblairjog0: what launchpad team should have access?21:10
pleia2jeblair: should all channels we interact with have jeblair set as founder? (I've been asking people to do it for gerritbot, but wondering about logging too)21:10
_david_last time we discussed it with mordred we agreed upon to patch at least this for now.21:10
jeblairpleia2: yes, so that when we automate channel configuration, i can just grant access to the script21:12
jog0jeblair: hrm not actually sure21:13
jog0let me check21:13
jog0sdague: ^ oh wait your on a plane21:13
jeblair_david_: i think we agreed that we would patch it against 2.8 if it went into master; but i don't want to speak for mordred.21:13
jog0jeblair: two options come to mind21:14
jog0https://launchpad.net/~tempest-bug-team21:14
jog0https://launchpad.net/~openstack-qa-team21:14
jog0but qa team has 157 members21:15
_david_jeblair, it went not into master, it was rejected, now what?21:15
jog0so jeblair I am not really sure21:15
_david_jeblair, you guys are 4 major release behind master, and you say, you really need this feature, so it was migrated into a plugin and still depends on 10 lines of changes in core, that were rejected by mfick. And now you want to tell me, that it is a no go for you to patch 10 LoC in Gerrit core?21:17
jeblair_david_: i think monty's last comment on that patch is good -- it would be worth working on generic statuses so that we can run 2.8 (or, well, 2.9 now) without carrying local patches21:19
jeblair_david_: but again, i don't want to speak for mordred21:19
jeblair_david_: we should really get his input since he's been involved more on this21:19
jog0clarkb: ping21:20
jog0https://bugs.launchpad.net/tempest/+bug/125389621:20
_david_jeblair, i am almost done with generic status change: https://gerrit-review.googlesource.com/#/c/5070021:20
uvirtbotLaunchpad bug 1253896 in tempest "test_minimum_basic_scenario fails with SSHException: Error reading SSH protocol banner" [Undecided,New]21:20
jog0is paramiko I think21:20
clarkbjog0: pong21:21
_david_jeblair, how to get his input?21:21
jog0clarkb: at least paramiko doesn't work with eventlet21:21
jeblair_david_: cool, so it sounds like it's getting closer!21:21
clarkbjog0: I don't think tempest uses eventlet21:22
jog0clarkb: yeah21:22
jeblair_david_: mordred is here most of the time, he's probably just in a meeting now or something.21:22
jog0after I said the parallel I think it was wrong21:22
jog0clarkb: could it be the VM taking too long to start up?21:23
_david_jeblair, i already told you my opinion how to proceed in this situation: take these two patches zaro's (that /me voted +1) and mine and patch core21:23
_david_jeblair, 2.8, and bcause it is almost stable now, i am here to ask you what are the next steps21:23
clarkbjeblair: https://review.openstack.org/#/c/57807/ any chance I can get you to review that really quick? need to get the subunit conversion on precise slaves to help neutron py27 failure false positives due to timeouts21:24
clarkbjog0: no the VM is up, we know this because the dropbear server is saying hello you are connected to dropbear version foo21:24
jeblair_david_: (not to distract again, but here's another bit of usability feedback; the comments section should be less wide; it's difficult for eyes to track back when reading long lines, so they should only be about 75 characters long at the most)21:24
clarkbjog0: I think it may be too slow to  do the rsa stuff which is relatively expensive21:25
jog0clarkb: right21:25
jog0ohh you mean the entire env21:25
jeblair_david_: i personally want to wait until some of this stuff starts to merge.  zaro and mordred may have different opinions which i'd like to hear from them.21:25
jog0we can check the load at teh same time21:25
_david_jeblair, that why it is so important that you upgrade to get your feedback and hear your voice in current and future development21:26
jog0clarkb: loads no the devstack vm don't look bad21:27
*** mrmartin has quit IRC21:27
jog0clarkb: maybe the metaserver didn't do its think in time?21:27
clarkbjog0: ohhhhh ya good point, the authorized key on the client side comes from the metadata server right?21:28
clarkbcould be a problem there21:28
*** dkliban has quit IRC21:28
*** ewindisch has quit IRC21:28
jeblairclarkb: why do you need 2 service definitions?21:28
clarkbjeblair: because one is only for debian derivatives21:29
*** vipul is now known as vipul-away21:29
clarkbjeblair: and the other is for only slaves21:29
*** vipul-away is now known as vipul21:29
clarkbjeblair: and d-g image builds don't use server.pp21:29
clarkb(it is a bit of a mess)21:29
jeblairclarkb: i think they do?21:31
jeblairclarkb: slave_template -> slave -> server21:31
clarkbhmm why did the server builds work after I made the slave rsyslog changes? I will dig21:32
jeblairclarkb: cool. it _seems_ like defining the service in server and then notifying it from both places should work21:32
fungii want to say we ran into something similar with the groups-dev server puppetry, and ended up being unable to have an object in one class notify a service in another class... but i could be misremembering21:34
clarkbjeblair: d-g slaves use slave_template -> jenkins::slave21:34
clarkbjeblair: there is no openstack_project::server21:34
clarkbjeblair: fungi: in this case I can't notify the rsyslog in server from slave.pp because d-g image builds don't build up from that point21:34
*** _david_ has left #openstack-infra21:35
fungigot it. openstack_server::slave not being in the chain there21:35
fungier, openstack_project::slave21:35
clarkbright21:35
jog0clarkb: metadata service has no hits on reboot21:35
*** vipul is now known as vipul-away21:37
*** vipul-away is now known as vipul21:37
jeblairclarkb: maybe the service definition should be in o_p::template then21:38
mikalSo, who can approve https://review.openstack.org/#/c/56158/ ? (Not clarkb, he's already reviewed it)21:38
clarkbjeblair: I can do that21:38
jeblairclarkb: (since server includes template)21:38
mikalI hassle because it will make our tech writer's life much easier and is part of an evil plan to trick companies into hiring more tech writers21:38
clarkbjeblair: fungi: do we want all machines to have a larger rsyslog message buffer or just notify the service in openstack_p::template?21:38
clarkbjeblair: fungi: eg should I consolidate everything in template.pp or just the service resource21:39
clarkbI like consolidating because it makes the code less spaghetti21:39
fungiin this case, a minor increase in rsyslog buffer size across more machines as a trade off to easier-to-maintain puppet configuration sounds fine to me21:41
devanandahiya. I'm trying to sync latest db migration code and lockutils from oslo, and have run into this interesting thing: http://logs.openstack.org/16/56516/9/check/gate-ironic-python27/4d9b449/console.html21:41
*** rnirmal has quit IRC21:41
devanandachatting with mikal over in -ironic, but i thought ya'll might have some ideas about it, too21:41
clarkbdevananda: looks like it is failing to create a file in the job workspace21:48
*** dstanek has quit IRC21:48
clarkbis it possible something is dleeting that dir before that test gets to it?21:48
clarkbin general shared paths like that are a bad thing. better to use tempdirs per test/process21:48
*** dstanek has joined #openstack-infra21:51
*** dkliban has joined #openstack-infra21:51
*** gyee has quit IRC21:52
devanandaclarkb: everything in that changeset is coming from oslo ...21:53
devanandaclarkb: it /used/ to use a per-test temp dir21:53
clarkbpossible oslo bug then?21:54
devanandaclarkb: compare L165 https://review.openstack.org/#/c/56516/6/ironic/tests/db/sqlalchemy/test_migrations.py21:54
devanandato L97 https://review.openstack.org/#/c/56516/9/ironic/openstack/common/db/sqlalchemy/test_migrations.py21:55
markwashjog0: hi. . can you help me figure out what's going on with https://bugs.launchpad.net/glance/+bug/1239856 ?21:55
uvirtbotLaunchpad bug 1239856 in glance "Registry client request GET /images/UUID raised ClientConnectionError" [Undecided,Confirmed]21:55
devanandamikal: any idea why oslo would have stopped using a per-test tempdir in favor of a global / shared lock dir?21:55
clarkbwait what21:56
clarkbwe are putting tests in oslo now?21:56
clarkbthat seems wrong for some reason21:56
devanandaclarkb: shared db test code21:57
clarkboh is this locking across processes?21:57
clarkbwe shouldn't do that21:57
clarkbinstead each process should use a distinct schema in the DB, we haven't quite made that work for myslq because mysql permissiosn are funny, but we should just do that if this is the laternative21:58
mikaldevananda: oh, I think that was because of a bug?21:58
clarkb(I was really hoping one of our mysql experts would make that change...)21:58
mikaldevananda: the per lock dir was happening for non-test code? IIRC?21:58
devanandathis http://git.openstack.org/cgit/openstack/oslo-incubator/tree/openstack/common/db/sqlalchemy/test_migrations.py#n16921:59
*** julim has quit IRC21:59
devanandaused to create a per-test temp dir and include that in the lock file prefix21:59
devanandait does not any more21:59
devanandaafaik, this code was moved from $project/tests/db/sqlalchemy/test_migrations.py to $project/openstack/common/db/sqlalchemy/test_migrations.py22:00
devanandaand also changed to no longer use a fixture // separate temp dirs per test22:00
devanandathat second part doesn't make sense to me22:01
*** denis_makogon has joined #openstack-infra22:01
devanandai haven't followed any discussion that led to these changes, though. just ran into this when trying to apply the changes to ironic22:01
*** mfer has quit IRC22:04
*** gyee has joined #openstack-infra22:09
openstackgerritClark Boylan proposed a change to openstack-infra/config: Consolidate rsyslog configs.  https://review.openstack.org/5780722:09
clarkbjeblair: fungi ^ I think that addresses the concerns22:09
clarkbdevananda: I have no idea either22:09
devanandaclarkb: k, thanks. I'm testing preserving the fixtures.TempDir() behavior from the older code. I will propose it to oslo if it works22:10
*** gyee_ has joined #openstack-infra22:10
*** gyee has quit IRC22:14
*** eharney has quit IRC22:14
fungiclarkb: any thoughts on where we can go with further abstraction so we can differentiate things we want installed on devstack slaces and unit test slaves but not on trusted slaves? add a new jenkins::bare_slave class and rework o_p::bare_slave to just instantiate that?22:15
fungis/slaces/slaves/22:15
clarkbfungi: yeah, I think we need to take jenkins::slave.pp and split it into a couple manifests22:15
clarkbfungi: have one be "bare" then build the others on top of that22:15
*** gyee_ has quit IRC22:16
clarkbwe sort of do that today with a conditional in slave.pp but it should be done at class level instead then you include jenkins::slave::base include jenkins::slave::all_the_stuff22:16
fungibecause we sort of have that going on already in o_p but most of what i want to break out is over in the jenkins module unfortunately22:16
*** gyee_ has joined #openstack-infra22:16
clarkbyeah I think we can just start tearing that class apart and group related things in smaller classes22:16
fungiexcellent. i'll head that direction with it22:17
*** gyee_ has quit IRC22:17
clarkbthen compose with include instead of if22:17
* fungi nods eagerly22:17
*** enarciso has joined #openstack-infra22:17
nibalizeryea just a base class then some extending classes22:18
nibalizerthis sounds like something i can help with, actually22:18
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Remove +/-2 governance votes from tech committee  https://review.openstack.org/5804222:18
jeblairfungi: wha, huh? why are trusted slaves different than devstack/unit test slaves?22:19
jeblair(obviously, they get extra things, but why should they get fewer things)22:20
jog0markwash: yeah22:21
fungijeblair: we're installing things which various projects want to use to run tests, but are not available in our distributions (so we use a variety of thord-party package repositories)22:21
fungier, third-party22:21
jeblairfungi: why are we doing that?22:21
fungigood question. should we stop?22:21
jog0markwash: I left a comment with a logstash query URL that finds all the hits22:22
*** pcm_ has quit IRC22:22
jeblairfungi: probably?  what projects are we talking about?22:22
jog0and I see a DB error in the registry22:22
* fungi will put together a list22:22
jog0but elasticsearch isn't collecting that22:22
*** SergeyLukjanov has quit IRC22:22
fungijeblair: so, at the moment it's backports of py3k and pypy. we have a request from soren to add riak for tests he wants to run on a stackforge project22:24
*** Ryan_Lane has quit IRC22:26
clarkbwe might get asked for node.js depending on how that horizon discussion goes22:26
devanandamikal, clarkb: fix for that locking in oslo - https://review.openstack.org/58044. this seems to have worked in ironic.22:26
devanandawith that, i need to run! have a good weekend all!22:26
clarkbyou too!22:26
fungiclarkb: yes, they do seem to be very close to deciding they want node.js as a test-time dependency22:26
jeblairso i don't think we've added an apt-repo for a non-openstack project.  and we are pretty aggressive about not adding them for openstack projects too22:28
jeblairclarkb: where's this horizon discussion?22:28
clarkbjeblair: on the openstack-dev ml22:30
jeblairof course, under the 'BootstrapV3 and lessc' thread22:30
*** ryanpetrello has quit IRC22:30
*** hashar has quit IRC22:30
pleia2jeblair: -ChanServ- jeblair has too many channels registered.22:32
clarkbnice jeblair wins22:32
jeblairugh, that'll be a problem for the bot then22:33
pleia2freenode can probably grant an acception, asking around22:33
pleia2late on a friday is clearly not the time :)22:34
jeblairheh22:34
cody-somervilleWhy would you want the bot to be a founder anyhow? ie. why would it need that level of permission?22:35
jeblaircody-somerville: because no one other than the bot should.22:35
openstackgerritA change was merged to openstack-infra/jeepyb: Allow automatic subscription to DocImpact bugs  https://review.openstack.org/5615822:36
cody-somervilleNot to be difficult but why does it make a difference?22:36
*** dangers is now known as danger_fo_away22:37
jeblaircody-somerville: because people come and go all the time around here, but not projects.  so asking people to grant other people founder status on irc is a losing proposition.22:37
fungicody-somerville: in the past we've had random people register official channels, but then move on and the projects using those outlive them. getting freenode staff to hand over control of a registered channel to someone else has not been easy apaprently22:37
jeblaircody-somerville: we want to automate it like everything else.22:37
fungier, what jeblair said22:38
*** Ryan_Lane has joined #openstack-infra22:38
cody-somervillesmall +f should be sufficient for that and works around the founder limit22:38
*** Ryan_Lane has quit IRC22:38
*** Ryan_Lane has joined #openstack-infra22:38
*** rockyg has joined #openstack-infra22:39
*** mriedem has quit IRC22:39
*** enqae has joined #openstack-infra22:39
lifelessclarkb: hi ?22:41
*** ewindisch has joined #openstack-infra22:41
lifelessclarkb: who needs 3rd party testing?22:41
jeblaircody-somerville: it would be nice for some account to have founder status22:41
clarkblifeless: nova pci passthrough folks22:42
jeblaircody-somerville: and it would be nicer if that account were a bot22:42
fungilifeless: the nova pci passthrough22:42
fungilifeless: thread on the -dev ml22:42
*** hogepodge has quit IRC22:43
mordredcody-somerville: is there a reason to not transfer founder status to the bot?22:43
*** mrodden has quit IRC22:45
cody-somervillemordred: apparently we can't get the bot in #storyboard until we add jeblair as founder but ChanServ won't let it happen since jeblair has so many channels registered to his name. Was just suggesting founder status wasn't that important to stated goal and +f (ability to change the access list) would accomplish it w/o the limit.22:45
mordredcody-somerville: hah. fascinating22:45
lifelessfungi: clarkb: will look tomorrow22:45
pleia2I found a freenode staffer, hopefully he can quickly toggle a bit ;)22:46
lifelesserm Monday22:46
lifelessclarkb: fungi: 3rd party for now, once the RH region comes online we should be able to do two regions etc etc22:46
lifelessclarkb: fungi: of course, we should also land the docs I sketched up about this ;)22:46
fungilifeless: yeah, that basically parrots what i replied to the ml with. thanks!22:47
*** ewindisch has quit IRC22:49
*** herndon has quit IRC22:50
*** UtahDave has joined #openstack-infra22:52
*** openstackinfra has joined #openstack-infra22:53
jeblairopenstackinfra: hi there!22:53
jeblairi registered openstackinfra so we can use it with the yet-to-be-written bot22:54
jeblairpleia2: if the op you found is responsive, maybe we can go ahead and bump the limit on openstackinfra, and maybe even start transferring founder status over22:54
pleia2jeblair: ok, will do22:54
*** hdd has quit IRC22:55
mordredI am in favor of our new openstackinfra overlord22:56
openstackgerritJoe Gordon proposed a change to openstack-infra/elastic-recheck: Add query for bug 1253896  https://review.openstack.org/5805322:56
uvirtbotLaunchpad bug 1253896 in tempest "test_minimum_basic_scenario fails with SSHException: Error reading SSH protocol banner" [Critical,Confirmed] https://launchpad.net/bugs/125389622:56
*** bpokorny has quit IRC22:56
jeblairclarkb, fungi, mordred: openstackinfra password added22:57
fungiawesome!22:57
openstackgerritElizabeth Krumbach Joseph proposed a change to openstack-infra/config: Add note about setting founder to IRC docs  https://review.openstack.org/5392522:58
*** rcleere has quit IRC23:02
pleia2anyone know who the freenode GC (group contact) is for openstack?23:04
*** sdake_ has quit IRC23:04
*** andreaf has quit IRC23:06
*** dcramer_ has quit IRC23:07
*** ^d has quit IRC23:07
*** datsun180b has quit IRC23:09
*** enqae has quit IRC23:09
jeblairpleia2: there is none, they don't accept new groups23:10
jeblairpleia2: that's one of the difficulties with this23:10
pleia2x_x23:11
pleia2thanks23:11
*** andreaf has joined #openstack-infra23:11
zaroclarkb: about your comment in https://bugs.launchpad.net/openstack-ci/+bug/1203198 , did we have that discussion during summing?  if so maybe updat this?23:11
uvirtbotLaunchpad bug 1203198 in openstack-ci "Mirror jobs should not copy new packages if installation fails." [High,Triaged]23:11
*** ewindisch has joined #openstack-infra23:12
*** sarob_ has quit IRC23:13
thingeejog0: did reviews with stale gate starting jobs get started back up again? I saw a mention on the ML that they would once things were resolved.23:19
*** dolphm_ has joined #openstack-infra23:20
*** dolphm has quit IRC23:20
*** ruhe has joined #openstack-infra23:20
*** dolphm_ has quit IRC23:20
*** denis_makogon has quit IRC23:20
*** rockyg has quit IRC23:21
*** gyee has joined #openstack-infra23:22
jeblairthingee: if it hasn't merged and isn't on the zuul status page, you may want to leave a 'reverify no bug' comment23:23
thingeejeblair: thanks. Just noting in case there was something ran to catch these.23:24
*** odyssey4me3 has joined #openstack-infra23:28
*** openstackinfra has quit IRC23:29
*** gyee has quit IRC23:34
*** ruhe has quit IRC23:35
*** gyee has joined #openstack-infra23:37
*** ewindisch has quit IRC23:44
*** flaper87 is now known as flaper87|afk23:46
*** ewindisch has joined #openstack-infra23:50
*** ewindisch has quit IRC23:51
*** odyssey4me3 has quit IRC23:54
*** UtahDave has quit IRC23:55
clarkbmordred: fungi can you take a look at the bug zaro pointed out? I wasn't in that design session ( went to a different one )23:56
*** otherwiseguy has quit IRC23:57
*** Ryan_Lane has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!