| *** hemna is now known as hemnafk | 00:03 | |
| *** zul has joined #openstack-infra | 00:04 | |
| *** wenlock has quit IRC | 00:05 | |
| *** zul has quit IRC | 00:05 | |
| jeblair | #status ok | 00:11 |
|---|---|---|
| *** ChanServ changes topic to "Discussion of OpenStack Developer Infrastructure | docs http://ci.openstack.org | bugs https://launchpad.net/openstack-ci/+milestone/grizzly | https://github.com/openstack-infra/config" | 00:11 | |
| pleia2 | jeblair: ooh, change topic to be git.o.o? | 00:12 |
| *** ChanServ sets mode: +o jeblair | 00:12 | |
| *** jeblair changes topic to "Discussion of OpenStack Project Infrastructure | Docs http://ci.openstack.org | Bugs https://launchpad.net/openstack-ci | Code http://git.openstack.org/cgit/openstack-infra/" | 00:14 | |
| jeblair | pleia2: like? | 00:14 |
| *** tomhe has quit IRC | 00:14 | |
| *** jeblair changes topic to "Discussion of OpenStack Project Infrastructure | Docs http://ci.openstack.org/ | Bugs https://launchpad.net/openstack-ci | Code http://git.openstack.org/cgit/openstack-infra/" | 00:14 | |
| pleia2 | \o/ | 00:15 |
| *** jjmb1 has quit IRC | 00:15 | |
| *** jjmb has joined #openstack-infra | 00:15 | |
| pleia2 | jeblair: thanks :) | 00:15 |
| *** jeblair sets mode: -o jeblair | 00:15 | |
| jeblair | pleia2: thanks for the suggestion :) | 00:15 |
| clarkb | https :) | 00:16 |
| *** ChanServ sets mode: +o jeblair | 00:16 | |
| *** jeblair changes topic to "Discussion of OpenStack Project Infrastructure | Docs http://ci.openstack.org/ | Bugs https://launchpad.net/openstack-ci | Code https://git.openstack.org/cgit/openstack-infra/" | 00:16 | |
| *** jeblair sets mode: -o jeblair | 00:16 | |
| jeblair | clarkb: http://logs.openstack.org/37/43537/1/check/gate-zuul-python27/44a6863/console.html | 00:18 |
| *** ryanpetrello has joined #openstack-infra | 00:18 | |
| jeblair | clarkb: er, do you understand that? | 00:18 |
| clarkb | the discover pass failed | 00:19 |
| clarkb | jeblair: usually indicates a problem importing the test files | 00:19 |
| jeblair | clarkb: tox -e py27 wfw locally | 00:19 |
| jeblair | clarkb: my tox env was built a while ago | 00:19 |
| clarkb | run `python -m subunit.run discover -t ./ tests --list` in the workspace and see if it fails there more verbosely? | 00:20 |
| *** svarnau has quit IRC | 00:20 | |
| clarkb | unpack requires a string argument of length 1 <- is that the error? | 00:20 |
| jeblair | clarkb: it output binary data that looks like a list of tests | 00:21 |
| clarkb | jeblair: return code is 0? | 00:21 |
| jeblair | t | 00:21 |
| clarkb | weird. | 00:22 |
| clarkb | what if you run testr by hand `testr run --parallel` does that fail? | 00:22 |
| jeblair | unpack requires a string argument of length 1 | 00:23 |
| jeblair | testrepository==0.0.17 | 00:23 |
| jeblair | testtools==0.9.32 | 00:23 |
| jeblair | python-subunit==0.0.14 | 00:23 |
| clarkb | `testr list-tests` does that fail? | 00:24 |
| clarkb | that shoudl just do the discover phase | 00:24 |
| jeblair | fails | 00:24 |
| clarkb | ok so it isn't failing trying to run tests | 00:24 |
| clarkb | I wonder if lifeless pushed a new release of subunit to fix the pypi thing | 00:26 |
| clarkb | s/pypi/pypy/ | 00:26 |
| jeblair | my local env has python-subunit==0.0.13 | 00:26 |
| jeblair | which is one rev less | 00:26 |
| clarkb | https://pypi.python.org/pypi/python-subunit/0.0.14 released today | 00:26 |
| *** pcm_ has quit IRC | 00:26 | |
| clarkb | jeblair: try downgrading python-subunit in the venv and see if it works | 00:26 |
| *** jamiem has quit IRC | 00:27 | |
| jeblair | clarkb: works | 00:27 |
| *** ryanpetrello has quit IRC | 00:27 | |
| clarkb | lifeless: ^ python-subunit 0.0.14 seems semi broken | 00:27 |
| clarkb | jeblair: I will write up a bug | 00:27 |
| jeblair | clarkb: .14 has not hit the openstack mirror yet | 00:29 |
| *** michchap has joined #openstack-infra | 00:30 | |
| clarkb | jeblair: ok I think it may be pinned there possibly | 00:30 |
| clarkb | nope nevermind | 00:31 |
| openstackgerrit | James E. Blair proposed a change to openstack/requirements: Pin python-subunit to 0.0.13 https://review.openstack.org/43560 | 00:31 |
| jeblair | i'm going to test an openstack project and make sure | 00:32 |
| *** dims has quit IRC | 00:32 | |
| clarkb | lifeless: https://bugs.launchpad.net/subunit/+bug/1216163 | 00:33 |
| uvirtbot | Launchpad bug 1216163 in subunit "unpack requires a string argument of length 1" [Undecided,New] | 00:33 |
| jeblair | clarkb: who is on testr and has simple tests? :) | 00:35 |
| clarkb | jeblair: any of the python-*clients | 00:35 |
| clarkb | jeblair: python-novaclient would work | 00:35 |
| jeblair | k, thx | 00:36 |
| jeblair | clarkb: my venv for it ended up with .13 | 00:39 |
| jeblair | clarkb: perhaps because it wasn't specified as an explicit dep? | 00:39 |
| clarkb | maybe? | 00:39 |
| clarkb | jeblair: or are you configured locallt to use the openstack mirror? | 00:39 |
| clarkb | I am and it causes weird problems until I remember | 00:39 |
| jeblair | clarkb: i'm doing this in my user account on precise5 | 00:39 |
| jeblair | and it's not configured to use the mirror | 00:40 |
| jeblair | clarkb: when i upgraded to .14, novaclient tests failed with the same error | 00:40 |
| jeblair | clarkb: so i think it is dangerous, but i'm not positive that we'll end up using it ... yet | 00:40 |
| clarkb | ya | 00:40 |
| jeblair | clarkb: zuul does explicitly have a python-subunit dependency (because of python6?) | 00:41 |
| jeblair | running nova tests | 00:42 |
| clarkb | I don't know why there isn't an explicit dependency | 00:42 |
| clarkb | I think the explict dependency makes sense because we are running subunit.run in .testr.conf | 00:43 |
| *** emagana has joined #openstack-infra | 00:46 | |
| jeblair | gee this takes forever | 00:47 |
| clarkb | nova has a lot of deps and it needs to compile things | 00:47 |
| *** dims has joined #openstack-infra | 00:48 | |
| jeblair | is neutron any faster? | 00:49 |
| clarkb | not really | 00:49 |
| jeblair | there we go; it failed | 00:49 |
| clarkb | ok I will +2 the requirements change then | 00:49 |
| jeblair | clarkb: 1 sec | 00:49 |
| openstackgerrit | James E. Blair proposed a change to openstack/requirements: Pin python-subunit to 0.0.13 https://review.openstack.org/43560 | 00:50 |
| jeblair | clarkb: better commit msg ^ | 00:50 |
| jeblair | i think that has 4 hours to merge before the scheduled mirror update breaks everything. | 00:51 |
| Alex_Gaynor | jeblair: I just approved it | 00:52 |
| jeblair | Alex_Gaynor: thanks | 00:53 |
| jeblair | um. | 00:54 |
| *** UtahDave has quit IRC | 00:54 | |
| jeblair | it failed python27 tests because they used subunit .14 | 00:54 |
| Alex_Gaynor | amazingly meta | 00:55 |
| Alex_Gaynor | jeblair: can we fix this by manually messing with pypi.o.o | 00:56 |
| jeblair | Alex_Gaynor: yeah, when it shows up, we can rm it | 00:56 |
| Alex_Gaynor | hmm, so why did 27 get .14? | 00:57 |
| jeblair | Alex_Gaynor: and keep rm-ing it every time the mirror scripts run | 00:57 |
| jeblair | Alex_Gaynor: i'm puzzled by that | 00:57 |
| jeblair | it does not have an explicit dependency in its test-requirements | 00:57 |
| clarkb | requirements doesnt run under the mirror | 00:58 |
| clarkb | I have to afk now | 00:58 |
| jeblair | clarkb: no that i understand :) | 00:58 |
| jeblair | clarkb: what i mean is i don't understand what pulled it in and why it's different than my python-novaclient test | 00:59 |
| jeblair | testrepository has a >= requirement on subunit | 01:01 |
| jeblair | i'm not sure why my novaclient test didn't get .14, but that doesn't seem to be the normal or expected behavior | 01:01 |
| *** dolphm has joined #openstack-infra | 01:04 | |
| openstackgerrit | James E. Blair proposed a change to openstack/requirements: Pin python-subunit to 0.0.13 https://review.openstack.org/43560 | 01:06 |
| jeblair | Alex_Gaynor, clarkb: ^ perhaps that will work | 01:06 |
| Alex_Gaynor | jeblair: I'll let check actually run this time, I don't want to contribute to gate resets | 01:06 |
| jeblair | Alex_Gaynor: there is nothing in the gate | 01:07 |
| Alex_Gaynor | jeblair: oh, then I feel way less guilty +2ing! | 01:07 |
| jeblair | I'm going to aprv it on clarkb's behalf | 01:07 |
| jeblair | hacking while driking in an airport lounge, making a release and then hopping on a plane. what could go wrong? :) | 01:09 |
| jeblair | Alex_Gaynor: that appeared to fix the tests | 01:09 |
| *** emagana has quit IRC | 01:10 | |
| Alex_Gaynor | :D | 01:10 |
| *** zul has joined #openstack-infra | 01:12 | |
| *** dolphm has quit IRC | 01:12 | |
| *** emagana has joined #openstack-infra | 01:18 | |
| *** ^d has quit IRC | 01:23 | |
| *** ^d has joined #openstack-infra | 01:23 | |
| *** emagana has quit IRC | 01:27 | |
| *** ^d has quit IRC | 01:28 | |
| *** jergerber has joined #openstack-infra | 01:29 | |
| *** melwitt has quit IRC | 01:42 | |
| *** nati_ueno has quit IRC | 01:43 | |
| *** jfriedly has quit IRC | 01:50 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Use stacked area test node graph https://review.openstack.org/43565 | 01:53 |
| *** wenlock_ has joined #openstack-infra | 02:00 | |
| openstackgerrit | A change was merged to openstack/requirements: Pin python-subunit to 0.0.13 https://review.openstack.org/43560 | 02:00 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Add sparklines to pipeline headers https://review.openstack.org/43567 | 02:11 |
| *** ColinMochrie is now known as anteaya | 02:16 | |
| *** sdake_ has quit IRC | 02:19 | |
| anteaya | night all | 02:19 |
| *** anteaya has quit IRC | 02:19 | |
| Alex_Gaynor | jeblair: do you have screenshots for either of those graphs? | 02:21 |
| *** fifieldt has quit IRC | 02:28 | |
| *** ryanpetrello has joined #openstack-infra | 02:36 | |
| *** jergerber has quit IRC | 02:37 | |
| *** pcrews has quit IRC | 02:42 | |
| *** Ryan_Lane1 has quit IRC | 02:43 | |
| lifeless | clarkb: gnar | 02:45 |
| clarkb | rawr | 02:45 |
| *** pcrews has joined #openstack-infra | 02:47 | |
| lifeless | cl | 02:50 |
| *** rcleere has joined #openstack-infra | 02:56 | |
| *** dims has quit IRC | 02:57 | |
| *** dkehn has quit IRC | 03:02 | |
| *** dkehn has joined #openstack-infra | 03:02 | |
| *** mestery has quit IRC | 03:08 | |
| *** dolphm has joined #openstack-infra | 03:29 | |
| *** senk has joined #openstack-infra | 03:36 | |
| *** lbragstad has joined #openstack-infra | 03:38 | |
| *** woodspa has joined #openstack-infra | 03:47 | |
| morganfainberg | lifeless / clarkb: you got a sec/here? | 03:48 |
| morganfainberg | long shot :P | 03:49 |
| *** ryanpetrello has quit IRC | 03:51 | |
| *** reed has joined #openstack-infra | 03:58 | |
| lifeless | morganfainberg: hi | 04:01 |
| morganfainberg | lifeless: i know it's like… weekend and stuff, but i think something just went ugly with the py27 tests in jenkins. | 04:02 |
| morganfainberg | lifeless: https://jenkins02.openstack.org/job/gate-nova-python27/1793/console seeing lots of failures that look like this | 04:02 |
| morganfainberg | lifeless: not super insanely important for my work this weekend, just didn't want it ot linger and not tell anyone if someone was here | 04:03 |
| morganfainberg | lifeless: (unrelated) and.. i think i noticed zuul do something very odd when i did 'reverify no bug', i saw the patchset appear both in check queue and gate queue. not sure if that is intentional. | 04:04 |
| *** senk has quit IRC | 04:07 | |
| *** arezadr has quit IRC | 04:10 | |
| lifeless | morganfainberg: no idea :P. If it's subunit, 0.0.4 is apparently broken :(. | 04:11 |
| lifeless | clarkb: btw do you have a failing case for me to eyeball ? | 04:11 |
| morganfainberg | lifeless: yeah, just noticed py27 failing on … a lot of things (the nova one was just a current one), saw 3 or 4 keystone ones and a number of neutrons as well | 04:12 |
| morganfainberg | lifeless: thanks, didn't want it to just sit and not do anything if someone was here. ;) | 04:13 |
| *** reed has quit IRC | 04:14 | |
| *** wenlock_ has quit IRC | 04:17 | |
| *** lbragstad has quit IRC | 04:17 | |
| *** SergeyLukjanov has joined #openstack-infra | 04:17 | |
| *** woodspa has joined #openstack-infra | 04:25 | |
| *** dolphm has quit IRC | 04:26 | |
| *** vogxn has joined #openstack-infra | 04:30 | |
| *** sdake_ has joined #openstack-infra | 04:30 | |
| *** SergeyLukjanov has quit IRC | 04:38 | |
| *** ryanpetrello has joined #openstack-infra | 04:38 | |
| lifeless | morganfainberg: ok - its my fault, a bug; | 04:39 |
| lifeless | testr | 04:39 |
| lifeless | 2013-08-24 04:01:45.215 | unpack requires a string argument of length 1 | 04:39 |
| lifeless | I need to figure out whats up | 04:39 |
| morganfainberg | lifeless: not a big deal, at least you know about it. right? | 04:41 |
| morganfainberg | lifeless: though.. weekend (sorry if i was the bearer of bad news) | 04:41 |
| *** dina_belova has joined #openstack-infra | 04:47 | |
| lifeless | morganfainberg: clarkb was :) | 04:49 |
| lifeless | morganfainberg: I fixed something for Alex_Gaynor , broke it for everyone else,a nd I'm committed in $stuff for hours | 04:49 |
| morganfainberg | hehe | 04:49 |
| clarkb | I was here but am now weekending | 05:00 |
| clarkb | I may have time in ~12 hours | 05:01 |
| *** dina_belova has quit IRC | 05:12 | |
| *** ryanpetrello has quit IRC | 05:13 | |
| *** michchap has quit IRC | 05:28 | |
| *** blamar has quit IRC | 05:32 | |
| *** morganfainberg is now known as morganfainberg|a | 05:37 | |
| clarkb | mordred it is too bad you don't have Internets because you will like http://mrsharpoblunto.github.io/foswig.js/ | 05:38 |
| *** xBsd has joined #openstack-infra | 05:45 | |
| *** dkliban has joined #openstack-infra | 05:51 | |
| *** morganfainberg|a is now known as morganfainberg | 05:53 | |
| *** saper has quit IRC | 06:06 | |
| *** saper has joined #openstack-infra | 06:06 | |
| *** dkehn_ has joined #openstack-infra | 06:15 | |
| *** dkehn has quit IRC | 06:17 | |
| *** dina_belova has joined #openstack-infra | 06:22 | |
| *** rcleere has quit IRC | 06:24 | |
| *** dina_belova has quit IRC | 06:27 | |
| *** dmakogon_ has joined #openstack-infra | 06:27 | |
| *** nayward has joined #openstack-infra | 06:35 | |
| *** sdake_ has quit IRC | 06:40 | |
| *** xBsd has quit IRC | 06:41 | |
| *** sdake_ has joined #openstack-infra | 06:41 | |
| *** boris-42 has joined #openstack-infra | 06:44 | |
| *** yolanda has joined #openstack-infra | 07:13 | |
| *** michchap has joined #openstack-infra | 07:23 | |
| *** sdake_ has quit IRC | 07:26 | |
| *** HenryG has quit IRC | 07:34 | |
| *** woodspa has quit IRC | 07:49 | |
| *** psedlakZzz is now known as psedla | 09:13 | |
| *** psedla is now known as psedlak | 09:13 | |
| psedlak | what's with that "Could not find a version that satisfies the requirement pytz"? .] | 09:23 |
| psedlak | https://review.openstack.org/#/c/43564/ | 09:23 |
| *** p5ntangle has joined #openstack-infra | 09:30 | |
| jd__ | nijaba: jeblair: could one of you add me as admin on #openstack-metering? | 09:32 |
| *** cthulhup has joined #openstack-infra | 09:48 | |
| *** cthulhup has quit IRC | 09:53 | |
| *** odyssey4me has joined #openstack-infra | 10:04 | |
| *** dina_belova has joined #openstack-infra | 10:18 | |
| *** odyssey4me has quit IRC | 10:27 | |
| *** dina_belova has quit IRC | 10:42 | |
| *** yolanda has quit IRC | 10:47 | |
| *** dmakogon_ has quit IRC | 11:17 | |
| *** dina_belova has joined #openstack-infra | 11:21 | |
| *** SergeyLukjanov has joined #openstack-infra | 11:22 | |
| *** dina_belova has quit IRC | 11:43 | |
| *** weshay has quit IRC | 12:02 | |
| lifeless | clarkb: did you say it's just 2.6 that is broken ? | 12:16 |
| *** dolphm has joined #openstack-infra | 12:19 | |
| *** yolanda has joined #openstack-infra | 12:36 | |
| *** dims has joined #openstack-infra | 12:41 | |
| *** jpeeler has quit IRC | 12:42 | |
| *** jpeeler has joined #openstack-infra | 12:43 | |
| *** SergeyLukjanov has quit IRC | 12:43 | |
| *** dina_belova has joined #openstack-infra | 12:44 | |
| *** dina_belova has quit IRC | 12:49 | |
| *** dmakogon_ has joined #openstack-infra | 12:50 | |
| *** onr has joined #openstack-infra | 12:53 | |
| *** dolphm has quit IRC | 12:58 | |
| *** onr has quit IRC | 13:00 | |
| dims | good morning, looks like gate-nova-python27 crapping out :( - https://jenkins02.openstack.org/job/gate-nova-python27/ - i see a lot of -1's in https://review.openstack.org/#/q/status:open+project:openstack/nova,n,z | 13:08 |
| lifeless | yes | 13:11 |
| lifeless | https://bugs.launchpad.net/subunit/+bug/1216163 | 13:11 |
| uvirtbot | Launchpad bug 1216163 in subunit "unpack requires a string argument of length 1" [Undecided,New] | 13:11 |
| lifeless | I have a candidate fix | 13:11 |
| lifeless | but | 13:11 |
| lifeless | I can't reproduce the problem yet | 13:12 |
| lifeless | I mean, clearly the change I put in there needs to be applied | 13:14 |
| lifeless | but there may be other bits | 13:14 |
| lifeless | I can't see any (but heck, I let this bug through in the first place) | 13:14 |
| *** mberwanger has joined #openstack-infra | 13:15 | |
| *** dims has quit IRC | 13:19 | |
| *** blitzrage is now known as leifmadsen | 13:23 | |
| *** dims has joined #openstack-infra | 13:34 | |
| *** yolanda has quit IRC | 13:36 | |
| clarkb | lifeless python26 seems finr | 13:36 |
| clarkb | I put reproduction steps in the bug do they not work? | 13:36 |
| lifeless | clarkb: I can't trigger it | 13:37 |
| clarkb | running zuul's test suite on precise with `tox -epy27` should do it | 13:37 |
| clarkb | not sure if precise is important but this doesnt happen with py26 on centos | 13:39 |
| lifeless | ahha, triggered it on python3.2 | 13:41 |
| lifeless | ERROR: subunit.tests.test_run.TestSubunitTestRunner.test_includes_timing_output | 13:41 |
| lifeless | ---------------------------------------------------------------------- | 13:41 |
| lifeless | File "/home/robertc/personal/subunit/working/python/subunit/v2.py", line 339, in _parse_varint | 13:41 |
| lifeless | data_0 = struct.unpack(FMT_8, data[pos:pos+1])[0] | 13:41 |
| lifeless | error: unpack requires a string argument of length 1 | 13:41 |
| lifeless | Interesting that 2.6/2.7/3.3 all pass for me | 13:41 |
| bearhands | yeah | 13:48 |
| bearhands | pep8 python 2.7 is failing everywhere in nova | 13:48 |
| *** bearhands is now known as comstud | 13:50 | |
| comstud | also: the devstack jobs seem to not be running tempest | 13:50 |
| comstud | but are reporting success. | 13:50 |
| comstud | http://paste.openstack.org/show/45092/ | 13:51 |
| lifeless | seems to be a broken struct.unpack :( | 13:52 |
| lifeless | clarkb: whats the minor python version for the failing python jobs? | 13:53 |
| *** dina_belova has joined #openstack-infra | 13:55 | |
| clarkb | give me a minute need a different machine to check | 13:55 |
| clarkb | lifeless: 2.7.3 | 13:57 |
| lifeless | yeah | 13:59 |
| lifeless | I bet you'll find struct was fixed to work with memoryview in 2.7.5 and 3.3 | 13:59 |
| lifeless | and/or | 13:59 |
| lifeless | thats when view[N] started returning str | 14:00 |
| *** dina_belova has quit IRC | 14:00 | |
| lifeless | so this exercise in zero copy may be a huge exercise in futility | 14:00 |
| lifeless | but I'll worry about that later | 14:05 |
| clarkb | I thought we had successfully pinned python-subunit with openstack/requirements though... | 14:08 |
| *** alexpilotti has joined #openstack-infra | 14:08 | |
| clarkb | I need to look through the mirror building logs | 14:08 |
| *** mberwanger has quit IRC | 14:10 | |
| clarkb | looks like the stable branches are at fault in openstack/requirements | 14:11 |
| lifeless | 0.0.15 is up | 14:12 |
| lifeless | I have to crash, up for 24h now :( | 14:12 |
| lifeless | I will do release paperwork tomorrow morning as well as following up | 14:12 |
| lifeless | gnight | 14:12 |
| clarkb | goodnight and thank you | 14:13 |
| clarkb | I have further openstack/requirements pinning if necessary. I am going to remove 0.0.14 from the mirror now | 14:16 |
| clarkb | test should start passing again now | 14:17 |
| *** lbragstad has joined #openstack-infra | 14:23 | |
| *** lbragstad has quit IRC | 14:30 | |
| *** ryanpetrello has joined #openstack-infra | 14:30 | |
| *** senk has joined #openstack-infra | 14:30 | |
| jeblair | clarkb: adding something to openstack/requirements allows projects to pin their versions; i think the next step would be for nova, etc, to pin subunit | 14:36 |
| *** ryanpetrello has quit IRC | 14:37 | |
| jeblair | clarkb: i don't think 'remove something from the mirror' is the way to handle this (after all, we can't remove something from pypi.python.org) | 14:37 |
| *** dkliban has quit IRC | 14:39 | |
| clarkb | I thought part of the intention behind pinning was to keep the mirror clean | 14:40 |
| clarkb | but not pinning folsom and grizzly allowed 0.0.14 througg | 14:40 |
| jeblair | clarkb: would be nice, but i'm not positive the mirror works like that; i thought it independently fetched everything in the list (so fetching testtools would still fetch it) | 14:41 |
| clarkb | it isn't independent. if we had just run over the master branch subunit wouldnt have updated on the mirror | 14:42 |
| *** ryanpetrello has joined #openstack-infra | 14:44 | |
| jeblair | clarkb: i think you are right, though i think due to a race, the master branch actually did put .14 into the mirror | 14:46 |
| jeblair | https://jenkins.openstack.org/job/post-mirror-python27/151/console | 14:46 |
| jeblair | at any rate, let's see if 15 works | 14:47 |
| clarkb | ++ | 14:48 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Fix releastestatus dependency https://review.openstack.org/43516 | 14:48 |
| jeblair | i rechecked those zuul changes | 14:49 |
| *** ryanpetrello has quit IRC | 14:52 | |
| *** dina_belova has joined #openstack-infra | 14:55 | |
| jeblair | clarkb: zuul tests ran with .15 | 14:57 |
| openstackgerrit | James E. Blair proposed a change to openstack/requirements: Revert "Pin python-subunit to 0.0.13" https://review.openstack.org/43584 | 14:58 |
| *** dina_belova has quit IRC | 15:00 | |
| *** sdake_ has joined #openstack-infra | 15:02 | |
| *** emagana has joined #openstack-infra | 15:02 | |
| *** emagana has quit IRC | 15:13 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Add a graphite key for all jobs in a pipeline https://review.openstack.org/43586 | 15:22 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Add a graphite key for all jobs in a pipeline https://review.openstack.org/43586 | 15:22 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Use stacked area test node graph https://review.openstack.org/43565 | 15:25 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Add sparklines to pipeline headers https://review.openstack.org/43567 | 15:25 |
| *** UtahDave has joined #openstack-infra | 15:27 | |
| openstackgerrit | A change was merged to openstack-infra/nodepool: Add an ssh check periodic task https://review.openstack.org/43015 | 15:32 |
| openstackgerrit | A change was merged to openstack-infra/nodepool: Change credentials-id parameter in config file https://review.openstack.org/43016 | 15:32 |
| openstackgerrit | A change was merged to openstack-infra/nodepool: Reduce timeout when waiting for server deletion https://review.openstack.org/43017 | 15:32 |
| openstackgerrit | A change was merged to openstack-infra/nodepool: Move setup scripts destination https://review.openstack.org/43033 | 15:32 |
| openstackgerrit | A change was merged to openstack-infra/nodepool: Fix error with stats for de-configured resources https://review.openstack.org/43376 | 15:32 |
| openstackgerrit | A change was merged to openstack-infra/nodepool: Make jenkins username and private key path configurable https://review.openstack.org/43377 | 15:32 |
| openstackgerrit | A change was merged to openstack-infra/nodepool: Add option to test jenkins node before use https://review.openstack.org/43313 | 15:34 |
| openstackgerrit | A change was merged to openstack-infra/config: Add node-test job https://review.openstack.org/43381 | 15:34 |
| openstackgerrit | A change was merged to openstack-infra/config: Add final newline check for requirements https://review.openstack.org/42416 | 15:35 |
| *** lbragstad has joined #openstack-infra | 15:36 | |
| openstackgerrit | A change was merged to openstack-infra/config: Fix zuul status hours display. https://review.openstack.org/43375 | 15:37 |
| *** thomasbiege has joined #openstack-infra | 15:38 | |
| openstackgerrit | A change was merged to openstack-infra/zuul: Ignore builds once they have been canceled https://review.openstack.org/43537 | 15:38 |
| openstackgerrit | A change was merged to openstack-infra/zuul: Re-launch a job if the worker fails to run it https://review.openstack.org/43547 | 15:38 |
| *** SergeyLukjanov has joined #openstack-infra | 15:40 | |
| jeblair | clarkb: https://review.openstack.org/#/c/43584/ | 15:46 |
| *** thomasbiege has quit IRC | 15:48 | |
| *** thomasbiege has joined #openstack-infra | 15:52 | |
| *** dina_belova has joined #openstack-infra | 15:56 | |
| *** michchap has quit IRC | 15:57 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Report pipeline queue length on startup to statsd https://review.openstack.org/43588 | 15:57 |
| *** dina_belova has quit IRC | 16:01 | |
| *** thomasbiege has quit IRC | 16:06 | |
| *** cthulhup has joined #openstack-infra | 16:07 | |
| *** cthulhup has joined #openstack-infra | 16:08 | |
| clarkb | jeblair: done | 16:15 |
| jeblair | woo | 16:15 |
| *** krtaylor has quit IRC | 16:18 | |
| *** thomasbiege has joined #openstack-infra | 16:22 | |
| *** jjmb1 has joined #openstack-infra | 16:23 | |
| Alex_Gaynor | jeblair: do you have screenshots for the graphs/charts you have patches up for? (I asked this a while ago, sorry if I missed the answer) | 16:23 |
| *** thomasbiege has quit IRC | 16:24 | |
| *** jjmb has quit IRC | 16:26 | |
| *** senk has quit IRC | 16:31 | |
| *** dkehn_ is now known as dkehn | 16:32 | |
| *** pcm_ has joined #openstack-infra | 16:32 | |
| *** pcm_ has joined #openstack-infra | 16:33 | |
| *** dkehn_ has joined #openstack-infra | 16:36 | |
| *** dkehn has quit IRC | 16:37 | |
| *** senk has joined #openstack-infra | 16:38 | |
| *** dkehn has joined #openstack-infra | 16:42 | |
| *** dkehn_ has quit IRC | 16:42 | |
| *** cthulhup has quit IRC | 16:50 | |
| *** UtahDave has quit IRC | 16:54 | |
| *** dina_belova has joined #openstack-infra | 16:56 | |
| *** xBsd has joined #openstack-infra | 16:58 | |
| *** dina_belova has quit IRC | 17:00 | |
| *** SergeyLukjanov has quit IRC | 17:00 | |
| *** cthulhup has joined #openstack-infra | 17:04 | |
| *** cthulhup has quit IRC | 17:05 | |
| *** ^d has joined #openstack-infra | 17:06 | |
| openstackgerrit | A change was merged to openstack/requirements: Revert "Pin python-subunit to 0.0.13" https://review.openstack.org/43584 | 17:07 |
| *** ryanpetrello has joined #openstack-infra | 17:10 | |
| *** lbragstad has quit IRC | 17:16 | |
| *** vogxn has quit IRC | 17:19 | |
| *** morganfainberg is now known as morganfainberg|a | 17:20 | |
| *** SergeyLukjanov has joined #openstack-infra | 17:26 | |
| *** dkliban has joined #openstack-infra | 17:27 | |
| *** thomasbiege has joined #openstack-infra | 17:28 | |
| *** yolanda has joined #openstack-infra | 17:33 | |
| *** dkliban has quit IRC | 17:34 | |
| *** morganfainberg|a is now known as morganfainberg | 17:38 | |
| *** thomasbiege has quit IRC | 17:46 | |
| *** thomasbiege has joined #openstack-infra | 17:56 | |
| *** dina_belova has joined #openstack-infra | 17:57 | |
| *** dina_belova has quit IRC | 18:02 | |
| *** dkliban has joined #openstack-infra | 18:16 | |
| *** cthulhup has joined #openstack-infra | 18:16 | |
| *** dkliban has quit IRC | 18:20 | |
| *** cthulhup has quit IRC | 18:20 | |
| *** dina_belova has joined #openstack-infra | 18:27 | |
| *** yolanda has quit IRC | 18:46 | |
| *** jergerber has joined #openstack-infra | 18:47 | |
| *** mriedem has joined #openstack-infra | 18:49 | |
| jeblair | Alex_Gaynor: http://tinyurl.com/kj3nna6 | 19:10 |
| jeblair | Alex_Gaynor: http://tinyurl.com/lg4tef5 | 19:11 |
| jeblair | Alex_Gaynor: those are the graphs not a screenshot, but you can get an idea) | 19:11 |
| *** thomasbiege has quit IRC | 19:11 | |
| *** sdake has quit IRC | 19:11 | |
| *** jergerber has quit IRC | 19:12 | |
| *** ryanpetrello has quit IRC | 19:14 | |
| jeblair | I replaced docs-draft with the new filesystem and am running the final rsync now | 19:15 |
| *** jamiem has joined #openstack-infra | 19:19 | |
| *** xBsd has quit IRC | 19:23 | |
| jeblair | (it's possible some docs jobs may fail until the rsync is complete) | 19:30 |
| *** dkliban has joined #openstack-infra | 19:30 | |
| *** pcrews has quit IRC | 19:32 | |
| *** olaph has quit IRC | 19:43 | |
| *** SergeyLukjanov has quit IRC | 19:45 | |
| *** marun has quit IRC | 19:51 | |
| *** marun has joined #openstack-infra | 19:52 | |
| *** pcm_ has quit IRC | 19:56 | |
| *** thomasbiege has joined #openstack-infra | 20:11 | |
| *** boris-42 has quit IRC | 20:13 | |
| *** marun has quit IRC | 20:14 | |
| lifeless | clarkb: is 0.0.15 better? | 20:15 |
| *** dina_belova has quit IRC | 20:19 | |
| *** dkliban has quit IRC | 20:21 | |
| *** thomasbiege has quit IRC | 20:23 | |
| clarkb | lifeless: yes it appears to have fixed the problem | 20:24 |
| lifeless | cool | 20:25 |
| lifeless | very frustrating bug | 20:25 |
| morganfainberg | clarkb: for adding a tox.ini to stable/grizzly requirements, do you think (mostly) lifting the tox.ini (with changes to point at tools/test-requires) and the master setup.py/setup.cfg would work? I'm not 100% familiar with the requirements repo, but noticed with dolph's recent patchset it was missing a tox.ini | 20:50 |
| morganfainberg | clarkb: you can also tell me you're the wrong person to ask :) | 20:50 |
| *** olaph has joined #openstack-infra | 20:57 | |
| clarkb | morganfainberg: the tox.ini should only be necessary if we are going to backport the tests as well | 20:59 |
| clarkb | and I am not sure if that is something that mordred wants | 21:00 |
| morganfainberg | clarkb: then likely we need to disable the checks on stable/grizzly branch. | 21:00 |
| morganfainberg | clarkb: i guess we could make it a no-op? | 21:01 |
| morganfainberg | clarkb: i guess it's a question for mordred though. just noticed it was failing because it couldn't run tests. | 21:01 |
| morganfainberg | (py27, et al) | 21:01 |
| *** apcruz has quit IRC | 21:02 | |
| clarkb | I think the choice is to either disable the test or backport the tests | 21:03 |
| morganfainberg | makes sense. | 21:03 |
| clarkb | I know that the tests have a hard time when the requirements are mxied which is why we went with global-requirements.txt | 21:03 |
| clarkb | so that the tests themselves could assert requirements without interfering :) | 21:03 |
| clarkb | tl;dr it is possible to go either way not sure which is preferred | 21:03 |
| morganfainberg | right. guess monday will require some of mordreds time to ponder this. | 21:04 |
| clarkb | well he is at burning man so we may just want to make a decision. The easy thing is to disable the test. Let me propose that change | 21:04 |
| morganfainberg | cool. | 21:04 |
| morganfainberg | yeah, i was just trying to help you guys out in the minutes between my local unit test runs. i know you've all been working crazy hard for this feature freeze time :) | 21:05 |
| clarkb | morganfainberg: do you have a link to the change that failed? i want to see which tests I need to disable | 21:06 |
| morganfainberg | sure. sec | 21:06 |
| morganfainberg | ignore my wrong comments on it btw | 21:06 |
| clarkb | I think pep8 and python27 are the two | 21:06 |
| morganfainberg | https://review.openstack.org/#/c/43564/ | 21:06 |
| morganfainberg | yeah those are the correct ones | 21:06 |
| morganfainberg | and i'm looking into the pytz thing | 21:06 |
| morganfainberg | which looks like a pip issue. | 21:09 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Don't run requirements pep8/py27 on Folsom/Grizzly https://review.openstack.org/43593 | 21:09 |
| clarkb | morganfainberg: new pip needs an explicit version if the package uses silly versioning | 21:10 |
| clarkb | morganfainberg: try giving it a set of boundaries | 21:10 |
| *** thomasbiege has joined #openstack-infra | 21:10 | |
| morganfainberg | hrm. fyi looks like pip-1.4.1 solved it at least locally for me | 21:10 |
| morganfainberg | whereas 1.4 was broken | 21:10 |
| morganfainberg | trying to duplicate again. | 21:10 |
| jeblair | clarkb: this is not urgent, but if you have a minute sometime, can you review these 2 small changes? https://review.openstack.org/#/q/status:open+project:openstack-infra/zuul+branch:master+topic:graph,n,z | 21:14 |
| clarkb | jeblair: sure | 21:14 |
| clarkb | jeblair: what do you think of 43593? | 21:15 |
| jeblair | clarkb: i'd like to do a zuul upgrade this weekend (and preferably just one) | 21:15 |
| jeblair | clarkb: looking now | 21:15 |
| jeblair | clarkb, morganfainberg: the other tests work? | 21:16 |
| *** thomasbiege has quit IRC | 21:16 | |
| morganfainberg | jeblair: yes, well, except a pytz issue, but thats pip related, not test related. | 21:16 |
| clarkb | jeblair: yup see https://review.openstack.org/#/c/43564/ | 21:16 |
| morganfainberg | pytz in the install test. | 21:16 |
| morganfainberg | but yes. | 21:16 |
| clarkb | jeblair: I think the devstack tests are a noop in that case but making them not run is more difficult | 21:17 |
| morganfainberg | clarkb: i think i broken my python install :P forgot i was on fedora, and pip installs in silly locations (overwrites my system packages) | 21:17 |
| jeblair | clarkb, morganfainberg: seems sensible for now; can easily re-enable if someone backports the tests | 21:17 |
| jeblair | the docs-draft rsync is finished | 21:18 |
| jeblair | cleaning up the old docs-draft and expanding logs fs now | 21:18 |
| morganfainberg | jeblair: i actually have the tests working locally, but i am not 100% sure i got it correct (breakage would be bad), i think it's much better to disable and have someone more knowledgable backport them. | 21:18 |
| morganfainberg | if that is even desired. | 21:18 |
| openstackgerrit | A change was merged to openstack-infra/config: Don't run requirements pep8/py27 on Folsom/Grizzly https://review.openstack.org/43593 | 21:20 |
| *** dina_belova has joined #openstack-infra | 21:20 | |
| clarkb | jeblair: both zuul changes lgtm | 21:20 |
| jeblair | morganfainberg: if you've done the work, i'd go ahead and propose it; we can merge it and add a silent job to run those tests (no rush) | 21:21 |
| morganfainberg | jeblair: ok, i will do so once i reconstruct my VM so i can even check that it works :P blew it up badly (python is broken completely) | 21:21 |
| morganfainberg | … note to self… SNAPSHOTS. | 21:22 |
| jeblair | i'm becoming kind of keen on the idea of keeping nodepool running locally so i always have a pool of throwaway vms :) | 21:23 |
| morganfainberg | jeblair: i have been using vagrant, but my box files got out of date =/ | 21:23 |
| morganfainberg | jeblair: and i've been a bit too busy to update them. | 21:23 |
| *** dina_belova has quit IRC | 21:25 | |
| morganfainberg | jeblair, clarkb, any issue with setting pytz >=2013b in that changeset? it's seems to solve the versioning. tested pip seems to resolve >=2010o to 2013b, so … it should work? | 21:30 |
| *** dina_belova has joined #openstack-infra | 21:30 | |
| clarkb | what is used on the master branch? | 21:31 |
| morganfainberg | hrm checking | 21:31 |
| clarkb | I think this has been solved there | 21:31 |
| morganfainberg | pytz>=2010h | 21:32 |
| morganfainberg | yeah, i'll just copy that one back. | 21:32 |
| morganfainberg | should that be proposed separately? or is it sane to lump them together? | 21:32 |
| morganfainberg | i'd err on separate, but whatever is easiest for you guys | 21:32 |
| clarkb | if you need both to pass tests they should go together | 21:33 |
| morganfainberg | well, need keyring to fix test issues, pytz for requirements to work, i could make it dependant patchsets. | 21:34 |
| *** dina_belova has quit IRC | 21:34 | |
| jeblair | /dev/mapper/main-logs 3.5T 1.7T 1.8T 50% /srv/static/logs | 21:35 |
| jeblair | /dev/mapper/main-docs--draft 291G 155G 137G 54% /srv/static/docs-draft | 21:35 |
| morganfainberg | clarkb / jeblair thanks for the help, as always you guys rock | 21:36 |
| jeblair | morganfainberg: this one's mostly clarkb, but for my part, you're welcome. :) | 21:37 |
| jeblair | okay, the volume rejiggering is done on static and i've deleted the old un-used volumes | 21:38 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/nodepool: Fix typo in deleteImage https://review.openstack.org/43594 | 21:42 |
| jeblair | i'm just going to push that one through ^ | 21:42 |
| jeblair | gee, i'm working during the quiet time and there are 14 changes in the check pipeline | 21:44 |
| morganfainberg | jeblair: i can go nuts and add changes for no reason if it helps :P ;) | 21:45 |
| jeblair | morganfainberg: not so much; i'm doing disruptive things (i'm about to restart nodepool, and then zuul...) | 21:45 |
| morganfainberg | fun times. | 21:45 |
| morganfainberg | *adds bigger sarcasm to previous statement* | 21:45 |
| clarkb | /SARCASM | 21:49 |
| morganfainberg | ^ | 21:49 |
| openstackgerrit | A change was merged to openstack-infra/nodepool: Fix typo in deleteImage https://review.openstack.org/43594 | 21:55 |
| jeblair | <sigh> yeah i think the sigusr1 to zuul affects the gearman process | 22:03 |
| jeblair | i'm going to restart nodepool and zuul now to pick up all those changes | 22:03 |
| jeblair | #status alert Zuul and nodepool are being restarted | 22:04 |
| openstackstatus | NOTICE: Zuul and nodepool are being restarted | 22:04 |
| *** ChanServ changes topic to "Zuul and nodepool are being restarted" | 22:04 | |
| jeblair | we need an 'abort all jobs' script :/ | 22:09 |
| clarkb | jeblair: does the gearman server need to fork twice and more fully detach from the parent? | 22:10 |
| clarkb | python daemon should do that though | 22:10 |
| jeblair | clarkb: probably something like that; it's also possible i did something dumb like setup the sig handler before forking; i haven't really looked | 22:10 |
| jeblair | oh this reminds me, i should also shut down jenkins01 and 02 and remove the 5000 or so credentials i accidentally created by not having the credential id in the nodepool config | 22:14 |
| clarkb | that many? wow | 22:15 |
| jeblair | is fast :) | 22:15 |
| *** dmakogon_ has quit IRC | 22:20 | |
| jeblair | is there a way to get novaclient to not use a pretty table to make parsing easier? | 22:22 |
| morganfainberg | jeblair: quick python script to directly interface? | 22:23 |
| jeblair | meh, this is where i'm at: nova list | grep -v '\+' | awk '{print $2}' |grep -v ID | 22:23 |
| morganfainberg | possibly use sed instead? but that's really my only other thought. | 22:24 |
| jeblair | the columns are easy, it's stripping the header and footer that's yucky. anyway, the above does the job | 22:25 |
| clarkb | sed 1d to get rid of line 1. | 22:26 |
| jeblair | ah neat | 22:26 |
| jeblair | stopping jenkins | 22:27 |
| jeblair | starting jenkins | 22:28 |
| jeblair | starting nodepool | 22:29 |
| jeblair | starting zuul | 22:30 |
| *** dina_belova has joined #openstack-infra | 22:31 | |
| morganfainberg | jeblair: is it safe for me to issue a recheck now or you still working on things? | 22:34 |
| jeblair | morganfainberg: not just yet | 22:34 |
| morganfainberg | jeblair: this is why i ask :) | 22:34 |
| jeblair | i didn't notice my zuul changes didn't merge... | 22:34 |
| *** dina_belova has quit IRC | 22:35 | |
| jeblair | morganfainberg: go for it | 22:38 |
| morganfainberg | oh haha | 22:38 |
| morganfainberg | you got the one i was going to:P | 22:39 |
| morganfainberg | *facepalm* | 22:39 |
| jeblair | oh good | 22:39 |
| jeblair | #status ok Zuul and nodepool are running again; rechecks have been issued (but double check your patch in case it was missed) | 22:40 |
| openstackstatus | NOTICE: Zuul and nodepool are running again; rechecks have been issued (but double check your patch in case it was missed) | 22:40 |
| *** ChanServ changes topic to "Discussion of OpenStack Project Infrastructure | Docs http://ci.openstack.org/ | Bugs https://launchpad.net/openstack-ci | Code https://git.openstack.org/cgit/openstack-infra/" | 22:40 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/nodepool: Fix typo in node check method https://review.openstack.org/43595 | 22:42 |
| *** Steely_Dan is now known as dansmith | 22:45 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Use more efficient jobs/hour graph https://review.openstack.org/43596 | 22:46 |
| *** jamiem has quit IRC | 22:49 | |
| morganfainberg | jeblair: i think there is a bug. | 22:59 |
| jeblair | morganfainberg: nodepool is not getting zmq info from jenkins | 23:00 |
| morganfainberg | http://status.openstack.org/zuul/ haS a job for both https://review.openstack.org/43564 and https://review.openstack.org/43564 | 23:00 |
| jeblair | morganfainberg: i think jenkins is not listening on the port | 23:00 |
| morganfainberg | erm | 23:00 |
| morganfainberg | that should have been patchset 1 and 2 | 23:00 |
| morganfainberg | adium is too helpful and expanded the urls for me. | 23:01 |
| clarkb | it doesnt open the socket until the first event iirc | 23:02 |
| jeblair | clarkb: hrm, there have certainly been events | 23:03 |
| jeblair | clarkb: i have unchecked the enable box, saved, rechecked, saved | 23:03 |
| jeblair | clarkb: but an event hasn't happened since then, i'll wait or make one happen and see if that had an effect | 23:03 |
| jeblair | clarkb: nope | 23:05 |
| clarkb | anything in the log | 23:05 |
| jeblair | Aug 24, 2013 10:38:49 PM org.jenkinsci.plugins.ZMQEventPublisher.ZMQRunnable bindSocket | 23:05 |
| jeblair | INFO: Binding ZMQ PUB to port 8888 | 23:05 |
| jeblair | i also have a simple stream client that should be subscribed as well; it's also receiving nothing | 23:06 |
| clarkb | does netstat -lnp show it? | 23:06 |
| jeblair | clarkb: no | 23:07 |
| jeblair | this is strange; i don't believe we upgraded jenkins or any plugins | 23:07 |
| clarkb | :/ | 23:09 |
| jeblair | clarkb: erm, i guess i'll try restarting jenkins again? | 23:10 |
| clarkb | ok | 23:10 |
| clarkb | I am doing family stuff now so hard to help | 23:10 |
| jeblair | i need to head out in a few minutes too, so that's going to be awkward | 23:10 |
| jeblair | it's showing in netstat now | 23:11 |
| clarkb | woot | 23:12 |
| clarkb | file a bug and I can try reproduce next week? | 23:12 |
| jeblair | now for the other one | 23:12 |
| jeblair | other one is good now too | 23:13 |
| jeblair | that has probably made a hash of the current crop of tests, and i'll have to manually tell nodepool about some used nodes | 23:14 |
| jeblair | but at least it should stabilize on its own | 23:14 |
| jeblair | morganfainberg: what happened to those two patchsets? | 23:14 |
| morganfainberg | jeblair: it just queued both patchsets | 23:15 |
| morganfainberg | somehow | 23:15 |
| morganfainberg | just an oddity. | 23:15 |
| morganfainberg | but if that happened more widespread, it could definitely impact available resources. | 23:15 |
| jeblair | morganfainberg: are they both still there? | 23:16 |
| morganfainberg | yep | 23:16 |
| jeblair | ah i see them now | 23:16 |
| morganfainberg | patchset 1 is failing (pytz) | 23:16 |
| morganfainberg | but ... | 23:16 |
| jeblair | huh | 23:18 |
| morganfainberg | it's def. odd. | 23:18 |
| jeblair | morganfainberg: i think the deal there is that patchset 2 was enqueued before ps1 | 23:18 |
| jeblair | morganfainberg: if it happens in chrono order, it should kick out 1 | 23:18 |
| morganfainberg | jeblair: hehe | 23:18 |
| morganfainberg | jeblair: right. | 23:18 |
| jeblair | morganfainberg: i don't think it handles reverse chrono | 23:18 |
| jeblair | morganfainberg: yeah, it looks like i did a recheck on ps2 and that was followed by you doing a recheck on ps1 | 23:19 |
| jeblair | morganfainberg: so, it's erm, not optimal, but i don't think it's a regression <whew> | 23:19 |
| morganfainberg | jeblair: ok | 23:19 |
| jeblair | a fun one though; i don't know what the right behaviour there is off-hand. :) | 23:20 |
| morganfainberg | jeblair: probably as long as it doesn't happen too often | 23:20 |
| morganfainberg | behavior is fine as is (e.g. people don't do something silly) | 23:20 |
| *** p5ntangle has quit IRC | 23:23 | |
| jeblair | ok, i manually set the state for a bunch of nodes nodepool missed; it should clean them up in a bit | 23:31 |
| jeblair | i'm heading out now; i'll double check those later | 23:31 |
| *** dina_belova has joined #openstack-infra | 23:31 | |
| *** dina_belova has quit IRC | 23:35 | |
| openstackgerrit | Evgeny Fadeev proposed a change to openstack-infra/askbot-theme: modified css for the en and zh-cn locales https://review.openstack.org/43598 | 23:56 |
| openstackgerrit | A change was merged to openstack-infra/askbot-theme: modified css for the en and zh-cn locales https://review.openstack.org/43598 | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!