| clarkb | anteaya: correct | 00:00 |
|---|---|---|
| anteaya | thought so but didnt' want to interfere with running tests | 00:00 |
| anteaya | thanks | 00:00 |
| openstackgerrit | A change was merged to openstack-infra/storyboard-webclient: Added no_api env https://review.openstack.org/68610 | 00:00 |
| clarkb | dims "host_name": "Jenkins" | 00:02 |
| clarkb | dims: not sure that is quite what we want | 00:02 |
| *** yassine has quit IRC | 00:02 | |
| *** CaptTofu has joined #openstack-infra | 00:02 | |
| fungi | anteaya: it's fine | 00:03 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Add devstack-precise-saucy-kernel nodes https://review.openstack.org/69749 | 00:03 |
| *** virmitio has quit IRC | 00:04 | |
| fungi | clarkb: anteaya: russellb: ^ | 00:04 |
| *** derekh has quit IRC | 00:05 | |
| anteaya | any reason we are putting them on rax only? | 00:05 |
| fungi | that should make sure jenkins07 always has one ready | 00:05 |
| fungi | anteaya: because we don't intend to run it a bunch or for very long | 00:05 |
| anteaya | okay lets get one up | 00:05 |
| clarkb | fungi: lgtm | 00:06 |
| fungi | anteaya: we'll be reverting the patches for these once we're comfortable that jobs run with the new kernel and don't encounter the bug it's supposed to fix | 00:06 |
| anteaya | right | 00:06 |
| fungi | and then we'll put through a change to upgrade the normal devstack-precise (and probably bare-precise) nodes to the newer kernel | 00:06 |
| krotscheck | jog0: http://paste.openstack.org/show/62054/ for example markup, I'll adjust your patch with the CSS shortly. | 00:08 |
| jog0 | krotscheck: awesome thanks! | 00:09 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/elastic-recheck: Only plot gate failures in status.o.o/elastic-recheck/ https://review.openstack.org/69735 | 00:09 |
| *** jcooley_ has quit IRC | 00:10 | |
| krotscheck | jog0: That should get you the tabs to select the queue with. The navigation sidebar will require a bit of additional work, but since you're going for just an incremental change I figured this'd be good. | 00:10 |
| *** ken1ohmichi has joined #openstack-infra | 00:11 | |
| krotscheck | fungi: https://review.openstack.org/#/c/69722/ - I made the changes clarkb asked for, any additional requests? | 00:13 |
| fungi | krotscheck: free bird? | 00:13 |
| *** jooools has joined #openstack-infra | 00:14 | |
| * fungi has probably already used that joke this week | 00:14 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add devstack-precise-saucy-kernel nodes https://review.openstack.org/69749 | 00:14 |
| krotscheck | ....I'm not certain I get it? | 00:15 |
| * krotscheck is german. He doesn't have a sense of humor. | 00:15 | |
| krotscheck | Oh. Requests. Free bird. | 00:15 |
| fungi | krotscheck: you simply have a superior sense of humor, that's all | 00:15 |
| krotscheck | It's not broken, it's advaaaaanced. | 00:16 |
| *** atiwari has quit IRC | 00:16 | |
| fungi | </zip> | 00:16 |
| fungi | zim | 00:16 |
| * fungi can't type | 00:16 | |
| fungi | (though i guess that was one of the tallest, not actually zim) | 00:17 |
| *** derekh has joined #openstack-infra | 00:17 | |
| fungi | still, episode #1 ftw | 00:17 |
| * clarkb decides to hack the name out of the root urkl | 00:17 | |
| *** jcooley_ has joined #openstack-infra | 00:17 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Update colors, header https://review.openstack.org/69723 | 00:19 |
| fungi | i've got images building on some providers and once those finish i'll do the (roughly) other half | 00:20 |
| anteaya | fungi: http://www.youtube.com/watch?v=np0solnL1XY | 00:21 |
| openstackgerrit | A change was merged to openstack-infra/config: Updated tarball/client dist upload for javascript https://review.openstack.org/69722 | 00:21 |
| anteaya | for you | 00:21 |
| *** slong has joined #openstack-infra | 00:21 | |
| *** thuc has quit IRC | 00:21 | |
| *** thuc has joined #openstack-infra | 00:22 | |
| fungi | heh. thanks anteaya | 00:22 |
| anteaya | :D | 00:22 |
| anteaya | fungi: how long until it makes sense for me to trigger more recheck experimental jobs | 00:24 |
| fungi | anteaya: when the ones you already triggered start running | 00:25 |
| dims | clarkb, will fine tune it. | 00:25 |
| anteaya | fungi: great thanks | 00:25 |
| clarkb | dims: did you want to work on that? I think I have decided that using the rootUrl to determine the host is better | 00:26 |
| fungi | anteaya: the nodepool server hasn't spotted that config update quite yet (any minute probably, and then it needs to spend a while building the corresponding image, then launch servers from it) | 00:26 |
| *** thuc has quit IRC | 00:26 | |
| clarkb | dims: but clunky | 00:26 |
| dims | clarkb, that sounds good to me., please go ahead with that. if i find something better will submit another review. | 00:27 |
| clarkb | dims: sounds good thanks | 00:28 |
| *** mattoliverau has quit IRC | 00:28 | |
| dims | clarkb, i am guessing you are going to do a urootUrl.getHost() and stick that in? | 00:29 |
| dims | sorry rootUrl.getHost() | 00:30 |
| *** jooools has quit IRC | 00:30 | |
| clarkb | oh there is a getHost method, I should've checked for that :) | 00:30 |
| dims | :) | 00:30 |
| *** matsuhashi has joined #openstack-infra | 00:30 | |
| clarkb | getRootUrl reutrns string | 00:30 |
| *** melwitt has quit IRC | 00:30 | |
| anteaya | fungi: very good | 00:31 |
| anteaya | but at least I have something pretty to look at while I wait | 00:31 |
| clarkb | dims: where does getHost() come from? | 00:31 |
| *** markmcclain has quit IRC | 00:31 | |
| *** mattoliverau has joined #openstack-infra | 00:31 | |
| *** markmcclain has joined #openstack-infra | 00:31 | |
| *** ryanpetrello has quit IRC | 00:33 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Update colors, header https://review.openstack.org/69723 | 00:33 |
| clarkb | oh looks like java.net.URL is what I want | 00:35 |
| dims | right | 00:36 |
| clarkb | this will teach me to java | 00:37 |
| *** alexpilotti has quit IRC | 00:37 | |
| dims | :) | 00:38 |
| openstackgerrit | Christopher Yeoh proposed a change to openstack-infra/elastic-recheck: Adds query for bug 1273556 https://review.openstack.org/69542 | 00:38 |
| *** CaptTofu has quit IRC | 00:38 | |
| *** malini is now known as malini_afk | 00:39 | |
| wenlock_ | clarkb if your trying to parse a url, i think you want java.net.URI .... not URL | 00:39 |
| clarkb | wenlock_: http://docs.oracle.com/javase/7/docs/api/java/net/URL.html seems to be used in jenkins | 00:41 |
| dims | wenlock_, i assumed rootUrl clarkb mentioned was already a java.net.URL | 00:41 |
| openstackgerrit | Christopher Yeoh proposed a change to openstack-infra/elastic-recheck: Adds query for bug 1273556 https://review.openstack.org/69542 | 00:41 |
| clarkb | dims: it isn't it is a string | 00:42 |
| clarkb | bceause jenkins rolls like that | 00:42 |
| wenlock_ | clarkb, yeah if they plan to open a connection, then URL makes sense | 00:42 |
| wenlock_ | clarkb , if they are just parsing to make a new URL then URI is the way to go | 00:43 |
| *** _ruhe is now known as ruhe | 00:43 | |
| clarkb | wenlock_: I want the hostname out of https?://foo.org/some/path/here | 00:43 |
| krotscheck | With the caveat of "it's not on the server with the API yet." .... | 00:44 |
| krotscheck | clarkb, fungi: Thanks for making this happen: http://docs-draft.openstack.org/23/69723/3/check/gate-storyboard-webclient-js-unittests/b202be0/dist/#!/ | 00:44 |
| clarkb | wenlock_: I will have a change up shortly and people can tell me how I did java wrong | 00:44 |
| *** sarob has joined #openstack-infra | 00:44 | |
| wenlock_ | clarkb, IMO URI is better for that, then you do URI("http://blah").getHost() and out comes a string with the hostname | 00:44 |
| *** pcrews has joined #openstack-infra | 00:45 | |
| dims | clarkb, technically both "new URL(rootUrl).getHost()" and "new URI(rootUrl).getHost()" will give you what you need | 00:45 |
| wenlock_ | dims, agreed, my understanding was that URL is heavier | 00:45 |
| *** ryanpetrello has joined #openstack-infra | 00:45 | |
| * wenlock_ wonders if URL supports ssh: file: | 00:47 | |
| dims | wenlock_, there's tons of opinion :) googling java URL vs URI | 00:47 |
| wenlock_ | hehe so true | 00:47 |
| *** mrodden has quit IRC | 00:48 | |
| clarkb | wtf java. the docs say it returns null of no hostname but I still have to catch an exception | 00:48 |
| anteaya | I'm running check experimental on this patch: https://review.openstack.org/#/c/69037/ | 00:48 |
| fungi | clarkb: 2014-01-29 00:46:40,250 ERROR nodepool.image.build.rax-ord.devstack-precise: Invalid parameter rules4 at /root/config/modules/openstack_project/manifests/slave_template.pp:13 on node devstack-precise-1390956157.template.openstack.org | 00:48 |
| * fungi has a sad | 00:48 | |
| dims | clarkb, java.net.URL is lot older than URI so it is a bit backward | 00:48 |
| anteaya | the first round had jobs that didn't run and it looks like the node isn't ready yet | 00:48 |
| anteaya | so I will go to dinner and try again | 00:49 |
| wenlock_ | clarkb, you think i can ask for a review later tonight on https://review.openstack.org/#/c/51425 | 00:49 |
| wenlock_ | ? | 00:49 |
| clarkb | fungi: :( | 00:49 |
| fungi | anteaya: we broke image builds, so need to fix them first anyway | 00:49 |
| clarkb | wenlock_: maybe, depends on how quickly I get this done | 00:49 |
| anteaya | fungi: I was just reading about your sad | 00:49 |
| anteaya | :( | 00:49 |
| wenlock_ | clarkb, no worries if you can't do it today... i still have time this week | 00:49 |
| fungi | clarkb: i'll switch rooms and then work up a patch for that one | 00:49 |
| anteaya | not great for the end of the day | 00:49 |
| wenlock_ | clarkb, know your busy... gota run ttyl | 00:50 |
| anteaya | I'll check in after dinner | 00:50 |
| clarkb | fungi: ok | 00:50 |
| *** wenlock_ has quit IRC | 00:50 | |
| clarkb | dims: https://review.openstack.org/69763 testing that now | 00:51 |
| openstackgerrit | A change was merged to openstack-infra/storyboard-webclient: Update colors, header https://review.openstack.org/69723 | 00:53 |
| *** yamahata has quit IRC | 00:54 | |
| clarkb | that worked, it is a bit heavy weight, but I don't care :) | 00:56 |
| clarkb | we are talking a few thousand events per day nothing horrible | 00:57 |
| dims | +1 | 00:58 |
| clarkb | fungi: I don't expect to get that in place tonight (as real review would be nice and it is getting latish) | 00:59 |
| clarkb | fungi: is there anything on your end of stuff I can help with? | 00:59 |
| clarkb | instead of poking at jenkinses? | 00:59 |
| fungi | clarkb: keep poking at jenkinses if you like. i'm about to start deciding how to fix the puppetingness | 01:00 |
| *** ryanpetrello has quit IRC | 01:00 | |
| clarkb | fungi: nah jenkins can wait for when I can bundle a few things together | 01:00 |
| clarkb | I will look at that rules4 thing too | 01:00 |
| fungi | okay, though i doubt it's complicated to fix | 01:01 |
| clarkb | fungi: should be iptables_rules4 | 01:02 |
| fungi | yup | 01:02 |
| *** mrodden has joined #openstack-infra | 01:03 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/config: Add Storyboard puppet module https://review.openstack.org/65017 | 01:03 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Pass iptables_rules4 to template instead of rules4 https://review.openstack.org/69765 | 01:05 |
| fungi | clarkb: ^ plain brown wraper | 01:05 |
| fungi | wrapper | 01:05 |
| *** sarob has quit IRC | 01:05 | |
| *** sarob has joined #openstack-infra | 01:06 | |
| clarkb | approved | 01:06 |
| fungi | thx | 01:06 |
| fungi | i'll speed it along once it merges | 01:06 |
| *** nati_uen_ has joined #openstack-infra | 01:07 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: register bug for new issue on instance caching https://review.openstack.org/69766 | 01:09 |
| *** SumitNaiksatam has quit IRC | 01:09 | |
| *** nati_ueno has quit IRC | 01:10 | |
| openstackgerrit | A change was merged to openstack-infra/config: Pass iptables_rules4 to template instead of rules4 https://review.openstack.org/69765 | 01:11 |
| *** sarob has quit IRC | 01:11 | |
| fungi | pulling that ^ on puppetmaster now | 01:11 |
| *** dcramer_ has joined #openstack-infra | 01:12 | |
| *** thuc has joined #openstack-infra | 01:12 | |
| ruhe | clarkb: fungi: (cc krotscheck): could you help us to push latest code from https://review.openstack.org/#/c/65017/ to ci-puppetmaster? if i understand this correctly, mordred already uploaded previous version, so we could play with it on storyboard-dev.o.o | 01:12 |
| fungi | ruhe: fastest way is for us to review (and hopefully approve) it. all the prerequisites are already merged as of a few hours aho | 01:14 |
| fungi | ago | 01:14 |
| krotscheck | fungi: That's correct. All the pieces are there. | 01:14 |
| fungi | and i started to review it, but am currently sidetracked fixing all the broken so it'll be a few | 01:15 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: register bug for new issue on instance caching https://review.openstack.org/69766 | 01:16 |
| *** VijayT has quit IRC | 01:16 | |
| *** krotscheck has quit IRC | 01:16 | |
| *** CaptTofu has joined #openstack-infra | 01:19 | |
| *** CaptTofu has quit IRC | 01:21 | |
| *** CaptTofu has joined #openstack-infra | 01:21 | |
| *** sarob has joined #openstack-infra | 01:22 | |
| *** sarob has quit IRC | 01:22 | |
| *** sarob has joined #openstack-infra | 01:23 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/gerritlib: update replicate command and add a version command https://review.openstack.org/69768 | 01:23 |
| *** senk has quit IRC | 01:23 | |
| fungi | image builds seem to be getting further now | 01:25 |
| *** senk has joined #openstack-infra | 01:25 | |
| *** sarob has quit IRC | 01:27 | |
| clarkb | fungi: they still going? | 01:33 |
| *** derekh has quit IRC | 01:36 | |
| *** nosnos has joined #openstack-infra | 01:37 | |
| fungi | yeah, for around 30 minutes so far without failing | 01:41 |
| fungi | the saucy kernel image too | 01:41 |
| fungi | i haven't deleted old images on hpcloud-az2, hpcloud-az3 or rax-iad yet, but the others will hopefully be ready soon | 01:42 |
| *** senk has quit IRC | 01:46 | |
| *** ruhe is now known as _ruhe | 01:48 | |
| *** senk has joined #openstack-infra | 01:48 | |
| openstackgerrit | Christopher Yeoh proposed a change to openstack-infra/elastic-recheck: Narrows query for bug 1273556 https://review.openstack.org/69542 | 01:50 |
| fungi | well, i was going to tell krotscheck and ruhe to take note of clarkb's comments on 65017 (which i am approving), but instead i'll remember to suggest an irc proxy/bouncer or shell server to them | 01:51 |
| clarkb | fungi: :) | 01:51 |
| fungi | because, you know, irc | 01:51 |
| StevenK | I've used my Linode to run irssi in screen for ... a long while | 01:53 |
| fungi | yup | 01:53 |
| *** yongli has quit IRC | 01:53 | |
| StevenK | -rw------- 1 steven users 3.7K Dec 7 2008 .irssi/config.old | 01:55 |
| fungi | i used to run ircii inside gnu screen. now it's weechat inside tmux, but same idea | 01:55 |
| fungi | heh | 01:55 |
| StevenK | Probably since then | 01:55 |
| *** ryanpetrello has joined #openstack-infra | 01:55 | |
| clarkb | I had an irssi up for almost 2 yaers without downtime | 01:55 |
| clarkb | then they rebooted the server. I was sad | 01:55 |
| StevenK | clarkb: I find something in screen or irssi loses its mind after about 70 days and it stops displaying unicode correctly | 01:56 |
| *** changbl has joined #openstack-infra | 01:56 | |
| fungi | at some point ircii got replaced with bitchx which got replaced by irssi, but i've been doing some semblance of that for at least 15 years | 01:56 |
| clarkb | StevenK: I haven't had that problem with screen and weechat. | 01:56 |
| clarkb | StevenK: but I didn't have working unicode support compiled into the screen back when I had that uptime | 01:56 |
| StevenK | fungi: xchat and then irssi for me | 01:56 |
| clarkb | we should all use ii | 01:57 |
| fungi | i don't think i could switch back to ircii at this point | 01:57 |
| StevenK | Neither | 01:57 |
| *** melwitt has joined #openstack-infra | 01:57 | |
| StevenK | My muscle memory is so trained to irssi that any other client just makes me scratch my head | 01:57 |
| bradm | StevenK: fwiw my current irssi uptime is 180-ish days, and I don't have a problem with unicode | 01:57 |
| bradm | StevenK: but I use tmux instead of screen | 01:58 |
| *** yamahata has joined #openstack-infra | 01:58 | |
| clarkb | StevenK: give weechat a shot. I mostly prefer it | 01:58 |
| *** yongli has joined #openstack-infra | 01:58 | |
| clarkb | and one feature is worth switching for, smart filters | 01:58 |
| StevenK | Hm, reparent a running irssi under tmux from screen. How hard could it be, and what could possibly go wrong ... | 01:58 |
| bradm | StevenK: /quit, start up tmux, run irssi | 01:59 |
| bradm | StevenK: :) | 01:59 |
| fungi | i've been very impressed with tmux, once i got used to the idea of sharing windows between separate tmux sessions. a good deal more flexible than screen's model | 01:59 |
| clarkb | fungi: but ^b | 01:59 |
| StevenK | bradm: That ends up with tmux running under screen :-P | 01:59 |
| fungi | meh | 01:59 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Narrows query for bug 1273556 https://review.openstack.org/69542 | 02:00 |
| *** vjay has joined #openstack-infra | 02:00 | |
| clarkb | ^a is two adjacent keys way off to the side. it is perfect | 02:00 |
| fungi | i sometimes run screen on remote systems under my closer tmux session in xterms under ratpoison, to ^a, ^b and ^t | 02:00 |
| StevenK | round tuits have mostly stopped me looking into tmux | 02:00 |
| bradm | clarkb: "set-option -g prefix C-a" is the first line in my .tmux.conf | 02:00 |
| *** nati_uen_ has quit IRC | 02:01 | |
| StevenK | bradm: Does C-a [ work in tmux? | 02:01 |
| fungi | yep | 02:01 |
| fungi | well, c-b,[ by default if you don't remap | 02:02 |
| fungi | and c-b,] to paste | 02:02 |
| StevenK | C-a c, C-a n, C-a p, C-a w, C-a [ are my most used | 02:02 |
| bradm | StevenK: I'm pretty sure I've just made tmux work like screen, I don't think I use most of the more interesting features of it | 02:03 |
| fungi | though the selection start/stop markers after c-b,[ are different from screen's | 02:03 |
| StevenK | Does tmux have nethack mode? | 02:03 |
| fungi | c-space to start selecting and c-w to end/copy | 02:03 |
| fungi | i can't remember if you can set nethack-style error messages in tmux. i think no | 02:04 |
| fungi | instead, i have a nethack session running in one of my tmux windows at all times, in case i get hungry for those messages | 02:04 |
| StevenK | That sounds like a missing critical feature :-P | 02:04 |
| * fungi points at you and curses | 02:04 | |
| StevenK | "You cannot escape from window 0!" "Your bell is no longer invisible" FTW | 02:05 |
| StevenK | A co-worker and I tried to work out how to get screen to bail out with "Suddenly the dungeon collapses! You die.", but screen's signal handling logic can be used to scare adults | 02:06 |
| clarkb | ha | 02:06 |
| StevenK | Mostly because screen tries *really* hard to pass all signals to children shells | 02:06 |
| * fungi smells a wumpus | 02:08 | |
| *** nati_ueno has joined #openstack-infra | 02:09 | |
| *** nati_ueno has quit IRC | 02:10 | |
| reed | starting the shutdown | 02:11 |
| reed | see some of you in Bruxelles | 02:11 |
| *** reed has quit IRC | 02:11 | |
| *** vjay has quit IRC | 02:14 | |
| clarkb | pleia2: before I run off to eat dinner. how did the nodepool stuff go? | 02:14 |
| * fungi hasn't looked at the fedora build fails yet | 02:18 | |
| fungi | hah, there's been a tripleo-fedora image in delete status for several days now | 02:19 |
| fungi | 76 hours | 02:19 |
| *** emagana has quit IRC | 02:21 | |
| lifeless | fungi: told ya :) | 02:21 |
| fungi | manually deleted it | 02:21 |
| *** emagana has joined #openstack-infra | 02:21 | |
| *** SumitNaiksatam has joined #openstack-infra | 02:25 | |
| *** _ruhe is now known as ruhe | 02:28 | |
| *** emagana has quit IRC | 02:29 | |
| ruhe | fungi: re irc bouncer. i'm using one, it just renames me to ruhe_ when i'm away | 02:29 |
| *** emagana has joined #openstack-infra | 02:29 | |
| ruhe | fungi: and comments from clarkb are already on my todo list :) | 02:30 |
| clarkb | ruhe: no need for a rename :{ | 02:31 |
| *** ryanpetrello has quit IRC | 02:31 | |
| ruhe | clarkb: i'll update bouncer config right now | 02:31 |
| fungi | ruhe: that explains it. i have my client to filter out nick changes because so much of them are noise | 02:32 |
| *** ryanpetrello has joined #openstack-infra | 02:32 | |
| *** chandankumar_ has joined #openstack-infra | 02:36 | |
| ruhe | fungi: they also pollute logs on eavesdrop.o.o. i might change/fix that. maybe you can give me direction? | 02:38 |
| StevenK | I just tend to mark myself /away, and I'll see if anyone hilighted when I get back | 02:39 |
| fungi | ruhe: we mostly just assume that if you don't answer, you're away and will chime in the next time you're around and see the highlight in scrollback | 02:39 |
| fungi | also, yes, setting a (not echoed to the channel) /away message helps for when people private /msg you | 02:39 |
| *** nati_ueno has joined #openstack-infra | 02:39 | |
| *** nati_ueno has quit IRC | 02:40 | |
| *** nati_ueno has joined #openstack-infra | 02:40 | |
| fungi | we all sleep some time... for me, that's going to be rather soon now | 02:40 |
| StevenK | fungi: I get notified about channel messages too if someone mentions me by name | 02:41 |
| fungi | yep, me too. i actually have a variety of highlight keywords set to help me skim scrollback of interest more efficiently | 02:42 |
| bknudson | is there some way we can get a measure of what % of submissions are failing Jenkins for a project? | 02:43 |
| StevenK | fungi: So finding those out and saying them in channel every 30 minutes would be unhelpful, huh? :-P | 02:43 |
| clarkb | bknudson: there is. the logstash and graphtie data is a good place to start | 02:43 |
| fungi | StevenK: for that, there's ignore ;) | 02:44 |
| clarkb | bknudson: I know jog0 and sdague spend a lot of time on this | 02:44 |
| StevenK | fungi: Haha | 02:44 |
| bknudson | clarkb: I bet logstash would have it... I'll poke at that. | 02:45 |
| ruhe | clarkb: fungi: there is a comment from gerrit "Your change requires a recursive merge to resolve." on https://review.openstack.org/#/c/65017/ , do i really need to rebase my patch? | 02:46 |
| clarkb | ruhe: yes | 02:46 |
| *** chandankumar_ has quit IRC | 02:48 | |
| ruhe | damn :( i lost all the precious votes | 02:49 |
| openstackgerrit | Ruslan Kamaldinov proposed a change to openstack-infra/config: Add Storyboard puppet module https://review.openstack.org/65017 | 02:50 |
| ruhe | oh, no i didn't :) | 02:50 |
| clarkb | and approved | 02:52 |
| *** ryanpetrello has quit IRC | 02:54 | |
| fungi | also, generally, unless the rebase is really complicated, we tend to honor prior votes even if the trivial rebase check doesn't consider them entirely identical | 02:54 |
| *** vjay has joined #openstack-infra | 02:55 | |
| fungi | but still avoid rebasing unless it's actually needed, since it makes inter-patchset diffs harder to compare | 02:56 |
| *** kraman has quit IRC | 02:58 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add Storyboard puppet module https://review.openstack.org/65017 | 02:59 |
| *** yaguang has joined #openstack-infra | 02:59 | |
| ruhe | clarkb: fungi: thank you! | 02:59 |
| *** CaptTofu has quit IRC | 03:00 | |
| *** pcrews has quit IRC | 03:01 | |
| *** zhiyan has joined #openstack-infra | 03:03 | |
| lifeless | fungi: gerrit could just be better about diffs | 03:10 |
| *** chandankumar_ has joined #openstack-infra | 03:10 | |
| lifeless | fungi: the math isn't too hard | 03:10 |
| clarkb | I think it uses jgit for the diffs | 03:11 |
| clarkb | and the problem is that they are correct diffs | 03:11 |
| clarkb | but correct diffs with too much info | 03:11 |
| lifeless | I know | 03:12 |
| lifeless | bzr had the same issue in LP | 03:12 |
| lifeless | aaron figured out how to solve it | 03:12 |
| lifeless | its not enabled for $uninterestingreasons | 03:12 |
| *** zhiyan has quit IRC | 03:15 | |
| *** chandankumar_ has quit IRC | 03:16 | |
| *** zhiyan has joined #openstack-infra | 03:17 | |
| *** vkozhukalov has joined #openstack-infra | 03:17 | |
| *** ArxCruz has quit IRC | 03:17 | |
| *** AlexF_ has joined #openstack-infra | 03:21 | |
| *** sandywalsh has quit IRC | 03:27 | |
| *** dstanek has quit IRC | 03:27 | |
| *** nati_uen_ has joined #openstack-infra | 03:28 | |
| *** wenlock has joined #openstack-infra | 03:28 | |
| *** weshay has quit IRC | 03:29 | |
| *** AlexF_ has quit IRC | 03:29 | |
| *** matsuhashi has quit IRC | 03:30 | |
| *** matsuhashi has joined #openstack-infra | 03:31 | |
| *** nati_ueno has quit IRC | 03:31 | |
| *** lcheng has joined #openstack-infra | 03:31 | |
| *** matsuhashi has quit IRC | 03:35 | |
| *** thuc has quit IRC | 03:39 | |
| *** zhiyan has joined #openstack-infra | 03:39 | |
| *** thuc has joined #openstack-infra | 03:39 | |
| *** dkliban has quit IRC | 03:40 | |
| *** jcooley_ has quit IRC | 03:41 | |
| *** kraman has joined #openstack-infra | 03:43 | |
| *** gyee has quit IRC | 03:44 | |
| *** thuc has quit IRC | 03:44 | |
| *** melwitt has quit IRC | 03:46 | |
| *** sandywalsh has joined #openstack-infra | 03:47 | |
| *** kraman has quit IRC | 03:48 | |
| *** ok_delta has joined #openstack-infra | 03:50 | |
| *** ok_delta__ has joined #openstack-infra | 03:50 | |
| *** VijayT has joined #openstack-infra | 03:55 | |
| *** Hefeweizen has quit IRC | 03:57 | |
| *** lttrl has joined #openstack-infra | 03:57 | |
| lifeless | fungi: I've tracked down the DHCP issue | 04:01 |
| lifeless | fungi: details in the bug, but I think I have a workaround in place. | 04:02 |
| lifeless | fungi: we'll know at the next rotation of slaves | 04:02 |
| *** david-lyle has joined #openstack-infra | 04:05 | |
| *** kraman has joined #openstack-infra | 04:08 | |
| *** talluri has joined #openstack-infra | 04:09 | |
| *** zhiyan has quit IRC | 04:10 | |
| *** nati_uen_ has quit IRC | 04:13 | |
| *** packet has quit IRC | 04:15 | |
| *** zhiyan has joined #openstack-infra | 04:15 | |
| *** zhiyan has left #openstack-infra | 04:15 | |
| *** dstanek has joined #openstack-infra | 04:15 | |
| *** CaptTofu has joined #openstack-infra | 04:16 | |
| *** harlowja is now known as harlowja_away | 04:16 | |
| *** jhesketh_ has joined #openstack-infra | 04:17 | |
| *** nati_ueno has joined #openstack-infra | 04:20 | |
| *** nati_ueno has quit IRC | 04:23 | |
| *** stevemar has joined #openstack-infra | 04:23 | |
| *** nati_ueno has joined #openstack-infra | 04:23 | |
| *** nati_uen_ has joined #openstack-infra | 04:24 | |
| *** nati_uen_ has quit IRC | 04:25 | |
| *** nati_uen_ has joined #openstack-infra | 04:26 | |
| *** nati_ueno has quit IRC | 04:28 | |
| *** emagana has quit IRC | 04:38 | |
| *** vjay has quit IRC | 04:42 | |
| *** kraman has quit IRC | 04:42 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/jeepyb: Fix incompatibility with gerrit 2.8 https://review.openstack.org/69791 | 04:47 |
| *** VijayT has quit IRC | 04:50 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/gerritlib: update replicate command and add a version command https://review.openstack.org/69768 | 04:51 |
| *** AlexF_ has joined #openstack-infra | 04:51 | |
| *** jcoufal-mobile has joined #openstack-infra | 04:52 | |
| *** matsuhashi has joined #openstack-infra | 04:55 | |
| *** dims has quit IRC | 04:55 | |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Allow workers to send back metadata https://review.openstack.org/66173 | 04:56 |
| *** dims has joined #openstack-infra | 04:57 | |
| *** oubiwann_ has quit IRC | 04:57 | |
| *** markmcclain has quit IRC | 04:58 | |
| *** kraman has joined #openstack-infra | 05:05 | |
| slong | Is anyone here a git-gerrit wizard? I'm having trouble pushing my changes back up. | 05:06 |
| clarkb | slong: sure what are you having trouble with? | 05:07 |
| slong | clarkb, am working on an amended commit. It asked me to merge a file, but then gerrit didn't allow the pushed merge. So undid it all, but it's still complaining about the merge. (and I got rid of the .orig file). | 05:08 |
| slong | I'd blow it away but am in the middle of a review. | 05:08 |
| slong | For this: https://review.openstack.org/#/c/67763/ | 05:09 |
| slong | Oh, and it's saying that I'm Jenkins as the author. | 05:09 |
| clarkb | if you amend a commit it shouldn't need to merge | 05:09 |
| clarkb | oh I think you must've amended a merge commit | 05:09 |
| clarkb | slong: what does git log -1 --oneline say? | 05:10 |
| *** jasondotstar has quit IRC | 05:10 | |
| slong | I did actually do a merge. | 05:10 |
| clarkb | oh you did a merge | 05:10 |
| clarkb | so you can't do merges with gerrit typically | 05:10 |
| slong | yes, before gerrit disallowed it. | 05:10 |
| slong | git log -1 --oneline | 05:11 |
| slong | 360b745 Added HA/Neutron architecture. | 05:11 |
| *** morganfainberg is now known as morganfainberg|z | 05:11 | |
| clarkb | so you are on the right commit, wheer did you do a merge? | 05:11 |
| slong | When I ran 'git review -v', there were upstream changes that had been done. | 05:12 |
| slong | The merge was fine, but gerrit rejected 'merged files'. | 05:12 |
| *** ryanpetrello has joined #openstack-infra | 05:12 | |
| clarkb | slong: did you do a git merge? | 05:12 |
| slong | 'git mergetool' | 05:12 |
| slong | yes | 05:12 |
| clarkb | slong: typically you want to do a git rebase instead | 05:12 |
| clarkb | git merge is probably not what you want | 05:13 |
| clarkb | because gerrit will refuse merge commits | 05:13 |
| slong | Yes, :), now I know that. | 05:13 |
| slong | The problem is, how to go forward. | 05:13 |
| slong | How do I convince gerrit that the files are no longer merged? | 05:14 |
| clarkb | ok. to untangle this I would `git checkout -b marker-branch ; git review -d 67763 ; git rebase master ; make local edits ; git commit -a --amend ; git review` | 05:14 |
| *** nati_ueno has joined #openstack-infra | 05:14 | |
| zaro | clarkb: what is a git-triggered job? https://review.openstack.org/#/c/65162 | 05:14 |
| clarkb | zaro: something not triggered by zuul | 05:15 |
| zaro | clarkb: using git-trigger plugin? | 05:15 |
| slong | thx clarkb, will try | 05:15 |
| clarkb | zaro: yeah | 05:16 |
| clarkb | zaro: it can poll a git repo iirc and if there are changes on a branch do stuff | 05:16 |
| *** nati_uen_ has quit IRC | 05:18 | |
| *** ok_delta__ has quit IRC | 05:18 | |
| *** ok_delta has quit IRC | 05:18 | |
| *** jcooley_ has joined #openstack-infra | 05:22 | |
| *** CaptTofu has quit IRC | 05:22 | |
| slong | clarkb, if rebase stutters, what's the command to say 'fine, use the master version'? (if I can't merge) | 05:22 |
| StevenK | slong: git rebase master should unapply your changes, update to master and then reapply your changes | 05:23 |
| slong | No, it hates me. | 05:23 |
| *** DinaBelova_ is now known as DinaBelova | 05:23 | |
| slong | CONFLICT (content): Merge conflict in doc/openstack-ops/bk_ops_guide.xml | 05:23 |
| slong | Failed to merge in the changes. | 05:23 |
| *** sarob has joined #openstack-infra | 05:24 | |
| slong | no worries, I'll pull a master copy out and paste in on top and see whether it can rebase that? | 05:25 |
| *** nicedice has quit IRC | 05:25 | |
| slong | Which feels wrong. | 05:26 |
| clarkb | slong: you can resolve the merge conflict in the rebase | 05:27 |
| clarkb | and you should | 05:27 |
| clarkb | the difference is there won't be a merge commit at the end of the rebase | 05:27 |
| *** vjay has joined #openstack-infra | 05:27 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 05:28 | |
| *** jcoufal-mobile_ has joined #openstack-infra | 05:28 | |
| slong | But this is what I did to begin with. During 'git review', the rebase conflict came up. I did a merge, and gerrit rejected it. | 05:28 |
| *** jcoufal-mobile has quit IRC | 05:28 | |
| clarkb | right you can't `git merge` | 05:29 |
| *** sarob has quit IRC | 05:29 | |
| clarkb | but you can `git rebase` the important difference between the two in this case is the lack of a merge commit when you git rebase | 05:29 |
| *** lcheng has quit IRC | 05:29 | |
| *** lcheng has joined #openstack-infra | 05:29 | |
| *** lcheng has quit IRC | 05:30 | |
| *** nati_ueno has quit IRC | 05:30 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: point zuul-dev to review-dev https://review.openstack.org/68271 | 05:30 |
| *** AlexF_ has quit IRC | 05:30 | |
| slong | So, clarkb, right now, after I've run 'git rebase master' and it's complained, I run 'git rebase' again? | 05:31 |
| StevenK | slong: Can you pastebin its output? | 05:31 |
| *** nati_ueno has joined #openstack-infra | 05:32 | |
| slong | sure, 2 secs | 05:32 |
| *** nati_ueno has quit IRC | 05:32 | |
| *** jcoufal-mobile_ has quit IRC | 05:32 | |
| *** jcoufal-mobile_ has joined #openstack-infra | 05:33 | |
| *** nati_ueno has joined #openstack-infra | 05:33 | |
| *** DinaBelova is now known as DinaBelova_ | 05:34 | |
| *** matsuhashi has quit IRC | 05:34 | |
| slong | http://pastebin.com/hCRnxM9P | 05:34 |
| *** matsuhashi has joined #openstack-infra | 05:35 | |
| *** nati_ueno has quit IRC | 05:35 | |
| slong | StevenK^^ | 05:35 |
| StevenK | slong: Right, so you should edit doc/openstack-ops/section_arch_example-nova.xml and doc/openstack-ops/bk_ops_guide.xml and fix the conflicts. Once you've done so, you should run 'git add .' and then 'git rebase --continue' | 05:36 |
| *** nati_ueno has joined #openstack-infra | 05:36 | |
| slong | Ok, it's just that you can't fix them using merge. | 05:36 |
| slong | ok, will do. | 05:36 |
| *** talluri has quit IRC | 05:36 | |
| *** jcoufal-mobile_ has quit IRC | 05:38 | |
| *** nosnos has quit IRC | 05:38 | |
| *** nati_uen_ has joined #openstack-infra | 05:38 | |
| *** wenlock has quit IRC | 05:39 | |
| *** DinaBelova_ is now known as DinaBelova | 05:40 | |
| *** nosnos has joined #openstack-infra | 05:41 | |
| *** nati_ueno has quit IRC | 05:41 | |
| *** mrda is now known as mrda_away | 05:41 | |
| *** jhesketh_ has quit IRC | 05:43 | |
| *** jcoufal-mobile_ has joined #openstack-infra | 05:44 | |
| *** jcoufal-mobile_ has quit IRC | 05:49 | |
| *** jcoufal-mobile_ has joined #openstack-infra | 05:49 | |
| *** paul-- has quit IRC | 05:50 | |
| *** jcooley_ has quit IRC | 05:50 | |
| *** talluri has joined #openstack-infra | 05:56 | |
| *** jcoufal-mobile_ has quit IRC | 05:56 | |
| *** DinaBelova is now known as DinaBelova_ | 05:59 | |
| *** VijayT has joined #openstack-infra | 06:01 | |
| *** nati_uen_ has quit IRC | 06:03 | |
| *** jcooley_ has joined #openstack-infra | 06:06 | |
| *** praneshp has quit IRC | 06:07 | |
| *** nati_ueno has joined #openstack-infra | 06:11 | |
| *** vkozhukalov has quit IRC | 06:13 | |
| *** talluri has quit IRC | 06:14 | |
| slong | StevenK, clarkb, finally got it to commit. Many thanks for your help :) | 06:14 |
| *** talluri has joined #openstack-infra | 06:15 | |
| *** talluri has quit IRC | 06:19 | |
| *** VijayT has quit IRC | 06:22 | |
| *** matsuhashi has quit IRC | 06:23 | |
| *** ryanpetrello has quit IRC | 06:23 | |
| *** talluri has joined #openstack-infra | 06:25 | |
| *** matsuhas_ has joined #openstack-infra | 06:25 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: replace jeepyb's trivial rebase gerrit hook with copyAllScoresOnTrivialRebase https://review.openstack.org/69800 | 06:26 |
| *** denis_makogon has joined #openstack-infra | 06:28 | |
| *** NikitaKonovalov_ is now known as NikitaKonovalov | 06:33 | |
| clarkb | vishy: I am so happy to know where AUDIT came from and that we can kill it | 06:38 |
| clarkb | that literally makes my evening | 06:38 |
| *** e0ne has joined #openstack-infra | 06:41 | |
| *** stevemar has quit IRC | 06:41 | |
| *** nati_ueno has quit IRC | 06:45 | |
| *** nati_ueno has joined #openstack-infra | 06:46 | |
| *** e0ne has quit IRC | 06:47 | |
| *** nati_ueno has quit IRC | 06:51 | |
| *** praneshp has joined #openstack-infra | 06:53 | |
| *** jcooley_ has quit IRC | 06:53 | |
| *** jcooley_ has joined #openstack-infra | 06:55 | |
| vishy | clarkb: kill it with fire! | 06:56 |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 06:58 | |
| *** AlexF_ has joined #openstack-infra | 07:03 | |
| *** kraman has quit IRC | 07:10 | |
| *** kraman has joined #openstack-infra | 07:11 | |
| *** kraman has quit IRC | 07:11 | |
| *** sdake has quit IRC | 07:14 | |
| *** yolanda_ has joined #openstack-infra | 07:14 | |
| *** lttrl has quit IRC | 07:17 | |
| *** coolsvap has joined #openstack-infra | 07:19 | |
| *** pblaho has joined #openstack-infra | 07:20 | |
| *** dstanek has quit IRC | 07:23 | |
| *** CaptTofu has joined #openstack-infra | 07:23 | |
| *** CaptTofu has quit IRC | 07:27 | |
| *** sdake has joined #openstack-infra | 07:36 | |
| *** alexpilotti has joined #openstack-infra | 07:38 | |
| *** kraman has joined #openstack-infra | 07:42 | |
| *** nsaje has joined #openstack-infra | 07:42 | |
| *** slong has quit IRC | 07:44 | |
| *** nsaje has quit IRC | 07:45 | |
| *** kraman has quit IRC | 07:46 | |
| *** rwsu has quit IRC | 07:46 | |
| *** masayukig has joined #openstack-infra | 07:46 | |
| *** praneshp has quit IRC | 07:46 | |
| *** flaper87|afk is now known as flaper87 | 07:47 | |
| *** paul-- has joined #openstack-infra | 07:47 | |
| *** rwsu has joined #openstack-infra | 07:50 | |
| *** vkozhukalov has joined #openstack-infra | 07:55 | |
| *** denis_makogon has quit IRC | 07:57 | |
| *** chandankumar_ has joined #openstack-infra | 07:59 | |
| *** DinaBelova_ is now known as DinaBelova | 08:00 | |
| *** emagana has joined #openstack-infra | 08:00 | |
| *** alexpilotti has quit IRC | 08:01 | |
| *** chandankumar_ has quit IRC | 08:03 | |
| *** chandankumar_ has joined #openstack-infra | 08:04 | |
| *** kraman has joined #openstack-infra | 08:08 | |
| *** DinaBelova is now known as DinaBelova_ | 08:12 | |
| *** kraman has quit IRC | 08:12 | |
| *** afazekas has joined #openstack-infra | 08:15 | |
| *** DinaBelova_ is now known as DinaBelova | 08:15 | |
| *** chandankumar_ has quit IRC | 08:15 | |
| *** sarob has joined #openstack-infra | 08:17 | |
| *** ken1ohmichi has quit IRC | 08:22 | |
| *** xBsd has joined #openstack-infra | 08:22 | |
| *** DinaBelova is now known as DinaBelova_ | 08:26 | |
| *** dcramer_ has quit IRC | 08:29 | |
| *** jcooley_ has quit IRC | 08:30 | |
| *** emagana has quit IRC | 08:33 | |
| *** DinaBelova_ is now known as DinaBelova | 08:38 | |
| *** amotoki has joined #openstack-infra | 08:39 | |
| *** dizquierdo has joined #openstack-infra | 08:39 | |
| *** chandankumar_ has joined #openstack-infra | 08:40 | |
| *** sarob has quit IRC | 08:44 | |
| *** sarob has joined #openstack-infra | 08:44 | |
| *** dcramer_ has joined #openstack-infra | 08:45 | |
| *** chandankumar_ has quit IRC | 08:46 | |
| *** sarob_ has joined #openstack-infra | 08:47 | |
| *** markmc has joined #openstack-infra | 08:48 | |
| *** sarob has quit IRC | 08:49 | |
| *** dstanek has joined #openstack-infra | 08:50 | |
| *** yassine has joined #openstack-infra | 08:50 | |
| *** AlexF_ has quit IRC | 08:50 | |
| *** paul-- has quit IRC | 08:51 | |
| *** paul-- has joined #openstack-infra | 08:52 | |
| *** dstanek has quit IRC | 08:54 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 08:56 | |
| *** hashar has joined #openstack-infra | 08:57 | |
| *** jpich has joined #openstack-infra | 09:02 | |
| *** matsuhas_ has quit IRC | 09:04 | |
| *** matsuhashi has joined #openstack-infra | 09:04 | |
| openstackgerrit | Joshua Harlow proposed a change to openstack/requirements: Unpin kazoo https://review.openstack.org/69815 | 09:07 |
| *** kraman has joined #openstack-infra | 09:08 | |
| *** kraman has quit IRC | 09:12 | |
| *** bookwar has joined #openstack-infra | 09:13 | |
| *** matsuhashi has quit IRC | 09:17 | |
| *** derekh has joined #openstack-infra | 09:18 | |
| *** matsuhashi has joined #openstack-infra | 09:19 | |
| *** jcooley_ has joined #openstack-infra | 09:21 | |
| *** CaptTofu has joined #openstack-infra | 09:24 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 09:25 | |
| *** jooools has joined #openstack-infra | 09:27 | |
| *** masayukig has quit IRC | 09:28 | |
| *** CaptTofu has quit IRC | 09:28 | |
| *** e0ne has joined #openstack-infra | 09:30 | |
| *** ociuhandu has joined #openstack-infra | 09:32 | |
| *** coolsvap_away has joined #openstack-infra | 09:33 | |
| *** ociuhandu has quit IRC | 09:34 | |
| *** coolsvap has quit IRC | 09:34 | |
| *** dizquierdo has quit IRC | 09:35 | |
| *** hemanth_ has quit IRC | 09:35 | |
| *** BobBallAway has quit IRC | 09:35 | |
| *** BobBallAway has joined #openstack-infra | 09:35 | |
| *** hemanth has joined #openstack-infra | 09:36 | |
| *** johnthetubaguy has joined #openstack-infra | 09:36 | |
| *** jcooley_ has quit IRC | 09:37 | |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/config: Updated the logs directory for tripleo jobs https://review.openstack.org/69824 | 09:37 |
| *** NikitaKonovalov is now known as NikitaKonovalov_ | 09:40 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 09:41 | |
| *** emagana has joined #openstack-infra | 09:44 | |
| *** coolsvap has joined #openstack-infra | 09:45 | |
| *** coolsvap_away has quit IRC | 09:48 | |
| *** emagana has quit IRC | 09:48 | |
| *** matsuhashi has quit IRC | 09:51 | |
| *** nosnos has quit IRC | 09:51 | |
| *** e0ne_ has joined #openstack-infra | 09:53 | |
| *** DinaBelova is now known as DinaBelova_ | 09:54 | |
| *** e0ne has quit IRC | 09:56 | |
| *** DinaBelova_ is now known as DinaBelova | 09:56 | |
| *** kraman has joined #openstack-infra | 10:08 | |
| *** jcooley_ has joined #openstack-infra | 10:09 | |
| *** svij has joined #openstack-infra | 10:09 | |
| svij | Hey, anyone around here, who can help me with my jenkins jclouds setup? I'm trying to specify my Image ID like this "regionOne/6b538071-b0a0-48ed-a82f-1c2711856d08". The error message is: "Unable to check the image id, please check if the credentials you provided are correct." but the credentials are correct | 10:10 |
| svij | any ideas? (I'm using jclouds plugin 1.4.1 with openstack havana) | 10:11 |
| *** kraman has quit IRC | 10:12 | |
| *** SnowDust has joined #openstack-infra | 10:13 | |
| *** jcooley_ has quit IRC | 10:15 | |
| *** e0ne_ has quit IRC | 10:15 | |
| *** che-arne has joined #openstack-infra | 10:15 | |
| *** e0ne has joined #openstack-infra | 10:15 | |
| *** jooools has quit IRC | 10:15 | |
| openstackgerrit | Lukas Bednar proposed a change to openstack-infra/jenkins-job-builder: scms: MultiSCM is generated for scms hidden in macro https://review.openstack.org/69827 | 10:18 |
| *** e0ne has quit IRC | 10:18 | |
| *** e0ne has joined #openstack-infra | 10:19 | |
| *** jooools has joined #openstack-infra | 10:19 | |
| *** gema has quit IRC | 10:19 | |
| openstackgerrit | Ruslan Kamaldinov proposed a change to openstack-infra/config: Update Storyboard jobs https://review.openstack.org/69204 | 10:20 |
| *** NikitaKonovalov_ is now known as NikitaKonovalov | 10:23 | |
| *** e0ne_ has joined #openstack-infra | 10:26 | |
| *** e0ne has quit IRC | 10:26 | |
| *** sarob_ has quit IRC | 10:30 | |
| *** max_lobur_afk is now known as max_lobur | 10:30 | |
| *** sarob has joined #openstack-infra | 10:31 | |
| *** dizquierdo has joined #openstack-infra | 10:33 | |
| *** sarob has quit IRC | 10:36 | |
| *** gema has joined #openstack-infra | 10:36 | |
| *** iv_m has joined #openstack-infra | 10:37 | |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Add oslo fixture module and update everything else https://review.openstack.org/69830 | 10:38 |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Database fixture added https://review.openstack.org/69384 | 10:39 |
| *** miguitas has joined #openstack-infra | 10:42 | |
| *** miguitas has left #openstack-infra | 10:42 | |
| *** e0ne has joined #openstack-infra | 10:44 | |
| *** BobBallAway is now known as BobBall | 10:47 | |
| *** jamielennox is now known as jamielennox|away | 10:48 | |
| *** e0ne_ has quit IRC | 10:48 | |
| *** BobBall is now known as Guest22890 | 10:48 | |
| *** hashar has quit IRC | 10:49 | |
| *** hashar has joined #openstack-infra | 10:50 | |
| *** Guest22890 is now known as BobBall | 10:50 | |
| *** e0ne has quit IRC | 10:51 | |
| *** talluri has quit IRC | 10:54 | |
| *** vjay has quit IRC | 10:54 | |
| *** talluri has joined #openstack-infra | 10:56 | |
| *** vjay has joined #openstack-infra | 11:01 | |
| SergeyLukjanov | lifeless, ping | 11:07 |
| SergeyLukjanov | lifeless, looks like latest testools changes breaks subunit | 11:08 |
| *** kraman has joined #openstack-infra | 11:08 | |
| SergeyLukjanov | lifeless, http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOiBcIkltcG9ydEVycm9yOiBjYW5ub3QgaW1wb3J0IG5hbWUgYWxsXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjkwMCIsImdyYXBobW9kZSI6ImNvdW50IiwidGltZSI6eyJ1c2VyX2ludGVydmFsIjowfSwic3RhbXAiOjEzOTA5OTMwMjU5MDF9 | 11:08 |
| SergeyLukjanov | lifeless, http://logs.openstack.org/96/69496/1/gate/gate-requirements-python27/13291f7/console.html#_2014-01-29_10_48_53_039 | 11:09 |
| DinaBelova | SergeyLukjanov, lifeless - or otherwise, new (today) subunit uses smth from testools that's not currently there | 11:09 |
| SergeyLukjanov | lifeless, it was broken by https://github.com/testing-cabal/testtools/commit/deedadf3750c16c2f26c5680a158ac96ca10ccd6 | 11:09 |
| *** bauzas has joined #openstack-infra | 11:10 | |
| *** kraman has quit IRC | 11:12 | |
| *** lcestari has joined #openstack-infra | 11:13 | |
| iv_m | SergeyLukjanov, DinaBelova -- it's testtools, pinning them to 0.9.34 (previous version) helps | 11:13 |
| SergeyLukjanov | iv_m, it couldn't be merged due to the glabel res :) | 11:14 |
| SergeyLukjanov | reqs* | 11:14 |
| SergeyLukjanov | lifeless, btw bug for it https://bugs.launchpad.net/subunit/+bug/1274056 | 11:14 |
| DinaBelova | iv_m, yep... that helps testing itself, but it won't pass because of global reqs | 11:14 |
| iv_m | is anybody submitting change to global reqs? ;) | 11:15 |
| *** coolsvap has quit IRC | 11:15 | |
| DinaBelova | iv_m, no, I mean that we may force 0.9.34 by setting <=0.9.34 in reqs of project | 11:15 |
| *** kraman has joined #openstack-infra | 11:16 | |
| DinaBelova | but that is not global reqs line for testtools | 11:16 |
| SergeyLukjanov | iv_m, it could be easily fixed in subunit, but we'll need new release, I don't think that it's a good idea to limit subunit version | 11:16 |
| *** xBsd has quit IRC | 11:18 | |
| *** ArxCruz has joined #openstack-infra | 11:19 | |
| *** kraman has quit IRC | 11:20 | |
| *** zul has quit IRC | 11:20 | |
| *** bookwar has quit IRC | 11:23 | |
| jd__ | ah, I was about to report the same things | 11:23 |
| jd__ | lifeless: ^ | 11:23 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack/requirements: Temporary fix testtols version to unblock gate https://review.openstack.org/69840 | 11:23 |
| SergeyLukjanov | probably, it could a good solution to unblock the gate before lifeless will be able to release fixed version | 11:24 |
| SergeyLukjanov | jd__, sdague, ^^ | 11:24 |
| *** zul has joined #openstack-infra | 11:24 | |
| *** CaptTofu has joined #openstack-infra | 11:25 | |
| *** vjay has quit IRC | 11:29 | |
| *** CaptTofu has quit IRC | 11:30 | |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/elastic-recheck: Add fingerprint for bug 1274056 https://review.openstack.org/69841 | 11:36 |
| *** tristanC has quit IRC | 11:36 | |
| *** tristanC has joined #openstack-infra | 11:36 | |
| *** rossella_s has joined #openstack-infra | 11:37 | |
| *** e0ne has joined #openstack-infra | 11:39 | |
| hashar | hi! | 11:39 |
| sdague | SergeyLukjanov: oh wow | 11:39 |
| *** DinaBelova is now known as DinaBelova_ | 11:40 | |
| hashar | was wondering whether you guys considered moving out of Launchpad ? I know ttx started a new project Storyboard but it does not seem to be very active. | 11:40 |
| *** e0ne has quit IRC | 11:40 | |
| *** e0ne has joined #openstack-infra | 11:41 | |
| *** e0ne has quit IRC | 11:42 | |
| *** e0ne has joined #openstack-infra | 11:42 | |
| *** bookwar has joined #openstack-infra | 11:43 | |
| sdague | hashar: there are actually a bunch of folks working on storyboard now | 11:43 |
| SergeyLukjanov | sdague, heh, fingerprint for a bug couldn't be merged due to the bug :) | 11:43 |
| hashar | sdague: Wikimedia is investigating replacing our various tools with a single one (graal of IT). | 11:44 |
| sdague | heh | 11:44 |
| *** DinaBelova_ is now known as DinaBelova | 11:44 | |
| SergeyLukjanov | sdague, http://logs.openstack.org/41/69841/1/check/gate-elastic-recheck-python27/9783754/console.html - Add fingerprint for bug 1274056 https://review.openstack.org/69841 | 11:44 |
| iv_m | SergeyLukjanov: lol | 11:44 |
| sdague | SergeyLukjanov: you want to propose the pin in requirements at the same time there? | 11:44 |
| *** rlandy has joined #openstack-infra | 11:44 | |
| SergeyLukjanov | sdague, it's a bad temp solution, but I don't see the other solutions | 11:45 |
| sdague | SergeyLukjanov: actually, can you update - https://review.openstack.org/#/c/69840/1 to also pin it's requirements? | 11:45 |
| sdague | otherwise it might not pass | 11:45 |
| SergeyLukjanov | sdague, yup, will do | 11:45 |
| sdague | yeh, it's passing it's unit tests | 11:45 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack/requirements: Temporary fix testtols version to unblock gate https://review.openstack.org/69840 | 11:46 |
| SergeyLukjanov | sdague, done | 11:46 |
| *** rfolco has joined #openstack-infra | 11:47 | |
| SergeyLukjanov | sdague, I'm not sure that it's a good enough solution, otherwise we should wait for lifeless | 11:47 |
| *** e0ne has quit IRC | 11:47 | |
| hashar | sdague: found out there is a StoryBoard 2 days sprint starting tomorrow in Bruxelles (aka pre Fosdem) | 11:47 |
| sdague | yep | 11:47 |
| SergeyLukjanov | hashar, correct | 11:47 |
| hashar | such a pity I can't go there this year :( | 11:48 |
| sdague | SergeyLukjanov: so if lifeless isn't on now, we're going to be waiting about 8+ hrs for him | 11:48 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/elastic-recheck: Add fingerprint for bug 1274056 https://review.openstack.org/69841 | 11:48 |
| SergeyLukjanov | sdague, yup, he's living in US? | 11:48 |
| sdague | SergeyLukjanov: New Zealand | 11:49 |
| sdague | so now is his evening | 11:49 |
| SergeyLukjanov | sdague, oh | 11:49 |
| *** DinaBelova is now known as DinaBelova_ | 11:49 | |
| SergeyLukjanov | sdague, looks like we geting the new traffic jam in gate | 11:50 |
| *** CaptTofu has joined #openstack-infra | 11:50 | |
| sdague | yep | 11:51 |
| *** katyafervent is now known as katyafervent_awa | 11:52 | |
| hashar | I had some jobs failing on Zuul repo earlier today | 11:53 |
| hashar | same issue as https://jenkins02.openstack.org/job/gate-requirements-python27/1076/console | 11:53 |
| hashar | from testtools.compat import all | 11:53 |
| hashar | ImportError: cannot import name all | 11:53 |
| sdague | hashar: yeh, that's what the scrollback is about | 11:53 |
| *** dstanek has joined #openstack-infra | 11:53 | |
| hashar | oops sorry | 11:53 |
| sdague | no worries | 11:54 |
| sdague | hashar: which TZ you in? | 11:55 |
| hashar | France, thus GMT+1 rightnow | 11:55 |
| *** jcooley_ has joined #openstack-infra | 11:58 | |
| *** dstanek has quit IRC | 11:59 | |
| sdague | cool | 11:59 |
| *** vjay has joined #openstack-infra | 12:00 | |
| SergeyLukjanov | sdague, where are you from? I see you always online in this time | 12:00 |
| sdague | East Coast US | 12:00 |
| sdague | but I'm a morning person | 12:00 |
| SergeyLukjanov | sdague, oh, interesting :) | 12:00 |
| sdague | and work from home | 12:00 |
| SnowDust | sdague : https://review.openstack.org/#/c/69826/ | 12:01 |
| sdague | so I usually just git on once the coffee pot is started | 12:01 |
| sdague | SnowDust: looking | 12:01 |
| SnowDust | hmm .. thx ! | 12:01 |
| hashar | I like US east coasters, we have a nice timezone overlap with Europe | 12:01 |
| SnowDust | hashar : what font zone are u in LOL ! | 12:02 |
| sdague | SnowDust: is there a trove test in the gate somewhere that would have caught this? | 12:03 |
| SnowDust | sdague: let me see ... :) | 12:03 |
| SergeyLukjanov | hashar, yup east cost tz overlap is much better :) | 12:05 |
| SergeyLukjanov | hashar, I'm UTC+4, so, it's especially important for me :) | 12:05 |
| hashar | my team has folks in San Francisco (GMT-7), UK (GMT) and Sidney (GMT+11) | 12:06 |
| sdague | yeh, that's just brutal :) | 12:06 |
| hashar | with DST kicking of at different time :-D | 12:06 |
| StevenK | hashar: Sydney doesn't have an i :-) | 12:07 |
| hashar | so Australia and Europe can have 8 or 10 hours of difference | 12:07 |
| hashar | sometime 9 | 12:07 |
| hashar | StevenK: thanks :] | 12:07 |
| StevenK | I'm a Sydneysider, FWIW | 12:08 |
| *** kraman has joined #openstack-infra | 12:08 | |
| sdague | I really need to get back to sydney | 12:08 |
| *** jcooley_ has quit IRC | 12:08 | |
| sdague | I was there for 2 months working on the olympics back in 2000. lots of fond memories | 12:09 |
| openstackgerrit | Tom Fifield proposed a change to openstack-infra/config: Add de and ko_kr builds for install guide https://review.openstack.org/69848 | 12:10 |
| *** kraman has quit IRC | 12:12 | |
| *** yaguang has quit IRC | 12:12 | |
| sdague | I'm also sufficiently confused, the github source tree for testtools is 2 months old | 12:14 |
| SergeyLukjanov | sdague, it was broken by 2 month old commit | 12:14 |
| SergeyLukjanov | sdague, https://github.com/testing-cabal/testtools/commit/deedadf3750c16c2f26c5680a158ac96ca10ccd6 | 12:14 |
| SergeyLukjanov | sdague, but it was released (0.9.35) today | 12:15 |
| *** yamahata has quit IRC | 12:15 | |
| *** yaguang has joined #openstack-infra | 12:15 | |
| sdague | ok | 12:15 |
| *** jamielennox|away has quit IRC | 12:15 | |
| sdague | yeh, so in 2 hrs, when fungi is online, someone can ask him to remove testtools from the mirror | 12:17 |
| *** malini_afk is now known as malini | 12:17 | |
| *** talluri has quit IRC | 12:19 | |
| hashar | do you have any issue # we can refer fungi too ? | 12:19 |
| *** jamielennox|away has joined #openstack-infra | 12:19 | |
| hashar | too/to | 12:19 |
| dims | hashar, https://bugs.launchpad.net/subunit/+bug/1274056 | 12:19 |
| *** talluri has joined #openstack-infra | 12:19 | |
| * hashar subscribes | 12:19 | |
| hashar | thank you dims | 12:19 |
| *** DinaBelova_ is now known as DinaBelova | 12:23 | |
| SergeyLukjanov | oh, bazaar makes me crazy | 12:23 |
| *** talluri has quit IRC | 12:23 | |
| SergeyLukjanov | sdague, https://review.openstack.org/#/c/69841/ passed check jobs | 12:25 |
| SergeyLukjanov | sdague, (fingerprint) | 12:25 |
| sdague | SergeyLukjanov: thanks | 12:26 |
| sdague | SergeyLukjanov: agree, bzr really needs to diaf | 12:26 |
| *** max_lobur is now known as max_lobur_afk | 12:27 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add fingerprint for bug 1274056 https://review.openstack.org/69841 | 12:28 |
| *** CaptTofu has quit IRC | 12:28 | |
| SergeyLukjanov | sdague, heh, looks like we'll probably wait for a long time before testtools version fix will be merged | 12:30 |
| *** e0ne has joined #openstack-infra | 12:30 | |
| *** e0ne has quit IRC | 12:36 | |
| *** smarcet has joined #openstack-infra | 12:38 | |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Add support to list running jobs to zuul client https://review.openstack.org/68828 | 12:40 |
| *** e0ne has joined #openstack-infra | 12:41 | |
| *** e0ne has quit IRC | 12:45 | |
| *** yassine has quit IRC | 12:47 | |
| *** yassine has joined #openstack-infra | 12:48 | |
| *** yassine has quit IRC | 12:48 | |
| sdague | SergeyLukjanov: http://status.openstack.org/elastic-recheck/ - your fingerprint just hit | 12:48 |
| sdague | current #2 bug in last 24 hrs | 12:48 |
| *** yassine has joined #openstack-infra | 12:48 | |
| *** yassine has quit IRC | 12:48 | |
| sdague | I'm sure that will change in the next hr | 12:48 |
| *** yassine has joined #openstack-infra | 12:49 | |
| *** yassine has quit IRC | 12:49 | |
| SergeyLukjanov | sdague, heh - 203 fails in 24hrs / 248 fails in 7 days | 12:49 |
| sdague | yeh, it also makes a good case for the hacking rule about not importing modules. There are so many compat import layers inside of testtools, that this just got lost | 12:53 |
| sdague | SergeyLukjanov: have you done a pull request on testtools? | 12:53 |
| sdague | for the root issue? | 12:54 |
| SergeyLukjanov | sdague, it was done by dims | 12:54 |
| sdague | ok, great | 12:54 |
| *** mriedem has joined #openstack-infra | 12:54 | |
| sdague | dims: thanks! | 12:54 |
| iv_m | sdague: isn't that subunit what should be fixed? or both? | 12:55 |
| SergeyLukjanov | sdague, and it should be fixed in subunit | 12:55 |
| *** jcooley_ has joined #openstack-infra | 12:55 | |
| SergeyLukjanov | sdague, https://code.launchpad.net/~subunit/subunit/trunk/+merge/203723 | 12:55 |
| sdague | oh | 12:55 |
| sdague | sigh, bzr | 12:56 |
| SergeyLukjanov | sdague, exactly | 12:56 |
| SergeyLukjanov | sdague, oh, I find a diff in it - http://bazaar.launchpad.net/~dims-v/subunit/compat-break/revision/239 | 12:59 |
| *** CaptTofu has joined #openstack-infra | 12:59 | |
| *** chandankumar_ has joined #openstack-infra | 13:01 | |
| *** prad has joined #openstack-infra | 13:01 | |
| *** yassine has joined #openstack-infra | 13:05 | |
| *** chandankumar_ has quit IRC | 13:05 | |
| *** yamahata has joined #openstack-infra | 13:07 | |
| *** chandankumar_ has joined #openstack-infra | 13:07 | |
| *** oubiwann_ has joined #openstack-infra | 13:07 | |
| *** paul--_ has joined #openstack-infra | 13:07 | |
| *** jp_at_hp has joined #openstack-infra | 13:07 | |
| *** david-lyle has quit IRC | 13:08 | |
| *** kraman has joined #openstack-infra | 13:08 | |
| *** jcooley_ has quit IRC | 13:09 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: last 24hr count needs to be failures only https://review.openstack.org/69858 | 13:09 |
| sdague | SergeyLukjanov: want to sanity check that ^^^^ | 13:10 |
| *** paul-- has quit IRC | 13:10 | |
| sdague | it will be a bit before jog0 or mtreinish are up, so I'd just like a second set of eyes before pushing through | 13:10 |
| SergeyLukjanov | sdague, looking on it now | 13:11 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: it's actually 14 days https://review.openstack.org/69859 | 13:12 |
| *** kraman has quit IRC | 13:12 | |
| dims | iv_m, SergeyLukjanov is right. unnecessary code was taken out in testtools, so we have to fix subunit | 13:13 |
| *** russellb_ has joined #openstack-infra | 13:13 | |
| *** paul--_ has quit IRC | 13:13 | |
| russellb_ | lifeless: looks like testtools release causing all the tempest jobs to fail? | 13:13 |
| SergeyLukjanov | dims, the funny thing is that it was unnecessary code in subunit too | 13:13 |
| SergeyLukjanov | russellb_, yup | 13:14 |
| SergeyLukjanov | russellb_, you can find a lot of details in scroll :) | 13:14 |
| russellb_ | k, will get back to my other irc client and read scrollback heh | 13:14 |
| sdague | :) | 13:14 |
| SergeyLukjanov | russellb_, https://bugs.launchpad.net/subunit/+bug/1274056 bug for it in subunit where it should be fixed | 13:14 |
| russellb_ | feel like we just can't win ... poor gate. | 13:15 |
| SergeyLukjanov | and fix for it https://code.launchpad.net/~subunit/subunit/trunk/+merge/203723 | 13:15 |
| sdague | yeh, we've been trying to find lifeless, but it looks like he went offline 3hrs ago | 13:15 |
| russellb_ | pin in the meantime? | 13:15 |
| SergeyLukjanov | russellb_, https://review.openstack.org/#/c/69840/ | 13:15 |
| dims | SergeyLukjanov, :) | 13:15 |
| sdague | russellb_: yeh, it's in the gate | 13:15 |
| sdague | but... needs a promote | 13:15 |
| * russellb_ nods | 13:15 | |
| russellb_ | thanks for the tl;dr :) | 13:16 |
| SergeyLukjanov | np ;) | 13:16 |
| sdague | russellb_: also, there is a new nova bug | 13:16 |
| sdague | https://review.openstack.org/#/c/69773/ | 13:16 |
| russellb_ | just what i like to hear | 13:16 |
| russellb_ | brb | 13:16 |
| *** russellb_ has quit IRC | 13:16 | |
| SergeyLukjanov | and probably we'll need to ask infra guys to remove the 0.9.35 testtools from mirror to make things working for all projects | 13:16 |
| *** yamahata has quit IRC | 13:17 | |
| mriedem | SergeyLukjanov: the global requirements change should propagate to all projects once it merges | 13:17 |
| mriedem | so the other projects should be ok | 13:17 |
| sdague | mriedem: as long as it's not tickled in unit tests | 13:17 |
| russellb | sdague: was that bug happening everywhere? | 13:19 |
| russellb | curious why it was approved after a single check run | 13:19 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: last 24hr count needs to be failures only https://review.openstack.org/69858 | 13:20 |
| *** jcoufal-mobile has joined #openstack-infra | 13:22 | |
| *** jcoufal-mobile has quit IRC | 13:22 | |
| *** AlexF_ has joined #openstack-infra | 13:22 | |
| *** oubiwann_ has quit IRC | 13:25 | |
| sdague | russellb: http://status.openstack.org/elastic-recheck/ - Bug 1273556 | 13:26 |
| *** vkozhukalov has quit IRC | 13:26 | |
| russellb | yeah was just looking at it, nasty | 13:26 |
| sdague | basically because it was so sudden, with such a discrete onset, which was about the same time as that patch landed, the chance that it was the cause seemed pretty high | 13:27 |
| *** oubiwann_ has joined #openstack-infra | 13:27 | |
| sdague | that bug is actually why the gate is 17hrs deep | 13:27 |
| russellb | yep, ok | 13:27 |
| SergeyLukjanov | sdague, could you, please, take a look on async gating jobs for savanna when you have some time - https://review.openstack.org/#/c/68066/ | 13:28 |
| sdague | SergeyLukjanov: sure | 13:30 |
| *** chandankumar_ has quit IRC | 13:30 | |
| *** talluri has joined #openstack-infra | 13:30 | |
| ArxCruz | jeblair: around ? | 13:30 |
| *** e0ne has joined #openstack-infra | 13:31 | |
| SergeyLukjanov | sdague, thx | 13:32 |
| *** dcramer_ has quit IRC | 13:33 | |
| *** sandywalsh has quit IRC | 13:37 | |
| *** freyes has joined #openstack-infra | 13:38 | |
| *** vkozhukalov has joined #openstack-infra | 13:39 | |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/storyboard: Temporary fix testtols version to unblock gate https://review.openstack.org/69860 | 13:43 |
| *** dkranz has joined #openstack-infra | 13:44 | |
| fungi | sdague: okay, testtools upgrade is breaking things? | 13:44 |
| sdague | yep | 13:44 |
| fungi | is there an upstream bug? | 13:44 |
| sdague | fungi: even an upstream patch | 13:45 |
| sdague | fungi: promote on 69840 should aleviate | 13:45 |
| sdague | and if you are doing a promote, 69773 should go as well | 13:46 |
| sdague | as that was the #1 gate bug yesterday | 13:46 |
| fungi | i've removed testtools-0.9.35.tar.gz from the openstack mirror | 13:46 |
| sdague | fungi: ok | 13:46 |
| fungi | promoting 69840 and 69773 | 13:46 |
| *** che-arne|2 has joined #openstack-infra | 13:47 | |
| *** che-arne has quit IRC | 13:48 | |
| sdague | so... thought, could we change the mirror and nodepool rebuild job to happen during a window of time when an infra person might be around? Like 1400 UTC | 13:48 |
| SergeyLukjanov | fungi, morning | 13:48 |
| sdague | then we could recover a little quicker if things go wrong | 13:49 |
| *** jcooley_ has joined #openstack-infra | 13:49 | |
| *** sandywalsh has joined #openstack-infra | 13:49 | |
| *** che-arne|2 is now known as che-arne | 13:49 | |
| fungi | sdague: and defer any on-demand refreshes as well, presumably | 13:50 |
| sdague | yep | 13:50 |
| fungi | (which currently happen on merges to openstack/requirements or when anybody releases just about anything) | 13:50 |
| fungi | i think the latter would either require a patch to zuul or removing all the on-demand refresh jobs | 13:51 |
| *** chandankumar_ has joined #openstack-infra | 13:51 | |
| *** dkranz has quit IRC | 13:51 | |
| *** chandankumar_ has quit IRC | 13:51 | |
| fungi | particularly since we can't control the merge timeframe for changes | 13:51 |
| sdague | yeh, fair | 13:51 |
| *** dkranz has joined #openstack-infra | 13:51 | |
| *** thuc has joined #openstack-infra | 13:51 | |
| sdague | though requirements is small enough job | 13:52 |
| sdague | that if we block that, it's not a big deal | 13:52 |
| sdague | oh, you are saying the requirements merge triggers mirror refresh? | 13:52 |
| *** julim has joined #openstack-infra | 13:52 | |
| fungi | yes | 13:53 |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Limit testtools verion https://review.openstack.org/69866 | 13:53 |
| sdague | gotcha | 13:53 |
| sdague | I am so not looking forward to the run up to pycon | 13:53 |
| sdague | while i3 is being prepped | 13:53 |
| fungi | anyway, i think it'll still be a few minutes until zuul is done processing the current gate reset avalanche, but the promote is in the event queue hopper waiting for zuu to see it | 13:54 |
| sdague | cool, thank you | 13:55 |
| *** dizquierdo has quit IRC | 13:57 | |
| *** yamahata has joined #openstack-infra | 13:57 | |
| *** jcooley_ has quit IRC | 13:58 | |
| fungi | sdague: i'm seeing jobs since clearing the new testtools (i think) failing with "tox.ConfigError: ConfigError: substitution key 'posargs' not found" | 14:00 |
| *** iv_m has quit IRC | 14:01 | |
| sdague | fungi: well... that I don't know | 14:02 |
| fungi | oh, and here's one with "pkg_resources.DistributionNotFound: virtualenv>=1.11.2" | 14:02 |
| fungi | i wonder if we got new tox and virtualenv releases today | 14:02 |
| *** dprince has joined #openstack-infra | 14:03 | |
| fungi | nah, virtualenv 1.11.2 was three days ago | 14:03 |
| *** AlexF_ has quit IRC | 14:04 | |
| fungi | aha! tox 1.7.0 today | 14:04 |
| sdague | oh ffs | 14:04 |
| fungi | this does not bode well for me getting caught up on reviews | 14:04 |
| *** zehicle has joined #openstack-infra | 14:05 | |
| sdague | yeh, seriously. Well I need to do some chartware anyway, I guess today is as good a day as any | 14:05 |
| *** kraman has joined #openstack-infra | 14:08 | |
| *** zehicle_at_dell has quit IRC | 14:08 | |
| SergeyLukjanov | heh, we have one more gate blocker?:( | 14:09 |
| *** zehicle has quit IRC | 14:09 | |
| fungi | i guess this is the changelog entry where it says "rework and simplify 'commands' parsing and in particular posargs substitutions to avoid various win32/posix related quoting issues" | 14:10 |
| SergeyLukjanov | fungi, yup, looks so | 14:11 |
| SergeyLukjanov | I'm looking on the diff now | 14:11 |
| sdague | fungi: so can you block tox at the mirror? | 14:12 |
| fungi | i have a feeling the solution is going to involve patches to every project | 14:12 |
| *** CaptTofu has quit IRC | 14:12 | |
| fungi | sdague: no, i think we'll need to control it via puppet | 14:12 |
| *** kraman has quit IRC | 14:12 | |
| sdague | gotch | 14:12 |
| SergeyLukjanov | fungi, looks like we'll need to replace {posargs} with something else | 14:13 |
| *** afazekas has quit IRC | 14:13 | |
| SergeyLukjanov | fungi, https://testrun.org/tox/latest/example/general.html?highlight=posargs | 14:14 |
| fungi | i suspect so. gonna grab a cup of coffee first. once again i looked in irc too early | 14:14 |
| sdague | ok, well I'm going to go hide from irc for a while. | 14:16 |
| fungi | sdague: i recommend it | 14:16 |
| openstackgerrit | Mate Lakat proposed a change to openstack-infra/config: XenServer installer script https://review.openstack.org/60581 | 14:18 |
| openstackgerrit | Mate Lakat proposed a change to openstack-infra/config: XenServer installer script https://review.openstack.org/60581 | 14:19 |
| *** ryanpetrello has joined #openstack-infra | 14:21 | |
| *** max_lobur_afk is now known as max_lobur | 14:23 | |
| *** afrittoli has joined #openstack-infra | 14:24 | |
| fungi | i have a tox pinning patch ready to push for review, but am opening an infra bug for this first so i can refer to it in the commit log | 14:24 |
| fungi | #status alert most tests are failing as a result of new tox and testtools releases--investigation in progress | 14:25 |
| openstackstatus | NOTICE: most tests are failing as a result of new tox and testtools releases--investigation in progress | 14:25 |
| *** ChanServ changes topic to "most tests are failing as a result of new tox and testtools releases--investigation in progress" | 14:25 | |
| ewindisch | ping again on getting a service account - https://bugs.launchpad.net/openstack-ci/+bug/1273264 | 14:26 |
| *** afazekas has joined #openstack-infra | 14:28 | |
| *** sdake has quit IRC | 14:28 | |
| *** sdake has joined #openstack-infra | 14:28 | |
| openstackgerrit | Mate Lakat proposed a change to openstack-infra/config: XenServer installer script https://review.openstack.org/60581 | 14:29 |
| *** dizquierdo has joined #openstack-infra | 14:30 | |
| *** yamahata has quit IRC | 14:30 | |
| *** markmcclain has joined #openstack-infra | 14:31 | |
| *** thuc has quit IRC | 14:32 | |
| *** thuc has joined #openstack-infra | 14:33 | |
| *** markmcclain1 has joined #openstack-infra | 14:33 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Temporarily pin tox<=1.6.1 https://review.openstack.org/69872 | 14:34 |
| fungi | clarkb: when you wake up, that ^ is going to require a rebase of your slave puppetry refactoring | 14:34 |
| *** CaptTofu has joined #openstack-infra | 14:34 | |
| *** mfink has joined #openstack-infra | 14:35 | |
| *** markmcclain has quit IRC | 14:35 | |
| *** DinaBelova is now known as DinaBelova_ | 14:37 | |
| fungi | #status alert most tests are failing as a result of new tox and testtools releases (bug 1274135, in progress) | 14:37 |
| openstackstatus | NOTICE: most tests are failing as a result of new tox and testtools releases (bug 1274135, in progress) | 14:37 |
| *** ChanServ changes topic to "most tests are failing as a result of new tox and testtools releases (bug 1274135, in progress)" | 14:37 | |
| *** thuc has quit IRC | 14:37 | |
| zul | is there a way to get testr to behave like a nose output, (ie printing if the test failed or not?) | 14:38 |
| *** DinaBelova_ is now known as DinaBelova | 14:39 | |
| *** yamahata has joined #openstack-infra | 14:39 | |
| openstackgerrit | A change was merged to openstack-infra/config: Temporarily pin tox<=1.6.1 https://review.openstack.org/69872 | 14:40 |
| fungi | zul: you need some sort of a filter to process the subunit stream. i think nova's run_tests.sh pipes it through something which does that | 14:41 |
| zul | fungi: cool thanks | 14:42 |
| *** e0ne_ has joined #openstack-infra | 14:44 | |
| *** yamahata has quit IRC | 14:45 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 14:46 | |
| *** e0ne has quit IRC | 14:46 | |
| *** burt1 has joined #openstack-infra | 14:47 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov_ | 14:47 | |
| *** dkliban has joined #openstack-infra | 14:47 | |
| *** freyes has quit IRC | 14:48 | |
| *** chandankumar_ has joined #openstack-infra | 14:48 | |
| *** lcheng has joined #openstack-infra | 14:48 | |
| *** oubiwann_ has quit IRC | 14:49 | |
| *** yamahata has joined #openstack-infra | 14:49 | |
| *** dkliban is now known as dkliban_afk | 14:49 | |
| *** dkliban_afk is now known as dkliban | 14:49 | |
| *** vkozhukalov has quit IRC | 14:49 | |
| *** dstanek has joined #openstack-infra | 14:50 | |
| *** jnoller has joined #openstack-infra | 14:50 | |
| *** jgrimm has quit IRC | 14:50 | |
| *** chandankumar_ has quit IRC | 14:51 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 14:53 | |
| fungi | gr... http://paste.openstack.org/show/62102/ | 14:53 |
| *** chandankumar_ has joined #openstack-infra | 14:53 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 14:53 | |
| fungi | anybody remember how to convince pip ^ to downgrade things? | 14:53 |
| *** oubiwann_ has joined #openstack-infra | 14:54 | |
| *** dcramer_ has joined #openstack-infra | 14:55 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov_ | 14:55 | |
| *** chandankumar_ has quit IRC | 14:57 | |
| *** chandankumar_ has joined #openstack-infra | 14:58 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 14:59 | |
| SergeyLukjanov | fungi, uninstall - install? | 15:01 |
| fungi | SergeyLukjanov: tried... i think it's finding previous downloads in its cache | 15:01 |
| fungi | gonna try clearing them from there next | 15:02 |
| SergeyLukjanov | fungi, probably you need to remove -U flag | 15:02 |
| *** chandankumar_ has quit IRC | 15:02 | |
| SergeyLukjanov | it could not work with fixed versions | 15:02 |
| *** vkozhukalov has joined #openstack-infra | 15:03 | |
| SergeyLukjanov | I mean that it probably doesn't work correctly with fixed versin | 15:03 |
| *** bauzas has quit IRC | 15:03 | |
| *** yaguang has quit IRC | 15:03 | |
| *** SnowDust has quit IRC | 15:03 | |
| *** chandankumar_ has joined #openstack-infra | 15:03 | |
| fungi | also tried without -U after uninstalling and it's still installing a newer version than requested, which is why i'm looking for a cache | 15:04 |
| SergeyLukjanov | oh | 15:04 |
| SergeyLukjanov | surprising | 15:04 |
| *** packet has joined #openstack-infra | 15:05 | |
| fungi | 'sudo rm -rf /tmp/pip-build-*' fixed it | 15:05 |
| *** boris-42 has quit IRC | 15:05 | |
| SergeyLukjanov | heh | 15:06 |
| SergeyLukjanov | fungi, are you planning to promote 69840 and 69773 after fixing it? | 15:06 |
| *** CaptTofu has quit IRC | 15:06 | |
| *** weshay has joined #openstack-infra | 15:06 | |
| fungi | SergeyLukjanov: yeah, well re-promote | 15:06 |
| SergeyLukjanov | fungi, oh, sorry, missed the first promote :) | 15:07 |
| *** chandankumar_ has quit IRC | 15:07 | |
| fungi | yeah, turns out it was premature given all the other broken | 15:08 |
| hashar | fungi thanks for the testtools-0.9.35 removal :) | 15:10 |
| fungi | hashar: well, we're not out of the woods yet | 15:10 |
| hashar | at least you are cutting trees to get out of them! | 15:10 |
| *** afazekas has quit IRC | 15:11 | |
| *** boris-42 has joined #openstack-infra | 15:12 | |
| * fungi is burning down the forest | 15:12 | |
| *** mrodden has quit IRC | 15:12 | |
| fungi | okay, i think all the long-running slaves have older tox/virtuaenv now. checking to see whether the nodepool nodes need any help in that regard | 15:13 |
| SergeyLukjanov | fungi, I've saved the screenshot of how the gate death is looks like :) http://f.slukjanov.name/w/Screen%20Shot%202014-01-29%20at%207.05.12%20PM.png | 15:16 |
| fungi | maybe we'll print posters for the summit | 15:17 |
| ArxCruz | fungi: clarkb i'm not seeing http://git.openstack.org/cgit/openstack-infra/config/plain/modules/openstack_project/templates/review.projects.yaml.erb file | 15:17 |
| fungi | ArxCruz: it moved last night | 15:18 |
| ArxCruz | the cache_git_repos.py is complaining | 15:18 |
| ArxCruz | fungi: where? :) | 15:18 |
| fungi | ArxCruz: you need newer jeepyb | 15:18 |
| *** markmcclain1 has quit IRC | 15:18 | |
| *** e0ne_ has quit IRC | 15:18 | |
| *** e0ne has joined #openstack-infra | 15:18 | |
| fungi | http://git.openstack.org/cgit/openstack-infra/config/plain/modules/openstack_project/files/review.projects.yaml | 15:19 |
| *** jpich has quit IRC | 15:19 | |
| fungi | we merged an improvement which splits the configuration out to a projects.ini file and makes the projects.yaml no longer require templating | 15:19 |
| ArxCruz | jeblair: I mean the prepare_node.sh script from nodepool calls cache_git_repos.py | 15:19 |
| ArxCruz | which ask for http://git.openstack.org/cgit/openstack-infra/config/plain/modules/openstack_project/templates/review.projects.yaml.erb | 15:19 |
| fungi | ArxCruz: oh, i wonder if we missed fixing that... checking now | 15:20 |
| ArxCruz | ;) | 15:20 |
| *** CaptTofu has joined #openstack-infra | 15:21 | |
| mordred | I thought I _did_ fix that | 15:22 |
| mordred | also, good morning | 15:22 |
| *** flaper87 is now known as flaper87|afk | 15:22 | |
| ArxCruz | mordred: let me check, perhaps I was the one who didn't update my local repo :) | 15:22 |
| fungi | ArxCruz: looks like you need a newer version of that script | 15:22 |
| *** kraman has joined #openstack-infra | 15:23 | |
| ArxCruz | fungi: yeah, my bad :( sorry | 15:23 |
| fungi | mordred: it's correct | 15:23 |
| SergeyLukjanov | mordred, morning | 15:23 |
| fungi | mordred: in fact, great morning. new tox release! | 15:23 |
| fungi | (you can tell by all the red in the zuul status page) | 15:23 |
| SergeyLukjanov | fungi, mordred, and I'd like to print this one http://f.slukjanov.name/w/Screen%20Shot%202014-01-29%20at%207.05.12%20PM.png | 15:24 |
| fungi | mordred: and also new testtools, just to make the day interesting | 15:24 |
| mordred | SergeyLukjanov: wow. nice | 15:24 |
| mordred | fungi: yeah. I was just reading about that in the scrollback | 15:24 |
| fungi | not sure what else is broken yet | 15:24 |
| fungi | i've got tox/virtualenv downgraded and puppet adjusted to hopefully avoid any reupgrading while we get our bearings | 15:25 |
| *** salv-orlando has quit IRC | 15:25 | |
| mordred | cool | 15:26 |
| SergeyLukjanov | looks like after fixing new tox release, promoting 69840 and 69773, we should avoid top 2 gate bugs | 15:26 |
| *** mrodden has joined #openstack-infra | 15:26 | |
| fungi | i'm working on that now SergeyLukjanov | 15:26 |
| SergeyLukjanov | heh, it sounds nice "fix new tox release" | 15:26 |
| SergeyLukjanov | fungi, I know and that's awesome that you're doing it! I just hope that noone more will push new release today... | 15:27 |
| mordred | I'm so happy that tox killed us | 15:29 |
| *** stevemar has joined #openstack-infra | 15:29 | |
| *** mestery has quit IRC | 15:29 | |
| *** enikanorov_ has quit IRC | 15:29 | |
| *** zul has quit IRC | 15:30 | |
| SergeyLukjanov | mordred, am I right that tox killing us not the first time? | 15:30 |
| *** zul has joined #openstack-infra | 15:30 | |
| mordred | hrm. actually, I think this is the first me that tox itself killed us. | 15:31 |
| dims | fungi, talk about life of the edge :) | 15:31 |
| fungi | dims: my fingers are nothing but cuts | 15:31 |
| sdague | mordred: yeh, I think that's true with tox | 15:31 |
| sdague | this is not the first time subunit / testtools killed us though | 15:32 |
| *** sarob has joined #openstack-infra | 15:32 | |
| dims | :) | 15:32 |
| *** sarob has quit IRC | 15:33 | |
| *** sarob has joined #openstack-infra | 15:33 | |
| SergeyLukjanov | sdague, heh, nice | 15:33 |
| *** chandankumar_ has joined #openstack-infra | 15:34 | |
| fungi | pip freeze on precise6 says tox==1.6.1 but this job just ran on it using tox==1.7.0 https://jenkins01.openstack.org/job/gate-python-keystoneclient-docs/2312/console | 15:35 |
| *** flaper87|afk is now known as flaper87 | 15:35 | |
| fungi | maybe our slave scripts aggressively upgrade a local copy of tox | 15:35 |
| *** afazekas has joined #openstack-infra | 15:35 | |
| *** chandankumar_ has quit IRC | 15:38 | |
| fungi | oh crap. tox --version reports 1.7.0 is installed but pip freeze says 1.6.1 | 15:38 |
| *** jgrimm has joined #openstack-infra | 15:38 | |
| chmouel | sneaky :( | 15:38 |
| *** sarob has quit IRC | 15:38 | |
| SergeyLukjanov | extremely sneaky... | 15:39 |
| fungi | i need to clean /usr/local/lib/python2.7/dist-packages/tox and /usr/local/bin/tox on all the slaves and retry installing | 15:39 |
| fungi | hopefully that's all | 15:39 |
| *** chandankumar_ has joined #openstack-infra | 15:39 | |
| *** wenlock has joined #openstack-infra | 15:41 | |
| *** dims has quit IRC | 15:42 | |
| *** dims has joined #openstack-infra | 15:43 | |
| *** senk has quit IRC | 15:44 | |
| *** chandankumar_ has quit IRC | 15:45 | |
| *** AlexF_ has joined #openstack-infra | 15:45 | |
| *** rcleere has joined #openstack-infra | 15:45 | |
| *** chandankumar_ has joined #openstack-infra | 15:46 | |
| *** lcheng has quit IRC | 15:47 | |
| SergeyLukjanov | fungi, heh, looks like single-use slaves are much more easier to fix such problems | 15:48 |
| fungi | indeed. well, except that it involves deleting all images and nodes and waiting a while | 15:48 |
| SergeyLukjanov | oh, correct | 15:49 |
| *** coolsvap has joined #openstack-infra | 15:49 | |
| fungi | so in actuality, much harder but there's an automated system to do all that work for us ;) | 15:49 |
| * mordred watches fungi wave the pedantic wand | 15:49 | |
| *** chandankumar_ has quit IRC | 15:49 | |
| fungi | i cling to my pedantry because it's all i have left to comfort me | 15:50 |
| *** chandankumar_ has joined #openstack-infra | 15:50 | |
| * mordred hands fungi a teddy bear and a bottle of scotch | 15:51 | |
| *** pcrews has joined #openstack-infra | 15:51 | |
| * fungi trades the teddy bear for a second bottle of scotch | 15:51 | |
| mordred | nicely played | 15:51 |
| *** AlexF_ has quit IRC | 15:52 | |
| *** dstufft has quit IRC | 15:52 | |
| *** chandankumar_ has quit IRC | 15:52 | |
| *** jcooley_ has joined #openstack-infra | 15:53 | |
| *** dstufft has joined #openstack-infra | 15:53 | |
| *** metabro has quit IRC | 15:56 | |
| *** metabro has joined #openstack-infra | 15:57 | |
| fungi | okay, i think this has got it... slaves are all cleanly reporting tox --version of 1.6.1 now | 15:57 |
| mordred | yay | 15:58 |
| SergeyLukjanov | great! | 15:58 |
| mordred | SergeyLukjanov: so what are we supposed to do differently now to support new-tox? | 15:58 |
| SergeyLukjanov | mordred, I'm looking on the tox code | 15:59 |
| *** virmitio has joined #openstack-infra | 15:59 | |
| *** dstufft_ has joined #openstack-infra | 16:00 | |
| *** senk has joined #openstack-infra | 16:00 | |
| *** lcheng has joined #openstack-infra | 16:00 | |
| mordred | SergeyLukjanov: also, I heard you did not get your visas. :( I'd offer to go beat up someone in the russian government, but something tells me that would end quite poorly for me | 16:00 |
| *** NikitaKonovalov is now known as NikitaKonovalov_ | 16:01 | |
| russellb | is reverify still off? *can't remember* | 16:01 |
| SergeyLukjanov | mordred, heh, we haven't received our IDs yet from | 16:01 |
| SergeyLukjanov | russellb, reverify bug XXX is still working | 16:01 |
| russellb | k | 16:01 |
| *** Sukhdev has joined #openstack-infra | 16:02 | |
| SergeyLukjanov | russellb, but due to the bynch of gate issues I don't think that it'll help :) | 16:02 |
| russellb | thought fixes were already in gate | 16:02 |
| SergeyLukjanov | russellb, not yet | 16:02 |
| devananda | wow, https://review.openstack.org/#/c/69496/ looks sad and lonely | 16:02 |
| russellb | k | 16:02 |
| *** bookwar has quit IRC | 16:02 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: it's actually 14 days https://review.openstack.org/69859 | 16:02 |
| SergeyLukjanov | russellb, we have a new one - tox 1.7.0 | 16:02 |
| devananda | fungi: is it safe to reverify things now? | 16:03 |
| russellb | fun.. | 16:03 |
| russellb | devananda: apparently not :) | 16:03 |
| SergeyLukjanov | devananda, I don't think so | 16:03 |
| devananda | ack | 16:03 |
| *** markmcclain has joined #openstack-infra | 16:03 | |
| mordred | devananda: I was going to say "you loko sad and lonely" - but realized that might be less funny if you actually were sad and lonely today | 16:03 |
| mordred | s/loko/look/ | 16:04 |
| SergeyLukjanov | devananda, currently waiting for the https://review.openstack.org/#/c/69840/ to be merged to unblock gate issue with testtools - subunit | 16:04 |
| *** dstufft has quit IRC | 16:04 | |
| *** dstufft_ is now known as dstufft | 16:04 | |
| fungi | yeah, i *think* things are safe again, but i'm reserving judgement (and not clearing the current status alert) until i see positive evidence | 16:05 |
| *** vkozhukalov has quit IRC | 16:07 | |
| anteaya | devananda has friends that care about him, he has no reason to be sad and lonely - unless he wants to be | 16:08 |
| mordred | anteaya: nod | 16:08 |
| anteaya | and morning | 16:08 |
| anteaya | turns out utah folks start conferences at 8am | 16:09 |
| anteaya | who knew? | 16:09 |
| * anteaya is stilling in hallway waiting for keynotes to finish | 16:09 | |
| fungi | anteaya: it's cultural. they also mostly go to bed at 9pm | 16:09 |
| * mordred wants to go to bed | 16:10 | |
| anteaya | our wild dinner that took us to 10:30 pm last night must have been a unique event | 16:10 |
| anteaya | mordred: night night | 16:10 |
| devananda | mordred: I am in Seattle. It's rainy and grey outside. So you'd /think/ I'm sad and lonely - but I'm not. However, I am sad for all of us that the gate is broken. | 16:10 |
| devananda | anteaya: good morning! | 16:10 |
| anteaya | devananda: morning my friend | 16:11 |
| fungi | devananda: it's not sad--it's joyous that tox upstream is active and making constant improvements... i see several things in the 1.7.0 changelog entry which could benefit us once we're ready to take advantage of them | 16:12 |
| devananda | fungi: wonderful news! | 16:12 |
| mordred | yeah. I like the posargs default value thing | 16:12 |
| *** yassine has quit IRC | 16:12 | |
| mordred | we could use that to replace -evenv with just py27 and py26, tbh | 16:13 |
| *** yassine has joined #openstack-infra | 16:13 | |
| *** salv-orlando has joined #openstack-infra | 16:13 | |
| devananda | i'm speaking more of the sadness that is nondeterministic gate failures | 16:13 |
| fungi | worth noting that tox 1.7.0 now requires virtualenv 1.11.2 though (which bundles pip 1.5.2) | 16:13 |
| mordred | fungi: well... we DO want that | 16:14 |
| fungi | so when the tox upgrade train blows its whistle, everybody rides | 16:14 |
| devananda | it's great that ironic now gates on tempest. it also means we haven't landed a single patch in 2 days, much, i suspect, as other projects. but really - I'm very happy about it :) | 16:14 |
| fungi | devananda: could be worse. you could be neutron... it hasn't landed a change in a couple weeks: http://git.openstack.org/cgit/openstack/neutron/log/ | 16:16 |
| devananda | fungi: aiieee :( | 16:16 |
| devananda | fungi: i like not-being a software project. if i had to be a not-humanoid, perhaps a teddy bear would be better. then I could be traded for whiskey :) | 16:17 |
| *** nicedice has joined #openstack-infra | 16:17 | |
| SergeyLukjanov | devananda, heh, I'd like to be happy too ;) so, promoting the same change for savanna - https://review.openstack.org/#/c/68066/ :) | 16:17 |
| devananda | SergeyLukjanov: ++ | 16:18 |
| fungi | devananda: perhaps you could still be traded for a good japanese whiskey... i'll find out | 16:19 |
| Shrews | fungi: ya know the worst thing about a telecommute job? no snow days :( | 16:19 |
| mordred | Shrews: ++ | 16:20 |
| * anteaya wonders who fungi is planning on querying about the devananda/japanese whiskey trade | 16:20 | |
| fungi | Shrews: at my old service provider job, they "let us" work from home in bad weather. it was very generous of them | 16:21 |
| SergeyLukjanov | heh, here's -30 Celsius outside... | 16:21 |
| Shrews | also, devananda is good for at least a nip of Nikka | 16:21 |
| fungi | anteaya: i query Shrews in these matters | 16:21 |
| portante | SergeyLukjanov: and inside? :) | 16:21 |
| SergeyLukjanov | portante, much warmer, but not enough | 16:22 |
| portante | :) | 16:22 |
| fungi | SergeyLukjanov: right, not so bad here... -6c at the moment, forecast for -13c after dark | 16:23 |
| SergeyLukjanov | I have a screenshot of today's morning forecase | 16:23 |
| SergeyLukjanov | let me find it | 16:23 |
| SergeyLukjanov | http://instagram.com/p/jvuQIotUee/ | 16:23 |
| *** hashar has quit IRC | 16:23 | |
| fungi | it's been a while since we had -30c temps here | 16:23 |
| *** mestery has joined #openstack-infra | 16:24 | |
| *** mestery has quit IRC | 16:24 | |
| fungi | SergeyLukjanov: that's going to be one cold dns server | 16:24 |
| SergeyLukjanov | fungi, exactly and I've forgot to setup due to the gate issues ;) | 16:25 |
| fungi | it looks like the next most pressing gate epidemic is that large-ops is entirely broken on stable/havana | 16:26 |
| * devananda dares to reverify | 16:27 | |
| *** mestery has joined #openstack-infra | 16:27 | |
| branen | Greetings, is there a requirements cord member available to take a look at https://review.openstack.org/#/c/65179/? Thanks | 16:27 |
| mriedem | SergeyLukjanov: we've been living with that for the last 2 months | 16:28 |
| mriedem | :_ | 16:28 |
| mriedem | :) | 16:28 |
| mriedem | on the plus side, clear skies | 16:28 |
| SergeyLukjanov | mriedem, yup, clear skies great | 16:28 |
| SergeyLukjanov | mriedem, heh, the main problem for me is that we could have +40 at summer and less than -30 at winter | 16:29 |
| mriedem | like mars | 16:29 |
| openstackgerrit | Julien Danjou proposed a change to openstack-dev/hacking: Allow to have noqa on H202 https://review.openstack.org/69596 | 16:30 |
| anteaya | branen: core members for requirements: https://review.openstack.org/#/admin/groups/131,members | 16:31 |
| branen | anteaya: thanks | 16:31 |
| SergeyLukjanov | looks like the gate unblocking fix about testtools will be merged in 6 mins if no new releases of tools that we're using | 16:31 |
| SergeyLukjanov | brrr, need to go home, will hopefully return back soon | 16:32 |
| fungi | looks like 69773,1 passed all jobs, and we're just waiting on a couple jobs for 69840,2 ahead of it | 16:32 |
| sdague | fungi: great | 16:32 |
| SergeyLukjanov | 69773 is a fix for top nova issue? | 16:32 |
| fungi | SergeyLukjanov: yes | 16:33 |
| SergeyLukjanov | awesome! | 16:33 |
| anteaya | branen: welcome, good hunting | 16:33 |
| *** SumitNaiksatam has quit IRC | 16:33 | |
| *** sarob has joined #openstack-infra | 16:33 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 16:34 | |
| cp16net | dtroyer_zz: ping about trove commit you added to devstack | 16:35 |
| *** pcrews has quit IRC | 16:36 | |
| *** rlandy has quit IRC | 16:36 | |
| *** jcooley_ has quit IRC | 16:37 | |
| *** DinaBelova is now known as DinaBelova_ | 16:37 | |
| *** jcooley_ has joined #openstack-infra | 16:37 | |
| dtroyer_zz | cp16net: hey | 16:37 |
| *** DinaBelova_ is now known as DinaBelova | 16:38 | |
| *** sarob has quit IRC | 16:38 | |
| *** thedodd has joined #openstack-infra | 16:40 | |
| *** david-lyle has joined #openstack-infra | 16:41 | |
| *** senk has quit IRC | 16:41 | |
| cp16net | dtroyer_zz: looks like the trove commit has the wrong names | 16:41 |
| cp16net | 70-trove instead of 70-trove.sh | 16:41 |
| cp16net | i think that should fix trove to be installed | 16:41 |
| *** jcooley_ has quit IRC | 16:42 | |
| zaro | morning | 16:42 |
| *** senk has joined #openstack-infra | 16:42 | |
| anteaya | morning zaro | 16:42 |
| dtroyer_zz | cp16net: https://review.openstack.org/#/c/69826/ is in the gate queue for that | 16:42 |
| dtroyer_zz | cp16net: apologies for me missing that initially... | 16:42 |
| cp16net | ok thanks :) | 16:43 |
| *** dizquierdo has quit IRC | 16:43 | |
| *** DinaBelova is now known as DinaBelova_ | 16:44 | |
| cp16net | hm jekins failed it... | 16:44 |
| *** nati_ueno has joined #openstack-infra | 16:45 | |
| *** senk has quit IRC | 16:45 | |
| *** yamahata has quit IRC | 16:46 | |
| *** gyee has joined #openstack-infra | 16:46 | |
| *** mestery has quit IRC | 16:46 | |
| *** senk has joined #openstack-infra | 16:47 | |
| *** rcleere has quit IRC | 16:47 | |
| *** emagana has joined #openstack-infra | 16:47 | |
| *** pblaho has quit IRC | 16:48 | |
| *** thuc has joined #openstack-infra | 16:48 | |
| *** rnirmal has joined #openstack-infra | 16:48 | |
| sdague | also, anyone able to +A this today - https://review.openstack.org/#/c/61892/ | 16:49 |
| sdague | we've got libvirt races in the gate, and we're completely blind, as we don't have logs | 16:49 |
| *** salv-orlando has quit IRC | 16:50 | |
| dims | sdague, i've dropped a note to Daniel (cc'ed you and Jog0) | 16:50 |
| *** AlexF_ has joined #openstack-infra | 16:52 | |
| *** senk has quit IRC | 16:52 | |
| *** DinaBelova_ is now known as DinaBelova | 16:53 | |
| openstackgerrit | A change was merged to openstack/requirements: Temporary fix testtols version to unblock gate https://review.openstack.org/69840 | 16:53 |
| *** afazekas has quit IRC | 16:54 | |
| *** eharney_ has joined #openstack-infra | 16:55 | |
| jgriffith | fungi: yall seen this one before: http://logs.openstack.org/87/69787/2/check/gate-cinder-python26/c439c44/console.html | 16:55 |
| *** eharney has quit IRC | 16:55 | |
| *** eharney_ is now known as eharney | 16:55 | |
| *** AlexF_ has quit IRC | 16:59 | |
| *** rcleere has joined #openstack-infra | 17:00 | |
| *** e0ne_ has joined #openstack-infra | 17:01 | |
| *** e0ne has quit IRC | 17:01 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 17:04 | |
| *** doddstack has joined #openstack-infra | 17:04 | |
| *** SumitNaiksatam has joined #openstack-infra | 17:04 | |
| *** stevemar has quit IRC | 17:04 | |
| *** thedodd has quit IRC | 17:05 | |
| *** amotoki has quit IRC | 17:06 | |
| mordred | woot. testtools change landed | 17:07 |
| fungi | jgriffith: yeah, recheck bug 1274135 (should be fixed now) | 17:07 |
| *** AlexF_ has joined #openstack-infra | 17:07 | |
| fungi | well, s/fixed/worked around/ | 17:07 |
| *** vjay has quit IRC | 17:08 | |
| fungi | #alert ok the gate is merging changes again... issues with tox/virtualenv versions can be rechecked or reverified against bug 1274135 | 17:09 |
| fungi | duh | 17:09 |
| fungi | #status ok the gate is merging changes again... issues with tox/virtualenv versions can be rechecked or reverified against bug 1274135 | 17:09 |
| openstackstatus | NOTICE: the gate is merging changes again... issues with tox/virtualenv versions can be rechecked or reverified against bug 1274135 | 17:09 |
| *** ChanServ changes topic to "Discussion of OpenStack Project Infrastructure | Docs http://ci.openstack.org/ | Bugs https://launchpad.net/openstack-ci | Code https://git.openstack.org/cgit/openstack-infra/" | 17:09 | |
| *** doude_ has joined #openstack-infra | 17:09 | |
| *** AlexF_ has quit IRC | 17:10 | |
| doude_ | Hi all, I meet some trouble to initiate git-review after a fres cloning of Neutron's depo | 17:10 |
| doude_ | I got this error http://paste.openstack.org/show/62092/ when I run 'git review -s' | 17:11 |
| doude_ | The scp command doesn't contains the revier server name | 17:11 |
| doude_ | any thought ? | 17:11 |
| *** dangers_away is now known as dangers | 17:13 | |
| fungi | doude_: was the clone of neutron your current working directory when you ran git-review -s? it looks like it couldn't find either the .git or .git/hooks subdirectories | 17:13 |
| doude_ | yes, it was | 17:13 |
| doude_ | In fact, if you lookk the scp command, it missing server name | 17:13 |
| doude_ | where it try to get the commit-msg script | 17:14 |
| anteaya | scp, why are you using scp? | 17:14 |
| anteaya | you need to git clone a repo | 17:14 |
| fungi | anteaya: git-review does that automagically | 17:15 |
| fungi | anteaya: he did clone a repository | 17:15 |
| doude_ | I try to copy from an older openstack depo git this script and the command 'git review -s' success | 17:15 |
| doude_ | but when I try to fect a review I've got another fail on an ssh command | 17:15 |
| anteaya | which openstack depo git? | 17:15 |
| doude_ | again without sever name | 17:15 |
| doude_ | Neutron | 17:15 |
| fungi | doude_: that is interesting. have you made any unusual changes to your ~/.ssh/config file? | 17:16 |
| anteaya | can you try again cloning from http://git.openstack.org/cgit/openstack/neutron/ | 17:16 |
| doude_ | http://paste.openstack.org/show/62095/ | 17:16 |
| doude_ | anteaya: yes, I can | 17:17 |
| fungi | anteaya: please don't suggest to people to clone from cgit repos. the built-in gitserver in cgit is horrible. https://git.openstack.org/openstack/neutron.git would be preferable | 17:17 |
| anteaya | sorry, I will in future | 17:17 |
| fungi | cgit is fine for browsing, but the actual git service running on those systems does a far better job | 17:17 |
| doude_ | fungi: no I don't think. What 'unusual' change you supose ? | 17:18 |
| anteaya | ah okay | 17:18 |
| fungi | doude_: mostly wondering whether you had "host" sections in your .ssh/config | 17:18 |
| doude_ | fungi: Ok, I forget the clone from cgit | 17:18 |
| doude_ | fungi: I've got a lot | 17:18 |
| doude_ | fungi: I test without my ssh config file | 17:19 |
| fungi | i'm going to try git-review -v -s on a fresh clone and see if it really is supposed to mention a hostname there | 17:19 |
| doude_ | fungi: ok, thanks. I don't thought to add verbose option. I try too | 17:21 |
| *** markmc has quit IRC | 17:22 | |
| doude_ | fungi: here the output with verbose mode and without any ssh config file | 17:22 |
| doude_ | http://paste.openstack.org/show/62116/ | 17:22 |
| *** sandywalsh has quit IRC | 17:22 | |
| doude_ | the line 13 seems strange | 17:23 |
| *** mestery_ has joined #openstack-infra | 17:23 | |
| devananda | anything we can do for the "Timed out waiting for thing xxx to become ACTIVE" errors, besides retry? | 17:24 |
| fungi | doude_: here's what a successful run looks like on my system... http://paste.openstack.org/show/62117/ | 17:24 |
| fungi | devananda: there's an open bug for those... i think the current suspicion is a libvirt bug? (i could be misremembering) | 17:25 |
| devananda | fungi: ack, i'll look | 17:25 |
| devananda | yea, 1254890 | 17:26 |
| jog0 | dims: just saw | 17:26 |
| jog0 | dims: hopefully we will get libvirt 1.x support in Icehouse | 17:26 |
| openstackgerrit | Bob Ball proposed a change to openstack-infra/nodepool: Allow useage of server IDs as well as names. https://review.openstack.org/69424 | 17:27 |
| fungi | doude_: what does 'git remote -v' give you? i get fetch and push remotes named "gerrit" which map to ssh://fungi@review.openstack.org:29418/openstack/neutron.git | 17:28 |
| devananda | hm, reverify didn't work ... | 17:28 |
| *** hashar has joined #openstack-infra | 17:28 | |
| * anteaya is still curious where doude_ cloned his git repo from | 17:28 | |
| *** alexpilotti has joined #openstack-infra | 17:29 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 17:29 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov_ | 17:30 | |
| *** nati_ueno has quit IRC | 17:31 | |
| fungi | ugh... we got latest testtools back into the mirror again | 17:31 |
| fungi | fixing | 17:31 |
| *** nati_ueno has joined #openstack-infra | 17:33 | |
| *** nati_ueno has quit IRC | 17:34 | |
| *** e0ne_ has quit IRC | 17:35 | |
| doude_ | fungi: does it (http://paste.openstack.org/show/62118/) work for you ? | 17:36 |
| *** VijayT has joined #openstack-infra | 17:37 | |
| dims | jog0, +1 hopefully | 17:37 |
| *** jaypipes_ has joined #openstack-infra | 17:37 | |
| fungi | doude_: yes | 17:37 |
| anteaya | doude_: do you have a public key installed on your gerrit account? | 17:37 |
| *** jaypipes_ has quit IRC | 17:37 | |
| doude_ | yes | 17:37 |
| *** sandywalsh has joined #openstack-infra | 17:37 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 17:38 | |
| anteaya | doude_: what is your gerrit account id number? | 17:38 |
| fungi | doude_: try ethuleau@review.openstack.org there | 17:38 |
| *** AlexF_ has joined #openstack-infra | 17:38 | |
| doude_ | fungi: I try the scp command with the '-i' option and my private DSA key | 17:38 |
| fungi | since that seems to be your gerrit username | 17:38 |
| doude_ | fungi: ha yes, it works with the correct user name | 17:39 |
| fungi | though ssh will generally try all the keys it has in ~/.ssh | 17:39 |
| doude_ | fungi: yes | 17:39 |
| *** starmer has joined #openstack-infra | 17:39 | |
| fungi | so specifying -i is generally only necessary if you have keys in a nonstandard location on your filesystem | 17:39 |
| doude_ | fungi: yes, understood | 17:40 |
| doude_ | fungi: so the scp command works manualy | 17:40 |
| markmcclain | so I'm seeing this error in some of the experimental checks " sudo: unable to resolve host devstack-precise-saucy-kernel-rax-dfw-1237817.slave.openstack.o" | 17:40 |
| doude_ | but git-review script doesn't provide the hostname on the scp command | 17:40 |
| fungi | doude_: normally it should | 17:41 |
| markmcclain | are we not populating the /etc/hosts file correctly? | 17:41 |
| fungi | markmcclain: i wonder if we hit a hostname limit with that new test image | 17:41 |
| doude_ | fungi: I try to remove my git-gerrit installation (I installed it with pip) | 17:41 |
| openstackgerrit | Matt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for bug 1274121 https://review.openstack.org/69929 | 17:42 |
| doude_ | fungi: I've got version 1.23 installed | 17:42 |
| fungi | markmcclain: that looks like 64 characters. suspiciously like a limit of some sort | 17:42 |
| *** AlexF_ has quit IRC | 17:42 | |
| fungi | doude_: i have git-review version 1.23 as well | 17:43 |
| *** doddstack has quit IRC | 17:43 | |
| markmcclain | fungi: 255 should be limit | 17:44 |
| fungi | markmcclain: short term, we probably need to shrink the image name we used there. long term we need to figure out where we're hitting that because we're already running pretty close to there | 17:44 |
| fungi | markmcclain: agreed. something else seems to be arbitrarily truncating it | 17:44 |
| *** thedodd has joined #openstack-infra | 17:44 | |
| markmcclain | yeah…want me to work on change to make a shorter name? | 17:45 |
| *** hashar has left #openstack-infra | 17:45 | |
| fungi | markmcclain: yeah if you don't mind. should just be able to git grep devstack-precise-saucy-kernel in openstack-infra/config and shorten it everywhere you get a match | 17:47 |
| *** hemna_ has joined #openstack-infra | 17:47 | |
| *** AlexF_ has joined #openstack-infra | 17:49 | |
| fungi | interestingly, this may be a rackspace-specific issue. we have longer hostnames on slaves in hplcoud-region-b and tripleo-test-cloud providers already | 17:49 |
| clarkb | morning | 17:49 |
| fungi | morning clarkb | 17:50 |
| markmcclain | interesting | 17:50 |
| openstackgerrit | Bob Ball proposed a change to openstack-infra/nodepool: Allow useage of server IDs as well as names. https://review.openstack.org/69424 | 17:50 |
| fungi | clarkb: i've made zero headway catching up on reviews, sorry. typical morning full of fire drills | 17:50 |
| doude_ | fungi: what's the output of the command 'git remote show -n gerrit' on your en ? | 17:50 |
| doude_ | fungi: what's the output of the command 'git remote show -n gerrit' on your env ? | 17:50 |
| clarkb | fungi :/ | 17:50 |
| clarkb | tox and testtools? | 17:51 |
| fungi | doude_: http://paste.openstack.org/show/62120/ | 17:51 |
| fungi | clarkb: mostly, yes | 17:51 |
| doude_ | fungi: thx | 17:51 |
| *** rnirmal_ has joined #openstack-infra | 17:52 | |
| *** salv-orlando has joined #openstack-infra | 17:52 | |
| fungi | clarkb: do you recall off the top of your head what funky local injection things rackspace does for /etc/hosts? | 17:52 |
| *** sandywalsh has quit IRC | 17:53 | |
| clarkb | no but it is special | 17:53 |
| *** jcooley_ has joined #openstack-infra | 17:53 | |
| clarkb | it doesnt make puppet happy often | 17:53 |
| *** Alexei_987 has joined #openstack-infra | 17:54 | |
| *** harlowja_away is now known as harlowja | 17:54 | |
| fungi | oh, weird. maybe the hostname command is limited to 64 characters? | 17:54 |
| fungi | http://paste.openstack.org/show/62121/ | 17:54 |
| doude_ | fungi: I've found the pb. I set my terminal language into french, so the output of 'git remote show -n gerrit' is translated in Franch. 'Push URL:' becomes 'URL push :' | 17:54 |
| clarkb | fungi isnt that a dns limit? | 17:55 |
| *** rnirmal has quit IRC | 17:55 | |
| *** rnirmal_ is now known as rnirmal | 17:55 | |
| anteaya | doude_: that's a new one | 17:55 |
| doude_ | and the git-gerrit code match line starting by Push to define scp URL | 17:55 |
| doude_ | anteaya: funny one :) | 17:55 |
| fungi | doude_: oh, interesting. we should probably override the locale before calling external commands if we're trying to parse the results | 17:55 |
| anteaya | glad you found the source of the problem | 17:56 |
| fungi | doude_: please open a bug against https://bugs.launchpad.net/git-review | 17:56 |
| doude_ | fungi: yes | 17:56 |
| doude_ | fungi: thanls for your help | 17:56 |
| *** BobBall is now known as BobBallAway | 17:56 | |
| *** cody-somerville has joined #openstack-infra | 17:56 | |
| fungi | doude_: you're welcome--sorry for the trouble! | 17:57 |
| clarkb | isnt that what that change I -1'd is trying to fix | 17:57 |
| clarkb | there may alreasy be a bug | 17:57 |
| fungi | clarkb: label limit is 63 | 17:57 |
| fungi | clarkb: name limit is 255 | 17:58 |
| fungi | ietf rfc 1035 section 2.3.4 | 17:59 |
| *** rcleere has quit IRC | 17:59 | |
| *** AlexF_ has quit IRC | 17:59 | |
| *** jooools has quit IRC | 17:59 | |
| *** derekh has quit IRC | 18:01 | |
| *** Sukhdev has quit IRC | 18:02 | |
| doude_ | fungi: https://bugs.launchpad.net/git-review/+bug/1274222 | 18:02 |
| *** fbo is now known as fbo_away | 18:04 | |
| *** vkozhukalov has joined #openstack-infra | 18:04 | |
| anteaya | doude_: I think your english/french labels in the bug report need to be switched | 18:05 |
| markmcclain | fungi: happy with devstack-prec-saucy-krnl as the shortened name? | 18:06 |
| doude_ | anteaya: ha yes. Nice catch :) I update it | 18:06 |
| fungi | clarkb: markmcclain: found it. rackspace tries to put the fqdn in /etc/hostname while hpcloud just uses the unqualified host name | 18:06 |
| markmcclain | ah | 18:07 |
| clarkb | dsvm-precise-krnl? | 18:07 |
| *** nati_ueno has joined #openstack-infra | 18:08 | |
| fungi | and the hostname command assumes it's dealing with an rfc 1035 label not a name (thus truncates to 63 octets) | 18:08 |
| anteaya | I'd like to see saucy ackknowledged somehoe | 18:08 |
| anteaya | somehow | 18:08 |
| *** starmer has quit IRC | 18:08 | |
| anteaya | so it doesn't get lost | 18:08 |
| fungi | anteaya: it's very short-term. it'll be ripped back out again as soon as we're sure it's helping | 18:08 |
| anteaya | yes | 18:08 |
| markmcclain | ok… I'll update to dsvm-precise-krnl | 18:09 |
| *** nati_ueno has quit IRC | 18:09 | |
| *** vjay has joined #openstack-infra | 18:10 | |
| fungi | that looks short enough to avoid the current issue so we can complete the testing | 18:10 |
| *** mestery_ is now known as mestery | 18:10 | |
| * fungi does not care what color this particular bike shed ends up | 18:10 | |
| clarkb | fungi: doude_: that bug is related to https://review.openstack.org/#/c/64307/ ? | 18:11 |
| clarkb | seems like https://bugs.launchpad.net/git-review/+bug/1177429 and 1274222 are at least related | 18:11 |
| zaro | clarkb: hey i'm looking into using git trigger to build javamelody. | 18:12 |
| clarkb | mordred: fungi: if folks are happy with https://review.openstack.org/#/c/69763/ I can roll that out as I update the scp plugin | 18:12 |
| *** enikanorov_ has joined #openstack-infra | 18:13 | |
| anteaya | doude_: thanks, the report looks good to my eyes | 18:13 |
| zaro | clarkb: since it gets triggered by the jenkins git plugin we don't control when it runs. | 18:13 |
| openstackgerrit | mark mcclain proposed a change to openstack-infra/config: shorten name of devstack-precise-saucy-kernel https://review.openstack.org/69934 | 18:13 |
| *** sandywalsh has joined #openstack-infra | 18:14 | |
| zaro | clarkb: so how would the reporting work? how would we know whether the job builds successfully? | 18:14 |
| clarkb | zaro: it would copy logs like any other periodic job I think | 18:14 |
| zaro | clarkb: ok, how would you know to look at the logs if you don't get any indication that the job failed? | 18:14 |
| markmcclain | fungi: thanks | 18:15 |
| harlowja | hi guys, have others seen stuff like in https://bugs.launchpad.net/openstack-ci/+bug/1274036 ? | 18:15 |
| harlowja | seems like some requirements aren't being found (but only by certain jobs) | 18:16 |
| clarkb | zaro: it is the same as any other periodic job, you would have to go look | 18:17 |
| mordred | harlowja: is taskflow configured to use the openstack/requirements repo? | 18:18 |
| harlowja | nope, thats a bad idea :-P | 18:18 |
| harlowja | or at least i don't think it is | 18:18 |
| mordred | it's not | 18:18 |
| * mordred just checked | 18:19 | |
| fungi | clarkb: zaro: or use zuul's smtp reporter | 18:19 |
| harlowja | mordred k, ya, it seems like its only finding versions that would be in that repo | 18:19 |
| clarkb | fungi: well it wouldn't be triggered by zuul | 18:19 |
| harlowja | *even thought its not supposed to use it :-/ | 18:19 |
| fungi | oh | 18:19 |
| clarkb | fungi: I suppose it could be a proper periodic job and be triggered by zuul | 18:20 |
| clarkb | harlowja: best guess is pypi.python.org derped | 18:20 |
| harlowja | hmmm, could be | 18:20 |
| harlowja | let me recheck these, and see what happens | 18:20 |
| fungi | harlowja: clarkb: yeah i don't see the debug level output i normally expect from pip there (where it mentions the urls it's checking) | 18:21 |
| harlowja | i thought pypi was supposed to be more stable now they got on rackspace gear :) | 18:21 |
| clarkb | harlowja: have you seen the cheeseshop code? | 18:21 |
| harlowja | lol | 18:21 |
| harlowja | clarkb is it scary? | 18:21 |
| *** stevemar has joined #openstack-infra | 18:22 | |
| fungi | it's not easy being cheesy | 18:22 |
| harlowja | is it swiss chesse like | 18:22 |
| clarkb | harlowja: I am trying to find an illustrative example | 18:22 |
| clarkb | but it is really hard to find the source because google doesn't index bitbucket or something | 18:22 |
| *** AlexF_ has joined #openstack-infra | 18:23 | |
| openstackgerrit | Philippe Godin proposed a change to openstack-infra/jenkins-job-builder: Add best and worst status details for conditional-step plugin. https://review.openstack.org/69608 | 18:23 |
| openstackgerrit | A change was merged to openstack/requirements: glance requires pyOpenSSL>=0.11 https://review.openstack.org/66867 | 18:24 |
| *** pcrews has joined #openstack-infra | 18:24 | |
| *** rms has joined #openstack-infra | 18:24 | |
| *** rms is now known as Guest29663 | 18:25 | |
| zaro | fungi: can you do that? the job isn't even using zuul at all. it's just an independent jenkins job. | 18:29 |
| clarkb | zaro: yeah, zuul can trigger periodic jobs | 18:29 |
| fungi | make them non-scheduled jobs in jenkins and add them to the "periodic" pipeline in zuul instead | 18:30 |
| *** nati_ueno has joined #openstack-infra | 18:30 | |
| fungi | though i recall jenkins also has an e-mail reporting option, it's not nearly as flexible as zuul's reporter | 18:30 |
| zaro | ohh. i see. ok. i was thinking on the lines of just using the git trigger to do the triggering. | 18:31 |
| harlowja | ya, fungi seems like was pypi issue | 18:31 |
| harlowja | weird | 18:32 |
| fungi | zaro: clarkb: perhaps we could track upstream javamelody in gerrit and have a post job in zuul which ran for upstream/* branch commits? (no idea whether that's feasible) | 18:33 |
| zaro | fungi: clarb and jeblair are opposed to tracking javamelody in our gerrit. | 18:34 |
| *** sarob has joined #openstack-infra | 18:34 | |
| clarkb | fungi: it is feasible but we don't want to add that project to our gerrit | 18:35 |
| zaro | fungi: https://review.openstack.org/#/c/65162/ | 18:35 |
| fungi | got it | 18:36 |
| fungi | suggestion retracted | 18:36 |
| *** hogepodge has joined #openstack-infra | 18:36 | |
| zaro | i'm thinking it might be better just to use the jenkins plugin to trigger instead of zuul periodic job. | 18:37 |
| zaro | fungi, clarkb : ^ your thoughts? | 18:37 |
| *** praneshp has joined #openstack-infra | 18:37 | |
| openstackgerrit | A change was merged to openstack-infra/config: shorten name of devstack-precise-saucy-kernel https://review.openstack.org/69934 | 18:37 |
| fungi | zaro: do we expect to only need this as long as we're running jenkins, or is there a post-jenkins option which doesn't involve having zuul run it? | 18:38 |
| clarkb | zaro: I like fungi's idea more now because it isn't jenkins dependent and will run the job on one jenkins master not 8 | 18:38 |
| *** VijayT has quit IRC | 18:39 | |
| *** sarob has quit IRC | 18:39 | |
| *** AlexF_ has quit IRC | 18:40 | |
| zaro | clarkb: you mean idea of tracking upstream in our gerrit? | 18:42 |
| clarkb | zaro: no, the idea of having a zuul periodic job | 18:42 |
| *** shivharis has joined #openstack-infra | 18:42 | |
| zaro | i see, i'll shoot for the zuul job then. | 18:43 |
| shivharis | Hi, I have a quick question to anyone who can answer: How do I skip specific tempest tests when running tempest using testr? | 18:44 |
| Guest29663 | @shivharis - The way I know is to add skip_test decorator to the test you want to skip | 18:45 |
| clarkb | shivharis: probably a better question for #openstack-qa. I think there are examples of this in the tempest tox.ini though. Basically you can use a reverse lookahead regex to filter test names | 18:45 |
| *** freyes has joined #openstack-infra | 18:46 | |
| clarkb | `testr run some_regex_here` will only run tests which have names matching that regex. Python allows for negative lookahead regexes which can be used to make things not match | 18:46 |
| *** johnthetubaguy has quit IRC | 18:46 | |
| shivharis | clarkb, Guest29663: Thanks for the pointers I will dig further. | 18:47 |
| clarkb | zaro: any chance I can get you to review https://review.openstack.org/#/c/69763/1 | 18:49 |
| jog0 | so it loks like bug 1274056 is still happenning in the gate | 18:51 |
| *** gokrokve has joined #openstack-infra | 18:52 | |
| jog0 | err I am seeing a different bug | 18:52 |
| jog0 | https://jenkins01.openstack.org/job/gate-nova-python26/19248/console | 18:53 |
| clarkb | I don't see any indication in 1274056 that it has been fixed | 18:53 |
| jog0 | slowest not recongnized | 18:53 |
| jog0 | clarkb: https://review.openstack.org/#/c/69840/ | 18:53 |
| clarkb | jog0: that won't actually fix anyone | 18:54 |
| jog0 | clarkb: o_O | 18:54 |
| jog0 | not even in gate? oh that only happens in tempest | 18:55 |
| clarkb | it changes the global requirements, it doesn't change any of the project requirements | 18:55 |
| fungi | somehow we seem to continue pulling testtools-0.9.35.tar.gz into the mirror | 18:55 |
| fungi | even though the mirror should be built from the global requirements list | 18:55 |
| clarkb | fungi: I bet that subunit and testrepository both depend on testtools uncapped | 18:56 |
| clarkb | and this is why pip needs a dep resolver | 18:56 |
| fungi | i've removed it for a third time now (the hope is this would allow people to get project-specific requirements fixes merged) | 18:56 |
| jog0 | gah pip | 18:56 |
| fungi | not sure where any of the projects are with their requirements patches though | 18:56 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add query for bug 1274121 https://review.openstack.org/69929 | 18:57 |
| jog0 | fungi: I'll send out an email to ML | 18:57 |
| clarkb | jog0: back to the original problem, setup.py test comes from pbr I think | 18:58 |
| clarkb | and that should accept --slowest | 18:58 |
| zaro | clarkb: reviewed | 18:58 |
| clarkb | zaro: thank you | 18:58 |
| jog0 | clarkb: which is why I am confused | 18:58 |
| * jog0 blindly blames to mordred | 18:59 | |
| clarkb | zaro: no way, that works? | 18:59 |
| clarkb | zaro: I will update, thanks again | 18:59 |
| zaro | clarkb: you can see what it returns by looking at the gearman functions that get registered. | 19:00 |
| clarkb | zaro: is it the fqdn? eg jenkins.openstack.org? | 19:00 |
| *** mrodden1 has joined #openstack-infra | 19:00 | |
| jog0 | clarkb: where is the jenkins auto update deps bot | 19:00 |
| jog0 | when we need it | 19:00 |
| *** VijayT has joined #openstack-infra | 19:00 | |
| zaro | clarkb: actually, i don't remember. | 19:00 |
| jog0 | https://review.openstack.org/#/q/owner:jenkins+project:openstack/nova+is:open,n,z | 19:01 |
| clarkb | jog0: I dunno, did we turn it off again? | 19:01 |
| *** mrodden has quit IRC | 19:01 | |
| fungi | jog0: it's broken. i've pointed people to the logs several times hoping someone would have time to fix it. perhaps i'll take a few minutes to open a bug | 19:02 |
| fungi | but the errors are fairly obvious in the job console log | 19:02 |
| *** yassine has quit IRC | 19:02 | |
| fungi | it's more a problem that nobody really actively looks at the log for it | 19:02 |
| *** yassine has joined #openstack-infra | 19:03 | |
| clarkb | jog0: pbr does a try import of testr internally if that fails test has no slowest option | 19:03 |
| jog0 | clarkb: ahh makes sense | 19:03 |
| clarkb | fungi: have a link handy to the fail? | 19:03 |
| lifeless | morning | 19:03 |
| jog0 | fungi: :/ | 19:03 |
| lifeless | I'm on the s | 19:03 |
| lifeless | I'm on the subunit thing | 19:04 |
| *** yassine has quit IRC | 19:04 | |
| jog0 | clarkb: does this make sense https://review.openstack.org/69940 | 19:04 |
| devananda | fungi: ironic is stuck on nondeterministic failures trying to unblock our requirements changes, fwiw | 19:04 |
| *** yassine has joined #openstack-infra | 19:04 | |
| *** vjay has quit IRC | 19:05 | |
| fungi | clarkb: http://logs.openstack.org/d6/d627576b50473cae501acd7124114a31099e7484/post/propose-requirements-updates/f1bc252/console.html | 19:05 |
| clarkb | jog0: yeah I think that is what you need. Note that if other reqs have changed you may need to update them as well | 19:05 |
| jog0 | clarkb: o_O | 19:05 |
| jog0 | do we have a sync script I can run? | 19:05 |
| jog0 | clarkb: your right just failed reqs test | 19:08 |
| clarkb | jog0: yes there is a sync script in the requirements repo | 19:08 |
| fungi | jog0: clarkb: i've opened https://launchpad.net/bugs/1274251 for it | 19:09 |
| *** yassine has quit IRC | 19:09 | |
| clarkb | fungi: you know what happened there. An out of band update happened | 19:09 |
| *** _david_ has joined #openstack-infra | 19:10 | |
| *** krtaylor has quit IRC | 19:10 | |
| fungi | quite probable | 19:10 |
| fungi | we wouldn't have noticed that in initial trial runs | 19:11 |
| *** e0ne has joined #openstack-infra | 19:11 | |
| fungi | certainly something the script should be robust enough to deal with though | 19:11 |
| clarkb | ya | 19:11 |
| *** AlexF_ has joined #openstack-infra | 19:11 | |
| fungi | s/be/be made/ | 19:11 |
| *** rnirmal has quit IRC | 19:11 | |
| *** doddstack has joined #openstack-infra | 19:12 | |
| _david_ | fungi, clarkb: i am trying it once time again merge WIP workflow as core Gerit feature: https://gerrit-review.googlesource.com/#/c/54088 | 19:12 |
| clarkb | we stopped using master as the update base because we got errors if there were no changes against the upstream patch, so we moved to basing on git review -d which opens us to merge failures form out of band updates | 19:12 |
| jog0 | clarkb: looks like as long as the testtools line syncs with global the nova-ress job passes | 19:12 |
| clarkb | jog0: oh good, it is smart enough to only look at the lines that changed | 19:12 |
| clarkb | _david_: good luck | 19:12 |
| jog0 | clarkb: yeah I am happy about that | 19:12 |
| *** rnirmal has joined #openstack-infra | 19:12 | |
| *** pblaho has joined #openstack-infra | 19:13 | |
| clarkb | fungi: I think we need to go back to using master and handle gerrit rejecting us becuse there are no changes | 19:13 |
| clarkb | fungi: I can write that now | 19:13 |
| zaro | _david_: https://code.google.com/p/gerrit/issues/detail?id=2438 | 19:13 |
| wenlock | clarkb, what do you think the chances for review of https://review.openstack.org/#/c/51425/ are today? | 19:13 |
| fungi | clarkb: sounds fine to me. matches the "better to ask forgiveness than permission" methodology, which i prefer | 19:13 |
| clarkb | wenlock: better than last night. I hope to switch to reviewing shortly after fixing this bug | 19:14 |
| wenlock | sweet, ok, im here all day to iterate on it as needed | 19:14 |
| *** amcrn has joined #openstack-infra | 19:14 | |
| *** cody-somerville has quit IRC | 19:15 | |
| *** lcheng has quit IRC | 19:15 | |
| *** thedodd has quit IRC | 19:15 | |
| wenlock | also, i wanted to ask... i was looking at jenkins::slave.pp.... has anyone wanted to refactor that yet?.... if wanted, i have an idea around it we've been playing with. | 19:16 |
| *** alexpilotti has quit IRC | 19:16 | |
| *** rcleere has joined #openstack-infra | 19:16 | |
| clarkb | wenlock: AaronGr might, he has been looking at our puppet and scheming | 19:17 |
| wenlock | cool, he has access to our work area, i'll ping him on it to see if he can contribute | 19:17 |
| *** gokrokve_ has joined #openstack-infra | 19:21 | |
| lifeless | subunt 0.0.18 should be compatible with testtools 0.9.35 | 19:22 |
| _david_ | zaro, fixed in https://gerrit-review.googlesource.com/#/c/54089 | 19:22 |
| *** Guest29663 has quit IRC | 19:22 | |
| SergeyLukjanov | lifeless, that's awesome! | 19:22 |
| _david_ | zaro last commit must be reverted, as it was done against Gerrit-API in master, and you are trying to build it against 2.8 | 19:23 |
| _david_ | zaro, i failed to create stable-2.8 branch. Did it now | 19:23 |
| *** CaptTofu_ has joined #openstack-infra | 19:25 | |
| *** gokrokve has quit IRC | 19:25 | |
| *** afrittoli is now known as andreaf | 19:26 | |
| SergeyLukjanov | lifeless, looks like we could bump subunit version to >=0.0.18 after testing | 19:26 |
| lifeless | SergeyLukjanov: sure | 19:26 |
| lifeless | SergeyLukjanov: I have tested, obviously :) | 19:26 |
| lifeless | SergeyLukjanov: but you never know... | 19:26 |
| SergeyLukjanov | and revert my temp attempt to fix it | 19:26 |
| *** CaptTofu has quit IRC | 19:27 | |
| *** pblaho has quit IRC | 19:29 | |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack/requirements: Revert testtols version fix and bump subunit to >=0.0.18 https://review.openstack.org/69956 | 19:29 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack/requirements: Revert testtools version fix and bump subunit to >=0.0.18 https://review.openstack.org/69956 | 19:30 |
| SergeyLukjanov | lifeless, I'm making it WIP to take a look on how it will be executed in gate | 19:30 |
| SergeyLukjanov | I think that it should fail before the subunit will be in the pypi.o.o | 19:31 |
| lifeless | clarkb: / fungi: can you mirror subunit 0.0.18 into our mirror? | 19:31 |
| fungi | lifeless: https://pypi.python.org/pypi/subunit says "not found" | 19:32 |
| jog0 | lifeless: when things are working can you comment on the '[openstack-dev] [all] Lots of gating failures because of testtools' thread | 19:33 |
| jog0 | fungi: https://pypi.python.org/pypi/python-subunit/0.0.18 | 19:33 |
| lifeless | sorry, python-subunit | 19:33 |
| fungi | ahh | 19:33 |
| SergeyLukjanov | jog0, ut's python-subunit | 19:33 |
| SergeyLukjanov | oops, it was for fungi | 19:33 |
| fungi | lifeless: yeah, i'll retrigger a mirror job forthwith | 19:34 |
| *** rossella_s has quit IRC | 19:34 | |
| *** sarob has joined #openstack-infra | 19:36 | |
| fungi | running... https://jenkins.openstack.org/job/post-mirror-python27/385/console | 19:37 |
| *** AlexF_ has quit IRC | 19:38 | |
| *** slong has joined #openstack-infra | 19:39 | |
| pabelanger | Hmm, when you delete a tag in gerrit (force push) does it also do the deletion for replication? | 19:40 |
| *** stevemar has left #openstack-infra | 19:40 | |
| jog0 | btw I just tried running nova unit tests with tox 1.7 | 19:41 |
| jog0 | and disaster | 19:41 |
| jog0 | it came out today https://pypi.python.org/pypi/tox/1.7.0 | 19:41 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/elastic-recheck: Extend fingerprint for bug 1274056 https://review.openstack.org/69957 | 19:41 |
| SergeyLukjanov | jog0, yup, it already break the gate today | 19:42 |
| SergeyLukjanov | jog0, fungi was fixed it by removing 1.7.0 from slaves | 19:42 |
| jog0 | SergeyLukjanov: oh we already pin tox in reqs? | 19:42 |
| SergeyLukjanov | jog0, AFAIU it's not possible to pin tox version, it was fixed on slaves | 19:42 |
| fungi | jog0: tox is not installed in reqs, reqs are installed by tox | 19:43 |
| SergeyLukjanov | jog0, some details could be found in scrollback | 19:43 |
| SergeyLukjanov | fungi, looks like mirror job failed - https://jenkins.openstack.org/job/post-mirror-python27/385/console | 19:44 |
| jog0 | sigh why does python keep breaking us | 19:44 |
| *** DinaBelova is now known as DinaBelova_ | 19:45 | |
| fungi | SergeyLukjanov: i believe it just failed to retrieve that one package mentioned above the traceback, but is still processing others | 19:45 |
| * fungi could be wrong though | 19:45 | |
| *** CaptTofu_ has quit IRC | 19:46 | |
| fungi | also, i wouldn't say i "fixed" our unit test problems by pinning tox at 1.6.1, merely bought us time to work on the actual fix | 19:46 |
| fungi | fixes | 19:46 |
| fungi | i suspect numerous projects will need patches | 19:46 |
| *** DinaBelova_ is now known as DinaBelova | 19:47 | |
| fungi | http://pypi.openstack.org/openstack/python-subunit/python-subunit-0.0.18.tar.gz is open for business | 19:49 |
| lifeless | fungi: please let me know when it's mirrored | 19:49 |
| lifeless | fungi: so I can let folk know | 19:49 |
| fungi | lifeless: go ahead and let folk know--it's there | 19:49 |
| lifeless | thanks | 19:50 |
| fungi | thank _you_ | 19:50 |
| mgagne | fungi: is there a bug people can recheck against? | 19:51 |
| *** CaptTofu has joined #openstack-infra | 19:51 | |
| mgagne | fungi: 1274056 ? | 19:51 |
| fungi | mgagne: looks right | 19:52 |
| mgagne | fungi: thanks | 19:52 |
| *** max_lobur is now known as max_lobur_afk | 19:53 | |
| *** krtaylor has joined #openstack-infra | 19:56 | |
| *** lcheng has joined #openstack-infra | 19:56 | |
| *** vkozhukalov has quit IRC | 19:56 | |
| *** VijayT has quit IRC | 20:02 | |
| *** thuc has quit IRC | 20:05 | |
| *** thuc has joined #openstack-infra | 20:06 | |
| fungi | zaro: it looked like people were hoping you might reply to https://groups.google.com/forum/#!topic/repo-discuss/Wica7iJ5DGk | 20:07 |
| *** mrodden has joined #openstack-infra | 20:10 | |
| sdague | lifeless: so if the fix is new version of subunit, does that mean we should set new minimums in global requirements? | 20:10 |
| *** thuc has quit IRC | 20:10 | |
| *** branen has quit IRC | 20:11 | |
| dkranz | sdague: Is there a way to successfully install tempest on a local machine and get around the testtools issue? | 20:11 |
| lifeless | sdague: It is probably wise | 20:12 |
| dkranz | sdague: pip installing an earlier version doesn't seem to actually work | 20:12 |
| lifeless | sdague: though pragmatically noone should get 0.0.17 anymore | 20:12 |
| *** mrodden1 has quit IRC | 20:12 | |
| sdague | lifeless: might be in distros | 20:13 |
| *** SumitNaiksatam has quit IRC | 20:13 | |
| sdague | or system level installed | 20:13 |
| sdague | and some of our test envs allow site packages | 20:13 |
| lifeless | sdague: 0.0.17 only existed for ~ 24 hours | 20:13 |
| *** SumitNaiksatam has joined #openstack-infra | 20:14 | |
| sdague | lifeless: oh, 0.0.17 went out at the same time? | 20:14 |
| lifeless | sdague: oh but yes, I see - testtools broke older versions of subunit at the same time | 20:14 |
| lifeless | sdague: yes, but thats irrelevant, I hadn't clicked. | 20:14 |
| sdague | lifeless: yeh, otherwise we could just != 0.0.17 | 20:14 |
| lifeless | sdague: So, yes, testtools 0.9.35 + any older subunit release will be a problem | 20:14 |
| lifeless | yup, lets add a hard dep | 20:15 |
| SergeyLukjanov | lifeless, does you mean >=0.0.18 | 20:15 |
| lifeless | I could backout the testtools change and do a release, but that won't fix the bad version being out there | 20:15 |
| lifeless | SergeyLukjanov: yes | 20:15 |
| sdague | lifeless: we can blacklist versions | 20:15 |
| fungi | dkranz: shouldn't be necessary as of an hour ago? use latest python-subunit | 20:15 |
| sdague | != is totally valid in pip | 20:15 |
| dkranz | fungi: Thanks! | 20:15 |
| openstack | sdague: Error: "=" is not a valid command. | 20:15 |
| sdague | we do it a bunch | 20:15 |
| sdague | maybe we do it less often now, jsonschema 1.4 was a big one | 20:16 |
| sdague | lifeless: testtools 0.9.32 works with new subunit? | 20:18 |
| sdague | just want to make sure - https://review.openstack.org/#/c/69956/2 is actually good so we can get that out there | 20:19 |
| lifeless | sdague: I don't recall adding any hard deps but let me check | 20:21 |
| sdague | cool, thanks | 20:21 |
| lifeless | sdague: no, it doesn't | 20:23 |
| lifeless | File "/home/robertc/personal/subunit/working/python/subunit/run.py", line 32, in <module> | 20:23 |
| lifeless | from testtools.run import ( | 20:23 |
| lifeless | bisecting to find minimum ver | 20:23 |
| lifeless | ImportError: cannot import name list_test | 20:23 |
| lifeless | sdague: ah setup.py already has it | 20:24 |
| lifeless | 'testtools>=0.9.34', | 20:24 |
| sdague | SergeyLukjanov: you want to update your requirements review with that? | 20:24 |
| *** yolanda_ has quit IRC | 20:25 | |
| SergeyLukjanov | sdague, looks like I've missed the idea | 20:25 |
| sdague | SergeyLukjanov: we also need the testtools bump, as new subunit doesn't work with the testtools we have listed as minimum | 20:26 |
| SergeyLukjanov | sdague, oh, this one | 20:26 |
| sdague | testtools>=0.9.34 | 20:26 |
| SergeyLukjanov | bump it to >=0.9.34& | 20:26 |
| sdague | yep | 20:26 |
| SergeyLukjanov | probably the latest version will be better? | 20:26 |
| sdague | SergeyLukjanov: we should be realistic about our minimums | 20:26 |
| SergeyLukjanov | and packaging too | 20:27 |
| sdague | so >=0.9.34 is probably best | 20:27 |
| clarkb | fungi: sorry been distracted by a few things | 20:27 |
| SergeyLukjanov | thanks for explanaition | 20:27 |
| SergeyLukjanov | going to udpda the CR | 20:27 |
| clarkb | fungi: most importantly there are other bugs in the requirement proposal script and I can't sort out how to unbug them | 20:27 |
| fungi | clarkb: no worries. i've been trying to get caught up on bug triage real quick | 20:27 |
| clarkb | git checkout stable/havana -- does not work in a recent origin fetched rep | 20:27 |
| clarkb | I think because we have mutliple remotes with the same branch | 20:28 |
| openstackgerrit | Shawn Hartsock proposed a change to openstack/requirements: add pyvmomi library https://review.openstack.org/69964 | 20:28 |
| clarkb | yeah if I prepend with origin/ it works. Going to fix that | 20:28 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack/requirements: Fix testtools version and bump subunit to >=0.0.18 https://review.openstack.org/69956 | 20:29 |
| *** hashar has joined #openstack-infra | 20:29 | |
| sdague | I think the testtools thing might have made a new record - 618 fails in 24hrs | 20:29 |
| SergeyLukjanov | sdague, that could be interesting to see the top bugs for the whole release cycle | 20:31 |
| *** dprince has quit IRC | 20:31 | |
| sdague | SergeyLukjanov: yeh, because of the rolling window on Elastic Recheck, we don't really keep that | 20:32 |
| lifeless | sdague: 'yay' ? | 20:32 |
| SergeyLukjanov | sdague, lifeless, https://review.openstack.org/#/c/69956/ is versions fix for testtools and subunit | 20:32 |
| sdague | lifeless: heh | 20:32 |
| SergeyLukjanov | sdague, on the other side, probably it'll be better to not see the results ;) | 20:32 |
| sdague | yeh, honestly, the point of them is to spot hot issues now we need to fix | 20:33 |
| sdague | which is why they are now sorted by number of hits in last 24 hrs | 20:33 |
| sdague | I'm actually hoping with this, the tox fix, and the image cache revert, the gate will actually move again | 20:34 |
| sdague | it took us about 24hrs to sort out the race yesterday | 20:34 |
| *** AlexF_ has joined #openstack-infra | 20:34 | |
| *** hashar has quit IRC | 20:35 | |
| *** e0ne has quit IRC | 20:35 | |
| *** melwitt has joined #openstack-infra | 20:36 | |
| sdague | fungi: what's the tox bug #? | 20:38 |
| fungi | sdague: 1274135 | 20:38 |
| sdague | oh, the --slowest is subunit still? | 20:39 |
| sdague | not tox? | 20:39 |
| sdague | re: https://review.openstack.org/#/c/69957/ | 20:39 |
| *** hashar has joined #openstack-infra | 20:39 | |
| *** rfolco has quit IRC | 20:40 | |
| lifeless | sdague: ok so, your email about subunit parallel data gathering - whats up there? | 20:42 |
| sdague | yep | 20:42 |
| sdague | so with tempest, were it's long running tests, in parallel, understanding progress is important | 20:43 |
| sdague | and understanding overlap can be pretty important to getting to the bottom of things | 20:43 |
| lifeless | totall | 20:43 |
| lifeless | totally | 20:43 |
| sdague | so I'd really like the ui to be able to show those | 20:44 |
| *** lcheng has quit IRC | 20:44 | |
| *** lcheng has joined #openstack-infra | 20:44 | |
| sdague | and as a first pass idea, if the tests for process 2 were indented from process 1, you'd have some pretty solid sense | 20:44 |
| lifeless | sdague: e.g. show one timeline per working line, and the current executing test on each line ? | 20:44 |
| lifeless | sdague: so (at the moment) testr itself doesn't show current executing tests at all (which I know is an issue, *primarily* because of the understanding progress/hung tests thing) | 20:45 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Make requirement update proposals more robust. https://review.openstack.org/69969 | 20:46 |
| clarkb | fungi: ^ there we go | 20:46 |
| *** coolsvap is now known as coolsvap_away | 20:46 | |
| sdague | lifeless: https://etherpad.openstack.org/p/testui-mockup | 20:46 |
| sdague | though it also raises a couple of other issues | 20:47 |
| sdague | #1 - start lines in the output today are completely useless, because they aren't printed until test is completed | 20:47 |
| lifeless | sdague: oh, is this for the local filter openstack carries at the moment ? | 20:47 |
| sdague | as seen by timestamps | 20:47 |
| sdague | well, if we had the ui in testr, I'd be fine as well | 20:48 |
| *** lcheng has quit IRC | 20:48 | |
| lifeless | sdague: so, you say tests aren't emitted until they finish | 20:48 |
| sdague | but yes, testr would need to default to providing progress | 20:48 |
| lifeless | let me just check a thing | 20:48 |
| *** rnirmal has quit IRC | 20:48 | |
| sdague | there is also the other ux issue that when testr fails 1 test, it says 2 tests failed | 20:49 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Make requirement update proposals more robust. https://review.openstack.org/69969 | 20:49 |
| sdague | because it counts the process exit as a test failure, which again confuses people | 20:49 |
| *** burt1 has quit IRC | 20:50 | |
| clarkb | fungi: lol at massive logs in unittests, it is possible that testr does that with the log capturing | 20:50 |
| *** VijayT has joined #openstack-infra | 20:50 | |
| clarkb | fungi: but I really doubt it | 20:50 |
| lifeless | sdague: I have a bug open for that I think, I agree its a nuisance | 20:50 |
| sdague | yeh, it also drops people's confidence in the toolchain, because if it can't do simple math, then it must have other issues | 20:51 |
| lifeless | so in my testing here | 20:52 |
| lifeless | tests are emitted immediately. | 20:52 |
| sdague | so this is an issue with the unittest filter of the subunit stream? | 20:52 |
| sdague | realistically either I want that test start time to be time accurate, or removed, as now it's spam | 20:53 |
| *** SumitNaiksatam has quit IRC | 20:53 | |
| fungi | clarkb: i think i see an error on 69969 but tell me if i'm smoking the wrong substances | 20:53 |
| clarkb | fungi: good point, I need to init that variable | 20:54 |
| * fungi resumes what he was smoking in that case | 20:54 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Make requirement update proposals more robust. https://review.openstack.org/69969 | 20:54 |
| lifeless | sdague: which filter are you using? | 20:54 |
| clarkb | fungi: apply more smoke ^ | 20:54 |
| sdague | lifeless: https://github.com/openstack/tempest/blob/master/tools/pretty_tox.sh | 20:55 |
| fungi | clarkb: lgtm | 20:55 |
| fungi | clarkb: oh, you might want to reference the bug i opened for it in the commit message too, but i'm +1 either way | 20:55 |
| clarkb | fungi: oh right /me finds it | 20:56 |
| fungi | clarkb: i would find it for you, but i'm about to hop on a conference call for which i'll be mostly afk | 20:56 |
| lifeless | sdague: its the filter | 20:56 |
| lifeless | sdague: subunit2pyunit downcasts to the serialised python unittest protocol | 20:56 |
| lifeless | sdague: so its going to be entirely useless for your purposes | 20:56 |
| lifeless | sdague: the nova filter should be a lot better | 20:57 |
| lifeless | sdague: and I'd be delighted if someone wants to submit that upstream | 20:57 |
| clarkb | fungi: I found it | 20:57 |
| sdague | lifeless: I'd be delighted if the upstream wasn't bzr :) | 20:57 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Make requirement update proposals more robust. https://review.openstack.org/69969 | 20:57 |
| clarkb | fungi: and done | 20:58 |
| lifeless | oh, no, nova's tools/colorizer.py is also going to be a bit useless for you | 20:58 |
| lifeless | sdague: ok, lets reset this conversation | 20:58 |
| lifeless | sdague: you want: | 20:58 |
| lifeless | - precise start times | 20:58 |
| clarkb | fungi: in other news, I am tempted to ask cisco to not have mutliple third party test accounts | 20:58 |
| lifeless | - worker identification | 20:58 |
| lifeless | - asap | 20:58 |
| lifeless | ? | 20:58 |
| clarkb | fungi: but maybe that is too heavy handed | 20:58 |
| clarkb | afk to grab lunch | 20:58 |
| sdague | so actually, what I want is: precise start times, worker identification, and an upstream location that looks like openstack process | 20:59 |
| sdague | because the reason we are doing this all in filters in projects is because that doesn't exist | 20:59 |
| fungi | clarkb: ibm has more than one (possibly severa) | 20:59 |
| fungi | l | 20:59 |
| sdague | which I realize you and I differ on opinions on | 21:00 |
| lifeless | sdague: I don't have a different opinion | 21:00 |
| lifeless | sdague: I just haven't had /time/ to do the required work. | 21:00 |
| lifeless | sdague: *nor* do I have real evidence that bzr is the problem - dims put a patch forward for subunit overnight, for instance. | 21:00 |
| lifeless | sdague: testtools for isntance, is git, and we've seen about 3 patches from openstack land for it. | 21:01 |
| sdague | lifeless: it's not where we typically are having issues | 21:01 |
| sdague | or want enhancements | 21:01 |
| sdague | anyway, again, I said we differ on opinions on that, per your response. | 21:01 |
| sdague | there were a number of folks that were interested when mtreinish and I talked about doing a stackforge project to build this kind of ui in montreal, that had no interest in looking at bzr. It's not just me that considers that a non starter | 21:02 |
| sdague | will they all materialize, no idea | 21:02 |
| lifeless | so, right now, my time is short. Do you want to talk meta, or the specific feature? | 21:03 |
| lifeless | I'm fine with either, can't do both. | 21:03 |
| *** dane has joined #openstack-infra | 21:03 | |
| sdague | the specific feature is fine | 21:04 |
| HenryG | clarkb: I am getting Dane from cisco online to discuss about the multiple accounts | 21:04 |
| dane | Hello | 21:04 |
| HenryG | dane: I think clarkb has stepped out for lunch | 21:04 |
| HenryG | hang around and I'm sure he'll ping you when he returns. | 21:05 |
| dane | Will do | 21:05 |
| openstackgerrit | Matt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for bug 1267537 https://review.openstack.org/69979 | 21:07 |
| *** SumitNaiksatam has joined #openstack-infra | 21:09 | |
| *** freyes has quit IRC | 21:10 | |
| *** SumitNaiksatam has left #openstack-infra | 21:10 | |
| *** lcheng has joined #openstack-infra | 21:10 | |
| openstackgerrit | Dina Belova proposed a change to openstack-infra/config: Setup tarballs and release jobs for Climate https://review.openstack.org/69980 | 21:11 |
| *** jcooley_ has quit IRC | 21:11 | |
| *** jcooley_ has joined #openstack-infra | 21:12 | |
| *** thuc has joined #openstack-infra | 21:13 | |
| *** thuc has quit IRC | 21:13 | |
| *** thuc has joined #openstack-infra | 21:14 | |
| openstackgerrit | Matt Riedemann proposed a change to openstack-infra/elastic-recheck: Adjust query for bug 1253482 https://review.openstack.org/69984 | 21:15 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Extend fingerprint for bug 1274056 https://review.openstack.org/69957 | 21:16 |
| *** DinaBelova is now known as DinaBelova_ | 21:17 | |
| *** denis_makogon_ has joined #openstack-infra | 21:18 | |
| sdague | clarkb: when you get back, let me know. Wanted to talk about grenade log indexing, as I had a thought. | 21:19 |
| *** AlexF_ has quit IRC | 21:20 | |
| *** oubiwann_ has quit IRC | 21:20 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Adjust query for bug 1253482 https://review.openstack.org/69984 | 21:20 |
| *** lcheng has quit IRC | 21:20 | |
| *** mattoliverau has quit IRC | 21:21 | |
| *** slong has quit IRC | 21:30 | |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/config: Setup tarballs and release jobs for Climate https://review.openstack.org/69980 | 21:36 |
| clarkb | sdague: here | 21:37 |
| clarkb | HenryG: dane: Hi, I ask because one account can do what two can do as far as Gerrit is concnered | 21:38 |
| ewindisch | anyone have time to give me a service account? - https://bugs.launchpad.net/openstack-ci/+bug/1273264 | 21:38 |
| sdague | clarkb: hey | 21:38 |
| sdague | so, instead of adding all the grenade files | 21:38 |
| sdague | could we make the indexer try the grenade locations for all the files as well? | 21:38 |
| dane | clarkb, would it be okay if we use one account, but perhaps sent 2 (or more) votes for a given commit? | 21:38 |
| clarkb | sdague: yes, it will triple the number of HTTP GETs but we can do that | 21:39 |
| ewindisch | or point me to the right repo and Ill submit a change request | 21:39 |
| clarkb | ewindisch: we don't have that automated yet. Need to wait for a human to sweep through the list and create the accounts | 21:39 |
| sdague | clarkb: we know the jobname? | 21:39 |
| sdague | we could probably just do that on grenade jobs | 21:39 |
| *** AlexF_ has joined #openstack-infra | 21:39 | |
| clarkb | sdague: we do, jeblair didn't likefiltering on that (though the ability to filter on that is still in the logstash client iirc) | 21:40 |
| clarkb | sdague: why don't I push a chagne that does that then we can argue over it in review :) | 21:40 |
| dane | clarkb: We have at least 5 different plugins to test (at the moment), it's going to be very tricky to orchestrate testing for all of those to create one vote | 21:40 |
| clarkb | I am happy to do it that way though | 21:40 |
| sdague | clarkb: sounds great | 21:40 |
| clarkb | dane: if you have a single zuul it sin't tricky at all | 21:40 |
| sdague | yeh, that would let us keep all the existing queries | 21:40 |
| clarkb | dane: but yeah one account can vote multiple times too | 21:40 |
| sdague | and they would just work in grenade, because the filenames would be the same as regular jobs | 21:41 |
| clarkb | sdague: well thefilename will change | 21:41 |
| sdague | clarkb: can we keep the filename? | 21:41 |
| stevebaker | clarkb: hey, has there been a node rebuild since the iptables change landed | 21:41 |
| stevebaker | ? | 21:41 |
| sdague | strip the old & new ? | 21:41 |
| clarkb | sdague: not in the scenario I describe | 21:41 |
| clarkb | stevebaker: I think so, fungi triggered them | 21:41 |
| sdague | I thought we assign the filename var for the metadata | 21:41 |
| sdague | so we could modify it | 21:42 |
| clarkb | sdague: we don't it comes from the filename in the config which is used to find the file on the logs server | 21:42 |
| clarkb | if filename != log server you get no files. obviously we can update that but updating it to special case grenade is special | 21:42 |
| dane | clarkb: If we can vote multiple times, that would make it easier (we can uncouple the testing for now... I'm not familiar with Zuul, so there would be a learning curve for that). The only minor concern is that we'd have only one contact alias, but there would be several separate groups handling the various plugins. | 21:44 |
| ewindisch | clarkb: understood, I'm just trying to get the process speed up a bit - we're risking ejection from Nova, so I'm hesitant to passively wait for someone to notice the bug. | 21:45 |
| clarkb | dane: in that case I am fine with mutliple accounts. | 21:45 |
| clarkb | dane: just want to make sure we don't have multiple accounts for multiple accounts sake | 21:45 |
| sdague | clarkb: hmmmm... | 21:45 |
| sdague | well, I guess it would be a start | 21:45 |
| clarkb | sdague: ya worst case we hate it and do something different, best case it works great and we are all happy | 21:46 |
| *** pblaho has joined #openstack-infra | 21:46 | |
| dane | Okay, we'll try to minimize accounts to be the same as the number of different contact groups. | 21:46 |
| *** CaptTofu has quit IRC | 21:46 | |
| *** e0ne has joined #openstack-infra | 21:46 | |
| *** CaptTofu has joined #openstack-infra | 21:47 | |
| *** e0ne has quit IRC | 21:50 | |
| *** hashar has quit IRC | 21:50 | |
| ewindisch | clarkb: is it a problem if I just register my own account in gerrit for this? | 21:52 |
| ewindisch | (not my "own" personal account, but a new one) | 21:52 |
| clarkb | ewindisch: that won't let you vote in the verified column | 21:53 |
| clarkb | sdague: I lied we seem to have removed the filtering based on job name | 21:54 |
| ewindisch | clarkb: it's non-voting for the moment, anyway | 21:54 |
| clarkb | sdague: but I can add it back in in the same change | 21:54 |
| sdague | clarkb: cool | 21:54 |
| *** VijayT has quit IRC | 21:55 | |
| *** rhsu1 has joined #openstack-infra | 21:58 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: direct link the job console if the job is running https://review.openstack.org/69989 | 21:59 |
| *** Alexei_987 has quit IRC | 22:00 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 22:01 | |
| annegentle | hey infra-ers, if you had to guess the number of daily hits to git.openstack.org and review.openstack.org what would it be? | 22:01 |
| annegentle | it's not really "visitors" so "hits" might be the right term | 22:02 |
| *** AlexF_ has quit IRC | 22:02 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Add grenade logs to logstash. https://review.openstack.org/69991 | 22:03 |
| devananda | sdague: i think i saw mention of this earlier - just want to check - you guys are working on a fix for the kernel bug that's causing all the timeouts, yes? | 22:03 |
| clarkb | annegentle: I would think it is quite large since our test systems hit them | 22:03 |
| sdague | devananda: this is the neutron one? | 22:04 |
| *** oubiwann_ has joined #openstack-infra | 22:04 | |
| sdague | devananda: Bug 1273386 - Neutron namespace metadata proxy triggers kernel crash on Ubuntu 12.04/3.2 kernel ? | 22:04 |
| devananda | sdague: the one i've got looks very similar, but not exactly the same trace: http://logs.openstack.org/95/69495/3/gate/gate-tempest-dsvm-ironic-postgres/7a5019e/logs/kern_log.txt.gz | 22:06 |
| *** pblaho has quit IRC | 22:06 | |
| *** VijayT has joined #openstack-infra | 22:07 | |
| devananda | sdague: ah yea, "kernel BUG at /build/buildd/linux-3.2.0/fs/buffer.c:2917" is the same. | 22:07 |
| devananda | i'll start using that bug id instead of the general "thing took too long" one | 22:07 |
| *** AlexF_ has joined #openstack-infra | 22:08 | |
| sdague | devananda: it would be interesting to know if it showed up in non neutron cases | 22:11 |
| sdague | and it was a more fundamental bug | 22:11 |
| sdague | russellb has a proposal to build a new nodepool set with the lts-saucy kernel to see if it goes away | 22:12 |
| russellb | sdague: that merged | 22:12 |
| sdague | cool | 22:12 |
| russellb | we should be able to run experimental rechecks now | 22:12 |
| russellb | hadn't really looked because of other gate problems today though | 22:12 |
| sdague | great | 22:12 |
| sdague | yep, fair | 22:12 |
| russellb | what's the command again? | 22:13 |
| sdague | check experimental | 22:13 |
| clarkb | wenlock: reviewed. sorry it took so long | 22:13 |
| russellb | i can try one to make sure it runs, but would really like some neutron folks to chase it from there .... | 22:13 |
| russellb | salv-orlando: ^^^ | 22:13 |
| wenlock | clarkb, woot, no worries... checking it out now | 22:13 |
| sdague | russellb: sure, which projects is it attached to? | 22:13 |
| *** cody-somerville has joined #openstack-infra | 22:13 | |
| russellb | sdague: just neutron | 22:13 |
| clarkb | russellb: sdague: there were name problems iwth the host that fungi debugged earlier | 22:13 |
| clarkb | did those problems get fixed? | 22:13 |
| clarkb | if not I can chase them down | 22:13 |
| sdague | clarkb: I do not know | 22:14 |
| devananda | sdague: http://logs.openstack.org/95/69495/3/gate/gate-tempest-dsvm-ironic-postgres/7a5019e/logs/kern_log.txt.gz | 22:14 |
| russellb | oh sorry, no, i didn't see that | 22:14 |
| russellb | clarkb: ^ | 22:14 |
| * clarkb looks | 22:14 | |
| clarkb | fungi: ^ | 22:14 |
| russellb | there are some experimental runs going right now for neutron patches | 22:14 |
| salv-orlando | russellb: we'll find somebody. I and markmcclain looked at the experimental builds, unfortunately the ovs 1.4.0 we used to ran needs to be recompiled for the saucy kernel, or we might just install the saucy openvswitch as well | 22:15 |
| salv-orlando | anyway, I've added my report to the bug, markmcclain will likely take it while I'm sleeping | 22:15 |
| russellb | oh, d'oh | 22:15 |
| russellb | one seemed to pass though .... | 22:15 |
| russellb | https://jenkins07.openstack.org/job/experimental-tempest-dsvm-neutron/4/ | 22:16 |
| clarkb | wait, the older ovs package installs when the new kernel is in place? that is fun | 22:16 |
| clarkb | russellb: oh cool so the nodes are fixed | 22:16 |
| russellb | you'd think package deps would fix that ... | 22:17 |
| russellb | clarkb: great thanks | 22:17 |
| clarkb | russellb: I was just logging into the nodepool server to check, but that slave has the new name so you should be good | 22:17 |
| russellb | salv-orlando: no occurrence of the kernel error in this one log that passed at least | 22:17 |
| russellb | and this one failed: https://jenkins07.openstack.org/job/experimental-tempest-dsvm-neutron-pg/4/ | 22:17 |
| russellb | Jan 29 21:00:48 dsvm-precise-krnl-rax-dfw-1241316 kernel: [ 1315.872310] kernel BUG at /build/buildd/linux-lts-saucy-3.11.0/fs/buffer.c:3005! | 22:18 |
| russellb | though that's a filesystem error ... lovely | 22:18 |
| devananda | sdague: i think this has hit every patch that we've tried to check or approve in Ironic, in the last few days | 22:19 |
| *** mattoliverau has joined #openstack-infra | 22:19 | |
| sdague | devananda: interesting | 22:19 |
| russellb | clarkb: salv-orlando at least we know it is definitely running the new kernel | 22:19 |
| jog0 | isn't the debugging the gate fun | 22:19 |
| salv-orlando | technically without a kernel bug we don't know the version :) | 22:19 |
| salv-orlando | I could have read it from sys stat screen | 22:20 |
| salv-orlando | but with the new kernel screen-sysstat is empty | 22:20 |
| clarkb | russellb: salv-orlando: and whoever else, if you check experimental and tell me the change number I am happy to hold slaves if that becomes necessary | 22:20 |
| mattoliverau | good morning | 22:20 |
| clarkb | for people to do on system debugging | 22:20 |
| anteaya | morning mattoliverau | 22:20 |
| annegentle | clarkb: 1 million a day? PRolly? | 22:20 |
| devananda | sdague: short link to the logstash search: http://bit.ly/1dOQKBZ | 22:20 |
| sdague | salv-orlando: it's empty on the old ones too... I was just looking at that | 22:20 |
| russellb | clarkb: cool thanks | 22:20 |
| clarkb | annegentle: I wouldn't be surprised | 22:20 |
| openstackgerrit | Dolph Mathews proposed a change to openstack-infra/elastic-recheck: eliminate false positives for bug 1253482 https://review.openstack.org/69997 | 22:20 |
| sdague | devananda: so can you timestamp corolate to what you are doing when it happens? | 22:21 |
| mattoliverau | morning anteaya, other day in the Sydney office, may be in and out of meetings today. | 22:21 |
| * fungi has resurfaced... skimming scrollback now | 22:21 | |
| devananda | russellb: that's a different line # than I'm seeing | 22:21 |
| mattoliverau | s/other/another/ | 22:21 |
| devananda | sdague: sure. ANYTHING. | 22:21 |
| anteaya | mattoliverau: hope you are enjoying sydney | 22:21 |
| devananda | sdague: i've been trying to land this fix for the stevedore issue: https://review.openstack.org/#/c/69495/ | 22:21 |
| clarkb | anteaya: the git.o.o haproxy log for today has almost one million lines in it | 22:22 |
| clarkb | er annegentle ^ | 22:22 |
| *** lcheng has joined #openstack-infra | 22:22 | |
| *** olaph has joined #openstack-infra | 22:22 | |
| clarkb | annegentle: I am not an haproxy expert but I think if you ignore errors that indicates about one million connects to the git.o.o site | 22:22 |
| annegentle | clarkb: ok that sounds right | 22:22 |
| clarkb | annegentle: remembre though that many of those connections are from test slaves | 22:22 |
| annegentle | clarkb: yeah not real people | 22:23 |
| *** lcheng has quit IRC | 22:23 | |
| devananda | sdague: short link for patchset 69495 search for tha tkernel bug: http://bit.ly/LpIGBw | 22:23 |
| fungi | stevebaker: clarkb: all of the current nodepool nodes should have the iptables update (we had to correct that patch last night, but images have rebuilt successfully since). if you see evidence it's not working, i can log onto a node and iptables -L to be sure | 22:23 |
| *** smarcet has left #openstack-infra | 22:23 | |
| sdague | clarkb: how do I do a timestamp query in logstash? | 22:24 |
| sdague | range query | 22:24 |
| devananda | pretty sure that's every time I've tried to reverify this patch, at least one and sometimes all of the tempest checks hit a kernel bug | 22:24 |
| salv-orlando | russellb: actually the 2nd experimental run did not spit ovs errors. Which might mean the 1.4 build works and for some reason the other nodes previously used were not prepared correctly. Still we see the usual failure | 22:24 |
| *** lcheng has joined #openstack-infra | 22:24 | |
| clarkb | sdague: field:[VALUE TO VALUE] | 22:25 |
| zaro | fungi: i've replied to gerrit forum post. | 22:25 |
| *** cody-somerville has quit IRC | 22:25 | |
| devananda | i'm wondering how other projects aren't getting completely blocked like this | 22:25 |
| russellb | salv-orlando: so, the usual failure, but not the kernel bug | 22:25 |
| devananda | russellb: are you able to land anything in nova right now? | 22:25 |
| russellb | devananda: i think so | 22:25 |
| fungi | annegentle: if you really want numbers from git.o.o and review.o.o i can do some quick digesting of apache logs to put together numbers, but off the top of my head i couldn't even begin to guess. clarkb's "very large" sounds as accurate as i'd manage too | 22:25 |
| sdague | clarkb: thanks | 22:26 |
| clarkb | fungi: haproxy log if I read it correctly says 989 thousandish connections today | 22:26 |
| russellb | clarkb: nice | 22:27 |
| sdague | devananda: so here is the 10 seconds (5 on either side) around one of those crashes | 22:28 |
| sdague | http://logstash.openstack.org/#eyJzZWFyY2giOiJAdGltZXN0YW1wOlsgMjAxNC0wMS0yOVQyMToxNzo1NiBUTyAyMDE0LTAxLTI5VDIxOjE4OjA2XSBBTkQgYnVpbGRfY2hhbmdlOjY5NDk1IiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiIxNzI4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxMzkxMDM0NDI5MTQyLCJtb2RlIjoiIiwiYW5hbHl6ZV9maWVsZCI6IiJ9 | 22:28 |
| fungi | russellb: clarkb: sdague: the only issue we addressed was rackspace forcing fqdn for hostname, which ended up being too long and got truncated, resulting in job failures. that's been addressed by markmcclain's patch which i merged and new images/nodes were subsequently rebuilt | 22:28 |
| sdague | looks like the last think logged was a neutron port disconnect | 22:28 |
| stevebaker | fungi: the test is still failing. Search for "Return code of 7 after executing" in https://jenkins02.openstack.org/job/gate-tempest-dsvm-neutron-heat-slow/24/consoleFull | 22:28 |
| russellb | fungi: thanks for the help! | 22:28 |
| devananda | very interesting. this is showing up in all the check-tempest-dsvm-ironic runs, but *not* the check-tempest-dsvm-full runs | 22:28 |
| devananda | but ironic shouldn't be doing anything with the network at this point ... | 22:28 |
| salv-orlando | russellb: ha I got mixed up reading logs | 22:29 |
| sdague | devananda: do both use neutron? | 22:29 |
| devananda | sdague: lemme check | 22:29 |
| sdague | neutron is definitely running in this one I'm looking at | 22:29 |
| fungi | salv-orlando: a 'uname -r' in devstack-gate (around where the ip diagnostics are output in the wrap script) might be a useful addition | 22:29 |
| sdague | as we have q-agnt logs | 22:29 |
| stevebaker | fungi: it might need spinning up a devstack in a node and poking at it until port 8000 can be reached from a vm | 22:29 |
| stevebaker | fungi: but I don't know if that is easy or possible | 22:29 |
| *** slong has joined #openstack-infra | 22:30 | |
| *** AlexF_ has quit IRC | 22:30 | |
| salv-orlando | fungi: sure. I actually was going to do that, but if you want to go ahead that will give me 5 minutes extra sleep tonight | 22:30 |
| sdague | jnoller: so do they keep changing the perf image? | 22:30 |
| sdague | because I just tried to spin one up again, and it was gone | 22:30 |
| salv-orlando | russellb: this log -> http://logs.openstack.org/53/69653/2/experimental/experimental-tempest-dsvm-neutron-pg/a11f72f | 22:30 |
| salv-orlando | contains the usual error message, but kernel shows no crash | 22:30 |
| russellb | ok | 22:31 |
| russellb | so can't blame kernel anymore then? | 22:31 |
| russellb | worth a shot | 22:31 |
| salv-orlando | however n-cpu fails because: http://logs.openstack.org/53/69653/2/experimental/experimental-tempest-dsvm-neutron-pg/a11f72f/logs/screen-n-cpu.txt.gz#_2014-01-29_19_33_11_270 | 22:31 |
| salv-orlando | and this happens because ovs-vswitchd is NOT running | 22:31 |
| salv-orlando | also notice the dns resolution error | 22:31 |
| russellb | salv-orlando: i think that has since been fixed | 22:32 |
| *** CaptTofu has quit IRC | 22:32 | |
| russellb | salv-orlando: i think that's what fungi was talking about a minute ago | 22:32 |
| salv-orlando | russellb: and this other thing, which you surely understand more than me: http://logs.openstack.org/53/69653/2/experimental/experimental-tempest-dsvm-neutron-pg/a11f72f/logs/screen-n-cpu.txt.gz#_2014-01-29_19_30_39_259 | 22:32 |
| *** AlexF_ has joined #openstack-infra | 22:32 | |
| russellb | salv-orlando: oh, fun ... | 22:33 |
| salv-orlando | russellb, fungi: correct, that's the issue. I'm not sure if that also the reason why openvswitch appears to not be running though | 22:33 |
| *** julim has quit IRC | 22:33 | |
| salv-orlando | I guess if we fail to inject the key we will hardly be able to ssh into the vm afterwards | 22:33 |
| salv-orlando | the other test in the same suite instead failed for a different error: http://logs.openstack.org/53/69653/2/experimental/experimental-tempest-dsvm-neutron-pg-isolated/3ff11e7/console.html | 22:34 |
| salv-orlando | ovs was running and no dns resolution error | 22:34 |
| salv-orlando | fungi: I guess that's perhaps because it was running in the hp cloud? | 22:34 |
| fungi | stevebaker: clarkb: oh, you know what? if it ran on hpcloud-az2 it wouldn't have been updated... we're having persistent issues getting successful image builds there. i can delete the existing images on that provider to get it to start looping until it gets a working image, but it may take a while | 22:35 |
| sdague | fungi / clarkb: when you get a sec, we seem extra backed up on py26 in the gate. I wonder if we lost our only valid nodes or something | 22:37 |
| fungi | salv-orlando: "devstack-precise-saucy-kernel-rax-dfw-1237817" means that one ran in rackspace (we only bothered to add them to rax-dfw anyway) | 22:37 |
| sdague | it looks like at least 4 are running actually, but not sure how many we should have | 22:37 |
| stevebaker | fungi: OK, I'll hang tight then | 22:38 |
| fungi | salv-orlando: also, that was with the old image. the new ones would be named dsvm-precise-krnl-rax-dfw-######## | 22:38 |
| clarkb | sdague: several of them are hung up on not having the latest scp plugin installed | 22:38 |
| sdague | ah | 22:38 |
| clarkb | sdague: I will kill those jobs to get things moving | 22:38 |
| sdague | cool, thanks! | 22:38 |
| openstackgerrit | Devananda van der Veen proposed a change to openstack-infra/config: Remove Neutron from Ironic tempest test pipelines https://review.openstack.org/70001 | 22:38 |
| clarkb | and I really really need to update that plugin everywhere. It is just so hard when things are pulling me in 50 directions :/ | 22:39 |
| devananda | clarkb: IIUC, that ^ will make Ironic's tempest tests stop breaking with Neutron bugs... | 22:39 |
| fungi | stevebaker: i can confirm that log you linked ran on a slave in hpcloud-az2, where the images are ~ a week stale | 22:39 |
| clarkb | devananda: doesn't ironic need neutron? | 22:41 |
| clarkb | devananda: maybe I am mixing up ironic and tripleo | 22:41 |
| fungi | clarkb: i'm going to delete the images in hpcloud-az2 so nodepool will get busy retrying to get fresh ones to stick, but we will be dropping aggregate quota by a couple hundred nodes fairly soon once that happens (since it won't be able to add new nodes there until it works) | 22:41 |
| devananda | clarkb: a) yes, but b) we don't have tempest tests for it yet, and c) we can't land the patch that actually enables ironic's use of neutron because neutron is crashing the kernel in every test | 22:42 |
| sdague | fungi: we're good on overall d-g pool, loosing the quota shouldn't hurt us | 22:42 |
| *** rcleere has quit IRC | 22:42 | |
| fungi | sdague: agreed, that's why i'm not too worried, just making sure it's known | 22:42 |
| sdague | ack | 22:43 |
| fungi | the stale images hurt us more, definitely | 22:43 |
| devananda | clarkb: if we were actually using neutron today, i'd think more carefully about removing it from our tempest tests. | 22:43 |
| clarkb | fungi: ok | 22:44 |
| clarkb | devananda: roger | 22:44 |
| devananda | clarkb: even then, i might -- i know folks are working on fixing https://bugs.launchpad.net/nova/+bug/1273386 but right now this has blocked all ironic patches since we enabled tempest in ironic's gate | 22:44 |
| *** openstackstatus has quit IRC | 22:44 | |
| fungi | clarkb: for the record, prior to deletion the bare-precise node there was 210.15 hours old and the devstack-precise image was 139.88 hours old | 22:44 |
| sdague | clarkb: the py26 nodes flowed into the gate, thanks | 22:45 |
| clarkb | wow | 22:45 |
| clarkb | sdague: np, I am going to put jenkins03 out to pasture now so that I can restart it with new SCP plugin then do 02 when things settle down a bit | 22:45 |
| clarkb | since 02 has py26 slaves | 22:45 |
| clarkb | fungi: ^ | 22:45 |
| salv-orlando | fungi: thanks for clarifying. The logs I've been looking at have a lot of ovs errors (protocol errors while connecting to the service), but perhaps it's better to recheck on new images | 22:46 |
| salv-orlando | As markmcclain patch got merged, I guess they're good to use now? | 22:46 |
| pleia2 | fungi, clarkb - when you have a moment (if such a time exists), I have been updating https://etherpad.openstack.org/p/fedora-on-gate with issues I'm running into, would appreciate some eyeballs to make sure I'm not going to far into the weeds, main problem at the moment is no puppet 2.7 on Fedora 20 | 22:46 |
| fungi | salv-orlando: yes | 22:46 |
| salv-orlando | cool | 22:46 |
| clarkb | pleia2: ok pulling it up now | 22:47 |
| fungi | clarkb: yeah, we need to re-add the dead centos6 nodes that got deleted from jenkins01-02 in previous restarts. meant to do that and then got sidetracked | 22:47 |
| fungi | pleia2: right, i encountered the same problem. also newer default ruby interpreter which made it coexist poorly with older puppet | 22:48 |
| pleia2 | fungi: yeah, so I'm *hoping* we can just nudge configs enough to work ok with puppet3 on fedora | 22:48 |
| clarkb | fungi: ok, I will try to add that to my list too :) | 22:49 |
| *** mrda_away is now known as mrda | 22:49 | |
| pleia2 | fedora is being mean to me though D: | 22:49 |
| fungi | pleia2: i suggest becoming bestest pals with AaronGr | 22:49 |
| pleia2 | fungi: good idea | 22:49 |
| *** dangers is now known as dangers_away | 22:49 | |
| fungi | see if you can convince him to help whitewash that fence | 22:49 |
| * fungi needs to step away for a few and cook dinner, but will be back soon to continue reducing the broken a little | 22:50 | |
| clarkb | oh man | 22:51 |
| clarkb | do we need to puppet3 now? | 22:51 |
| openstackgerrit | Elizabeth Krumbach Joseph proposed a change to openstack-infra/config: Update some deprecated Puppet variable references https://review.openstack.org/70007 | 22:51 |
| clarkb | pleia2: I have a hunch that we can puppet3 ize the slave manifests fairly easiliy | 22:52 |
| pleia2 | AaronGr: could you take a look at this when you have a moment? I'm quite sure it won't cause 2.7 to explode, but confirmation would be nice :) | 22:52 |
| clarkb | pleia2: before worrying about puppet3 everywhere | 22:52 |
| clarkb | but that is a hunch I have no real data | 22:52 |
| pleia2 | clarkb: good, I'm on the right track then | 22:52 |
| pleia2 | at least for now :) | 22:52 |
| AaronGr | clarkb, pleia2 - i tried puppet3 against upstream, and there wasn't much to be worried over, based on extremely limited testing. | 22:52 |
| AaronGr | pleia2: checking your patch | 22:52 |
| clarkb | woot AaronGr has hard data :) | 22:53 |
| pleia2 | I don't know what to do with these pip errors | 22:53 |
| pleia2 | it seems to run get-pip.py fine | 22:53 |
| pleia2 | I even tried installing the python-pip package in fedora20, still errors | 22:53 |
| *** mfink has quit IRC | 22:53 | |
| clarkb | pleia2: is it possibly caching the pip location? | 22:53 |
| clarkb | like puppet things it isn't there beacuse it checked before it installed the stuff | 22:54 |
| clarkb | iirc the pip provider may do something silly like that | 22:54 |
| pleia2 | clarkb: hm, maybe | 22:54 |
| jog0 | sdague: quick JS question if you have a minute | 22:54 |
| sdague | jog0: sure | 22:54 |
| dstufft | pip errors? | 22:55 |
| clarkb | dstufft: I don't think it is pips fault | 22:55 |
| pleia2 | it's puppet's fault ;) | 22:55 |
| clarkb | puppet says it can't find pip even though pip is in /usr/bin/pip | 22:55 |
| dstufft | oh | 22:56 |
| dstufft | carry on then :] | 22:56 |
| dstufft | I like when things turn out to be someone elses fault | 22:57 |
| jog0 | sdague: I will ahve the code up soon | 22:57 |
| jog0 | but for https://review.openstack.org/#/c/69735/3 | 22:57 |
| jog0 | http://paste.openstack.org/show/62054/ | 22:57 |
| jog0 | I have tabs | 22:57 |
| jog0 | going to start with two: all queues and gate queue | 22:57 |
| jog0 | and I don't know how to change which tab has the active class | 22:57 |
| *** oubiwann_ has quit IRC | 22:57 | |
| jog0 | sdague: in short I will have a patch that has the code working soon, but the JS won't be finished | 22:58 |
| *** hogepodge has quit IRC | 22:58 | |
| openstackgerrit | A change was merged to openstack-infra/config: Remove Neutron from Ironic tempest test pipelines https://review.openstack.org/70001 | 23:00 |
| sdague | jog0: so is this going to be multiple html files? | 23:02 |
| *** hogepodge has joined #openstack-infra | 23:02 | |
| sdague | jog0: so what I think we want | 23:03 |
| *** mfink has joined #openstack-infra | 23:03 | |
| sdague | graph takes a -q param for queues to limit to | 23:03 |
| sdague | the config repo gets updated with another command to run to build a 2nd json data set | 23:03 |
| *** oubiwann_ has joined #openstack-infra | 23:03 | |
| sdague | we have a 2nd html page | 23:03 |
| *** dizquierdo has joined #openstack-infra | 23:04 | |
| sdague | and we do the active tab selection similar to how it's done for status.o.o, there is a js function for that. You'd just be targetting a different div | 23:04 |
| *** oubiwann_ has quit IRC | 23:05 | |
| jog0 | sdague: I can do multiple files but was moching something up to just be one | 23:06 |
| *** dane_ has joined #openstack-infra | 23:06 | |
| jog0 | mocking | 23:06 |
| jog0 | sdague: that is much easier | 23:07 |
| jog0 | give me 5 minutes | 23:07 |
| jog0 | and I will ahve it | 23:07 |
| sdague | jog0: sure | 23:07 |
| sdague | well, if we did it multiply, then we can add in the uncategorized as a tab | 23:07 |
| sdague | which would be *win*! | 23:07 |
| *** sarob_ has joined #openstack-infra | 23:07 | |
| *** AlexF_ has quit IRC | 23:08 | |
| *** dcramer_ has quit IRC | 23:08 | |
| *** sarob__ has joined #openstack-infra | 23:09 | |
| *** dane has quit IRC | 23:09 | |
| jog0 | sdague: so only JS question now is: | 23:10 |
| *** sarob has quit IRC | 23:11 | |
| jog0 | how do I make the graph.json URL change based on the apge | 23:11 |
| jog0 | apge | 23:11 |
| jog0 | page | 23:11 |
| jog0 | presumablly pass in a variable from the html page to the js function | 23:11 |
| jog0 | but ? | 23:11 |
| sdague | yeh, that's the right way. You could be lame and define the data file inline | 23:12 |
| sdague | in a script tag at the top of the html | 23:12 |
| sdague | then have the js pick up the var from there | 23:12 |
| sdague | it's all one namespace | 23:12 |
| *** sarob_ has quit IRC | 23:12 | |
| sdague | i.e. it's all global | 23:12 |
| sdague | the right way to do this is with some js templates, I might try working on that on the plane on Sunday | 23:13 |
| jog0 | can you comment on https://review.openstack.org/#/c/69735/3 | 23:13 |
| jog0 | with your idea | 23:13 |
| jog0 | korea? | 23:13 |
| *** malini is now known as malini_afk | 23:13 | |
| *** andreaf has quit IRC | 23:14 | |
| *** andreaf has joined #openstack-infra | 23:15 | |
| *** dizquierdo has quit IRC | 23:17 | |
| *** ryanpetrello has quit IRC | 23:17 | |
| harlowja | qq for u guys, about zookeeper access inside tests | 23:18 |
| harlowja | from what i see the tooz project doing, is that they actually start zookeeper using there run_tests.sh | 23:19 |
| harlowja | and i was wondering if like mysql/postgres we can just have it running? | 23:19 |
| harlowja | so it can be conditionally used by tests | 23:19 |
| *** krtaylor has quit IRC | 23:22 | |
| *** denis_makogon_ has quit IRC | 23:24 | |
| *** sarob__ has quit IRC | 23:24 | |
| *** prad__ has joined #openstack-infra | 23:25 | |
| *** sarob has joined #openstack-infra | 23:25 | |
| *** dane_ has quit IRC | 23:25 | |
| *** jgrimm has quit IRC | 23:27 | |
| *** prad has quit IRC | 23:27 | |
| *** prad__ is now known as prad | 23:27 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Add new job to build the javamelody gerrit plugin https://review.openstack.org/70014 | 23:28 |
| jog0 | sdague: multi page is working | 23:28 |
| *** ken1ohmichi has joined #openstack-infra | 23:28 | |
| jog0 | patch up soon | 23:28 |
| anteaya | what server is manage projects supposed to run on when it is fully automated? | 23:28 |
| *** jamielennox|away is now known as jamielennox | 23:29 | |
| zaro | fungi: question about this.. https://review.openstack.org/#/c/70014/1/modules/openstack_project/files/zuul/layout.yaml | 23:30 |
| *** sarob has quit IRC | 23:30 | |
| zaro | fungi: not sure about the name, does it have to be in our gerrit? | 23:30 |
| *** sarob has joined #openstack-infra | 23:31 | |
| *** weshay has quit IRC | 23:31 | |
| clarkb | I haven't done jenkins03 yet, being distracted | 23:36 |
| jnoller | sdague: we officially released the HVM versions today; these are the final IDs | 23:36 |
| clarkb | should be ok though there are a bunch of masters | 23:36 |
| sdague | jnoller: yeh, I saw them in image list | 23:36 |
| jnoller | sdague: email me if questions must go home finally | 23:36 |
| *** jnoller has quit IRC | 23:36 | |
| sdague | key injection failed when I tried | 23:37 |
| *** sarob has quit IRC | 23:37 | |
| sdague | or at least changed from the way we used to be able to do it | 23:37 |
| *** homeless has quit IRC | 23:37 | |
| zaro | clarkb: would like your opinion on this https://review.openstack.org/#/c/61321 | 23:38 |
| *** dkranz has quit IRC | 23:39 | |
| *** sarob has joined #openstack-infra | 23:40 | |
| *** mriedem has quit IRC | 23:41 | |
| fungi | harlowja: so... starting zookeeper on demand as the user running the tests is a bit of a security optimization i believe, since the distributions we use don't have it packaged under security support (such that we don't want it running all the time on all slaves whether it's used or not) | 23:41 |
| harlowja | hmmm | 23:41 |
| harlowja | fungi ya, looking at what tooz is doing makes me wonder if there is a better way | 23:41 |
| harlowja | basically https://github.com/stackforge/tooz/blob/master/run_tests.sh#L21 | 23:41 |
| harlowja | and then that is activated from there tox | 23:42 |
| fungi | get zookeeper supported by red hat and canonical in their server distributions? | 23:42 |
| harlowja | :) | 23:42 |
| harlowja | durn it, lol | 23:42 |
| *** hogepodge has quit IRC | 23:42 | |
| harlowja | anyway that there could be a special slave type that has zookeeper running, similar to centos6 or something? | 23:43 |
| *** prad has quit IRC | 23:43 | |
| * fungi does not really like being "hard-headed security wonk" but sometimes it's a good devil's advocate position for the sake of discussion | 23:43 | |
| harlowja | understandable | 23:43 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Add new job to build the javamelody gerrit plugin https://review.openstack.org/70014 | 23:44 |
| fungi | harlowja: possibly. i think we would probably balk at maintaining server images specific to stackforge projects, but i might also be wrong about that | 23:44 |
| *** rfolco has joined #openstack-infra | 23:44 | |
| lifeless | sdague: how do you want failures? | 23:45 |
| *** doddstack has quit IRC | 23:45 | |
| lifeless | sdague: inline, or just [failed] and read the HTML we generate separately ? | 23:45 |
| fungi | clarkb: ^ your ideas are welcome on "can we run persistent zookeeper on some subset of jenkins slaves for tooz testing" | 23:45 |
| harlowja | fungi if say taskflow is in oslo, then would that make it all better :-P | 23:46 |
| harlowja | fungi not just tooz, taskflow also | 23:46 |
| clarkb | fungi: we do run zookeeper on some subset of slaves | 23:46 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: replace jeepyb's trivial rebase gerrit hook with copyAllScoresOnTrivialRebase https://review.openstack.org/69800 | 23:46 |
| fungi | clarkb: oh, we run it on precise slaves, right? | 23:46 |
| harlowja | ah | 23:46 |
| harlowja | then i can just use it ?? | 23:46 |
| fungi | was it just rhel that didn't have zookeeper packaged? | 23:47 |
| *** mrodden has quit IRC | 23:47 | |
| sdague | lifeless: I'd like failures in the stream. we can then decide on display at the filter level | 23:47 |
| fungi | harlowja: clarkb: now that i think about it, yes there was one platform where it was available from the distro, so running it there may be fie | 23:48 |
| fungi | fine | 23:48 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: point zuul-dev to review-dev https://review.openstack.org/68271 | 23:48 |
| harlowja | fungi woot | 23:48 |
| harlowja | is there some special file i can adjust to make it run (slaves.pp?) | 23:49 |
| sdague | fungi: that seems like a good case for doing a functional test with a custom d-g script | 23:49 |
| lifeless | sdague: everything is in the stream | 23:49 |
| lifeless | sdague: I'm just doing the UI filter you wanted | 23:49 |
| sdague | lifeless: ok, yes, in the filter, displayed inline | 23:49 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/gerritlib: update replicate command and add a version command https://review.openstack.org/69768 | 23:50 |
| clarkb | harlowja: it should be running | 23:50 |
| harlowja | ah | 23:50 |
| harlowja | even better then | 23:50 |
| *** oubiwann_ has joined #openstack-infra | 23:51 | |
| *** rfolco has quit IRC | 23:51 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Add tab to only plot gate failures in status.o.o/elastic-recheck/ https://review.openstack.org/69735 | 23:52 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/jeepyb: Fix incompatibility with gerrit 2.8 https://review.openstack.org/69791 | 23:52 |
| jog0 | sdague: ^ what do you think | 23:52 |
| *** thuc has quit IRC | 23:52 | |
| *** crank has quit IRC | 23:52 | |
| jog0 | sdague: and by that I mean feel free to append the patch set to make it better | 23:52 |
| *** thuc has joined #openstack-infra | 23:52 | |
| sdague | heh | 23:52 |
| *** crank has joined #openstack-infra | 23:53 | |
| jog0 | it works, just not very DRA | 23:53 |
| *** dims has quit IRC | 23:53 | |
| jog0 | DRY | 23:53 |
| sdague | so ... I'll look in the morning if that's ok. Need to get away from computers for a bit | 23:53 |
| jog0 | sdague: cool thanks. also the config side patch still needs to be done | 23:53 |
| jog0 | but overall it appears to work well | 23:53 |
| jog0 | sdague: thanks again | 23:54 |
| fungi | anteaya: if nobody answered you yet, manage-projects runs on gerrit servers (review.o.o and review-dev.o.o in the openstack project infrastructure's case) | 23:54 |
| clarkb | zaro: https://review.openstack.org/#/c/69763/ how does that look? it is running on jenkins-dev | 23:55 |
| lifeless | mmm, did I just fine a bug. | 23:56 |
| *** thuc has quit IRC | 23:56 | |
| *** virmitio has quit IRC | 23:57 | |
| harlowja | clarkb looks at a test thats trying to use zookeeper, isn't actually getting triggered, maybe it has to be setup to run in daemon mode? | 23:57 |
| *** cadenzajon has quit IRC | 23:57 | |
| lifeless | 2014-01-29T23:57:04.980429+00:00: (4) testrepository.tests.test_repository.TestRepositoryContract.test_get_test_run_preserves_time(memory) [start] | 23:57 |
| lifeless | 2014-01-29T23:57:04.980630+00:00: (4) testrepository.tests.arguments.test_path.TestArgument.test_rejects_missing_file [success] | 23:57 |
| lifeless | I'm going to have to dig into this; I'm sure its cosmetic, but yeah... | 23:58 |
| harlowja | clarkb 'telnet localhost 2181' should connect on a slave if its running | 23:58 |
| sdague | heh | 23:58 |
| harlowja | *as a simple test | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
