| *** Masahiro has joined #openstack-infra | 00:01 | |
| *** Masahiro has quit IRC | 00:05 | |
| *** _nadya_ has joined #openstack-infra | 00:07 | |
| *** emagana has quit IRC | 00:08 | |
| *** emagana has joined #openstack-infra | 00:09 | |
| *** MarkAtwood has quit IRC | 00:09 | |
| *** emagana has quit IRC | 00:09 | |
| *** emagana has joined #openstack-infra | 00:09 | |
| reed | trove's API documentation is on github? (not, broken link http://docs.openstack.org/developer/trove/#developer-resources) but still... | 00:09 |
|---|---|---|
| *** flashgordon is now known as jogo | 00:10 | |
| *** _nadya_ has quit IRC | 00:11 | |
| anteaya | dougwig mestery sorry I wasn't around earlier, it looks like things are all arranged with fungi for the freeze and split | 00:12 |
| anteaya | dougwig: when are you going to implement the start of the freeze? | 00:13 |
| mordred | reed: https://review.openstack.org/#/c/136400/ | 00:15 |
| mordred | reed: I have a patch up to fix that | 00:15 |
| reed | mordred, thanks, is there a bug report too? | 00:15 |
| clarkb | reed: barbican too iirc | 00:16 |
| reed | mordred, now there is :) https://bugs.launchpad.net/trove/+bug/1399839 couldn't find one | 00:16 |
| uvirtbot | Launchpad bug 1399839 in trove "Link to Trove API Documentation broken in docs" [Undecided,New] | 00:16 |
| *** harlowja_ has quit IRC | 00:17 | |
| *** dalgaaf has quit IRC | 00:17 | |
| reed | mordred, your patch seems incomplete ... there is one more piece | 00:17 |
| fungi | i also found (and corrected) a lot of places in hacking/contributing/readme files which instructed new contributors to clone from github | 00:18 |
| mordred | reed: also, it seems that I may have removed too much from the README | 00:18 |
| fungi | though i'm sure there are more lurking out there i didn't find | 00:18 |
| mordred | but my laptop is about to die - so I prolly won't fix it until tomorrow | 00:18 |
| reed | mordred, my bad, it's correct from what I can see | 00:20 |
| nibalizer | clarkb: ya barbican too :/ | 00:21 |
| reed | friday afternoon sifting through questions on Ask | 00:21 |
| anteaya | SergeyLukjanov: in the renaming etherpad can we have a time in there? | 00:24 |
| anteaya | for when our gerrit downtime window is scheduled? | 00:24 |
| fungi | anteaya: starting at 1600 utc | 00:24 |
| *** melwitt has quit IRC | 00:25 | |
| *** mmaglana has joined #openstack-infra | 00:25 | |
| *** davideagnello has quit IRC | 00:25 | |
| anteaya | I will add that thanks | 00:27 |
| *** mmaglana has quit IRC | 00:30 | |
| *** dannywilson has quit IRC | 00:31 | |
| *** harlowja has joined #openstack-infra | 00:32 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Tool to list accounts voting verified https://review.openstack.org/138585 | 00:32 |
| clarkb | anteaya: ^ now passing pep8 | 00:32 |
| *** hdd has quit IRC | 00:33 | |
| anteaya | now with more cleaning power | 00:36 |
| *** david-lyle is now known as david-lyle_afk | 00:39 | |
| anteaya | I like it | 00:40 |
| anteaya | thank you | 00:40 |
| *** reed has quit IRC | 00:40 | |
| *** dmellado has quit IRC | 00:41 | |
| *** dimtruck is now known as zz_dimtruck | 00:42 | |
| *** ivar-laz_ has joined #openstack-infra | 00:43 | |
| *** dmellado has joined #openstack-infra | 00:45 | |
| *** ivar-laz_ has quit IRC | 00:45 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Log ipv6 addresses for nodes https://review.openstack.org/132307 | 00:46 |
| *** ivar-lazzaro has quit IRC | 00:46 | |
| *** Longgeek_ has joined #openstack-infra | 00:49 | |
| *** Longgeek_ has quit IRC | 00:49 | |
| *** ivar-lazzaro has joined #openstack-infra | 00:49 | |
| *** Longgeek has joined #openstack-infra | 00:50 | |
| *** otter768 has joined #openstack-infra | 00:53 | |
| *** Longgeek has quit IRC | 00:54 | |
| heyongli | anteaya, i'm not sure about the testcases, we are look for a 'fake libvirt' testing, so if it prooved not suit to put into tempest, the third party CI will be allowd to be online with thoes testcase? what the next step to do for the Intel-HW third-party CI? | 00:55 |
| *** lbiasi has quit IRC | 00:57 | |
| *** emagana has quit IRC | 00:57 | |
| heyongli | anteaya, and it's weeken, i will be offline 2 days. i'm going to check logs when i'm online. | 00:57 |
| harlowja | qq, can i get https://review.openstack.org/#/c/137693/ approved, it was already approved once, but needed rebase; if people are ok with that at the current time :) | 00:58 |
| *** otter768 has quit IRC | 00:58 | |
| *** emagana has joined #openstack-infra | 00:58 | |
| *** radez is now known as radez_g0n3 | 00:59 | |
| harlowja | much appreciated if possible | 00:59 |
| *** mmaglana has joined #openstack-infra | 00:59 | |
| clarkb | harlowja: so why not remove 33? | 01:00 |
| harlowja | clarkb i can, should i? | 01:00 |
| *** lttrl has quit IRC | 01:00 | |
| clarkb | harlowja: well the whole idea was to stop testing 33 and test 34 | 01:00 |
| harlowja | i thought that meant a larger change to 'python3-jobs' and such | 01:01 |
| harlowja | and therefore no more usage of the template there | 01:01 |
| *** salv-orlando has quit IRC | 01:01 | |
| *** shashankhegde has quit IRC | 01:01 | |
| harlowja | is that ok/not a problem? | 01:02 |
| *** Masahiro has joined #openstack-infra | 01:02 | |
| *** wenlock has quit IRC | 01:02 | |
| *** emagana has quit IRC | 01:02 | |
| clarkb | harlowja: I just see it as redundant and we can always put the template back if/when the template runs 34 | 01:02 |
| harlowja | kk | 01:02 |
| harlowja | let me adjust then | 01:03 |
| *** sarob has quit IRC | 01:03 | |
| *** pc_m has quit IRC | 01:03 | |
| anteaya | harlowja: I think jogo left you some messages in the #openstack-qa channel | 01:04 |
| anteaya | harlowja: sorry tab fail | 01:04 |
| harlowja | np :) | 01:04 |
| anteaya | heyongli: I think jogo left you some messages in the #openstack-qa channel | 01:04 |
| anteaya | heyongli: my understanding is that you are being asked to start creating a spec | 01:05 |
| anteaya | because right now noone has enough information to be able to make an accurate decison about where your testcases should go | 01:05 |
| anteaya | the decision is not saying they should not go upstream | 01:05 |
| anteaya | you are being asked to detail more information in the spec so a decision can be made | 01:06 |
| openstackgerrit | Joshua Harlow proposed openstack-infra/project-config: Enable gate/check (with voting) for taskflow-python34 https://review.openstack.org/137693 | 01:06 |
| anteaya | heyongli: does that make sense | 01:06 |
| *** emagana has joined #openstack-infra | 01:06 | |
| *** Masahiro has quit IRC | 01:06 | |
| harlowja | clarkb done | 01:06 |
| *** jerryz has joined #openstack-infra | 01:09 | |
| *** MarkAtwood has joined #openstack-infra | 01:10 | |
| *** MarkAtwood has quit IRC | 01:10 | |
| *** gyee has quit IRC | 01:13 | |
| *** alexpilotti has quit IRC | 01:20 | |
| anteaya | can anyone help me figure out what topology refers to in these jobs? https://review.openstack.org/#/c/139167/1/jenkins/jobs/devstack-gate.yaml | 01:26 |
| anteaya | I'm trying to figure out which repos will be affected by this change, but searching zuul/layout.yaml for tempest-dsvm gives me over 100 matches | 01:27 |
| anteaya | so I need to filter down a bit, problem is I can't figure out what an expected value for {topology} would be so I am having trouble guessing | 01:27 |
| *** boris-42 has quit IRC | 01:27 | |
| clarkb | anteaya: topology is the type of devstack install. all in one or all in one + ncpu are currently supported | 01:28 |
| clarkb | anteaya: in this case those jobs are used to test the second thing which is our 2node devstack test | 01:28 |
| anteaya | ah thank you | 01:30 |
| anteaya | I want to make sure that the all in one case wont' be affected | 01:30 |
| anteaya | how to I see that? | 01:30 |
| *** amcrn has quit IRC | 01:31 | |
| clarkb | the jobs are distinct so all in one is not tested by those jobs | 01:31 |
| anteaya | oh | 01:31 |
| anteaya | how can I see that? | 01:31 |
| anteaya | what is the other topology? aio? | 01:32 |
| *** sarob has joined #openstack-infra | 01:32 | |
| anteaya | or is it currently called full? | 01:32 |
| clarkb | its aio but there is no instantiation of that template with aio | 01:34 |
| anteaya | okay | 01:34 |
| clarkb | so grepping for the template name to see where it is used is how you can check that | 01:35 |
| anteaya | yes I am, well ctrl-f actually | 01:35 |
| *** emagana has quit IRC | 01:36 | |
| anteaya | so right now any use of {topology} in a macro means it is the aiopcpu devstack installation | 01:36 |
| anteaya | would it make sense to have that as a comment in the macro? | 01:36 |
| *** Ryan_Lane has quit IRC | 01:36 | |
| *** ihrachyshka has quit IRC | 01:37 | |
| clarkb | I dont think so because it could be used on other ways | 01:37 |
| clarkb | we just dont | 01:37 |
| anteaya | okay | 01:38 |
| anteaya | ansible is using it as aio-build | 01:38 |
| clarkb | they use those tamplates? | 01:39 |
| anteaya | well if we are putting a change in a macro which is reusable by either aio and aiopcpu and it is meant for just aiopcpu that creates an issue in my mind | 01:39 |
| *** Ryan_Lane has joined #openstack-infra | 01:40 | |
| anteaya | yes: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/macros.yaml#n185 | 01:40 |
| clarkb | thats a builder not a job | 01:41 |
| clarkb | the thing you asked about are jobs | 01:41 |
| clarkb | I dont thinkansible is related to this | 01:41 |
| *** emagana has joined #openstack-infra | 01:42 | |
| anteaya | sorry | 01:43 |
| anteaya | http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/os-ansible-jobs.yaml#n22 | 01:43 |
| anteaya | that is a job template | 01:44 |
| anteaya | but again it is ansible | 01:44 |
| clarkb | ya thats distinct | 01:44 |
| anteaya | just thinking of our cargo cult world is all | 01:44 |
| anteaya | okay | 01:44 |
| *** bdpayne has quit IRC | 01:45 | |
| *** Ryan_Lane has quit IRC | 01:53 | |
| *** ryanpetrello has joined #openstack-infra | 01:58 | |
| *** mase_x200 has joined #openstack-infra | 01:58 | |
| *** dimsum__ has quit IRC | 02:02 | |
| *** dimsum__ has joined #openstack-infra | 02:03 | |
| *** dimsum__ has quit IRC | 02:08 | |
| *** dannywilson has joined #openstack-infra | 02:11 | |
| clarkb | mordred the sound in that new stadium near you is pretty terrible | 02:16 |
| anteaya | for sports ball or a concert? | 02:17 |
| clarkb | sportsball | 02:17 |
| clarkb | so much echo | 02:17 |
| anteaya | gerrit signed me out and wont' let me sign back in | 02:17 |
| anteaya | I tried to with lauchpad id and got a 500 error | 02:18 |
| anteaya | oh back now, might have been just me | 02:18 |
| anteaya | not sure what happened but I'm good now | 02:19 |
| fungi | could have been launchpad openid going out to lunch briefly | 02:21 |
| fungi | certainly wouldn't be the first time | 02:21 |
| *** dannywilson has quit IRC | 02:22 | |
| *** dannywilson has joined #openstack-infra | 02:22 | |
| fungi | rax-iad is still hogging all the bare-precise nodes in building state | 02:22 |
| fungi | crazy thing is, it's just the bare-precise images | 02:23 |
| mordred | clarkb: was probably them trying to compete with the twelfth man | 02:23 |
| fungi | maybe this is something gone wrong with the snapshot it's booting | 02:23 |
| *** yamamoto has joined #openstack-infra | 02:24 | |
| *** baoli has joined #openstack-infra | 02:24 | |
| *** emagana has quit IRC | 02:24 | |
| fungi | i'm deleting the most recent one there and rebuilding it | 02:24 |
| *** SumitNaiksatam has quit IRC | 02:25 | |
| *** dannywilson has quit IRC | 02:27 | |
| *** Ryan_Lane has joined #openstack-infra | 02:28 | |
| *** yamamoto has quit IRC | 02:30 | |
| *** yamamoto has joined #openstack-infra | 02:31 | |
| *** yamamoto has quit IRC | 02:35 | |
| *** rkukura has quit IRC | 02:36 | |
| openstackgerrit | Merged openstack-infra/system-config: Switch subunit2sql to use decomposed uri https://review.openstack.org/138853 | 02:37 |
| *** patrickeast has quit IRC | 02:37 | |
| fungi | that sure took a while | 02:38 |
| *** sarob has quit IRC | 02:43 | |
| *** rkukura has joined #openstack-infra | 02:45 | |
| mordred | clarkb: I'm in a bar at the airport with sportsball, a power outlet for my laptop and deep fried artichoke hearts. it's almost civilized | 02:45 |
| mordred | clarkb: my earlier experience of watching texas almost upset kentucky while flying through the air was good - but would have been nicer if texas had done the deed | 02:46 |
| fungi | now i need to find deep fried artichoke hearts | 02:46 |
| *** jerryz has quit IRC | 02:47 | |
| mordred | fungi: yeah you do | 02:47 |
| *** jerryz has joined #openstack-infra | 02:47 | |
| fungi | i like artichoke hearts | 02:47 |
| mordred | they're really good | 02:47 |
| fungi | i like things which are fried | 02:47 |
| fungi | how can this go wrong? | 02:47 |
| mordred | I make artichokes pretty much weekly | 02:47 |
| mordred | they're so good | 02:47 |
| mordred | fungi: grilled artichokes is also good | 02:48 |
| fungi | indeed. now that i'm mostly settled in the new place i need to get my grilling schedule back into swing again | 02:48 |
| mordred | clarkb: dude. he just ran right ovver those people | 02:49 |
| mordred | fungi: grilling is better than not grilling | 02:50 |
| *** Masahiro has joined #openstack-infra | 02:50 | |
| openstackgerrit | Merged openstack-infra/project-config: Adjust wording for new Workflow URLs https://review.openstack.org/139718 | 02:51 |
| clarkb | mordred apparently he is a national champion hurdler | 02:52 |
| clarkb | so running over things is a thing that person does | 02:52 |
| mordred | indeed | 02:54 |
| *** Ryan_Lane has quit IRC | 02:54 | |
| *** otter768 has joined #openstack-infra | 02:54 | |
| mordred | clarkb: now that you say that, I'd like to express that I'm confused why more champion hurdlers are not used as running backs | 02:54 |
| mordred | seems kinda like a gimme, no? | 02:54 |
| *** Masahiro has quit IRC | 02:55 | |
| clarkb | indeed | 02:55 |
| fungi | rax-iad bare-precise image updated. also those are no longer taking forever to boot. coincidence? | 02:57 |
| fungi | looks like as soon as i deleted the one from 10 hours ago they started to boot normally | 02:58 |
| fungi | i bet nova was waiting indefinitely for access to a snapshot which wasn't getting retrieved | 02:58 |
| fungi | similar to the image issues in rax last week | 02:58 |
| *** otter768 has quit IRC | 02:58 | |
| *** mase_x200 has quit IRC | 03:02 | |
| *** yamamoto has joined #openstack-infra | 03:03 | |
| mordred | fungi: btw - when I uploaded the image to glance at rax from dib - it booted in a good amoutn of time | 03:03 |
| mordred | like, it wasn't terribly slow | 03:03 |
| fungi | sounds remarkably promising | 03:03 |
| mordred | well - hrm. that was a fairly bare image - didn't have all the git cache on it | 03:03 |
| mordred | so, maybe unconclusive | 03:03 |
| fungi | yeah, image size probably has an impact on boot time, at least if the nova host doesn't have it cached already | 03:06 |
| mordred | btw - vhd images are HUGE compared to qcow2 | 03:07 |
| *** yamamoto has quit IRC | 03:09 | |
| anteaya | dumb question time | 03:09 |
| anteaya | why do some job names have single quotes around them and some don't? http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml | 03:10 |
| mordred | anteaya: orgeon is up by 6 points | 03:10 |
| anteaya | mordred: woooo | 03:10 |
| anteaya | do we like oregon? | 03:10 |
| mordred | oh. I anticipated the question incorrectly | 03:10 |
| anteaya | that is okay, you gave a good answer | 03:10 |
| mordred | anteaya: well, clarkb likes oregon, and I'm still mad at the university of arizona from having beaten duke in basketball a few years ago | 03:10 |
| mordred | so, sure, let's all root for oregon | 03:11 |
| * anteaya wipes her brow in relief | 03:11 | |
| anteaya | yay oregon | 03:11 |
| clarkb | this game is bad though | 03:11 |
| anteaya | people be run down I hear | 03:11 |
| clarkb | I blame it being played in california :P | 03:11 |
| anteaya | being | 03:11 |
| mordred | clarkb: it's not great | 03:11 |
| clarkb | the crows is bad | 03:11 |
| clarkb | *crowd | 03:11 |
| mordred | anteaya: I think many of them do not actually need quotes | 03:11 |
| fungi | worshippers of the cult of cargo | 03:12 |
| mordred | clarkb: the crowd are all from silicon valley. they're probably all annoyed that their attendence is getting in the way of a meeting about another round of funding | 03:12 |
| anteaya | yeah okay that doesn't surprise me | 03:12 |
| clarkb | {} need quoting in yaml in some cases | 03:12 |
| anteaya | any idea what cases? | 03:13 |
| fungi | i think if a string starts with { the yaml parser will assume it's supposed to be a dict instead | 03:13 |
| anteaya | ah ha | 03:13 |
| clarkb | when you want {} in a string and { leads a token iirc | 03:13 |
| mordred | yes. that is definitely true | 03:13 |
| anteaya | a criterion | 03:13 |
| anteaya | wooo | 03:13 |
| mordred | it doesn't hurt anything to quote them | 03:13 |
| mordred | so it's a safe cult to cargo | 03:13 |
| anteaya | so if the job name starts with { it must be quoted | 03:13 |
| fungi | so quoting makes it explicitly a string, rather than implicitly | 03:13 |
| mordred | quoting fungi makes him explicitly a string | 03:14 |
| anteaya | and if we quote then nothing bad will happen | 03:14 |
| anteaya | 'fungi | 03:14 |
| fungi | quit stringing me along | 03:14 |
| anteaya | ' | 03:14 |
| anteaya | you are an open string | 03:14 |
| anteaya | you can stuff some additional contents on the rest of that line | 03:14 |
| fungi | i am a quantum string | 03:14 |
| clarkb | they should go back to playing this game at home stadium of team with better record | 03:15 |
| anteaya | you are that | 03:15 |
| mordred | clarkb: ++ | 03:15 |
| fungi | (theoretically) | 03:15 |
| anteaya | so we don't care if there is random quoting in zuul/layout.yaml? | 03:15 |
| fungi | oh, i care | 03:15 |
| * anteaya bets money andreas will care | 03:15 | |
| fungi | look how much | 03:15 |
| mordred | clarkb: I think neutral stadium works for basketball conference tournaments because there are like 15 games in 3 days or something | 03:15 |
| fungi | i care this much '' | 03:15 |
| mordred | so it's worth random folks going | 03:15 |
| anteaya | fungi: ha ha ha | 03:15 |
| mordred | neutral stadium for conference champ game as a one-off is bong | 03:15 |
| clarkb | mordred ya | 03:16 |
| anteaya | okay sorry to disturb the ball, thanks | 03:16 |
| clarkb | also that stadium is an odd choice | 03:16 |
| fungi | i'm going to stop being glib on the internet for tonight and just subject those in my direct meatspace presence to my glibness for a change. g'night all | 03:16 |
| clarkb | fungi have fun subjecting | 03:17 |
| anteaya | fungi: night | 03:17 |
| mordred | clarkb: the EXISTENCE of that stadium is a weird choice | 03:19 |
| clarkb | wow fail | 03:20 |
| mordred | clarkb: I did see reference to the Santa Clara 49'ers in a sports article the other day | 03:20 |
| mordred | clarkb: in general, I think it's a bad strategy to miss fieldgoals | 03:20 |
| clarkb | mordred that stadium is closer to oakland than san francisco :) | 03:20 |
| mordred | yah | 03:21 |
| mordred | well, also, San Jose isn't even in the Combined Statistical Area of San Francisco | 03:21 |
| openstackgerrit | Merged openstack-infra/project-config: Set check-ansible-aio-build to use devstack-trusty image https://review.openstack.org/139676 | 03:21 |
| anteaya | clarkb: DEVSTACK_GATE_FULL=1 only appears in the aiopcpu job templates | 03:21 |
| mordred | it's separate enough to not even be considered in one of the broadest definitions of metro area | 03:21 |
| mordred | they might as well have put the stadium in sacramento really | 03:21 |
| anteaya | clarkb: jogo has a change to remove it, since there is no other use of it in project-config | 03:21 |
| anteaya | clarkb: any idea why it is there? | 03:21 |
| clarkb | ya thats default now | 03:22 |
| clarkb | so likely more culting | 03:22 |
| anteaya | https://review.openstack.org/#/c/139190/1 | 03:22 |
| anteaya | so safe to remove? | 03:22 |
| clarkb | fine to remove | 03:22 |
| anteaya | thank you | 03:22 |
| anteaya | can I see where it is set as a default? | 03:22 |
| anteaya | or what repo I would look in? | 03:23 |
| anteaya | nodepool? | 03:23 |
| mordred | clarkb: oh, I'm sorry - it's in the CSA - it's not in the same Metropolitan Statistical Area | 03:23 |
| clarkb | anteaya devstack-gate | 03:23 |
| anteaya | thanks | 03:23 |
| clarkb | mordred that was a nice thing about seattle. stadiums were basically downtown | 03:24 |
| clarkb | which is bad for transportation but great if you live nearby | 03:25 |
| anteaya | I am grepping the devstack-gate repo for 'DEVSTACK_GATE_FULL' and I get nothing | 03:25 |
| mordred | clarkb: great if you use public transit and not a burb-box | 03:26 |
| clarkb | anteaya it may have been removed completely then | 03:26 |
| clarkb | anteaya you can check git log -p | 03:26 |
| mordred | clarkb: it's great about the sports in new york that are not football | 03:26 |
| anteaya | thanks | 03:26 |
| mordred | clarkb: that the new york football stadium is in jersey is ... inconvenient | 03:26 |
| mordred | but the new barclay center that the nets play in is in an awesome location, as is MSG | 03:27 |
| mordred | (other than MSG having been part of the destruction of the old Penn Station) | 03:27 |
| *** Shrews has quit IRC | 03:29 | |
| clarkb | where do the mls teams play? | 03:30 |
| clarkb | oh wow yankee stadium for the new one? | 03:32 |
| clarkb | field will be smaller than pge parks current field | 03:36 |
| mordred | clarkb: wait - what? the red bulls play at yankee stadium? | 03:37 |
| anteaya | git log -p | grep 'DEVSTACK_GATE_FULL' on devstack-gate gave me no output, git log -p | grep 'DEVSTACK_GATE' gave me lots | 03:37 |
| anteaya | :/ | 03:38 |
| mordred | clarkb: yikes - gross - the red bulls statium is in the armpit of newark | 03:38 |
| clarkb | no nycfc will be in yankee stadium | 03:38 |
| mordred | clarkb: oh! I had missed their existence! | 03:39 |
| *** ZZelle has quit IRC | 03:40 | |
| mordred | neat. that makes it easier to start to like mls in new york - because having any connection to the "red bulls" is just hard to do with a straight face | 03:41 |
| *** jamielennox is now known as jamielennox|away | 03:45 | |
| *** yamamoto has joined #openstack-infra | 03:49 | |
| *** otter768 has joined #openstack-infra | 03:51 | |
| *** Masahiro has joined #openstack-infra | 03:51 | |
| *** yamamoto has quit IRC | 03:52 | |
| openstackgerrit | Merged openstack-infra/project-config: Remove DEVSTACK_GATE_FULL https://review.openstack.org/139190 | 03:52 |
| openstackgerrit | Merged openstack-infra/project-config: Enable gate/check (with voting) for taskflow-python34 https://review.openstack.org/137693 | 03:56 |
| *** Masahiro has quit IRC | 03:56 | |
| *** sabeen1 has joined #openstack-infra | 03:57 | |
| *** lbiasi has joined #openstack-infra | 03:58 | |
| *** ivar-lazzaro has quit IRC | 04:16 | |
| *** achanda has joined #openstack-infra | 04:27 | |
| *** thedodd has joined #openstack-infra | 04:29 | |
| *** zz_dimtruck is now known as dimtruck | 04:35 | |
| *** koolhead17 has joined #openstack-infra | 04:42 | |
| *** lbiasi has quit IRC | 04:43 | |
| *** achanda has quit IRC | 04:43 | |
| *** achanda has joined #openstack-infra | 04:44 | |
| *** yamamoto has joined #openstack-infra | 04:52 | |
| *** dimsum__ has joined #openstack-infra | 04:53 | |
| *** stevemar has joined #openstack-infra | 04:57 | |
| *** dimsum__ has quit IRC | 04:57 | |
| *** jamespage has quit IRC | 05:00 | |
| *** gnuoy has quit IRC | 05:00 | |
| *** gnuoy has joined #openstack-infra | 05:01 | |
| *** jamespage has joined #openstack-infra | 05:01 | |
| *** jamespage has joined #openstack-infra | 05:01 | |
| *** bhunter71 has quit IRC | 05:03 | |
| *** emagana has joined #openstack-infra | 05:06 | |
| *** stevemar has quit IRC | 05:08 | |
| *** sarob has joined #openstack-infra | 05:09 | |
| *** yamamoto has quit IRC | 05:11 | |
| *** sarob has quit IRC | 05:13 | |
| *** dannywilson has joined #openstack-infra | 05:23 | |
| *** teran_ has quit IRC | 05:25 | |
| *** dannywilson has quit IRC | 05:27 | |
| *** achanda has quit IRC | 05:29 | |
| *** achanda has joined #openstack-infra | 05:30 | |
| *** SumitNaiksatam has joined #openstack-infra | 05:31 | |
| *** achanda has quit IRC | 05:35 | |
| *** Masahiro has joined #openstack-infra | 05:40 | |
| *** sandywalsh has quit IRC | 05:42 | |
| *** emagana has quit IRC | 05:44 | |
| *** dimtruck is now known as zz_dimtruck | 05:44 | |
| *** emagana has joined #openstack-infra | 05:44 | |
| *** sandywalsh has joined #openstack-infra | 05:44 | |
| *** Masahiro has quit IRC | 05:45 | |
| *** achanda has joined #openstack-infra | 05:45 | |
| *** achanda has quit IRC | 05:47 | |
| *** lbiasi has joined #openstack-infra | 05:47 | |
| *** emagana has quit IRC | 05:49 | |
| *** jamielennox|away is now known as jamielennox | 05:50 | |
| *** lbiasi has quit IRC | 05:51 | |
| *** sabeen1 has quit IRC | 06:04 | |
| *** otter768 has quit IRC | 06:07 | |
| *** teran has joined #openstack-infra | 06:10 | |
| *** yamamoto has joined #openstack-infra | 06:12 | |
| *** koolhead17 has quit IRC | 06:12 | |
| *** koolhead17 has joined #openstack-infra | 06:12 | |
| *** emagana has joined #openstack-infra | 06:15 | |
| *** yamamoto has quit IRC | 06:17 | |
| *** otter768 has joined #openstack-infra | 06:17 | |
| *** emagana has quit IRC | 06:19 | |
| *** _nadya_ has joined #openstack-infra | 06:21 | |
| *** koolhead17 has quit IRC | 06:24 | |
| *** fandi has joined #openstack-infra | 06:24 | |
| *** otter768 has quit IRC | 06:28 | |
| *** pcrews has quit IRC | 06:30 | |
| *** pcrews has joined #openstack-infra | 06:31 | |
| *** Svedrin has quit IRC | 06:34 | |
| *** Svedrin has joined #openstack-infra | 06:38 | |
| *** fandi has quit IRC | 06:38 | |
| *** talluri has joined #openstack-infra | 06:47 | |
| *** harlowja is now known as harlowja_away | 06:52 | |
| *** mrunge has quit IRC | 06:52 | |
| *** sandywalsh has quit IRC | 07:02 | |
| *** sandywalsh has joined #openstack-infra | 07:04 | |
| *** krotscheck has quit IRC | 07:05 | |
| *** emagana has joined #openstack-infra | 07:09 | |
| *** emagana has quit IRC | 07:13 | |
| *** Masahiro has joined #openstack-infra | 07:29 | |
| *** rushiagr_away is now known as rushiagr | 07:31 | |
| openstackgerrit | Christian Berendt proposed openstack-infra/project-config: Add new project packstack-vagrant to stackforge https://review.openstack.org/139660 | 07:33 |
| *** Masahiro has quit IRC | 07:33 | |
| *** krotscheck has joined #openstack-infra | 07:39 | |
| *** nelsnelson has quit IRC | 07:41 | |
| *** zz_avozza is now known as avozza | 07:43 | |
| *** armax has quit IRC | 07:48 | |
| *** emagana has joined #openstack-infra | 08:03 | |
| *** emagana has quit IRC | 08:07 | |
| *** _nadya_ has quit IRC | 08:11 | |
| *** sarob has joined #openstack-infra | 08:14 | |
| *** sarob has quit IRC | 08:18 | |
| *** koolhead17 has joined #openstack-infra | 08:28 | |
| *** otter768 has joined #openstack-infra | 08:29 | |
| *** otter768 has quit IRC | 08:33 | |
| *** Longgeek has joined #openstack-infra | 08:33 | |
| *** Longgeek has quit IRC | 08:34 | |
| *** Longgeek has joined #openstack-infra | 08:35 | |
| *** Longgeek has quit IRC | 08:36 | |
| *** Longgeek has joined #openstack-infra | 08:36 | |
| *** Longgeek has quit IRC | 08:40 | |
| *** andreykurilin_ has joined #openstack-infra | 08:41 | |
| *** baoli has quit IRC | 08:43 | |
| *** thedodd has quit IRC | 08:45 | |
| *** Longgeek has joined #openstack-infra | 08:46 | |
| *** andreykurilin_ has quit IRC | 08:51 | |
| *** shakamunyi has joined #openstack-infra | 08:51 | |
| *** shakamunyi has quit IRC | 08:51 | |
| *** Longgeek has quit IRC | 08:51 | |
| *** Longgeek has joined #openstack-infra | 08:52 | |
| *** _nadya_ has joined #openstack-infra | 08:53 | |
| *** avozza is now known as zz_avozza | 08:54 | |
| *** emagana has joined #openstack-infra | 08:57 | |
| *** _nadya_ has quit IRC | 09:00 | |
| *** emagana has quit IRC | 09:02 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add fwaas and vpnaas repos to #openstack-neutron https://review.openstack.org/139152 | 09:04 |
| *** _nadya_ has joined #openstack-infra | 09:12 | |
| *** yamamoto has joined #openstack-infra | 09:15 | |
| *** Masahiro has joined #openstack-infra | 09:18 | |
| *** _nadya_ has quit IRC | 09:19 | |
| *** yamamoto has quit IRC | 09:20 | |
| *** Masahiro has quit IRC | 09:22 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Add .gitreview content to Creator's Guide https://review.openstack.org/138831 | 09:25 |
| *** talluri has quit IRC | 09:29 | |
| *** shashankhegde has joined #openstack-infra | 09:33 | |
| *** talluri has joined #openstack-infra | 09:34 | |
| *** chandankumar has joined #openstack-infra | 09:45 | |
| *** chandankumar has quit IRC | 09:47 | |
| *** shashankhegde has quit IRC | 09:47 | |
| *** emagana has joined #openstack-infra | 09:52 | |
| *** HeOS has quit IRC | 09:52 | |
| *** ildikov_ has joined #openstack-infra | 09:53 | |
| *** zz_avozza is now known as avozza | 09:53 | |
| *** rushiagr is now known as rushiagr_away | 09:54 | |
| *** emagana has quit IRC | 09:56 | |
| odyssey4me | hi there - if anyone's around, since https://review.openstack.org/#/c/139676/ merged our check is showing as 'NOT_REGISTERED' - does a dvsm job have to be registered somewhere? | 09:59 |
| *** teran_ has joined #openstack-infra | 10:01 | |
| *** teran has quit IRC | 10:03 | |
| *** jamielennox is now known as jamielennox|away | 10:10 | |
| *** rushiagr_away is now known as rushiagr | 10:10 | |
| *** talluri has quit IRC | 10:11 | |
| *** talluri has joined #openstack-infra | 10:14 | |
| *** penguinRaider has quit IRC | 10:15 | |
| *** andreykurilin_ has joined #openstack-infra | 10:19 | |
| *** koolhead17 has quit IRC | 10:22 | |
| *** koolhead17 has joined #openstack-infra | 10:22 | |
| *** ildikov_ has quit IRC | 10:23 | |
| *** koolhead17 has quit IRC | 10:26 | |
| *** otter768 has joined #openstack-infra | 10:30 | |
| *** otter768 has quit IRC | 10:34 | |
| *** teran has joined #openstack-infra | 10:35 | |
| *** talluri has quit IRC | 10:37 | |
| *** teran_ has quit IRC | 10:38 | |
| *** ihrachyshka has joined #openstack-infra | 10:39 | |
| *** e0ne has joined #openstack-infra | 10:45 | |
| *** teran has quit IRC | 10:53 | |
| *** teran has joined #openstack-infra | 10:55 | |
| *** ihrachyshka has quit IRC | 10:56 | |
| *** e0ne has quit IRC | 10:58 | |
| *** e0ne has joined #openstack-infra | 10:59 | |
| *** teran has quit IRC | 10:59 | |
| *** Masahiro has joined #openstack-infra | 11:06 | |
| *** Masahiro has quit IRC | 11:11 | |
| *** andreykurilin_ has quit IRC | 11:15 | |
| *** andreykurilin_ has joined #openstack-infra | 11:15 | |
| *** tnovacik has joined #openstack-infra | 11:15 | |
| openstackgerrit | Christian Berendt proposed openstack-infra/project-config: Add new project packstack-vagrant to stackforge https://review.openstack.org/139660 | 11:16 |
| *** avozza is now known as zz_avozza | 11:19 | |
| *** koolhead17 has joined #openstack-infra | 11:24 | |
| *** koolhead17 has joined #openstack-infra | 11:24 | |
| *** mase_x200 has joined #openstack-infra | 11:35 | |
| *** e0ne has quit IRC | 11:39 | |
| *** emagana has joined #openstack-infra | 11:40 | |
| *** zz_avozza is now known as avozza | 11:41 | |
| *** emagana has quit IRC | 11:44 | |
| *** cnesa has joined #openstack-infra | 11:45 | |
| *** yamamoto has joined #openstack-infra | 11:46 | |
| *** salv-orlando has joined #openstack-infra | 11:50 | |
| *** yamamoto has quit IRC | 11:53 | |
| *** teran has joined #openstack-infra | 11:54 | |
| *** Longgeek has quit IRC | 11:55 | |
| *** ddieterly has joined #openstack-infra | 11:58 | |
| *** teran has quit IRC | 11:59 | |
| *** vladan has quit IRC | 12:06 | |
| *** vladan has joined #openstack-infra | 12:07 | |
| *** e0ne has joined #openstack-infra | 12:10 | |
| *** andreykurilin_ has quit IRC | 12:14 | |
| *** ZZelle has joined #openstack-infra | 12:15 | |
| *** fandi has joined #openstack-infra | 12:20 | |
| *** salv-orlando has quit IRC | 12:21 | |
| *** salv-orlando has joined #openstack-infra | 12:23 | |
| *** otter768 has joined #openstack-infra | 12:31 | |
| *** dimsum__ has joined #openstack-infra | 12:32 | |
| *** salv-orlando has quit IRC | 12:33 | |
| *** yamamoto has joined #openstack-infra | 12:34 | |
| *** otter768 has quit IRC | 12:35 | |
| *** dimsum__ has quit IRC | 12:38 | |
| *** mrunge has joined #openstack-infra | 12:38 | |
| *** koolhead17 has quit IRC | 12:43 | |
| *** koolhead17 has joined #openstack-infra | 12:43 | |
| *** alexpilotti has joined #openstack-infra | 12:43 | |
| *** bradjones has quit IRC | 12:44 | |
| *** avozza is now known as zz_avozza | 12:45 | |
| *** bradjones has joined #openstack-infra | 12:47 | |
| *** koolhead17 has quit IRC | 12:48 | |
| Kiall | Love it .. To Get from Ireland -> r.o.o .. IE -> FR -> UK -> NL -> LON -> NY -> ATL -> DAL.. No wonder it's performing so badly -_- | 12:50 |
| Kiall | and 50% packet loss -_- | 12:51 |
| *** fandi has quit IRC | 12:51 | |
| *** salv-orlando has joined #openstack-infra | 12:52 | |
| *** tnovacik has quit IRC | 12:53 | |
| *** yamamoto_ has joined #openstack-infra | 12:55 | |
| *** yamamoto has quit IRC | 12:55 | |
| *** fandi has joined #openstack-infra | 12:55 | |
| *** teran has joined #openstack-infra | 12:55 | |
| *** Masahiro has joined #openstack-infra | 12:55 | |
| *** Longgeek has joined #openstack-infra | 12:55 | |
| *** Longgeek has quit IRC | 12:59 | |
| *** Masahiro has quit IRC | 12:59 | |
| *** teran has quit IRC | 13:00 | |
| *** salv-orlando has quit IRC | 13:01 | |
| *** zz_avozza is now known as avozza | 13:07 | |
| *** frank_zhou has joined #openstack-infra | 13:09 | |
| *** rushiagr is now known as rushiagr_away | 13:14 | |
| *** salv-orlando has joined #openstack-infra | 13:16 | |
| *** mrunge has quit IRC | 13:19 | |
| *** rushiagr_away is now known as rushiagr | 13:20 | |
| *** salv-orlando has quit IRC | 13:25 | |
| *** emagana has joined #openstack-infra | 13:28 | |
| *** e0ne has quit IRC | 13:30 | |
| *** fandi has quit IRC | 13:32 | |
| *** emagana has quit IRC | 13:33 | |
| *** dimsum__ has joined #openstack-infra | 13:38 | |
| *** baoli has joined #openstack-infra | 13:39 | |
| *** e0ne has joined #openstack-infra | 13:40 | |
| *** dimsum__ has quit IRC | 13:43 | |
| *** fandi has joined #openstack-infra | 13:49 | |
| *** koolhead17 has joined #openstack-infra | 13:52 | |
| *** teran has joined #openstack-infra | 13:56 | |
| *** teran has quit IRC | 14:00 | |
| fungi | odyssey4me: i see the issue. the magic parameter functions we have to tell zuul to look for "dsvm" jobs registered on devstack-trusty nodes doesn't match your check-os-ansible-deployment-dvsm-aio-build job name because "dvsm" is not "dsvm" | 14:02 |
| fungi | odyssey4me: sorry nobody spotted that in review | 14:03 |
| fungi | odyssey4me: so as a result, zuul is looking for check-os-ansible-deployment-dvsm-aio-build:bare-trusty when jenkins is only registering check-os-ansible-deployment-dvsm-aio-build:devstack-trusty | 14:03 |
| *** avozza is now known as zz_avozza | 14:09 | |
| *** e0ne has quit IRC | 14:15 | |
| *** yamamoto_ has quit IRC | 14:16 | |
| *** koolhead17 has quit IRC | 14:17 | |
| *** koolhead17 has joined #openstack-infra | 14:17 | |
| *** koolhead17 has quit IRC | 14:22 | |
| *** emagana has joined #openstack-infra | 14:22 | |
| *** ddieterly has quit IRC | 14:26 | |
| *** yamamoto has joined #openstack-infra | 14:27 | |
| *** emagana has quit IRC | 14:27 | |
| *** zz_avozza is now known as avozza | 14:31 | |
| *** otter768 has joined #openstack-infra | 14:31 | |
| *** yamamoto has quit IRC | 14:34 | |
| *** mase_x200 has quit IRC | 14:36 | |
| *** otter768 has quit IRC | 14:36 | |
| SergeyLukjanov | anteaya, hey, yeah, I've been sleeping at that time ;) | 14:37 |
| *** jerryz_ has joined #openstack-infra | 14:39 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Correct misnamed check-{name}-dsvm-aio-build jobs https://review.openstack.org/139803 | 14:40 |
| fungi | odyssey4me: ^ | 14:40 |
| SergeyLukjanov | fungi, morning! | 14:41 |
| *** jerryz has quit IRC | 14:43 | |
| *** Masahiro has joined #openstack-infra | 14:44 | |
| openstackgerrit | Brant Knudson proposed openstack-infra/system-config: Correct keystone log links https://review.openstack.org/139805 | 14:44 |
| *** frank_zhou has quit IRC | 14:47 | |
| *** Masahiro has quit IRC | 14:49 | |
| fungi | morning, SergeyLukjanov | 14:49 |
| fungi | i can go ahead and put zuul in graceful shutdown in about 15-20 minutes | 14:50 |
| fungi | doesn't look particularly busy | 14:50 |
| *** rushiagr is now known as rushiagr_away | 14:54 | |
| tchaypo | Is there anything I need to do on https://review.openstack.org/#/c/136811/ to get it ready to land? | 14:55 |
| *** baoli has quit IRC | 14:55 | |
| tchaypo | or is it just waiting for enough eyeballs? | 14:55 |
| *** Longgeek has joined #openstack-infra | 14:56 | |
| *** teran has joined #openstack-infra | 14:57 | |
| *** ddieterly has joined #openstack-infra | 14:57 | |
| *** ddieterly has quit IRC | 14:58 | |
| *** ddieterl_ has joined #openstack-infra | 14:59 | |
| fungi | tchaypo: eyeballs | 15:00 |
| *** Longgeek has quit IRC | 15:00 | |
| *** ddieterl_ has quit IRC | 15:00 | |
| *** ddieterly has joined #openstack-infra | 15:00 | |
| *** teran has quit IRC | 15:01 | |
| *** baoli has joined #openstack-infra | 15:03 | |
| *** ryanpetrello has quit IRC | 15:04 | |
| fungi | 138432 is our first storyboard rename... krotscheck: if you're around, is that particularly complicated? any tips? | 15:05 |
| *** ddieterly has quit IRC | 15:05 | |
| fungi | luckily gerrit-powered-agenda seems to have no stories/tasks so maybe we just let it slide for this one and figure out how to delete the old project name from storyboard | 15:07 |
| *** Longgeek has joined #openstack-infra | 15:10 | |
| *** cnesa has quit IRC | 15:13 | |
| fungi | jd__: i spotted a couple of non-critical issues with https://review.openstack.org/135215 if you're around and want to correct them (one requires a decision on the part of the oslo/tooz devs). if not, it can be addressed next week--it won't break anything for now | 15:15 |
| fungi | okay, if i put zuul into graceful shutdown now, the current jobs should finish up right at 1600 utc | 15:18 |
| fungi | #status notice [reminder] gerrit will be offline for 30 minutes starting at 16:00 utc for project renames | 15:19 |
| openstackstatus | fungi: sending notice | 15:19 |
| -openstackstatus- NOTICE: [reminder] gerrit will be offline for 30 minutes starting at 16:00 utc for project renames | 15:20 | |
| openstackstatus | fungi: finished sending notice | 15:21 |
| SergeyLukjanov | fungi, thanks | 15:25 |
| *** fandi has quit IRC | 15:26 | |
| *** penguinRaider has joined #openstack-infra | 15:30 | |
| *** markmcclain has quit IRC | 15:31 | |
| *** ZZelle has quit IRC | 15:32 | |
| *** markmcclain has joined #openstack-infra | 15:34 | |
| *** yamamoto has joined #openstack-infra | 15:34 | |
| *** stevemar has joined #openstack-infra | 15:36 | |
| *** yamamoto has quit IRC | 15:39 | |
| fungi | i've also got puppet runs disabled globally on the puppet master | 15:39 |
| * jeblair yawns | 15:42 | |
| fungi | on the github updates in step #14, i think i want to try out their ownership transfer between orgs and see how it works out, rather than just deleting the stackforge repos | 15:43 |
| jeblair | fungi: istr that had a complication but i don't recall what | 15:44 |
| *** _nadya_ has joined #openstack-infra | 15:44 | |
| fungi | jeblair: it's unwieldy for transferring ownership between orgs with disjoint sets of admins | 15:44 |
| fungi | for example when the original pylockfile admins wanted to transfer their github repo to one of our orgs | 15:45 |
| jeblair | ah, so we should not use it for [wherever]->stackforge but stackforge->openstack maybe | 15:45 |
| fungi | yeah, where we control both orgs it looks like it's very straightforward | 15:45 |
| fungi | the complication is that the account initiating the transfer has to be an admin in both orgs | 15:46 |
| jeblair | i'm looking into the storyboard rename | 15:47 |
| jeblair | (i'd rather try the rename than have to clean up by deleting a project) | 15:47 |
| *** cnesa has joined #openstack-infra | 15:48 | |
| fungi | agreed, even if there is no real activity for it, i just didn't notice it far enough in advance to familiarize myself with the db schema on the spot and know if some things had to be shut down before making changes there | 15:48 |
| fungi | okay, zuul says in t-7 minutes it will be done with currently running jobs | 15:49 |
| jeblair | fungi: i think caching is pretty limited at this point, so probably no shutdown needed. we could do so for safety, but i'm also thinking this is a good time to experiment, so let's try leaving it up. | 15:51 |
| fungi | so if we _did_ shut something down for that, it would be apache, yeah? | 15:52 |
| fungi | as storyboard is just apache subprocesses? | 15:52 |
| jeblair | fungi: yep. rabbitmq should not matter for this sort of thing. | 15:52 |
| jeblair | where's the etherpad? | 15:53 |
| fungi | jeblair: https://etherpad.openstack.org/p/repo-renaming-2014-12-06 | 15:53 |
| SergeyLukjanov | storyboard rename? | 15:54 |
| *** Longgeek has quit IRC | 15:54 | |
| fungi | SergeyLukjanov: renaming a project which uses storyboard | 15:54 |
| fungi | no show-stoppers on the three proposed changes. i'm going to double-check them for merge conflicts with one another and master now | 15:55 |
| SergeyLukjanov | oh, got it | 15:55 |
| SergeyLukjanov | fungi, ok, thank you | 15:55 |
| clarkb | 1600UTC feels so much earlier on saturday | 15:55 |
| *** Longgeek has joined #openstack-infra | 15:55 | |
| clarkb | good morning | 15:55 |
| SergeyLukjanov | heh, sorry | 15:55 |
| SergeyLukjanov | morning | 15:55 |
| SergeyLukjanov | 7 pm feels ok for me ;) | 15:55 |
| fungi | 11am here | 15:56 |
| * fungi will need lunch after this | 15:56 | |
| jeblair | okay, pasted storyboard update command into bottom of etherpad | 15:56 |
| fungi | no merge conflicts with master or between the three proposed changes, so we should be all set | 15:57 |
| *** teran has joined #openstack-infra | 15:57 | |
| SergeyLukjanov | great! | 15:58 |
| jeblair | SergeyLukjanov: which tasks do you want to do? Gerrit, Zuul, or both? | 15:58 |
| *** Shrews has joined #openstack-infra | 15:58 | |
| SergeyLukjanov | jeblair, I'd like to try both if you're ok with it | 15:58 |
| SergeyLukjanov | to try the all things needs to be done :) | 15:58 |
| jeblair | fungi: oh, did you graceful stop zuul? | 15:59 |
| SergeyLukjanov | do we need one more notice? #status notice gerrit will be offline for 30 minutes starting at 16:00 utc for project renames | 15:59 |
| *** ddieterly has joined #openstack-infra | 15:59 | |
| fungi | jeblair: i did | 15:59 |
| jeblair | neato | 15:59 |
| jeblair | then there's not much zuul to do :) | 16:00 |
| fungi | looks like it just wrapped up the last running job a minute or two ago | 16:00 |
| SergeyLukjanov | fungi, you did: sudo kill -USR1 $(cat /var/run/zuul/zuul.pid) | 16:00 |
| SergeyLukjanov | jeblair, oh, yeah | 16:00 |
| fungi | SergeyLukjanov: yep, about 40 minutes ago so the would finish in time | 16:00 |
| fungi | er, they | 16:00 |
| SergeyLukjanov | fungi, zuul is offline already | 16:00 |
| fungi | SergeyLukjanov: yep, it just finished the running jobs and stopped itself | 16:01 |
| fungi | SergeyLukjanov: kill -USR1 is what i did 40 minutes ago to initiate the graceful shutdown | 16:01 |
| fungi | which just completed now | 16:01 |
| SergeyLukjanov | fungi, ack, thx | 16:01 |
| SergeyLukjanov | puppet is disabled on puppetmaster already | 16:01 |
| fungi | #status alert gerrit will be offline for 30 minutes while we rename a few projects. eta 16:30 utc | 16:02 |
| openstackstatus | fungi: sending alert | 16:02 |
| fungi | SergeyLukjanov: yes, i said i had done that too | 16:02 |
| fungi | and confirmed it was no longer running | 16:02 |
| SergeyLukjanov | fungi, yup, just checking through the list of items | 16:02 |
| fungi | awesome | 16:02 |
| *** teran has quit IRC | 16:02 | |
| jeblair | SergeyLukjanov: okay, you're running the show now :) | 16:03 |
| fungi | wanted to make sure we were ready to stop gerrit on time | 16:03 |
| SergeyLukjanov | okay, so, I'm going to shutdown gerrit when alert will be confirmed | 16:03 |
| fungi | i wouldn't bother waiting for all the channel topics to update. it'll be soon enough | 16:03 |
| SergeyLukjanov | ack | 16:03 |
| SergeyLukjanov | starting the show :) | 16:03 |
| -openstackstatus- NOTICE: gerrit will be offline for 30 minutes while we rename a few projects. eta 16:30 utc | 16:03 | |
| *** ChanServ changes topic to "gerrit will be offline for 30 minutes while we rename a few projects. eta 16:30 utc" | 16:03 | |
| *** ddieterly has quit IRC | 16:04 | |
| fungi | there was so little going on in zuul an hour ago that i'm pretty sure nobody is going to notice anyway ;) | 16:04 |
| SergeyLukjanov | yeah | 16:04 |
| SergeyLukjanov | I even was too lazy to update my patches today :) | 16:04 |
| fungi | heh | 16:04 |
| clarkb | I don't see gerrit reindex on the etherpad | 16:05 |
| openstackstatus | fungi: finished sending alert | 16:06 |
| SergeyLukjanov | btw me decided to learn puppet a bit more to setup own small puppetmaster + 3-4 nodes infra to replace my handmade cron bash scripts :) | 16:06 |
| SergeyLukjanov | clarkb, it's in the guide | 16:06 |
| SergeyLukjanov | clarkb, I've added only customized items that are including project names | 16:06 |
| fungi | clarkb: SergeyLukjanov only etherpadded the commands which were templated | 16:06 |
| clarkb | oh ok, so etherpad is just for when you need text | 16:06 |
| clarkb | yup gotcha | 16:06 |
| jeblair | SergeyLukjanov: let us know what you're doing :) | 16:08 |
| SergeyLukjanov | oops, sorry :) | 16:08 |
| SergeyLukjanov | so, backup is done | 16:08 |
| SergeyLukjanov | and gerrit db update done | 16:09 |
| SergeyLukjanov | checking filesystem moves now | 16:09 |
| jeblair | the storyboard name update is complete; it appears to have taken effect immediately :) | 16:10 |
| SergeyLukjanov | updating git farm | 16:10 |
| fungi | step 7 will take long enough to run that you can get step 8 done while it's going | 16:10 |
| fungi | i'm going to play with the github transfers | 16:11 |
| fungi | unless you wanted to do that part too | 16:11 |
| clarkb | jeblair: that is a very simple storyboard step | 16:11 |
| *** emagana has joined #openstack-infra | 16:11 | |
| clarkb | also I am just sitting here following along :) | 16:11 |
| jeblair | ya. i read the code and also did a db dump looking for the string 'gerrit-powered-agenda'. seemed like that's all that's needed. | 16:11 |
| *** _nadya_ has quit IRC | 16:11 | |
| tchaypo | Thank you all | 16:12 |
| jeblair | tchaypo: you're welcome, though it's a bit early -- all we've done so far is broken your project, we still need to fix it ;) | 16:13 |
| SergeyLukjanov | now doing "Reindex the lucene search index on review.openstack.org:' | 16:13 |
| jeblair | SergeyLukjanov: oh that's the step that fungi suggested you could start before doing the git farm because it takes a while. no big deal though :) | 16:14 |
| fungi | SergeyLukjanov: that step will take about 10 minutes | 16:14 |
| SergeyLukjanov | fungi, if you not done github rename - I'm going to do it | 16:14 |
| SergeyLukjanov | git farm done already | 16:14 |
| fungi | SergeyLukjanov: i just finished the two org transfers | 16:14 |
| SergeyLukjanov | fungi, okay | 16:14 |
| fungi | looks like it really is about as easy as a project rename in github | 16:14 |
| clarkb | fungi: that is good news | 16:15 |
| fungi | was curious to give it a go since we hadn't tested that previously | 16:15 |
| jeblair | will be helpful for devstack, etc | 16:15 |
| SergeyLukjanov | yeah | 16:15 |
| *** emagana has quit IRC | 16:15 | |
| SergeyLukjanov | I've been already used org transfer several times | 16:15 |
| SergeyLukjanov | and it was working ok | 16:15 |
| clarkb | so really the only issue with it is being an admin of both orgs | 16:16 |
| fungi | yep | 16:16 |
| jeblair | yeah, which is why i don't think we should use it for [random]->stackforge imports | 16:16 |
| *** jerryz_ has quit IRC | 16:16 | |
| SergeyLukjanov | clarkb, only for the moment of transfering, so, it's a bit better | 16:16 |
| SergeyLukjanov | jeblair, I think we just not spent additonal time for [random]->stackforge | 16:17 |
| fungi | in the "danger zone" section of the project settings there's a transfer ownership button, which takes you to a page where you confirm the name of the project and the name of the new "owner" (in this case the new org name) | 16:17 |
| SergeyLukjanov | but it probably could be used for [not-so-random]->openstack | 16:17 |
| *** Longgeek has quit IRC | 16:17 | |
| jeblair | SergeyLukjanov: yep | 16:18 |
| fungi | then it gives you a list of additional collaboration teams which would be added (in this case our gerrit account so that that replication will work) | 16:18 |
| fungi | and that was all | 16:18 |
| fungi | but yeah, your account needs to be an admin of the origin and destination orgs | 16:18 |
| fungi | and github's redirects already seem to be working as advertised | 16:19 |
| SergeyLukjanov | yay! | 16:19 |
| SergeyLukjanov | [2014-12-06 16:13:41,290] ERROR com.google.gerrit.server.index.ChangeBatchIndexer : repository not found: /home/gerrit2/review_site/git/openstack-ci/gerrit-verification-status-plugin | 16:20 |
| SergeyLukjanov | Reindexing changes: projects: 25% (114/455), 31% (43409/138795) (-)[2014-12-06 16:16:03,856] ERROR com.google.gerrit.server.index.ChangeBatchIndexer : repository not found: /home/gerrit2/review_site/git/openstack/openstack-ci | 16:20 |
| SergeyLukjanov | Reindexing changes: projects: 25% (117/455), 33% (46008/138795) (\)[2014-12-06 16:16:12,129] ERROR com.google.gerrit.server.index.ChangeBatchIndexer : repository not found: /home/gerrit2/review_site/git/openstack/openstack-puppet | 16:20 |
| SergeyLukjanov | is it oK? | 16:20 |
| *** Masahiro has joined #openstack-infra | 16:20 | |
| fungi | yeah | 16:21 |
| clarkb | fungi: it is complaining that projects it knew about are no longer there? | 16:21 |
| fungi | those are projects which got renamed long ago | 16:21 |
| *** nikesh_vedams_ has joined #openstack-infra | 16:22 | |
| fungi | possibly incompletely | 16:22 |
| nikesh_vedams_ | i am trying to deploy kilo devstack | 16:22 |
| fungi | it complains about those on every reindex run | 16:22 |
| SergeyLukjanov | I'll try to digg into it after renaming finished | 16:22 |
| jeblair | we should look at those individual changes (hopefully the numbers in the error line point to them) and see if we need to do cleanup there. but later, not today. :) | 16:22 |
| SergeyLukjanov | fungi, clarkb ^^ | 16:22 |
| SergeyLukjanov | Reindexed 136666 changes in 461.2s (296.3/s) | 16:22 |
| SergeyLukjanov | okay, I'm going to start gerrit | 16:23 |
| *** _nadya_ has joined #openstack-infra | 16:23 | |
| *** achanda has joined #openstack-infra | 16:23 | |
| nikesh_vedams_ | but my instance is not getting any ip this is my local.conf http://paste.openstack.org/show/146108/ where am i doing wrong i m deploying all in one node | 16:23 |
| nikesh_vedams_ | devstack | 16:23 |
| nikesh_vedams_ | with kilo | 16:23 |
| *** Longgeek has joined #openstack-infra | 16:24 | |
| clarkb | looks like zuul was just started? | 16:24 |
| SergeyLukjanov | yeah | 16:25 |
| *** Masahiro has quit IRC | 16:25 | |
| SergeyLukjanov | renamed gerrit groups | 16:25 |
| fungi | nikesh_vedams_: this is probably not a great channel to ask for help running devstack | 16:25 |
| * SergeyLukjanov going to re-enable puppet after changes merged | 16:25 | |
| fungi | nikesh_vedams_: you probably want to ask in #openstack or #openstack-101 | 16:26 |
| fungi | nikesh_vedams_: this is the channel where we run the project developer and community infrastructure servers | 16:26 |
| fungi | jobs do seem to be running, that's a good sign | 16:27 |
| SergeyLukjanov | fungi, yup :) | 16:27 |
| clarkb | fungi: yup, I think they are mostly waiting on nodes to run on at this point | 16:27 |
| SergeyLukjanov | just uploaded .gitreview fixes | 16:27 |
| fungi | SergeyLukjanov: you can feel free to `#status ok` as soon as you're comfortable things are running correctly | 16:28 |
| SergeyLukjanov | fungi, ack | 16:28 |
| SergeyLukjanov | fungi, I don't project-config changes in the gate, hm | 16:28 |
| jeblair | SergeyLukjanov: you will probably need to recheck the .gitreview changes after zuul reloads after the changes merge (because right now zuul does not know about the renamed projects) | 16:29 |
| nikesh_vedams_ | fungi:thanks | 16:29 |
| SergeyLukjanov | jeblair, yeah, that's correct | 16:29 |
| * jeblair looks at zuul logs to see what happened to the project-config jobs | 16:29 | |
| SergeyLukjanov | jeblair, sorry, everything is ok | 16:30 |
| SergeyLukjanov | jeblair, seems like I've approved thm before zuul was fully operating | 16:30 |
| jeblair | SergeyLukjanov: ah yeah, it takes maybe 10-20 seconds to start up | 16:31 |
| fungi | yep, they're running in the gate now | 16:31 |
| jeblair | SergeyLukjanov: i usually 'tail -f /var/log/zuul/debug.log' to see when it's fully up | 16:31 |
| SergeyLukjanov | jeblair, fungi, I've re-approved them and they are now in gate | 16:31 |
| *** andreykurilin_ has joined #openstack-infra | 16:31 | |
| SergeyLukjanov | jeblair, thx | 16:31 |
| *** _nadya_ has quit IRC | 16:32 | |
| *** otter768 has joined #openstack-infra | 16:32 | |
| *** _nadya_ has joined #openstack-infra | 16:33 | |
| SergeyLukjanov | jeblair, I'll upload the change to our doc with update storyboard instructions | 16:34 |
| openstackgerrit | Merged openstack-infra/project-config: Rename the heat-translator project repo https://review.openstack.org/131558 | 16:34 |
| SergeyLukjanov | I've added ansible runs to etherpad to cleanup persistent jenkins workspaces | 16:36 |
| SergeyLukjanov | fungi, clarkb, jeblair ^^ | 16:36 |
| fungi | SergeyLukjanov: looks good | 16:36 |
| *** _nadya_ has quit IRC | 16:37 | |
| *** otter768 has quit IRC | 16:37 | |
| clarkb | yup loogs good. I think those are less and less necessary due to running all the sdist stuff on single use machines, but it won't hurt to be thorough | 16:37 |
| jeblair | yep | 16:37 |
| *** AlexF has joined #openstack-infra | 16:38 | |
| openstackgerrit | Merged openstack-infra/project-config: Move tooz from Stackforge to OpenStack https://review.openstack.org/135215 | 16:39 |
| SergeyLukjanov | clarkb, yeah | 16:39 |
| openstackgerrit | Merged openstack-infra/project-config: Rename gerrit-powered-agenda to yaml2ical https://review.openstack.org/138432 | 16:39 |
| *** AlexF has quit IRC | 16:40 | |
| fungi | clarkb: it still craps up the pypi uploads and translation proposals and what have you | 16:41 |
| *** AlexF has joined #openstack-infra | 16:41 | |
| fungi | because the git remote ends up being wrong | 16:41 |
| SergeyLukjanov | puppet is enabled again | 16:41 |
| clarkb | fungi: we don't use a git remote for pypi uploads. I think only translations might be affected anymore | 16:42 |
| fungi | ahh, point | 16:44 |
| SergeyLukjanov | ansible stuff done | 16:44 |
| SergeyLukjanov | sent gerrit replication | 16:44 |
| *** AlexF has quit IRC | 16:45 | |
| *** openstackgerrit has quit IRC | 16:45 | |
| *** openstackgerrit has joined #openstack-infra | 16:46 | |
| *** _nadya_ has joined #openstack-infra | 16:46 | |
| SergeyLukjanov | ok, so, looks like it's ok now | 16:48 |
| SergeyLukjanov | need to wait for new jobs created in jenkins | 16:48 |
| SergeyLukjanov | #status ok | 16:49 |
| openstackstatus | SergeyLukjanov: sending ok | 16:49 |
| SergeyLukjanov | jeblair, clarkb, fungi, thanks folks, show is ended :) | 16:49 |
| * SergeyLukjanov going to cleanup old jobs from jenkins | 16:49 | |
| fungi | SergeyLukjanov: excellent work! thanks for taking care of it | 16:49 |
| *** ChanServ changes topic to "Discussion of OpenStack Developer Infrastructure | docs http://ci.openstack.org | bugs https://launchpad.net/openstack-ci/ | https://git.openstack.org/cgit/openstack-infra/system-config/tree/" | 16:49 | |
| jeblair | SergeyLukjanov: cool thanks! | 16:50 |
| clarkb | tahnk you! that was the easiest rename I have done in a long time :) | 16:50 |
| openstackstatus | SergeyLukjanov: finished sending ok | 16:51 |
| openstackgerrit | Sergey Lukjanov proposed openstack-infra/system-config: Add StoryBoard update step to gerrit project renaming guide https://review.openstack.org/139818 | 16:54 |
| SergeyLukjanov | jeblair, ^^ | 16:54 |
| jeblair | SergeyLukjanov: thanks; let's get the storyboard devs to look that over | 16:55 |
| SergeyLukjanov | jeblair, project is here and storyboard is loading, that great :) | 16:57 |
| SergeyLukjanov | jeblair, https://storyboard.openstack.org/#!/project/716 | 16:57 |
| *** teran has joined #openstack-infra | 16:59 | |
| *** ddieterly has joined #openstack-infra | 16:59 | |
| *** teran has quit IRC | 17:03 | |
| *** ddieterly has quit IRC | 17:04 | |
| *** emagana has joined #openstack-infra | 17:05 | |
| *** ddieterly has joined #openstack-infra | 17:06 | |
| fungi | looks good | 17:09 |
| *** emagana has quit IRC | 17:09 | |
| *** armax has joined #openstack-infra | 17:15 | |
| *** Sukhdev has joined #openstack-infra | 17:18 | |
| anteaya | o/ | 17:20 |
| anteaya | anything I can do to help? | 17:20 |
| anteaya | looks like you are done | 17:21 |
| SergeyLukjanov | anteaya, morning | 17:21 |
| anteaya | morning | 17:21 |
| anteaya | great work | 17:21 |
| anteaya | I haven't slept so well in months | 17:22 |
| *** _nadya_ has quit IRC | 17:22 | |
| *** talluri has joined #openstack-infra | 17:25 | |
| *** yfried_ has joined #openstack-infra | 17:27 | |
| *** rushiagr_away is now known as rushiagr | 17:30 | |
| *** achanda has quit IRC | 17:38 | |
| *** emagana has joined #openstack-infra | 17:39 | |
| *** dimsum__ has joined #openstack-infra | 17:41 | |
| *** AlexF has joined #openstack-infra | 17:41 | |
| *** emagana has quit IRC | 17:43 | |
| *** stevemar has quit IRC | 17:44 | |
| *** dimsum__ has quit IRC | 17:45 | |
| *** AlexF has quit IRC | 17:46 | |
| *** mrunge has joined #openstack-infra | 17:46 | |
| *** mrunge has quit IRC | 17:47 | |
| *** mrunge has joined #openstack-infra | 17:47 | |
| *** markmcclain1 has joined #openstack-infra | 17:47 | |
| *** markmcclain has quit IRC | 17:49 | |
| *** markmcclain has joined #openstack-infra | 17:51 | |
| *** markmcclain1 has quit IRC | 17:52 | |
| *** teran has joined #openstack-infra | 17:59 | |
| *** armax has quit IRC | 18:00 | |
| *** ryanpetrello has joined #openstack-infra | 18:03 | |
| *** teran has quit IRC | 18:04 | |
| *** nikesh_vedams_ has quit IRC | 18:05 | |
| *** armax has joined #openstack-infra | 18:05 | |
| *** Masahiro has joined #openstack-infra | 18:09 | |
| openstackgerrit | Khai Do proposed stackforge/python-jenkins: Workflow documentation is now in infra-manual https://review.openstack.org/139821 | 18:09 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Workflow documentation is now in infra-manual https://review.openstack.org/139425 | 18:12 |
| *** Masahiro has quit IRC | 18:13 | |
| *** markmcclain has quit IRC | 18:14 | |
| *** shakamunyi has joined #openstack-infra | 18:23 | |
| *** shashankhegde has joined #openstack-infra | 18:23 | |
| *** koolhead17 has joined #openstack-infra | 18:24 | |
| *** tnovacik has joined #openstack-infra | 18:25 | |
| *** Longgeek has quit IRC | 18:32 | |
| *** emagana has joined #openstack-infra | 18:33 | |
| *** otter768 has joined #openstack-infra | 18:33 | |
| *** shashankhegde has quit IRC | 18:35 | |
| *** Longgeek has joined #openstack-infra | 18:36 | |
| *** yamamoto has joined #openstack-infra | 18:37 | |
| *** otter768 has quit IRC | 18:38 | |
| *** emagana has quit IRC | 18:38 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Make Neutron DVR job run on the full tempest suite. https://review.openstack.org/139822 | 18:39 |
| *** yamamoto has quit IRC | 18:42 | |
| *** AlexF has joined #openstack-infra | 18:42 | |
| *** AlexF has quit IRC | 18:47 | |
| *** ryanpetrello has quit IRC | 18:49 | |
| *** ryanpetrello has joined #openstack-infra | 18:54 | |
| *** armax has quit IRC | 18:56 | |
| *** waynr has quit IRC | 18:58 | |
| *** dkliban is now known as dkliban_afk | 18:59 | |
| *** HeOS has joined #openstack-infra | 19:00 | |
| *** teran has joined #openstack-infra | 19:00 | |
| *** harlowja_at_home has joined #openstack-infra | 19:00 | |
| *** superdan is now known as dansmith | 19:03 | |
| ashp | Anyone know in gerrit where to configure "how many +'s are required until a CR is considered verified"? | 19:04 |
| ashp | We just went from gerrit 2.4 to 2.9 | 19:04 |
| ashp | and now verified +1 from jenkins isn't enough | 19:04 |
| ashp | it's looking for a +2 before we can submit | 19:04 |
| *** talluri has quit IRC | 19:05 | |
| *** teran has quit IRC | 19:05 | |
| jkt | ashp: check the range of that label in project.config in refs/meta/config (and also in parent projects) | 19:09 |
| *** andreykurilin_ has quit IRC | 19:12 | |
| ashp | I was just doing that, the only range we have for that label is on the top level project | 19:13 |
| ashp | http://pastebin.com/k3Vg0XxQ | 19:14 |
| ashp | and that -seems- to me like it's saying +1 or +2 is verified | 19:14 |
| *** ryanpetrello has quit IRC | 19:15 | |
| ashp | what's most weird is within the actual CR | 19:15 |
| ashp | "Verified +1 Jenkins" | 19:15 |
| ashp | then along the top left | 19:15 |
| ashp | Change 4095 - Needs Verified | 19:15 |
| *** avozza is now known as zz_avozza | 19:17 | |
| ashp | https://code.google.com/p/gerrit/issues/detail?id=2798 it has to be related to this | 19:18 |
| *** Sukhdev has quit IRC | 19:18 | |
| zaro | ashp: it's the MaxWithBlock which mean block approval until max score is set | 19:18 |
| ashp | Ah weird, I wonder why this worked in 2.4 | 19:19 |
| ashp | zaro: what would be the right function there? I don't even know where these are documented | 19:19 |
| *** ryanpetrello has joined #openstack-infra | 19:20 | |
| zaro | ashp: https://gerrit-review.googlesource.com/Documentation/config-labels.html#label_function | 19:20 |
| zaro | ashp: but really if you want to make Verified +1 submittable then just remove the -2/+2 from the range | 19:20 |
| ashp | makes sense, trying that | 19:21 |
| *** zz_avozza is now known as avozza | 19:21 | |
| clarkb | the reason we use -2..+2 is +/-1 is for check and +/-2 is for gate | 19:22 |
| mordred | clarkb: you know what didn't happen last night? | 19:22 |
| mordred | clarkb: arizona did not upset oregon | 19:22 |
| mordred | clarkb: or, really, even play in the game | 19:23 |
| clarkb | mordred not even close | 19:23 |
| ashp | clarkb: ahhhhhh, yeah, it only ran a check not a gate | 19:23 |
| *** avozza is now known as zz_avozza | 19:24 | |
| *** AlexF has joined #openstack-infra | 19:25 | |
| mordred | clarkb: btw - I'll be rooting for gonzaga over arizona later today | 19:25 |
| *** AlexF has quit IRC | 19:26 | |
| *** zz_avozza is now known as avozza | 19:27 | |
| *** emagana has joined #openstack-infra | 19:27 | |
| *** _nadya_ has joined #openstack-infra | 19:27 | |
| clarkb | mordred that is a good choice | 19:28 |
| ashp | clarkb: well this sucks | 19:28 |
| ashp | this job has check: and gate: defined | 19:28 |
| ashp | but it only does the check gate and completely ignores gate, argh | 19:28 |
| ashp | all the other projects have check and gate and work fine, of course | 19:28 |
| *** ryanpetrello has quit IRC | 19:31 | |
| *** emagana has quit IRC | 19:32 | |
| *** ihrachyshka has joined #openstack-infra | 19:34 | |
| ashp | Are there other places than layout.yaml that would stop a project running a gate job, like.. anything in gerrit itself? | 19:35 |
| ashp | it only runs check, which gives a +1, then just ignores gate altogether | 19:35 |
| ashp | wondering if something in the project in gerrit could do something weird that would make it fail to match for gate | 19:36 |
| clarkb | you have to approve changes for them to gate | 19:37 |
| ashp | Ahhhh | 19:37 |
| clarkb | and the change must be mergeable | 19:37 |
| clarkb | eg not depend on unapproved code | 19:37 |
| *** ryanpetrello has joined #openstack-infra | 19:37 | |
| ashp | i approved the change but i guess zuul didn't trigger the gate job | 19:38 |
| ashp | I think what I need to do, is special case this project | 19:38 |
| *** shashankhegde has joined #openstack-infra | 19:38 | |
| ashp | and try to copy the label verified stuff from All-Projects to it | 19:38 |
| ashp | and set it to +1 only | 19:38 |
| ashp | because this project needs to basically be as frictionless as possible or ops will melt down | 19:38 |
| clarkb | I dont think you need to do that | 19:39 |
| clarkb | its likely just a case zuul specifically protects you against | 19:39 |
| clarkb | like depending on unapproved code | 19:39 |
| ashp | the tl;dr is this job used to auto-merge by exploiting a bug | 19:39 |
| *** e0ne has joined #openstack-infra | 19:39 | |
| *** e0ne has quit IRC | 19:39 | |
| ashp | we need them to be able to "git review" in the code, and then just mash SUBMIT and do nothing else other than have it go through a single check job | 19:40 |
| ashp | just to be sure it's mergable | 19:40 |
| *** harlowja_at_home has quit IRC | 19:40 | |
| *** Longgeek has quit IRC | 19:41 | |
| *** SumitNaiksatam has quit IRC | 19:41 | |
| *** shashankhegde has quit IRC | 19:42 | |
| *** SumitNaiksatam has joined #openstack-infra | 19:42 | |
| ashp | let me pastebin some stuff and get you to sanity check it, every other bit of my big migration this weekend worked :( | 19:43 |
| clarkb | we do that with noop jobs | 19:43 |
| clarkb | it works fine with +2... | 19:44 |
| fungi | ashp: you said you just upgraded gerrit, right? | 19:44 |
| ashp | fungi: from 2.4 to 2.9 | 19:45 |
| fungi | ashp: we had to change our comment triggers in layout.yaml going from gerrit 2.4 to 2.8 | 19:45 |
| fungi | ashp: the comment format changes | 19:45 |
| ashp | fungi: I think I changed those, but I'm curious what you changed if you have an example | 19:45 |
| ashp | http://pastebin.com/2Rd75MN8 | 19:45 |
| ashp | that's my two pipelines and two jobs | 19:45 |
| ashp | http://imgur.com/34tXcES and a screenshot showing it only verifying and never getting to gate jobs | 19:45 |
| *** ddieterly has quit IRC | 19:46 | |
| ashp | fungi: it sounds like whatever you changed might help :) | 19:46 |
| clarkb | oh and 2.9 has new events that people have patched zuul for but recently enough to be unmerged | 19:46 |
| ashp | as it does seem to be ignoring comments | 19:46 |
| fungi | hrm, yeah that looks reasonable at first glance... check it against ours at http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml if you haven't already | 19:46 |
| fungi | and right, you may want to check with someone runnign 2.9 as we're still on 2.8 | 19:46 |
| ashp | I hope I haven't bungled this whole migration by using 2.9.2 instead of 2.8.4 :/ | 19:47 |
| clarkb | 2.9 also has potentially broken ssh | 19:47 |
| fungi | well, you're blazing the trail for our benefit if so ;) | 19:47 |
| clarkb | zaro ^ did that get fixed? | 19:47 |
| *** ihrachyshka has quit IRC | 19:47 | |
| *** ryanpetrello has quit IRC | 19:49 | |
| ashp | clarkb: wouldn't zuul just ignore those events and be ok? | 19:50 |
| *** ddieterly has joined #openstack-infra | 19:50 | |
| clarkb | no it has a whitelist iirc | 19:51 |
| clarkb | I would need to read the changes though | 19:51 |
| *** baoli has quit IRC | 19:52 | |
| ashp | looking at our layout and the upstream stuff we're in sync | 19:52 |
| *** ryanpetrello has joined #openstack-infra | 19:53 | |
| zaro | clarkb: no | 19:54 |
| zaro | SSD is stil broken, which means stream events might die on you. | 19:54 |
| ashp | even in 2.9.2? :/ | 19:54 |
| ashp | This fixes SSHD-348 which was causing ssh threads allocated to stream-events clients to get stuck. | 19:54 |
| zaro | clarkb: i believe there was an email thread that 2.9.3 will contain a fix for that. | 19:55 |
| ashp | It was reported [1] that Gerrit Code Review 2.9.2 that includes SSHD 0.13 still has this problem. | 19:55 |
| zaro | basically the fix is just rollback of SSH to earlier ver | 19:55 |
| ashp | I guess this means I'm gonna have to roll back to 2.8.6.1? | 19:55 |
| ashp | and resync all my database and that stuff? | 19:55 |
| zaro | ashp: yes, Sasa says he is going to make 2.9.3 next week? | 19:56 |
| ashp | hmm, so we could probably live with this until .3 comes out, but what we can't live with is our gate jobs not triggering | 19:56 |
| ashp | and if that's part of a 2.9 change then we're screwed on that front | 19:56 |
| zaro | ashp: yeah, that would be either a zuul thing or gerrit thing. we have not tested | 19:57 |
| *** rcarrill` has joined #openstack-infra | 19:57 | |
| zaro | ashp: gerrit events might have changed enough where you might need to tweek the zuul triggers | 19:57 |
| ashp | zaro: yeah, that's what I'm hoping, it's just a slight change to events | 19:58 |
| ashp | just reading release notes | 19:58 |
| *** Masahiro has joined #openstack-infra | 19:58 | |
| *** ryanpetrello has quit IRC | 19:58 | |
| zaro | ashp: please document what you find, i will need to do the same :) | 19:59 |
| *** rcarrillocruz has quit IRC | 20:00 | |
| ashp | zaro: Well, I found.. it didn't work :D | 20:00 |
| ashp | I don't see anything in the release notes relating to event changes :/ | 20:00 |
| *** teran has joined #openstack-infra | 20:01 | |
| *** otter768 has joined #openstack-infra | 20:01 | |
| ashp | I can pastebin the debug.log from zuul as to what was sent to it for the gate that fails | 20:02 |
| ashp | maybe that'll be of some use to you if you're going to have to adapt to these changes | 20:02 |
| *** Masahiro has quit IRC | 20:02 | |
| *** avozza is now known as zz_avozza | 20:03 | |
| zaro | ashp: does that contain the gerrit event info? | 20:03 |
| ashp | yeah,: 2014-12-06 19:42:40,276 DEBUG gerrit.Gerrit: Received data from Gerrit query: | 20:03 |
| *** cnesa has quit IRC | 20:03 | |
| ashp | then a giant chunk of data | 20:03 |
| *** devlaps has joined #openstack-infra | 20:03 | |
| zaro | ashp: that would probably help | 20:04 |
| ashp | It doesn't really look like they've changed anything on the streamed events, I'll upload this chunk of the logs in a second | 20:04 |
| ashp | but at the end it seems happy with what it sees: | 20:04 |
| ashp | 2014-12-06 19:42:40,277 DEBUG zuul.Scheduler: Adding trigger event: <TriggerEvent comment-added metacloud/glance mc/2014.1.0 4093,1 Approved:1, Code-Review:2> | 20:04 |
| *** teran has quit IRC | 20:06 | |
| zaro | ashp: so maybe a problem somwhere else? | 20:06 |
| ashp | I think so | 20:06 |
| zaro | ashp: did you make an update to anything else? zuul, jenkins, etc? | 20:07 |
| ashp | Oh yeah | 20:08 |
| ashp | we migrated from an old gerrit 2.4/old zuul/old jenkins setup | 20:08 |
| ashp | to a brand new gerrit 2.9.2/zuul/jenkins setup, so it changed ... everything | 20:08 |
| ashp | I spent weeks testing it but never merged anything in because it was just in test, and that turned out to be the only piece we can't do :) | 20:09 |
| zaro | ashp: wow, kitchen sink! | 20:10 |
| *** koolhead17 has quit IRC | 20:10 | |
| ashp | zaro: yeah, it's been a long time coming | 20:10 |
| *** koolhead17 has joined #openstack-infra | 20:10 | |
| zaro | ashp: which version of jenkins? | 20:10 |
| zaro | ashp: we are using LTS 1.565.3 | 20:10 |
| ashp | 1.590 | 20:11 |
| zaro | ashp: is that LTS? or latest? | 20:11 |
| ashp | latest, not LTS | 20:11 |
| zaro | ashp: do you have the gearman-plugin installed and running? | 20:12 |
| ashp | I do, jobs actually get submitted and come back fine for check | 20:12 |
| ashp | Jenkins: Patch Set 1: Verified+1 | 20:12 |
| ashp | is what we get as comment-added in gerrit | 20:12 |
| fungi | really does sound like a comment trigger issue between the gerrit event stream and zuul | 20:13 |
| ashp | If we then have someone set Approved+1 that's not enough to trigger gate | 20:13 |
| *** zz_avozza is now known as avozza | 20:13 | |
| zaro | ahh, so this is only for gate? | 20:13 |
| ashp | fungi: yeah, I'd just expect it to fail for check too if it was that broken, it's weird as zuul seems ... you know, happy | 20:13 |
| ashp | but it must be a mismatch somewhere | 20:13 |
| ashp | I didn't want to spend hours downgrading but it's looking more likely | 20:13 |
| ashp | at least if it fails after I can realistically beg for help then as I'm on 2.8 | 20:13 |
| fungi | have you checked the output of the comment-added event to make sure it matches the regex you have for the gate pipeline trigger? | 20:13 |
| ashp | as best I can, yes | 20:14 |
| ashp | I just sent zaro a chunk of the log privately, let me show you | 20:14 |
| fungi | ashp: not sure it would necessarily fail for check. the check pipeline triggers mostly on new patchset and recheck/reverify comments | 20:14 |
| *** avozza is now known as zz_avozza | 20:15 | |
| *** koolhead17 has quit IRC | 20:15 | |
| *** mrunge has quit IRC | 20:15 | |
| zaro | zuul log does say that it scheduled something on approved | 20:16 |
| ashp | I wonder... the username for jenkins in our CI group is "Jenkins", with a capital | 20:18 |
| ashp | I don't suppose zuul is case sensitive in any way? | 20:18 |
| ashp | a horrible dumb thought that is unlikely, but still | 20:18 |
| zaro | ashp: ohh wait, didn't we change 'verified' to 'workfow' | 20:18 |
| ashp | that whole "username: jenkins" trigger would fail if it was seeing Jenkins | 20:18 |
| ashp | zaro: Hmm, in which bit? trigger for gate upstream has both workflow and verified | 20:18 |
| fungi | ashp: your event dump had username jenkins and name Jenkins | 20:19 |
| fungi | so i think it's right | 20:19 |
| ashp | yeah, was just checking that, phew | 20:19 |
| ashp | never going to be the easy fix :) | 20:19 |
| zaro | ashp: well both, our gerrit label is 'workflow' and zuul trigger matches that for gate jobs. | 20:20 |
| * zaro finds in our configs | 20:20 | |
| *** andreykurilin_ has joined #openstack-infra | 20:21 | |
| *** penguinRaider has quit IRC | 20:21 | |
| zaro | http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n25 | 20:22 |
| zaro | ashp: is your system using that same trigger? | 20:23 |
| *** hdd has joined #openstack-infra | 20:23 | |
| ashp | I was about to get excitd but yes, we have the same | 20:23 |
| zaro | opps line 47 is for gate actually | 20:23 |
| zaro | ashp: then you need to setup gerrit to use the same label, not 'approved' | 20:23 |
| ashp | OK, so maybe that's what we're doing wrong | 20:24 |
| ashp | I'm a bit of a moron when it comes to thrashing around in gerrit, so to be clear.. instead of "approved" you have a label called workflow? | 20:24 |
| zaro | setup like ours: https://review.openstack.org/gitweb?p=All-Projects.git;a=blob;f=project.config;h=80835d57d2d2e027e756b7b80f27b26cea3c2a0b;hb=HEAD | 20:25 |
| zaro | line 93 | 20:25 |
| ashp | aha, I see it | 20:25 |
| fungi | ahh, yep, i missed that the name of the gerrit label in the stream wasn't workflow | 20:28 |
| ashp | I did a quick reverse on that for testing | 20:28 |
| ashp | and changed workflow to approved temporarily in layout.yaml | 20:28 |
| ashp | 2014-12-06 20:27:50,993 DEBUG zuul.DependentPipelineManager: Event <TriggerEvent comment-added metacloud/glance mc/2014.1.0 4093,1 Approved:1, Code-Review:1> for change <Change 0x180de90 4093,1> matched <EventFilter types: comment-added event_approvals: approved:1> in pipeline <DependentPipelineManager gate> | 20:28 |
| ashp | It failed, because: 2014-12-06 20:27:50,994 DEBUG zuul.DependentPipelineManager: Change <Change 0x180de90 4093,1> can not merge, ignoring | 20:29 |
| ashp | but it's trying! | 20:29 |
| fungi | that's progress | 20:29 |
| fungi | we settled on the name "workflow" btw because we use -1 to represent work in progress and 0 for ready to review | 20:29 |
| ashp | If I can figure out why it thinks it can't merge suddenly, we might be ok | 20:30 |
| zaro | w00t! | 20:30 |
| *** e0ne has joined #openstack-infra | 20:31 | |
| fungi | ashp: that's likely going to be something in your gerrit configuration. zuul asks gerrit if the change is ready to merge before enqueuing into the gate | 20:31 |
| ashp | ah interesting, so gerrit decides that | 20:32 |
| ashp | wonder if I'll have to reclone everything inside gerrit from github | 20:32 |
| fungi | so for us that's at least one code review +2, no code review -2, workflow +1, no workflow -1 | 20:32 |
| fungi | oh, and parent changes if they exist need to already be enqueued | 20:33 |
| ashp | I wonder if our "strategy" in gerrit is now wrong | 20:34 |
| ashp | as it's just merge if necessary | 20:34 |
| zaro | ashp: where is strategy set? | 20:40 |
| ashp | in the top level project, it seems like the right choice to be using, still trying to figure out why gerrit thinks a +2 readme change can't be merged | 20:40 |
| ashp | trying a different repo first in case it's as simple as that one being bust, it's new | 20:41 |
| zaro | all votes correctly set? | 20:42 |
| zaro | any prolog rules? | 20:43 |
| ashp | they seem to be, it triggers the gate job and immediately fails for not being mergable, does that come exclusively from gerrit or try to merge into the stuff in zuul's git copy | 20:43 |
| ashp | no prolog rules | 20:43 |
| fungi | that debug line comes from isChangeReadyToBeEnqueued() in the scheduler | 20:45 |
| fungi | means that self.pipeline.source.canMerge(change, self.getSubmitAllowNeeds()) returned a value which evaluated as boolean false | 20:46 |
| fungi | which i believe means the combination of things zuul expects and determines gerrit expects for that change and any of its parent changes is not met | 20:47 |
| zaro | fungi: that's just checking that all votes lined up? could it be failing because an attempt to merge caused a conflict? | 20:49 |
| zaro | zuul would probably return a different message for that though? | 20:49 |
| ashp | I think, if I'm not wrong, that zuul can git clone from gerrit if the repo is not already checked out (zuul-merger, right?) | 20:50 |
| fungi | i don't think it got far enough to submit a merger work request into gearman at that point | 20:50 |
| ashp | so I'm trying to try and remove my copy of the repo on zuul in case some weirdness is going on there | 20:50 |
| fungi | so it's complaining about the state of votes and parent changes i bleieve | 20:50 |
| zaro | ashp: maybe you need to try a fresh patch with no dependent parents? | 20:51 |
| ashp | I should take up farming :) | 20:51 |
| ashp | zaro: will do | 20:51 |
| ashp | zuul checked out from gerrit, so that part seems ok, letting this run through the full set of check: stuff and maybe we'll be making progress | 20:52 |
| *** armax has joined #openstack-infra | 20:54 | |
| ashp | I just hope someone in infra goes mad and writes their own review system one day | 20:54 |
| *** AlexF has joined #openstack-infra | 20:55 | |
| *** shakamunyi has quit IRC | 20:55 | |
| anteaya | I just looked at my flights for tomorrow, I get picked up in 12 hours to go to the airport, wooooo | 20:58 |
| * anteaya starts laundry | 20:58 | |
| ashp | take all your dirty laundry in a suitcase, let the airline lose it, and buy all new clothes with the money they give you | 20:58 |
| clarkb | anteaya going somewhere warm? | 20:59 |
| *** teran has joined #openstack-infra | 21:02 | |
| anteaya | well warmer than here | 21:04 |
| anteaya | salt lake city for neutron mid-cycle | 21:04 |
| anteaya | above freezing there, maybe some rain on thursday | 21:04 |
| anteaya | ashp: well there's that too | 21:05 |
| anteaya | but I am hoping I can get away with just my back pack this trip | 21:05 |
| * anteaya dreams of light luggage | 21:05 | |
| *** teran has quit IRC | 21:06 | |
| *** AlexF has quit IRC | 21:06 | |
| *** _nadya_ has quit IRC | 21:07 | |
| ashp | so close and yet so far, I was hoping letting zuul check out from gerrit would magically fix the merge thing | 21:07 |
| fungi | ashp: the openstack-infra/vinz project was supposed to be the beginnings of that. devs from rackspace were going to work on it... if you wanted to give them a hand ;) | 21:07 |
| ashp | fungi: I'll have to take a look, anything is less painful than this | 21:09 |
| ashp | ok this is interesting | 21:09 |
| ashp | the contents of zuul's git repo contains this CR contents | 21:09 |
| ashp | so it -did- merge | 21:09 |
| *** jgjl has joined #openstack-infra | 21:09 | |
| *** baoli has joined #openstack-infra | 21:09 | |
| * zaro sorry need to afk | 21:10 | |
| ashp | http://pastebin.com/YuxBNWUP obviously it must be to do with the votes as suggested | 21:10 |
| *** ildikov_ has joined #openstack-infra | 21:14 | |
| *** sarob has joined #openstack-infra | 21:14 | |
| *** emagana has joined #openstack-infra | 21:15 | |
| *** armax has quit IRC | 21:16 | |
| *** rushiagr is now known as rushiagr_away | 21:17 | |
| fungi | yeah, so the comment parsing seems to be fine | 21:18 |
| fungi | it did notice a comment carrying a verified +1 and checked to see if it could enqueue into the gate | 21:19 |
| fungi | but then decided the necessary prerequisites for that were unmet | 21:19 |
| *** emagana has quit IRC | 21:20 | |
| *** ildikov_ has quit IRC | 21:21 | |
| *** krtaylor has quit IRC | 21:21 | |
| ashp | fungi: so digging into those: | 21:22 |
| ashp | u'submitRecords': [{u'labels': [{u'label': u'Verified', u'status': u'NEED'}, | 21:22 |
| ashp | We have Verified +1 jenkins set on this, and I would have thought that would be enough for a gate job to trigger | 21:23 |
| ashp | but it looks like it's still expecting +2 from verified before it'll run a gate job | 21:23 |
| *** esker has joined #openstack-infra | 21:24 | |
| *** armax has joined #openstack-infra | 21:25 | |
| *** krtaylor has joined #openstack-infra | 21:27 | |
| *** dimsum__ has joined #openstack-infra | 21:27 | |
| *** baoli has quit IRC | 21:30 | |
| ashp | https://github.com/openstack-infra/zuul/blob/e9a8184fe0e15d877e8fc43bdd59c717615bc249/zuul/scheduler.py#L995-L1003 | 21:30 |
| *** baoli has joined #openstack-infra | 21:30 | |
| ashp | If i could work out how it figures out "success_actions" I could work out what statuses it's happy to filter out in https://github.com/openstack-infra/zuul/blob/186a1d5261a61d16df2210bbfb29a999f3369cf8/zuul/trigger/gerrit.py#L263-L267 | 21:31 |
| *** zz_avozza is now known as avozza | 21:39 | |
| *** yamamoto has joined #openstack-infra | 21:40 | |
| ashp | well that's weird | 21:42 |
| ashp | we had to set code-review +2 to get gate to run | 21:42 |
| ashp | which sounds crazy | 21:42 |
| fungi | yeah, if your gerrit is configured to allow code review +2 then you need at least one +2 there before it's ready to be considered | 21:44 |
| *** yamamoto has quit IRC | 21:44 | |
| ashp | ok, we think we want to keep this workflow for now, I was going to add -code-review to approval: | 21:44 |
| ashp | but I think this... makes sense | 21:45 |
| *** hdd has quit IRC | 21:45 | |
| ashp | I have to work out how to change a single project to not need +2 code-review before it runs the gate job | 21:46 |
| ashp | if I can figure that out we're done and I can cry in a corner | 21:46 |
| *** Masahiro has joined #openstack-infra | 21:47 | |
| ashp | I am guessing there's no way to make a project in gerrit set labels on creation, but I'm going to find out :) | 21:47 |
| *** SumitNaiksatam has quit IRC | 21:47 | |
| clarkb | why cant the reviewers set it? | 21:48 |
| clarkb | also in theory zuul could set it | 21:48 |
| ashp | to give a bit of awkward history | 21:49 |
| ashp | basically this is a single queue for an ops team that don't do code reviews | 21:49 |
| ashp | and would rather push directly into github but can't due to crazyreasons | 21:50 |
| clarkb | you can let them push directly to gerrit | 21:50 |
| ashp | this is just a temporary kludge anyway as they will be moving into a real "must review your code" thing | 21:50 |
| ashp | my thoughts were to try and redefine the label "code-review" function to something other than MaxWithBlock or maybe just set only "value = 0" in there for that one project | 21:51 |
| *** SumitNaiksatam has joined #openstack-infra | 21:51 | |
| *** Masahiro has quit IRC | 21:51 | |
| ashp | NoBlock/NoOp | 21:51 |
| ashp | The label is purely informational and values are not considered when determining whether a change is submittable. | 21:51 |
| clarkb | I guess if you do that why not give them direct push? | 21:52 |
| *** tnovacik has quit IRC | 21:52 | |
| clarkb | seems like what you want is push access | 21:52 |
| clarkb | then remove that when they need to do code review | 21:52 |
| fungi | yeah, having zuul trigger on code review +2 rather than workflow +1 would be a fairly simple workaround | 21:53 |
| fungi | or just have whoever leaves the workflow +1 also leave a code review +2 | 21:54 |
| fungi | if you're trying to mimic the setup we have, minus social convention | 21:54 |
| *** baoli has quit IRC | 21:55 | |
| ashp | were a bit all over the place in what we're doing, we're basically slowly aligning with upstream more and more | 21:56 |
| ashp | but we don't want to change everything at once :) | 21:56 |
| *** armax has quit IRC | 21:58 | |
| *** tnovacik has joined #openstack-infra | 22:00 | |
| *** avozza is now known as zz_avozza | 22:01 | |
| *** armax has joined #openstack-infra | 22:01 | |
| *** teran has joined #openstack-infra | 22:02 | |
| ashp | argh, so close, once again Verified shows up as NEED rather than OK despite being +1, grumpgrumpgrump | 22:05 |
| *** baoli has joined #openstack-infra | 22:05 | |
| *** teran has quit IRC | 22:07 | |
| *** armax has quit IRC | 22:08 | |
| *** yfried_ has quit IRC | 22:09 | |
| *** sarob has quit IRC | 22:10 | |
| *** otter768 has quit IRC | 22:10 | |
| *** emagana has joined #openstack-infra | 22:10 | |
| *** emagana has quit IRC | 22:14 | |
| *** stevemar has joined #openstack-infra | 22:17 | |
| *** baoli has quit IRC | 22:17 | |
| *** baoli has joined #openstack-infra | 22:17 | |
| *** sarob has joined #openstack-infra | 22:18 | |
| *** e0ne has quit IRC | 22:20 | |
| *** sarob has quit IRC | 22:23 | |
| ashp | almost all done until I realized whatever we had that pushed our gerrit repos into github | 22:27 |
| ashp | is now missing :) | 22:27 |
| clarkb | gerrit replication | 22:28 |
| clarkb | its a plugin and configured in conf file | 22:28 |
| ashp | yeah, i forgot I had it deliberately disabled during test | 22:30 |
| ashp | just had to reenable it | 22:30 |
| ashp | reject HostKey: github.com - figures | 22:30 |
| *** teran has joined #openstack-infra | 22:32 | |
| ashp | hopefully this is the last thing I have to fix today :) | 22:32 |
| anteaya | famous last words | 22:32 |
| *** teran_ has joined #openstack-infra | 22:33 | |
| *** teran has quit IRC | 22:36 | |
| *** sarob has joined #openstack-infra | 22:44 | |
| *** Longgeek has joined #openstack-infra | 22:48 | |
| *** sarob has quit IRC | 22:49 | |
| *** jgjl has quit IRC | 22:53 | |
| *** Longgeek has quit IRC | 22:53 | |
| *** emagana has joined #openstack-infra | 23:04 | |
| *** toabctl has quit IRC | 23:05 | |
| *** toabctl has joined #openstack-infra | 23:07 | |
| *** ekarlso- has quit IRC | 23:07 | |
| *** emagana has quit IRC | 23:08 | |
| *** ryanpetrello has joined #openstack-infra | 23:12 | |
| *** andreykurilin_ has quit IRC | 23:22 | |
| *** andreykurilin_ has joined #openstack-infra | 23:22 | |
| *** mwagner_lap has quit IRC | 23:22 | |
| *** devlaps has quit IRC | 23:25 | |
| *** mwagner_lap has joined #openstack-infra | 23:35 | |
| *** Masahiro has joined #openstack-infra | 23:35 | |
| *** Masahiro has quit IRC | 23:39 | |
| *** Dafna has quit IRC | 23:51 | |
| *** ryanpetrello has quit IRC | 23:53 | |
| *** ryanpetrello has joined #openstack-infra | 23:53 | |
| *** otter768 has joined #openstack-infra | 23:54 | |
| *** teran has joined #openstack-infra | 23:55 | |
| *** teran_ has quit IRC | 23:58 | |
| *** emagana has joined #openstack-infra | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!