| *** mrodden has quit IRC | 00:10 | |
| *** pmoosh has quit IRC | 00:24 | |
| *** pmoosh has joined #openstack-infra | 00:24 | |
| *** enikanorov-w has quit IRC | 00:24 | |
| *** enikanorov-w has joined #openstack-infra | 00:24 | |
| *** rnirmal has joined #openstack-infra | 00:48 | |
| *** mrodden has joined #openstack-infra | 00:48 | |
| *** rnirmal has quit IRC | 00:49 | |
| *** yongli has joined #openstack-infra | 00:59 | |
| *** dcramer__ has joined #openstack-infra | 01:00 | |
| *** dcramer__ has quit IRC | 01:05 | |
| *** degrizzle has joined #openstack-infra | 01:25 | |
| *** dzyu has joined #openstack-infra | 01:31 | |
| *** dzyu has quit IRC | 01:39 | |
| *** marun has joined #openstack-infra | 01:49 | |
| *** CaptTofu has joined #openstack-infra | 01:57 | |
| *** dcramer__ has joined #openstack-infra | 02:00 | |
| *** jinkoo has joined #openstack-infra | 02:00 | |
| *** yaguang has joined #openstack-infra | 02:01 | |
| *** zehicle_at_dell has joined #openstack-infra | 02:04 | |
| *** fandikurnia01 has joined #openstack-infra | 02:04 | |
| *** senk has joined #openstack-infra | 02:05 | |
| *** CaptTofu has quit IRC | 02:13 | |
| *** fandikurnia01 has quit IRC | 02:35 | |
| *** xchu has joined #openstack-infra | 02:39 | |
| *** fandikurnia01 has joined #openstack-infra | 02:41 | |
| *** fandikurnia01 has quit IRC | 02:41 | |
| *** zehicle_at_dell has quit IRC | 02:59 | |
| *** senk has quit IRC | 03:15 | |
| *** senk has joined #openstack-infra | 03:16 | |
| *** mrodden has quit IRC | 03:17 | |
| *** lnxnut has quit IRC | 03:24 | |
| *** dhellmann is now known as dhellmann_ | 03:28 | |
| *** yamahata has joined #openstack-infra | 03:31 | |
| *** degrizzle has quit IRC | 03:34 | |
| *** dcramer__ has quit IRC | 03:37 | |
| *** markmcclain has joined #openstack-infra | 03:40 | |
| *** lnxnut has joined #openstack-infra | 03:45 | |
| *** lnxnut has quit IRC | 03:47 | |
| *** lnxnut has joined #openstack-infra | 03:47 | |
| *** dcramer__ has joined #openstack-infra | 03:50 | |
| *** lnxnut has quit IRC | 03:52 | |
| *** lnxnut_ has joined #openstack-infra | 03:52 | |
| *** dcramer__ has quit IRC | 03:57 | |
| *** vogxn has joined #openstack-infra | 04:08 | |
| *** dkliban has joined #openstack-infra | 04:10 | |
| *** SergeyLukjanov has joined #openstack-infra | 04:16 | |
| *** markmcclain has quit IRC | 04:22 | |
| *** yamahata has quit IRC | 04:25 | |
| *** lnxnut_ has quit IRC | 04:30 | |
| *** dkehn has joined #openstack-infra | 04:31 | |
| *** dkliban has quit IRC | 04:31 | |
| *** yamahata has joined #openstack-infra | 04:48 | |
| *** UtahDave has quit IRC | 04:50 | |
| *** SergeyLukjanov has quit IRC | 04:51 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Diff between installed packages and requirements https://review.openstack.org/45329 | 04:53 |
|---|---|---|
| *** UtahDave has joined #openstack-infra | 04:54 | |
| *** boris-42 has joined #openstack-infra | 04:55 | |
| *** SergeyLukjanov has joined #openstack-infra | 04:59 | |
| pmoosh | rak_ did you do a search on http://docs.openstack.org/ | 05:02 |
| *** UtahDave has quit IRC | 05:03 | |
| *** tian has joined #openstack-infra | 05:07 | |
| *** pmoosh has quit IRC | 05:08 | |
| *** SergeyLukjanov has quit IRC | 05:22 | |
| *** sungju has joined #openstack-infra | 05:28 | |
| *** jinkoo has quit IRC | 05:33 | |
| *** pblaho has joined #openstack-infra | 05:46 | |
| *** afazekas is now known as __afazekas | 05:59 | |
| *** xchu has quit IRC | 06:02 | |
| *** senk has quit IRC | 06:06 | |
| *** xchu has joined #openstack-infra | 06:19 | |
| *** afazekas has joined #openstack-infra | 06:22 | |
| *** yaguang has quit IRC | 06:24 | |
| *** jhesketh__ has quit IRC | 06:24 | |
| *** jhesketh__ has joined #openstack-infra | 06:24 | |
| *** yolanda_ has joined #openstack-infra | 06:26 | |
| *** cody-somerville has joined #openstack-infra | 06:27 | |
| *** cody-somerville has quit IRC | 06:27 | |
| *** cody-somerville has joined #openstack-infra | 06:27 | |
| *** yamahata has quit IRC | 06:31 | |
| *** SpamapS has quit IRC | 06:31 | |
| *** yamahata has joined #openstack-infra | 06:36 | |
| *** senk has joined #openstack-infra | 06:37 | |
| *** __afazekas has quit IRC | 06:40 | |
| *** yaguang has joined #openstack-infra | 06:41 | |
| *** cody-somerville has quit IRC | 06:42 | |
| *** senk has quit IRC | 06:44 | |
| *** SergeyLukjanov has joined #openstack-infra | 06:52 | |
| *** sungju has quit IRC | 06:55 | |
| *** ekarlso- has quit IRC | 07:07 | |
| *** jinkoo has joined #openstack-infra | 07:07 | |
| *** flaper87|afk is now known as flaper87 | 07:15 | |
| *** thomasbiege has joined #openstack-infra | 07:18 | |
| *** thomasbiege has quit IRC | 07:27 | |
| *** dizquierdo has joined #openstack-infra | 07:28 | |
| *** jpich has joined #openstack-infra | 07:29 | |
| *** Ryan_Lane has quit IRC | 07:41 | |
| *** senk has joined #openstack-infra | 07:41 | |
| *** yongli has quit IRC | 07:41 | |
| *** mkerrin has joined #openstack-infra | 07:44 | |
| *** senk has quit IRC | 07:46 | |
| *** xchu has quit IRC | 07:47 | |
| *** fbo_away is now known as fbo | 07:52 | |
| *** yongli has joined #openstack-infra | 07:53 | |
| *** SpamapS has joined #openstack-infra | 07:54 | |
| *** SpamapS has quit IRC | 07:54 | |
| *** SpamapS has joined #openstack-infra | 07:54 | |
| *** odyssey4me has joined #openstack-infra | 07:55 | |
| *** xchu has joined #openstack-infra | 07:59 | |
| *** senk has joined #openstack-infra | 08:12 | |
| *** SergeyLukjanov has quit IRC | 08:12 | |
| *** SergeyLukjanov has joined #openstack-infra | 08:13 | |
| *** senk has quit IRC | 08:16 | |
| *** michchap has quit IRC | 08:17 | |
| *** yolanda_ has quit IRC | 08:20 | |
| *** jinkoo has quit IRC | 08:27 | |
| *** jinkoo has joined #openstack-infra | 08:27 | |
| *** anteaya has quit IRC | 08:29 | |
| openstackgerrit | Flavio Percoco proposed a change to openstack/requirements: Add missing requirement for tests https://review.openstack.org/46702 | 08:34 |
| *** yongli is now known as yongli_away | 08:41 | |
| *** dizquierdo has left #openstack-infra | 08:47 | |
| *** thomasbiege has joined #openstack-infra | 09:05 | |
| *** thomasbiege has quit IRC | 09:05 | |
| *** senk has joined #openstack-infra | 09:13 | |
| *** jhesketh__ has quit IRC | 09:14 | |
| *** senk has quit IRC | 09:17 | |
| *** xchu has quit IRC | 09:23 | |
| *** jinkoo has quit IRC | 09:48 | |
| *** yaguang has quit IRC | 10:01 | |
| *** pcm_ has joined #openstack-infra | 10:04 | |
| *** pcm_ has quit IRC | 10:05 | |
| *** pcm_ has joined #openstack-infra | 10:05 | |
| *** dizquierdo has joined #openstack-infra | 10:12 | |
| *** SergeyLukjanov has quit IRC | 10:13 | |
| *** senk has joined #openstack-infra | 10:14 | |
| *** SergeyLukjanov has joined #openstack-infra | 10:14 | |
| *** senk has quit IRC | 10:18 | |
| *** lnxnut has joined #openstack-infra | 10:43 | |
| *** lnxnut has quit IRC | 10:52 | |
| flaper87 | hey guys, I hate to poke for reviews but, could any of you take a look here? https://review.openstack.org/#/c/46702/ | 10:56 |
| flaper87 | We need that to make marconi tests pass in the gate | 10:56 |
| *** vogxn has quit IRC | 11:03 | |
| *** senk has joined #openstack-infra | 11:15 | |
| *** senk has quit IRC | 11:19 | |
| *** bingbu has joined #openstack-infra | 11:40 | |
| *** bingbu has quit IRC | 11:40 | |
| *** degrizzle has joined #openstack-infra | 11:43 | |
| *** ArxCruz has joined #openstack-infra | 11:46 | |
| *** HenryG has quit IRC | 11:49 | |
| *** weshay has joined #openstack-infra | 11:55 | |
| *** CaptTofu has joined #openstack-infra | 11:58 | |
| *** yamahata has quit IRC | 12:05 | |
| *** yamahata has joined #openstack-infra | 12:09 | |
| *** CaptTofu has quit IRC | 12:12 | |
| *** dkliban has joined #openstack-infra | 12:15 | |
| *** senk has joined #openstack-infra | 12:15 | |
| *** lcestari has joined #openstack-infra | 12:17 | |
| *** senk has quit IRC | 12:19 | |
| *** CaptTofu has joined #openstack-infra | 12:23 | |
| openstackgerrit | Tom Fifield proposed a change to openstack-infra/jeepyb: Fix logic in doc impact https://review.openstack.org/46721 | 12:23 |
| *** lnxnut has joined #openstack-infra | 12:24 | |
| *** degrizzle has quit IRC | 12:25 | |
| *** rfolco has joined #openstack-infra | 12:25 | |
| *** AJaeger has joined #openstack-infra | 12:27 | |
| *** lnxnut has quit IRC | 12:29 | |
| *** jcoufal has joined #openstack-infra | 12:29 | |
| *** acabrera has joined #openstack-infra | 12:30 | |
| *** thomasm has joined #openstack-infra | 12:38 | |
| *** dizquierdo has quit IRC | 12:39 | |
| *** jaypipes has joined #openstack-infra | 12:46 | |
| *** zehicle_at_dell has joined #openstack-infra | 12:54 | |
| *** pblaho- has joined #openstack-infra | 13:00 | |
| *** HenryG has joined #openstack-infra | 13:02 | |
| *** pblaho has quit IRC | 13:04 | |
| *** pblaho- has quit IRC | 13:06 | |
| mordred | flaper87: I will look at that right now | 13:06 |
| mordred | flaper87: just so you know - the rest of the project uses testscenarios for that | 13:06 |
| mordred | flaper87: just -1'd. the entry needs to be in global-requirements.txt | 13:08 |
| *** pblaho has joined #openstack-infra | 13:08 | |
| *** dkranz has quit IRC | 13:10 | |
| *** jpeeler has quit IRC | 13:11 | |
| *** prad has joined #openstack-infra | 13:12 | |
| mordred | flaper87: but honestly - it would be great if you could migrate to testscenarios | 13:12 |
| *** matty_dubs|gone is now known as matty_dubs | 13:13 | |
| *** senk has joined #openstack-infra | 13:16 | |
| *** dkliban has quit IRC | 13:19 | |
| *** senk has quit IRC | 13:21 | |
| *** dkliban has joined #openstack-infra | 13:22 | |
| *** michchap has joined #openstack-infra | 13:24 | |
| *** mriedem has joined #openstack-infra | 13:24 | |
| *** lnxnut has joined #openstack-infra | 13:31 | |
| mordred | fungi: morning - you ready for a week with all the rest of us distracted? | 13:31 |
| *** pblaho has quit IRC | 13:32 | |
| *** jergerber has joined #openstack-infra | 13:32 | |
| *** jpeeler has joined #openstack-infra | 13:34 | |
| *** jpeeler has quit IRC | 13:34 | |
| *** jpeeler has joined #openstack-infra | 13:34 | |
| *** adalbas has joined #openstack-infra | 13:35 | |
| fungi | mordred: ready as i'll ever be | 13:36 |
| fungi | i take it clarkb's going to be occupied with the tripleo hackathon/sprint thing while you and jeblair are at pycon | 13:38 |
| mordred | fungi: I'm assuming he'll at least be distracted | 13:38 |
| * fungi has stocked up on caffeine. should either be able to take care of everything or stroke out | 13:40 | |
| mordred | neat! | 13:40 |
| flaper87 | mordred: thanks for that | 13:41 |
| flaper87 | I'll move it, lets approve it for now. We'll migrate to testscenarios | 13:41 |
| flaper87 | mordred: thanks a lot | 13:42 |
| mordred | awesome | 13:42 |
| *** burt has joined #openstack-infra | 13:44 | |
| *** pblaho has joined #openstack-infra | 13:45 | |
| openstackgerrit | Flavio Percoco proposed a change to openstack/requirements: Add missing requirement for tests https://review.openstack.org/46702 | 13:46 |
| flaper87 | mordred: done, thanks again | 13:46 |
| mordred | flaper87: k. +2 from me. fungi ^^ | 13:48 |
| fungi | flaper87: lgtm. was this the main issue which broke testing after the org move on saturday? | 13:49 |
| flaper87 | fungi: I think so, I'll recheck your patch. | 13:50 |
| flaper87 | mordred: fungi thanks a lot guys | 13:51 |
| fungi | flaper87: you'll want to wait until 46702 merges and then the mirror jobs complete | 13:51 |
| flaper87 | fungi: yup | 13:51 |
| mordred | fungi, jeblair, pleia2: quick thought about cgit - the /cgit/ portion of the URL makes it hard to know which url to put on a slide | 13:51 |
| *** blamar has joined #openstack-infra | 13:54 | |
| *** michchap has quit IRC | 13:54 | |
| fungi | mordred: you mean as far as browsing vs git operations? | 13:54 |
| *** SergeyLukjanov has quit IRC | 13:54 | |
| mordred | yeah. I mean, if I put https://git.openstack.org/openstack/blah.git ... | 13:55 |
| mordred | hrm. maybe .git at the end shold be the signifier | 13:55 |
| *** michchap has joined #openstack-infra | 13:55 | |
| mordred | if I have a .git, I should not have a cgit, and if I don't have a .git, I should | 13:55 |
| fungi | i usually try to include the .git suffix to indicate it's a bare remote repo | 13:55 |
| fungi | so that makes sense to me | 13:55 |
| fungi | client tools strip the trailing .git anyway when they see it, so should be safe | 13:56 |
| *** dkranz has joined #openstack-infra | 13:56 | |
| fungi | and also in favor of that pattern, trying to browse /cgit/foo/bar.git fails with "no repositories found" (cgit doesn't deal with the .git in its urls) | 13:58 |
| *** SergeyLukjanov has joined #openstack-infra | 13:58 | |
| *** michchap has quit IRC | 13:59 | |
| *** zehicle_at_dell has quit IRC | 14:00 | |
| *** michchap has joined #openstack-infra | 14:00 | |
| *** markmcclain has joined #openstack-infra | 14:00 | |
| fungi | ugh, https://jenkins02.openstack.org/job/gate-requirements-install/164/console | 14:02 |
| fungi | i guess that's an argument in favor of running a full pypi mirror rather than a partial one. we could switch the requirements tests to use the mirror that way | 14:04 |
| *** markmcclain has joined #openstack-infra | 14:06 | |
| *** pblaho has quit IRC | 14:09 | |
| *** mrodden has joined #openstack-infra | 14:09 | |
| *** pblaho has joined #openstack-infra | 14:10 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/gear: Encapsulate the raw socket.send calls https://review.openstack.org/46736 | 14:12 |
| *** wenlock has joined #openstack-infra | 14:16 | |
| *** w_ is now known as olaph | 14:16 | |
| *** senk has joined #openstack-infra | 14:16 | |
| *** changbl has quit IRC | 14:17 | |
| *** adalbas has quit IRC | 14:19 | |
| *** senk has quit IRC | 14:20 | |
| *** dcramer__ has joined #openstack-infra | 14:25 | |
| *** dizquierdo has joined #openstack-infra | 14:27 | |
| *** lnxnut_ has joined #openstack-infra | 14:28 | |
| Alex_Gaynor | Gate appears to be very flaky right now | 14:28 |
| *** vogxn has joined #openstack-infra | 14:30 | |
| *** changbl has joined #openstack-infra | 14:30 | |
| *** lnxnut has quit IRC | 14:31 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/gear: Add SSL error checking https://review.openstack.org/46741 | 14:32 |
| *** UtahDave has joined #openstack-infra | 14:33 | |
| mordred | fungi: what's using thrift that we're using? | 14:34 |
| jeblair | mordred, fungi: good morning | 14:34 |
| mordred | jeblair: morning jeblair ! | 14:34 |
| mordred | jeblair: the two gear patches are purely based on chatting with Shrews | 14:34 |
| jeblair | anything i need to look at? | 14:34 |
| mordred | jeblair: not to my knowledge | 14:35 |
| jeblair | mordred: cool, i recall shrews said more stuff needed to be done for ssl, so they are not unexpected | 14:35 |
| *** adalbas has joined #openstack-infra | 14:35 | |
| *** datsun180b has joined #openstack-infra | 14:35 | |
| mordred | jeblair: yeah. basically, I implemented his email | 14:35 |
| jeblair | mordred: yay! | 14:35 |
| *** senk has joined #openstack-infra | 14:35 | |
| mordred | jeblair: I'm not sure the best way to _test_ it | 14:35 |
| jeblair | i am at the conference now, btw | 14:35 |
| mordred | so I expect more work needs to be done | 14:35 |
| mordred | but I figured I'd do some leg work in case that made it easier for Shrews to start looking at consuming gear | 14:36 |
| mordred | jeblair: I won't be over there for anoter bit - I've got a 10am call I have to be on | 14:36 |
| mordred | jeblair: how long did it take you to walk? 10-15ish? | 14:36 |
| jeblair | mordred: i took a wrong turn, so i don't have data :( | 14:37 |
| *** UtahDave has quit IRC | 14:37 | |
| jeblair | i'm not sure i'm going to go to any sessions. they have donkey kong and air hockey and more in the lobby. | 14:38 |
| *** senk has quit IRC | 14:38 | |
| mordred | jeblair: nice | 14:38 |
| mordred | jeblair: well, also, I want to steal a chunk of your time to talk about dib today | 14:39 |
| *** michchap has quit IRC | 14:39 | |
| mordred | both the mechanics of using it with nodepool, and hte logistics of where diskimage building/consuming wants to live in the overall infra design | 14:39 |
| mordred | which are two different, but related topics | 14:39 |
| jeblair | mordred: bring quarters! | 14:40 |
| openstackgerrit | Marton Kiss proposed a change to openstack-infra/config: Add groups-dev.openstack.org node https://review.openstack.org/42608 | 14:40 |
| openstackgerrit | David Shrewsbury proposed a change to openstack-infra/gear: Add SSL error checking https://review.openstack.org/46741 | 14:40 |
| *** doctorjnupe has joined #openstack-infra | 14:40 | |
| Shrews | mordred: ^^^ just a minor change | 14:41 |
| Shrews | mordred: basically, you'd need to check for all 3 ssl files. I just added a use_ssl flag. | 14:42 |
| *** vogxn has quit IRC | 14:42 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/gear: Add SSL error checking https://review.openstack.org/46741 | 14:43 |
| mordred | Shrews: awesome | 14:43 |
| * mordred just fixed up Alex_Gaynor's comments. thanks Alex_Gaynor - great catch | 14:43 | |
| fungi | mordred: apparently thrift is needed by happybase in global-requirements.txt | 14:45 |
| mordred | fungi: yeah - just tracked that down | 14:46 |
| mordred | fungi: in any case, I still think partial mirror is fine, and rechecking requirements changes is fine by me for now | 14:46 |
| dansmith | I've been kinda out of it for a week, so I'm sure I missed this but... what's the "silent" queue I'm now seeing? | 14:50 |
| fungi | mordred: pypi.p.o is seeming pretty unreliable in that job (failed again reverifying that change, but this time on a different download). perhaps we're getting outbound network connection tracking/nat failures in hpcloud? | 14:51 |
| fungi | though i guess if that were the problem, we'd be seeing a similar proportion of download failures from devstack jobs hitting pypi.o.o and i don't think we do | 14:51 |
| *** pentameter has joined #openstack-infra | 14:53 | |
| jeblair | dansmith: silent has always been there; it's like check -- it runs jobs on new patchsets, but doesn't report back to gerrit | 14:55 |
| dansmith | jeblair: huh, I've not been seeing it in dash until just now.. | 14:56 |
| jeblair | dansmith: it's so you can see how a job is gonig to perform as a gating or check job without botherings devs | 14:56 |
| jeblair | dansmith: experimental is new | 14:56 |
| dansmith | hmm, I wonder if I was skipping the first one or something such that a change in order made silent start showing up | 14:56 |
| * dansmith will have to read his own code | 14:56 | |
| jeblair | dansmith: it only runs jobs in response to "check experimental" comments (like rechecks); for testing jobs that aren't really expected to work yet | 14:57 |
| *** weshay has quit IRC | 14:57 | |
| jeblair | dansmith: so yeah, the addition of experimental may have changed the array order | 14:57 |
| fungi | dansmith: though the particular job running in silent at the moment was added in https://review.openstack.org/45501 if that helps with rationale | 14:57 |
| mordred | jeblair: (you should mention experimental in your talk) | 14:57 |
| jeblair | mordred: yes! | 14:58 |
| dansmith | fungi: ah | 14:58 |
| fungi | it moved from experimental (where it was being manually triggered) to silent (where it can be profiled statistically) | 14:59 |
| *** mgagne has joined #openstack-infra | 14:59 | |
| *** mgagne has joined #openstack-infra | 14:59 | |
| fungi | at least statistically profiled more easily, since it will run a lot more often over a more representative set of changes | 15:00 |
| Alex_Gaynor | dstufft: ping | 15:00 |
| dstufft | Alex_Gaynor: pong | 15:01 |
| *** mgagne1 has joined #openstack-infra | 15:01 | |
| *** mgagne1 has joined #openstack-infra | 15:01 | |
| Alex_Gaynor | dstufft: seeing some connectivity issues on pypi, and status.p.o reports higher than average response stime, any idea what's up? | 15:01 |
| dstufft | nope, I jut sat down, I can take a look though | 15:02 |
| fungi | yeah, we're definitely getting random timeouts from the handful of jobs we have which hit actual pypi rather than our mirror | 15:02 |
| Alex_Gaynor | dstufft: thanks | 15:02 |
| *** pcrews has joined #openstack-infra | 15:04 | |
| *** mgagne has quit IRC | 15:04 | |
| *** thomasbiege1 has joined #openstack-infra | 15:05 | |
| *** dkranz has quit IRC | 15:05 | |
| openstackgerrit | Julien Danjou proposed a change to openstack-infra/config: Run Tempest tests against Ceilometer w/ MongoDB https://review.openstack.org/45862 | 15:06 |
| *** UtahDave has joined #openstack-infra | 15:06 | |
| *** dkehn has quit IRC | 15:09 | |
| *** rnirmal has joined #openstack-infra | 15:11 | |
| dstufft | Alex_Gaynor: I'm not seeing anything at the moment, and it looks like the high ping times (5kms) might be in the past since we're at 700ms right now | 15:11 |
| Alex_Gaynor | dstufft: is 700ms good? I don't have a reference point | 15:11 |
| *** UtahDave has quit IRC | 15:11 | |
| dstufft | I think we're normally around 400-500 | 15:11 |
| dstufft | oh wait | 15:12 |
| dstufft | I'm reading this chart wrong | 15:12 |
| dstufft | lol being half asleep | 15:12 |
| dstufft | we're averaged at 700 for the past day, but we're currently higher | 15:12 |
| *** openstackgerrit has quit IRC | 15:13 | |
| *** cyeoh has quit IRC | 15:14 | |
| *** sdague has quit IRC | 15:14 | |
| *** briancline has quit IRC | 15:14 | |
| *** pcrews has quit IRC | 15:15 | |
| Alex_Gaynor | dstufft: is this just a bad route? | 15:15 |
| jeblair | mordred, ttx: we launched 10,000 jobs on aug 28 | 15:15 |
| mordred | jeblair: 10,000 jobs? 10,000 nodes? or both? | 15:15 |
| jeblair | jobs | 15:15 |
| dstufft | Alex_Gaynor: "route" is a loaded term, which def of route do you mean :) | 15:16 |
| mordred | jeblair: ossum | 15:16 |
| Alex_Gaynor | dstufft: I mean, like, there are some packets that aren't going super fast | 15:16 |
| Alex_Gaynor | dstufft: I don't know how networks work, FYI | 15:16 |
| dstufft | It appears the origin is taking a long time | 15:17 |
| dstufft | fastly is making it appear better since they'll cache stuff | 15:17 |
| *** briancline has joined #openstack-infra | 15:17 | |
| jeblair | mordred, ttx: we launched approx 6,500 nodes that day | 15:18 |
| Alex_Gaynor | dstufft: origin? | 15:18 |
| dstufft | Alex_Gaynor: PyPI itself, what fastly connects to | 15:18 |
| *** thomasbiege1 has quit IRC | 15:18 | |
| Alex_Gaynor | dstufft: so, OSUOSL is slow for some reason, netwroking wise, or is our pythons slow? | 15:18 |
| mordred | jeblair: NICE | 15:19 |
| *** cody-somerville has joined #openstack-infra | 15:19 | |
| dstufft | Alex_Gaynor: unclear atm, I just did a few ``time curl http://pypi.int.python.org/pypi``'s | 15:19 |
| *** sdague has joined #openstack-infra | 15:19 | |
| *** senk has joined #openstack-infra | 15:26 | |
| Shrews | fungi, et.al.: bot is missing in #stackforge-dev | 15:27 |
| *** danger_fo_away is now known as danger_fo | 15:27 | |
| *** pcrews has joined #openstack-infra | 15:28 | |
| fungi | Shrews: openstackgerrit was lost at sea, apparently. i'll head out in search of him now | 15:29 |
| *** senk has quit IRC | 15:30 | |
| *** senk has joined #openstack-infra | 15:30 | |
| *** adam_g has quit IRC | 15:31 | |
| *** openstackgerrit has joined #openstack-infra | 15:31 | |
| Shrews | fungi: gracias | 15:31 |
| *** mrodden has quit IRC | 15:31 | |
| fungi | Shrews: yeah, disappeared about 15 minutes ago (ping timeout) but is back now after restarting the bot | 15:32 |
| *** markmcclain has quit IRC | 15:32 | |
| fungi | looks like we lost a few others with similar ping timeouts at the same time, so probably one of freenode's servers is thrashing | 15:33 |
| *** thomasbiege1 has joined #openstack-infra | 15:33 | |
| *** thomasbiege1 has quit IRC | 15:33 | |
| *** weshay has joined #openstack-infra | 15:34 | |
| *** yaguang has joined #openstack-infra | 15:34 | |
| *** rnirmal has quit IRC | 15:36 | |
| afazekas | sdague: https://review.openstack.org/#/c/46663/ | 15:38 |
| *** zul has quit IRC | 15:40 | |
| jeblair | sdague: from earlier: | 15:40 |
| jeblair | 15:16 < jeblair> mordred, ttx: we launched 10,000 jobs on aug 28 | 15:40 |
| jeblair | 15:19 < jeblair> mordred, ttx: we launched approx 6,500 nodes that day | 15:40 |
| jeblair | dhellmann_: ^ | 15:41 |
| Alex_Gaynor | nice | 15:41 |
| jeblair | (that's a peak, not average) | 15:41 |
| *** zul has joined #openstack-infra | 15:43 | |
| *** dcramer__ has quit IRC | 15:43 | |
| dstufft | Alex_Gaynor: so it appears like it might be DB related, looking closer | 15:44 |
| dstufft | also | 15:45 |
| dstufft | fucking pypi | 15:45 |
| Alex_Gaynor | dstufft: k | 15:45 |
| dstufft | hey let's just pass our application class into the template and do queries directly in the templates | 15:45 |
| dstufft | it'll be fine | 15:45 |
| *** mrodden has joined #openstack-infra | 15:45 | |
| * fungi is willing to buy that. also, do you have any bridges for sale? | 15:46 | |
| *** dcramer__ has joined #openstack-infra | 15:46 | |
| *** yaguang has quit IRC | 15:47 | |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/jeepyb: Improve git2lp and is_direct_release behaviour https://review.openstack.org/37620 | 15:48 |
| dstufft | well this query doesn't seem to be the problem https://gist.github.com/dstufft/6582501 | 15:51 |
| *** yaguang has joined #openstack-infra | 15:52 | |
| Alex_Gaynor | dstufft: a cool thing is using some enums instead of strings | 15:52 |
| *** doctorjnupe has quit IRC | 15:53 | |
| dstufft | Alex_Gaynor: out of all the things wrong in PyPI enums is pretty low on my list ;P | 15:53 |
| Alex_Gaynor | dstufft: so what am I even looking at? | 15:54 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Diff between installed packages and requirements https://review.openstack.org/45329 | 15:54 |
| *** thomasbiege1 has joined #openstack-infra | 15:54 | |
| dstufft | Alex_Gaynor: the gist? it's just telling me what the query on the page that taking 3s to load takes when I run it | 15:54 |
| Alex_Gaynor | dstufft: 3 seconds? "Total runtime: 2.613 ms" | 15:55 |
| dstufft | Alex_Gaynor: the page load is taking 3 seconds | 15:55 |
| dstufft | not the query | 15:55 |
| dstufft | I was seeing if the query was the problem | 15:55 |
| Alex_Gaynor | dstufft: ah | 15:55 |
| Alex_Gaynor | dstufft: postgresql is a pretty cool thing :) | 15:56 |
| dstufft | Alex_Gaynor: :) | 15:56 |
| dstufft | https://bitbucket.org/pypa/pypi/src/18f27218146244eb62c41a8cdeff4e1084d67905/webui.py?at=default#cl-877 is the view that's slow | 15:56 |
| Alex_Gaynor | dstufft: ugh, do I gotta read a template now? (should we move to python-infra?) | 15:57 |
| dstufft | we can move there yea | 15:57 |
| openstackgerrit | Kurt Griffiths proposed a change to openstack/requirements: Allow the new Falcon 0.1.7 series https://review.openstack.org/46757 | 15:58 |
| Alex_Gaynor | mordred: for the packaging freeze, is that just going to be on adding new stuff, or changing versions as well? | 16:01 |
| *** SergeyLukjanov has quit IRC | 16:04 | |
| *** atiwari has joined #openstack-infra | 16:06 | |
| *** thomasbiege1 has quit IRC | 16:09 | |
| *** ryanpetrello has joined #openstack-infra | 16:10 | |
| *** dprince has joined #openstack-infra | 16:11 | |
| *** flaper87 is now known as flaper87|afk | 16:12 | |
| *** dkranz has joined #openstack-infra | 16:12 | |
| *** matty_dubs is now known as matty_dubs|lunch | 16:14 | |
| *** adam_g has joined #openstack-infra | 16:15 | |
| *** adam_g has quit IRC | 16:15 | |
| *** adam_g has joined #openstack-infra | 16:15 | |
| *** bearhands is now known as comstud | 16:16 | |
| *** dkranz has quit IRC | 16:18 | |
| clarkb | morning | 16:19 |
| *** dkranz has joined #openstack-infra | 16:19 | |
| clarkb | fungi: yes I am being distracted, hopefully this will help our ability to test upstream | 16:19 |
| fungi | clarkb: too awesome. good luck on productive distractions! | 16:20 |
| *** pcrews has quit IRC | 16:23 | |
| fungi | i think we should pretty much just assume any of our jobs which touch pypi.python.org are unlikely to succeed until their issues are sorted... https://jenkins02.openstack.org/job/gate-requirements-install/ | 16:24 |
| fungi | all of those failed on timeouts retrieving various packages | 16:25 |
| *** yaguang has quit IRC | 16:25 | |
| fungi | well, i guess not various packages. twice retrieving thrift and five times retrieving python-heatclient (odd that) | 16:27 |
| *** jpich has quit IRC | 16:27 | |
| *** cody-somerville has quit IRC | 16:28 | |
| dhellmann_ | fungi: ping? | 16:28 |
| *** dhellmann_ is now known as dhellmann | 16:28 | |
| fungi | dhellmann: howdy | 16:28 |
| *** senk has quit IRC | 16:28 | |
| dhellmann | hi! you're not at linuxconf, I take it? | 16:28 |
| fungi | dhellmann: nope, holding down the fort | 16:28 |
| dhellmann | :-) | 16:29 |
| mordred | Alex_Gaynor: I think we should potentially consider it frozen in general, and treat requests to land version changes at feature freeze exceptions | 16:29 |
| *** senk has joined #openstack-infra | 16:29 | |
| mordred | Alex_Gaynor: mainly so that we're not screwing the distros | 16:29 |
| dhellmann | fungi:I'm trying to get a WSME beta release done between sessions this morning. I thought the job definitions went through, but I don't see them running. http://logs.openstack.org/15/15c05263c3166f1321b46174f2c0705194a36192/ | 16:30 |
| * fungi takes a gander | 16:30 | |
| dhellmann | fungi: hmm, maybe that's the wrong tag | 16:31 |
| dhellmann | I mean ref | 16:31 |
| dhellmann | hang on | 16:31 |
| fungi | dhellmann: yeah, that looks like a prerelease tag | 16:32 |
| fungi | 0.5b5 seems to be your latest? | 16:32 |
| dhellmann | yeah | 16:32 |
| fungi | a.k.a. 0c35c38807730a16f878bdb15eefb98fc4e32ae2 | 16:32 |
| dhellmann | I sent a bad link, that's to the commit but not to the tag | 16:32 |
| fungi | http://logs.openstack.org/0c/0c35c38807730a16f878bdb15eefb98fc4e32ae2/ | 16:33 |
| *** Ryan_Lane has joined #openstack-infra | 16:33 | |
| fungi | http://logs.openstack.org/0c/0c35c38807730a16f878bdb15eefb98fc4e32ae2/pre-release/wsme-pypi-upload/2543d00/console.html | 16:33 |
| dhellmann | yeah, how do I get that value? git log isn't showing the tag separately, does git tag have a verbose mode or something? | 16:33 |
| fungi | "curl: (22) The requested URL returned error: 404" | 16:33 |
| *** pblaho has quit IRC | 16:33 | |
| fungi | dhellmann: 'git show-ref 0.5b5' | 16:33 |
| dhellmann | ah | 16:33 |
| fungi | it's a secret incantation | 16:34 |
| *** SergeyLukjanov has joined #openstack-infra | 16:34 | |
| *** senk has quit IRC | 16:34 | |
| *** doctorjnupe has joined #openstack-infra | 16:34 | |
| dhellmann | I need to make git os-job smarter :-) | 16:34 |
| dhellmann | it works if I specify the tag explicitly | 16:35 |
| fungi | anyway, something bad about the pypi upload. either pypi itself had issues (seems to be a theme today) or maybe you have a bad trove classifier. i'll try running it manually without the redaction to see why it's being rejected | 16:35 |
| dhellmann | so, I don't understand the failure -- it couldn't download a tarball that was just uploaded? | 16:35 |
| dhellmann | ah, ok | 16:35 |
| *** wenlock has quit IRC | 16:36 | |
| fungi | oh, right i misread. it failed to retrieve the tarball from tarballs.o.o before uploading it to pypi | 16:36 |
| *** CaptTofu has quit IRC | 16:36 | |
| fungi | aha. our jobs seem to assume everyone rips the caps-lock keys off their keyboards | 16:37 |
| *** moted has quit IRC | 16:37 | |
| *** wenlock has joined #openstack-infra | 16:37 | |
| dhellmann | oh, is the tarball called *WSME* | 16:37 |
| *** moted has joined #openstack-infra | 16:37 | |
| fungi | i think this *might* be the first project we've tried autoreleasing to pypi which has shoutycaps | 16:37 |
| dhellmann | indeed, seems to be | 16:38 |
| dhellmann | :-( | 16:38 |
| *** rnirmal has joined #openstack-infra | 16:38 | |
| dhellmann | does that mean renaming a job or jobs to get the right name passed through? | 16:38 |
| fungi | i'm torn on whether this should be fixed in the sdist step (maybe within pbr) or if we need some better introspection into the tarball capitalization | 16:38 |
| fungi | mordred: if you're near an internet for a moment, opinion? ^ | 16:39 |
| mordred | looking | 16:39 |
| mordred | oh. wow. | 16:40 |
| mordred | uhm | 16:40 |
| mordred | it should not be fixed in the sdist step - we'd be breaking how python works if we did that | 16:41 |
| mordred | if the project name is WSME, then the project name is WSME | 16:41 |
| afazekas | fungi: https://review.openstack.org/#/c/46770/ | 16:41 |
| dhellmann | so rename our jobs? | 16:41 |
| *** SergeyLukjanov has quit IRC | 16:41 | |
| mordred | possibly | 16:41 |
| mordred | except I think that will make the repos unhappy | 16:41 |
| dhellmann | wonder what will mean for the existing git repo | 16:41 |
| mordred | as in, all the jobs that are not the tarball upload job | 16:41 |
| mordred | so I think that's a bad idea | 16:41 |
| fungi | mordred: yeah, good point. casing is a locale-specific concept, so changing case is a slippery slope to other forms of characterset normalization | 16:42 |
| *** senk has joined #openstack-infra | 16:42 | |
| mordred | maybe we need to make the tarball job smarter and/or able to grok a name argument | 16:42 |
| mordred | if we have the upload job check out the repo | 16:42 |
| dhellmann | does jjb support optional args? | 16:42 |
| fungi | i'm thinking that's probably the sanest solution | 16:42 |
| mordred | then we can get the name out of setup.cfg | 16:42 |
| fungi | dhellmann: yeah, it does | 16:43 |
| mordred | pretty easily programmatically | 16:43 |
| mordred | or we can do optional args | 16:43 |
| dhellmann | fungi: I'll have to look for that, I wanted to use some but couldn't figure out how to make them work. | 16:43 |
| *** SergeyLukjanov has joined #openstack-infra | 16:43 | |
| *** Ryan_Lane has quit IRC | 16:43 | |
| dhellmann | (in an internal job) | 16:43 |
| *** senk1 has joined #openstack-infra | 16:43 | |
| fungi | afazekas: lgtm, though i'm not core on devstack so +1 from me | 16:43 |
| *** cyeoh has joined #openstack-infra | 16:44 | |
| fungi | dhellmann: parameterized jobs can stuff environment variables in the shell snippets/scripts | 16:44 |
| fungi | dhellmann: so in theory the script could either look in the calling environment or we adjust the command line to pass a variable as an argument | 16:45 |
| dhellmann | fungi: oh, ok, I figured out how to do that -- I meant could I provide a default for a parameter in jjb, and then have one job override it | 16:45 |
| fungi | oic | 16:45 |
| dhellmann | but one question at a time :-) | 16:45 |
| fungi | you said *optional* args. my bar | 16:45 |
| fungi | bad | 16:46 |
| dhellmann | ah, I guess I meant "optional parameter" then :-) | 16:46 |
| *** senk has quit IRC | 16:46 | |
| *** markmcclain has joined #openstack-infra | 16:46 | |
| fungi | i honestly don't recall if i've seen any examples of us doing that in any jobs... i'd have to dig | 16:47 |
| dhellmann | maybe that's what the "defaults" feature is for, I'll play with that | 16:47 |
| *** afazekas has quit IRC | 16:47 | |
| fungi | mordred: would we be going to far afield if we added a jeepyb projects.yaml field which indicates the python package name (and have that default t the same as the project name)? | 16:48 |
| fungi | seems a little out of scope for that file, but then again it is a bit of a dumping ground for random facets of a project anyway | 16:49 |
| *** ekarlso has joined #openstack-infra | 16:49 | |
| *** DennyZhang has joined #openstack-infra | 16:51 | |
| mordred | fungi: no, I think a field that defaults to package name (so it can be mostly ignore) sounds great | 16:51 |
| mordred | fungi: unless you are saying we'd need to add that field to every job | 16:52 |
| mordred | in which case I think that sounds bad/evil | 16:52 |
| *** odyssey4me has quit IRC | 16:53 | |
| *** matty_dubs|lunch is now known as matty_dubs | 16:54 | |
| mordred | Alex_Gaynor: we may want to ask people who are requesting new packages or versions during the freeze to do the research on whether or not the lib is in distros or not | 16:55 |
| fungi | mordred: yeah, i just meant an optional field in the jeepyb projects.yaml to indicate the python package name if it differs from the git project name | 16:56 |
| jeblair | fungi: jeepyb is not used by jjb | 16:56 |
| dhellmann | fungi: would it be simpler to just rename "wsme" to "WSME"? | 16:57 |
| fungi | jeblair: right, i meant for use by the pypi-upload script | 16:57 |
| *** senk1 has quit IRC | 16:57 | |
| fungi | though if there's a static way to derive the python package name from the git repo contents, maybe we just add a ggp for that workspace and find out what it should be by analyzing the source? | 16:58 |
| *** cody-somerville has joined #openstack-infra | 16:58 | |
| *** dprince has quit IRC | 16:58 | |
| dhellmann | "python setup.py --name" | 16:58 |
| dhellmann | I guess that's not "static" thouh | 16:58 |
| dhellmann | *though | 16:58 |
| jeblair | fungi: jeepy also isn't used by that; i'm not sure i'm excited about adding another dep there; rename or jjb args sound preferable... | 16:59 |
| jeblair | i actually would prefer 'inspect setup.cfg' to jjb args... | 16:59 |
| fungi | jeblair: yeah, i'm similarly not keen on adding more deps to jjb or the upload script | 16:59 |
| jeblair | but while you could do that in the tarball job, i'm not sure how to convey that to the upload job | 17:00 |
| *** fbo is now known as fbo_away | 17:00 | |
| jeblair | so rename / jjb args sound like leading candidates | 17:00 |
| fungi | i'll see if it's safe to just figure out the package name from the git repo contents. it would be nice for the pypi upload to have a copy of the same ref which called it, for other future sorts of analysis prior to uploading anyway | 17:01 |
| *** senk has joined #openstack-infra | 17:01 | |
| mordred | jeblair: any reason to not inspect setup.cfg? | 17:02 |
| dhellmann | python -c 'import ConfigParser; cp = ConfigParser.SafeConfigParser(); cp.read("setup.cfg"); print cp.get("metadata", "name")' | 17:02 |
| fungi | setup.cfg contains "name = WSME" so in theory that should work | 17:02 |
| mordred | yes. the tarball name is 100% driven by setup.cfg metadata.name | 17:02 |
| jeblair | mordred: how does the upload job get that? | 17:03 |
| fungi | gerrit git prep? | 17:03 |
| mordred | jeblair: we'd have to add a gerrit-git-prep to it | 17:03 |
| mordred | since it wouldn't be executing code from the repo, it _should_ be safe on our upload node, yeah? | 17:04 |
| *** tstevenson_ is now known as tstevenson | 17:04 | |
| jeblair | oh, i see what you mean. i didn't understand what you meant by that noun. | 17:04 |
| jeblair | so have a git checkout to fetch the metadata... | 17:04 |
| mordred | yeah | 17:04 |
| fungi | i would similarly like to ggp the calling git ref on the upload slave to be able to do things like diff the state of the git repo represented by the tag against the contents of the retrieved tarball | 17:05 |
| jeblair | how possible is it to pwn the jenkins node by doing that? | 17:05 |
| mordred | it seems pretty safe, as long as we never run setup.py | 17:05 |
| jeblair | that == python -c 'import ConfigParser; cp = ConfigParser.SafeConfigParser(); cp.read("setup.cfg"); print cp.get("metadata", "name")' | 17:05 |
| fungi | we could always do something even more braindead like grep+sed on that file to avoid getting a python interpreter anywhere near it | 17:06 |
| jeblair | so as long as that's safe, it sounds like a reasonable solution | 17:06 |
| mordred | yeah. I think ConfigParser should be fairly safe - but also what fungi said is probably not impossible | 17:07 |
| fungi | though it seems a little tinfoil hat to me | 17:07 |
| jeblair | we should use perl ;) | 17:07 |
| jeblair | (jk) | 17:07 |
| mordred | main key is a) don't ever execute setup.py in that repo b) make sure we handle metadata.name not existing and falling back to the jjb name | 17:07 |
| * fungi was readying the spud gun | 17:07 | |
| mordred | because name will only be there in pbr-based repos, and we still have some non-pbr repos | 17:07 |
| jeblair | sgtm | 17:08 |
| mordred | but I think it's fair to not support alternate names for non-pbr repos | 17:08 |
| mordred | for this reason | 17:08 |
| mordred | :) | 17:08 |
| *** dizquierdo has quit IRC | 17:09 | |
| fungi | mordred: yeah, i think "assume the package name is == to the project name by default" is the right way, and then we override that from the metadata.name value | 17:09 |
| *** SergeyLukjanov has quit IRC | 17:09 | |
| fungi | we can always expand the name discovery mechanism there in the future if there's some need to support other ways of finding it in non-pbr projects, though i doubt that's likely to become necessary | 17:10 |
| dhellmann | all of this should work, but I'll ask again: would renaming the "wsme" project stuff to "WSME" be simpler? or would that be super disruptive? | 17:10 |
| dhellmann | i.e., do we need to support alternate names, or did I just make a mistake when I imported this project? | 17:10 |
| fungi | dhellmann: we have a lot of other places where we likely assume all lower-case names for git repos | 17:11 |
| mordred | it would be simpler | 17:11 |
| fungi | so renaming WSME to wsme might be simpler, but not sure about the other way around | 17:11 |
| mordred | and pip and friends are case insensitive, so it shouldn't break anyone currently consuming | 17:11 |
| jeblair | i don't think we assume lower case for git repos | 17:11 |
| dhellmann | oh, I was talking about the git repo and stuff on stackforge, not the pypi project or packages | 17:12 |
| mordred | right. renaming to wsme would be simpler. but also, I don't think that adding the support to the upload script would be terrible either | 17:12 |
| *** kgriffs has joined #openstack-infra | 17:12 | |
| jeblair | we do assume that repo name == projet name | 17:12 |
| mordred | jeblair: we assume name of git repo matches name in jjb etc | 17:12 |
| mordred | yeah | 17:12 |
| *** SergeyLukjanov has joined #openstack-infra | 17:12 | |
| mordred | dhellmann: I think renaming the git repo and stuff would be much more work | 17:12 |
| jeblair | so i'm trying to say that yeah, rename git repo and corresponding jjb config to WSME is the "right" way | 17:12 |
| jeblair | and what we have done in the past | 17:12 |
| mordred | oh. gotcha | 17:12 |
| mordred | but is not something that will/can happen today | 17:13 |
| mordred | as it involves gerrit downtime | 17:13 |
| dhellmann | wow, really? | 17:13 |
| mordred | yes. project renames are extremely disruptive and involve excuting database queries and a bunch of other things | 17:13 |
| jeblair | if we want to expand our supported offering to include a git repo/project name mismatch, i'm ok with that. :) | 17:14 |
| fungi | since we don't have any mixed/upper-case projects elsewhere afaik, i wouldn't be surprised to find it break on another capitalization assumption somewhere. but i'm willing to believe we don't intentionally assume lower-case-only | 17:14 |
| mordred | dhellmann: in case you're wondering: http://ci.openstack.org/gerrit.html#renaming-a-project | 17:14 |
| fungi | we did that again just this past weekend for marconi. total time for those of us working on it was somewhere around 1-1.5 hours i think | 17:15 |
| fungi | though a good bit of that was waiting for automagic things to happen | 17:15 |
| jeblair | fungi: thanks, btw! | 17:16 |
| fungi | jeblair: you bet | 17:16 |
| fungi | happy i could help | 17:16 |
| *** vipul is now known as vipul-away | 17:16 | |
| *** mrmartin has joined #openstack-infra | 17:16 | |
| dhellmann | so what's the best path forward? | 17:17 |
| fungi | i'm perfectly happy giving the pypi-upload job a copy of the repo/checkout of the ref and adding a few lines to the script to override the package name | 17:17 |
| *** pcrews has joined #openstack-infra | 17:18 | |
| *** julim has joined #openstack-infra | 17:18 | |
| * fungi works up a patch real quick-like | 17:18 | |
| dhellmann | I'm about to run out of power, so I may have to sign off shortly until I can find an outlet. | 17:18 |
| fungi | dhellmann: should be a tiny addition. once we get that through review, i can re-trigger your prerelease upload job manually | 17:19 |
| fungi | that'll give us a thorough confirmation it works | 17:19 |
| dhellmann | fungi: thanks, I appreciate it | 17:19 |
| fungi | in the meantime, happy conferencing | 17:19 |
| dhellmann | fungi: will you add me to the review when you post it, please? | 17:20 |
| fungi | dhellmann: sure thing | 17:20 |
| dhellmann | cool, thanks | 17:20 |
| *** kgriffs has left #openstack-infra | 17:22 | |
| *** vipul-away is now known as vipul | 17:22 | |
| *** thomasbiege1 has joined #openstack-infra | 17:24 | |
| jeblair | fungi, mordred: https://review.openstack.org/#/c/46772/ | 17:24 |
| jeblair | clarkb: ^ | 17:24 |
| *** markmcclain has quit IRC | 17:26 | |
| fungi | awesome! | 17:27 |
| *** ryanpetrello has quit IRC | 17:29 | |
| *** julim has quit IRC | 17:30 | |
| *** nati_ueno has joined #openstack-infra | 17:32 | |
| Alex_Gaynor | As a heads up, dstufft and I believe we've fixed the issue with PyPi | 17:32 |
| *** harlowja has quit IRC | 17:33 | |
| *** harlowja has joined #openstack-infra | 17:33 | |
| *** pmoosh has joined #openstack-infra | 17:33 | |
| *** thomasbiege2 has joined #openstack-infra | 17:33 | |
| fungi | Alex_Gaynor: dstufft: thanks! the current reverify of the failing change i was watching is doing better on the job which was flaking out on pypi downloads | 17:34 |
| *** thomasbiege1 has quit IRC | 17:35 | |
| *** dcramer__ has quit IRC | 17:37 | |
| mtreinish | mordred: on https://review.openstack.org/#/c/45303/ do you have any ideas why build_sphinx fails? I took a quick look at it and nothing seemed obvious but I don't know enough about pbr, or sphinx. | 17:38 |
| *** Ryan_Lane has joined #openstack-infra | 17:42 | |
| *** tstevenson has quit IRC | 17:42 | |
| *** senk has quit IRC | 17:42 | |
| *** gyee has joined #openstack-infra | 17:42 | |
| *** jerryz has joined #openstack-infra | 17:42 | |
| *** tstevenson has joined #openstack-infra | 17:43 | |
| *** burt has quit IRC | 17:46 | |
| *** thomasbiege2 has quit IRC | 17:53 | |
| *** thomasbiege1 has joined #openstack-infra | 17:56 | |
| *** SergeyLukjanov has quit IRC | 18:00 | |
| *** HenryG has quit IRC | 18:00 | |
| *** carlp is now known as carlp-away | 18:02 | |
| *** DennyZhang has quit IRC | 18:02 | |
| *** SergeyLukjanov has joined #openstack-infra | 18:04 | |
| *** pentameter has quit IRC | 18:05 | |
| pmoosh | could I ask one of you guys a git/gerrit question? | 18:05 |
| openstackgerrit | A change was merged to openstack/requirements: Add missing requirement for tests https://review.openstack.org/46702 | 18:14 |
| *** DennyZhang has joined #openstack-infra | 18:27 | |
| *** DinaBelova has joined #openstack-infra | 18:27 | |
| *** afazekas has joined #openstack-infra | 18:32 | |
| *** senk has joined #openstack-infra | 18:43 | |
| *** dims has joined #openstack-infra | 18:44 | |
| *** jcoufal has quit IRC | 18:45 | |
| *** gyee has quit IRC | 18:50 | |
| *** CaptTofu has joined #openstack-infra | 18:52 | |
| *** colinmcnamara has joined #openstack-infra | 18:59 | |
| *** sarob has joined #openstack-infra | 19:02 | |
| jeblair | fungi: thanks for catching that typo! | 19:02 |
| *** julim has joined #openstack-infra | 19:02 | |
| fungi | jeblair: my pleasure | 19:02 |
| fungi | pmoosh: sure, what's the question? | 19:02 |
| *** sarob has quit IRC | 19:03 | |
| *** dcramer__ has joined #openstack-infra | 19:04 | |
| *** sarob has joined #openstack-infra | 19:06 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Add some branches to the channel config for publications https://review.openstack.org/46790 | 19:06 |
| *** harlowja has quit IRC | 19:06 | |
| *** harlowja has joined #openstack-infra | 19:07 | |
| *** jcoufal has joined #openstack-infra | 19:08 | |
| *** sdake_ has joined #openstack-infra | 19:09 | |
| *** sdake_ has quit IRC | 19:10 | |
| *** sdake_ has joined #openstack-infra | 19:10 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/gearman-plugin: Always return WORK_COMPLETE when a build finishes regardless of the result. https://review.openstack.org/46125 | 19:11 |
| *** Protux has joined #openstack-infra | 19:11 | |
| *** wenlock has quit IRC | 19:16 | |
| *** DinaBelova has quit IRC | 19:20 | |
| *** ArxCruz has quit IRC | 19:23 | |
| *** Mithrandir has quit IRC | 19:24 | |
| *** Mithrandir has joined #openstack-infra | 19:24 | |
| *** ryanpetrello has joined #openstack-infra | 19:28 | |
| *** sdake_ has quit IRC | 19:29 | |
| *** burt has joined #openstack-infra | 19:31 | |
| *** acabrera is now known as cppcabrera | 19:39 | |
| *** hashar has joined #openstack-infra | 19:40 | |
| *** sdake_ has joined #openstack-infra | 19:42 | |
| *** senk has quit IRC | 19:43 | |
| *** thomasbiege1 has quit IRC | 19:45 | |
| *** Ryan_Lane1 has joined #openstack-infra | 19:50 | |
| *** Ryan_Lane has quit IRC | 19:50 | |
| *** wenlock has joined #openstack-infra | 19:51 | |
| *** dguitarbite has joined #openstack-infra | 19:51 | |
| *** Ryan_Lane1 has quit IRC | 19:55 | |
| *** Ryan_Lane has joined #openstack-infra | 19:55 | |
| *** sdake_ has quit IRC | 19:55 | |
| *** jcoufal has quit IRC | 19:56 | |
| *** blamar has quit IRC | 19:56 | |
| *** colinmcnamara has quit IRC | 19:56 | |
| *** dcramer__ has quit IRC | 19:59 | |
| *** jcoufal has joined #openstack-infra | 20:00 | |
| *** blamar has joined #openstack-infra | 20:00 | |
| *** beagles has quit IRC | 20:03 | |
| *** rev has joined #openstack-infra | 20:04 | |
| *** hashar has quit IRC | 20:04 | |
| *** cppcabrera has quit IRC | 20:06 | |
| *** beagles has joined #openstack-infra | 20:06 | |
| *** julim has quit IRC | 20:06 | |
| *** gyee has joined #openstack-infra | 20:07 | |
| *** wenlock has quit IRC | 20:08 | |
| *** danger_fo has quit IRC | 20:20 | |
| *** atiwari has quit IRC | 20:20 | |
| *** hemnafk has quit IRC | 20:20 | |
| *** danger_fo has joined #openstack-infra | 20:22 | |
| *** hemnafk has joined #openstack-infra | 20:22 | |
| *** atiwari has joined #openstack-infra | 20:22 | |
| *** thedodd has joined #openstack-infra | 20:24 | |
| *** hemnafk is now known as hemna | 20:25 | |
| *** thedodd has quit IRC | 20:26 | |
| *** markmcclain has joined #openstack-infra | 20:26 | |
| *** thedodd has joined #openstack-infra | 20:27 | |
| *** thedodd has quit IRC | 20:28 | |
| *** thedodd has joined #openstack-infra | 20:28 | |
| *** fbo_away is now known as fbo | 20:28 | |
| *** senk has joined #openstack-infra | 20:31 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Determine the package name when uploading to PyPI https://review.openstack.org/46805 | 20:31 |
| *** SergeyLukjanov has quit IRC | 20:34 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Determine the package name when uploading to PyPI https://review.openstack.org/46805 | 20:35 |
| mrmartin | fungi, if you have a few minutes, please review the community portal infra patch: https://review.openstack.org/#/c/42608/ | 20:38 |
| mrmartin | fungi: thnx | 20:39 |
| fungi | mrmartin: i was just about back around to that one. having a look now | 20:39 |
| mrmartin | thanks | 20:39 |
| mrmartin | then I wait a few minutes before going to sleep | 20:40 |
| jeblair | mordred: you should add this to the slide on how your test tripleo using the fake bare metal driver :) http://en.wikipedia.org/wiki/File:Serpiente_alquimica.jpg | 20:41 |
| fungi | that's even better than the FlapJackStack | 20:42 |
| *** dkehn has joined #openstack-infra | 20:43 | |
| *** dguitarbite has quit IRC | 20:43 | |
| *** dguitarbite has joined #openstack-infra | 20:48 | |
| *** lnxnut has joined #openstack-infra | 20:51 | |
| *** markmcclain has quit IRC | 20:53 | |
| *** lnxnut_ has quit IRC | 20:54 | |
| *** burt has quit IRC | 20:55 | |
| *** markmcclain has joined #openstack-infra | 20:56 | |
| *** amotoki_ has joined #openstack-infra | 20:58 | |
| *** afazekas is now known as afazekas_zz | 20:59 | |
| *** amotoki is now known as amotoki__ | 20:59 | |
| *** mestery has joined #openstack-infra | 20:59 | |
| *** amotoki_ is now known as amotoki | 20:59 | |
| *** thomasbiege1 has joined #openstack-infra | 21:00 | |
| *** vipul is now known as vipul-away | 21:00 | |
| *** HenryG has joined #openstack-infra | 21:01 | |
| *** mrmartin has quit IRC | 21:01 | |
| *** boris-42 has quit IRC | 21:02 | |
| *** boris-42 has joined #openstack-infra | 21:03 | |
| *** dguitarbite has quit IRC | 21:03 | |
| *** Ryan_Lane1 has joined #openstack-infra | 21:05 | |
| *** Ryan_Lane has quit IRC | 21:05 | |
| *** rev has quit IRC | 21:07 | |
| *** rnirmal has quit IRC | 21:07 | |
| *** DennyZhang has quit IRC | 21:08 | |
| *** rfolco has quit IRC | 21:11 | |
| *** sarob has quit IRC | 21:13 | |
| *** Ryan_Lane1 is now known as Ryan_Lane | 21:14 | |
| *** Ryan_Lane has joined #openstack-infra | 21:14 | |
| *** vipul-away is now known as vipul | 21:15 | |
| *** dprince has joined #openstack-infra | 21:21 | |
| *** thedodd has quit IRC | 21:23 | |
| *** dcramer__ has joined #openstack-infra | 21:24 | |
| *** julim has joined #openstack-infra | 21:24 | |
| *** dprince has quit IRC | 21:26 | |
| *** dcramer__ has quit IRC | 21:30 | |
| *** mriedem has quit IRC | 21:30 | |
| *** senk has quit IRC | 21:36 | |
| *** fbo is now known as fbo_away | 21:37 | |
| *** lnxnut has quit IRC | 21:42 | |
| *** dcramer__ has joined #openstack-infra | 21:42 | |
| *** julim has quit IRC | 21:43 | |
| *** rnirmal has joined #openstack-infra | 21:45 | |
| *** burt has joined #openstack-infra | 21:47 | |
| *** senk has joined #openstack-infra | 21:48 | |
| *** dkranz has quit IRC | 21:50 | |
| *** thomasm has quit IRC | 21:52 | |
| *** senk1 has joined #openstack-infra | 21:52 | |
| *** senk has quit IRC | 21:52 | |
| *** nicedice has joined #openstack-infra | 21:53 | |
| *** matty_dubs is now known as matty_dubs|gone | 21:55 | |
| *** senk has joined #openstack-infra | 21:55 | |
| *** jcoufal has quit IRC | 21:56 | |
| *** dkliban has quit IRC | 21:56 | |
| *** senk1 has quit IRC | 21:56 | |
| *** pcm_ has quit IRC | 21:57 | |
| *** boris-42 has quit IRC | 21:59 | |
| *** enikanorov-w has quit IRC | 22:01 | |
| *** enikanorov-w has joined #openstack-infra | 22:02 | |
| *** dizquierdo has joined #openstack-infra | 22:02 | |
| *** senk1 has joined #openstack-infra | 22:04 | |
| *** amotoki has quit IRC | 22:05 | |
| *** HenryG has quit IRC | 22:05 | |
| *** senk has quit IRC | 22:06 | |
| *** thomasbiege1 has quit IRC | 22:09 | |
| *** senk1 has quit IRC | 22:09 | |
| *** burt has quit IRC | 22:13 | |
| *** dkehn has quit IRC | 22:15 | |
| *** dkehn has joined #openstack-infra | 22:18 | |
| *** dkehn has joined #openstack-infra | 22:18 | |
| *** dkehn has quit IRC | 22:20 | |
| *** dkehn has joined #openstack-infra | 22:20 | |
| *** dprince has joined #openstack-infra | 22:23 | |
| *** gyee has quit IRC | 22:23 | |
| openstackgerrit | A change was merged to openstack-infra/nodepool: Ignore hacking warnings https://review.openstack.org/46481 | 22:28 |
| openstackgerrit | A change was merged to openstack-infra/nodepool: Make node SSH timeout configurable. https://review.openstack.org/46565 | 22:29 |
| *** UtahDave has joined #openstack-infra | 22:29 | |
| *** sarob has joined #openstack-infra | 22:32 | |
| *** anteaya has joined #openstack-infra | 22:32 | |
| *** dizquierdo has quit IRC | 22:33 | |
| openstackgerrit | A change was merged to openstack-infra/config: Fix publish location of High Availibility Guide https://review.openstack.org/46425 | 22:33 |
| mordred | jeblair: ++ | 22:34 |
| mordred | mtreinish: no - I am 10000% baffled by that and keep trying to track it down | 22:34 |
| *** mestery has quit IRC | 22:38 | |
| *** markmcclain has quit IRC | 22:38 | |
| *** jhesketh__ has joined #openstack-infra | 22:39 | |
| UtahDave | fungi: Hey, I haven't been able to reproduce that issue you were seeing. My 15 vms I left over the weekend are all working correctly. | 22:41 |
| UtahDave | fungi: Did you see the same problem crop up again? | 22:42 |
| mordred | UtahDave: jeblair and I are sitting in thatch's talk at LinuxCon right now | 22:43 |
| openstackgerrit | Peter Mooshammer proposed a change to openstack/requirements: merge adding sphinxcontrib-programoutput to global requirements https://review.openstack.org/46325 | 22:43 |
| fungi | UtahDave: after the modification you had me add to the master config, i didn't see any of the centos machines drop out again. checked yesterday, but i'll check again now | 22:43 |
| UtahDave | mordred: Oh, yeah? That's awesome. Be sure to ask him if he's sending UtahDave to the OpenStack summit. :) | 22:44 |
| UtahDave | fungi: great | 22:44 |
| mordred | UtahDave: will do | 22:44 |
| Alex_Gaynor | jeblair: Do you have a preference for what order that stuff happens in (i.e. do you want me to add handling of null to that patch now?) | 22:44 |
| fungi | UtahDave: if he sends you to the openstack summit, make mordred buy us both tasty beverages so we can discuss more salt things | 22:45 |
| *** ArxCruz has joined #openstack-infra | 22:46 | |
| UtahDave | fungi: sounds like a plan. | 22:46 |
| *** pmoosh has left #openstack-infra | 22:48 | |
| fungi | UtahDave: setting minion_data_cache on the master *seems* to have helped (all minions still responding after 48 hours). is this a long-term solution? if so, i'll add it to the pile of related puppet clean-up i need to submit for this | 22:49 |
| fungi | er, setting minion_data_cache to False i mean | 22:49 |
| UtahDave | fungi: I was discussing this with some other engineers yesterday. Hopefully this will work in the short term. terminalmage said he helped with a patch that will land in 0.16.4 that fixed some behavior with the mine. | 22:52 |
| *** datsun180b has quit IRC | 22:52 | |
| *** lnxnut has joined #openstack-infra | 22:52 | |
| jeblair | Alex_Gaynor: no preference -- your patch fixes an immediate problem; we can make it better by building on it | 22:53 |
| fungi | okay, cool. maybe i puppet it into that config for now, and we revisit later if we need the minion data cache to work | 22:53 |
| Alex_Gaynor | jeblair: k | 22:53 |
| UtahDave | what's weird is my test cent vms are running 0.16.3 and they aren't exhibiting that. So I'm going to investigate it some more | 22:53 |
| UtahDave | fungi: OK, sounds good | 22:53 |
| fungi | UtahDave: don't burn too much time on our account. this looks like it's working great now, for what we're doing. i'll press forward on the remaining implementation details | 22:54 |
| *** dcramer__ has quit IRC | 22:54 | |
| *** weshay has quit IRC | 22:55 | |
| *** Ryan_Lane has quit IRC | 22:55 | |
| UtahDave | fungi: cool. What's left to complete? Implement the Jenkins job? | 22:56 |
| *** Ryan_Lane has joined #openstack-infra | 22:56 | |
| *** michchap has joined #openstack-infra | 22:56 | |
| *** Ryan_Lane has quit IRC | 22:56 | |
| *** Ryan_Lane has joined #openstack-infra | 22:56 | |
| *** michchap has quit IRC | 22:57 | |
| fungi | UtahDave: turn the master into its own minion, add the bit which does a git pull and waits for it to complete before triggering the other slaves to update their puppetry, and then the actual jenkins job which runs the trigger on the salt-trigger slave, yeah | 22:57 |
| *** michchap has joined #openstack-infra | 22:57 | |
| *** lnxnut has quit IRC | 22:58 | |
| fungi | UtahDave: also, disable the cron job on the slaves which currently runs puppet apply every 15 minutes, and then start looking into expanding this update workflow beyond the jenkins slaves to our other long-running servers | 22:58 |
| fungi | all fairly simple stuff i can tackle | 22:58 |
| UtahDave | OK, great! | 23:00 |
| UtahDave | let me know if you need any pointers. You can reach out to me any time. | 23:00 |
| fungi | UtahDave: your assistance has been invaluable. i'll let you know if i hit any other roadblocks | 23:02 |
| UtahDave | very good! | 23:02 |
| *** danger_fo is now known as danger_fo_away | 23:02 | |
| *** Ryan_Lane has quit IRC | 23:03 | |
| *** Ryan_Lane has joined #openstack-infra | 23:03 | |
| * anteaya is glad fungi and UtahDave are happy | 23:03 | |
| anteaya | go Salt | 23:04 |
| * anteaya disappears on the next reboot | 23:04 | |
| fungi | anteaya: i'm happy that you're volunteering to be an elections official | 23:04 |
| hub_cap | mordred: u will be seeing my smile on thursday :) | 23:04 |
| fungi | (one less thing i feel compelled to volunteer to help with!) | 23:04 |
| anteaya | fungi: thanks, the tasker one was a test drive, I did okay so why not 14 more | 23:04 |
| anteaya | fungi: yay | 23:04 |
| anteaya | happy to take something off your plate | 23:04 |
| anteaya | more time for salt then | 23:05 |
| fungi | salt and pepper both, yes | 23:05 |
| anteaya | ha ha ha | 23:05 |
| *** wenlock has joined #openstack-infra | 23:05 | |
| anteaya | disappearing | 23:05 |
| *** anteaya has quit IRC | 23:05 | |
| *** jhesketh has quit IRC | 23:06 | |
| *** sarob has quit IRC | 23:07 | |
| *** sarob has joined #openstack-infra | 23:08 | |
| *** dprince has quit IRC | 23:12 | |
| *** sarob has quit IRC | 23:12 | |
| *** dprince has joined #openstack-infra | 23:14 | |
| *** rnirmal has quit IRC | 23:15 | |
| *** jhesketh has joined #openstack-infra | 23:18 | |
| *** mrodden has quit IRC | 23:23 | |
| *** wenlock has quit IRC | 23:25 | |
| *** cyeoh has quit IRC | 23:27 | |
| *** pcrews has quit IRC | 23:37 | |
| *** UtahDave has quit IRC | 23:37 | |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Build Blocker Plugin support added https://review.openstack.org/46262 | 23:38 |
| *** dcramer__ has joined #openstack-infra | 23:38 | |
| *** lnxnut has joined #openstack-infra | 23:38 | |
| *** atiwari has quit IRC | 23:39 | |
| *** lnxnut has quit IRC | 23:39 | |
| *** lnxnut has joined #openstack-infra | 23:40 | |
| *** lnxnut has quit IRC | 23:44 | |
| *** michchap_ has joined #openstack-infra | 23:46 | |
| *** michchap has quit IRC | 23:46 | |
| *** amotoki__ has quit IRC | 23:47 | |
| *** dims has quit IRC | 23:51 | |
| *** michchap_ has quit IRC | 23:52 | |
| *** michchap has joined #openstack-infra | 23:53 | |
| *** dcramer__ has quit IRC | 23:53 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/config: Move large-ops test to check pipeline https://review.openstack.org/46840 | 23:54 |
| *** michchap_ has joined #openstack-infra | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
