| *** clarkb has joined #openstack-infra | 00:02 | |
| clarkb | and back | 00:03 |
|---|---|---|
| *** bnemec has quit IRC | 00:05 | |
| *** bnemec has joined #openstack-infra | 00:05 | |
| *** CaptTofu has quit IRC | 00:09 | |
| *** wu_wenxiang has quit IRC | 00:12 | |
| stevebaker | mordred: hey, your unfulfilled heat use cases: would you want a single template to launch resources on more than one cloud? | 00:12 |
| *** sdake has joined #openstack-infra | 00:13 | |
| *** sdake has quit IRC | 00:13 | |
| *** sdake has joined #openstack-infra | 00:13 | |
| clarkb | stevebaker: I think that would be ideal as we run stuff across 2 clouds today | 00:13 |
| lifeless | stevebaker: FSVO template | 00:15 |
| lifeless | stevebaker: 'one stack' | 00:15 |
| lifeless | [IMNSHO] | 00:15 |
| stevebaker | yes, i should stop saying that | 00:16 |
| stevebaker | clarkb: that could be done with 2 stacks (launched with different credentials). But if resources in one stack need to reference resources in the other, that might be better represented in a single stack | 00:17 |
| clarkb | fungi: you'll be happy to know that my new IRC client is reporting timestamps to me in UTC | 00:18 |
| clarkb | stevebaker: one use case I would like to use is cross provider clusters. jenkins masters, elasticsearch nodes, and so on. We can probably get away with not coordinating across stack barriers but being able to do so would be nice | 00:19 |
| lifeless | yeah | 00:20 |
| lifeless | you need floating ips and other manual bits to do cross-heat apis | 00:20 |
| stevebaker | Its all on the roadmap, but the next thing to implement will probably be one heat that can launch one stack into one of a choice of clouds | 00:22 |
| *** dstufft has quit IRC | 00:37 | |
| *** dstufft has joined #openstack-infra | 00:38 | |
| *** CaptTofu has joined #openstack-infra | 00:38 | |
| *** bnemec has quit IRC | 00:43 | |
| *** bnemec has joined #openstack-infra | 00:43 | |
| *** dims has joined #openstack-infra | 00:59 | |
| *** CaptTofu has quit IRC | 01:20 | |
| *** michchap_ has joined #openstack-infra | 01:30 | |
| *** michchap has quit IRC | 01:30 | |
| *** sdake has quit IRC | 01:33 | |
| *** sdake has joined #openstack-infra | 01:36 | |
| *** sdake has quit IRC | 01:36 | |
| *** sdake has joined #openstack-infra | 01:36 | |
| *** reed has quit IRC | 01:39 | |
| *** dims has quit IRC | 02:08 | |
| *** dguitarbite has joined #openstack-infra | 02:18 | |
| *** woodspa has joined #openstack-infra | 02:19 | |
| *** xchu has joined #openstack-infra | 02:21 | |
| *** woodspa has quit IRC | 02:27 | |
| mordred | stevebaker: yes | 02:34 |
| mordred | stevebaker: I mean, it could be managed with multiple stacks | 02:35 |
| mordred | stevebaker: but for the underlying usecase - think of the openstack slave pool | 02:35 |
| *** yaguang has joined #openstack-infra | 02:35 | |
| mordred | stevebaker: we have 2 (hopefully soon 3) clouds each with a couple of different zones and or regions | 02:35 |
| mordred | stevebaker: we want an elastic pool of build resources. ultimately, we want a build slave from any of them | 02:36 |
| mordred | but for performance reasons, we want to keep a certain number in each region | 02:36 |
| mordred | or zone | 02:36 |
| mordred | so we want to set both region/zone min and maxes, as well as a global thing we want to occur | 02:36 |
| mordred | and all of them are really part of one system | 02:37 |
| mordred | other than a set of scripts that juggle a database of credentials that we have, it's really one application | 02:37 |
| mordred | with slaves from az3 at hp cloud publishing things to machines in dallas at Rackspace | 02:37 |
| mordred | stevebaker: I'm expecting that the day that heat can do that in rich manner will be a very exciting day | 02:38 |
| stevebaker | right, I'll be keeping that use case in mind | 02:42 |
| mordred | lifeless: 'floating ips and other manual bits' -- can you expand on that? | 02:44 |
| *** cody-somerville has quit IRC | 02:45 | |
| mordred | stevebaker: cool. let me know if it's ever useful for me to babble more | 02:45 |
| *** mriedem has quit IRC | 02:50 | |
| stevebaker | mordred: to help with this, what favors do I perform for whom to waive charges on my hpcloud account? | 02:52 |
| mordred | stevebaker: send me an email with your tenant id and username and I'll get it done | 02:52 |
| clarkb | mordred: did you comp our new infra account? | 02:53 |
| stevebaker | magic! | 02:53 |
| mordred | clarkb: funny story - that right there just reminded me I need to do that... | 02:53 |
| clarkb | :) | 02:53 |
| mordred | stevebaker: actually: "We need the username and email address for each account along with the domain ID – the domain ID is the Account Number shown on Console->Account->MyAccount." | 02:54 |
| stevebaker | ok | 02:54 |
| clarkb | mordred: do we know why there are 3 different numbers for each account? | 02:54 |
| mordred | clarkb: there are MANY questions I tend to try to not ask | 02:55 |
| clarkb | how hard is ot to SELECT * FROM accout_table WHERE email = foo@bar AND uname = foo; | 02:55 |
| mordred | clarkb: you're assuming there is a relational database with user accounts | 02:57 |
| *** bnemec has quit IRC | 02:57 | |
| *** bnemec has joined #openstack-infra | 02:57 | |
| *** jjmb has quit IRC | 03:03 | |
| *** blamar has joined #openstack-infra | 03:14 | |
| *** michchap_ has quit IRC | 03:22 | |
| *** michchap has joined #openstack-infra | 03:23 | |
| *** michchap_ has joined #openstack-infra | 03:26 | |
| *** michchap has quit IRC | 03:26 | |
| *** nati_ueno has quit IRC | 03:34 | |
| *** vipul is now known as vipul-away | 03:37 | |
| openstackgerrit | Steve Baker proposed a change to openstack-infra/config: Create new repo to host legacy heat-cfn client. https://review.openstack.org/38226 | 03:37 |
| stevebaker | mordred: ^^ we've moved some old client code out of the heat core repo. could we host it on stackforge? It will be maintained but is verging on abandonware | 03:39 |
| mordred | stevebaker: sure thing | 03:39 |
| mordred | stevebaker: although that patch hosts it in the openstack/ org | 03:40 |
| mordred | which is also fine | 03:40 |
| mordred | since it is a part of heat | 03:40 |
| mordred | +2 | 03:41 |
| stevebaker | ok, there might be other parts of that patch that need switching to stackforge | 03:43 |
| *** krtaylor has joined #openstack-infra | 03:44 | |
| *** jjmb has joined #openstack-infra | 03:51 | |
| *** nati_ueno has joined #openstack-infra | 03:51 | |
| *** jjmb has quit IRC | 03:52 | |
| *** yaguang has quit IRC | 03:54 | |
| *** bnemec has quit IRC | 04:01 | |
| *** bnemec has joined #openstack-infra | 04:01 | |
| *** yaguang has joined #openstack-infra | 04:08 | |
| mordred | kk | 04:16 |
| *** yaguang has quit IRC | 04:18 | |
| *** michchap_ has quit IRC | 04:23 | |
| *** michchap has joined #openstack-infra | 04:24 | |
| lifeless | mordred: if you have two heat stacks managing one cluster | 04:29 |
| lifeless | mordred: you have to pass in things like 'the endpoint for puppet is <here>' where <here> is: always reachable, stable even if the instance is redeployed | 04:30 |
| *** michchap has quit IRC | 04:30 | |
| *** michchap_ has joined #openstack-infra | 04:30 | |
| mordred | lifeless: yes. that makes total sense - and is one of the reaons I'd _prefer_ one stack | 04:31 |
| mordred | lifeless: but - that said - we actually keep our long-lived things that matter in a completely different account anyway | 04:32 |
| *** SergeyLukjanov has joined #openstack-infra | 04:32 | |
| mordred | so I imagine that we'll get to "manage the pool and tell it about things that arent' in the pool" long before we get to "manage long running services" | 04:32 |
| lifeless | yes | 04:35 |
| lifeless | clarkb: mordred: btw HP support have clsoed the ticket : you should have glance upload in us-east | 04:37 |
| mordred | lifeless: cool. I mean, that'll be in the beta cloud - but exciting none the less | 04:37 |
| lifeless | yes | 04:37 |
| *** yaguang has joined #openstack-infra | 04:37 | |
| *** nati_ueno has quit IRC | 04:46 | |
| *** w_ has joined #openstack-infra | 04:50 | |
| *** olaph has quit IRC | 04:53 | |
| *** yaguang has quit IRC | 04:58 | |
| *** yaguang has joined #openstack-infra | 04:59 | |
| *** Ryan_Lane has quit IRC | 04:59 | |
| *** Ryan_Lane has joined #openstack-infra | 05:00 | |
| *** xchu has quit IRC | 05:01 | |
| *** jhesketh has quit IRC | 05:05 | |
| *** jjmb has joined #openstack-infra | 05:14 | |
| *** emagana has joined #openstack-infra | 05:15 | |
| *** amotoki has joined #openstack-infra | 05:16 | |
| *** nicedice has quit IRC | 05:25 | |
| *** xchu has joined #openstack-infra | 05:49 | |
| *** yaguang has quit IRC | 05:49 | |
| *** yaguang has joined #openstack-infra | 06:07 | |
| *** afazekas is now known as afazekas__ | 06:07 | |
| *** SergeyLukjanov has quit IRC | 06:09 | |
| *** dguitarbite has quit IRC | 06:21 | |
| *** jjmb has quit IRC | 06:21 | |
| *** sileht has quit IRC | 06:32 | |
| *** Ryan_Lane has quit IRC | 06:32 | |
| *** sileht has joined #openstack-infra | 06:33 | |
| GheRivero | pabelanger: you got it! | 06:35 |
| *** michchap_ has quit IRC | 06:35 | |
| *** michchap has joined #openstack-infra | 06:36 | |
| *** emagana has quit IRC | 06:37 | |
| *** xchu has quit IRC | 06:49 | |
| *** GheRivero has quit IRC | 06:50 | |
| *** jjmb has joined #openstack-infra | 06:54 | |
| *** ndipanov has joined #openstack-infra | 06:58 | |
| *** xchu has joined #openstack-infra | 07:02 | |
| *** afazekas has joined #openstack-infra | 07:04 | |
| *** psedlak has joined #openstack-infra | 07:20 | |
| *** odyssey4me has joined #openstack-infra | 07:28 | |
| *** odyssey4me has quit IRC | 07:33 | |
| *** SergeyLukjanov has joined #openstack-infra | 07:36 | |
| *** GheRivero has joined #openstack-infra | 07:37 | |
| *** sdake_ has quit IRC | 07:39 | |
| *** sileht has quit IRC | 07:39 | |
| *** odyssey4me has joined #openstack-infra | 07:42 | |
| *** sileht has joined #openstack-infra | 07:42 | |
| *** dina_belova has joined #openstack-infra | 07:44 | |
| *** jpich has joined #openstack-infra | 07:48 | |
| *** hashar has joined #openstack-infra | 07:49 | |
| openstackgerrit | A change was merged to openstack/requirements: Added cffi as a requirement. https://review.openstack.org/38544 | 07:56 |
| openstackgerrit | A change was merged to openstack/requirements: update global requires on clients for keystone fix https://review.openstack.org/38686 | 07:56 |
| *** rustlebee has quit IRC | 08:01 | |
| *** russellb has joined #openstack-infra | 08:08 | |
| *** dguitarbite has joined #openstack-infra | 08:11 | |
| *** derekh has joined #openstack-infra | 08:12 | |
| *** BobBall_Away is now known as BobBall | 08:28 | |
| *** dguitarbite has quit IRC | 08:36 | |
| *** odyssey4me has quit IRC | 08:37 | |
| *** dguitarbite has joined #openstack-infra | 08:40 | |
| *** dguitarbite has quit IRC | 08:47 | |
| *** sdake_ has joined #openstack-infra | 08:48 | |
| *** SergeyLukjanov has quit IRC | 08:48 | |
| *** koolhead17 has quit IRC | 08:52 | |
| *** odyssey4me has joined #openstack-infra | 08:57 | |
| *** dina_belova has quit IRC | 09:06 | |
| *** HueJorgan has joined #openstack-infra | 09:28 | |
| *** jjmb has quit IRC | 09:28 | |
| *** isviridov has joined #openstack-infra | 09:42 | |
| *** koolhead17 has joined #openstack-infra | 09:51 | |
| *** isviridov has quit IRC | 09:55 | |
| *** jjmb has joined #openstack-infra | 09:55 | |
| *** jjmb has quit IRC | 09:57 | |
| *** rpodolyaka has joined #openstack-infra | 10:05 | |
| *** jjmb has joined #openstack-infra | 10:13 | |
| *** jjmb has quit IRC | 10:13 | |
| *** dina_belova has joined #openstack-infra | 10:15 | |
| *** SergeyLukjanov has joined #openstack-infra | 10:16 | |
| *** isviridov has joined #openstack-infra | 10:18 | |
| *** hashar has quit IRC | 10:39 | |
| *** hashar has joined #openstack-infra | 10:39 | |
| *** yaguang has quit IRC | 10:40 | |
| *** dina_belova has quit IRC | 10:44 | |
| *** jjmb has joined #openstack-infra | 10:47 | |
| *** isviridov has quit IRC | 10:47 | |
| *** dina_belova has joined #openstack-infra | 10:48 | |
| *** mjfork has joined #openstack-infra | 10:49 | |
| *** HueJorgan has quit IRC | 10:49 | |
| *** dims has joined #openstack-infra | 10:57 | |
| *** dina_belova has quit IRC | 10:57 | |
| *** psedlak_ has joined #openstack-infra | 10:58 | |
| *** dina_belova has joined #openstack-infra | 10:59 | |
| *** psedlak has quit IRC | 11:01 | |
| *** afazekas has quit IRC | 11:04 | |
| *** mjfork has quit IRC | 11:07 | |
| *** derekh has quit IRC | 11:22 | |
| *** afazekas has joined #openstack-infra | 11:24 | |
| *** derekh has joined #openstack-infra | 11:29 | |
| *** derekh has quit IRC | 11:32 | |
| *** lcestari has joined #openstack-infra | 11:33 | |
| *** dina_belova has quit IRC | 11:36 | |
| *** HueJorgan has joined #openstack-infra | 11:40 | |
| *** dina_belova has joined #openstack-infra | 11:42 | |
| *** dina_belova has quit IRC | 11:50 | |
| *** dkranz has quit IRC | 11:54 | |
| *** dina_belova has joined #openstack-infra | 11:56 | |
| *** xchu has quit IRC | 11:57 | |
| *** psedlak__ has joined #openstack-infra | 12:00 | |
| *** ndipanov has quit IRC | 12:04 | |
| *** psedlak_ has quit IRC | 12:04 | |
| *** sdake_ has quit IRC | 12:07 | |
| *** dina_belova has quit IRC | 12:14 | |
| *** dkliban has quit IRC | 12:17 | |
| *** ndipanov has joined #openstack-infra | 12:19 | |
| *** sdake_ has joined #openstack-infra | 12:19 | |
| *** woodspa has joined #openstack-infra | 12:22 | |
| *** rfolco has joined #openstack-infra | 12:24 | |
| *** beagles has joined #openstack-infra | 12:24 | |
| *** ndipanov has quit IRC | 12:26 | |
| *** CaptTofu has joined #openstack-infra | 12:29 | |
| *** dina_belova has joined #openstack-infra | 12:32 | |
| *** leifmadsen has joined #openstack-infra | 12:34 | |
| *** mriedem has joined #openstack-infra | 12:35 | |
| *** cppcabrera has joined #openstack-infra | 12:46 | |
| *** w_ is now known as olaph | 12:46 | |
| *** HueJorgan has quit IRC | 12:47 | |
| *** adalbas has joined #openstack-infra | 12:47 | |
| *** acfleury has joined #openstack-infra | 12:48 | |
| *** dkranz has joined #openstack-infra | 12:50 | |
| *** anteaya has joined #openstack-infra | 12:59 | |
| *** amotoki has quit IRC | 13:10 | |
| *** cppcabrera has left #openstack-infra | 13:12 | |
| *** HueJorgan has joined #openstack-infra | 13:14 | |
| *** CaptTofu has quit IRC | 13:16 | |
| *** rahmu has quit IRC | 13:17 | |
| *** koobs has quit IRC | 13:18 | |
| *** rahmu has joined #openstack-infra | 13:18 | |
| *** afazekas has quit IRC | 13:21 | |
| *** acfleury has quit IRC | 13:21 | |
| *** koobs has joined #openstack-infra | 13:21 | |
| *** jpeeler has joined #openstack-infra | 13:24 | |
| pabelanger | GheRivero, thanks | 13:27 |
| *** krtaylor has quit IRC | 13:28 | |
| *** pabelanger has quit IRC | 13:30 | |
| *** afazekas has joined #openstack-infra | 13:36 | |
| *** akscram has quit IRC | 13:39 | |
| *** afazekas has quit IRC | 13:39 | |
| *** afazekas has joined #openstack-infra | 13:39 | |
| *** dkliban has joined #openstack-infra | 13:45 | |
| *** jjmb has quit IRC | 13:45 | |
| *** dina_belova has quit IRC | 13:47 | |
| *** _TheDodd_ has joined #openstack-infra | 13:50 | |
| *** dina_belova has joined #openstack-infra | 13:52 | |
| *** sandywalsh has joined #openstack-infra | 13:57 | |
| *** pabelanger has joined #openstack-infra | 14:00 | |
| *** michchap has quit IRC | 14:01 | |
| *** michchap has joined #openstack-infra | 14:02 | |
| *** blamar has quit IRC | 14:02 | |
| *** blamar has joined #openstack-infra | 14:02 | |
| *** vijendar has joined #openstack-infra | 14:03 | |
| *** prad_ has joined #openstack-infra | 14:04 | |
| _TheDodd_ | clarkb, I've put together the etherpad that you requested last week. ( https://etherpad.openstack.org/LvuStWrm2E ) | 14:06 |
| _TheDodd_ | clarkb, let me know if there is anything else that you would like me to add or clarify. | 14:07 |
| *** pentameter has joined #openstack-infra | 14:08 | |
| *** dina_belova has quit IRC | 14:10 | |
| anteaya | _TheDodd_: well done, that looks awesome | 14:16 |
| anteaya | one question | 14:16 |
| _TheDodd_ | Thanks, anteaya! | 14:16 |
| _TheDodd_ | Sure | 14:16 |
| *** krtaylor has joined #openstack-infra | 14:16 | |
| anteaya | what happens if someone continues to use "bug #<bug_number> in their commit? | 14:17 |
| _TheDodd_ | It will still work, | 14:17 |
| anteaya | grand | 14:17 |
| anteaya | could you identify this case in the etherpad message? | 14:17 |
| _TheDodd_ | It will default to the 'Closes-Bug' functionality. | 14:17 |
| anteaya | just to close that door | 14:17 |
| anteaya | ah okay that would be handy information to share, I think | 14:18 |
| anteaya | " | 14:18 |
| _TheDodd_ | If an unknown prefix is supplied, or some funky header is used, it will not close the bug, however. | 14:18 |
| anteaya | I was missing the closing double quote | 14:18 |
| _TheDodd_ | Indeed. I will add it. | 14:18 |
| anteaya | great thanks | 14:18 |
| Alex_Gaynor | Do all the jenkins slaves have libffi-dev installed, or only some of them? | 14:19 |
| _TheDodd_ | lol ... late correction on that double quote :) | 14:19 |
| *** HueJorgan has left #openstack-infra | 14:19 | |
| anteaya | _TheDodd_: yeah, pretty late | 14:19 |
| anteaya | :D | 14:19 |
| anteaya | Alex_Gaynor: I haven't seen activity from anyone yet who would have the answer to your question | 14:20 |
| anteaya | fungi should be around soon | 14:20 |
| Alex_Gaynor | anteaya: ok, /me waits patiently | 14:20 |
| anteaya | :D | 14:20 |
| fungi | _TheDodd_: probably some of them may be stuck puppet-wise. i'll check them here momentarily | 14:21 |
| fungi | er, that was for Alex_Gaynor, sorry | 14:21 |
| Alex_Gaynor | fungi: stuck meaning they didn't install necessary packages for some eason? | 14:22 |
| fungi | Alex_Gaynor: yeah, puppet installs packages on the slaves for us, but sometimes gets stuck either on a remote git operation or (for some reason) restarting cgroups management daemons | 14:23 |
| fungi | so some slaves may indeed lack that package | 14:23 |
| fungi | but should be cleared up here in a bit once i churn through them | 14:23 |
| _TheDodd_ | fungi, is there an actionable item here for me? | 14:24 |
| *** michchap has quit IRC | 14:24 | |
| _TheDodd_ | In regards to puppet, that is. | 14:25 |
| Alex_Gaynor | fungi: awesome, thanks | 14:25 |
| *** sdake has quit IRC | 14:25 | |
| *** sdake has joined #openstack-infra | 14:26 | |
| *** sdake has quit IRC | 14:26 | |
| *** sdake has joined #openstack-infra | 14:26 | |
| fungi | _TheDodd_: nope, i merely misread who i was replying to in the channel | 14:26 |
| *** burt has joined #openstack-infra | 14:28 | |
| _TheDodd_ | Copy that. | 14:28 |
| *** markmcclain has joined #openstack-infra | 14:30 | |
| *** adalbas has quit IRC | 14:31 | |
| jeblair | i can tell the openstack list migration is complete as i now have several hundred messages in my inbox. :| | 14:34 |
| * jeblair updates sieve filters | 14:34 | |
| _TheDodd_ | lol | 14:34 |
| mordred | jeblair: ++ | 14:36 |
| *** jergerber has joined #openstack-infra | 14:38 | |
| fungi | jeblair: i'm thinking i should just >/dev/null the ones still spewing from lp | 14:38 |
| mordred | fungi: I am going to do that | 14:39 |
| fungi | since i updated my filters not to account for it, thinking posting would be shut down there, they all began landing in my inbox over the weekend. and there were surprisingly many | 14:40 |
| dhellmann_ | mordred, sdague : I'm catching up on the grenade thing. Was it caused by the jsonschema version downgrade? If so, is that a "good" thing, or would it be better if stevedore loaded plugins without enforcing their requirements? | 14:41 |
| *** dhellmann_ is now known as dhellmann | 14:41 | |
| fungi | or disappointingly many, perhaps | 14:41 |
| sdague | dhellmann_: I think it was the downgrade. Honestly, I need to fully postmortem | 14:41 |
| fungi | Alex_Gaynor: cleaned up. if your job ran on precise2, precise4 or centos6-12 then puppet hadn't updated those since the 23rd or 24th | 14:42 |
| dhellmann | sdague: I'm torn on whether the plugin import should be worried about dependencies. It seems like a mistake to let the installation downgrade like that, but at the same time the code may work under that configuration and import time seems a weird place to be doing the check. | 14:42 |
| Alex_Gaynor | fungi: I'm honestly not sure where the libffi-dev packages was configured to be installed, is there; is there a way to query where it's supposed to be installed? | 14:43 |
| *** adalbas has joined #openstack-infra | 14:43 | |
| fungi | Alex_Gaynor: probably on all of them? i'll check the puppet manifest | 14:43 |
| sdague | jeblair: http://imageshack.us/photo/my-images/838/02wo.png/ - the fact that it has no lines on the right drives me a little nuts :) | 14:44 |
| *** datsun180b has joined #openstack-infra | 14:44 | |
| fungi | Alex_Gaynor: all the precise unit test slaves should have libffi-dev and all the centos6 slaves libffi-devel | 14:45 |
| jeblair | sdague: oh! interesting. so i decided to be cutting edge and i used the <progress> element in HTML5. | 14:46 |
| *** avtar has joined #openstack-infra | 14:46 | |
| jeblair | sdague: without any styling, so it's browser-default drawing | 14:47 |
| Alex_Gaynor | fungi: so in theory "devstack-precise-hpcloud" should have it now? | 14:47 |
| fungi | Alex_Gaynor: ahh, no those are not unit test slaves, but devstack integration test slaves. they won't have it until new devstack slave images are updated and new slaves launched from them. let me see when that change merged to ourpuppet config | 14:48 |
| Alex_Gaynor | fungi: ah, doh, sorry I didn't realize they were of different sorts | 14:49 |
| jeblair | sdague: here's what mine looks like in ff/linux/xfce: http://imgur.com/Esq8Zo4 | 14:49 |
| sdague | yeh, well not chrome | 14:50 |
| sdague | chrome / raring | 14:50 |
| jeblair | sdague: adding explicit css styling might fix it | 14:50 |
| sdague | yeh | 14:50 |
| jeblair | sdague: ah yeah, i see that in chromium too. | 14:51 |
| fungi | Alex_Gaynor: https://review.openstack.org/37990 seems to have merged 10 days ago, so it's pretty well guaranteed to be there but i'll check one just to confirm | 14:52 |
| jeblair | sdague: i wonder if setting the width to a different value would change it (eg, those bars are just set at a fixed interval that does not match the width i forced) | 14:52 |
| jeblair | sdague: (they are set to approximate the width of the words "SUCCESS" and "FAILURE" to reduce visual disruption) | 14:52 |
| * fungi is *so* digging the new status page improvements | 14:53 | |
| Alex_Gaynor | fungi: http://logs.openstack.org/15/38415/4/check/gate-tempest-devstack-vm-full/36961/console.html leads me to believe it's not :) | 14:53 |
| fungi | jeblair: in my browser (ff17 basically) the status bars are a good 15% longer than SUCCESS but it could be my font is a little more condensed than anticipated | 14:54 |
| fungi | Alex_Gaynor: taking a look | 14:54 |
| Alex_Gaynor | thanks | 14:56 |
| jeblair | fungi: no, i think you're right, i think they are a little longer (however, they are defined in ems, so they should scale with the font assuming one choses a correct value). | 14:57 |
| *** rcleere has joined #openstack-infra | 14:57 | |
| fungi | makes sense | 14:57 |
| *** fbo_away is now known as fbo | 14:58 | |
| *** fbo is now known as fbo_away | 14:59 | |
| sdague | jeblair: where is this all at? might want to play with the css quick | 14:59 |
| jeblair | infra/config/modules/openstack_project/files/zuul/status.* | 15:00 |
| *** mrodden has quit IRC | 15:01 | |
| fungi | Alex_Gaynor: i think we need to modify devstack to include libffi-dev in its debs list | 15:03 |
| anteaya | look at all those pretty progress bars | 15:03 |
| fungi | Alex_Gaynor: confirming and will have a patch proposed forthwith | 15:04 |
| Alex_Gaynor | fungi: ok, was going to try to write one myself, but Id on't have a checkout of config and GH seems down :/ | 15:05 |
| sdague | jeblair: you have any issue with me pulling the css out of the html? | 15:05 |
| fungi | yeah, i'm noticing it's slow. you can clone from https://review.openstack.org/p/openstack-dev/devstack.git instead if you want | 15:05 |
| Alex_Gaynor | fungi: s/devstack/config/ ? | 15:05 |
| fungi | Alex_Gaynor: no, this is goint to be a change to devstack i think | 15:06 |
| Alex_Gaynor | fungi: oh, I assumed the puppet manifests for it were also in config, not so? | 15:06 |
| fungi | Alex_Gaynor: puppet manifests for the devstack slaves are in openstack-infra/config but devstack has lists of packages it should depend on itself. does libffi-dev/libffi-devel fall into that category of things? | 15:07 |
| Alex_Gaynor | ah, I guess it's the latter then | 15:07 |
| *** jpeeler has quit IRC | 15:08 | |
| jeblair | sdague: there's so little css, it seemed a waste to have a second request for it. | 15:08 |
| *** jpeeler has joined #openstack-infra | 15:08 | |
| fungi | Alex_Gaynor: not everyone who uses devstack uses our puppet manifests to set u their devstack machines, so we want to be nice to them | 15:08 |
| sdague | you mean an 8th request for it | 15:08 |
| sdague | there are already a lot of requests in there anyway | 15:08 |
| jeblair | sdague: indeed. :) | 15:08 |
| *** adalbas has quit IRC | 15:08 | |
| Alex_Gaynor | fungi: hmm, where approximately should I be looking? | 15:09 |
| sdague | to solve that you should compile and compress them all server side | 15:09 |
| *** dkranz has quit IRC | 15:09 | |
| jeblair | sdague: i was trying to keep it simple all around. :) | 15:09 |
| Alex_Gaynor | fungi: I guess lib/swift ? | 15:09 |
| fungi | Alex_Gaynor: files/apts/swift | 15:10 |
| Alex_Gaynor | fungi: ah, tahnks | 15:10 |
| fungi | Alex_Gaynor: and also files/rpms/swift | 15:10 |
| fungi | Alex_Gaynor: those list packages which should be installed by devstack on their respective platforms when swift is enabled | 15:10 |
| jeblair | sdague: if you feel strongly it should be in another file, that's fine. it's just that there's no re-use of those attributes outside of this single page, so i didn't see that it gained anything. | 15:11 |
| Alex_Gaynor | fungi: does http://bpaste.net/show/118388/ look sane? | 15:11 |
| fungi | Alex_Gaynor: yep! | 15:11 |
| Alex_Gaynor | fungi: review req incoming! | 15:12 |
| * jeblair breaks fast | 15:12 | |
| sdague | jeblair: yeh, inline css is just something I typically try to avoid. Where are you actually setting the progress element? | 15:12 |
| *** rcleere has quit IRC | 15:12 | |
| *** rcleere has joined #openstack-infra | 15:12 | |
| jeblair | sdague: status.js | 15:13 |
| Alex_Gaynor | fungi: https://review.openstack.org/#/c/39096/ thanks so much for your help! | 15:13 |
| sdague | doh, I had an old pull | 15:14 |
| *** mrodden has joined #openstack-infra | 15:15 | |
| fungi | Alex_Gaynor: it was my pleasure | 15:16 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: float the progress bars to the right https://review.openstack.org/39097 | 15:18 |
| sdague | also, any chance in landing the htmlifier changes today to get that on the main log servers? | 15:20 |
| *** adalbas has joined #openstack-infra | 15:24 | |
| *** dkranz has joined #openstack-infra | 15:24 | |
| *** dina_belova has joined #openstack-infra | 15:29 | |
| openstackgerrit | A change was merged to openstack-infra/config: change date link to something more understandable https://review.openstack.org/38680 | 15:32 |
| *** vijendar has quit IRC | 15:33 | |
| *** adalbas has quit IRC | 15:33 | |
| fungi | sdague: testing it out in a bit | 15:33 |
| sdague | cool | 15:33 |
| sdague | the patch after that is what flips it | 15:33 |
| sdague | I still don't understand why we broke readme | 15:33 |
| sdague | I can't replicate that locally | 15:34 |
| fungi | sdague: yeah, what i meant was i'll be testing the one that flips it on in a bit, before voting on it | 15:35 |
| *** SergeyLukjanov has quit IRC | 15:35 | |
| sdague | cool, thanks | 15:35 |
| *** akscram has joined #openstack-infra | 15:36 | |
| *** hashar has quit IRC | 15:37 | |
| Alex_Gaynor | hmm, https://jenkins.openstack.org/ doesn't seem to be responding | 15:38 |
| Alex_Gaynor | err, maybe it is but exceptionally slowly | 15:38 |
| fungi | that webui tends to be slow | 15:39 |
| *** SergeyLukjanov has joined #openstack-infra | 15:39 | |
| Alex_Gaynor | It was outside of normal bounds of sanity long, but it seems to be back to normal now. | 15:40 |
| *** _TheDodd_ has quit IRC | 15:41 | |
| fungi | i wouldn't normally put sanity and the jenkins webui in the same sentence | 15:41 |
| Alex_Gaynor | yes, well, that's fair. | 15:41 |
| pleia2 | good morning | 15:42 |
| fungi | jenkins doesn't look too bad off for a west-coast north american monday morning... http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=10&page=1 | 15:43 |
| *** dina_belova has quit IRC | 15:43 | |
| *** _TheDodd_ has joined #openstack-infra | 15:44 | |
| sdague | fungi: hmmm... I seem to have broken something in that last go around with the logs | 15:45 |
| fungi | sdague: in what way? | 15:46 |
| fungi | seems fine to me so far, just browsing around... | 15:46 |
| sdague | in the not working way | 15:46 |
| sdague | hmmmm | 15:46 |
| mordred | back | 15:47 |
| fungi | i'll try to pick some more recent logs in case i've cached them somehow | 15:47 |
| mordred | sdague: I haven't read all the scrollback - but we broke README? | 15:47 |
| *** cody-somerville has joined #openstack-infra | 15:47 | |
| sdague | mordred: in apache, and I don't know why | 15:48 |
| sdague | fungi: ok, I found one of the logs which went funny, will need to look more | 15:48 |
| jeblair | mordred: as long as we don't break REAMDE | 15:48 |
| sdague | mordred: on the plus side, it's back | 15:48 |
| mordred | wow | 15:48 |
| mordred | that's amazing | 15:48 |
| *** dina_belova has joined #openstack-infra | 15:50 | |
| *** adalbas has joined #openstack-infra | 15:50 | |
| ttx | mordred: folsom is fixed with https://review.openstack.org/#/c/38854/ -- if you want to apply capping to it | 15:50 |
| ttx | mordred: if you come up with a script that does it, i'll add it to the stable maint toolkit | 15:51 |
| *** bclifford has joined #openstack-infra | 15:52 | |
| *** w_ has joined #openstack-infra | 15:53 | |
| *** pcrews has joined #openstack-infra | 15:54 | |
| *** olaph has quit IRC | 15:55 | |
| *** reed has joined #openstack-infra | 15:56 | |
| *** w_ has quit IRC | 15:57 | |
| fungi | sdague: ahh, yes, i see that http://logs.openstack.org/85/38685/4/gate/gate-tempest-devstack-vm-full/36990/ has no readme displayed, and console.html is not console.html.gz | 15:59 |
| *** adalbas has quit IRC | 16:00 | |
| fungi | sdague: actually, i do see readme on old-style log directories, from before we added the extra level of depth... i wonder if that's what broke it | 16:00 |
| * fungi digs back into the readme path pattern | 16:01 | |
| fungi | yep! we've got patterns in logs.vhost.erb matching on the number of parent directories in the path | 16:03 |
| *** datsun180b has quit IRC | 16:04 | |
| *** bearhands is now known as comstud | 16:04 | |
| *** vijendar has joined #openstack-infra | 16:06 | |
| sdague | ah, cool | 16:07 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Add new jenkins masters. https://review.openstack.org/38885 | 16:07 |
| *** sdake has quit IRC | 16:08 | |
| jeblair | can we match on any number of directories? | 16:08 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Additional path patterns for log readme files. https://review.openstack.org/39116 | 16:09 |
| fungi | sdague: ^ | 16:09 |
| jeblair | fungi: ^ | 16:09 |
| *** pabelanger has quit IRC | 16:09 | |
| fungi | jeblair: oh, maybe... i wonder if ** will glob on multiple directory levels | 16:09 |
| sdague | jeblair: we want to match specific numbers, for a reason | 16:09 |
| jeblair | i'd really like it if that worked for, say, periodic jobs too. | 16:09 |
| *** longlostnickname is now known as cp16net | 16:09 | |
| jeblair | sdague: what's the reason? | 16:10 |
| sdague | we have different kinds of docs at different levels | 16:10 |
| sdague | anyway, need food here, back in a few | 16:10 |
| jeblair | sdague: i mean any number of initial directories | 16:10 |
| *** pabelanger has joined #openstack-infra | 16:10 | |
| *** w_ has joined #openstack-infra | 16:10 | |
| jeblair | it doesn't matter what's before "gate-tempest-devstack*", only after. | 16:11 |
| fungi | i'll try a variant of it on the logs-dev vhost and see what happens | 16:11 |
| fungi | keep in mind that we can only do what apache's glob matching allows. regular expressions aren't possible for applying readmename and headername | 16:11 |
| fungi | which is unfortunate, and surprising, but backed up by the apache docs | 16:12 |
| jeblair | clarkb, mordred, fungi: quick review on https://review.openstack.org/38885 ? I'd like to start spinning those up today. | 16:13 |
| jeblair | clarkb: i would like to defer your puppet suggestions in that change for another time, unless someone knows exactly how to do that right now. | 16:13 |
| *** nicedice has joined #openstack-infra | 16:13 | |
| *** dina_belova has quit IRC | 16:13 | |
| fungi | jeblair: sure thing. same for https://review.openstack.org/#/c/38103/ ...i'd like to start spinning those up today too | 16:14 |
| mordred | looking | 16:14 |
| fungi | and that's the only patch blocking production py33 unit test slaves at the moment | 16:14 |
| mordred | jeblair: is the idea that you'll spin up nodes with those | 16:15 |
| clarkb | jeblair: I am ok with defering my suggestions. It will probably require use of puppet-stdlib to do string manipulation in ways that are not pretty | 16:15 |
| * clarkb updates review | 16:15 | |
| mordred | jeblair: and then just do the global jenkins config by hand? | 16:15 |
| *** adalbas has joined #openstack-infra | 16:16 | |
| mordred | (which is fine, just making sure I grok) | 16:16 |
| jeblair | mordred: yes. i'm deferring management of the global jenkins config as well. | 16:16 |
| *** sdake has joined #openstack-infra | 16:17 | |
| *** sdake has quit IRC | 16:17 | |
| *** sdake has joined #openstack-infra | 16:17 | |
| jeblair | mordred: (i expect to have a copy of the interesting parts of the config as a side effect, so small progress can be made on that task) | 16:17 |
| openstackgerrit | A change was merged to openstack-infra/config: Conditionally install Python 3 development libs. https://review.openstack.org/38103 | 16:18 |
| jeblair | also, if we merge this: https://review.openstack.org/#/c/38753/ | 16:18 |
| jeblair | we can have better validation of layout.yaml | 16:18 |
| fungi | jeblair: do you want to defer addition to modules/openstack_project/files/ssl_cert_check/ssldomains for a separate change as well? | 16:20 |
| fungi | if so, lgtm otherwise | 16:21 |
| *** reed has quit IRC | 16:21 | |
| jeblair | fungi: ah, yeah, what should we do about ssl certs? atm i'm leaning toward self-signed... | 16:21 |
| openstackgerrit | Tom Fifield proposed a change to openstack-infra/jeepyb: cease docimpact emails, create bugs only https://review.openstack.org/39118 | 16:21 |
| *** w_ is now known as olaph | 16:21 | |
| jeblair | (though currently the change just reuses the jenkins.o.o cert) | 16:21 |
| fungi | jeblair: that's cool with me. we don't so much direct people to the jenkins webui ay longer | 16:21 |
| *** jergerber has quit IRC | 16:21 | |
| jeblair | ok, how about i update it to use self-signed certs that are in hiera (and i'll add them) | 16:21 |
| jeblair | ? | 16:22 |
| fungi | wfm | 16:22 |
| fungi | and set crazy-long expiration on them | 16:22 |
| fungi | i missed that it was reusing the same key contents, which will be not entirely correct. i see it in there now | 16:23 |
| clarkb | wfm | 16:23 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Add new jenkins masters. https://review.openstack.org/38885 | 16:24 |
| jeblair | there it is | 16:24 |
| fungi | lgtm | 16:25 |
| fungi | jeblair: one other concern this raises... won't there be contention on archived job artifact paths? | 16:26 |
| clarkb | jeblair: approve at will | 16:26 |
| clarkb | the note about the periodic jobs is worth thinking about | 16:26 |
| clarkb | jeblair: we could even have a cron job on zuul.o.o insert those jobs into the gearman queue for now | 16:27 |
| jeblair | clarkb: adding timer support to zuul is item 4 on my todo list | 16:27 |
| *** adalbas has quit IRC | 16:27 | |
| jeblair | fungi: well, lets think about that | 16:27 |
| fungi | right now the job sequence numbers are decided by each jenkins master independently | 16:28 |
| jeblair | fungi: .../change/patchset/pipeline/job/number | 16:28 |
| *** thingee has quit IRC | 16:28 | |
| fungi | for triggered jobs we also include the change and patchset number, so unless there'sa recheck | 16:28 |
| *** emagana has joined #openstack-infra | 16:28 | |
| jeblair | we could s/number/zuul_uuid/ | 16:29 |
| fungi | if zuul decided the job number instead of jenkins, it ceases to be an issue | 16:29 |
| fungi | yep | 16:29 |
| jeblair | url gets long though. | 16:29 |
| jeblair | we could truncate the uuid. | 16:29 |
| fungi | shortsha | 16:30 |
| fungi | yeah, something like that | 16:30 |
| clarkb | or list the master | 16:30 |
| clarkb | master/slave/some other unique key making value | 16:30 |
| *** odyssey4me has quit IRC | 16:31 | |
| Alex_Gaynor | Is there anyway to enumerate hte people who are core reviewers on a given project? | 16:31 |
| jeblair | Alex_Gaynor: https://review.openstack.org/#/admin/groups/ | 16:31 |
| fungi | Alex_Gaynor: you can look at https://review.openstack.org/#/admin/groups/ | 16:31 |
| Alex_Gaynor | Thanks | 16:32 |
| clarkb | Alex_Gaynor: and if you don't know which group you need, you can looked under admin -> project and view the project ACLs | 16:32 |
| *** _TheDodd_ has quit IRC | 16:32 | |
| fungi | clarkb: though the acls are redacted if you don't have the right group membership | 16:32 |
| clarkb | really? | 16:33 |
| clarkb | I guess that sort of makes sense | 16:33 |
| fungi | not everyone sees the same acl contents in the webui. totally depends on whether they're in the groups mentioned in the acl | 16:33 |
| fungi | but we can point people to openstack-infra/config:modules/openstack_project/files/gerrit/acls/ instead | 16:33 |
| clarkb | do you get the gitweb link regardless? because that will expose everything | 16:33 |
| clarkb | or point people at the source | 16:34 |
| *** thingee has joined #openstack-infra | 16:34 | |
| jeblair | fungi, clarkb: we could use the build start time instead of build number. | 16:35 |
| jeblair | chance of starting two jobs with the same name for the same change in the same pipeline at the same second is very very small. | 16:36 |
| clarkb | jeblair: and since zuul won't queue a single change up in the same pipelines twice that will be unique | 16:36 |
| clarkb | jeblair: the one place where it will break is with the periodic jobs | 16:36 |
| clarkb | but we can probably live with that until zuul schedules them | 16:36 |
| fungi | agreed. the job would have to finish and get requeued with the same patchset number in less than a second (assuming we're using unixtime or something) | 16:36 |
| jeblair | clarkb: yes, it seems that in practice it would be unique. advantage is that it's a sequential counter so it's easy to see whch is latest. | 16:37 |
| clarkb | good point on that over uuids | 16:37 |
| jeblair | (of course, apache puts timestamps in the dir listing, so i guess a hash would be as well) | 16:37 |
| jeblair | what order does apache list dirs in? | 16:37 |
| *** ^demon has joined #openstack-infra | 16:37 | |
| *** ^demon has joined #openstack-infra | 16:37 | |
| jeblair | asceding filename order by default | 16:38 |
| fungi | locally configurable, but alpha order by default. which alpha order (c vs. en_us) depends on the default locale for the server i think | 16:38 |
| jeblair | so we could change that to date and use uuids, or leave as alpha and use unix timestamps | 16:39 |
| fungi | if we're not using capital letters in the id, the locale concerns are moot | 16:39 |
| clarkb | uuids would be technically correct I think | 16:39 |
| clarkb | as they uniquely identify each job | 16:39 |
| *** dkranz has quit IRC | 16:40 | |
| jeblair | clarkb: well, mostly uniquely if we short them, but yes. :) | 16:40 |
| fungi | fairly unlikely to collide given the small number of them which will coexist in that parent dir | 16:40 |
| jeblair | i'm concerned about changing the default sort order though | 16:41 |
| *** vipul-away is now known as vipul | 16:41 | |
| clarkb | One other thing to keep in mind is today we can easily determine the job url with no external info. If you have the change/commits details you can construct the url | 16:41 |
| fungi | zuul could keep an integer counter of its own i guess, but that's more effort | 16:41 |
| fungi | and would have to persist across restarts | 16:41 |
| jeblair | fungi: zuul has no state across restarts currently (i expect that to change) | 16:41 |
| * fungi nods | 16:42 | |
| jeblair | but i'm trying to keep dependencies for this change low. | 16:42 |
| clarkb | though I guess the actual job numbers are not constructable | 16:42 |
| clarkb | so uuids/dates would be equivalent there | 16:42 |
| jeblair | clarkb: right. i think the main thing is that you go into that dir, and look for the most recent (or whichever) job. | 16:42 |
| fungi | jenkins job number plus zuul change id, concatenated? | 16:42 |
| jeblair | fungi: that still may not sort correctly | 16:43 |
| fungi | oh, right, one master may run lots more of a given job than the other | 16:43 |
| jeblair | fungi: 7-uuid could be followed by 3-uuid | 16:43 |
| *** adalbas has joined #openstack-infra | 16:43 | |
| jeblair | let's just try short uuid, and expect someone looking at the dir index to read the dates. | 16:44 |
| *** afazekas has quit IRC | 16:44 | |
| *** simonmcc has quit IRC | 16:44 | |
| jeblair | (and we can address that later if it's a problem; not many people do that) | 16:44 |
| *** _TheDodd_ has joined #openstack-infra | 16:44 | |
| clarkb | ++ | 16:45 |
| *** simonmcc has joined #openstack-infra | 16:45 | |
| *** jpich has quit IRC | 16:45 | |
| fungi | sounds fine | 16:45 |
| *** jog0-away is now known as jog0 | 16:45 | |
| clarkb | jeblair: in other news http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=419&rra_id=all gear appears to leak memory. My current theory is it is related to the way python lists grow and fail at shrinking | 16:45 |
| fungi | if they really care about sort order in the autoindex, there's a column sort link | 16:45 |
| clarkb | jeblair: I need to read more gear but I think using deques to store the queued jobs may help | 16:46 |
| *** psedlak__ has quit IRC | 16:46 | |
| jeblair | clarkb: quite possibly | 16:46 |
| jeblair | fungi: +1 | 16:46 |
| clarkb | jeblair: note the drop in memory use last night was a result of my restarting the gear server | 16:47 |
| *** datsun180b has joined #openstack-infra | 16:47 | |
| clarkb | with the new job log path sorted /me AFKs for a bit | 16:48 |
| *** SergeyLukjanov has quit IRC | 16:49 | |
| *** bnemec has quit IRC | 16:51 | |
| *** rpodolyaka has left #openstack-infra | 16:51 | |
| *** rpodolyaka has quit IRC | 16:51 | |
| *** nati_ueno has joined #openstack-infra | 16:52 | |
| *** datsun180b has quit IRC | 16:53 | |
| *** datsun180b has joined #openstack-infra | 16:53 | |
| *** dkranz has joined #openstack-infra | 16:53 | |
| *** bnemec has joined #openstack-infra | 16:53 | |
| *** adalbas has quit IRC | 16:54 | |
| *** mriedem has quit IRC | 16:56 | |
| annegentle | anyone know if we have transclusion enabled on our wiki? https://www.mediawiki.org/wiki/Extension:Labeled_Section_Transclusion My guess is no after testing those steps. | 16:58 |
| *** sarob has joined #openstack-infra | 17:01 | |
| *** NobodyCam has quit IRC | 17:02 | |
| *** Ryan_Lane has joined #openstack-infra | 17:05 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Pass the Job to the parameter function https://review.openstack.org/39130 | 17:06 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Pass the Job to the parameter function https://review.openstack.org/39130 | 17:07 |
| Alex_Gaynor | fungi: once the devstack patch is landed, does anything need to be done for that to propogate (I think you mentioned building new images?), or is that automate? | 17:08 |
| Alex_Gaynor | automatic* | 17:08 |
| jeblair | Alex_Gaynor: it will take effect instantly (even the check job on the patch should use the change) | 17:08 |
| jeblair | Alex_Gaynor: until a new image is built, it will be downloading it from the ubuntu mirror, which will slow the job down a tiny bit | 17:09 |
| Alex_Gaynor | Awesome thanks, now I just need to find some reviewers to bribe. (Note: if it makes a difference, I will bake some cookies to bribe you with) | 17:09 |
| jeblair | Alex_Gaynor: but the next time an image is rebuilt, the package will be cached locally and runtimes will be faster | 17:09 |
| *** pabelanger has quit IRC | 17:10 | |
| *** adalbas has joined #openstack-infra | 17:10 | |
| fungi | Alex_Gaynor: right. it was puppet changes which might imply a need to rebuild devstack slave images and burn the old ones. devstack itself does what it's configured for at that point in time | 17:10 |
| Alex_Gaynor | yay for automation | 17:10 |
| clarkb | fungi devstack should install libffi | 17:11 |
| clarkb | this is why it wasnt added to puppet for d-g slaves | 17:12 |
| *** SergeyLukjanov has joined #openstack-infra | 17:12 | |
| fungi | clarkb: yep. that's why i nudged Alex_Gaynor to add it to devstack | 17:13 |
| *** reed has joined #openstack-infra | 17:14 | |
| fungi | when he was first asking whether it was installed on all the slaves, i thought he meant unit test slaves (since you had a change to add that a week or so ago) | 17:14 |
| fungi | then he linked to a tempest-devstack log, and i realized that wasn't what he was talking about | 17:15 |
| *** dims has quit IRC | 17:17 | |
| fungi | jeblair: sdague: tried using /**/ to match multiple depths, but apache globs aren't that smart apparently. looking through the docs, i can't see any way to match multiple directory levels with a single glob (only regular expressions) | 17:17 |
| jeblair | fungi: this is really unfortunate, since i'm about to add a path element to a bunch of logs. and then change them around again. | 17:18 |
| jeblair | fungi: the config is going to be a mess by the time we're done. :( | 17:18 |
| fungi | agreed, though the old patterns only need to stick around until the logs using them expire and get cleaned out | 17:19 |
| jeblair | fungi: however, eventually we will have exhaustively listed all of the likely possibilities: '*/', '*/*/', ... | 17:19 |
| *** pcrews has quit IRC | 17:19 | |
| zaro | clarkb: got time to make a release for zmq? | 17:19 |
| jeblair | fungi: so i guess it's a bounded problem. | 17:19 |
| fungi | the alternative is to make ReadmeName point to an ssi and have it decide what to present based on a more programmatic investigation of the path | 17:20 |
| jeblair | fungi: so i guess in addition to your change, you should also add the current spec for periodic jobs, and also one deeper than the current periodic jobs (if you want to future-proof against what i'm doing) | 17:21 |
| fungi | the up side to that option is that we get to wax nostalgic about ssi | 17:21 |
| jeblair | fungi: :) i think the long term is we keep moving in the direction of having the log serving app handle it. | 17:21 |
| fungi | that definitely seems sanest | 17:21 |
| fungi | sdague: just to confirm, are the current readmes relevant to periodic jobs as well? (see above) | 17:22 |
| sdague | yes, they should be | 17:23 |
| fungi | perfect. i'll tack them on and future-proof them | 17:23 |
| *** dina_belova has joined #openstack-infra | 17:23 | |
| *** cp16net is now known as cp16net|away | 17:26 | |
| *** dims has joined #openstack-infra | 17:29 | |
| *** cp16net|away is now known as cp16net | 17:31 | |
| *** burt has quit IRC | 17:34 | |
| *** dims has quit IRC | 17:36 | |
| *** dims has joined #openstack-infra | 17:36 | |
| *** ladquin has joined #openstack-infra | 17:37 | |
| *** sarob has quit IRC | 17:37 | |
| *** sarob has joined #openstack-infra | 17:37 | |
| *** avtar has quit IRC | 17:39 | |
| *** zul has quit IRC | 17:41 | |
| *** sarob has quit IRC | 17:41 | |
| *** dina_belova has quit IRC | 17:42 | |
| *** rnirmal has joined #openstack-infra | 17:43 | |
| *** datsun180b_ has joined #openstack-infra | 17:43 | |
| *** datsun180b has quit IRC | 17:45 | |
| *** datsun180b_ is now known as datsun180b | 17:45 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Switch Zuul/JJB to use LOG_PATH https://review.openstack.org/39133 | 17:49 |
| jeblair | so it turns out that's not easy. and there's at least one reason why we'd want to go ahead and do the zuul trigger change before that as well. | 17:49 |
| clarkb | jeblair: the not easy bits being in zuul? | 17:52 |
| clarkb | the config change seems minor | 17:52 |
| jeblair | clarkb: all over | 17:52 |
| jeblair | clarkb: requires a code change to zuul, and breaks logstash for periodic jobs. | 17:53 |
| jeblair | clarkb: (until zuul has timed triggers) | 17:53 |
| clarkb | jeblair: https://review.openstack.org/#/c/39133/1/modules/openstack_project/files/logstash/log-gearman-client.py line 92. Why are we removing the post and release stuff? | 17:54 |
| jeblair | clarkb: LOG_PATH will always be set by zuul for all jobs | 17:56 |
| clarkb | jeblair: the shortref is included in the fields so that it ends up in the logstash events. That way you can trace particular events back to the commit that caused them to run | 17:58 |
| clarkb | jeblair: I think we should keep the short ref in this case even if it isn't necessaryfor construction of the url | 17:58 |
| clarkb | I will leave a review | 17:59 |
| *** zul has joined #openstack-infra | 18:00 | |
| jeblair | clarkb: which jobs get a shortref and store info in logstash? | 18:01 |
| clarkb | jeblair: the post, prerelease and release jobs | 18:01 |
| *** dkliban is now known as dkliban_afk | 18:01 | |
| jeblair | clarkb: logstash picks those up? i thought it was just devstack jobs? | 18:01 |
| clarkb | jeblair: it picks up everything | 18:02 |
| jeblair | clarkb: ok, well it should probably just use the full sha instead of the short one then. | 18:02 |
| clarkb | for most jobs that means only the console log ends up in logstash but for many things that is sufficient | 18:02 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Additional path patterns for log readme files. https://review.openstack.org/39116 | 18:04 |
| clarkb | _TheDodd_: your commit message bug automation message looks good to me | 18:05 |
| jeblair | _TheDodd_: me too | 18:05 |
| clarkb | jeblair: fungi: should we approve that change now and send the message after some burn in or just do both? | 18:05 |
| _TheDodd_ | clarkb, great! Glad to hear it. | 18:05 |
| jeblair | clarkb: since it's backwards compat, let's burn-in. | 18:06 |
| fungi | clarkb: since it's backward compatible, ... what jeblair just said | 18:06 |
| clarkb | ok, I will approve it now | 18:06 |
| pleia2 | fungi: if you have a few minutes as some point, can we take a look at the jeepyb install status on git.o.o? I saw it get nudged in puppet hours ago, but it still seems to have dependency issues | 18:06 |
| fungi | pleia2: can you point me to a log or paste.o.o the error? | 18:07 |
| pleia2 | sure, just a moment | 18:07 |
| fungi | pleia2: wondering if it's another case of what i'm trying to fix with https://review.openstack.org/38066 | 18:07 |
| openstackgerrit | A change was merged to openstack-infra/jeepyb: Improving Gerrit + commit-log automation. https://review.openstack.org/36886 | 18:08 |
| pleia2 | fungi: http://puppet-dashboard.openstack.org:3000/reports/717973 log tab | 18:08 |
| pleia2 | fungi: ah yes, I saw that commit earlier this weekend and was wondering if that would be the key | 18:08 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Switch Zuul/JJB to use LOG_PATH https://review.openstack.org/39133 | 18:08 |
| fungi | pleia2: your log there looks like a github problem | 18:09 |
| jeblair | clarkb: ^ a slightly more comprehensive treatment of the subject which more closely matches zuul behavior. | 18:09 |
| pleia2 | fungi: yeah, just realized that | 18:09 |
| pleia2 | fungi: even so, I don't think jeepyb is installed properly (have to dig a bit further to when the first patches went in) | 18:09 |
| fungi | pleia2: i'll jump on the server and check | 18:09 |
| clarkb | jeblair: lgtm | 18:10 |
| clarkb | _TheDodd_: 36866 should get applied in the next half hour or so assuming jeepyb is installing properly on review.o.o | 18:10 |
| * jeblair -> afk | 18:11 | |
| clarkb | at that point we can test it with a dummy change | 18:11 |
| pleia2 | fungi: it should have installed and exec'ed on /home/cgit/projects.yaml to create /etc/cgitrepos - but I don't see evidence of this having happened | 18:11 |
| _TheDodd_ | Ok, sounds great. | 18:11 |
| fungi | pleia2: /opt/jeepyb is more than a week behind | 18:11 |
| fungi | which makes me think something is wrong with that clone of the git repo. i'll play around with it a little | 18:12 |
| pleia2 | fungi: thank you | 18:12 |
| fungi | pleia2: not sure what's going on there. i was able to remote update and pull into master | 18:13 |
| pleia2 | hrm | 18:14 |
| fungi | also fetch --tags origin is not erroring for me in that clone | 18:14 |
| * pleia2 checks on vcsrepo details | 18:14 | |
| pleia2 | right, is just be the standard jeepyb include | 18:15 |
| pleia2 | fungi: does /etc/cgitrepos exist? | 18:15 |
| pleia2 | wondering if exec didn't trigger because now it thinks /home/cgit/projects.yaml hasn't changed | 18:16 |
| pleia2 | this all went much smoother on my test vm :) | 18:16 |
| clarkb | pleia2: I think that a rule about puppet is you will get beneficial ordering on your test machien and the worst possible order in production | 18:17 |
| fungi | pleia2: i tried to run the install exec for the jeepyb puppet module, but looks like jeepyb is not entirely python 2.6 compatible | 18:17 |
| pleia2 | clarkb: haha | 18:17 |
| fungi | couple things we may need to patch in jeepyb to make it work | 18:18 |
| pleia2 | hmm, how did I get this to work | 18:19 |
| *** pcrews has joined #openstack-infra | 18:19 | |
| fungi | pleia2: clarkb: http://paste.openstack.org/show/42467/ | 18:20 |
| fungi | that's a new one on me | 18:20 |
| pleia2 | [root@git-vanilla ~]# ls /opt/jeepyb/ | 18:20 |
| pleia2 | I definitely managed to get it installed on my system | 18:21 |
| fungi | pleia2: in /opt/jeepyb (as root) run 'python setup.py install' | 18:21 |
| clarkb | fungi: looks like we have somehow registered an atexit function that is a NoneType | 18:21 |
| clarkb | fungi: is setup.py install creating that error? | 18:22 |
| pleia2 | fungi: http://paste.openstack.org/show/42468/ | 18:22 |
| pleia2 | seems ok | 18:22 |
| *** UtahDave has joined #openstack-infra | 18:22 | |
| fungi | clarkb: it's hard to tell. the logs is missing context, but it's right after "Installing openstackwatch script to /usr/bin" | 18:22 |
| fungi | s/logs/log/ | 18:23 |
| *** arosen has quit IRC | 18:23 | |
| fungi | also pip freeze doesn't show pbr installed | 18:24 |
| pleia2 | mine doesn't have pbr | 18:24 |
| fungi | ahh, i guess pbr doesn't need to be installed globally since it's not a runtime dependency, just a setup_requires | 18:26 |
| fungi | so ignore that bit of speculation | 18:26 |
| pleia2 | and don't have anything weird going on with python, just default 2.6.6-37.el6_4 | 18:29 |
| sdague | mordred: so I'm still scratching my head why mtreinish's change didn't cause the grenade fail | 18:29 |
| sdague | but then everything after him did | 18:29 |
| *** sarob has joined #openstack-infra | 18:33 | |
| *** dkliban_afk is now known as dkliban | 18:36 | |
| *** hashar has joined #openstack-infra | 18:37 | |
| *** dina_belova has joined #openstack-infra | 18:40 | |
| *** arosen has joined #openstack-infra | 18:40 | |
| fungi | clarkb: pleia2: the plot thickens... running python setup.py install a second time doesn't spew those tracebacks any longer | 18:42 |
| pleia2 | huh | 18:42 |
| *** sarob has quit IRC | 18:42 | |
| fungi | i'm going to try uninstalling jeepyb and seeing if it installs cleanly a second time | 18:42 |
| *** sarob has joined #openstack-infra | 18:42 | |
| *** mgagne has joined #openstack-infra | 18:43 | |
| fungi | got it! | 18:43 |
| fungi | if i 'git clean -dfx' before 'python setup.py install' then it happens, so it's something running out of one of the other cached eggs i guess | 18:44 |
| *** vipul is now known as vipul-away | 18:45 | |
| fungi | implying those tracebacks are possibly benign | 18:45 |
| mordred | sdague: can you show me his change? | 18:45 |
| mordred | ttx: ping | 18:47 |
| pleia2 | fungi: ok, so jeepyb should be installed ok now, does /etc/cgitrepos exist? wondering if we just wait for next puppet run if not | 18:47 |
| sdague | mordred: https://review.openstack.org/#/c/38810/ | 18:47 |
| sdague | with the associated test runs | 18:47 |
| fungi | pleia2: since puppet installs that, i'll need to fire a puppet run | 18:48 |
| Alex_Gaynor | sdague: Is there something https://review.openstack.org/#/c/39096/ is missing to get an accept? | 18:48 |
| sdague | a second +2 | 18:49 |
| mordred | sdague: and you're telling me that the change revert it _fixes_ grenade? | 18:49 |
| Alex_Gaynor | oh, duh, sorry I'm slow today apparently | 18:49 |
| sdague | yes | 18:49 |
| sdague | mordred: it was the awesome... and by that, not very awesome | 18:49 |
| mordred | sdague: so, that makes ZERO sense | 18:50 |
| fungi | pleia2: puppet runs clean but /etc/cgitrepos still dne | 18:50 |
| mordred | we don't install anything from requirements.txt yet | 18:50 |
| sdague | mordred: yes we do | 18:50 |
| mordred | oh. wait | 18:50 |
| fungi | pleia2: maybe i need to step the git repo for jeepyb back a commit to trigger the machinery. trying that now | 18:50 |
| pleia2 | fungi: ok, so the exec for creating it runs on /home/cgit/projects.yaml being changed, can you confirm projects.yaml exists? | 18:50 |
| mordred | sdague: sorry man. my brain thought that was requirements.txt in openstack/requirements | 18:50 |
| sdague | if we didn't, everything would be broken all the time :) | 18:50 |
| mordred | sdague: looking again | 18:50 |
| *** burt has joined #openstack-infra | 18:51 | |
| fungi | pleia2: yeah, /home/cgit/projects.yaml is there last modified Jul 22 05:53 | 18:51 |
| pleia2 | fungi: puppet installs /etc/cgitrc but /etc/cgitrepos is generated by jeepyb's script that runs when projects.yaml cnages | 18:51 |
| fungi | pleia2: i'll try tweaking that so it gets updated | 18:51 |
| pleia2 | fungi: thanks | 18:51 |
| sdague | mordred: so .... the force on global requirements in devstack, isn't going to work. Because it pops that up before rpm package install | 18:52 |
| sdague | or deb package install | 18:52 |
| mordred | sdague: can you tell me what the general strategy is for requirements in grenade? | 18:52 |
| sdague | regardless, it means you don't have devel headers | 18:52 |
| sdague | mordred: ok on grenade | 18:52 |
| sdague | it uses pieces of devstack | 18:52 |
| sdague | so basically goes into the new git source trees, runs setup.py develop, and off we go | 18:53 |
| mordred | ok | 18:54 |
| fungi | pleia2: sorry! http://paste.openstack.org/show/42470/ | 18:54 |
| mordred | so - it installs via devstack the first time - then how does it upgrade the requrements? | 18:54 |
| mordred | sdague: also, I disagree with you re: devstack, the install reuqirements code is right before all the setup.py develop calls | 18:54 |
| adalbas | sdague, from the logs you sen in the mailing list, it looks like we had a race condition with cinder. My guess is that it may have caused when the job downgrades jsonschema to version 1.3.0 | 18:54 |
| sdague | mordred: but it assumes *all* services are enabled | 18:55 |
| mordred | sdague: ah. I see what you are saying | 18:56 |
| fungi | pleia2: aha! http://paste.openstack.org/show/42471/ | 18:56 |
| mordred | because we ... oh for the love of | 18:56 |
| fungi | pleia2: pbr again | 18:56 |
| pleia2 | fungi: bah | 18:56 |
| mordred | sdague: ok. I have ideas - let's come back to them | 18:56 |
| sdague | well, we correctly only install the packages we need | 18:56 |
| mordred | yeah. no, I'm with you | 18:56 |
| sdague | ok | 18:56 |
| fungi | pleia2: so pbr *is* a runtime dependency of (at least parts of) jeepyb but is not being installed globally since it's only in setup_requires | 18:56 |
| sdague | ok, so yes, it does requirements processing twice | 18:56 |
| mordred | let's go back to grenade, it's more imporant right now - you install grizzly devstack software as expected, yeah? | 18:56 |
| sdague | once through on all enabled packages on the first devstack | 18:57 |
| sdague | yep | 18:57 |
| pleia2 | fungi: so `python /opt/jeepyb/jeepyb/cmd/create_cgitrepos.py` should work fine, but for the wrapper thing we use we need pbr is required | 18:57 |
| mordred | sdague: are you doing pip install -U on those? | 18:57 |
| sdague | then you do the install_* portion for the new devstack trees | 18:57 |
| mordred | or just the install_ functions which do setup.py develop | 18:57 |
| pleia2 | fungi: except in english. s/we use we need pbr is required/we use we need pbr | 18:57 |
| mordred | sdague: sorry, I'm asking dumb questions on purpose here | 18:57 |
| *** vipul-away is now known as vipul | 18:58 | |
| mordred | wanting to make sure I don't miss an assumption | 18:58 |
| fungi | pleia2: more or less. i want to pick mordred's brain on the installing from local source, should pbr be globally installed question once he pulls his brain back out of grenade for a bit | 18:58 |
| pleia2 | fungi: ok, thanks | 18:58 |
| sdague | mordred: https://github.com/openstack-dev/devstack/blob/master/functions#L1128 | 18:58 |
| sdague | that's what we do to each tree | 18:58 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Add Wiki upgrade process documentation. https://review.openstack.org/39137 | 18:59 |
| clarkb | Ryan_Lane: ^ any chance you can review that | 18:59 |
| clarkb | jeblair: fungi mordred ^ also | 18:59 |
| sdague | adalbas: yeh, we're actually running through the post mortem on that right now | 18:59 |
| adalbas | sdague, yes, im following your thoughts here | 18:59 |
| mordred | sdague: ok. I don't think that's likely to have the effects you want | 19:00 |
| mordred | because there is no -U involved | 19:00 |
| mordred | which means that pip is probably not going to do what you think it is | 19:00 |
| sdague | mordred: why | 19:00 |
| sdague | we only need to bump the requirement if we have to bump the requirement | 19:00 |
| mordred | I do not believe that pip will bump the requirement even in that case | 19:01 |
| sdague | we know it downgrades if you are out of bounds | 19:01 |
| adalbas | mordred, in that specific case, if i correctly understood, what happened was a downgrade instead | 19:01 |
| sdague | so why don't you think it will upgrade if out of bounds? | 19:01 |
| * mordred may need to make a sequencing test script | 19:01 | |
| clarkb | pleia2: meeting tomorrow and bug day right? | 19:01 |
| fungi | pleia2: manually pip-installing pbr and d2to1 gets it further, but something also wants pycrypto>=2.1,!=2.4 and i'm getting 'splosions trying to pip install it | 19:01 |
| sdague | we still actually downgrade a package as part of normal runs right now | 19:01 |
| sdague | and upgrade many | 19:01 |
| fungi | pleia2: "RuntimeError: autoconf error" does not sound good | 19:02 |
| pleia2 | clarkb: oh bother, I forgot about bug day! MarkAtwood is borrowing me to Palo Alto tomorrow morning (will probably miss the meeting too) | 19:02 |
| pleia2 | I can prep an etherpad today that everyone can fill out | 19:02 |
| clarkb | pleia2: that would be super | 19:02 |
| * pleia2 has a lplib script now :) | 19:02 | |
| fungi | pleia2: heh, "configure: error: no acceptable C compiler found in $PATH" | 19:02 |
| * fungi boggles at a modern linux with no cc | 19:03 | |
| mordred | sdague: oh. ok. I'm wrong. | 19:03 |
| pleia2 | fungi: gosh, what is using gcc? | 19:03 |
| mordred | sdague: (sorry, needed to test it myself) | 19:03 |
| sdague | mordred: yeh - http://paste.openstack.org/show/42472/ | 19:03 |
| sdague | that's in a normal functioning install | 19:03 |
| fungi | pleia2: no, there's no c compiler installed by default at all it seems | 19:03 |
| *** nati_uen_ has joined #openstack-infra | 19:03 | |
| clarkb | fungi: ya ubuntu does not install gcc in a default install | 19:04 |
| pleia2 | fungi: right, I'm wondering what we're installing that needs it | 19:04 |
| sdague | everything except the cinderclient requests bit is an upgrade, that's actually a downgrade | 19:04 |
| clarkb | neither do a bunch of other distros | 19:04 |
| pleia2 | clarkb: centos | 19:04 |
| sdague | it's hard to one line grep for that though, because pip spits out useful information in too many discreet places | 19:04 |
| *** nati_ueno has quit IRC | 19:06 | |
| sdague | ok, back to global requirements on devstack - so for use to do what we want to do with devstack.... we'd need to make the base case act more like devstack gate, right? | 19:07 |
| sdague | where what we actually do is pull all the trees up front | 19:08 |
| sdague | then apply all the pip files at once | 19:08 |
| _TheDodd_ | clarkb: where do we stand? Has disaster struck? | 19:08 |
| mordred | sdague: actually | 19:08 |
| mordred | sdague: I think the easier thing might be | 19:08 |
| mordred | sdague: clone requirements | 19:08 |
| clarkb | _TheDodd_: I don't know. I haven't tested the change yet. Let me check really quickly if the jeepyb install updated then we can test | 19:08 |
| fungi | pleia2: pycrypto wants to compile modules | 19:09 |
| mordred | sdague: then, in the pip_install function | 19:09 |
| mordred | sdague: run the update.py script from requirements | 19:09 |
| mordred | sdague: which will update the local requirements list with the ones in the requirements file | 19:09 |
| mordred | but we'll still only run the ones that we're configured to run | 19:09 |
| mordred | and it shouldn't be that hard of a patch | 19:09 |
| mordred | and it should also have the benefit of making sure that update script works | 19:09 |
| sdague | ok, 'splain that too me again, I'm slow | 19:09 |
| clarkb | _TheDodd_: looks like we still have old jeepyb on review.o.o. | 19:10 |
| mordred | openstack/requirements has an update.py script | 19:10 |
| clarkb | _TheDodd_: fungi is currently debugging issues with installing jeepyb on a different host, hopefully he will know how to correct review.o.o's install | 19:10 |
| mordred | which will update the requirements in a project to the ones listed in openstack/requirements - but only for the deps the project already uses | 19:10 |
| mordred | so it won't add things - it will only update versions | 19:10 |
| clarkb | fungi: any chance you can poke at review.o.o when git.o.o is happy? | 19:10 |
| sdague | so in each of the projects, run the update | 19:10 |
| mordred | so, if in the setup_develop script, we first run the update | 19:10 |
| mordred | yeah | 19:11 |
| sdague | ok. interesting. let me have a go at that | 19:11 |
| mordred | cool | 19:11 |
| fungi | clarkb: what needs poking? | 19:11 |
| mordred | that should also let us know that if a requirements change passes the gate | 19:11 |
| clarkb | fungi: jeepyb on review.o.o isnt updating to pull in _TheDodd_'s update bug change | 19:11 |
| fungi | clarkb: https://review.openstack.org/#/c/38066/ | 19:11 |
| mordred | that automation around using update.py to update the projects _should_ work | 19:11 |
| clarkb | fungi: 38066 should fixthe problem? | 19:12 |
| clarkb | +2'd | 19:12 |
| clarkb | I am starving. I will grab lunch but can assist with more pbr jeepyb after | 19:12 |
| fungi | clarkb: 38066 *does* work around the problem. according to mordred some heavy hacking on pbr internals would be required to actually *fix* the problem | 19:12 |
| clarkb | fungi: wfm | 19:13 |
| mordred | fungi: I'm not even sure that hacking on pbr will get us out of this hole, just because of how the whole system works - but it's definitely more dev time than we probably want to be without an up to date jeepyb | 19:13 |
| *** sarob has quit IRC | 19:13 | |
| *** sarob_ has joined #openstack-infra | 19:14 | |
| fungi | clarkb: pleia2: as for git.o.o, something about the entrypoint for create-cgitrepos wants pycrypto (either directly or indirectly) which we'll either need a suitable version of installed or need a compiler if we want pip to install it for us | 19:14 |
| pleia2 | requirements for that script are pretty minimal, just imports os and yaml, so it must be pretty indirect | 19:16 |
| fungi | specifically from pkg_resources import load_entry_point seems to be triggering that | 19:16 |
| pleia2 | does look like I did end up installing gcc somewhere along the way on my test system though, browsing history now | 19:17 |
| pleia2 | http://paste.openstack.org/show/42475/ | 19:17 |
| fungi | indeed | 19:18 |
| pleia2 | heh, so I probably did run into this too | 19:18 |
| *** sarob_ has quit IRC | 19:18 | |
| fungi | from whence did you obtain pycrypto? can you tell whether it was via pip or yum? | 19:18 |
| pleia2 | pip | 19:18 |
| pleia2 | [root@git-vanilla config]# pip freeze | grep pycrypto | 19:18 |
| pleia2 | pycrypto==2.0.1 | 19:18 |
| fungi | pleia2: so in theory, https://review.openstack.org/38066 to force pbr to be installed globally before jeepyb, along with adding the gcc package to the git.pp manifest ought to get us past this | 19:20 |
| pleia2 | should we just add the gcc package as a depenency for jeepyb? | 19:20 |
| pleia2 | or that | 19:20 |
| fungi | i think so, yes | 19:21 |
| fungi | pleia2: -rw-r--r--. 1 root root 20322 Jul 29 19:21 /etc/cgitrepos | 19:21 |
| pleia2 | woo, http://git.openstack.org/cgit is pretty now | 19:22 |
| pleia2 | (no repos behind it yet though, so no links work) | 19:22 |
| fungi | pleia2: once we iron out these last bits, we probably ought to blow away this server and launch a fresh one just to make sure all the retooling is sufficient to build from scratch like we hope | 19:22 |
| pleia2 | fungi: +1 | 19:23 |
| *** bnemec has quit IRC | 19:23 | |
| *** bnemec has joined #openstack-infra | 19:23 | |
| pleia2 | I think jeblair said he got an ssl cert, so I also need to configure that w/ apache | 19:23 |
| fungi | because i no longer trust that vm to be 100% consistent with what we'll get, following some of the troubleshooting i've done there | 19:23 |
| pleia2 | and finish getting the git:// server installed | 19:23 |
| pleia2 | oh, and we need to decide how we want to structure the URLs | 19:24 |
| fungi | potential topic for tomorrow's meeting | 19:24 |
| fungi | or just take a first stab and we can hash it out in review | 19:24 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-dev/hacking: Import exceptions list is now configurable https://review.openstack.org/39140 | 19:24 |
| pleia2 | fungi: so I'll probably miss that meeting (have to go down the peninsula tomorrow for some on-site stuff) | 19:25 |
| fungi | k | 19:25 |
| fungi | how ever will we manage a bug day without you though? | 19:25 |
| pleia2 | I'll see where I get today with other things though, maybe I can snag a cube at noon | 19:25 |
| anteaya | ttx are you about? | 19:25 |
| pleia2 | fungi: I am prepping the etherpad this afternoon ;) | 19:26 |
| fungi | pleia2: too awesome | 19:26 |
| sdague | mordred: is there a reason we do pbr before setup_tools? | 19:30 |
| sdague | in devstack | 19:30 |
| mordred | hrm. | 19:30 |
| mordred | no | 19:30 |
| mordred | it should be the other way around | 19:30 |
| mordred | upgrade setuptools, then install pbr, then install real things | 19:30 |
| sdague | ok, cool | 19:31 |
| sdague | makes it easier | 19:31 |
| fungi | puppet agent on review.o.o is hung for the past ~5 hours due to github hiccough. fixing | 19:31 |
| sdague | i think they are being ddosed today | 19:32 |
| *** swifterdarrell has quit IRC | 19:32 | |
| *** thingee_ has joined #openstack-infra | 19:32 | |
| *** thingee has quit IRC | 19:33 | |
| *** crank has quit IRC | 19:33 | |
| *** jaypipes has quit IRC | 19:33 | |
| *** klrmn has quit IRC | 19:33 | |
| *** swifterdarrell has joined #openstack-infra | 19:33 | |
| *** jaypipes has joined #openstack-infra | 19:33 | |
| *** klrmn has joined #openstack-infra | 19:33 | |
| *** crank has joined #openstack-infra | 19:34 | |
| fungi | same for lists.o.o, though it wasn't hung on anything particular, it seemed to be running and enabled but not reporting into dashboard. i've cleanly stopped and started the agent to see if that helps | 19:35 |
| sdague | mordred: where does pkg_resources come from in a base install? | 19:36 |
| sdague | never mind, got it | 19:37 |
| *** leifmadsen has quit IRC | 19:38 | |
| sdague | scrubbing back a devstack node to bare is *interesting* | 19:38 |
| *** nati_uen_ has quit IRC | 19:38 | |
| *** leifmadsen has joined #openstack-infra | 19:38 | |
| mordred | sdague: :) | 19:40 |
| mordred | sdague: oh - btw- over the weekend, I put together diskimage-builder elements that makes a qcow2 image that looks like a devstack-gate node | 19:41 |
| *** nati_ueno has joined #openstack-infra | 19:41 | |
| mordred | sdague: it'll be a few steps yet before we can base anything off it - but it's totally useful for locally spinning up a vm that's identical to a d-g node | 19:41 |
| pleia2 | mordred: nice! | 19:41 |
| sdague | setup.py develop not valid for pbr? | 19:42 |
| pleia2 | I think I saw that review come in, but didn't take a close look yet | 19:42 |
| sdague | damn you mordred for being unstandard.... :) | 19:42 |
| mordred | pleia2: I also tested takeovernode/kexec to make a cloud server look like it | 19:42 |
| mordred | sdague: it very much shoudl work | 19:42 |
| sdague | mordred: qcow2 d-g sounds cool :) | 19:42 |
| mordred | sdague: I have trunk pbr develop'd on my laptop all the time | 19:42 |
| mordred | sdague: can you paste me your error? | 19:42 |
| jeblair | current ATC count for Icehouse summit: 860 | 19:42 |
| mordred | jeblair: WOW | 19:42 |
| mordred | jeblair: we have a lot of devs | 19:43 |
| sdague | jeblair: nice | 19:43 |
| sdague | that the last 12 months? | 19:43 |
| jeblair | thats 2012-09-27 -- new | 19:43 |
| mordred | is anyone going to be ironic enough to throw a party with kegs of icehouse beer? | 19:43 |
| jeblair | thats 2012-09-27 -- now | 19:43 |
| sdague | nice | 19:43 |
| mordred | zomg | 19:43 |
| mordred | we should throw an Ironic™ party where we ironically service Icehouse™ beer | 19:43 |
| sdague | mordred: you can't get beer that crappy in hong kong :) | 19:43 |
| * sdague hits mordred with a trout | 19:43 | |
| mordred | sdague: we could import it - hell man, I work for HP - I'm sure we have a fleet of boats somewhere | 19:44 |
| jeblair | fungi: and i haven't forgotten that i plan on checking that in and cronning it; however that has bumped a few places down on the list (currently #8) | 19:44 |
| sdague | mordred: http://paste.openstack.org/show/42481/ | 19:45 |
| *** w_ has joined #openstack-infra | 19:45 | |
| *** cp16net is now known as cp16net|away | 19:46 | |
| *** rpodolyaka has joined #openstack-infra | 19:46 | |
| mordred | sdague: you moved the setuptools install to before it? | 19:46 |
| mordred | because you're showing me a machine witha broken setuptools upgrade | 19:46 |
| sdague | yeh, hold on, I'll push the change back out onto gerrit | 19:46 |
| mordred | OH | 19:46 |
| mordred | sdague: this is the pip instlaled setuptools gets weird with os installed setuptools | 19:47 |
| mordred | god I hate every bit of this | 19:47 |
| sdague | "Why OpenStack hates Python™" | 19:47 |
| mordred | srrsly | 19:47 |
| *** olaph has quit IRC | 19:47 | |
| mordred | it's VERY tempting to embed a fork of setuptools renamed into pbr that does not use or touch system setuptools or distutils | 19:48 |
| mordred | but instead just does EVERYTHING on its own | 19:48 |
| mordred | but I will not do this | 19:48 |
| sdague | Sean Dague proposed a change to openstack-dev/devstack: Update projects to global requirements before setup https://review.openstack.org/35705 | 19:48 |
| fungi | mordred: embed a renamed python interpreter into pbr | 19:48 |
| sdague | so that's my new version of your patch | 19:48 |
| sdague | I'm also trying to unwind back to working pip and friends from the os, which is mostly about uninstalling packages | 19:50 |
| sdague | so if you think there is something I missed, let me know | 19:50 |
| rpodolyaka | mordred: could you take a look at https://review.openstack.org/#/c/38459/ when you've got a minute? I' | 19:51 |
| mordred | sdague: I just updated https://review.openstack.org/35705 - try that on for size | 19:52 |
| mordred | sdague: funny enough - I had made another devstack patch a little while ago that actually does exactly that- it uninstalls system setuptools after pip installing it | 19:53 |
| mordred | because, it turns out, things go horribly horribly wrong | 19:53 |
| sdague | you have got to be kidding me.... | 19:54 |
| rpodolyaka | mordred: I've modified tox.ini of SQLAlchemy-migrate to run tests on every Python/SQLAlchemy combination we claim to support. It's a bit ugly in tox 1.x... Is it the right approach and can we set up gate jobs to run those tests? Thanks! | 19:54 |
| sdague | I feel like I'm playing out "whose on first" | 19:54 |
| sdague | ls | 19:55 |
| sdague | oops | 19:55 |
| mordred | rpodolyaka: yes and yes | 19:55 |
| mordred | sdague: tell me about it. I cannot WAIT until zul has fixed ubuntu and dprince has fixed redhat for us so that we can stop needing to do this dance | 19:56 |
| sdague | yeh, so that doesn't work | 19:56 |
| rpodolyaka | mordred: ok, thanks a lot! I'll make a patch for openstack-infra/config and add you to the review | 19:57 |
| sdague | oh, wait one minute | 19:57 |
| *** rpodolyaka has left #openstack-infra | 19:57 | |
| Alex_Gaynor | 2.5 hours is the timeout for jenkins jobs right? | 19:57 |
| *** cybertron_ has joined #openstack-infra | 19:58 | |
| *** cp16net|away is now known as cp16net | 19:58 | |
| *** bnemec has quit IRC | 19:58 | |
| sdague | mordred: ok, that might work | 19:59 |
| *** derekh has joined #openstack-infra | 19:59 | |
| mordred | sdague: it's an evil sledgehammer | 19:59 |
| sdague | I had to unborkify a lot to get to a cleanish state on things | 19:59 |
| fungi | Alex_Gaynor: it depends entirely on the job | 20:00 |
| *** vipul has quit IRC | 20:00 | |
| Alex_Gaynor | fungi: the devstack ones specifically | 20:00 |
| *** vipul has joined #openstack-infra | 20:00 | |
| *** melwitt has joined #openstack-infra | 20:00 | |
| sdague | well it's doing a thing | 20:00 |
| *** cybertron_ has quit IRC | 20:01 | |
| *** dkliban has quit IRC | 20:01 | |
| mordred | sdague: that's a start! | 20:01 |
| *** bnemec has joined #openstack-infra | 20:02 | |
| fungi | Alex_Gaynor: depends on the devstack job in question. see openstack-infra/config in modules/openstack_project/files/jenkins_job_builder/config/devstack-gate.yaml | 20:02 |
| Alex_Gaynor | thanks | 20:02 |
| fungi | Alex_Gaynor: some are as little as 1.5 hours, some as long as 3 | 20:03 |
| jog0 | is jenkins acting funny today? http://logs.openstack.org/36/36436/6/gate/gate-tempest-devstack-vm-full/37036/console.html.gz | 20:03 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-dev/hacking: Extract configs-related code to the configs helper https://review.openstack.org/39143 | 20:05 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-dev/hacking: Import exceptions list is now configurable https://review.openstack.org/39140 | 20:05 |
| sdague | so, now we run into the oslo-config doesn't have releases problem | 20:05 |
| *** nati_uen_ has joined #openstack-infra | 20:06 | |
| sdague | mordred: your update.py strips out this entirely from nova's requirements.txt | 20:06 |
| sdague | - | 20:06 |
| sdague | --f http://tarballs.openstack.org/oslo.config/oslo.config-1.2.0a3.tar.gz#egg=oslo.config-1.2.0a3 | 20:06 |
| sdague | -oslo.config>=1.2.0a3 | 20:06 |
| mordred | sdague: ah. bugger. bug in update.py | 20:08 |
| jog0 | fungi: ^ | 20:08 |
| fungi | jog0: yeah, i'm trying to spot what happened in that console log | 20:09 |
| sdague | also, global requirements really should require a higher version of sqla, but that's another matter | 20:09 |
| fungi | jog0: is "AttributeError: 'module' object has no attribute 'DeprecatedOpt' | 20:09 |
| fungi | jog0: typical? | 20:09 |
| jog0 | fungi: ahh I see | 20:10 |
| pleia2 | fungi: ok, so did we want to include package gcc for jeepyb module or just git.pp manifest (having gcc installed is not a bad thing, and putting it in jeepyb module would prevent this woe in the future) | 20:10 |
| jog0 | no | 20:10 |
| jog0 | looks like that is related to oslo.config | 20:10 |
| *** mgagne1 has joined #openstack-infra | 20:10 | |
| *** mgagne1 has quit IRC | 20:10 | |
| *** mgagne1 has joined #openstack-infra | 20:10 | |
| jog0 | fungi: at least that is my guess based on, the fact that sdague and mordred are talking about it | 20:10 |
| fungi | jog0: seems likely. i have only been paying partial attention to their discourse, hoping for a tl;dr since i'm also trying to work on stuff | 20:11 |
| fungi | pleia2: i think so. if the entrypoints use for jeepyb won't work without pycrypto installed and we want to be able to pip install pycrypto, then gcc is needed | 20:12 |
| pleia2 | fungi: thanks | 20:12 |
| *** mgagne has quit IRC | 20:12 | |
| fungi | so the jeepyb puppet module seems like the right place | 20:13 |
| jog0 | fungi: makes sense. | 20:13 |
| jog0 | sdague: is this the bug you guys are working on http://logs.openstack.org/36/36436/6/gate/gate-tempest-devstack-vm-full/37036/logs/screen-n-api.txt.gz | 20:13 |
| sdague | yes, actually | 20:13 |
| sdague | is that in the gate? | 20:13 |
| jog0 | sdague: yes | 20:13 |
| sdague | wait... how? | 20:13 |
| openstackgerrit | Tom Fifield proposed a change to openstack-infra/jeepyb: cease docimpact emails, create bugs only https://review.openstack.org/39118 | 20:14 |
| * jog0 shrugs | 20:14 | |
| jog0 | sdague: https://review.openstack.org/#/c/36436/ | 20:14 |
| SpamapS | pleia2: -> #openstack-meeting in case you forgot (TripleO) | 20:14 |
| jog0 | thats all I know | 20:14 |
| pleia2 | SpamapS: right, thanks | 20:14 |
| sdague | so I know how we've created, but we're off in crazy land doing bad things to devstack | 20:15 |
| sdague | mordred: so, fyi, this is the diff of all the projects after the gr update - http://paste.openstack.org/show/42484/ | 20:16 |
| mordred | sdague: AH -crappit. there's a special case we need to do... | 20:17 |
| *** mgagne1 has quit IRC | 20:17 | |
| *** mgagne has joined #openstack-infra | 20:17 | |
| *** mgagne has quit IRC | 20:17 | |
| *** mgagne has joined #openstack-infra | 20:17 | |
| mordred | sdague: OR - we need to limit this just to requirements.txt and ignore test-requirements.txt for now | 20:18 |
| mordred | sdague: otherwise, hacking is going to screw people | 20:18 |
| sdague | actually - http://paste.openstack.org/show/42485/ | 20:19 |
| sdague | mordred: we don't run hacking on devstack-gate nodes for now | 20:19 |
| sdague | the second one is easier to read | 20:20 |
| mordred | sdague: yah - I meant for auto-patch submission | 20:20 |
| sdague | oh, yeh | 20:20 |
| mordred | sdague: I think we may need to start with just syncing requirements.txt | 20:20 |
| sdague | well, if we solve the devstack gate, it's one step closer | 20:20 |
| mordred | yah | 20:20 |
| clarkb | ok back from lunch | 20:21 |
| openstackgerrit | Monty Taylor proposed a change to openstack/requirements: Remove d2to1 from list https://review.openstack.org/39144 | 20:22 |
| sdague | and I think your only issue there is oslo | 20:22 |
| mordred | sdague: btw ^^ - your diff reminded me of that | 20:22 |
| openstackgerrit | Chris Jones proposed a change to openstack-infra/gitdm: Add cmsj@tenshu.net to the HP group. https://review.openstack.org/39146 | 20:27 |
| mordred | dhellmann: I think we're good to release a new pbr which should unscrew virtualenvwrappers yeah? | 20:28 |
| *** pabelanger has joined #openstack-infra | 20:30 | |
| jeblair | mordred, clarkb, fungi: i just sent email to openstack-dev nominating 4 new jjb reviewers | 20:31 |
| * fungi skips ahead in his e-mail | 20:31 | |
| * clarkb reads | 20:31 | |
| *** w_ is now known as olaph | 20:32 | |
| jeblair | (one of whom i believe is on vacation) | 20:32 |
| openstackgerrit | A change was merged to openstack-infra/gitdm: Add cmsj@tenshu.net to the HP group. https://review.openstack.org/39146 | 20:32 |
| clarkb | looks like I haven't gotten it yet | 20:32 |
| jeblair | well, i did _just_ send it. :) | 20:32 |
| *** russellb has quit IRC | 20:35 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/reviewstats: Use current username as default https://review.openstack.org/39150 | 20:36 |
| jeblair | (^ related :) | 20:36 |
| openstackgerrit | Elizabeth Krumbach Joseph proposed a change to openstack-infra/config: Add gcc package dependency to jeepyb module https://review.openstack.org/39151 | 20:36 |
| *** thingee_ is now known as thingee | 20:37 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/gear: Use deques instead of lists for gear job queues. https://review.openstack.org/39152 | 20:37 |
| clarkb | jeblair: ^ completely untested | 20:37 |
| *** russellb has joined #openstack-infra | 20:39 | |
| *** ladquin has quit IRC | 20:39 | |
| jeblair | clarkb: neat :) | 20:39 |
| *** dkliban has joined #openstack-infra | 20:41 | |
| fungi | i've not played with those yet. nifty! | 20:41 |
| reed | do you guys think we can disable the OpenStack list on launchpad? will it keep the archives if deactivated? | 20:41 |
| clarkb | jeblair: fungi: the underlying deque implementation is a double linked list rather than the dynamic sized arrays used for list() | 20:41 |
| jeblair | clarkb: okay, i'll test it for you if you can help me with something: | 20:42 |
| clarkb | jeblair: fungi: that makes it really fast for operating on the ends and memory use should be proportional to the number of elements | 20:42 |
| clarkb | jeblair: sure | 20:42 |
| jeblair | clarkb: i would like to run testr not in a virtualenv. that is not covered by Zuul's TESTING file. | 20:42 |
| fungi | clarkb: some bits of deque are python 2.7 only (maxlen, reverse, count) | 20:42 |
| fungi | clarkb: though i doubt we're targeting 2.6 at all | 20:43 |
| clarkb | fungi: thats fine, we aren't using them atm | 20:43 |
| clarkb | jeblair: do you want me to test and document that process? | 20:43 |
| fungi | even better | 20:43 |
| clarkb | jeblair: I can do that | 20:43 |
| jeblair | clarkb: sure | 20:43 |
| jeblair | clarkb: it's the only way i've ever tested gear -- 'python setup.py develop' it and then run zuul's unit tests outside of a venv. but then zuul moved to testr and i don't know how to do that. | 20:44 |
| clarkb | jeblair: is the not in virtualenv impotant? or do we just need direct testr running incantions | 20:44 |
| jeblair | running the command in tox.ini does not work. | 20:44 |
| clarkb | jeblair: I see | 20:44 |
| jeblair | clarkb: another way of asking my question is "why does 'python setup.py testr' not work outside of a venv?" | 20:45 |
| clarkb | jeblair: can you source .tox/py27/bin/activate for zuul, cd to gear, python setup.py develop, then testr run --parallel back in the zuul dir? | 20:45 |
| jeblair | clarkb: (since that's what tox is supposed to be running) | 20:45 |
| jeblair | clarkb: i could probably do that. | 20:45 |
| mordred | it sohuld work | 20:45 |
| jeblair | mordred: http://paste.openstack.org/show/42498/ | 20:46 |
| mordred | jeblair: do you have pbr and testrepository both installed outside of your venv? | 20:46 |
| clarkb | jeblair: and if you do they will need to be new versions | 20:46 |
| mordred | jeblair: pbr is the thing that provides the testr command now | 20:46 |
| mordred | jeblair: also- you can just run "testr run --parallel" which is what I do | 20:47 |
| jeblair | that is likely the problem. | 20:47 |
| jeblair | mordred: oh, yeah, that just kept saying AttributeError: 'module' object has no attribute 'StringStream' | 20:47 |
| jeblair | over and over | 20:47 |
| mordred | because that way you're actually using testr ui and stuff | 20:47 |
| mordred | NICE | 20:47 |
| jeblair | clarkb: i will try to muddle through the venv. | 20:47 |
| clarkb | jeblair: ok, let me know how that goes | 20:48 |
| *** bnemec has quit IRC | 20:48 | |
| mordred | jeblair: and honestly, just fixing whatever's weird with your system testrepository install would potentially give you happy making in the actually using testr directly | 20:49 |
| *** bnemec has joined #openstack-infra | 20:50 | |
| jeblair | mordred, clarkb: http://paste.openstack.org/show/42500/ | 20:50 |
| mordred | jeblair: the setup.py testr command's main feature is that it runs testr init in a directory for you if there is not .testrepository dir there - which when we put the shell commands in to tox.ini for that got awkward with warnings about commands not in venvs | 20:50 |
| mordred | jeblair: that's completely expected | 20:51 |
| mordred | jeblair: you have not installed any of the test-requirements.txt files | 20:51 |
| jeblair | i see. why doesn't 'develop' do that? | 20:51 |
| mordred | because setuptools' develop does not install the contents of tests_require | 20:52 |
| *** amotoki has joined #openstack-infra | 20:52 | |
| clarkb | wait what | 20:52 |
| mordred | although, now that you bring it up - it might be a nice feature to add | 20:52 |
| mordred | I'd need to think about it for a long time | 20:52 |
| clarkb | that seems broken | 20:52 |
| mordred | nope | 20:52 |
| mordred | or, maybe, but that's how it works | 20:52 |
| reed | looks like we can deactivate the old General mailing list on launchpad | 20:52 |
| mordred | the only setuptools command that installs the contents of tests_require | 20:53 |
| mordred | is python setup.py test | 20:53 |
| mordred | which itself _should_ work now in latest pbr | 20:53 |
| reed | anybody objects with me deactivating it? | 20:53 |
| mordred | reed: do it | 20:53 |
| * reed do it | 20:53 | |
| jeblair | mordred: i assumed it would work because i thought: "install is to installation requirements as develop is to development requirements" | 20:53 |
| *** bnemec has quit IRC | 20:54 | |
| jeblair | just giving new-user feedback here. :) | 20:54 |
| mordred | jeblair: yes. I believe that that makes perfect sense. sadly, sense doesn't come into the picture here nearly as often :) | 20:54 |
| *** SergeyLukjanov has quit IRC | 20:54 | |
| mordred | jeblair: amazingly enough - this isn't even a pbr thing - although I'm totally going to put your feature request on the TDL | 20:54 |
| mordred | jeblair: because I agree with you | 20:54 |
| fungi | reed: does that preserve the archive (or did we import a copy of the old archive too)? | 20:54 |
| reed | fungi, too late | 20:54 |
| reed | the archives are preserved | 20:55 |
| fungi | excellent | 20:55 |
| reed | we haven't imported them yet | 20:55 |
| jeblair | reed: there may be new user (getting started?) directions in the wiki that say join the lp group | 20:55 |
| *** bnemec has joined #openstack-infra | 20:55 | |
| reed | jeblair, ttx edited that yesterday | 20:56 |
| jeblair | reed: awesome. i'm behind, but still trying to be helpful. :) | 20:56 |
| *** nati_uen_ has quit IRC | 20:56 | |
| reed | I and Tom are going through the wiki, the man pages in search of references to lists.launchpa.net | 20:56 |
| jeblair | mordred: http://paste.openstack.org/show/42501/ | 20:57 |
| jeblair | (that's after 'pip install -r test-requirements.txt) | 20:58 |
| *** nati_uen_ has joined #openstack-infra | 20:58 | |
| mordred | jeblair: and this is in a fresh vm? | 20:58 |
| mordred | venv? | 20:58 |
| jeblair | yes | 20:58 |
| jeblair | (after the 2 develop commands from earlier) | 20:58 |
| jeblair | 'python setup.py testr' seems to work | 20:59 |
| reed | https://lists.launchpad.net/openstack/ still there | 21:01 |
| anteaya | is there a page that allows me to see the current open meeting slots for -meeting and -meeting-alt? | 21:01 |
| *** vipul is now known as vipul-away | 21:01 | |
| anteaya | I am here: https://wiki.openstack.org/wiki/Meetings | 21:01 |
| jeblair | clarkb: 'python setup.py testr' says: FAILED (id=238, failures=14 (+14)) | 21:01 |
| jeblair | clarkb: how do i find out which 14 tests failed? | 21:01 |
| clarkb | jeblair: above that it should've spat out the exceptions for each of the failing tests | 21:03 |
| clarkb | jeblair: you can also run `testr last` to have it spit out that info again | 21:03 |
| clarkb | jeblair: you can also open .testrepository/238 and look in the subunit directly | 21:03 |
| jeblair | clarkb: it spat out the logs, so the exceptions are burieed in thousands of lines of logs | 21:03 |
| clarkb | jeblair: `testr failing` | 21:04 |
| clarkb | jeblair: the --list option to that command may be useful | 21:04 |
| jeblair | clarkb: same thing. i can see the last one, so i guess i can look at it one at a time and work backwards. | 21:04 |
| jeblair | clarkb: that's it, thanks. | 21:04 |
| *** vipul-away is now known as vipul | 21:05 | |
| jgriffith | sdague: Just noticed something interesting maybe you have some insight... | 21:08 |
| jgriffith | sdague: got a minute? | 21:08 |
| clarkb | Ryan_Lane: can you create the NOTES file that I mention in the new wiki documentation when you get a chance? | 21:12 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Use the public gear API to iterate over jobs in the queue https://review.openstack.org/39159 | 21:12 |
| jeblair | clarkb: ^ with that change in place, zuul tests pass using your gear change | 21:12 |
| clarkb | cool | 21:12 |
| clarkb | jeblair: the other thing we should test before merging my change is whether or not adding 500k jobs of semi substantial size then removing all of them causing the memory use to shrink | 21:13 |
| clarkb | and compare that against the list implementation | 21:13 |
| jeblair | clarkb: +1 | 21:14 |
| jeblair | clarkb: i'll leave that for you, if that's ok | 21:14 |
| clarkb | jeblair: ya thats fine | 21:14 |
| clarkb | I will wip the change | 21:14 |
| * reed ranting: BI is hard...hard...hard | 21:15 | |
| jeblair | the zuul change should be safe to merge before then, as the getQueue method returns a copy of the queue(s) regardless | 21:15 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: enable access for openstack-ci-core https://review.openstack.org/39160 | 21:15 |
| clarkb | jeblair: I WIPed it. Will work on modeling the resource usage | 21:16 |
| *** woodspa has quit IRC | 21:18 | |
| *** mindjive1 has joined #openstack-infra | 21:18 | |
| *** gaelL has quit IRC | 21:18 | |
| *** mindjiver has quit IRC | 21:19 | |
| *** gaelL has joined #openstack-infra | 21:20 | |
| dhellmann | mordred: yes, please, for a pbr release | 21:21 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Stats: break out job runtimes and counts by result https://review.openstack.org/38942 | 21:24 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Pass the Job to the parameter function https://review.openstack.org/39130 | 21:25 |
| clarkb | asking a gearman client to submit 300k jobs in a tight look takes some time >_> | 21:26 |
| clarkb | s/look/loop/ | 21:27 |
| jgriffith | dkranz: ping | 21:27 |
| jeblair | clarkb: the gearman client is probably going to use ram in a similar way; it maintains a list of associated jobs, so it may need a similar change (can be separate from the server change) | 21:28 |
| clarkb | jeblair: ok | 21:29 |
| clarkb | my poor laptop is having a fun time blasting all this info over lo right now | 21:30 |
| jeblair | clarkb: (to a lesser extent, so do the workers, but that's scaling to "number of jobs running" not "number of jobs queueing" which is what you're focusing on) | 21:30 |
| jeblair | clarkb: (ditto for the server's list of running jobs) | 21:31 |
| clarkb | yeah running jobs I am not too worried about | 21:31 |
| jeblair | yeah, just mentioning it for completeness. | 21:31 |
| *** sandywalsh has quit IRC | 21:31 | |
| clarkb | it would be cool to have several hundred thousand workers | 21:32 |
| clarkb | we should build a botnet | 21:32 |
| jeblair | heh | 21:32 |
| dkranz | jgriffith: pong | 21:32 |
| jgriffith | dkranz: about https://bugs.launchpad.net/tempest/+bug/1202254 | 21:35 |
| uvirtbot | Launchpad bug 1202254 in cinder "Flakey test: VolumesActionsTest" [High,Confirmed] | 21:35 |
| jgriffith | dkranz: I haven't gotten to root cause of what's failed but I see what's going on | 21:35 |
| dkranz | jgriffith: OK | 21:35 |
| jgriffith | dkranz: we only handle a limited set of cases for delete | 21:35 |
| jgriffith | dkranz: something fails and when teardown tries to delete we hit the unhandled exception | 21:36 |
| jgriffith | dkranz: I'm patching cinder to give more info here (exactly what the state is) | 21:36 |
| dkranz | jgriffith: Sounds good | 21:36 |
| jgriffith | dkranz: and then I'll have a patch for tempest to catch this and handle it better | 21:36 |
| dkranz | jgriffith: Looking forward to it. Let me know if I can help. | 21:37 |
| jgriffith | dkranz: thx | 21:37 |
| *** ^demon has quit IRC | 21:37 | |
| *** ^demon has joined #openstack-infra | 21:38 | |
| *** ^demon has joined #openstack-infra | 21:38 | |
| Ryan_Lane | clarkb: will do | 21:38 |
| *** bnemec has quit IRC | 21:40 | |
| * fungi will be back after he gets some food in him | 21:40 | |
| *** bnemec has joined #openstack-infra | 21:41 | |
| *** mrodden has quit IRC | 21:42 | |
| *** dina_belova has quit IRC | 21:44 | |
| *** sandywalsh has joined #openstack-infra | 21:44 | |
| *** dkranz has quit IRC | 21:44 | |
| *** cp16net is now known as cp16net|away | 21:46 | |
| *** cp16net|away is now known as cp16net | 21:47 | |
| jeblair | mordred: ping | 21:50 |
| mordred | jeblair: pong | 21:50 |
| jeblair | mordred: we have spoken about adding support for multiple triggers to zuul. do you have code? | 21:50 |
| * mordred has blurred vision from all of his phone calls | 21:50 | |
| mordred | jeblair: not that works | 21:50 |
| jeblair | mordred: i may do some work in that direction in order to support timed jobs | 21:51 |
| mordred | jeblair: I can pastebin what I have so far - but it's probably not _that_ interesting | 21:51 |
| jeblair | mordred: if it's easy, i'll take a look. i'm happy to build on what you have, or just implement in the direction we discussed otherwise. | 21:52 |
| mordred | jeblair: http://paste.openstack.org/show/42510 | 21:52 |
| mordred | that's what I had so far | 21:52 |
| mordred | jeblair: but I think that's about when I realized I'd need to do something with extending the config, and then the weekend was over | 21:53 |
| mordred | jeblair: so feel free to either use or ignore | 21:53 |
| jeblair | mordred: cool, i'll incorporate that. | 21:53 |
| clarkb | jeblair: does it make sense to have a submit job utility for zuul (like the existing one) that you can simply put in cron? | 21:59 |
| *** hub_cap has joined #openstack-infra | 21:59 | |
| jog0 | have a mailman question | 21:59 |
| hub_cap | hey what OS are the slaves that you spin up for tox runs? /me thinks they are rpm based? | 21:59 |
| jog0 | is there a shorter URL for http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ? | 21:59 |
| jog0 | as that seems a little long for something we want to put in docs | 21:59 |
| *** nati_ueno has quit IRC | 22:00 | |
| clarkb | hub_cap: for everything but python26 jobs it is ubuntu precise. for python26 jobs it is CentOS 6.4 | 22:00 |
| jeblair | clarkb: jog0 not that i'm aware of | 22:00 |
| jeblair | gah | 22:00 |
| jeblair | jog0: not that i'm aware of | 22:00 |
| hub_cap | Ah ok its py26 thats a'failin for me | 22:00 |
| hub_cap | thx clarkb <3 | 22:00 |
| jeblair | clarkb: i don't really want to configure the periodic jobs that way. seems pretty hackish. | 22:00 |
| *** rnirmal has quit IRC | 22:01 | |
| jeblair | clarkb: (and it won't solve the logstash issue) | 22:01 |
| clarkb | jeblair: hmm good point | 22:01 |
| clarkb | actually the submitting job could have a LOG_PATH | 22:02 |
| clarkb | I bring it up because using the gear queue in that way makes me happy. Sure zuul can do the magic for you but one of the nice things about gearman is you don't need much magic | 22:02 |
| jeblair | clarkb: what would the log path be? | 22:03 |
| clarkb | /periodic/job_name/$TIMESTAMP or you could generate a UUID to be consistent with the non periodic jobs | 22:04 |
| jog0 | jeblair: thanks | 22:04 |
| *** vipul is now known as vipul-away | 22:04 | |
| jeblair | clarkb: do you feel that timed triggers don't belong in zuul? | 22:05 |
| jeblair | i think it makes a lot of sense to be able to describe all of the jobs that we run related to given projects in layout.yaml | 22:06 |
| clarkb | jeblair: I agree and having zuul support timed jobs so that all jobs are described in one place is a good thing | 22:06 |
| jeblair | i think asking people to edit that is much nicer than saying "oh, the periodic jobs? edit the crontab that gets installed on this host which triggers the jobs behind the scenes" | 22:07 |
| *** pentameter has quit IRC | 22:07 | |
| clarkb | jeblair: but until that feature is added zuul has been a gerrit event based system. So scope is expanding | 22:07 |
| jeblair | clarkb: if i don't have working code by the end of today, i'll do your idea. :) | 22:08 |
| *** burt has quit IRC | 22:08 | |
| *** vipul-away is now known as vipul | 22:08 | |
| jeblair | (at least, a first cut) | 22:08 |
| *** woodspa has joined #openstack-infra | 22:15 | |
| *** _TheDodd_ has quit IRC | 22:16 | |
| *** rfolco has quit IRC | 22:17 | |
| *** zehicle has quit IRC | 22:23 | |
| *** derekh has quit IRC | 22:24 | |
| reed | jeblair, I'm having trouble extracting only the new ATCs from the new list you sent me | 22:26 |
| jeblair | reed: 1 sec | 22:26 |
| jeblair | reed: i can get you a diff in about 15 mins | 22:28 |
| Alex_Gaynor | fungi: Does devstack-grenade not use the same devstack things? | 22:29 |
| jeblair | reed: and i'll add that to the list of things the automated job should do | 22:29 |
| *** vijendar has quit IRC | 22:29 | |
| reed | jeblair, cool, thanks | 22:30 |
| reed | one reason why I'm confused is that some ATCs have disappeared from the new list... but now that I think about it, it may be normal: their contribution is older than XX months today, wasn't older 1 month ago | 22:31 |
| reed | and some have just changed/added more emails to their identity | 22:32 |
| jeblair | reed: hrm, i don't think that should be the case because i didn't change the start date for the range | 22:32 |
| *** prad_ has quit IRC | 22:32 | |
| reed | uhm ... maybe my diff skills are bad and I'm not seeing something | 22:33 |
| jeblair | reed: 126 added, 17 removed | 22:33 |
| jeblair | reed: let me look at the removed and see why | 22:33 |
| jeblair | reed: (i know one off the top of my head -- a user rename, which is what i'm keying off of because it's the most stable thing in the diff) | 22:34 |
| *** gyee has joined #openstack-infra | 22:34 | |
| jeblair | (later, we should add the gerrit userid in there so it's more stable) | 22:34 |
| *** bnemec has quit IRC | 22:34 | |
| reed | what ids are those? launchpads? | 22:34 |
| jeblair | reed: gerrit username | 22:34 |
| reed | gotcha | 22:35 |
| *** bnemec has joined #openstack-infra | 22:35 | |
| *** rcleere has quit IRC | 22:35 | |
| *** w_ has joined #openstack-infra | 22:36 | |
| *** olaph has quit IRC | 22:38 | |
| jeblair | reed: i think i made an error running the script and missed a project; re-running. | 22:39 |
| *** krtaylor has quit IRC | 22:39 | |
| reed | jeblair, thanks | 22:39 |
| *** dina_belova has joined #openstack-infra | 22:44 | |
| *** bnemec has quit IRC | 22:45 | |
| *** bnemec has joined #openstack-infra | 22:46 | |
| *** lcheng has quit IRC | 22:46 | |
| *** lcheng has joined #openstack-infra | 22:47 | |
| *** esp has joined #openstack-infra | 22:49 | |
| *** dina_belova has quit IRC | 22:49 | |
| esp | hello folks we ran across an issue in trove land recently involving package versioning. | 22:49 |
| esp | ok for me to give details here? | 22:50 |
| clarkb | Alex_Gaynor: grenade uses devstack as a library but not as an executable | 22:50 |
| esp | https://github.com/openstack-dev/pbr/blob/master/pbr/packaging.py | 22:50 |
| clarkb | Alex_Gaynor: so the bits are the same but composed differently | 22:51 |
| clarkb | esp: yup, go for it | 22:51 |
| esp | clarkb: thx | 22:51 |
| Alex_Gaynor | clarkb: So earlier today we landed a thing so devstack installs libffi-dev, this doesn't seem to result in it being present in a devstack-grenade test run. Is tehre somethign else that neesd t obe edited? | 22:51 |
| esp | so in the packaging.py file above: _get_revno(git_dir): | 22:51 |
| esp | """Return the number of commits since the most recent tag. | 22:51 |
| clarkb | Alex_Gaynor: for that I am not sure, I would expect grenade to install dependencies using the devstack bits | 22:52 |
| esp | this creates a packager version like this: trove-2013.2.a5.ge9d559d | 22:52 |
| mordred | yes | 22:52 |
| clarkb | Alex_Gaynor: however that may be different because it is starting with grizzly devstack and going to master | 22:52 |
| mordred | that is correct | 22:52 |
| *** sarob has joined #openstack-infra | 22:53 | |
| esp | however the previous package version was: trove-2013.2.a716.<git tag> | 22:53 |
| mordred | right | 22:53 |
| mordred | well, no | 22:53 |
| mordred | the previous veroisn should have been trove-<git tag> | 22:53 |
| mordred | if there was a tag on the version | 22:54 |
| esp | k, but do you know where the a<number> comes from? | 22:54 |
| mordred | yes | 22:54 |
| *** dina_belova has joined #openstack-infra | 22:54 | |
| mordred | number of commits from most recent tag | 22:54 |
| mordred | this will not necessarily be monotonically increasing | 22:55 |
| mordred | because if you have an H2 tag in the middle of teh process, it will reset the commit count | 22:55 |
| *** datsun180b has quit IRC | 22:56 | |
| mordred | are you generating debs or rpms automatically from the tarball and you're having problems upgrading? | 22:56 |
| jeblair | reed: new total 879; 129 added, 1 removed (due to an account rename) | 22:56 |
| Alex_Gaynor | clarkb: hmm, do you have any idea who'd be a good person to speak with? | 22:56 |
| reed | jeblair, sounds good | 22:56 |
| clarkb | jeblair: I haven't been able to convince myself that the switch to deques helps anything. my test server isn't reclaiming memory either | 22:56 |
| esp | ah. so that's what happened, we must have set an H2 tag to mark a milestone or something | 22:56 |
| jeblair | reed: turns out we renamed reddwarf to trove since i last ran. | 22:56 |
| clarkb | Alex_Gaynor: dtroyer | 22:56 |
| mordred | esp: yes. that in fact most likely happened | 22:56 |
| hub_cap | sweet mordred that makes sense | 22:56 |
| mordred | esp: there is an env var you can set "PBR_VERSION" | 22:56 |
| mordred | which will override the version | 22:56 |
| esp | mordred: cool | 22:56 |
| mordred | so that if you're trying to do auto-upgrades from debs or something | 22:56 |
| mordred | you can make it be what you need it to be | 22:57 |
| hub_cap | PBR_VERSION=1billion | 22:57 |
| Alex_Gaynor | dtroyer: So we added a package to things to be installed in devstack by adding it to files/apt/swift; however it doesn't seem to be installed in the devstack-grenade builds. WHat do I need to do to make sure it's installed there as well | 22:57 |
| Alex_Gaynor | clarkb: thanks | 22:57 |
| esp | hub_cap: nice, was gonna set to 1.5 million | 22:57 |
| vipul | the recent package in tarballs.o.o is versioned as '.b2' how did it change to 'bXX' | 22:57 |
| mordred | esp, hub_cap: make sense? | 22:57 |
| hub_cap | aye mordred | 22:57 |
| *** emagana has quit IRC | 22:57 | |
| mordred | vipul: b2 was part of the tag | 22:57 |
| esp | mordred: yeah I think so. sounds like we just need to set the var to something more predictable. | 22:57 |
| vipul | ah ok | 22:57 |
| mordred | vipul: this is related to the very complex system of pre-release versioning we employ | 22:57 |
| mordred | which is versioning for a thing we aim to release that will be versioned 2013.2 | 22:58 |
| *** woodspa_ has joined #openstack-infra | 22:58 | |
| mordred | I promise, there are WAY more moving parts in there than you ever want to know about ... | 22:58 |
| * mordred head hurts | 22:58 | |
| vipul | i can imagine :) | 22:58 |
| esp | k, thx for the clarification everyone! | 22:59 |
| mordred | esp: sure thing! | 22:59 |
| *** dina_belova has quit IRC | 22:59 | |
| mordred | clarkb: also, once jeblair does the thing he does, we should also be able to make a github PR trigger | 22:59 |
| mordred | clarkb: which we can then use to run tests on pull requests to pip | 22:59 |
| * hub_cap is glad we dont need an explaination of mordred's moving parts | 22:59 | |
| mordred | clarkb: and inform them that they're about to break openstack | 22:59 |
| jeblair | reed: email sent. | 23:00 |
| reed | thanks | 23:00 |
| mordred | clarkb: so it is a scope increase - but I think gets us down the road of awesome | 23:01 |
| *** woodspa has quit IRC | 23:02 | |
| clarkb | mordred: cool | 23:02 |
| clarkb | fungi: jeepyb on review.o.o looks happy now. did you kick it? | 23:02 |
| *** emagana has joined #openstack-infra | 23:04 | |
| fungi | clarkb: i did not kick jeepyb on review.o.o but i did fix the puppet agent which had hung for a couple days | 23:05 |
| clarkb | we should consider restarting mysqlds http://www.ubuntu.com/usn/usn-1909-1/ | 23:05 |
| clarkb | fungi: wow I should've totally checked that | 23:05 |
| fungi | clarkb: had to do the same for lists.o.o and groups.o.o | 23:06 |
| fungi | clarkb: as well as a couple of precise slaves and a centos6 slave this morning | 23:06 |
| fungi | (various causes) | 23:06 |
| *** ladquin has joined #openstack-infra | 23:07 | |
| *** zehicle has joined #openstack-infra | 23:09 | |
| clarkb | fungi: so it looks like jeepyb's git repo updated after kicking puppet but to actually upgrade to a new version we need your puppet fix | 23:10 |
| fungi | clarkb: yes, that is consistent with my findings for the past several weeks | 23:10 |
| fungi | puppet agent updates via vcsrepo, but the install exec fails because of a broken pbr installed on the server | 23:11 |
| fungi | upgrading that pbr gets it out of the cycle | 23:11 |
| clarkb | mordred: jeblair https://review.openstack.org/#/c/38066/ can haz review? | 23:12 |
| *** bnemec has quit IRC | 23:12 | |
| fungi | getting it to upgrade pbr automagically as part of the install when a broken pbr is already in the lib path is what we were unable to find a good solution for | 23:12 |
| *** bnemec has joined #openstack-infra | 23:13 | |
| fungi | clarkb: jeblair: https://review.openstack.org/39133 lgtm. are we ready to merge that (i'll be around for at least another several hours to keep an eye on it) or do you want to wait? | 23:14 |
| jeblair | fungi: that won't work until the change to zuul is merged and zuul is restarted. and somehow that's missing a changed file. | 23:16 |
| jeblair | and no one has reviewed the change to zuul | 23:17 |
| * clarkb reviews | 23:17 | |
| jeblair | fungi: i'm terribly sorry, but i'm slightly confused by the puppet jeepyb pbr change | 23:18 |
| jeblair | fungi: i recall that we talked about it | 23:18 |
| jeblair | fungi: but i'm not clear on whether your change is intended to be permanent | 23:18 |
| *** pcrews has quit IRC | 23:18 | |
| *** emagana has quit IRC | 23:19 | |
| *** emagana has joined #openstack-infra | 23:20 | |
| *** nati_ueno has joined #openstack-infra | 23:20 | |
| fungi | jeblair: i don't think i have the wherewithall to figure out how to get pbr to cope with an already-installed broken version of itself. the theory we had about it being caused by a cached egg turned out to be false | 23:22 |
| jeblair | fungi: so here's the thing: i understand things are broken, and upgrading pbr fixes them. | 23:23 |
| mordred | jeblair: yes. we explored the other options since that discussion. at the moment, I believe we shoudl do this until further notice | 23:23 |
| clarkb | jeblair: if I approve https://review.openstack.org/#/c/38054/ does that conflict with any of your changes? | 23:23 |
| jeblair | fungi: in that case, i believe we should ssh into the affected hosts and upgrade pbr | 23:23 |
| mordred | oh - hrm. that's an interesting idea... | 23:23 |
| jeblair | but i'm not comfortable abandoning "python setup.py install" as an installation method. since we use it lots of places. | 23:24 |
| fungi | jeblair: i have no qualms with that. 1) i'll want to hunt for other servers where we potentially gotpbr into a simialr state and 2) this doesn't help other people (not us) who may have used out jeepyb puppet module | 23:24 |
| * mordred believes jeblair is right. the parse error is an error in a version of pbr that's been fixed | 23:24 | |
| * fungi is typing too fast again | 23:24 | |
| jeblair | clarkb: should be fine | 23:25 |
| *** mberwanger has joined #openstack-infra | 23:25 | |
| mordred | jeblair: I do not think we have to abandon that method - I think we got a bad version of a thing installed which prevented self upgrading | 23:25 |
| clarkb | jeblair: thanks | 23:25 |
| fungi | i was hoping to find an elegant solution to make the puppet module more robust against this (for the sake of others and the future) since pbr seems to have an odd chicken-and-egg usage there | 23:25 |
| jeblair | fungi: i don't want to paper over that kind of problem with pbr | 23:25 |
| jeblair | fungi: we should either help the pbr fix the problems, or stop using pbr for our tools. :) | 23:26 |
| fungi | but if we're okay with ignoring it and just upgrading pbr manually whenever this happens, it seems unfortunate but maybe not worth spinning our wheels on any longer | 23:26 |
| jeblair | mordred: i favor the first. :) | 23:26 |
| clarkb | jeblair: https://review.openstack.org/#/c/33204/ hasn't been merged because of this ... | 23:26 |
| mordred | I do not believe there is a way to fix _this_ problem in a seamless manner | 23:27 |
| jeblair | fungi: i'm okay with mordred fixing it whenever this happens, which hopefully will be never again. :) | 23:27 |
| mordred | I do not believe this is likely to be a type of problem that will come up frequently | 23:27 |
| mordred | exactly | 23:27 |
| mordred | oh! | 23:27 |
| * mordred read wrong | 23:27 | |
| mordred | I thought that jeblair meant "fix the problem in upstream pbr" by "help the pbr fix the problems" | 23:27 |
| fungi | fine by me. i'll abandon that change and just fix the gerrit servers in that case | 23:27 |
| * mordred goes back to writing a steady stream of emails | 23:28 | |
| fungi | though we exposed a similar problem with installing jeepyb via the puppet module on git.o.o which is also fixed by globally installing pbr | 23:28 |
| fungi | because python setup.py install in the jeepyb source tree does not globally install pbr | 23:28 |
| jeblair | mordred: i meant "help the pbr authors fix such problems". by which i more or less meant yell at mordred to fix pbr. | 23:28 |
| fungi | but jeepyb's entrypoints wrappers do not work without pbr in the lib path | 23:29 |
| jeblair | mordred: i also meant that if this happens again, i'm okay with you sshing into the servers and fixing them, seeing as how we were kind enough to let our servers tell us pbr was broken. | 23:29 |
| fungi | so that also seems like something which will need fixing in pbr if we're going to stop manually installing pbr as a dependency of the jeepyb puppet module | 23:29 |
| openstackgerrit | A change was merged to openstack-infra/zuul: Make E123 pep8 clean https://review.openstack.org/38054 | 23:29 |
| jeblair | fungi: that makes me sad as well. | 23:30 |
| jeblair | mordred: are you aware of that problem? | 23:30 |
| fungi | or possibly just fixing in jeepyb by making pbr a proper runtime dependency? | 23:30 |
| mordred | pbr should be a proper runtime depend, is it not in requirements.txt ? | 23:31 |
| fungi | nope | 23:31 |
| fungi | only setup_requires | 23:31 |
| mordred | oh. that is a bug | 23:31 |
| mordred | it should also be in requirements.txt | 23:32 |
| fungi | this might solve a number of issues in that case | 23:32 |
| fungi | i wonder if that could also be causing the issue with it not updating on the gerrit servers? | 23:32 |
| mordred | sorry - never thought to look/ask on that - still would not have fully helped in this case if there was a version which couldn't read the requirments.txt file ... | 23:32 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/jeepyb: PBR is a run-time dependency. https://review.openstack.org/39179 | 23:33 |
| *** bnemec has quit IRC | 23:33 | |
| fungi | we'll see how that goes. i'll try it out on review-dev shortly | 23:33 |
| *** bclifford has left #openstack-infra | 23:34 | |
| fungi | not getting my hopes up, but should at least solve pleia2's need on git.o.o | 23:34 |
| * fungi will brb | 23:34 | |
| reed | bbl | 23:39 |
| *** reed has quit IRC | 23:39 | |
| *** dhellmann is now known as dhellmann_ | 23:40 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-dev/hacking: Make H202 work again https://review.openstack.org/39180 | 23:40 |
| *** michchap has joined #openstack-infra | 23:42 | |
| pleia2 | https://etherpad.openstack.org/cibugreview-july2013 coming together for tomorrow | 23:49 |
| jeblair | mordred, clarkb: i have run "tox -epy27" | 23:51 |
| jeblair | mordred, clarkb: it hangs | 23:51 |
| jeblair | mordred, clarkb: do you know how i can try to find out which test is hanging? | 23:51 |
| mordred | yes | 23:51 |
| mordred | firstly, just to capture it: | 23:51 |
| mordred | python -m testtools.run tests.test_scheduler.TestScheduler.test_zuul_refs | 23:51 |
| mordred | will run that one test | 23:52 |
| jeblair | i don't know which test is hanging? | 23:52 |
| jeblair | i just know that at least one test out of all of them hangs | 23:52 |
| mordred | I know. that was just for the record from last time | 23:52 |
| mordred | python -m testtools.run discover | 23:52 |
| mordred | will run all of the tests in order and not do any log suppression | 23:52 |
| jeblair | mordred: the thing from last time is in TESTING.rst. thanks for confirming that though. | 23:53 |
| mordred | cool | 23:53 |
| mordred | just making sure | 23:53 |
| jeblair | mordred: ok, so how do i find out which test is hanging? | 23:53 |
| mordred | python -m testtools.run discover | 23:53 |
| jeblair | no i get that | 23:53 |
| jeblair | :) | 23:53 |
| mordred | should run all of the tests in order, printing out test names as it does | 23:53 |
| mordred | also | 23:53 |
| mordred | python -m testtools.run discover --list | 23:54 |
| mordred | will show you the list of tests | 23:54 |
| jeblair | mordred: what does the output where it prints test names look ilke? | 23:54 |
| jeblair | mordred: i redirected that to a file, and the very first line is a zuul log message. | 23:55 |
| *** dina_belova has joined #openstack-infra | 23:55 | |
| mordred | oh. my bad- one sec | 23:56 |
| jeblair | mordred: presumably "TestScheduler" should show up in that output if it printed a test name, but grepping for that fails | 23:56 |
| *** esp has left #openstack-infra | 23:56 | |
| jeblair | (the output is 15929 lines long) | 23:56 |
| mordred | try this: python -m subunit.run discover 2>1 | subunit2pyunit | 23:57 |
| mordred | jeblair: it _will_ supress logs, but you should see test names printing | 23:57 |
| jeblair | mordred: that seems to be working, thanks. | 23:58 |
| mordred | ossum! | 23:58 |
| * mordred has an open tdl to put a flag on to testr that will do the equiv | 23:58 | |
| mordred | jeblair: oh, and duh - slightly easier to type: 'testr run --subunit | subunit2pyunit' | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
