| *** achanda_ has joined #openstack-infra | 00:02 | |
| openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add non voting fuel agent python jobs https://review.openstack.org/204711 | 00:02 |
|---|---|---|
| *** flepied has quit IRC | 00:03 | |
| *** achanda has quit IRC | 00:05 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added ACL for ironic-webclient https://review.openstack.org/214381 | 00:05 |
| openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add new contrail-neutron-plugin project https://review.openstack.org/214389 | 00:06 |
| *** shashank_hegde has joined #openstack-infra | 00:06 | |
| *** geoffarnold has quit IRC | 00:06 | |
| *** asettle has joined #openstack-infra | 00:07 | |
| *** geoffarnold has joined #openstack-infra | 00:07 | |
| *** achanda_ has quit IRC | 00:07 | |
| *** regXboi has quit IRC | 00:11 | |
| *** geoffarnold has quit IRC | 00:11 | |
| greghaynes | jhesketh: replied on https://review.openstack.org/#/c/195175/ | 00:12 |
| *** sharikapongubala has quit IRC | 00:13 | |
| *** sergmelikyan has quit IRC | 00:13 | |
| *** tiswanso has joined #openstack-infra | 00:14 | |
| *** shashank_hegde has quit IRC | 00:16 | |
| *** sputnik13 has quit IRC | 00:16 | |
| *** mpopow has quit IRC | 00:17 | |
| *** esmute_ has quit IRC | 00:18 | |
| *** minwang2 has quit IRC | 00:20 | |
| *** minwang2 has joined #openstack-infra | 00:20 | |
| clarkb | mordred: http://logs.openstack.org/54/211754/4/check/gate-dsvm-nodepool-nv/958471b/logs/screen-nodepool.txt.gz#_2015-08-18_22_59_57_227 so Ithink we are broken too | 00:21 |
| clarkb | asselin_: ^ we didn't notice because neutron was otherwise broken | 00:21 |
| *** esmute_ has joined #openstack-infra | 00:21 | |
| clarkb | greghaynes: ^ need to install deboostrap | 00:21 |
| jeblair | booourns | 00:22 |
| clarkb | so many things | 00:22 |
| *** sergmelikyan has joined #openstack-infra | 00:22 | |
| greghaynes | clarkb: hrm | 00:22 |
| clarkb | but I think this shows it will be valuable to get voting asap | 00:22 |
| clarkb | greghaynes: I will update my patch to deboostrap | 00:22 |
| greghaynes | clarkb: ah, yep | 00:22 |
| *** esmute_ has quit IRC | 00:22 | |
| openstackgerrit | Michael Krotscheck proposed openstack/requirements: Updated oslo_middleware https://review.openstack.org/214394 | 00:23 |
| *** spzala has quit IRC | 00:24 | |
| asselin_ | clarkb, looks similar, but not entirely sure its the same bug... | 00:25 |
| *** tiswanso has quit IRC | 00:25 | |
| *** minwang2 has quit IRC | 00:25 | |
| clarkb | asselin_: pretty sure it is project id not found demo | 00:26 |
| clarkb | keystoneclient is just broken right now | 00:26 |
| *** sergmelikyan has quit IRC | 00:26 | |
| *** claudiub has quit IRC | 00:28 | |
| *** saurabhs has left #openstack-infra | 00:28 | |
| *** tsekiyam_ has joined #openstack-infra | 00:29 | |
| clarkb | greghaynes: what other packages will I need? | 00:30 |
| clarkb | ithink this is documented somewhere | 00:30 |
| greghaynes | clarkb: check out tests/install-deps in dib | 00:31 |
| clarkb | tahnks | 00:31 |
| *** mtanino has quit IRC | 00:31 | |
| clarkb | sdague: now can a devstack plugin provide package lists like the built in things? | 00:32 |
| clarkb | mtreinish: ^ | 00:32 |
| *** tsekiyama has quit IRC | 00:32 | |
| * clarkb uses the grep | 00:32 | |
| clarkb | sweet its documented even | 00:33 |
| openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add new contrail-neutron-plugin project https://review.openstack.org/214389 | 00:33 |
| *** shashank_hegde has joined #openstack-infra | 00:33 | |
| *** tsekiyam_ has quit IRC | 00:34 | |
| *** btully has quit IRC | 00:34 | |
| *** sridhar_ram has quit IRC | 00:34 | |
| *** salv-orl_ has quit IRC | 00:34 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Test dib image builds with devstack too. https://review.openstack.org/211754 | 00:36 |
| clarkb | greghaynes: ^ I think that should do it | 00:38 |
| clarkb | then once oscc/keystoneclient work again we can hopefully have everything working | 00:38 |
| mordred | clarkb: oh - so we are thinking that keystoneclient made a release which broke things/ | 00:38 |
| clarkb | mordred: :/ ok well its broken the nodepool dsvm job | 00:38 |
| jamielennox | ksc hasn't had a release in a while | 00:39 |
| clarkb | and I guess its likely that nodepool will break on the next restart | 00:39 |
| clarkb | so don't restart nodepool if you can avoid it :) | 00:39 |
| mordred | clarkb: I have an oscc patch up to make it stop treating id and name as interchangable | 00:39 |
| clarkb | mordred: that doesn't fix us | 00:39 |
| clarkb | mordred: because we use the wrong one | 00:39 |
| mordred | clarkb: once that's up, we'll want to make sure we use the correct thing (id or name) | 00:40 |
| mordred | like, in the places where we're passing a name into an id field - we should just stop doing that | 00:40 |
| mordred | even though it has worked in the past | 00:40 |
| clarkb | except I thought the whole point was they were interchangeable? | 00:40 |
| clarkb | now you are telling me they aren't | 00:40 |
| mordred | id and name? | 00:40 |
| clarkb | this is terrible | 00:40 |
| clarkb | yes! | 00:40 |
| clarkb | oscc explicitly said "make them all the same because they are the same" and there is that funky for loop tat does it | 00:41 |
| mordred | right. and I have a patch up to change that | 00:41 |
| mordred | beacuse it seems that is no longer true | 00:41 |
| clarkb | right I am saying you can't change that now | 00:41 |
| clarkb | the ship has sailed it must remain true | 00:41 |
| mordred | nope | 00:41 |
| mordred | it's changed | 00:41 |
| mordred | that ship has sailed | 00:41 |
| mordred | it doesn't work | 00:41 |
| clarkb | then this is a backward incompatible change | 00:41 |
| mordred | sure | 00:41 |
| SpamapS | awww snap | 00:41 |
| *** pcrews has joined #openstack-infra | 00:41 | |
| mordred | I dont' care | 00:41 |
| clarkb | I do | 00:41 |
| mordred | it's life and now we have to deal with it | 00:41 |
| clarkb | because we have non trivial softare that was relying on it | 00:41 |
| SpamapS | that ship has #failed | 00:42 |
| clarkb | and we need to stop doing that | 00:42 |
| mordred | I have no control over that | 00:42 |
| clarkb | every time we do this users that have no ties upstream get screwed | 00:42 |
| mordred | all I can do is manage what upstraem things break me | 00:42 |
| clarkb | its one thing to screw infra | 00:42 |
| *** sergmelikyan has joined #openstack-infra | 00:42 | |
| clarkb | yes I am saying we should go to upstream and say fix it | 00:42 |
| *** otter768 has joined #openstack-infra | 00:42 | |
| mordred | clarkb: sure- although I could see them telling us to get bent | 00:42 |
| SpamapS | mordred: is it possible you're just wounded on this level? | 00:43 |
| mordred | because they could take the position that we were relying on a bug behavior | 00:43 |
| clarkb | except the behavior was there and worked | 00:43 |
| clarkb | it doesn't matter if its a bug | 00:43 |
| clarkb | the api can't change that way | 00:43 |
| mordred | like, I would have a hard time saying with a straight face "zomg, you stopped accepting project names as parameters to the project id parameter" | 00:43 |
| clarkb | mordred: I can say it with a straight face | 00:44 |
| mordred | I think it was a mistake for us to have depended on that behavior - and it's obviously biting us now | 00:44 |
| clarkb | because now every config file and client consumer has to change | 00:44 |
| SpamapS | Was it documented as working, or just awesome that it was working? | 00:44 |
| mordred | our config files are actually correct, last I checked | 00:44 |
| clarkb | SpamapS: it doesn't matter | 00:44 |
| *** sergmelikyan has quit IRC | 00:44 | |
| SpamapS | clarkb: to you. But to developers, it often does. | 00:44 |
| SpamapS | Some developers aren't willing to maintain bug-for-bug backward compatibility. | 00:44 |
| asselin_ | I'm still confused as to where it gets it tenantId from. It seems to discover it from the url... _discover.Discover(session, url, | 00:44 |
| clarkb | mordred: iirc we explicitly changed all our config to the wrong thing | 00:45 |
| clarkb | mordred: because we were told the wrong thing was correct ... | 00:45 |
| SpamapS | But most are willing to support ambiguously documented behaviors. | 00:45 |
| clarkb | I double checked al lthat because it was insane | 00:45 |
| mordred | clarkb: no | 00:45 |
| mordred | you are wrong | 00:45 |
| mordred | our config file is correct | 00:45 |
| mordred | and is not aligned to the bad behavior | 00:45 |
| clarkb | then why ar ewe broken? | 00:45 |
| clarkb | our config file uses what oscc passes through | 00:45 |
| clarkb | so that its 1:1 | 00:45 |
| mordred | because occ is aligning something it does not need to | 00:45 |
| mordred | which we can fix very easily | 00:45 |
| mordred | so that our correct config file can not be broken by a thing occ was doing | 00:45 |
| mordred | it's a 2 line fi | 00:46 |
| *** Swami has quit IRC | 00:46 | |
| mordred | fix | 00:46 |
| *** dims has joined #openstack-infra | 00:46 | |
| clarkb | sure but we explicitly said what is oscc going to use? then used that too | 00:46 |
| clarkb | and you are telling me oscc is wrong | 00:46 |
| clarkb | that means our config is wrong | 00:46 |
| mordred | no - we did not say that | 00:46 |
| mordred | dude | 00:46 |
| mordred | look at the config | 00:46 |
| mordred | our config is correct | 00:46 |
| clarkb | I don't even know what is correct | 00:46 |
| mordred | also, shade consumes things correctly from occ | 00:46 |
| mordred | correct is saying what the thign is | 00:46 |
| clarkb | I am just going off my memory ofreviewing all this and saying wtf | 00:46 |
| mordred | right | 00:46 |
| clarkb | and being told its all fine and correct | 00:46 |
| mordred | I know | 00:46 |
| mordred | I just looked at everything | 00:46 |
| mordred | so you're responding to memories that you have | 00:46 |
| mordred | and I'm trying to tell you the actual situatino | 00:47 |
| clarkb | and what I was told is that we should use the same thing oscc uses | 00:47 |
| *** pcrews has quit IRC | 00:47 | |
| clarkb | which we did | 00:47 |
| jeblair | https://review.openstack.org/214398 | 00:47 |
| mordred | we ARE DOING TH?E RIGHT THING | 00:47 |
| jeblair | gave shade lightning talk ^ | 00:47 |
| clarkb | mordred: then how is it broken? | 00:47 |
| clarkb | I am really confused | 00:47 |
| jeblair | oh i hope no one just came in here because i told them how awesome oscc is :) | 00:47 |
| *** dims_ has quit IRC | 00:47 | |
| mordred | http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/nodepool/clouds.yaml.erb | 00:47 |
| clarkb | jeblair: well its currently broen | 00:47 |
| mordred | look at that | 00:47 |
| mordred | we have project_id for rackspace and project_name for hp | 00:48 |
| clarkb | mordred: I am not tlaking about clouds | 00:48 |
| mordred | because that's what those parameters need to be | 00:48 |
| clarkb | mordred: nodepool.yaml | 00:48 |
| mordred | right | 00:48 |
| *** glauco has joined #openstack-infra | 00:48 | |
| clarkb | also we use name and id | 00:48 |
| mordred | that's the ENTIRE REASON to move away from putting those things in that file | 00:48 |
| clarkb | so which is correct? | 00:48 |
| mordred | because the logic here is too hard to encode into nodepool.yaml | 00:48 |
| mordred | this is pretty much 100% of the reason to stop putting things in there directly | 00:48 |
| mordred | and the reason we stopped | 00:48 |
| clarkb | I am more confused now than I was before | 00:49 |
| clarkb | if we are using both then what is correct? | 00:49 |
| mordred | what is correct is passing ids to id params and names to name params | 00:49 |
| mordred | for hp, we have a project name | 00:49 |
| mordred | for rax we have a project id | 00:49 |
| mordred | that's what we get from the cloud vendor | 00:49 |
| clarkb | ok so you are saying that nodepool is wrong | 00:49 |
| mordred | yes | 00:49 |
| *** baoli has joined #openstack-infra | 00:49 | |
| clarkb | because nodepool needs to accept both | 00:49 |
| clarkb | now I am less ocnfused because that is what I have been dsaying over and over ... | 00:50 |
| clarkb | nodepool is wrong | 00:50 |
| mordred | right. but fixing that is silly because people should just use clouds.yaml | 00:50 |
| mordred | sorry | 00:50 |
| mordred | i thought you were saying clouds.yaml is wrong | 00:50 |
| mordred | yes | 00:50 |
| mordred | nodepool is doing the wrong thing | 00:50 |
| clarkb | no nodepool I don't care about clouds.yaml becaus ewe can't actually use it in devstack yet | 00:50 |
| mordred | why can't we use it in devstack yet? | 00:50 |
| *** sharikapongubala has joined #openstack-infra | 00:50 | |
| mordred | there is already a clouds.yaml in devstack | 00:50 |
| mordred | we can just use ut | 00:50 |
| mordred | it | 00:51 |
| mordred | we use it in the shade functional tests | 00:51 |
| mordred | works great | 00:51 |
| clarkb | because devstack is broekn | 00:51 |
| clarkb | doesnt start services with correct homedir I think | 00:51 |
| clarkb | and only sets clouds.yaml in the stack user homedur | 00:51 |
| mordred | we fixed that in shade | 00:51 |
| clarkb | you cannot just use it my change to do that failed | 00:51 |
| mordred | it just needs a file copy | 00:51 |
| *** vahidh has quit IRC | 00:51 | |
| clarkb | mordred yes but shade isnt a devstack plugin | 00:51 |
| *** smccully has joined #openstack-infra | 00:51 | |
| *** zz_dimtruck is now known as dimtruck | 00:52 | |
| *** sergmelikyan has joined #openstack-infra | 00:52 | |
| *** tiswanso has joined #openstack-infra | 00:52 | |
| mordred | https://review.openstack.org/#/c/212083/ | 00:52 |
| mordred | yes it is | 00:52 |
| mordred | oh - no it isn't | 00:52 |
| mordred | bother | 00:52 |
| clarkb | no it isnt... | 00:52 |
| mordred | well, listen. I do not think adding project_name support to nodepool because devstack is broken is the right choice | 00:52 |
| mordred | I think that fixixng the devstack test is the right thing | 00:53 |
| clarkb | so I need to fix devstack whih us way harder than just copying a file | 00:53 |
| *** sergmelikyan has quit IRC | 00:53 | |
| clarkb | partially because the devstack reviewers are all afk right now | 00:53 |
| *** serg_melikyan has joined #openstack-infra | 00:53 | |
| *** serg_melikyan has quit IRC | 00:53 | |
| *** gildub has joined #openstack-infra | 00:53 | |
| *** baoli has quit IRC | 00:54 | |
| *** tiswanso has quit IRC | 00:54 | |
| mordred | listen - I'm not going to write or support adding project-name as an option to nodepool, because I think it's 100% the wrong thign to do and we should just be using clouds.yaml | 00:54 |
| mordred | however | 00:54 |
| mordred | I will not -2 it | 00:54 |
| clarkb | we need a 3.0 nodepool release then | 00:54 |
| *** tiswanso has joined #openstack-infra | 00:54 | |
| greghaynes | clarkb: 3.0? | 00:54 |
| *** glauco has quit IRC | 00:54 | |
| clarkb | because nodepool cannot openstack that way anymore | 00:55 |
| clarkb | so should remoce the feature abd 3.0 | 00:55 |
| mordred | I'm fine with that | 00:55 |
| *** gildub has quit IRC | 00:55 | |
| *** gyee has quit IRC | 00:55 | |
| mordred | but ... sigh. fine. I'll add project-name | 00:56 |
| *** dims has quit IRC | 00:56 | |
| mordred | to nodepool | 00:56 |
| *** dims has joined #openstack-infra | 00:56 | |
| clarkb | and we do need an oscc release before next nodepool restart to ve safe ya? | 00:57 |
| mordred | yes | 00:57 |
| clarkb | otherwise id==name and we could break | 00:57 |
| *** pvaneck has quit IRC | 00:57 | |
| mordred | yah | 00:57 |
| mordred | I would LOVE to know why this all of a sudden stopped working, btw | 00:58 |
| clarkb | me too | 00:58 |
| clarkb | my guess is keystone change that was backported | 00:58 |
| asselin_ | me3 | 00:58 |
| clarkb | or client change that soans both! | 00:58 |
| clarkb | er ? | 00:58 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Add support for project-name parameter https://review.openstack.org/214399 | 00:59 |
| mordred | clarkb: ^^ check me on that | 01:00 |
| clarkb | er nodepool may not have 2.0 release dunno why I thought it did but this is major change either way | 01:00 |
| clarkb | mordred update the devstack/plugin.sh config too in order to test it works once oscc is hapoy | 01:01 |
| *** camunoz has quit IRC | 01:01 | |
| mordred | clarkb: you know - we coudl just write a clouds.yaml in the devstack plugin | 01:02 |
| mordred | rather than caring about the one that devstack writes | 01:02 |
| *** thorst has quit IRC | 01:02 | |
| clarkb | we'd have to make it global I think | 01:03 |
| clarkb | as determining the wrapper homedir may get hairy | 01:03 |
| clarkb | and we may not have perms to read there once nodepool starts | 01:04 |
| clarkb | such fun | 01:04 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Add support for project-name parameter https://review.openstack.org/214399 | 01:05 |
| *** pahuang has quit IRC | 01:05 | |
| *** sflanigan has quit IRC | 01:06 | |
| *** darrenc is now known as darrenc_afk | 01:07 | |
| *** zhenguo has joined #openstack-infra | 01:09 | |
| clarkb | mordred we might also cobsider an explicit flag to set clouds.yaml path for nodepool | 01:09 |
| *** SumitNaiksatam has joined #openstack-infra | 01:09 | |
| clarkb | pretty sure that isnt a thing yet but would be simple to do Ithink | 01:09 |
| *** thcipriani is now known as thcipriani|afk | 01:09 | |
| mordred | clarkb: yah. I could see that | 01:09 |
| *** SumitNaiksatam has left #openstack-infra | 01:09 | |
| mordred | clarkb: occ supports passing in a path - so it should be simple from nodepool side | 01:09 |
| asselin_ | mordred, that patch works in my setup | 01:10 |
| *** jswarren has quit IRC | 01:10 | |
| mordred | asselin_: woot! | 01:10 |
| mordred | asselin_: that's great news | 01:10 |
| mordred | asselin_: (you un-patched keystoneclient, yeah?) | 01:10 |
| *** jswarren has joined #openstack-infra | 01:10 | |
| *** bpokorny has quit IRC | 01:10 | |
| asselin_ | mordred, yes! it's much simpler. Yes, I had to...my patched version fails with the nodepool change | 01:11 |
| *** sthillma has quit IRC | 01:11 | |
| asselin_ | so I will use this as the workaround until something else lands. thank you | 01:12 |
| chen12 | ping Andreas Jaeger | 01:13 |
| mordred | clarkb, asselin_: ok, I fixed the unittests for it: https://review.openstack.org/#/c/214382 | 01:14 |
| mordred | Shrews: ^^ if you have a sec | 01:14 |
| *** pfallenop has quit IRC | 01:14 | |
| clarkb | chen12 andreas is in europe so likely wont respond for another 6 hours or so | 01:14 |
| *** puranamr has quit IRC | 01:14 | |
| chen12 | clarkb, ok. thanks! | 01:14 |
| *** pfallenop has joined #openstack-infra | 01:15 | |
| *** pfallenop has joined #openstack-infra | 01:15 | |
| asselin_ | mordred, fyi, i'm not using os-client-config | 01:15 |
| chen12 | clarkb, what is his irc name ? | 01:15 |
| *** alexsyip has quit IRC | 01:15 | |
| *** puranamr has joined #openstack-infra | 01:15 | |
| *** cbader has joined #openstack-infra | 01:15 | |
| *** Yanyanhu has joined #openstack-infra | 01:15 | |
| *** hdd has joined #openstack-infra | 01:16 | |
| clarkb | AJaeger is his irc nick | 01:16 |
| chen12 | any core here ? Need review for https://review.openstack.org/#/c/213010/ | 01:16 |
| *** FallenPegasus has quit IRC | 01:16 | |
| chen12 | clarkb, thanks! | 01:16 |
| *** sergmelikyan has joined #openstack-infra | 01:17 | |
| *** sergmelikyan has quit IRC | 01:17 | |
| *** yamamoto has joined #openstack-infra | 01:18 | |
| *** camunoz has joined #openstack-infra | 01:18 | |
| *** sflanigan has joined #openstack-infra | 01:18 | |
| *** asselin__ has joined #openstack-infra | 01:20 | |
| mordred | asselin_: oh - wait - which patch were you talking about? the project-name patch? | 01:20 |
| mordred | awesome | 01:20 |
| *** darrenc_afk is now known as darrenc | 01:21 | |
| *** asselin has quit IRC | 01:22 | |
| asselin_ | mordred, yes, nodepool project-name patch works w/ everything else as released/merged (using my updated nodepool.yaml of course) | 01:22 |
| *** pahuang has joined #openstack-infra | 01:22 | |
| *** Yanyan has joined #openstack-infra | 01:22 | |
| mordred | sweet | 01:22 |
| asselin_ | mordred, will set it up to run in a cleaner env now to be sure | 01:22 |
| *** gildub has joined #openstack-infra | 01:23 | |
| *** sergmelikyan has joined #openstack-infra | 01:23 | |
| *** julim has joined #openstack-infra | 01:24 | |
| *** asselin__ has quit IRC | 01:25 | |
| *** Yanyanhu has quit IRC | 01:25 | |
| *** cbader has quit IRC | 01:25 | |
| *** chen12 has quit IRC | 01:28 | |
| *** tjones has quit IRC | 01:29 | |
| *** yamamoto has quit IRC | 01:30 | |
| *** regXboi has joined #openstack-infra | 01:30 | |
| *** chen12 has joined #openstack-infra | 01:31 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Allow for passing in a clouds.yaml path https://review.openstack.org/214407 | 01:32 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Add a doc section mentioning named clouds https://review.openstack.org/214408 | 01:32 |
| mordred | clarkb: ^^ there's a patch that adds support for passing in a clouds.yaml path - and an update to the devstack plugin to write a clouds.yaml and use it | 01:33 |
| *** tjones has joined #openstack-infra | 01:35 | |
| *** sergmelikyan has quit IRC | 01:36 | |
| mordred | also - fungi, clarkb, jeblair, jhesketh: https://review.openstack.org/#/c/214399 fixes things for asselin_ | 01:37 |
| clarkb | mordred 214407 plugin should pass that path as an arg when starting nodepool | 01:37 |
| mordred | clarkb: I added it to the nodepool.yaml | 01:38 |
| clarkb | oh I see | 01:38 |
| clarkb | its config not arg | 01:38 |
| mordred | yah. I could do arg instead if you think that's better? | 01:38 |
| clarkb | nah that works | 01:38 |
| clarkb | then its one config file command line arg | 01:38 |
| clarkb | do we expect that change to work as is? or does oscc need to release too? | 01:39 |
| jhesketh | mordred: will look | 01:39 |
| * regXboi wanders back in :) | 01:39 | |
| mordred | clarkb: I believe we'll need an oscc release | 01:40 |
| * asselin_ goes to dinner | 01:40 | |
| shashank_hegde | Hi… looks like devstack was broken if it was run on a server without setuptools. I have proposed a fix - https://review.openstack.org/#/c/214409/ | 01:40 |
| shashank_hegde | Can someone please take a look? | 01:40 |
| asselin_ | thanks for your help. my system is upand running and will keep monitoring it | 01:40 |
| jhesketh | mordred: lgtm | 01:41 |
| *** jyuso1 has joined #openstack-infra | 01:42 | |
| shashank_hegde | sdague: I think the bug was exposed by 05aa3846a0402edc9cc49f4ba36f09592004b273. So I would appreciate it if you took a look at it | 01:43 |
| *** ivar-lazzaro has joined #openstack-infra | 01:44 | |
| *** hdd has quit IRC | 01:44 | |
| openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add new contrail-neutron-plugin project https://review.openstack.org/214389 | 01:45 |
| *** hdd has joined #openstack-infra | 01:45 | |
| openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add new contrail-neutron-plugin project https://review.openstack.org/214389 | 01:51 |
| *** kgiusti has quit IRC | 01:55 | |
| mordred | shashank_hegde: and install_pip.sh needs the requirements repo to exist in order to install setuptools? | 01:55 |
| shashank_hegde | Yeah | 01:56 |
| mordred | oh - because of constraints | 01:56 |
| mordred | lgtm - I'm not devstack core though | 01:56 |
| shashank_hegde | mordred: yep. Earlier it was conditional | 01:56 |
| shashank_hegde | Any idea if there are cores here? Quite a lot of CIs are broken because of this | 01:57 |
| mordred | shashank_hegde: well, dtroyer is on vacation still I think, sdague is at a conference and it's dinner time so is likey not online. same with jeblair | 01:58 |
| mordred | I'm not sure who else is core - but I think most of them are in a similar state | 01:58 |
| clarkb | I am about to push the fix | 01:58 |
| clarkb | mtreinish | 01:58 |
| mordred | mtreinish is also at linuxcon and at dinner | 01:59 |
| shashank_hegde | oh… Hopefully someone will look at it once they are free | 01:59 |
| clarkb | it is being looked at... I have the fix I need to push it | 02:00 |
| shashank_hegde | clarkb: I have pushed a fix - https://review.openstack.org/#/c/214409/1 | 02:00 |
| clarkb | oh ok | 02:01 |
| mordred | clarkb: 214399 passed CI | 02:02 |
| mordred | clarkb: so perhaps we do not need a new occ release | 02:02 |
| clarkb | shashank_hegde: I would actually move it up even further | 02:02 |
| clarkb | shashank_hegde: like in https://review.openstack.org/214417 that way if install_prereqs grows pip_install it continues to work | 02:02 |
| clarkb | shashank_hegde: do you hvae an opinion between the two? | 02:02 |
| clarkb | shashank_hegde: basically we want to do that clone really early otherwise any pip_install use that sneaks in before will break | 02:03 |
| shashank_hegde | clarkb: Yeah… I guess it makes sense | 02:03 |
| clarkb | and unfortunately git cloning is one thing in devstack that is not tested in the gate | 02:03 |
| clarkb | so it helps to be defensive | 02:03 |
| clarkb | anyways I can abandon my change | 02:04 |
| clarkb | jgriffith: lifeless 214409 is the change with the fix | 02:04 |
| *** sergmelikyan has joined #openstack-infra | 02:06 | |
| openstackgerrit | Steve Kowalik proposed openstack-infra/jeepyb: Refactor logging arguments into a common module https://review.openstack.org/212971 | 02:07 |
| *** sergmelikyan has quit IRC | 02:07 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Make NODEPOOL_CONFIG a dir https://review.openstack.org/213059 | 02:08 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Configure nodepool logging more like production https://review.openstack.org/212970 | 02:08 |
| regXboi | clarkb: ping - do you know who has the care and feeding of gate-rally-dsvm-neutron-neutron? | 02:08 |
| clarkb | regXboi: I think neutron does? | 02:08 |
| mordred | clarkb: ^^ I rebased those on top of the clouds.yaml change beause it was all in teh same place and conflicting | 02:08 |
| clarkb | we only add the rally jobs to projects that want them iirc | 02:08 |
| *** dimtruck is now known as zz_dimtruck | 02:08 | |
| regXboi | clarkb: I meant did you have an IRC handle I can go heckle :) | 02:08 |
| clarkb | regXboi: #openstack-neutron? | 02:08 |
| lifeless | clarkb: cool, thanks | 02:08 |
| clarkb | regXboi: I am saying that the project is responsible as far as I know | 02:09 |
| clarkb | regXboi: I think the rally tests go in the project too even | 02:09 |
| regXboi | clarkb: ok - I think I may go heckle mestery for names for these jobs | 02:09 |
| mordred | and with that - I will go dinner | 02:09 |
| clarkb | regXboi: see https://git.openstack.org/cgit/openstack/neutron/tree/rally-jobs | 02:09 |
| clarkb | maybe do some git blaming in there to get names? | 02:09 |
| regXboi | clarkb: ack | 02:09 |
| boris-42 | regXboi: I can help you | 02:10 |
| boris-42 | regXboi: what is the question? | 02:10 |
| shashank_hegde | clarkb: Pushed a new patch | 02:10 |
| clarkb | shashank_hegde: looking | 02:10 |
| regXboi | boris-42: I happened to notice that the neutron rally job appears to be going off to insanity and was asking who I could talk to about it - I got a reply in -neutron about a merged patch that may help | 02:11 |
| clarkb | shashank_hegde: of course watch I will be wrong and install_prereqs installs git :P | 02:11 |
| clarkb | shashank_hegde: if that is the case I beg forgiveness | 02:11 |
| regXboi | boris-42: so I'll let it cook and then play the git blame game | 02:11 |
| clarkb | shashank_hegde: oh wait no you git clone devstack therefore it must be assumed to be already installed | 02:11 |
| regXboi | boris-42: if need be :) | 02:11 |
| boris-42 | regXboi: soo sometimes things are merged | 02:11 |
| boris-42 | regXboi: that breaks concurrency | 02:11 |
| boris-42 | regXboi: so I can help you with running locally it | 02:12 |
| regXboi | boris-42: thankx, but I'm not looking to run it locally (*yet*) | 02:12 |
| shashank_hegde | clarkb: :) | 02:13 |
| *** yamahata has quit IRC | 02:14 | |
| *** yamamoto has joined #openstack-infra | 02:16 | |
| *** tjones has quit IRC | 02:18 | |
| *** hdd has quit IRC | 02:19 | |
| boris-42 | regXboi: ;))) | 02:20 |
| boris-42 | regXboi: so if you need help about running something specific in gates you can ping me as well =) | 02:20 |
| *** annegentle has quit IRC | 02:25 | |
| *** annegentle has joined #openstack-infra | 02:26 | |
| *** gildub has quit IRC | 02:27 | |
| *** ybathia has joined #openstack-infra | 02:27 | |
| jlvillal | If the Ironic gate was blocked by a Neutron issue. How long after the patch to fix it is merged will the Ironic gate pick up the change? | 02:27 |
| * jlvillal hopes he is understandable | 02:27 | |
| jlvillal | Patch is to the neutron project. | 02:28 |
| *** shashank_hegde has quit IRC | 02:28 | |
| jlvillal | regXboi, Are you getting postgres errors? Just curious as that is our broken gate issue in Ironic with regards to neutron. | 02:29 |
| clarkb | as soon as its in gate for the gate and as soon as it merges for everywhere else | 02:29 |
| jlvillal | clarkb, How long is "its in the gate for the gate"? That confused me on what it means. | 02:30 |
| jlvillal | clarkb, We have a broken gate job for Ironic. Hoping that a patch that just got merged into neutron will fix it. I did a recheck about 5 minutes after it got merged, but gate still failed. | 02:31 |
| jlvillal | Unsure if the patch didn't work, or if it takes time to propogate out. | 02:31 |
| jlvillal | Just wondering how patient I should be :) | 02:32 |
| *** annegentle has quit IRC | 02:32 | |
| *** achanda has joined #openstack-infra | 02:32 | |
| openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add new contrail-neutron-plugin project https://review.openstack.org/214389 | 02:33 |
| *** unicell has quit IRC | 02:33 | |
| *** camunoz has quit IRC | 02:34 | |
| *** sflanigan has quit IRC | 02:34 | |
| *** hdd has joined #openstack-infra | 02:35 | |
| *** ybathia has quit IRC | 02:35 | |
| *** geoffarnold has joined #openstack-infra | 02:35 | |
| openstackgerrit | Abhishek Raut proposed openstack-infra/devstack-gate: [Do not merge]: Test patch to debug rally jobs https://review.openstack.org/214426 | 02:35 |
| *** minwang2 has joined #openstack-infra | 02:36 | |
| *** geoffarnold has quit IRC | 02:36 | |
| regXboi | jlvillal: I haven't dug into the error mode of that job - there are others in channel chasing it - I'm chasing a different error mode with a particular patch set | 02:37 |
| jlvillal | regXboi, Okay. Thanks | 02:37 |
| *** geoffarnold has joined #openstack-infra | 02:38 | |
| *** regXboi has quit IRC | 02:41 | |
| *** sharikapongubala has quit IRC | 02:41 | |
| *** sharikapongubala has joined #openstack-infra | 02:43 | |
| *** pfallenop has quit IRC | 02:43 | |
| *** pfallenop has joined #openstack-infra | 02:46 | |
| *** gildub has joined #openstack-infra | 02:47 | |
| *** sflanigan has joined #openstack-infra | 02:47 | |
| *** sflanigan has joined #openstack-infra | 02:47 | |
| *** camunoz has joined #openstack-infra | 02:47 | |
| *** salv-orlando has joined #openstack-infra | 02:49 | |
| *** jswarren has quit IRC | 02:51 | |
| *** glauco has joined #openstack-infra | 02:51 | |
| *** jswarren has joined #openstack-infra | 02:52 | |
| *** pahuang has quit IRC | 02:54 | |
| *** dims has quit IRC | 02:55 | |
| *** glauco has quit IRC | 02:57 | |
| *** jeadr has quit IRC | 02:57 | |
| *** jeadr has joined #openstack-infra | 02:58 | |
| *** pfallenop has quit IRC | 02:59 | |
| openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add new contrail-neutron-plugin project https://review.openstack.org/214389 | 02:59 |
| *** pfallenop has joined #openstack-infra | 02:59 | |
| *** madong_ has quit IRC | 03:01 | |
| *** madong_ has joined #openstack-infra | 03:02 | |
| *** asettle is now known as asettle-afk | 03:03 | |
| *** madong_ has quit IRC | 03:04 | |
| *** madong_ has joined #openstack-infra | 03:04 | |
| *** madong_ has quit IRC | 03:04 | |
| *** madong_ has joined #openstack-infra | 03:05 | |
| *** salv-orlando has quit IRC | 03:05 | |
| *** pahuang has joined #openstack-infra | 03:06 | |
| *** tjones has joined #openstack-infra | 03:09 | |
| *** madong_ has quit IRC | 03:12 | |
| *** asselin has joined #openstack-infra | 03:13 | |
| *** zxiiro has quit IRC | 03:14 | |
| *** legoktm has quit IRC | 03:14 | |
| *** tbarron has quit IRC | 03:15 | |
| *** purp has quit IRC | 03:15 | |
| *** erlon has quit IRC | 03:18 | |
| *** purp has joined #openstack-infra | 03:19 | |
| *** tbarron has joined #openstack-infra | 03:20 | |
| *** legoktm has joined #openstack-infra | 03:20 | |
| *** legoktm is now known as Guest69082 | 03:21 | |
| *** zxiiro has joined #openstack-infra | 03:24 | |
| *** tiswanso has quit IRC | 03:25 | |
| *** mrodden has quit IRC | 03:27 | |
| *** raginbajin has quit IRC | 03:27 | |
| *** purp has quit IRC | 03:28 | |
| *** raginbajin has joined #openstack-infra | 03:29 | |
| *** purp has joined #openstack-infra | 03:30 | |
| *** asettle-afk is now known as asettle | 03:31 | |
| *** esmute_ has joined #openstack-infra | 03:32 | |
| *** mrodden has joined #openstack-infra | 03:33 | |
| *** chen12 has quit IRC | 03:35 | |
| *** pfallenop has quit IRC | 03:35 | |
| *** kiran-r has joined #openstack-infra | 03:36 | |
| *** kiran-r has quit IRC | 03:36 | |
| *** yamamoto has quit IRC | 03:37 | |
| *** pfallenop has joined #openstack-infra | 03:37 | |
| *** yamahata has joined #openstack-infra | 03:40 | |
| *** shashank_hegde has joined #openstack-infra | 03:41 | |
| *** yamamoto has joined #openstack-infra | 03:41 | |
| *** ajmiller has quit IRC | 03:43 | |
| *** shardy_ has joined #openstack-infra | 03:47 | |
| *** unicell has joined #openstack-infra | 03:48 | |
| *** shardy has quit IRC | 03:49 | |
| *** shardy_ has quit IRC | 03:52 | |
| *** shardy has joined #openstack-infra | 03:53 | |
| *** jeadr has quit IRC | 03:55 | |
| *** camunoz has quit IRC | 03:55 | |
| *** jeadr has joined #openstack-infra | 03:56 | |
| *** julim has quit IRC | 03:59 | |
| *** pahuang has quit IRC | 04:03 | |
| *** sflanigan has quit IRC | 04:03 | |
| *** salv-orlando has joined #openstack-infra | 04:04 | |
| *** jeadr has quit IRC | 04:05 | |
| *** ayoung has quit IRC | 04:05 | |
| *** tlian2 has quit IRC | 04:05 | |
| *** jamespag` has quit IRC | 04:05 | |
| *** gnuoy` has quit IRC | 04:05 | |
| *** gnuoy has joined #openstack-infra | 04:06 | |
| *** jeadr has joined #openstack-infra | 04:06 | |
| *** asselin has quit IRC | 04:06 | |
| *** asselin has joined #openstack-infra | 04:07 | |
| *** tbarron has quit IRC | 04:08 | |
| *** raginbajin has quit IRC | 04:10 | |
| *** ivar-lazzaro has quit IRC | 04:11 | |
| *** camunoz has joined #openstack-infra | 04:12 | |
| *** purp has quit IRC | 04:12 | |
| *** angerson has quit IRC | 04:12 | |
| *** pfallenop has quit IRC | 04:13 | |
| *** BharatK has joined #openstack-infra | 04:15 | |
| *** sflanigan has joined #openstack-infra | 04:16 | |
| *** sflanigan has joined #openstack-infra | 04:16 | |
| *** pahuang has joined #openstack-infra | 04:16 | |
| *** pfallenop has joined #openstack-infra | 04:16 | |
| *** tbarron has joined #openstack-infra | 04:17 | |
| *** angerson has joined #openstack-infra | 04:18 | |
| *** purp has joined #openstack-infra | 04:18 | |
| *** otter768 has quit IRC | 04:18 | |
| *** otter768 has joined #openstack-infra | 04:20 | |
| BharatK | ianw, ping | 04:20 |
| ianw | BharatK: hey | 04:21 |
| BharatK | ianw, Regarding the patch https://review.openstack.org/#/c/214065/ | 04:21 |
| *** salv-orlando has quit IRC | 04:21 | |
| BharatK | ianw, I understood that neutron is required in job name. | 04:21 |
| BharatK | ianw, But I can see few job names without 'neutron', even though Neutron enabled. | 04:22 |
| BharatK | ianw, https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/devstack-gate.yaml#L1818 | 04:22 |
| BharatK | ianw, https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/devstack-gate.yaml#L634 | 04:22 |
| BharatK | https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/devstack-gate.yaml#L850 | 04:22 |
| BharatK | https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/devstack-gate.yaml#L1553 | 04:22 |
| BharatK | https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/devstack-gate.yaml#L1589 | 04:22 |
| BharatK | https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/devstack-gate.yaml#L1623 | 04:22 |
| BharatK | https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/devstack-gate.yaml#L1722 | 04:22 |
| BharatK | https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/devstack-gate.yaml#L1785 | 04:22 |
| BharatK | https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/devstack-gate.yaml#L1818 | 04:22 |
| ianw | BharatK: yeah, i believe you :) | 04:23 |
| ianw | BharatK: i think let's just sync with AJaeger because i'm not 100% sure what the policy is we want to keep around this | 04:23 |
| BharatK | ianw, Please let me know, if 'neutron' really required. I will rename the jobs. | 04:23 |
| ianw | i don't much care, as long as we try to be consistent | 04:23 |
| *** jerryz has quit IRC | 04:23 | |
| BharatK | ianw, Thanks. | 04:24 |
| *** pfallenop has quit IRC | 04:24 | |
| *** raginbajin has joined #openstack-infra | 04:28 | |
| *** puranamr has quit IRC | 04:28 | |
| *** puranamr has joined #openstack-infra | 04:28 | |
| *** otter768 has quit IRC | 04:29 | |
| *** sdake has quit IRC | 04:29 | |
| *** Sree has joined #openstack-infra | 04:31 | |
| *** jeadr has quit IRC | 04:31 | |
| *** Sree has quit IRC | 04:31 | |
| *** Sree has joined #openstack-infra | 04:32 | |
| *** jeadr has joined #openstack-infra | 04:32 | |
| *** yamamoto has quit IRC | 04:33 | |
| *** minwang2 has quit IRC | 04:33 | |
| *** esmute_ has quit IRC | 04:37 | |
| *** ivar-lazzaro has joined #openstack-infra | 04:39 | |
| *** yamamoto has joined #openstack-infra | 04:41 | |
| *** pcrews has joined #openstack-infra | 04:42 | |
| *** Guest69082 has quit IRC | 04:45 | |
| *** Guest69082 has joined #openstack-infra | 04:45 | |
| *** coolsvap|away is now known as coolsvap | 04:46 | |
| *** Guest69082 is now known as legoktm | 04:46 | |
| *** tbarron has quit IRC | 04:48 | |
| *** mrmartin has joined #openstack-infra | 04:51 | |
| *** deepakcs has joined #openstack-infra | 04:52 | |
| *** glauco has joined #openstack-infra | 04:54 | |
| *** tbarron has joined #openstack-infra | 04:55 | |
| *** tjones has quit IRC | 04:57 | |
| *** FallenPegasus has joined #openstack-infra | 04:58 | |
| *** glauco has quit IRC | 05:00 | |
| *** rlandy has quit IRC | 05:02 | |
| *** cody-somerville has joined #openstack-infra | 05:02 | |
| *** flepied has joined #openstack-infra | 05:02 | |
| *** sabeen2 has quit IRC | 05:05 | |
| *** BharatK has quit IRC | 05:08 | |
| *** coolsvap is now known as coolsvap|away | 05:08 | |
| *** JoshNang has quit IRC | 05:17 | |
| *** ivar-lazzaro has quit IRC | 05:18 | |
| *** legoktm is now known as Sn0c0 | 05:18 | |
| *** ivar-lazzaro has joined #openstack-infra | 05:18 | |
| *** boris-42 has quit IRC | 05:20 | |
| *** peristeri has joined #openstack-infra | 05:22 | |
| *** abregman has joined #openstack-infra | 05:23 | |
| *** coolsvap|away is now known as coolsvap | 05:23 | |
| *** cody-somerville has quit IRC | 05:24 | |
| *** nadya has joined #openstack-infra | 05:24 | |
| *** nadya has quit IRC | 05:24 | |
| *** JoshNang has joined #openstack-infra | 05:25 | |
| *** salv-orlando has joined #openstack-infra | 05:28 | |
| *** Sree_ has joined #openstack-infra | 05:38 | |
| *** hdd has quit IRC | 05:39 | |
| *** Sree_ is now known as Guest17840 | 05:39 | |
| *** ivar-lazzaro has quit IRC | 05:41 | |
| *** sharikapongubala has quit IRC | 05:41 | |
| *** Sree has quit IRC | 05:42 | |
| *** puranamr has quit IRC | 05:44 | |
| *** BharatK has joined #openstack-infra | 05:45 | |
| *** Sn0c0 is now known as legoktm | 05:46 | |
| *** jswarren has quit IRC | 05:48 | |
| *** rbradfor has quit IRC | 05:48 | |
| *** jswarren has joined #openstack-infra | 05:48 | |
| *** amotoki has joined #openstack-infra | 05:50 | |
| *** BharatK has quit IRC | 05:51 | |
| *** ihrachyshka has joined #openstack-infra | 05:54 | |
| *** claudiub has joined #openstack-infra | 05:55 | |
| *** zeih has joined #openstack-infra | 05:56 | |
| *** zeih has quit IRC | 06:01 | |
| *** asettle has quit IRC | 06:02 | |
| *** peristeri has quit IRC | 06:03 | |
| *** BharatK has joined #openstack-infra | 06:03 | |
| *** sharikapongubala has joined #openstack-infra | 06:03 | |
| *** rbradfor has joined #openstack-infra | 06:05 | |
| *** armax has quit IRC | 06:05 | |
| *** FallenPegasus has quit IRC | 06:06 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/213606 | 06:06 |
| *** hdd has joined #openstack-infra | 06:06 | |
| *** afazkas has joined #openstack-infra | 06:07 | |
| *** peristeri has joined #openstack-infra | 06:08 | |
| *** coolsvap is now known as coolsvap|away | 06:10 | |
| *** kaisers has joined #openstack-infra | 06:10 | |
| *** pahuang has quit IRC | 06:12 | |
| *** sergmelikyan has joined #openstack-infra | 06:12 | |
| *** ihrachyshka has quit IRC | 06:13 | |
| *** mrunge has joined #openstack-infra | 06:13 | |
| *** Guest17840 has quit IRC | 06:13 | |
| *** Sree has joined #openstack-infra | 06:14 | |
| *** zeih has joined #openstack-infra | 06:14 | |
| *** geoffarnold has quit IRC | 06:15 | |
| *** geoffarnold has joined #openstack-infra | 06:16 | |
| *** larainema has joined #openstack-infra | 06:16 | |
| *** shashank_hegde has quit IRC | 06:17 | |
| *** hyakuhei has joined #openstack-infra | 06:17 | |
| *** hyakuhei has quit IRC | 06:19 | |
| *** jeadr has quit IRC | 06:21 | |
| *** jeadr has joined #openstack-infra | 06:22 | |
| *** vlaza has joined #openstack-infra | 06:22 | |
| *** larainema has quit IRC | 06:24 | |
| *** sflanigan has quit IRC | 06:25 | |
| *** shashank_hegde has joined #openstack-infra | 06:25 | |
| *** larainema has joined #openstack-infra | 06:26 | |
| *** pahuang has joined #openstack-infra | 06:26 | |
| *** markus_z has joined #openstack-infra | 06:30 | |
| *** otter768 has joined #openstack-infra | 06:30 | |
| *** sridhar_ram has joined #openstack-infra | 06:31 | |
| *** achanda has quit IRC | 06:34 | |
| *** otter768 has quit IRC | 06:35 | |
| *** sridhar_ram has quit IRC | 06:35 | |
| *** hdd has quit IRC | 06:35 | |
| *** sflanigan has joined #openstack-infra | 06:38 | |
| *** scheuran has joined #openstack-infra | 06:40 | |
| *** salv-orlando has quit IRC | 06:40 | |
| *** wshao has joined #openstack-infra | 06:40 | |
| *** hyakuhei has joined #openstack-infra | 06:41 | |
| *** wshao has quit IRC | 06:41 | |
| *** madong_ has joined #openstack-infra | 06:41 | |
| *** huazhihao has joined #openstack-infra | 06:42 | |
| *** larainema has quit IRC | 06:43 | |
| *** nadya has joined #openstack-infra | 06:45 | |
| *** woodster_ has quit IRC | 06:49 | |
| *** sergmelikyan has quit IRC | 06:50 | |
| *** hyakuhei has quit IRC | 06:51 | |
| *** chen12 has joined #openstack-infra | 06:56 | |
| *** sthillma has joined #openstack-infra | 06:56 | |
| *** glauco_ has joined #openstack-infra | 06:56 | |
| *** matbu has quit IRC | 06:58 | |
| *** jlvillal has quit IRC | 06:58 | |
| *** jlvillal has joined #openstack-infra | 06:58 | |
| *** StevenK has quit IRC | 06:58 | |
| *** dizquierdo has joined #openstack-infra | 06:58 | |
| *** StevenK has joined #openstack-infra | 06:59 | |
| *** hyakuhei has joined #openstack-infra | 06:59 | |
| *** hyakuhei has quit IRC | 06:59 | |
| *** matbu has joined #openstack-infra | 07:00 | |
| *** glauco_ has quit IRC | 07:01 | |
| *** Sree has quit IRC | 07:02 | |
| *** Sree has joined #openstack-infra | 07:03 | |
| *** kiran-r has joined #openstack-infra | 07:06 | |
| *** Sree has quit IRC | 07:07 | |
| *** shashank_hegde has quit IRC | 07:10 | |
| *** gaurangt has joined #openstack-infra | 07:11 | |
| *** HeOS has quit IRC | 07:14 | |
| *** sshnaidm has joined #openstack-infra | 07:14 | |
| *** sileht has joined #openstack-infra | 07:15 | |
| *** shashank_hegde has joined #openstack-infra | 07:16 | |
| *** shashank_hegde has quit IRC | 07:16 | |
| *** shashank_hegde has joined #openstack-infra | 07:16 | |
| *** peristeri has quit IRC | 07:18 | |
| *** jschwarz has joined #openstack-infra | 07:18 | |
| *** sharikapongubala has quit IRC | 07:22 | |
| *** sharikapongubala has joined #openstack-infra | 07:22 | |
| *** fawadkhaliq has joined #openstack-infra | 07:23 | |
| *** scheuran has quit IRC | 07:23 | |
| *** dtantsur|pto19Au is now known as dtantsur | 07:26 | |
| *** jtomasek has quit IRC | 07:26 | |
| *** camunoz has quit IRC | 07:27 | |
| *** arxcruz has joined #openstack-infra | 07:29 | |
| *** kiran-r has quit IRC | 07:29 | |
| *** kiran-r has joined #openstack-infra | 07:33 | |
| *** zeih has quit IRC | 07:34 | |
| *** madong_ has quit IRC | 07:36 | |
| openstackgerrit | Merged openstack-infra/puppet-user: Add Gemfile and puppet 4 checks https://review.openstack.org/213301 | 07:40 |
| *** camunoz has joined #openstack-infra | 07:40 | |
| *** salv-orlando has joined #openstack-infra | 07:41 | |
| *** che-arne has joined #openstack-infra | 07:44 | |
| openstackgerrit | Merged openstack-infra/puppet-storyboard: Add Gemfile and puppet 4 checks https://review.openstack.org/212890 | 07:44 |
| *** larainema has joined #openstack-infra | 07:44 | |
| *** mpopow has joined #openstack-infra | 07:44 | |
| *** yamamoto has quit IRC | 07:46 | |
| *** dizquierdo has quit IRC | 07:48 | |
| *** yamamoto has joined #openstack-infra | 07:48 | |
| *** mpopow has quit IRC | 07:48 | |
| openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add new networking-contrail project https://review.openstack.org/214389 | 07:52 |
| *** deepakcs has quit IRC | 07:54 | |
| *** Sree has joined #openstack-infra | 07:55 | |
| *** fhubik has joined #openstack-infra | 07:58 | |
| *** boris-42 has joined #openstack-infra | 07:58 | |
| *** HeOS has joined #openstack-infra | 08:01 | |
| *** sharikapongubala has quit IRC | 08:01 | |
| *** jcoufal has joined #openstack-infra | 08:02 | |
| *** deepakcs has joined #openstack-infra | 08:11 | |
| *** skiafa_ has quit IRC | 08:14 | |
| *** shashank_hegde has quit IRC | 08:17 | |
| *** zeih has joined #openstack-infra | 08:18 | |
| *** gildub has quit IRC | 08:19 | |
| *** mpopow has joined #openstack-infra | 08:19 | |
| *** ociuhandu has quit IRC | 08:20 | |
| *** bharath_ has quit IRC | 08:20 | |
| *** mpopow has quit IRC | 08:21 | |
| *** bharath_ has joined #openstack-infra | 08:21 | |
| *** markvoelker has quit IRC | 08:22 | |
| *** notnownikki has joined #openstack-infra | 08:22 | |
| openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add new networking-contrail project https://review.openstack.org/214389 | 08:23 |
| *** sthillma has quit IRC | 08:25 | |
| *** bharath_ has quit IRC | 08:26 | |
| *** matbu_ has joined #openstack-infra | 08:26 | |
| *** matbu has quit IRC | 08:27 | |
| *** derekh has joined #openstack-infra | 08:27 | |
| *** k4n0 has joined #openstack-infra | 08:28 | |
| openstackgerrit | Neil Jerram proposed openstack-infra/project-config: Fix typo in ACL config for networking-calico https://review.openstack.org/214507 | 08:28 |
| *** otter768 has joined #openstack-infra | 08:31 | |
| *** Sree__ has joined #openstack-infra | 08:33 | |
| openstackgerrit | Merged openstack/requirements: Updated from generate-constraints https://review.openstack.org/213606 | 08:33 |
| *** fhubik_ has joined #openstack-infra | 08:33 | |
| *** jistr has joined #openstack-infra | 08:34 | |
| *** Sree__ has quit IRC | 08:34 | |
| *** zeih has quit IRC | 08:34 | |
| *** fhubik_ has quit IRC | 08:35 | |
| *** bharath_ has joined #openstack-infra | 08:36 | |
| *** otter768 has quit IRC | 08:36 | |
| *** fawadkhaliq has quit IRC | 08:36 | |
| *** huazhihao has quit IRC | 08:37 | |
| *** fhubik has quit IRC | 08:37 | |
| *** ihrachyshka has joined #openstack-infra | 08:38 | |
| *** fhubik has joined #openstack-infra | 08:41 | |
| openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add new networking-contrail project https://review.openstack.org/214389 | 08:44 |
| openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add new networking-contrail project https://review.openstack.org/214389 | 08:46 |
| *** fhubik is now known as fhubik_brb | 08:46 | |
| *** ihrachyshka has quit IRC | 08:48 | |
| *** ihrachyshka has joined #openstack-infra | 08:48 | |
| *** achanda has joined #openstack-infra | 08:48 | |
| *** kiran-r has quit IRC | 08:49 | |
| *** fhubik_brb is now known as fhubik | 08:52 | |
| *** fhubik is now known as fhubik_brb | 08:52 | |
| *** mquin has left #openstack-infra | 08:53 | |
| *** mquin has joined #openstack-infra | 09:00 | |
| *** nijaba has quit IRC | 09:00 | |
| *** dizquierdo has joined #openstack-infra | 09:01 | |
| *** rguillebert has joined #openstack-infra | 09:04 | |
| *** romcheg has joined #openstack-infra | 09:04 | |
| openstackgerrit | Ryu Ishimoto proposed openstack-infra/project-config: Set DEVSTACK_GATE_SETTINGS for midonet gate job https://review.openstack.org/207731 | 09:04 |
| *** pelix has joined #openstack-infra | 09:05 | |
| *** mquin has left #openstack-infra | 09:05 | |
| *** matbu_ is now known as matbu | 09:06 | |
| *** larainema has quit IRC | 09:10 | |
| *** jschwarz is now known as jschwarz|lunch | 09:10 | |
| *** abregman is now known as abregman|lunch | 09:12 | |
| *** larainema has joined #openstack-infra | 09:12 | |
| *** fhubik_brb is now known as fhubik | 09:13 | |
| openstackgerrit | Ryu Ishimoto proposed openstack-infra/project-config: Set DEVSTACK_GATE_SETTINGS for midonet gate job https://review.openstack.org/207731 | 09:14 |
| *** achanda has quit IRC | 09:17 | |
| *** mquin has joined #openstack-infra | 09:18 | |
| *** markvoelker has joined #openstack-infra | 09:23 | |
| *** bharath__ has joined #openstack-infra | 09:24 | |
| *** bharath_ has quit IRC | 09:24 | |
| *** Sree__ has joined #openstack-infra | 09:24 | |
| *** ajo is now known as ajo\afk | 09:27 | |
| *** nadya has quit IRC | 09:27 | |
| *** fawadkhaliq has joined #openstack-infra | 09:28 | |
| *** SumitNaiksatam has joined #openstack-infra | 09:28 | |
| *** Sree has quit IRC | 09:28 | |
| *** markvoelker has quit IRC | 09:28 | |
| *** Sree__ has quit IRC | 09:29 | |
| *** kiran-r has joined #openstack-infra | 09:34 | |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Reduce openstack-ansible commit check timeout https://review.openstack.org/214531 | 09:35 |
| *** madong_ has joined #openstack-infra | 09:38 | |
| *** larainema has quit IRC | 09:38 | |
| *** _kiran_ has joined #openstack-infra | 09:40 | |
| *** kiran-r has quit IRC | 09:41 | |
| *** bharath__ has quit IRC | 09:43 | |
| *** jaypipes has quit IRC | 09:46 | |
| *** zeih has joined #openstack-infra | 09:47 | |
| *** jeadr has quit IRC | 09:49 | |
| *** jeadr has joined #openstack-infra | 09:50 | |
| openstackgerrit | Qiming Teng proposed openstack/requirements: Bump oslo.db to version 2.4 https://review.openstack.org/214536 | 09:52 |
| *** _kiran_ is now known as kiran-r | 09:53 | |
| *** kiran-r has quit IRC | 09:53 | |
| *** kiran-r has joined #openstack-infra | 09:54 | |
| *** ociuhandu has joined #openstack-infra | 09:54 | |
| *** jtomasek has joined #openstack-infra | 09:55 | |
| *** glauco has joined #openstack-infra | 09:58 | |
| *** yamamoto has quit IRC | 10:04 | |
| *** zeih has quit IRC | 10:04 | |
| *** glauco has quit IRC | 10:05 | |
| *** f1ller has quit IRC | 10:05 | |
| *** dolphm has quit IRC | 10:05 | |
| *** sigmavirus24_awa has quit IRC | 10:06 | |
| *** eglute has quit IRC | 10:06 | |
| *** Trozz_ has quit IRC | 10:06 | |
| *** apmelton has quit IRC | 10:06 | |
| *** Yanyan has quit IRC | 10:07 | |
| *** d34dh0r53 has quit IRC | 10:07 | |
| *** pblaho has joined #openstack-infra | 10:08 | |
| *** eglute has joined #openstack-infra | 10:08 | |
| *** d34dh0r53 has joined #openstack-infra | 10:08 | |
| *** f1ller has joined #openstack-infra | 10:09 | |
| *** apmelton has joined #openstack-infra | 10:09 | |
| *** dolphm has joined #openstack-infra | 10:09 | |
| *** u_glide has joined #openstack-infra | 10:09 | |
| *** fhubik is now known as fhubik_brb | 10:09 | |
| *** sigmavirus24_awa has joined #openstack-infra | 10:09 | |
| *** Trozz_ has joined #openstack-infra | 10:10 | |
| *** BharatK has quit IRC | 10:11 | |
| *** Ng has quit IRC | 10:12 | |
| *** dirk has quit IRC | 10:12 | |
| *** sharikapongubala has joined #openstack-infra | 10:12 | |
| *** dirk has joined #openstack-infra | 10:13 | |
| *** Ng has joined #openstack-infra | 10:13 | |
| *** BharatK has joined #openstack-infra | 10:13 | |
| *** sharikapongubala has quit IRC | 10:14 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Allow zuul status.json to be paramerized https://review.openstack.org/214543 | 10:15 |
| *** kmartin has quit IRC | 10:16 | |
| *** sharikapongubala has joined #openstack-infra | 10:16 | |
| *** asselin_ has quit IRC | 10:16 | |
| *** mdenny has quit IRC | 10:17 | |
| *** sharikapongubala has quit IRC | 10:17 | |
| *** sharikapongubala has joined #openstack-infra | 10:18 | |
| *** sharikapongubala has quit IRC | 10:19 | |
| *** sharikapongubala has joined #openstack-infra | 10:20 | |
| *** sharikapongubala has quit IRC | 10:21 | |
| *** abregman|lunch is now known as abregman | 10:22 | |
| *** sharikapongubala has joined #openstack-infra | 10:22 | |
| *** _kiran_ has joined #openstack-infra | 10:23 | |
| *** kiran-r has quit IRC | 10:24 | |
| *** sharikap_ has joined #openstack-infra | 10:24 | |
| *** sharikap_ has quit IRC | 10:26 | |
| *** sharikapongubala has quit IRC | 10:27 | |
| *** _kiran_ has quit IRC | 10:29 | |
| *** jschwarz|lunch is now known as jschwarz | 10:29 | |
| *** yamahata has quit IRC | 10:32 | |
| *** otter768 has joined #openstack-infra | 10:32 | |
| *** otter768 has quit IRC | 10:37 | |
| *** kiran-r has joined #openstack-infra | 10:43 | |
| *** bharath_ has joined #openstack-infra | 10:43 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/puppet-openstackci: Fix target path for regular git clone during tests https://review.openstack.org/214549 | 10:44 |
| *** _kiran_ has joined #openstack-infra | 10:45 | |
| *** _kiran_ has quit IRC | 10:45 | |
| *** _kiran_ has joined #openstack-infra | 10:45 | |
| *** _kiran_ has quit IRC | 10:46 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/puppet-zuul: Fix target path for regular git clone during tests https://review.openstack.org/214553 | 10:47 |
| *** _kiran_ has joined #openstack-infra | 10:47 | |
| openstackgerrit | Fatih Degirmenci proposed openstack-infra/jenkins-job-builder: Validate and set compare types in gerrit trigger https://review.openstack.org/202180 | 10:47 |
| *** kiran-r has quit IRC | 10:48 | |
| *** bharath_ has quit IRC | 10:48 | |
| *** _kiran_ has quit IRC | 10:48 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/puppet-jenkins: Fix target path for regular git clone during tests https://review.openstack.org/214554 | 10:48 |
| *** kiran-r has joined #openstack-infra | 10:49 | |
| openstackgerrit | Anton Arefiev proposed openstack-infra/project-config: Add job to test Add Cinder API with Apache https://review.openstack.org/208498 | 10:50 |
| *** salv-orlando has quit IRC | 10:53 | |
| *** ruagair has quit IRC | 10:53 | |
| *** Sree has joined #openstack-infra | 10:53 | |
| *** fawadkhaliq has quit IRC | 10:53 | |
| *** hyakuhei has joined #openstack-infra | 10:54 | |
| *** jeadr has quit IRC | 10:54 | |
| *** hyakuhei has quit IRC | 10:55 | |
| *** ruagair has joined #openstack-infra | 10:55 | |
| *** jeadr has joined #openstack-infra | 10:55 | |
| *** dims has joined #openstack-infra | 10:56 | |
| *** madong_ has quit IRC | 10:56 | |
| *** madong_ has joined #openstack-infra | 10:56 | |
| *** mwagner_lap has quit IRC | 10:57 | |
| *** peristeri has joined #openstack-infra | 10:58 | |
| *** yamamoto_ has joined #openstack-infra | 10:58 | |
| *** pal has joined #openstack-infra | 10:59 | |
| *** madong_ has quit IRC | 11:01 | |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Create experimental jobs for VPN DevStack plugin https://review.openstack.org/209887 | 11:01 |
| *** glauco has joined #openstack-infra | 11:02 | |
| *** dims_ has joined #openstack-infra | 11:03 | |
| *** baoli has joined #openstack-infra | 11:05 | |
| *** doug-fish has joined #openstack-infra | 11:07 | |
| *** dims has quit IRC | 11:07 | |
| *** glauco has quit IRC | 11:07 | |
| *** thorst has joined #openstack-infra | 11:09 | |
| *** baoli has quit IRC | 11:10 | |
| *** pc_m has joined #openstack-infra | 11:11 | |
| openstackgerrit | Matthias Runge proposed openstack-infra/project-config: Switch Django-1.8 test to voting https://review.openstack.org/214561 | 11:15 |
| *** ociuhandu has quit IRC | 11:16 | |
| *** ociuhandu has joined #openstack-infra | 11:18 | |
| *** boris-42 has quit IRC | 11:20 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Allow zuul status.json to be parameterized https://review.openstack.org/214543 | 11:20 |
| *** pal has quit IRC | 11:21 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-jenkins: Allow to specify groups to jenkins user https://review.openstack.org/214563 | 11:22 |
| *** jtomasek has quit IRC | 11:22 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-jenkins: Allow to specify groups to jenkins user https://review.openstack.org/214563 | 11:23 |
| *** markvoelker has joined #openstack-infra | 11:24 | |
| *** pelix has quit IRC | 11:27 | |
| *** markvoelker has quit IRC | 11:28 | |
| *** dims has joined #openstack-infra | 11:29 | |
| *** dims_ has quit IRC | 11:31 | |
| *** dims_ has joined #openstack-infra | 11:31 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Add an API endpoint for Worklists https://review.openstack.org/213702 | 11:33 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Add tables for Worklists and Boards https://review.openstack.org/213701 | 11:33 |
| *** gordc has joined #openstack-infra | 11:33 | |
| *** dims has quit IRC | 11:34 | |
| *** Kiall_ is now known as Kiall | 11:34 | |
| *** yamamoto_ has quit IRC | 11:35 | |
| *** fawadkhaliq has joined #openstack-infra | 11:35 | |
| *** yamamoto has joined #openstack-infra | 11:36 | |
| *** fhubik_brb is now known as fhubik | 11:36 | |
| *** yamamoto has quit IRC | 11:37 | |
| *** jtomasek has joined #openstack-infra | 11:37 | |
| *** yamamoto has joined #openstack-infra | 11:37 | |
| *** ajo\afk is now known as ajo | 11:38 | |
| *** pfallenop has joined #openstack-infra | 11:38 | |
| *** otter768 has joined #openstack-infra | 11:46 | |
| *** dizquierdo has quit IRC | 11:47 | |
| *** pfallenop has quit IRC | 11:47 | |
| *** pfallenop has joined #openstack-infra | 11:48 | |
| *** moravec has quit IRC | 11:49 | |
| *** jaypipes has joined #openstack-infra | 11:53 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Add an API endpoint for Worklists https://review.openstack.org/213702 | 11:53 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Add tables for Worklists and Boards https://review.openstack.org/213701 | 11:53 |
| *** doug-fish has quit IRC | 11:54 | |
| *** zeih has joined #openstack-infra | 11:54 | |
| *** jschwarz has quit IRC | 11:55 | |
| *** pc_m_ has joined #openstack-infra | 11:57 | |
| *** AJaeger has joined #openstack-infra | 11:58 | |
| *** otter768 has quit IRC | 12:02 | |
| *** nadya_ has joined #openstack-infra | 12:03 | |
| *** pc_m has quit IRC | 12:03 | |
| *** afazkas has quit IRC | 12:04 | |
| *** doug-fish has joined #openstack-infra | 12:05 | |
| *** zeih has quit IRC | 12:05 | |
| *** jpeeler has quit IRC | 12:07 | |
| *** dprince has joined #openstack-infra | 12:08 | |
| *** julim has joined #openstack-infra | 12:10 | |
| *** alivigni has joined #openstack-infra | 12:11 | |
| *** samueldmq has joined #openstack-infra | 12:12 | |
| *** bswartz has quit IRC | 12:15 | |
| *** zeih has joined #openstack-infra | 12:16 | |
| *** amotoki_ has joined #openstack-infra | 12:17 | |
| *** ldnunes has joined #openstack-infra | 12:17 | |
| *** glauco has joined #openstack-infra | 12:19 | |
| *** hyakuhei has joined #openstack-infra | 12:20 | |
| *** hyakuhei has quit IRC | 12:21 | |
| *** erlon has joined #openstack-infra | 12:22 | |
| *** bexelbie_ has joined #openstack-infra | 12:22 | |
| *** cdent has joined #openstack-infra | 12:23 | |
| *** deepakcs has quit IRC | 12:23 | |
| *** bexelbie_ is now known as bexelbie | 12:25 | |
| *** salv-orlando has joined #openstack-infra | 12:25 | |
| *** angerson has quit IRC | 12:26 | |
| *** glauco has quit IRC | 12:26 | |
| *** angerson has joined #openstack-infra | 12:26 | |
| *** chlong has joined #openstack-infra | 12:26 | |
| *** amotoki_ has quit IRC | 12:27 | |
| *** dkranz has joined #openstack-infra | 12:31 | |
| *** yamamoto has quit IRC | 12:32 | |
| *** salv-orl_ has joined #openstack-infra | 12:32 | |
| *** salv-orlando has quit IRC | 12:33 | |
| *** bharath has joined #openstack-infra | 12:33 | |
| *** mwagner_lap has joined #openstack-infra | 12:33 | |
| *** jyuso1 has quit IRC | 12:34 | |
| *** hyakuhei has joined #openstack-infra | 12:35 | |
| *** romcheg has left #openstack-infra | 12:37 | |
| *** bharath has quit IRC | 12:38 | |
| *** markvoelker has joined #openstack-infra | 12:40 | |
| *** julim has quit IRC | 12:41 | |
| *** julim has joined #openstack-infra | 12:42 | |
| *** yamamoto has joined #openstack-infra | 12:43 | |
| *** gildub has joined #openstack-infra | 12:43 | |
| *** eharney has joined #openstack-infra | 12:45 | |
| *** fawadkhaliq has quit IRC | 12:46 | |
| *** amotoki_ has joined #openstack-infra | 12:47 | |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Update DELOREAN_URL to one from 2015-08-19 https://review.openstack.org/214591 | 12:47 |
| *** rguillebert has quit IRC | 12:47 | |
| *** yamamoto has quit IRC | 12:47 | |
| *** che-arne has quit IRC | 12:48 | |
| *** che-arne has joined #openstack-infra | 12:49 | |
| *** u_glide has left #openstack-infra | 12:51 | |
| *** fhubik is now known as fhubik_brb | 12:52 | |
| *** pal has joined #openstack-infra | 12:52 | |
| *** BharatK has quit IRC | 12:52 | |
| *** tlian has joined #openstack-infra | 12:57 | |
| *** fhubik_brb is now known as fhubik | 12:58 | |
| *** jcoufal_ has joined #openstack-infra | 12:58 | |
| *** sergmelikyan has joined #openstack-infra | 12:59 | |
| *** glauco has joined #openstack-infra | 12:59 | |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Pin puppet-neutron before Liberty config changes https://review.openstack.org/214598 | 13:00 |
| *** xyang1 has joined #openstack-infra | 13:00 | |
| *** mquin has left #openstack-infra | 13:00 | |
| *** rguillebert has joined #openstack-infra | 13:01 | |
| *** jcoufal has quit IRC | 13:01 | |
| *** glauco has quit IRC | 13:02 | |
| *** flaviosr has joined #openstack-infra | 13:04 | |
| *** bdemers has joined #openstack-infra | 13:05 | |
| *** pblaho has quit IRC | 13:05 | |
| *** rfolco has joined #openstack-infra | 13:06 | |
| *** doug-fish has quit IRC | 13:06 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: OIDC - OpenId Connect Implementation https://review.openstack.org/198458 | 13:08 |
| *** rlandy has joined #openstack-infra | 13:08 | |
| *** BharatK has joined #openstack-infra | 13:09 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Remove heat pin https://review.openstack.org/214348 | 13:10 |
| *** puranamr has joined #openstack-infra | 13:12 | |
| *** pal has quit IRC | 13:13 | |
| openstackgerrit | Brant Knudson proposed openstack/requirements: Fix update requirements mixed case in extras https://review.openstack.org/214604 | 13:13 |
| *** annegentle has joined #openstack-infra | 13:13 | |
| *** moravec has joined #openstack-infra | 13:13 | |
| *** esker has joined #openstack-infra | 13:14 | |
| annegentle | ttx: ping re: how to set up process around service catalog | 13:14 |
| *** pal has joined #openstack-infra | 13:14 | |
| *** BharatK has quit IRC | 13:14 | |
| *** pc_m_ has quit IRC | 13:15 | |
| *** pc_m has joined #openstack-infra | 13:15 | |
| openstackgerrit | Anne Gentle proposed openstack-infra/irc-meetings: Proposal to move the OpenStack cross-project meeting to 1800 Tues. https://review.openstack.org/214605 | 13:15 |
| *** tiswanso has joined #openstack-infra | 13:15 | |
| *** BharatK has joined #openstack-infra | 13:16 | |
| *** Sree has quit IRC | 13:17 | |
| *** dizquierdo has joined #openstack-infra | 13:18 | |
| *** pal has quit IRC | 13:20 | |
| *** doug-fish has joined #openstack-infra | 13:21 | |
| *** doug-fish has quit IRC | 13:21 | |
| *** spzala has joined #openstack-infra | 13:21 | |
| *** doug-fish has joined #openstack-infra | 13:22 | |
| *** doug-fish has quit IRC | 13:22 | |
| *** doug-fish has joined #openstack-infra | 13:23 | |
| *** doug-fis_ has joined #openstack-infra | 13:24 | |
| *** pabelanger has joined #openstack-infra | 13:26 | |
| *** doug-fish has quit IRC | 13:28 | |
| *** dims_ has quit IRC | 13:29 | |
| *** dims has joined #openstack-infra | 13:29 | |
| *** prad_ has joined #openstack-infra | 13:32 | |
| *** hyakuhei has quit IRC | 13:32 | |
| *** mriedem has joined #openstack-infra | 13:33 | |
| *** flaviosr has quit IRC | 13:34 | |
| *** pal has joined #openstack-infra | 13:35 | |
| *** glauco has joined #openstack-infra | 13:35 | |
| *** bexelbie has quit IRC | 13:35 | |
| *** wenlock_ has joined #openstack-infra | 13:37 | |
| *** annegentle has quit IRC | 13:37 | |
| *** moravec has quit IRC | 13:38 | |
| *** moravec has joined #openstack-infra | 13:41 | |
| *** mtrovo has joined #openstack-infra | 13:41 | |
| pabelanger | morning | 13:41 |
| *** chen12 has quit IRC | 13:42 | |
| yolanda | hi pabelanger, i was just looking at some of your changes... | 13:42 |
| yolanda | how did you make to apache and httpd co-exist together? | 13:42 |
| yolanda | it was just "if defined(apache) do this ... " ? | 13:42 |
| *** kiran-r has quit IRC | 13:42 | |
| *** zeih has quit IRC | 13:43 | |
| pabelanger | yolanda: https://github.com/openstack-infra/puppet-openstackci/blob/master/manifests/logserver.pp#L37 | 13:43 |
| pabelanger | for example | 13:43 |
| pabelanger | that code actually needs to be removed | 13:43 |
| *** zeih has joined #openstack-infra | 13:43 | |
| yolanda | i'm having same use case downtream | 13:43 |
| yolanda | downstream | 13:43 |
| openstackgerrit | will soula proposed openstack-infra/jenkins-job-builder: Add Ability to use the AWS Cloudformation Plugin https://review.openstack.org/202300 | 13:44 |
| pabelanger | Ya, going to remove that code now, since we merged everything in system-config | 13:44 |
| yolanda | yes, i'm still on that effort downstream | 13:44 |
| yolanda | several modules still using old apache | 13:44 |
| *** jpeeler has joined #openstack-infra | 13:45 | |
| *** yamamoto has joined #openstack-infra | 13:46 | |
| *** yamamoto has quit IRC | 13:46 | |
| *** yamamoto has joined #openstack-infra | 13:46 | |
| *** yamamoto has quit IRC | 13:46 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-openstackci: Remove logic to check for puppetlabs-apache https://review.openstack.org/214618 | 13:46 |
| yolanda | ah, good to have acted as a reminder :) | 13:47 |
| *** yamamoto has joined #openstack-infra | 13:47 | |
| openstackgerrit | Sean M. Collins proposed openstack-infra/project-config: Make the Linux Bridge CI voting on Kilo+ https://review.openstack.org/205674 | 13:48 |
| *** jcoufal_ has quit IRC | 13:49 | |
| openstackgerrit | Sean M. Collins proposed openstack-infra/project-config: Make the Linux Bridge CI voting on Kilo+ https://review.openstack.org/205674 | 13:50 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-meetbot: Remove logic to check for puppetlabs-apache https://review.openstack.org/214620 | 13:50 |
| *** hyakuhei has joined #openstack-infra | 13:50 | |
| *** jcoufal has joined #openstack-infra | 13:51 | |
| *** zeih has quit IRC | 13:53 | |
| *** bdemers_ has joined #openstack-infra | 13:55 | |
| *** fhubik has quit IRC | 13:56 | |
| *** austin81 has joined #openstack-infra | 13:56 | |
| *** pelix has joined #openstack-infra | 13:56 | |
| *** fhubik has joined #openstack-infra | 13:56 | |
| *** yamamoto has quit IRC | 13:56 | |
| *** prad_ is now known as pradk | 13:56 | |
| *** yamamoto has joined #openstack-infra | 13:56 | |
| *** yamamoto has quit IRC | 13:56 | |
| *** sdake has joined #openstack-infra | 13:56 | |
| *** bdemers has quit IRC | 13:57 | |
| *** bdemers_ is now known as bdemers | 13:57 | |
| *** yamamoto has joined #openstack-infra | 13:57 | |
| *** sdake_ has joined #openstack-infra | 13:58 | |
| *** hyakuhei has quit IRC | 13:58 | |
| *** mriedem is now known as mriedem_meeting | 13:59 | |
| *** kgiusti has joined #openstack-infra | 13:59 | |
| *** doug-fish has joined #openstack-infra | 14:00 | |
| *** cburroughs has joined #openstack-infra | 14:01 | |
| ttx | fungi, jeblair: we discussed adding the ability for everyone to set topics in Gerrit changes (so that I can apply a topic to a class of governance changes) | 14:01 |
| *** Sree has joined #openstack-infra | 14:01 | |
| ttx | Did we push that already ? | 14:01 |
| *** sdake has quit IRC | 14:01 | |
| *** gildub has quit IRC | 14:02 | |
| cburroughs | I may be misreading http://docs.openstack.org/infra/jenkins-job-builder/definition.html#yaml-anchors-aliases Can I define some anchor defaults in defaults.yaml and then reference them in foo.yaml? | 14:02 |
| clarkb | ttx I believe anyone can do it but that may be my accounts special powers confusing me | 14:03 |
| jeblair | ttx: i think we may have forgotten about that | 14:03 |
| *** otter768 has joined #openstack-infra | 14:03 | |
| ttx | clarkb: it's your superpowers | 14:03 |
| *** yamamoto has quit IRC | 14:03 | |
| *** doug-fis_ has quit IRC | 14:03 | |
| *** zz_dimtruck is now known as dimtruck | 14:03 | |
| ttx | jeblair: are you pushing it ? | 14:03 |
| cburroughs | Or are anchors only bound to a single file just like 'normal' yaml? | 14:03 |
| clarkb | cburroughs yes the yaml is all smashed together and filenames have no signifigance | 14:04 |
| *** pal has quit IRC | 14:04 | |
| jeblair | ttx: yep, working on it now | 14:04 |
| ttx | jeblair: or should I (Friday probably) | 14:04 |
| ttx | ok cool | 14:04 |
| jeblair | this way i don't forget | 14:04 |
| jeblair | again | 14:05 |
| *** sharikapongubala has joined #openstack-infra | 14:05 | |
| pabelanger | Any infra cores not at the ops summit this week? Wouldn't mind some help to land fedora22 dib patches | 14:05 |
| *** bswartz has joined #openstack-infra | 14:05 | |
| cburroughs | clarkb, Maybe I have an embarassing indentation error or something? http://dpaste.com/1A0QDAN works at the top of foo.yaml but jenkins-jobs test defaults.yaml:foo.yaml fails with yaml.composer.ComposerError: found undefined alias 'ops_wrapper_defaults' | 14:05 |
| clarkb | cburroughs at least that is how we attempt to make jjb work,if you have a counter example please share it | 14:05 |
| StevenK | pabelanger: Against dib itself? Then you don't need infra cores, you need tripleo cores. | 14:05 |
| *** otter768 has quit IRC | 14:07 | |
| *** sharikapongubala has quit IRC | 14:08 | |
| *** ajmiller has joined #openstack-infra | 14:08 | |
| fungi | ttx: jeblair clarkb: yeah, i think we had decided to just set it in the all-projects acl and add it to the documented acl in our system-config docs, but i don't recall getting around to it. sorry! | 14:08 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Allow registered users to edit topics https://review.openstack.org/214628 | 14:08 |
| jeblair | fungi: oh look, a round tuit! ^ | 14:08 |
| fungi | thanks! | 14:08 |
| jeblair | i have not executed that (except on -dev). | 14:09 |
| *** flepied has quit IRC | 14:09 | |
| jeblair | (which was mostly to look up the acl verb) | 14:09 |
| clarkb | cburroughs maybe the behavior is different when loading a dir instead of specific files? | 14:09 |
| pabelanger | StevenK: this is to launch jenkins fedora 22 nodes and build the actual fedora dibs | 14:09 |
| openstackgerrit | Roman Prykhodchenko proposed openstack-infra/project-config: Run Python jobs for python-fuelclient https://review.openstack.org/214630 | 14:09 |
| pabelanger | system-config / project-config | 14:10 |
| StevenK | pabelanger: Ah, right, carry on then | 14:10 |
| *** sharikapongubala has joined #openstack-infra | 14:10 | |
| clarkb | cburroughs jjb definitely tries to make the equivalent of one large yaml doc though so I believe this should work but the jjb docs say something funny about how you can use the same name | 14:10 |
| pabelanger | StevenK: Did you ever finish up the packaging spec work left over from the last summit? | 14:10 |
| clarkb | its possible that we have "scoped" anchor expansion poorly | 14:10 |
| pabelanger | Also, here are the 2 reviews I'm looking to land for fedora 22: https://review.openstack.org/#/c/211703/ and https://review.openstack.org/#/c/211294/ for people playing at home | 14:11 |
| StevenK | pabelanger: It still has a few -1s on it, I have yet to capture mordred's attention enough for him to relook at it | 14:11 |
| pabelanger | StevenK: Ya, was going to bring it up again in the next week or so, see if we can rejump start it | 14:12 |
| *** sdake_ is now known as sdake | 14:13 | |
| clarkb | pabelanger https://review.openstack.org/#/c/211703/2/nodepool/scripts/prepare_node.sh should be left as is | 14:13 |
| clarkb | since nodepool/scripts build snapshot images based on what clouds provide us. or at least the comment should not change | 14:14 |
| cburroughs | clarkb, I tried to take the example from the docs and split it over two files: http://dpaste.com/3HCHKRW | 14:14 |
| pabelanger | clarkb: sounds good, reverting now | 14:14 |
| *** boris-42 has joined #openstack-infra | 14:15 | |
| openstackgerrit | Ryan Moats proposed openstack-infra/project-config: make gate-tempest-dsvm-neutron-multinode-* jobs voting https://review.openstack.org/212058 | 14:16 |
| svasheka | hi guys | 14:16 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Use restorecon over chcon for unbound selinux https://review.openstack.org/211703 | 14:16 |
| svasheka | need some help with devstack gate | 14:16 |
| *** doug-fish has quit IRC | 14:17 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Use dnf download to cache packages https://review.openstack.org/211294 | 14:18 |
| *** mtanino has joined #openstack-infra | 14:18 | |
| pabelanger | I sometime wish that zuul could auto rebase, if possible, and upload patchsets into gerrit. That would be cool | 14:18 |
| *** doug-fish has joined #openstack-infra | 14:19 | |
| pabelanger | rather then me :) | 14:19 |
| StevenK | pabelanger: There is a Rebase change button | 14:19 |
| * jeblair starts driving to palo alto | 14:20 | |
| openstackgerrit | Ryan Moats proposed openstack-infra/project-config: make gate-tempest-dsvm-neutron-multinode-* jobs voting https://review.openstack.org/212058 | 14:20 |
| StevenK | But that only works for conflictless, I think. | 14:20 |
| pabelanger | crap, I keep forgetting about it | 14:20 |
| pabelanger | will have to try next time | 14:20 |
| fungi | pabelanger: looking to write an artificial intelligence engine? it only flags them as needing rebase if there's a merge conflict or if you modify a parent change | 14:20 |
| AJaeger | pabelanger, why are you rebasing at all? | 14:20 |
| pabelanger | AJaeger: mostly because I dislike looking at [OUTDATED] patchs in gerrit | 14:21 |
| pabelanger | no other reason | 14:21 |
| fungi | pabelanger: the parent change situation might be automatable (though arguably if you modify a change in the middle of a series you would be better off doing so via rebase -i) | 14:21 |
| AJaeger | pabelanger, looking at https://review.openstack.org/#/c/21170 I don't understand why you rebased at all - you even lost some votes that way... | 14:21 |
| *** gaurangt has left #openstack-infra | 14:22 | |
| *** bharath has joined #openstack-infra | 14:22 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:22 | |
| *** aysyd has joined #openstack-infra | 14:23 | |
| pabelanger | AJaeger: Ya, I guess I should live with the outdated flag that gerrit prints, and deal with rebase only when jenkins does a -1 | 14:23 |
| AJaeger | pabelanger, where does it print outdated? | 14:23 |
| fungi | AJaeger: in the dependencies table of the webui | 14:24 |
| pabelanger | AJaeger: In patch A -> B series, the web will display [OUTDATED] for B. When you ammend A | 14:24 |
| pabelanger | I usually rebase, simply to remove the [OUTDATED] flag from the webui | 14:25 |
| AJaeger | fungi, pabelanger: Yes, that's right for those cases... | 14:25 |
| AJaeger | pabelanger, so, in this case you could have jsut rebased the second change on top of the first one instead of both... | 14:25 |
| openstackgerrit | Roman Prykhodchenko proposed openstack-infra/project-config: Run Python jobs for python-fuelclient https://review.openstack.org/214630 | 14:25 |
| cburroughs | clarkb, thanks for your help https://storyboard.openstack.org/#!/story/2000338 created | 14:25 |
| AJaeger | But no real problem... | 14:25 |
| *** olena has joined #openstack-infra | 14:26 | |
| pabelanger | Ya, nothing more them just me complaining | 14:26 |
| pabelanger | then* | 14:26 |
| *** bharath has quit IRC | 14:26 | |
| fungi | pabelanger: anyway, if it's your patch, updating a commit in the middle of the series is cleaner if you rebase -i starting from the parent of the change you want to modify and then set that one to edit, make your adjustment, and rebase --continue, then re-review the series | 14:26 |
| pabelanger | fungi: ya, going to try that next time | 14:26 |
| fungi | that way you don't end up with outdated child changes | 14:26 |
| pabelanger | ack | 14:26 |
| *** vlaza has quit IRC | 14:27 | |
| *** yamamoto has joined #openstack-infra | 14:27 | |
| *** yamamoto has quit IRC | 14:27 | |
| clarkb | svasheka what do you need to know about devstack gate? | 14:27 |
| *** hdd has joined #openstack-infra | 14:27 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix typo in ACL config for networking-calico https://review.openstack.org/214507 | 14:27 |
| clarkb | jeblair you are driving? I suppose thats likely your only option :( | 14:28 |
| *** olena has quit IRC | 14:28 | |
| *** yamamoto has joined #openstack-infra | 14:28 | |
| *** doug-fish has quit IRC | 14:28 | |
| *** doug-fish has joined #openstack-infra | 14:29 | |
| *** amitgandhinz has joined #openstack-infra | 14:30 | |
| *** Sree has quit IRC | 14:31 | |
| *** doug-fish has quit IRC | 14:32 | |
| svasheka | clarkb, I need to make adjustments, so it would copy artefacts after horizon integration tests | 14:32 |
| *** doug-fish has joined #openstack-infra | 14:32 | |
| svasheka | clarkb, And I don't know yet where and how | 14:32 |
| *** deepakcs has joined #openstack-infra | 14:33 | |
| *** deepakcs has quit IRC | 14:34 | |
| clarkb | svasheka https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n614 is where we do the base artifact collection. if it makes sense to have those artifacts on every devstack run you can add your items there | 14:35 |
| *** thcipriani|afk is now known as thcipriani | 14:35 | |
| austin81 | has anyone tried to build their own nodepool images lately and run into unbound variable issues? specifically CIRROS_VERSION in my case, build-image.sh keeps erroring out | 14:35 |
| *** flepied has joined #openstack-infra | 14:35 | |
| svasheka | clarkb, Thanks! | 14:35 |
| clarkb | if not you likely want to have your job(s) copy to the appropriate location after d-g runs | 14:35 |
| *** mtrovo has quit IRC | 14:35 | |
| svasheka | clarkb, It's horizon integration tests fail screenshots | 14:36 |
| clarkb | svasheka so probably only useful for the horizon tests I would copy them in the job to the logs dir so they get copied | 14:36 |
| *** glauco has quit IRC | 14:36 | |
| AJaeger | clarkb, regarding neutron reviews: Should we add all three folks to reviews? Or wait until they find it? | 14:36 |
| *** doug-fish has quit IRC | 14:37 | |
| *** fhubik has quit IRC | 14:37 | |
| clarkb | AJaeger I wasnt planning on adding them, was hoping neutron side would add them since this mostly comes from them | 14:37 |
| *** mriedem_meeting is now known as mriedem | 14:37 | |
| clarkb | but doesnt hurt to add them if you see reviews that need their input | 14:37 |
| svasheka | clarkb, is it should be done same place? | 14:38 |
| AJaeger | clarkb, ok. | 14:38 |
| svasheka | clarkb, I mean is there a way to do this only for horizon tests some place else ? | 14:38 |
| *** doug-fish has joined #openstack-infra | 14:38 | |
| *** tvanderwiel has joined #openstack-infra | 14:40 | |
| *** glauco_ has joined #openstack-infra | 14:40 | |
| *** tvanderwiel has left #openstack-infra | 14:40 | |
| *** sdake_ has joined #openstack-infra | 14:41 | |
| pabelanger | austin81: not here. Just did image updates yesterday | 14:41 |
| clarkb | svasheka it should be done in the jenkins job instead https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/horizon.yaml | 14:41 |
| fungi | austin81: fedora by any chance? | 14:42 |
| svasheka | clarkb, thanks alot | 14:42 |
| fungi | austin81: oh, i misread. when you said unbound variable issues my mind immediately jumped to recent proposed patches to fix selinux settings on fedora for the "unbound" dns resolver daemon | 14:43 |
| fungi | austin81: we publish all our image build logs at http://nodepool.openstack.org/ if you need to compare notes | 14:44 |
| *** sdake has quit IRC | 14:44 | |
| therve | Does anyone can help me with logstash? I can't seem to be able to find logs anymore | 14:44 |
| *** jcoufal_ has joined #openstack-infra | 14:45 | |
| austin81 | fungi: Runnuing on ubuntu. Thanks for the link! Debugging is a little trickier when the exit trap deletes all of its tmp dirs haha | 14:45 |
| clarkb | therve can you be more specific than that? what log specifically? | 14:45 |
| therve | clarkb, Sure. Trying to find failures like http://logs.openstack.org/86/208386/2/gate/gate-heat-dsvm-functional-orig-mysql/9ab3705/logs/ for example | 14:46 |
| *** tonytan4ever has joined #openstack-infra | 14:46 | |
| *** annegentle has joined #openstack-infra | 14:46 | |
| *** annegentle has quit IRC | 14:47 | |
| therve | I used to be able to do message:"stuff in console.html" | 14:47 |
| *** pblaho has joined #openstack-infra | 14:47 | |
| clarkb | therve that specific job is likely not indexed yet due to the backlog still in place after a cluster node failed and was recovered | 14:47 |
| *** annegentle has joined #openstack-infra | 14:47 | |
| AJaeger | clarkb, fungi, jeblair, do we have any guideline on naming of jobs? Ianw asked in https://review.openstack.org/#/c/214065/ whether the dsvm jobs should include "neutron" in it. | 14:48 |
| therve | clarkb, Ah, that's interesting information. How much log is there? | 14:48 |
| *** jcoufal has quit IRC | 14:48 | |
| clarkb | you should be able to still search like that but there is a fairly large delay right now I think | 14:48 |
| annegentle | fungi: waahh, how'd i miss the conflict with keystone meeting? I specifically looked at the calendar :( | 14:48 |
| clarkb | therve you can check logstash for the most recent console.html content to get a rough idea | 14:48 |
| therve | clarkb, I've noticed that logs are now all html now too. Isn't that an issue for indexing? | 14:49 |
| odyssey4me | we've been struggling for two weeks with getting merges into our master branch which are consistently failing gate checks whenever the build executes on hpcloud | 14:49 |
| annegentle | fungi: oh, I see. I meant to propose 1700, will revise | 14:49 |
| odyssey4me | only on hpcloud - rax nodes build just fine | 14:50 |
| clarkb | therve the log server also serves plain text, that is what we index | 14:50 |
| odyssey4me | also, we're seeing very slow build execution on hpcloud nodes | 14:50 |
| therve | Hum | 14:50 |
| therve | clarkb, eyJzZWFyY2giOiJmaWxlbmFtZTpcImxvZ3Mvc2NyZWVuLXMtYWNjb3VudC50eHRcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiOTAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJtb2RlIjoiIiwiYW5hbHl6ZV9maWVsZCI6IiIsInN0YW1wIjoxNDM5OTk1ODI4MTYzfQ shows some weird html to me | 14:50 |
| *** pal has joined #openstack-infra | 14:50 | |
| clarkb | therve by default depends on what your http client reports as acceptable but you can force it to plaintext | 14:50 |
| therve | For example | 14:50 |
| clarkb | therve that is just a random string to me I think you need to minify the url | 14:51 |
| therve | Ah sorry | 14:51 |
| odyssey4me | I need some help getting to the bottom of this - oddly enough it's only happening with liberty code. kilo/juno builds are fine - so I'm betting that there's an image/package difference somewhere that's causing it. Any thoughts? | 14:51 |
| therve | clarkb, I searched for filename:"logs/screen-s-account.txt" | 14:51 |
| clarkb | odyssey4me hpcloud is slower generally yes | 14:51 |
| *** fedexo has joined #openstack-infra | 14:52 | |
| *** erikwilson has joined #openstack-infra | 14:53 | |
| odyssey4me | clarkb ok, so that's known - the slowness is so bad sometimes that our builds time out after two hours... in rax they complete in 70 mins | 14:54 |
| *** dangers_away is now known as dangers | 14:54 | |
| clarkb | odyssey4me: do the hpcloud nodes fail in the same way each time? | 14:54 |
| clarkb | odyssey4me: if I hda to guess the hpcloud slowness is actually network IO problems since all that container stuff doesn't make use of any of the caching we have done for you | 14:55 |
| odyssey4me | clarkb so I'd like to work on improving our use of any of the caching mechanisms - it would help reduce our build time | 14:55 |
| clarkb | therve: hrm | 14:55 |
| *** regXboi has joined #openstack-infra | 14:55 | |
| clarkb | odyssey4me: git repos are all in /opt/git and in theory we have debs/rpms in the package manager appropriate cache location on the host | 14:56 |
| clarkb | (rpms don't currently get cached on dib built nodes but should on snaphost built images iirc) | 14:56 |
| clarkb | therve: I think we may have broken the plaintext selectability | 14:56 |
| odyssey4me | clarkb and yes, the failure is one of two things: 1) it runs forever until build timeout, or 2) it fails tempest scenario checks in a way that seems to possibly relate to cinder, but it's not certain exactly | 14:56 |
| clarkb | jhesketh: ^ side effect of the recent sreve these things as http change maybe? | 14:56 |
| *** mtrovo1 has joined #openstack-infra | 14:57 | |
| clarkb | odyssey4me: ok so first step is likely make use of git cache in /opt/git and make use of host package cache and see if we can stop the job timeouts | 14:57 |
| *** puranamr has quit IRC | 14:57 | |
| therve | clarkb, Ah. At least that would mean I'm not insane. | 14:57 |
| *** mtrovo1 is now known as mtrovo2 | 14:58 | |
| odyssey4me | clarkb can you point me to an example of something that uses those? | 14:58 |
| clarkb | odyssey4me: devstack-gate | 14:58 |
| *** mtrovo2 is now known as mtrovo3 | 14:58 | |
| clarkb | therve: confirmed a raw wget returns html when it should return plaintext | 14:59 |
| clarkb | odyssey4me: but then apt/yum automagically use the cache as is so I think for containers you likely want to bind mount it in | 14:59 |
| clarkb | odyssey4me: /var/cache/apt on ubuntu | 15:00 |
| clarkb | odyssey4me: https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n436 is the location where we grab the git cache repo then update it | 15:00 |
| *** geoffarnold has quit IRC | 15:01 | |
| *** dims has quit IRC | 15:01 | |
| *** dims has joined #openstack-infra | 15:01 | |
| *** peristeri has quit IRC | 15:01 | |
| *** sabeen has joined #openstack-infra | 15:02 | |
| openstackgerrit | Sergey Lukjanov proposed openstack-infra/project-config: Move experimental scenario gate jobs for Sahara to non-voting check https://review.openstack.org/214653 | 15:02 |
| openstackgerrit | Sergey Lukjanov proposed openstack-infra/project-config: Make Sahara scenario jobs voting https://review.openstack.org/214654 | 15:02 |
| clarkb | therve: so I would expect logstash to be a bit wonky until that is fixed, sorry | 15:02 |
| *** zeih has joined #openstack-infra | 15:02 | |
| *** BharatK has quit IRC | 15:02 | |
| *** yfried|afk has joined #openstack-infra | 15:03 | |
| odyssey4me | thanks clarkb let me look into consuming the caching | 15:03 |
| odyssey4me | clarkb with regards to the images - are they uniform? | 15:03 |
| odyssey4me | ie are they the same across both clouds and all regions within the cloud? | 15:04 |
| clarkb | odyssey4me: mostly, some are built using snapshots and some are built using disk image builder so there is some variance | 15:04 |
| clarkb | odyssey4me: but the key bits of package cache and git cache should all be there | 15:04 |
| clarkb | we also cache the cirros image for devstack if that is useful to you | 15:05 |
| timrc | crinkle, Hi. So https://review.openstack.org/#/c/203868 got me thinking. I feel like cgit::selinux assumes that selinux is permissive or enabled but doesn't take into account systems in which it's been disabled (who would ever do that!?) -- I do not believe semanage or any other selinux command needs to be executed if the policy has been Disabled. Do you agree? | 15:05 |
| *** dims_ has joined #openstack-infra | 15:05 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: jenkins: add copy-puppet-logs publish to integration job https://review.openstack.org/214655 | 15:05 |
| timrc | This change would probably go in cgit::init to check the policy state. | 15:05 |
| *** mtrovo3 has quit IRC | 15:05 | |
| *** ajmiller_ has joined #openstack-infra | 15:05 | |
| *** dims has quit IRC | 15:06 | |
| *** zeih has quit IRC | 15:06 | |
| clarkb | therve: ya even passing ?content-type=text/plain returns html so definitely a bug in the log server wsgi app | 15:06 |
| odyssey4me | clarkb by image consistency I mean the devstack-trusty image specifically, which is what we use | 15:07 |
| odyssey4me | and yes, the cirros image would be handy too for the tempest run | 15:07 |
| clarkb | odyssey4me: yes on rackspace its snapshot built and on hpcloud its disk image builder built | 15:07 |
| *** zul has joined #openstack-infra | 15:07 | |
| odyssey4me | ah ok, I understand | 15:07 |
| clarkb | odyssey4me: but the apt cache should exist on both and the git cache should exist on both | 15:07 |
| openstackgerrit | Merged openstack-infra/project-config: Run Python jobs for python-fuelclient https://review.openstack.org/214630 | 15:09 |
| clarkb | odyssey4me: I think the cirros image cache is in ~jenkins/cache/files | 15:09 |
| *** ajmiller has quit IRC | 15:09 | |
| odyssey4me | clarkb sure, but the speed of the builds is a secondary concern for me right now - the main concern is to figure out what's causing minimum_basic_scenario to fail only in hpcloud and only in liberty code from liberty-2 onwards | 15:10 |
| clarkb | odyssey4me: ya a little below the git cache rsync stuff it checks for ~/cache/files and the current user there should be jenkins | 15:10 |
| clarkb | odyssey4me: I think the speed of the builds is the fail | 15:10 |
| *** flepied has quit IRC | 15:10 | |
| clarkb | at least I think it is a performance problem so make performance better than double check | 15:10 |
| fungi | odyssey4me: you might consider testing the ubuntu-trusty image instead of devstack-trusty, which is dib-built in all our providers | 15:11 |
| clarkb | also its hard to debug one fail if another keeps hitting you (the timeout) | 15:11 |
| odyssey4me | clarkb yeah, I'm thinking that perhaps a reduction in threads, etc may help - let's try that avenue | 15:11 |
| clarkb | so fix issue with a known fix | 15:11 |
| clarkb | then move on | 15:11 |
| odyssey4me | fungi it may be worth a try to add that as a non-voting job to try it out - let me get on that then work with the team to try the various angles suggested - thanks guys | 15:12 |
| *** moravec has quit IRC | 15:13 | |
| *** dannywilson has joined #openstack-infra | 15:13 | |
| *** pvaneck has joined #openstack-infra | 15:13 | |
| *** erikmwilson_ has joined #openstack-infra | 15:13 | |
| fungi | odyssey4me: if nothing else, it will rule out the image differences and put it squarely in the realm of provider/flavor differences | 15:13 |
| odyssey4me | fungi yep, that's why I like the idea | 15:13 |
| *** dannywilson has quit IRC | 15:14 | |
| claudiub | fungi: hi. can you link to some procedure / steps that we have to take for the rename from stackforge to openstack? | 15:14 |
| *** dannywilson has joined #openstack-infra | 15:14 | |
| *** pcrews has quit IRC | 15:15 | |
| *** erikwilson has quit IRC | 15:16 | |
| *** jeadr has quit IRC | 15:17 | |
| *** flepied has joined #openstack-infra | 15:17 | |
| *** coolsvap|away is now known as coolsvap | 15:18 | |
| *** erikmwilson_ has quit IRC | 15:18 | |
| *** yamahata has joined #openstack-infra | 15:18 | |
| *** jeadr has joined #openstack-infra | 15:18 | |
| *** bpokorny has joined #openstack-infra | 15:18 | |
| *** pal has quit IRC | 15:19 | |
| *** dims_ has quit IRC | 15:19 | |
| *** dims has joined #openstack-infra | 15:19 | |
| *** sabeen3 has joined #openstack-infra | 15:19 | |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/puppet-cgit: Manage selinux policy for cgit https://review.openstack.org/214659 | 15:20 |
| *** sabeen has quit IRC | 15:20 | |
| timrc | Oops^^ | 15:21 |
| fungi | claudiub: http://lists.openstack.org/pipermail/openstack-infra/2015-August/003069.html outlines our plan. we're going to create a wiki page for projects to register their interest, and send a follow-up announcement once we've done that | 15:21 |
| timrc | Oh interesting.. maybe my change does apply here... | 15:21 |
| claudiub | fungi: cool, looking forward for that. :) reading | 15:21 |
| timrc | it seems like we only manage selinux policy mode for load balancer... | 15:21 |
| *** glauco_ has quit IRC | 15:22 | |
| *** coolsvap is now known as coolsvap|away | 15:22 | |
| *** moravec has joined #openstack-infra | 15:23 | |
| *** zul has quit IRC | 15:23 | |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/puppet-cgit: Manage selinux policy for cgit https://review.openstack.org/214667 | 15:23 |
| *** doug-fish has quit IRC | 15:24 | |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/puppet-cgit: Manage selinux policy for cgit https://review.openstack.org/214667 | 15:24 |
| timrc | Wow I suck at puppet. | 15:24 |
| *** BharatK has joined #openstack-infra | 15:24 | |
| *** doug-fish has joined #openstack-infra | 15:24 | |
| timrc | clarkb, pleia2 Really should have interviewed me a bit better :) Jeez | 15:24 |
| mordred | timrc: I just type random strings of characters until one of them is valid puppet syntax | 15:24 |
| yolanda | ++ | 15:25 |
| timrc | mordred, Hah. | 15:25 |
| yolanda | :) | 15:25 |
| *** yfried|afk has quit IRC | 15:25 | |
| yolanda | i just need at leat 5 iterations to make puppet lint and syntax pass :) | 15:25 |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/puppet-cgit: Manage selinux policy for cgit https://review.openstack.org/214667 | 15:26 |
| timrc | There we go... I think maybe I should listen to puppet-lint when it complains in my vim. | 15:26 |
| *** vadivelp has quit IRC | 15:27 | |
| *** ajmiller_ is now known as ajmiller | 15:27 | |
| mordred | yolanda: my _real_ method is to write bad puppet then show it to nibalizer so he gets unhappy and fixes it for me :) | 15:28 |
| *** k4n0 has quit IRC | 15:28 | |
| fungi | timrc: or run tox locally before submitting for review | 15:28 |
| crinkle | timrc: o/ | 15:29 |
| yolanda | mordred,i can try do the same here :) | 15:29 |
| fungi | writing ugly software is the easiest way to take advantage of perfectionists | 15:30 |
| timrc | mordred, NaaS? Nice. | 15:30 |
| timrc | fungi, Another fine strategy. | 15:30 |
| yolanda | i just can't make arrows aligned on first step, i need to fail at least one or i'm not happy :) | 15:31 |
| therve | clarkb, Anything I can do to help fix that issue? | 15:31 |
| *** bswartz has quit IRC | 15:31 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added ACL for ironic-webclient https://review.openstack.org/214381 | 15:31 |
| clarkb | therve need to patch os-loganalyze to not enforce html so strictly | 15:32 |
| *** sputnik13 has joined #openstack-infra | 15:32 | |
| clarkb | I can do it once this baby is fed | 15:32 |
| openstackgerrit | Marton Kiss proposed openstack-infra/groups: Refactor bleed margins of bootstrap theme https://review.openstack.org/214672 | 15:32 |
| timrc | mordred, Maybe you can put clarkb's kids to work writing your puppet code for you? | 15:33 |
| mordred | timrc: they'd do a great job I'm sure | 15:33 |
| *** erikwilson has joined #openstack-infra | 15:33 | |
| fungi | clarkb: did you delete those large db dumps jeblair mentioned you had on etherpad.o.o? this morning's backup completed in a mere 3 hours | 15:33 |
| therve | clarkb, I'll have a look :) | 15:33 |
| fungi | as opposed to trying to run all day | 15:33 |
| clarkb | therve look for where should_be_html is called we check it too late so a few lines above need changing | 15:34 |
| clarkb | fungi I did not | 15:34 |
| fungi | hrm. something sure did speed it up | 15:34 |
| clarkb | I think we arent swapping anymore so its faster | 15:34 |
| fungi | oh, could have been backups fighting runaway abiword yesterday | 15:35 |
| fungi | duelling banjos | 15:35 |
| *** pal has joined #openstack-infra | 15:37 | |
| nibalizer | mordred: lol | 15:37 |
| *** bswartz has joined #openstack-infra | 15:37 | |
| *** FallenPegasus has joined #openstack-infra | 15:37 | |
| nibalizer | mordred: its working for now but it's not sustainable | 15:37 |
| timrc | nibalizer, Are you suggesting mordred take a break? JK ;) | 15:38 |
| fungi | nibalizer: we just need to multi-thread you | 15:38 |
| *** tsekiyama has joined #openstack-infra | 15:38 | |
| pabelanger | how I picture mordred writting puppet: https://goo.gl/1EKZeq | 15:38 |
| fungi | for better scalability | 15:38 |
| therve | clarkb, https://github.com/openstack-infra/os-loganalyze/blob/master/etc/os_loganalyze/wsgi.conf looks suspicious | 15:39 |
| *** nadya_ has quit IRC | 15:39 | |
| timrc | pabelanger, That is almost perfect. It just needs an empty glass on the desk. | 15:39 |
| *** sshnaidm has quit IRC | 15:39 | |
| *** scheuran has joined #openstack-infra | 15:40 | |
| *** Swami has joined #openstack-infra | 15:41 | |
| *** minwang2 has joined #openstack-infra | 15:41 | |
| *** flepied has quit IRC | 15:42 | |
| *** che-arne has quit IRC | 15:43 | |
| *** sanjayu_ has joined #openstack-infra | 15:43 | |
| *** pal has quit IRC | 15:44 | |
| yolanda | pabelanger ++ | 15:44 |
| *** tonytan4ever has quit IRC | 15:45 | |
| *** erikwilson has quit IRC | 15:45 | |
| *** zul has joined #openstack-infra | 15:45 | |
| *** pal has joined #openstack-infra | 15:46 | |
| *** thiagop has joined #openstack-infra | 15:46 | |
| thiagop | gate problems? | 15:47 |
| *** sanjayu has quit IRC | 15:48 | |
| *** tonytan4ever has joined #openstack-infra | 15:48 | |
| *** dims has quit IRC | 15:49 | |
| *** sdake_ is now known as sdake | 15:49 | |
| *** dims has joined #openstack-infra | 15:49 | |
| *** scheuran has quit IRC | 15:50 | |
| *** minwang2 has quit IRC | 15:50 | |
| *** dprince has quit IRC | 15:51 | |
| openstackgerrit | Anne Gentle proposed openstack-infra/irc-meetings: Proposal to move the OpenStack cross-project meeting to 1700 Tues. https://review.openstack.org/214605 | 15:51 |
| *** pc_m has quit IRC | 15:52 | |
| *** pc_m has joined #openstack-infra | 15:53 | |
| *** dims_ has joined #openstack-infra | 15:53 | |
| *** hyakuhei has joined #openstack-infra | 15:53 | |
| *** dims has quit IRC | 15:54 | |
| *** flepied has joined #openstack-infra | 15:54 | |
| fungi | thiagop: care to elaborate? looks like it's churning through changes like mad | 15:54 |
| openstackgerrit | Derek Higgins proposed openstack/diskimage-builder: Remove grup https://review.openstack.org/214684 | 15:54 |
| *** Sukhdev has joined #openstack-infra | 15:54 | |
| thiagop | just asking if the gate is slow by any known problem fungi | 15:55 |
| fungi | thiagop: lgtm | 15:55 |
| *** zul has quit IRC | 15:55 | |
| *** arxcruz has quit IRC | 15:56 | |
| mordred | pabelanger: hahahaha | 15:56 |
| thiagop | fungi: I was seeing some jobs that had finished working already and didn't get removed, but now seems fine indeed | 15:58 |
| *** cebruns_ is now known as cebruns | 16:01 | |
| *** fedexo has quit IRC | 16:02 | |
| *** hyakuhei has quit IRC | 16:03 | |
| *** kiran-r has joined #openstack-infra | 16:03 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Remove heat pin https://review.openstack.org/214348 | 16:03 |
| *** geoffarnold has joined #openstack-infra | 16:03 | |
| *** otter768 has joined #openstack-infra | 16:04 | |
| *** mestery has joined #openstack-infra | 16:04 | |
| *** cbader has joined #openstack-infra | 16:05 | |
| *** flepied has quit IRC | 16:07 | |
| *** flaviosr has joined #openstack-infra | 16:07 | |
| *** spzala_ has joined #openstack-infra | 16:07 | |
| *** fawadkhaliq has joined #openstack-infra | 16:08 | |
| odyssey4me | clarkb to have a non-voting job, do I just add a {branch-designator} to the job name with '-nv' as the value? | 16:08 |
| *** glauco has joined #openstack-infra | 16:08 | |
| *** otter768 has quit IRC | 16:08 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/os-loganalyze: Only provide html if client supports it https://review.openstack.org/214692 | 16:09 |
| clarkb | therve: ^ I think that should fix it | 16:09 |
| clarkb | odyssey4me: yes we have a blanket rule that any job matching that is non voting in zuul | 16:09 |
| therve | clarkb, Sounds good indeed. | 16:10 |
| *** sthillma has joined #openstack-infra | 16:10 | |
| *** bharath has joined #openstack-infra | 16:10 | |
| *** spzala has quit IRC | 16:11 | |
| *** spzala_ is now known as spzala | 16:11 | |
| odyssey4me | clarkb thanks | 16:11 |
| clarkb | greghaynes: hrm adding deboostrap as documented to the devstack plugin didn't work will have to do more digging | 16:11 |
| *** kmartin has joined #openstack-infra | 16:11 | |
| *** jeadr has quit IRC | 16:12 | |
| *** sharikapongubala has quit IRC | 16:13 | |
| *** jeadr has joined #openstack-infra | 16:13 | |
| *** ajmiller has quit IRC | 16:13 | |
| *** ayoung has joined #openstack-infra | 16:13 | |
| *** bharath has quit IRC | 16:15 | |
| *** hyakuhei has joined #openstack-infra | 16:17 | |
| *** rguillebert has quit IRC | 16:17 | |
| *** ajmiller has joined #openstack-infra | 16:18 | |
| *** jcoufal_ has quit IRC | 16:18 | |
| *** dprince has joined #openstack-infra | 16:19 | |
| *** gyee has joined #openstack-infra | 16:20 | |
| *** spzala has quit IRC | 16:22 | |
| *** FallenPegasus has quit IRC | 16:22 | |
| *** unicell has quit IRC | 16:23 | |
| SpamapS | greghaynes: remind me what the one thing you're going to do next is for infra-cloud. baremetal00 ? | 16:24 |
| greghaynes | SpamapS: bifrost supporting vlan config drive | 16:24 |
| SpamapS | greghaynes: ok. Can I take all 4 boxes enrolled in baremetal01 and wipe them out, or are you using some of them? | 16:25 |
| greghaynes | SpamapS: take them all | 16:25 |
| SpamapS | greghaynes: ok. :) | 16:26 |
| TheJulia | greghaynes: do you need me to do something with that, or are going to write the magical module to create the dict. | 16:26 |
| *** moravec has quit IRC | 16:26 | |
| SpamapS | The Magical Modules is my new band. | 16:27 |
| greghaynes | TheJulia: hrm, I was going to just hack on the jinja for now, I thought the module thing is a nice future enhancement | 16:27 |
| *** shashank_hegde has joined #openstack-infra | 16:27 | |
| *** _kiran_ has joined #openstack-infra | 16:27 | |
| greghaynes | TheJulia: I dont think there is any technical reason it needs to be switched off jinja for that right? | 16:27 |
| *** minwang2 has joined #openstack-infra | 16:28 | |
| greghaynes | TheJulia: Were in "charge ahead and boot the cloud mode", so if thats too hacky to merge you think I wont be offended, we can keep a patch around for now | 16:28 |
| TheJulia | no, not really, if you just want to stub it in for now, I could go back and re-factor the jinja to python | 16:28 |
| SpamapS | famous last words | 16:29 |
| greghaynes | yea :/ | 16:29 |
| jesusaurus | clarkb: does that address the issue where we have a bunch of processed html indexed into es? | 16:29 |
| TheJulia | yeah, I'd prefer you guys not carry a patch like that for any period of time | 16:29 |
| *** dizquierdo has quit IRC | 16:29 | |
| *** rguillebert has joined #openstack-infra | 16:30 | |
| clarkb | jesusaurus ya | 16:30 |
| *** jistr has quit IRC | 16:30 | |
| TheJulia | but propose what works for you upstream and we can then see where it goes from there | 16:30 |
| greghaynes | TheJulia: ok. SGTM | 16:30 |
| jesusaurus | sweet, ive been meaning to find the time to look into that | 16:30 |
| *** kiran-r has quit IRC | 16:31 | |
| *** ashleighfarnham has joined #openstack-infra | 16:31 | |
| *** alexsyip has joined #openstack-infra | 16:32 | |
| zaro | morning | 16:32 |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Add ubuntu-trusty node to os-ansible-deployment https://review.openstack.org/214700 | 16:33 |
| *** esmute_ has joined #openstack-infra | 16:33 | |
| odyssey4me | clarkb ^ is to try out fungi's suggestion | 16:33 |
| *** pcrews has joined #openstack-infra | 16:34 | |
| fungi | it's possible the parameter function which matches jobs with "dsvm" in the name may override that | 16:35 |
| fungi | peeking now to see | 16:35 |
| odyssey4me | fungi ubuntu-trusty appears not to be used in very many places - I take it this is a new thing? | 16:37 |
| SpamapS | hrm | 16:38 |
| SpamapS | 2015-08-19 16:37:49.494 4519 ERROR ironic.drivers.modules.ipmitool [-] IPMI power off timed out after 6 retries on node 49d5d5ba-a249-4d65-8bb0-749765a3a5bb. | 16:38 |
| odyssey4me | fungi clarkb also, this would help us to keep things moving: https://review.openstack.org/214531 | 16:38 |
| *** sharikapongubala has joined #openstack-infra | 16:39 | |
| *** pabelanger has quit IRC | 16:39 | |
| fungi | odyssey4me: yeah, the ubuntu-trusty image is a minimal dib image. so far we've worked out jobs that can run devstack-gate and nova unit tests on it. the plan is to migrate things using bare-trusty and devstack-trusty onto ubuntu-trusty and then retire the first two | 16:39 |
| *** dims_ has quit IRC | 16:39 | |
| *** puranamr has joined #openstack-infra | 16:39 | |
| *** pblaho has quit IRC | 16:39 | |
| *** nadya has joined #openstack-infra | 16:39 | |
| *** dims has joined #openstack-infra | 16:39 | |
| *** pc_m_ has joined #openstack-infra | 16:40 | |
| mordred | Shrews, clarkb, fungi: I'm going to tag an os-client-config release. I do not expect it to break the gate like last time | 16:40 |
| *** puranamr has quit IRC | 16:40 | |
| odyssey4me | fungi ah - we're happy with a very minimal image... we've had to implement package removals and iptables changes in our builds when using the devstack image, otherwise stuff breaks :p | 16:40 |
| *** zul has joined #openstack-infra | 16:40 | |
| * fungi has to run and babysit carpet cleaners at the old rental. will be back on from wireless modem in the car fairly soon | 16:40 | |
| fungi | mordred: sounds great | 16:40 |
| Shrews | mordred: there were concerns | 16:40 |
| clarkb | the iptables rules are still there | 16:40 |
| mordred | Shrews: there were? | 16:41 |
| *** puranamr has joined #openstack-infra | 16:41 | |
| clarkb | and package removals doesnt compute but ok | 16:41 |
| clarkb | (the package list is already fairly small) | 16:41 |
| Shrews | mordred: oh, terry tested it. nm | 16:41 |
| *** jerryz has joined #openstack-infra | 16:41 | |
| odyssey4me | clarkb things may have changed, but there were mysql libraries there which conflict with the mariadb libraries we use | 16:41 |
| fungi | i think we still need a change merged to stop installing cloud-utils since it indirectly drags in python-requests distro package | 16:42 |
| *** pc_m has quit IRC | 16:42 | |
| clarkb | odyssey4me shouldnt be on devstack nodea | 16:42 |
| fungi | but i believe that's in dib's simple-init element right now | 16:42 |
| odyssey4me | we have plans to split the monolithic all-in-one into a multi-node gate check, but haven't had enough time to figure that one out | 16:42 |
| * fungi will bbiab | 16:42 | |
| *** pabelanger has joined #openstack-infra | 16:42 | |
| clarkb | we let devstack install db libs | 16:42 |
| anteaya | fungi: happy babysitting | 16:43 |
| timrc | crinkle, Okay I looked at this downstream and I think I have a good idea of how to move forward. I'll try to get patches out soon-ish. | 16:43 |
| timrc | re:selinux | 16:43 |
| odyssey4me | clarkb the same build script is used for local builds in test vm's etc, so we leave the package removals - happy to know that we're getting bare images :) | 16:43 |
| *** nadya has quit IRC | 16:44 | |
| *** pcrews has quit IRC | 16:44 | |
| clarkb | also I didnt realize ubuntu trusty had mariadb packages | 16:44 |
| *** pelix has quit IRC | 16:44 | |
| crinkle | timrc: neato | 16:45 |
| odyssey4me | clarkb we add the repo :) | 16:45 |
| clarkb | maybe we can switch to it across the board to simplify at some point (mordred probably hates this idea) | 16:45 |
| * mordred doesn't care at all | 16:45 | |
| clarkb | ah ok thats another thibg you shouldnt do for reliability reasosn but its your job | 16:45 |
| *** jtomasek has quit IRC | 16:46 | |
| odyssey4me | clarkb but perhaps we should spend a little time discussing how we could do things better - some fresh eyes would help | 16:46 |
| odyssey4me | but I owe you some work anyway on the ELK stack :p | 16:46 |
| *** ashleighfarnham has quit IRC | 16:46 | |
| clarkb | the simple thing is used the cached mysql packages | 16:46 |
| *** zul has quit IRC | 16:47 | |
| greghaynes | SpamapS: In here might be better - so what you could do is deploy to all of them, see which ones fail, then remove those from inventory | 16:47 |
| odyssey4me | clarkb so to query fungi's comment in https://review.openstack.org/214700 - do we even need dsvm in the name ? | 16:47 |
| odyssey4me | as far as I recall, that was only a requirement when using the devstack vm | 16:48 |
| clarkb | I would have to look and see how we did the other ubuntu-trusty tests but I belice you dont because that | 16:48 |
| SpamapS | greghaynes: Yeah that was the plan. I kind of thought we already had a handle on that. | 16:48 |
| SpamapS | greghaynes: I'm tempted to scrape the ilo version using SSH first. 1.20 is really, really old and IIRC, is just known to fail. | 16:49 |
| greghaynes | SpamapS: I deployed all of them, some did fail, I didnt really take note. I was mostly just spinning on getting a single node working how we wanted since then | 16:49 |
| mordred | SpamapS, greghaynes: did we ever get anywhere with hardware remediations? or is that what we're working on now? | 16:49 |
| SpamapS | what I hate is you have to go into the web interface to reset the ilo :-P | 16:49 |
| *** zul has joined #openstack-infra | 16:49 | |
| SpamapS | mordred: nope. They're freaked out because their hardware inventory in (whatever they call Holly now) is all wrong. | 16:49 |
| clarkb | in my experience tge only way to use hp ilo is via .net web thing | 16:50 |
| mordred | SpamapS: oh! excellent | 16:50 |
| clarkb | in IE | 16:50 |
| SpamapS | clarkb: the SSH is fine. until its not. ;) | 16:50 |
| greghaynes | SpamapS: We havent asked them for anything, no. The fear was if we ask them to replace all the NICs or similar then we kind of have to expect to be out of work for a while during then | 16:50 |
| mordred | SpamapS: are they working with you to get their inventory fixed? | 16:50 |
| SpamapS | clarkb: and they actually fixed it for Firefox ~2012-ish | 16:50 |
| clarkb | ah so right when I stopped needing it :) | 16:50 |
| SpamapS | clarkb: so if you have a 2012 or later ilo firmware, it works perfectly in Firefox. | 16:50 |
| SpamapS | mordred: no | 16:51 |
| mordred | SpamapS: yay! | 16:51 |
| mordred | SpamapS: they just freaked out and ran away? :) | 16:51 |
| SpamapS | mordred: they mostly went /o\ thats wrong. and then o_O we have to fix it. | 16:51 |
| *** earlephilhower has quit IRC | 16:51 | |
| *** derekh has quit IRC | 16:51 | |
| SpamapS | greghaynes: did we ever end up backing up /home/shared somewhere? | 16:53 |
| * SpamapS backs it up now regardless of the answer | 16:53 | |
| *** pabelanger has quit IRC | 16:53 | |
| *** atuvenie has joined #openstack-infra | 16:53 | |
| *** moravec has joined #openstack-infra | 16:53 | |
| *** rguillebert has quit IRC | 16:53 | |
| greghaynes | SpamapS: I have been pulling the bits of it that are useful onto the new bastion, and I think I got all the stuff we actually want in the ubuntu homedir. ++ on doing a tar up of it too though | 16:54 |
| *** tonytan4ever has quit IRC | 16:54 | |
| *** pvaneck has quit IRC | 16:54 | |
| *** unicell has joined #openstack-infra | 16:55 | |
| openstackgerrit | Merged openstack-infra/project-config: Reduce openstack-ansible commit check timeout https://review.openstack.org/214531 | 16:55 |
| openstackgerrit | Khai Do proposed openstack-infra/jenkins-job-builder: Add MultiJob Project Documentation. https://review.openstack.org/212666 | 16:56 |
| *** doug-fish has quit IRC | 16:56 | |
| *** doug-fish has joined #openstack-infra | 16:56 | |
| odyssey4me | clarkb ok, so I've inspected zuul/openstack_functions.py and see the workarounds for puppet, kolla, etc - I'm just finding myself wondering why have those workaround when not using dsvm in the name would have the same effect (it seems to me) of trusting the job's specification of a node... does the dsvm moniker do some other magic too? | 16:57 |
| odyssey4me | fungi ^ | 16:57 |
| clarkb | because of branches | 16:57 |
| clarkb | we test old branches on older releases | 16:57 |
| odyssey4me | ok, so best to just follow the pattern | 16:57 |
| *** sergmelikyan has quit IRC | 16:57 | |
| odyssey4me | cool, will do that then | 16:58 |
| clarkb | once juno is gone that all gets massively simpler | 16:58 |
| odyssey4me | haha, yes - our lives simplify too : | 16:58 |
| clarkb | may need simplification now even but ya branches | 16:58 |
| *** sergmelikyan has joined #openstack-infra | 16:59 | |
| *** _kiran_ has quit IRC | 16:59 | |
| odyssey4me | clarkb I take it that the {name} macro won't translate into openstack_functions? ie do I have to change the job name in jenkins/jobs/projects and the macro too? | 17:00 |
| clarkb | you can pass it into the macro if it accepts {name} | 17:01 |
| clarkb | the run tox macro should have examples since it takes an envlist | 17:01 |
| *** pelix has joined #openstack-infra | 17:01 | |
| odyssey4me | let me take a crack at this and we'll see whether I get it right | 17:02 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Validate and set compare types in gerrit trigger https://review.openstack.org/202180 | 17:02 |
| *** sergmelikyan has quit IRC | 17:03 | |
| *** sharikapongubala has quit IRC | 17:03 | |
| *** ivar-lazzaro has joined #openstack-infra | 17:04 | |
| *** cbader has quit IRC | 17:04 | |
| *** cbader has joined #openstack-infra | 17:04 | |
| *** unicell has quit IRC | 17:04 | |
| *** unicell has joined #openstack-infra | 17:04 | |
| *** pabelanger has joined #openstack-infra | 17:04 | |
| *** resker has joined #openstack-infra | 17:04 | |
| *** pal has quit IRC | 17:05 | |
| *** sanjayu has joined #openstack-infra | 17:05 | |
| *** sharikapongubala has joined #openstack-infra | 17:06 | |
| *** kmartin has quit IRC | 17:08 | |
| *** kmartin has joined #openstack-infra | 17:08 | |
| dougwig | hi infra, is etherpad angry again? | 17:08 |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Add ubuntu-trusty node to os-ansible-deployment https://review.openstack.org/214700 | 17:08 |
| *** fifieldt has joined #openstack-infra | 17:08 | |
| *** sanjayu_ has quit IRC | 17:08 | |
| *** esker has quit IRC | 17:08 | |
| fifieldt | etherpad.openstack.org - 503 | 17:08 |
| odyssey4me | clarkb better? https://review.openstack.org/214700 | 17:09 |
| fifieldt | just dropped 40 people at an inopportune time :| | 17:09 |
| fifieldt | is the nightly backup running again? :) | 17:10 |
| jeblair | fifieldt: i'll check | 17:10 |
| *** cbader has quit IRC | 17:10 | |
| *** cbader has joined #openstack-infra | 17:10 | |
| *** mrmartin has quit IRC | 17:10 | |
| jeblair | fifieldt: what's the curret pad? | 17:10 |
| fifieldt | appreciated :D | 17:10 |
| clarkb | fwiw yesterday I had no disconnwcts | 17:11 |
| clarkb | just occasional slowness | 17:11 |
| *** asselin_ has joined #openstack-infra | 17:11 | |
| clarkb | (once jeblair clued is ibto the etherpads in use) | 17:11 |
| anteaya | clarkb: I wonder if someone's browser type/version was doing something strange when connected | 17:11 |
| jeblair | i don't see either a runaway tar or abiword, and node is using a large but not excessive amount of ram. so i think we're still at the state we were yesterday afternoon | 17:12 |
| anteaya | as ops meetup had problems certainly all of yesterday morning | 17:12 |
| clarkb | anteaya the morning issues were coreected | 17:12 |
| jeblair | looks like it's https://etherpad.openstack.org/p/PAO-ops-deployment-tips | 17:12 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: jenkins/puppet: add missing builders to integration job https://review.openstack.org/214716 | 17:13 |
| anteaya | we discovered once that HenryG had a browser plugin that added extra empty lines to any open etherpad | 17:13 |
| anteaya | clarkb: yes when the download was stopped | 17:13 |
| anteaya | just wondering why the ops are having such a hard time with it | 17:13 |
| anteaya | speculating as it were | 17:13 |
| *** markus_z has quit IRC | 17:14 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image uploads using gearman https://review.openstack.org/197722 | 17:14 |
| *** mestery has quit IRC | 17:14 | |
| openstackgerrit | will soula proposed openstack-infra/jenkins-job-builder: Add Ability to use the AWS Cloudformation Plugin https://review.openstack.org/202300 | 17:15 |
| *** SumitNaiksatam has quit IRC | 17:15 | |
| *** gaurangt has joined #openstack-infra | 17:16 | |
| *** sthillma has quit IRC | 17:16 | |
| *** sdake_ has joined #openstack-infra | 17:17 | |
| *** angdraug has joined #openstack-infra | 17:17 | |
| *** claudiub has quit IRC | 17:18 | |
| * HenryG winces | 17:18 | |
| fifieldt | FWIW, I checked with the network guy here and they weren't doing any interestingness with connections | 17:18 |
| jeblair | clarkb: can you load up https://etherpad.openstack.org/p/PAO-ops-deployment-tips to be an offsite canary? | 17:18 |
| jeblair | clarkb: also, may want to read it :) | 17:19 |
| sdake_ | fungi when will the next batch of atc passes hit? | 17:19 |
| *** shashank_hegde has quit IRC | 17:19 | |
| fungi | sdake_: since i just sent some a week ago, wasn't planning to do more until early next week | 17:19 |
| *** dtantsur is now known as dtantsur|afk | 17:19 | |
| sdake_ | cool thanks :) | 17:19 |
| jeblair | people seem to like linuxbridge over ovs | 17:19 |
| sdake_ | jeblair i hear that all the time as well | 17:19 |
| *** sthillma has joined #openstack-infra | 17:20 | |
| fungi | sdake_: have some _very_ (since last tuesday) recent additions? | 17:20 |
| sdake_ | thatis why with kolla we implemented it first | 17:20 |
| sdake_ | fungi we got a cat named xiabing or something | 17:20 |
| sdake_ | not sure if he is an atc | 17:20 |
| *** fawadk has joined #openstack-infra | 17:20 | |
| *** sdake has quit IRC | 17:20 | |
| sdake_ | that may not be his nam e:) | 17:20 |
| * jeblair is really excited about feline atcs | 17:21 | |
| *** spzala has joined #openstack-infra | 17:21 | |
| *** fawadkhaliq has quit IRC | 17:21 | |
| * fungi wonders if feline contributors write more or less deterministic puppet than mordred | 17:21 | |
| *** resker has quit IRC | 17:22 | |
| * fungi has seen some fairly elaborate typing work by his cats over the years | 17:22 | |
| jeblair | mordred's cat has thumbs. | 17:22 |
| fungi | a maine coon i guess | 17:22 |
| *** pelix has quit IRC | 17:23 | |
| jeblair | i don't know if that helps with typing, but it's probably really good with those 5 button mice. | 17:23 |
| fungi | biggest downside so far to living on island time. contractors *never* show up when they say they will, nor even call to let you know they're running late | 17:23 |
| *** zul has quit IRC | 17:23 | |
| jeblair | fungi: oh, do you have plywood for your windows? | 17:24 |
| fungi | jeblair: thankfully, no, just waiting for carpet cleaners to come do a pass on the old rental before i drop off the keys | 17:25 |
| sdake_ | my cats that have passed one had thumbs | 17:25 |
| sdake_ | he was dumb, but his name was "Einstein" | 17:25 |
| sdake_ | my other cat was brilliant, his name was Euclid :) | 17:25 |
| *** AJaeger_ has joined #openstack-infra | 17:26 | |
| fungi | can haz gridded coordinate system | 17:26 |
| AJaeger_ | clarkb, do we still need https://review.openstack.org/#/c/176072/ - or do you want to abandon it? | 17:26 |
| jeblair | fungi: ah, though i was actually randomly wondering if you had plywood on hand for the new place in case of hurricane, or if that was .... | 17:26 |
| clarkb | it can be abandoned will do | 17:26 |
| jeblair | i think we just had a reconnect event | 17:26 |
| *** puranamr has quit IRC | 17:27 | |
| jeblair | log looks like lots of pads were affected | 17:27 |
| *** puranamr has joined #openstack-infra | 17:27 | |
| fungi | jeblair: storm shutters | 17:27 |
| clarkb | jeblair sorry I have been unable to get laptop to keep a canary connection open | 17:27 |
| jeblair | but the one on the main screen (ops deployment) did reconnect | 17:27 |
| jeblair | fungi: ah even better | 17:28 |
| fungi | the etherpad process doesn't seem to have crashed out | 17:28 |
| *** tiswanso has quit IRC | 17:28 | |
| *** tonytan4ever has joined #openstack-infra | 17:28 | |
| *** tiswanso has joined #openstack-infra | 17:28 | |
| fungi | since i'm bouncing around between computers, no current pad open from my netbook here, so no idea if it was local to the venue network or global | 17:29 |
| *** pvaneck has joined #openstack-infra | 17:29 | |
| openstackgerrit | Glauco Oliveira proposed openstack-infra/puppet-gerrit: Adding a base set of acceptance tests for puppet-gerrit. https://review.openstack.org/214725 | 17:30 |
| AJaeger_ | dougwig: https://review.openstack.org/214389 does not need PTL +1 - if they want to be part of neutron, a +1 on governance is needed. But with the stackforge deprecation, the change can go in as is. But I'd like the PTL to know about it ;) | 17:30 |
| dougwig | AJaeger_: ok, true. so far, everything networking- has been an official neutron tent project, but that's not enforced, and i was assuming. | 17:31 |
| AJaeger_ | dougwig: I don't mind to have a discussion with Kyle about whether it should be an official project - inthe opposite, I'd like to see that discussion ;) | 17:32 |
| dougwig | AJaeger_: ok, that will have to wait until he gets some time at linuxcon. | 17:33 |
| *** minwang2 has quit IRC | 17:33 | |
| jeblair | also, wasn't someone looking into switching etherpad to websockets? | 17:34 |
| AJaeger_ | Sure, dougwig. | 17:34 |
| *** yamahata has quit IRC | 17:34 | |
| fungi | i've got https://etherpad.openstack.org/p/PAO-ops-deployment-tips open over cell modem right now, stable for me so far | 17:34 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image delete using gearman https://review.openstack.org/198114 | 17:35 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Use correct element name in scoverage module https://review.openstack.org/214299 | 17:35 |
| *** minwang2 has joined #openstack-infra | 17:36 | |
| openstackgerrit | Glauco Oliveira proposed openstack-infra/puppet-gerrit: Adding a base set of acceptance tests for puppet-gerrit. https://review.openstack.org/214725 | 17:36 |
| openstackgerrit | Merged openstack-infra/project-config: Removed special treatment for feature/qos branch https://review.openstack.org/212475 | 17:36 |
| *** sridhar_ram has joined #openstack-infra | 17:36 | |
| *** sdake has joined #openstack-infra | 17:37 | |
| SpamapS | greghaynes: wow.. the bastion has a ton of useless garbage in /home/shared. :-P | 17:37 |
| *** krtaylor has quit IRC | 17:37 | |
| greghaynes | SpamapS: Yes. Kind of why I was wanting to start over pull stuff in that I knew we needed | 17:38 |
| greghaynes | its got five nines of garbage | 17:38 |
| *** HeOS has quit IRC | 17:38 | |
| SpamapS | greghaynes: and 9 fives of it is valuable? | 17:38 |
| *** sthillma has quit IRC | 17:38 | |
| jeblair | moving to https://etherpad.openstack.org/p/PAO-ops-network-model | 17:38 |
| jeblair | fungi: clarkb ^ | 17:38 |
| greghaynes | SpamapS: maybe with a few 0's prefixed | 17:39 |
| fungi | jeblair: thanks. i've switched to that one now | 17:39 |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/puppet-cgit: Manage selinux policy for cgit https://review.openstack.org/214667 | 17:39 |
| *** sdake_ has quit IRC | 17:40 | |
| *** jeadr has quit IRC | 17:40 | |
| SpamapS | greghaynes: so I'm just going to start opening tickets for each box. The big email you sent seemed to freak them out a bit. ;) | 17:40 |
| boris-42 | fungi: jeblair hi there | 17:41 |
| AJaeger_ | clarkb: one more change of yours to abandon probably: https://review.openstack.org/#/c/202754/ | 17:41 |
| *** jeadr has joined #openstack-infra | 17:41 | |
| greghaynes | SpamapS: hah. If you didnt know the info I sent them I got from expect + asking the ILO's for serial numbers, so my guess is their data is borked | 17:41 |
| greghaynes | SpamapS: but ++ on doing that | 17:41 |
| boris-42 | fungi: jeblair can I create new python job called coverage_voting or something like that | 17:42 |
| boris-42 | that will check that there is no regression in coverage | 17:42 |
| jeblair | boris-42: call it 'gate-coverage' | 17:42 |
| *** achanda has joined #openstack-infra | 17:42 | |
| boris-42 | currently people is copy paste script from rally | 17:42 |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Add ubuntu-trusty node to os-ansible-deployment https://review.openstack.org/214700 | 17:42 |
| boris-42 | jeblair: https://github.com/openstack/rally/blob/master/tests/ci/cover.sh this one | 17:42 |
| boris-42 | jeblair: so i would prefer to store this script in infra is it ok? | 17:43 |
| greghaynes | clarkb: Do you have any ideas about how to maybe stage a nodepool for the builder changes? | 17:43 |
| greghaynes | clarkb: I am getting a little freaked out about just deploying that to prod | 17:43 |
| jeblair | boris-42: yep, you can add it as a jenkins script. you may want to remove the rally references. | 17:44 |
| clarkb | greghaynes with our test | 17:44 |
| jeblair | boris-42: (just in the mktemps, so it's not confusing to people reading the script) | 17:44 |
| fifieldt | etherpad.openstack.org 503 | 17:44 |
| clarkb | if the dsvm test works ship it | 17:44 |
| boris-42 | jeblair: sure | 17:44 |
| boris-42 | jeblair: sounds great | 17:44 |
| *** ashleighfarnham has joined #openstack-infra | 17:44 | |
| greghaynes | clarkb: hrm, specifically I am a little freaked about operational implications. An example - I just noticed that I wasnt adding image-upload jobs for stuff on disk so a restart would remove the ability to upload all previously made images | 17:45 |
| SpamapS | greghaynes: funny, we actually knew this box was dead for a long time ILO has hung. no JIRA ticket yet. 06/17/15 - ILO still hung | 17:45 |
| jeblair | fungi: how's your canary? | 17:45 |
| greghaynes | SpamapS: Yep | 17:45 |
| *** abregman has quit IRC | 17:45 | |
| greghaynes | SpamapS: I think I put a note in there about "still hung" | 17:45 |
| fungi | jeblair: looking okay so far | 17:45 |
| SpamapS | greghaynes: yeah the data they have is likely just bong. | 17:45 |
| SpamapS | greghaynes: u did | 17:46 |
| fifieldt | after 5 refreshes, another 503 | 17:46 |
| fifieldt | the refreshes were like themissing javascript error | 17:46 |
| fungi | jeblair: ok, i just saw it (very briefly) flash up a "reconnecting" message | 17:46 |
| clarkb | still there for my phone | 17:46 |
| fifieldt | anpther 503 | 17:46 |
| Shrews | SpamapS: mordred: i'm about to disappear for a really long time. it would be swell to see this shade change get merged today: https://review.openstack.org/211710 | 17:47 |
| *** sdake has quit IRC | 17:47 | |
| jeblair | restarting apache | 17:47 |
| jeblair | (to clear cached 500s) | 17:47 |
| * fifieldt is back | 17:48 | |
| *** ihrachyshka has quit IRC | 17:48 | |
| jeblair | i wonder if apache is making this worse by caching 500 errors | 17:49 |
| *** atuvenie has quit IRC | 17:49 | |
| SpamapS | Shrews: going to the Bahamas? | 17:49 |
| mordred | Shrews: lgtm - SpamapS you? | 17:49 |
| * jeblair works on fixing that | 17:49 | |
| *** armax has joined #openstack-infra | 17:50 | |
| *** sdake has joined #openstack-infra | 17:51 | |
| openstackgerrit | Grant Murphy proposed openstack-infra/jeepyb: Make SMTP connection configurable https://review.openstack.org/214733 | 17:51 |
| *** moravec has quit IRC | 17:51 | |
| *** moravec1 has joined #openstack-infra | 17:51 | |
| fungi | i do see a few uncaught exceptions of various sorts in the etherpad access log. stuff like "Uncaught TypeError: Cannot read property 'data' of undefined" | 17:51 |
| SpamapS | mordred: yeah I'm almost done reviewing | 17:51 |
| *** hyakuhei has quit IRC | 17:52 | |
| mordred | cool | 17:52 |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/puppet-cgit: Do not execute selinux commands if policy disabled https://review.openstack.org/214667 | 17:53 |
| fungi | also we might consider rotating /var/log/eplite/access.log since it stretches back to last year and is now nearly 2gb in size | 17:53 |
| Shrews | SpamapS: that's one of the places that crossed my mind | 17:53 |
| SpamapS | Shrews: I'd say come visit us here, but honestly, it's miserable here right now. ;) | 17:54 |
| *** achanda_ has joined #openstack-infra | 17:54 | |
| *** Sukhdev has quit IRC | 17:54 | |
| *** afazkas has joined #openstack-infra | 17:55 | |
| *** achanda has quit IRC | 17:55 | |
| jeblair | fungi, clarkb: ah we need to upgrade to apache 2.4 to get the websocket stuff | 17:55 |
| *** kiran-r has joined #openstack-infra | 17:55 | |
| jeblair | fungi, clarkb: so i think we need to do a precise->trusty upgrade | 17:56 |
| jeblair | on etherpad | 17:56 |
| *** Sukhdev has joined #openstack-infra | 17:56 | |
| armax | hello, any known issues with kibana right now? | 17:56 |
| *** yamahata has joined #openstack-infra | 17:56 | |
| *** vponomaryov has quit IRC | 17:56 | |
| *** flaviosr has quit IRC | 17:56 | |
| *** glauco has quit IRC | 17:57 | |
| armax | my queries yield 0 results | 17:57 |
| fungi | jeblair: the apache error log also has a lot of stuff like Internal error: proxy: error reading status line from remote server localhost:9001, referer: https://etherpad.openstack.org/p/PAO-ops-containers-for-deployment | 17:57 |
| armax | even though I expect there should be | 17:57 |
| *** glauco has joined #openstack-infra | 17:58 | |
| *** angela-s has joined #openstack-infra | 17:58 | |
| fungi | armax: yeah, the recent changes to how logs.openstack.org is serving html-based logs has broken the indexing process we use to feed them into logstash | 17:58 |
| fungi | armax: clarkb was just looking at that a few minutes ago, i think | 17:58 |
| armax | fungi: ok cool | 17:58 |
| armax | fungi: I’ll keep an eye on things, thanks | 17:59 |
| openstackgerrit | Merged openstack-infra/project-config: Add a non-voting py34 check job to Horizon https://review.openstack.org/214292 | 17:59 |
| *** sabeen3 has quit IRC | 18:00 | |
| clarkb | ya we are polluting logs with html | 18:00 |
| clarkb | I pushed what I think is the fix to os-loganalyze | 18:00 |
| *** shashank_hegde has joined #openstack-infra | 18:00 | |
| fungi | jeblair: looks like https://bz.apache.org/bugzilla/show_bug.cgi?id=37770 might be relevant to the mod_proxy errors | 18:01 |
| openstack | bz.apache.org bug 37770 in mod_proxy "proxy: error reading status line from remote server (null)" [Critical,Resolved: fixed] - Assigned to bugs | 18:01 |
| *** jeadr has quit IRC | 18:02 | |
| *** jeadr has joined #openstack-infra | 18:03 | |
| odyssey4me | fungi clarkb is this right? https://review.openstack.org/214700 | 18:04 |
| *** annegentle has quit IRC | 18:04 | |
| *** otter768 has joined #openstack-infra | 18:05 | |
| jeblair | fungi: if we're hitting that bug, then the 503 caching is probably exacerbating things | 18:05 |
| *** kiran-r has quit IRC | 18:05 | |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/system-config: Parameterize setting the selinux mode https://review.openstack.org/214737 | 18:05 |
| *** bharath has joined #openstack-infra | 18:06 | |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/system-config: Parameterize setting the selinux mode https://review.openstack.org/214737 | 18:07 |
| jeblair | fungi: but i'm having trouble figuring out how to set a retry=0 proxy parameter when using mod_rewrite | 18:07 |
| fungi | jeblair: oh, hrm. not mod_proxy | 18:08 |
| *** BharatK has quit IRC | 18:08 | |
| fungi | that might be unrelated then | 18:08 |
| jeblair | fungi: we use mod_proxy, just via mod_rewrite | 18:08 |
| *** nadya has joined #openstack-infra | 18:09 | |
| clarkb | for the /p stuff | 18:09 |
| *** otter768 has quit IRC | 18:09 | |
| fungi | but yeah, i have a feeling upgrading to trusty will be helpful all around. i'll get poking at launching a new etherpad-dev with trusty now though i doubt it's a solution that will be much help before the ops mid-cycle is over | 18:09 |
| *** nadya has quit IRC | 18:10 | |
| *** FallenPegasus has joined #openstack-infra | 18:11 | |
| *** puranamr has quit IRC | 18:13 | |
| *** krtaylor has joined #openstack-infra | 18:13 | |
| *** tvanderwiel has joined #openstack-infra | 18:13 | |
| *** puranamr has joined #openstack-infra | 18:13 | |
| *** tvanderwiel has left #openstack-infra | 18:13 | |
| fungi | still looking for how to feed a retry value through mod_rewrite though | 18:13 |
| *** ayoung has quit IRC | 18:15 | |
| *** FallenPegasus has quit IRC | 18:16 | |
| jeblair | fungi: i think we can just switch to proxypass | 18:16 |
| jeblair | i think the rewrites we have in there will happen first | 18:16 |
| fungi | the examples i'm finding look like that's what they're doing, i just haven't found anyone state conclusively yet that the implied proxy will get those options applied | 18:17 |
| glauco | @here silly question: why puppet-pip does not install pip after all? https://github.com/openstack-infra/puppet-pip/blob/master/manifests/params.pp | 18:18 |
| *** puranamr has quit IRC | 18:18 | |
| *** puranamr has joined #openstack-infra | 18:18 | |
| glauco | Right now it is only installing python-all-dev | 18:18 |
| fungi | glauco: http://lists.openstack.org/pipermail/openstack-infra/2015-August/003015.html | 18:18 |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-etherpad_lite: Switch to proxypass with retry=0 for etherpad https://review.openstack.org/214741 | 18:19 |
| jeblair | fungi: best guess ^ | 18:19 |
| fungi | glauco: i think we're going to get rid of/rename that module since all it's really used for now is to set pip.conf options | 18:19 |
| glauco | @fungi thanks for the clarification! :) | 18:19 |
| jeblair | fungi: now would be a good time to try that out actually; we just started coffeeing | 18:19 |
| *** geoffarnold has quit IRC | 18:20 | |
| fungi | jeblair: want i should hand-apply it to the server? | 18:21 |
| fungi | i've got a while left on my battery | 18:21 |
| *** sputnik13 has quit IRC | 18:21 | |
| *** fifieldt has quit IRC | 18:21 | |
| clarkb | I am back at a computer now | 18:21 |
| clarkb | baby is done trolling me | 18:21 |
| fungi | i'll give it a shot on etherpad-dev | 18:21 |
| clarkb | and larissa is back from doctor | 18:21 |
| *** mrmartin has joined #openstack-infra | 18:23 | |
| jeblair | fungi: i'll start doing it on prod; let me know if you run into probs in dev | 18:23 |
| fungi | reconfigured successfully | 18:24 |
| clarkb | fungi: we can test on https://etherpad-dev.openstack.org/p/clarkb-test2 | 18:25 |
| jeblair | fungi: i don't know how to work the retry=0 into the websocket proxy command, but we have a while to figure that out :) | 18:25 |
| fungi | clarkb: oh, good idea... anyway https://etherpad-dev.openstack.org/p/testpad_lkhegl worked | 18:26 |
| jeblair | i just applied it to production | 18:26 |
| fungi | basic functionality seems fine on etherpad-dev | 18:27 |
| fungi | approving the patch | 18:27 |
| clarkb | what is this fixing? sorry I was distracted by a troll baby for the lsat hour or so | 18:27 |
| fungi | clarkb: workaround for races in mod_proxy | 18:27 |
| jeblair | clarkb: i think apache was caching 503 errors | 18:27 |
| *** gaurangt has left #openstack-infra | 18:28 | |
| jeblair | clarkb: (which are possibily initially caused by bug fungi found) | 18:28 |
| clarkb | ah | 18:28 |
| clarkb | odyssey4me: yes that lgtm | 18:28 |
| jeblair | so it's possible that a single user gets a 503 due to the race and everyone gets disconnected | 18:28 |
| *** stevemar has joined #openstack-infra | 18:28 | |
| clarkb | odyssey4me: oh except we hvae to tell zuul to run your new job too | 18:28 |
| clarkb | odyssey4me: you should edit zuul/layout.yaml to add the new -nv job to your project(s) experimental pipeline | 18:29 |
| odyssey4me | clarkb ok, sorry - silly mistake | 18:29 |
| clarkb | odyssey4me: otherwise it looks correct | 18:29 |
| jeblair | puppet is disabled on etherpad, we'll want to reenable after the change lands | 18:30 |
| *** flepied has joined #openstack-infra | 18:30 | |
| clarkb | jeblair: it was disabled because puppte was causing the swapping | 18:30 |
| clarkb | there was very strong correletion for that at least based on log timestamps | 18:30 |
| *** geoffarnold has joined #openstack-infra | 18:31 | |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Add ubuntu-trusty node to os-ansible-deployment https://review.openstack.org/214700 | 18:31 |
| *** bapalm has quit IRC | 18:31 | |
| odyssey4me | clarkb like so ^ | 18:32 |
| *** HeOS has joined #openstack-infra | 18:32 | |
| jeblair | clarkb: oh ok. it's double disabled. :) | 18:32 |
| *** sthillma has joined #openstack-infra | 18:32 | |
| *** yamamoto has quit IRC | 18:32 | |
| *** kmartin has quit IRC | 18:32 | |
| * nibalizer shakes collection tin on https://review.openstack.org/#/c/208799/ | 18:32 | |
| *** bapalm has joined #openstack-infra | 18:32 | |
| clarkb | odyssey4me: yup | 18:32 |
| *** mpopow has joined #openstack-infra | 18:33 | |
| jeblair | starting up again on https://etherpad.openstack.org/p/PAO-ops-user-committtee | 18:34 |
| *** pabelanger has quit IRC | 18:34 | |
| openstackgerrit | Ronald Bradford proposed openstack-infra/project-config: Moved magnum-coverage gate job https://review.openstack.org/214746 | 18:34 |
| AJaeger_ | dougwig: https://review.openstack.org/#/c/212291/ is fine, could you revisit your -1, please | 18:35 |
| fungi | clarkb: potential race bug was https://bz.apache.org/bugzilla/show_bug.cgi?id=37770 | 18:35 |
| openstack | bz.apache.org bug 37770 in mod_proxy "proxy: error reading status line from remote server (null)" [Critical,Resolved: fixed] - Assigned to bugs | 18:35 |
| openstackgerrit | Merged openstack-infra/puppet-etherpad_lite: Switch to proxypass with retry=0 for etherpad https://review.openstack.org/214741 | 18:35 |
| *** jeadr has quit IRC | 18:35 | |
| fungi | carpet cleaner just finished, so i'm driving back home. will be back online shortly | 18:36 |
| *** rm_work is now known as rm_work|away | 18:36 | |
| *** dmorita has joined #openstack-infra | 18:36 | |
| *** dmorita has quit IRC | 18:36 | |
| *** pabelanger has joined #openstack-infra | 18:36 | |
| *** jeadr has joined #openstack-infra | 18:36 | |
| *** eharney has quit IRC | 18:37 | |
| *** glauco has quit IRC | 18:39 | |
| *** eharney has joined #openstack-infra | 18:39 | |
| clarkb | nibalizer: the commit title doesn't really match the change unless I am missing something | 18:40 |
| clarkb | nibalizer: you are doing it to all or just accessbot? /me keeps reading | 18:40 |
| clarkb | oh its a new job template name so the existing stuff is updated | 18:41 |
| *** sabeen has joined #openstack-infra | 18:42 | |
| nibalizer | clarkb: yea in one of the patchsets it added it to everything but anita wanted to start slow which I understand | 18:42 |
| nibalizer | accessbot has beaker tests written in review so its a good one to start on | 18:42 |
| clarkb | gotcha | 18:43 |
| *** claudiub has joined #openstack-infra | 18:43 | |
| openstackgerrit | Sean M. Collins proposed openstack-infra/irc-meetings: FwaaS meeting: Add an APAC friendly time alternate https://review.openstack.org/214748 | 18:43 |
| clarkb | nibalizer: so how are those jobs different than http://logs.openstack.org/25/214725/2/check/gate-openstackci-beaker-trusty-dsvm/5c24712/console.html ? | 18:43 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added npm publish to eslint-config-openstack https://review.openstack.org/199725 | 18:44 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Switched npm-run-test to npm-test https://review.openstack.org/212154 | 18:44 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added npm publish job. https://review.openstack.org/199715 | 18:44 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added npm tarball upload job https://review.openstack.org/212153 | 18:44 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Switch Horizon to Javascript-jobs https://review.openstack.org/214373 | 18:44 |
| clarkb | oh ^ is only the openstackci module then why is it running against changes to the revie module? | 18:44 |
| clarkb | independent of your change but maybe we should clean that up? | 18:44 |
| nibalizer | no thats intentional | 18:44 |
| clarkb | openstackci will never deploy a gerrit | 18:44 |
| clarkb | so how is that intentional? | 18:45 |
| nibalizer | so the idea is that openstackci is the 'entry point' so the openstackci tests run any time a module gets touched | 18:45 |
| nibalizer | clarkb: well that might actually be an oversight | 18:45 |
| nibalizer | but I imagine openstackci will grow a gerrit eventually | 18:45 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added ACL for ironic-webclient https://review.openstack.org/214381 | 18:45 |
| clarkb | ok so generaly it applies to many of the modules but maybe not gerrit module | 18:45 |
| *** sabeen3 has joined #openstack-infra | 18:45 | |
| nibalizer | I mean certainly what we do with gozer, it makes sense for us to add gerrit to openstackci | 18:45 |
| *** esker has joined #openstack-infra | 18:46 | |
| *** cfarquhar has joined #openstack-infra | 18:47 | |
| *** cfarquhar has quit IRC | 18:47 | |
| *** cfarquhar has joined #openstack-infra | 18:47 | |
| clarkb | nibalizer: its confusing because it implies that we have test coverage there but we dont | 18:47 |
| *** sabeen has quit IRC | 18:47 | |
| nibalizer | well that is a bug | 18:47 |
| clarkb | that change adds tests that are beaker tests that are not run by the beaker test that reported | 18:47 |
| *** Sree has joined #openstack-infra | 18:47 | |
| nibalizer | well beaker tests don't stack well becuase they make changes to the system | 18:48 |
| nibalizer | so openstackci test can't run the gerrit beaker tests, then the openstackci tests | 18:48 |
| nibalizer | I think is maybe what you're talking about? | 18:48 |
| clarkb | no but it could deploy a gerrit and test it as part o fopenstackci | 18:48 |
| clarkb | is I think more what I had in mind, if it is going to be the integration test | 18:48 |
| nibalizer | well I think the beaker-gerrit tests will feed parameters to the puppet-beaker module and validate that the right thing has happened | 18:49 |
| nibalizer | and the openstackci tests will feed parameters into many things, eventually causing a gerrit to come up, and validate that the right thing has happened | 18:49 |
| *** puranamr has quit IRC | 18:50 | |
| *** zul has joined #openstack-infra | 18:50 | |
| *** puranamr has joined #openstack-infra | 18:50 | |
| fungi | okay, back home again | 18:51 |
| *** rkukura has quit IRC | 18:51 | |
| *** geoffarnold has quit IRC | 18:52 | |
| *** puranamr has quit IRC | 18:52 | |
| *** rkukura has joined #openstack-infra | 18:52 | |
| *** puranamr has joined #openstack-infra | 18:52 | |
| *** geoffarnold has joined #openstack-infra | 18:54 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image delete using gearman https://review.openstack.org/198114 | 18:54 |
| openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add new networking-contrail project https://review.openstack.org/214389 | 18:55 |
| *** kmartin has joined #openstack-infra | 18:56 | |
| *** rm_work|away is now known as rm_work | 18:57 | |
| *** pcrews has joined #openstack-infra | 18:57 | |
| openstackgerrit | Merged openstack-infra/project-config: Add nonvoting beaker tests to infra/puppet-accessbot https://review.openstack.org/208799 | 18:57 |
| *** pal has joined #openstack-infra | 18:58 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Test dib image builds with devstack too. https://review.openstack.org/211754 | 18:59 |
| *** rkukura has quit IRC | 19:01 | |
| odyssey4me | fungi mind casting your eye on https://review.openstack.org/214700 so we can give ubuntu-trusty a whirl? | 19:01 |
| *** glauco has joined #openstack-infra | 19:02 | |
| *** fawadk has quit IRC | 19:04 | |
| mordred | odyssey4me: I support the use of ubuntu-trusty | 19:04 |
| clarkb | mordred: 214407 is very unhappy | 19:04 |
| odyssey4me | :) mordred | 19:05 |
| mordred | clarkb: looking | 19:05 |
| pabelanger | fungi: EmilienM: When you have a moment, this is for our msync job: https://review.openstack.org/#/c/210517/3 | 19:06 |
| mordred | clarkb: oh yeah. that's super unhappy :) | 19:06 |
| pabelanger | AJaeger: ^ | 19:06 |
| *** stevemar has quit IRC | 19:07 | |
| rcarrillocruz | mordred: heya, re: infra_ansible per-server cloud config, https://github.com/rcarrillocruz/infra-ansible/commit/f357563ea26483d3842da2e7b98aad14f7943b0c | 19:07 |
| *** ociuhandu has quit IRC | 19:08 | |
| rcarrillocruz | btw, you pinged me yesterday, been on vaca (ends today, sad panda...) | 19:08 |
| mordred | neat! | 19:08 |
| EmilienM | pabelanger: +1 | 19:09 |
| greghaynes | SpamapS: Hey, can I get a review on https://review.openstack.org/#/c/206636/ when you have a sec - needed to fix our ubuntu-trusty images | 19:09 |
| *** dimtruck is now known as zz_dimtruck | 19:10 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Allow for passing in a clouds.yaml path https://review.openstack.org/214407 | 19:10 |
| rcarrillocruz | jeblair: it's not clear to me when you said to incubate this, you meant incubating the project off openstack-ci for a bit or you referred to the have-one-repo-per-role ? | 19:10 |
| *** sharikapongubala has quit IRC | 19:10 | |
| mordred | rcarrillocruz: the second | 19:10 |
| *** nadya has joined #openstack-infra | 19:11 | |
| mordred | rcarrillocruz: basically, I thnk he's saying pull it in to infra in its current form - and then we can split out repo-per-role later | 19:11 |
| *** cdent has quit IRC | 19:11 | |
| rcarrillocruz | alright, jeblair when you get a chance mind checking the project import change? i need PTL sign off due to using openstack-infra namespace | 19:11 |
| *** esmute_ has quit IRC | 19:12 | |
| rcarrillocruz | https://review.openstack.org/#/c/211923/ | 19:12 |
| *** w_ has joined #openstack-infra | 19:12 | |
| fungi | 210517 makes me wonder if we should rethink the safety of jenkins/scripts/propose_update.sh since now we have several repos we're running scripts from within a context that has access to the proposal gerrit account credentials. it might be better to get those scripts committed into project-config so that we can more carefully review what they're doing | 19:12 |
| fungi | anyone have thoughts on that? | 19:12 |
| *** olaph has quit IRC | 19:12 | |
| *** annegentle has joined #openstack-infra | 19:13 | |
| odyssey4me | mordred this may be a good time to bring up https://review.openstack.org/213779 - openstack-ansible is considering splitting all roles into their own repositories to allow consumption in different architectures and to 'big tent' the roles, letting the openstack-ansible repo be more of a set of reference builds that are tested | 19:13 |
| *** pcrews has quit IRC | 19:13 | |
| clarkb | fungi: +1 | 19:13 |
| openstackgerrit | Glauco Oliveira proposed openstack-infra/puppet-gerrit: Implementing a set of acceptance tests for puppet-gerrit. https://review.openstack.org/214725 | 19:13 |
| *** afazkas has quit IRC | 19:13 | |
| *** nikhil_k_ has quit IRC | 19:13 | |
| fungi | effectively the core reviewers for docs, requirements and now potentially openstack-puppet have access to subvert those credentials (in addition to the project-config cores) | 19:13 |
| *** minwang2 has quit IRC | 19:14 | |
| *** abdelwas has joined #openstack-infra | 19:14 | |
| *** afazekas has joined #openstack-infra | 19:14 | |
| mordred | odyssey4me: awesome. I'm highly in favor of that | 19:14 |
| fungi | it's not that i don't trust those people, but this is not a trust model which scales well | 19:14 |
| odyssey4me | mordred yep, if you could weigh in on the review it'd be great - we'll be discussing it in the meeting tomorrow, then I'll send a mail out to the ML to solicit more reviews | 19:15 |
| *** nadya has quit IRC | 19:16 | |
| *** esker has quit IRC | 19:16 | |
| odyssey4me | with separate roles, it'll be easier for people to pile in and contribute feature additions, other platform support, etc | 19:16 |
| *** olaph has joined #openstack-infra | 19:16 | |
| odyssey4me | it'll also potentially add an easier way for kolla and openstack-ansible to converge and build roles together - even if the reference architecture is different | 19:17 |
| *** w_ has quit IRC | 19:17 | |
| sdake | odyssey4me not sure how well that will work out - our ansible implementations are competely different | 19:18 |
| sdake | for example osad expects to template every configuration option possible | 19:18 |
| openstackgerrit | Julia Kreger proposed openstack-infra/shade: Initial support for ironic enroll state https://review.openstack.org/212070 | 19:18 |
| odyssey4me | sdake sure, and we'd like to change that | 19:18 |
| sdake | kolla expects the operator to specify those in overrides in /etc/kolla - read ansible-multi spec in our repo for more details | 19:18 |
| openstackgerrit | Merged openstack-infra/project-config: Add ubuntu-trusty node to os-ansible-deployment https://review.openstack.org/214700 | 19:19 |
| sdake | second our ansible implementation is totally and completely tied to our container architecture | 19:19 |
| sdake | those would be the two blockers to that approach imo :) | 19:19 |
| *** esmute_ has joined #openstack-infra | 19:20 | |
| *** geoffarnold has quit IRC | 19:20 | |
| *** sharikapongubala has joined #openstack-infra | 19:20 | |
| *** klagid has joined #openstack-infra | 19:20 | |
| *** lennyb has quit IRC | 19:20 | |
| openstackgerrit | Fatih Degirmenci proposed openstack-infra/jenkins-job-builder: Add support for forbidden file paths in gerrit trigger https://review.openstack.org/202056 | 19:20 |
| odyssey4me | sdake the point would be to provide a platform to work from - right now neither of us have that... with roles being separate then it may become an easier possibility | 19:21 |
| odyssey4me | it's rather pointless having two different groups working on much the same thing | 19:21 |
| sdake | odyssey4me I disagree the point is to generate the best ideas out of each project | 19:21 |
| sdake | atm the upstream is pretty opinionated about the templating vs not templating | 19:22 |
| clarkb | mordred: so new oscc exists now and we can safely restart nodepool if we upgrade oscc yes? | 19:22 |
| *** eharney has quit IRC | 19:22 | |
| clarkb | then the other changes to nodepool allow us to keep testing with the devstack plugin | 19:22 |
| *** mpopow has quit IRC | 19:22 | |
| sdake | exmple of our globals.yml file: https://github.com/stackforge/kolla/blob/master/etc/kolla/globals.yml | 19:23 |
| *** Sukhdev has quit IRC | 19:23 | |
| odyssey4me | sdake well, it's simply an invitation to consider the option of convergence - I think it's premature at this point to simply discount it | 19:23 |
| sdake | not discounted, just helping you understand the gaps | 19:23 |
| sdake | if you look at that globals.yml file only 4 required variables | 19:23 |
| sdake | rest are overrides | 19:23 |
| sdake | osad much different in this respect | 19:23 |
| *** esmute_ has quit IRC | 19:24 | |
| AJaeger_ | fungi, this is what we use in docs: http://git.openstack.org/cgit/openstack/openstack-manuals/tree/tools/sync-projects.sh | 19:25 |
| sdake | so the question comes up - how do you override the hypervisor libvirt type, you put the config in this file: https://github.com/stackforge/kolla/blob/master/etc/kolla/config/nova.conf | 19:25 |
| *** sharikapongubala has quit IRC | 19:25 | |
| sdake | and it gets merged | 19:25 |
| sdake | this is our answer to "templating sucks" :) | 19:25 |
| sdake | no dev/release cycle to change configs aroudn | 19:25 |
| sdake | this is like a key key design tenant of kolla | 19:26 |
| *** eharney has joined #openstack-infra | 19:26 | |
| sdake | odyssey4me ^ | 19:26 |
| odyssey4me | sdake it appears to me that you still have a template: https://github.com/stackforge/kolla/blob/master/ansible/roles/nova/templates/nova.conf.j2 | 19:26 |
| odyssey4me | and I don't think this is the place or time for a tit for tat, seriously | 19:27 |
| sdake | yes opinionated out of the box, but not alot of {{ }} options | 19:27 |
| AJaeger_ | fungi: I'm happy to move this over but this is not static, it might need updates while we change contents... | 19:27 |
| sdake | not tit for tating helping you understand the differences | 19:27 |
| AJaeger_ | Or it needs a config file to read... | 19:27 |
| openstackgerrit | Madhusudhan Kandadai proposed openstack-infra/project-config: Make lbaasv2 scenario API job voting https://review.openstack.org/214767 | 19:27 |
| sdake | odyssey4me tbh I"m not sure who you represent, osad or some other party :) | 19:27 |
| sdake | odyssey4me if you could sort out the differences that would be fantastic | 19:28 |
| fungi | AJaeger_: yep, i'm aware. just pointing out that as we continue to expand that script to call out to more and more repos we might be better off either coming up with a better abstraction model than "run arbitrary external code," or perhaps some means to sandbox those away from the credentials themselves | 19:28 |
| sdake | I just dont think it can be done, but maybe I lack imagination :) | 19:28 |
| sdake | enjoy i'm off | 19:29 |
| *** shashank_hegde has quit IRC | 19:29 | |
| AJaeger_ | fungi: yeah, I agree with that - just wonder how to do it best... | 19:29 |
| fungi | AJaeger_: a simple sandbox might just be to sudo to a different unprivileged user to perform those steps and then collect the results as the jenkins user, making sure the credentials are not accessible to the second account | 19:30 |
| *** moravec1 has quit IRC | 19:31 | |
| fungi | AJaeger_: that at least raises the bar to needing to exploit local privilege escalation vulnerabilities on proposal.slave.openstack.org | 19:31 |
| *** regXboi has quit IRC | 19:32 | |
| fungi | anyway, just brainstorming at this point | 19:32 |
| *** yamamoto has joined #openstack-infra | 19:32 | |
| clarkb | setting up our test nodes so that devstack can run takes about 10 minutes now | 19:33 |
| clarkb | I wonder how much fastr that can be if we trim the PROJECTS list | 19:33 |
| clarkb | there is a way to find out :) | 19:33 |
| *** rkukura has joined #openstack-infra | 19:34 | |
| openstackgerrit | Brad Lodgen proposed openstack/diskimage-builder: Ramdisk should consider the size unit when inspecting the amount of RAM https://review.openstack.org/214771 | 19:34 |
| fungi | a very simply way in fact, involving a change to remove lines from one file | 19:34 |
| fungi | clarkb: though i have a feeling it's a combination of that and the ever increasing complexity and lengthening list of dependency packages | 19:34 |
| pabelanger | fungi: replied to msync hook. For your credentials issue, if you can list a possible solution I can go away and work on it | 19:35 |
| *** moravec has joined #openstack-infra | 19:35 | |
| *** AJaeger_ has quit IRC | 19:36 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: See if trimming PROJECTS make setup faster https://review.openstack.org/214774 | 19:37 |
| fungi | pabelanger: appreciated. mostly i also want to get jeblair to circle back around to that review since he had some fairly strong opinions/preferences in the original discussion (before that proposed change came into existence) | 19:37 |
| clarkb | fungi: ^ I do think we should make project specific jobs list themselves in the PROJECTS list though | 19:37 |
| clarkb | fungi: then keep the list we hard code small | 19:37 |
| *** jtrovo has joined #openstack-infra | 19:37 | |
| *** pal has quit IRC | 19:37 | |
| clarkb | I think all the libs can come out too then we add any back in when testing in the from source jobs | 19:37 |
| fungi | clarkb: would be nice to keep the list we hard-code as short as possible and allow more duplication of services lists in job descriptions instead | 19:37 |
| *** achanda_ has quit IRC | 19:37 | |
| *** yamamoto has quit IRC | 19:38 | |
| clarkb | ya | 19:38 |
| *** ashleighfarnham has quit IRC | 19:38 | |
| pabelanger | fungi: Ya, I keep feeling we are skipping the key point. For what ever the reason is, we need to copy x file over 50 puppet modules. How do we do that, is some automated / control process, with out everybody just having local scripts to do it | 19:38 |
| fungi | like, a baked-in services list 0-1 entries long | 19:38 |
| clarkb | pabelanger: except we should only ever need to do it once... | 19:39 |
| clarkb | I don't think we have needed any more updates since we did it last | 19:39 |
| *** flepied has quit IRC | 19:39 | |
| *** moravec has quit IRC | 19:39 | |
| nibalizer | fbo: you about? | 19:39 |
| clarkb | also what prevents a local module sync then push? | 19:40 |
| nibalizer | wnat to explode your #{repo} change out to all the repos? | 19:40 |
| pabelanger | clarkb: or until something changes in the file the you originally copied. Like a version number, etc | 19:40 |
| *** kmartin has quit IRC | 19:40 | |
| clarkb | translations are automated because they are contnuously updated in another tool and we can change them without conflicts | 19:40 |
| clarkb | it makes senes to update translations automatically for tese reasons | 19:41 |
| pabelanger | clarkb: nothing prevents is, that is how the puppet modules team does it today. Just means we are dependent on people to do the sync, over gate. | 19:41 |
| clarkb | updating a small set of files across a set of repos once very couple months to years isn't really necessary imo | 19:41 |
| *** shardy_ has joined #openstack-infra | 19:41 | |
| fungi | locally running a mass-proposal script is going to be a thing anyway regardless. i've done changes to readme files across all openstack repos, changes to tox.ini files, changes to remove/replace specific modules/libraries across hundreds of repos. optimizing for puppet boilerplate seems like tunnel vision | 19:41 |
| nibalizer | ya I just use explode.sh | 19:41 |
| nibalizer | and now I want fbo to run explode.sh since we need to patch spec_helper_acceptance.rb for all 60 puppet repos | 19:41 |
| nibalizer | (yippie) | 19:42 |
| pabelanger | However, this is what is confusing me. These same points could in fact be raised against the global requirements repo, some person could invoke the sync process. Why is there a difference here? | 19:42 |
| fungi | and i worry that we'll end up with every project-team having their own additions to the list of mass-proposal jobs until it's untenable (i sort of feel it's already there, hence my security concerns) | 19:42 |
| clarkb | pabelanger: because again its continuous | 19:42 |
| clarkb | pabelanger: we are constantly updating the global reqs and constraints | 19:42 |
| openstackgerrit | Merged openstack-infra/shade: Add flavor access API https://review.openstack.org/211710 | 19:42 |
| *** shardy has quit IRC | 19:42 | |
| fungi | pabelanger: requirements sync is happening on average once or more a day. translations is also happening daily | 19:43 |
| *** Sukhdev has joined #openstack-infra | 19:43 | |
| fungi | it seems unlikely that the puppet boilerplate will change meaningfully on a daily or probably even weekly frequency | 19:43 |
| pabelanger | so, if sync is great then a day, don't automate? I mean, I am fine with that. Just want to understand if that is the sticking point to all of this | 19:43 |
| clarkb | pabelanger: I think if its greater than monthly | 19:43 |
| clarkb | which I expect puppet to be once the initial edits are in | 19:43 |
| *** nadya has joined #openstack-infra | 19:44 | |
| clarkb | if we are changing them more than once a month I give up | 19:44 |
| clarkb | there are too many repos to have that many things to review every month | 19:44 |
| pabelanger | adding documentation or local script to do it is fine, I only fear people will forget how it works or worse, the code will just bit rot locally | 19:44 |
| *** rkukura has quit IRC | 19:44 | |
| *** jeadr has quit IRC | 19:44 | |
| fungi | pabelanger: for me the sticking point is to push back/provide resistance before this goes from 4 proposal jobs to 40 (or 400) without a more carefully thought-out design. the present mechanism is and always has been an unfortunate hack | 19:45 |
| *** jeadr has joined #openstack-infra | 19:45 | |
| *** e0ne has joined #openstack-infra | 19:45 | |
| clarkb | also with reqs and translations they are both rolling, projects can get to them when they have time | 19:45 |
| clarkb | with the modulesync the implication seems to be any updates should go in asap which is different | 19:45 |
| pabelanger | fungi: See, I can now understand that. Honestly, this is the first time seeing that issue being raised | 19:46 |
| clarkb | if it is indeed urgent a human should push it and walk the changes through | 19:46 |
| *** afazekas has quit IRC | 19:46 | |
| *** nadya has quit IRC | 19:46 | |
| *** shardy_ has quit IRC | 19:46 | |
| clarkb | (which is often what happens with urgent requirements or translation changes) | 19:46 |
| clarkb | greghaynes: SpamapS fyi https://github.com/openstack/diskimage-builder/pull/8 | 19:47 |
| *** shardy has joined #openstack-infra | 19:47 | |
| *** e0ne has quit IRC | 19:47 | |
| *** gyee has quit IRC | 19:47 | |
| pabelanger | well, for me, it was simply removing the human from the puzzle. Since we had the global requirements job working, then it must be the better way to do things. Add to the fact that openstack-puppet was already manually doing it and actively looking to automate it, my reason for helping on the -infra side for msync hook. | 19:48 |
| clarkb | pabelanger: you aren't removing the human from the puzzle | 19:48 |
| clarkb | we are just making it easier to create a lot of work for other humans | 19:49 |
| *** samueldmq has quit IRC | 19:49 | |
| pabelanger | Yes, that | 19:49 |
| fungi | pabelanger: totally understand. i feel like the current mechanism we're using for requirements and translation updates is not great to start with, and i'm not even sure that having a job propose changes to various projects is long-term how we should be solving these sorts of problems | 19:49 |
| *** FallenPegasus has joined #openstack-infra | 19:49 | |
| *** esker has joined #openstack-infra | 19:50 | |
| nibalizer | crinkle: can you review https://review.openstack.org/#/q/status:open+project:openstack-infra/puppet-jenkins+branch:master+topic:fix_regular_git_clone,n,z | 19:50 |
| clarkb | for translations I can definitely see us sync them once a relase/milestone and make it part of that process | 19:50 |
| clarkb | requirements are trickier because tests break without those updates | 19:50 |
| fungi | but since i haven't made solving that a priority for myself, i'm not going to tell other people they have to redesign the entire system. just that it's something we ought to come up with a better answer for | 19:50 |
| *** ociuhandu has joined #openstack-infra | 19:51 | |
| *** achanda has joined #openstack-infra | 19:51 | |
| *** moravec has joined #openstack-infra | 19:51 | |
| pabelanger | well, I don't mind working on something better, I just need help / direction on it. If we think the current system is faulty | 19:52 |
| fungi | definitely don't want people coming along fresh thinking the current solution is great, or even opreferred, just that it's what we've got for now and we'd rather not use it as a general solution | 19:52 |
| pabelanger | I mean, a manual sync works. | 19:52 |
| pabelanger | regardless how you run it | 19:52 |
| nibalizer | manual sync of the exact same change is not hard to produce or approve | 19:52 |
| fungi | since continuing to proliferate there means an increase in technical debt we need to pay back once we work out a superior alternative | 19:52 |
| nibalizer | so its like... what problem are we solving | 19:53 |
| nibalizer | and are we saving anyone time | 19:53 |
| *** moravec has quit IRC | 19:53 | |
| nibalizer | becuase when you build a complex system like that you gotta train everyone on it, and involve infra-rooters to debug it when it goes belly-up | 19:53 |
| *** zz_dimtruck is now known as dimtruck | 19:53 | |
| fungi | well, mass-proposing changes can also be complex if you've not done it before | 19:53 |
| fungi | so i don't want to oversell that either | 19:54 |
| pabelanger | well, in this case, we build top of an existing process. However, now I know, infra roots don't like the process to start with :) | 19:54 |
| *** glauco has quit IRC | 19:54 | |
| *** glauco has joined #openstack-infra | 19:54 | |
| fungi | it may be that we should look into ways to make it easier for someone to do mass-change proposals | 19:54 |
| *** esker has quit IRC | 19:54 | |
| clarkb | like gerrty's mas reviews | 19:55 |
| pabelanger | the initial patch from puppet team was their own sync tooling, I just conformed it to how requirments / translations worked | 19:55 |
| *** esker has joined #openstack-infra | 19:55 | |
| *** puranamr has quit IRC | 19:55 | |
| *** minwang2 has joined #openstack-infra | 19:56 | |
| *** angdraug has quit IRC | 19:56 | |
| *** jtrovo has quit IRC | 19:56 | |
| *** gyee has joined #openstack-infra | 19:56 | |
| *** puranamr has joined #openstack-infra | 19:56 | |
| *** geoffarnold has joined #openstack-infra | 19:56 | |
| *** FallenPegasus has quit IRC | 19:56 | |
| clarkb | also with upper constraints I think we can kill the reqs syncs | 19:56 |
| clarkb | because we will be overriding all the things anyways | 19:57 |
| fungi | clarkb: that's a goal of the constraints work, yes, though we may need the lower-constraints worked out too | 19:57 |
| clarkb | then each project can just declare the raw dep and constraints provides the version value | 19:57 |
| nibalizer | fungi: i've thought of scripting up something for reviews that verifies the sha1sum of the diff something something | 19:59 |
| *** annegentle has quit IRC | 19:59 | |
| fungi | for translations, i wonder whether it would be possible to move those to separate repositories and have zanata pushing into those instead of going through code review to repos containing the source language master copies | 20:00 |
| clarkb | I think zanata can do that on its own | 20:01 |
| fungi | no idea if that even makes sense | 20:01 |
| pabelanger | fungi: clarkb: Here is the real goal I am trying to solve. Perhaps you can help me, it revolves around puppet requirements in our infra modules. As you know, currently it sucks to keep all our dependencies in order. We basically require system-config to handle them. However, because it is now possible to run -infra modules with our system-config, we do a terrible job at define the local | 20:01 |
| pabelanger | requirements / depends for a puppet-zuul module (lets say). For me, I still think the Puppetfile or metadata.json is the best place to do it, but have no better way to manage it beside by hand. | 20:01 |
| clarkb | so its more a question of whether or not projects find value in having that in tree | 20:01 |
| pabelanger | recently msync came to light, and at least offered up a way to template the files | 20:01 |
| clarkb | pabelanger: we can look at the rate of change on our deps but its very low | 20:02 |
| openstackgerrit | Sean M. Collins proposed openstack-infra/irc-meetings: FwaaS meeting: Add an APAC friendly time alternate https://review.openstack.org/214748 | 20:02 |
| clarkb | pabelanger: which is why I don't expect to need to update them ever | 20:02 |
| fungi | pabelanger: also adding deps to our master file shouldn't necessarily have any impact on the deps in the zuul module, right? | 20:02 |
| *** e0ne has joined #openstack-infra | 20:02 | |
| *** sharikapongubala has joined #openstack-infra | 20:03 | |
| *** kgiusti has left #openstack-infra | 20:03 | |
| fungi | is the actual problem that we're declaring dependencies in our modules that may be incorrect and we don't know because we're not using those when we run tests? | 20:03 |
| pabelanger | clarkb: As more people use our modules outside of -infra, I think our deps will bump more and more. Even using fedora 22 as an example required some updates | 20:03 |
| fungi | or that they're incompatible and result in modules which aren't co-installable? | 20:03 |
| clarkb | pabelanger: I don't | 20:03 |
| clarkb | pabelanger: it is very hard to test that bumps dont break and that they upgrade cleanly regardless of how you proopse the changes | 20:04 |
| nibalizer | pabelanger: puppet dependency resolution is poo though | 20:04 |
| clarkb | right ^ that | 20:04 |
| pabelanger | however, as we add more functional testing, each module would then be tested more and more out side system-config | 20:04 |
| nibalizer | and there isn't standard tooling, or data forms | 20:04 |
| pabelanger | I know it is | 20:04 |
| nibalizer | so you're chasing a unicorn | 20:04 |
| nibalizer | even if you automated metadata.json to the moon | 20:04 |
| nibalizer | no one would agree about how to use it | 20:04 |
| nibalizer | so no one would benefit | 20:04 |
| clarkb | or when it is actually safe to approve a change | 20:04 |
| pabelanger | I am suggestion we manually do the dep management throught a sync process. and use something like puppet-librarian-simple or r10k to install said modules | 20:05 |
| clarkb | remember we don't have atomic merges | 20:05 |
| clarkb | so you can't say you need newer mysql in gerrit and not also upgrade it for etherpad at the same time | 20:05 |
| clarkb | so modulesync doesn't help anything | 20:05 |
| nibalizer | so the community is trying to figure out how to enable the behavior that clark is specifying | 20:05 |
| clarkb | (this is one reason we have centralized module installs today) | 20:05 |
| nibalizer | but thats not done yet | 20:05 |
| *** otter768 has joined #openstack-infra | 20:05 | |
| nibalizer | and I don't want to turn infra into a testbed for crackpot puppet exploration | 20:06 |
| nibalizer | sorry crackpot isn't the right word | 20:06 |
| nibalizer | my point is that we dont run a puppet infrastructure for fun | 20:06 |
| nibalizer | we do it to get something else done | 20:06 |
| nibalizer | so we shouldn't be innovating in how we use puppet, we should use old, borring, known techniques | 20:06 |
| *** w_ has joined #openstack-infra | 20:06 | |
| nibalizer | and modules.env is just a list of modules you need if you want to run infra, its a simple statement | 20:06 |
| nibalizer | its easy to communicate to users | 20:07 |
| timrc | Oh... look a topic being discussed which as produced a certain level annoyance with puppet in me :) | 20:07 |
| timrc | has* | 20:07 |
| pabelanger | I am asking each puppet module we have include a Puppetfile to their dependencies. That's pretty boring I though | 20:07 |
| clarkb | fungi: after trimming PROJECTS it took 4 minutes, need more data to be sure that helps but first glance is promising | 20:07 |
| *** puranamr has quit IRC | 20:08 | |
| *** puranamr has joined #openstack-infra | 20:08 | |
| nibalizer | pabelanger: to what end? what workflow does that enable? | 20:08 |
| timrc | Except we can't get modules.env to work downstream since it's completely idiotic how the puppet master works :) | 20:08 |
| fungi | clarkb: agreed, it's a great sign anyway | 20:08 |
| *** FallenPegasus has joined #openstack-infra | 20:08 | |
| timrc | I love when two completely unrelated services conflict on a dependency. | 20:08 |
| nibalizer | totally | 20:09 |
| jesusaurus | timrc: and when a module lists a dependency that is only needed for certain parameter values... | 20:09 |
| pabelanger | nibalizer: I would like to take module X from -infra, heck ever openstack puppet team. Run r10k or puppet-librarian-simple on it, modules installed. | 20:09 |
| pabelanger | then use module as I see fit | 20:09 |
| pabelanger | either for testing or produciton | 20:09 |
| pabelanger | production* | 20:09 |
| *** mrmartin has quit IRC | 20:10 | |
| clarkb | pabelanger: you can do that today | 20:10 |
| *** olaph has quit IRC | 20:10 | |
| clarkb | since its centralized all you need is a central list to compare against which does exist | 20:10 |
| *** mrmartin has joined #openstack-infra | 20:10 | |
| *** otter768 has quit IRC | 20:10 | |
| *** mrmartin has quit IRC | 20:10 | |
| fungi | it seems like the consensus is that most large puppet-using sites don't actually use puppet's module dep solver and just paper over it with some central list or service plus manual testing and finger-crossing | 20:10 |
| pabelanger | clarkb: So, that is the problem, to me, the central list keeps changing over time. Which is fine, but now I have 2 sources I have to check. My module and system-config. I would prefer everything included into a single repo | 20:11 |
| fungi | and that will probably continue to be the case until puppet gets a real dep solver | 20:11 |
| clarkb | pabelanger: you rproposal to do module syncing doesn't solve that | 20:11 |
| clarkb | pabelanger: it makes it worse since now you must refer to 50 repos | 20:11 |
| clarkb | somehow merge conflicting deps together to make a complete list (including unlisted dependencies because puppet) | 20:12 |
| *** woodster_ has joined #openstack-infra | 20:13 | |
| fungi | and it's not just our modules at fault there. we depend on other forge modules which have just as inaccurate/incomplete dependency declarations as ours | 20:13 |
| *** smccully has quit IRC | 20:13 | |
| pabelanger | clarkb: right, I've accepted msync is not the tool to use. Automated or manual. However, the real issue I was working towards was adding Puppetfile into puppet-jenkins for example, with all the dependencies listed. So, I could then consume that module and do something outside of system-config | 20:13 |
| clarkb | pabelanger: yes I am saying thats a fine goal, but it is impossile to achieve with puppet | 20:14 |
| fungi | it's sort of a catch-22 that puppet module dependency declarations aren't trustworthy because puppet's dep solver is inadequate, so people don't rely on them, which means the inaccuracies go unnoticed... | 20:14 |
| clarkb | it has nothing t odo with you or me or openstack and everything to do with a broken package system | 20:14 |
| jeblair | nibalizer, pabelanger: i can't read the full scrollback right now, but let me try to be clear on the module sync thing: | 20:14 |
| timrc | ++ | 20:14 |
| nibalizer | which is largely ignorred by most competent people who just use git | 20:14 |
| *** stevemar has joined #openstack-infra | 20:14 | |
| *** w_ has quit IRC | 20:15 | |
| jeblair | 1) i don't have an opinion on what the openstack puppet modules should do in this area. whatever they need is fine, and if we need to establish policies for jjb definitions, etc, to make that feasible, that's fine. | 20:15 |
| pabelanger | I had good success using puppet-librarian-simple in the past. Not saying that is the tool, but NOT expecting puppet to manage the dependencies is the first step to success :) | 20:15 |
| nibalizer | clarkb: re: upgrading http://scienceofficersblog.blogspot.com/2015/08/inspecting-puppet-module-metadata.html can probably help us when it comes time | 20:15 |
| jeblair | 2) i don't want any autmated rote-approval kinds of jobs for openstack-infra. it's understandable that we might need to, very occasionaly, make mass changes to many or all of our repos. if we do that at all regularly, then we need to refactor that thing out of the repos. | 20:16 |
| jeblair | we have done significant work in the past to avoid that for python projects (pbr exists so that we don't have to bump version numbers), and we will continue to hold the line for puppet as well. | 20:17 |
| nibalizer | jeblair: o7 | 20:18 |
| *** e0ne has quit IRC | 20:18 | |
| fungi | and it makes sense to help the puppet community solve their dependency issues rather than investing time in automating workarounds in our ci. lifeless is setting an awesome example of helping pip fix that same problem | 20:18 |
| jeblair | nibalizer: do i need to o7 back so you aren't just standing there and o7ing? | 20:18 |
| lifeless | fungi: someone needs to tell the Debian community that too :) [see debian-python's latest two emails] :) | 20:19 |
| nibalizer | jeblair: no we're not so formal | 20:19 |
| jeblair | fungi: i agree. | 20:19 |
| jeblair | nibalizer: whew | 20:19 |
| fungi | lifeless: yes, that thread is kinda disheartening | 20:19 |
| *** w_ has joined #openstack-infra | 20:19 | |
| EmilienM | fungi: ++ for keeping sync with puppet community | 20:20 |
| lifeless | fungi: I find myself with a hard to debug case of the angries | 20:20 |
| EmilienM | fungi: this is mostly why we are using beaker | 20:20 |
| pabelanger | jeblair: just the reasoning I was looking for. Out side today, I assume the proposal sync was the accepted way of doing things. I'll abandon the code now let the puppet openstack team know to manually sync stuff now | 20:21 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Test dib image builds with devstack too. https://review.openstack.org/211754 | 20:23 |
| fungi | manually is probably a poor term. having it scripted makes sense. having it triggered continuously makes less sense | 20:23 |
| clarkb | greghaynes: ^ its the little things that get you | 20:23 |
| *** r-daneel has joined #openstack-infra | 20:24 | |
| *** jeadr has quit IRC | 20:24 | |
| *** julim has quit IRC | 20:25 | |
| *** jeadr has joined #openstack-infra | 20:25 | |
| *** Sree has quit IRC | 20:26 | |
| *** e0ne has joined #openstack-infra | 20:29 | |
| *** ybathia has joined #openstack-infra | 20:29 | |
| *** jtrovo has joined #openstack-infra | 20:30 | |
| pabelanger | fungi: clarkb: if this process has taught me anything, its to rewrite our modules in ansible | 20:31 |
| pabelanger | :) | 20:32 |
| *** olaph has joined #openstack-infra | 20:32 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Test that the modules.env file in infra is sorted https://review.openstack.org/191247 | 20:32 |
| fungi | pabelanger: consider rewriting puppet itself in ansible ;) | 20:34 |
| *** w_ has quit IRC | 20:34 | |
| clarkb | greghaynes: the good news there is dib apperas to be running properly now, Ithink this is really close and as soon as nodepool works with oscc again we should have a working test | 20:35 |
| *** e0ne has quit IRC | 20:35 | |
| clarkb | mordred: 214407 is still failing | 20:35 |
| *** e0ne has joined #openstack-infra | 20:36 | |
| *** rkukura has joined #openstack-infra | 20:37 | |
| fungi | jeblair: etherpad utilization seems to have trailed off for the past hour or so. any further issues after the apache reconfig? | 20:38 |
| greghaynes | clarkb: \O/ | 20:39 |
| fungi | we do still get occasional "proxy: error reading status line from remote server localhost:9001" in the apache error log but hopefully it's not wreaking havoc across all clients now | 20:40 |
| *** geoffarnold has quit IRC | 20:40 | |
| *** w_ has joined #openstack-infra | 20:41 | |
| *** ashleighfarnham has joined #openstack-infra | 20:42 | |
| *** kmartin has joined #openstack-infra | 20:42 | |
| *** olaph has quit IRC | 20:44 | |
| *** annegentle has joined #openstack-infra | 20:45 | |
| *** w_ has quit IRC | 20:46 | |
| *** pcrews has joined #openstack-infra | 20:46 | |
| *** nadya has joined #openstack-infra | 20:47 | |
| *** tonytan4ever has quit IRC | 20:47 | |
| jeblair | fungi: just started back from lnuch | 20:47 |
| jeblair | we're split; i'm on https://etherpad.openstack.org/p/PAO-ops-tools-mon | 20:47 |
| fungi | oh, right! timezones... ;) | 20:47 |
| *** achanda has quit IRC | 20:47 | |
| *** FallenPegasus has quit IRC | 20:48 | |
| SpamapS | mordred: I think I've asked you this like 12 times.. but.. gearman-interface is dead, right? | 20:48 |
| SpamapS | mordred: going to have it removed from Debian | 20:48 |
| *** w_ has joined #openstack-infra | 20:49 | |
| *** shashank_hegde has joined #openstack-infra | 20:50 | |
| *** armax has quit IRC | 20:51 | |
| *** nadya has quit IRC | 20:51 | |
| *** achanda has joined #openstack-infra | 20:52 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/system-config: Test that modules.env is complete https://review.openstack.org/214787 | 20:52 |
| fungi | i think nodepool has gone awol | 20:52 |
| fungi | it may have lost connectivity to zuul | 20:52 |
| jeblair | fungi, ttx, reed: ops feedback: ask.o.o is not very useful because of stale information and lack of curation. no one is volunteering to do that work. | 20:52 |
| greghaynes | :( | 20:52 |
| *** annegentle has quit IRC | 20:53 | |
| fungi | jeblair: i still think ask is a honeypot for people who don't know how to use mailing lists/irc, and is slightly less spam-ridden than the web forums it replaced | 20:53 |
| jesusaurus | clarkb: fungi: we aren't currently testing that modules.env is a complete list of modules needed because we have puppet modules that were installed during the slave configuration, care to take a look at https://review.openstack.org/214787 ? | 20:54 |
| *** annegentle has joined #openstack-infra | 20:54 | |
| *** geoffarnold has joined #openstack-infra | 20:54 | |
| fungi | jesusaurus: i'll pull it up for after i finish looking into the nodepool issue | 20:54 |
| jesusaurus | cool | 20:54 |
| reed | jeblair, thanks for the feedback... definitely it would work better if more people demoted bad questions and promoted good ones | 20:54 |
| *** cburroughs has quit IRC | 20:54 | |
| *** tonytan4ever has joined #openstack-infra | 20:54 | |
| reed | I try to fix questions but frankly there are too many bad ones coming in | 20:54 |
| jeblair | reed: yeah | 20:54 |
| reed | not spam, just badly written badly expressed questions | 20:55 |
| reed | hard to make them look pretty | 20:55 |
| fungi | also most of them aren't even aware of esr's smart questions faq | 20:55 |
| fungi | which is basically still relevant even now that almost nobody uses usenet | 20:56 |
| reed | fungi, yeah, that art is getting lost behind being politically correct | 20:56 |
| greghaynes | clarkb: SpamapS answered your question on https://review.openstack.org/#/c/206636/9/elements/growroot/init-scripts/upstart/growroot.conf | 20:56 |
| jeblair | fungi: 2015-08-19 20:56:25,906 DEBUG nodepool.NodePool: Demand from gearman: devstack-trusty: 3 | 20:57 |
| jeblair | it looks like it thinks it's seeing demand | 20:57 |
| reed | i heard community managers say that ESR essay is bad to reference because its title basically says that the person asking is not smart :) | 20:57 |
| fungi | jeblair: yeah, so it's possible zuul isn't expressing it? | 20:57 |
| *** bswartz has quit IRC | 20:57 | |
| jeblair | NameError: global name 'openstack_ansible__re' is not defined | 20:57 |
| greghaynes | hrm, shade | 20:57 |
| jeblair | i think we stuck zuul with a reconfiguration error | 20:57 |
| clarkb | jeblair oh thats oddyssey4mes change | 20:58 |
| clarkb | did we miss a typo? | 20:58 |
| *** esker has quit IRC | 20:58 | |
| greghaynes | oh | 20:58 |
| * fungi grumbles | 20:58 | |
| jeblair | yep, the double _ is a typo | 20:58 |
| jeblair | and i guess that is not exercised by the layout job | 20:59 |
| fungi | NameError: global name 'openstack_ansible__re' is not defined | 20:59 |
| *** olaph has joined #openstack-infra | 20:59 | |
| fungi | i'll stop puppet and hand-patch | 20:59 |
| jeblair | we should fix zuul to at least do an import when it does that | 20:59 |
| *** armax has joined #openstack-infra | 20:59 | |
| jeblair | fungi: yeah, if you stop puppet, fix, then HUP to reconfig, then land the change fix, then re-enable puppet, you might be able to fix without downtime | 20:59 |
| *** zul has quit IRC | 21:00 | |
| fungi | done and watching logs | 21:01 |
| fungi | i'll whip up the patch to make it all proper now | 21:01 |
| *** w_ has quit IRC | 21:02 | |
| *** alivigni has quit IRC | 21:02 | |
| jeblair | fungi: looks good, woot! | 21:02 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Correct ansible regex varname in zuul param funcs https://review.openstack.org/214795 | 21:03 |
| fungi | jeblair: clarkb: ^ | 21:03 |
| mordred | SpamapS: yu. totes dead | 21:03 |
| clarkb | fungi approved | 21:04 |
| *** stevemar has quit IRC | 21:05 | |
| fungi | thanks! i'll reenable puppet once it's in place | 21:05 |
| *** regXboi has joined #openstack-infra | 21:05 | |
| ianw | fungi: on another topic https://review.openstack.org/#/c/211294/ (Use dnf download to cache packages) <- so it turns out caching with dnf is much harder than i thought; it's a little too smart about everything. one thought is a squid proxy in front might work | 21:05 |
| clarkb | greghaynes can we just use zypper in div? | 21:05 |
| greghaynes | clarkb: were suse'ing? | 21:06 |
| greghaynes | clarkb: I mean, I do love me some zypper | 21:06 |
| mordred | clarkb: oh - headdesk | 21:06 |
| greghaynes | clarkb: oh, for caching | 21:06 |
| greghaynes | ianw: thats unfortunate | 21:06 |
| mordred | what are we zyppering? | 21:06 |
| clarkb | for caching ya | 21:06 |
| *** achanda has quit IRC | 21:06 | |
| clarkb | just use package manager that works | 21:07 |
| fungi | ianw: wow, unfortunate. also pabelanger indicated that dnf upstream seemed to have no interest in a cache-but-don't-install option? | 21:07 |
| *** aysyd has quit IRC | 21:07 | |
| mordred | sigh | 21:07 |
| ianw | i think he's referring to https://bugzilla.redhat.com/show_bug.cgi?id=1209638 | 21:08 |
| openstack | bugzilla.redhat.com bug 1209638 in dnf "dnf is missing --downloadonly --downloaddir parameter" [Unspecified,Closed: duplicate] - Assigned to packaging-team-maint | 21:08 |
| clarkb | zypper can do it with a small bit of config if I am not mistaken | 21:08 |
| fungi | clarkb: greghaynes: you're onto something. we could replace fedora-based testing with suse! | 21:08 |
| greghaynes | :) | 21:09 |
| greghaynes | ianw: if you install with dnf does it also download the package to a cache? | 21:09 |
| mordred | clarkb: but would dnf be able to install the packages from zypper cache? | 21:09 |
| ianw | greghaynes: it does, with keepcache=1 ... the layout i haven't figure out though | 21:09 |
| clarkb | mordred no I am semi suggesting we use suse instead | 21:09 |
| fungi | greghaynes: it does, so i guess we could install then roll back a snapshot of the file tree except for the cache dir | 21:09 |
| greghaynes | ianw: fungi ok, so a hack could be to build two images and bind mount the cache into them both | 21:09 |
| greghaynes | and throw away the image that does a full install | 21:10 |
| ianw | i also says "kept until the next successful operation" which is a little vague as to when it might get cleared out | 21:10 |
| mordred | clarkb: oh, well, I'm fine with that ... EXCEPT - I do not have a good minimal cloud image story with suse yet | 21:10 |
| *** sputnik13 has joined #openstack-infra | 21:10 | |
| greghaynes | fungi: ianw or even simpler, just install all those packages into a chroot and bind mount the cache into it then rm the chroot | 21:10 |
| clarkb | but ya zypper install --download-only | 21:10 |
| greghaynes | (this exposes the sillyness of lacking a downloadonly option) | 21:10 |
| ianw | greghaynes: yeah, that's inception levels of chroot happening with dib... | 21:11 |
| greghaynes | ianw: we could do it during a phase that happens outside of the dib chroot | 21:11 |
| mordred | I can't believe they won't support a downloadonly option | 21:11 |
| fungi | this nail has a docker hammer written all over it! | 21:11 |
| greghaynes | mordred: maybe if we show them a rube goldberg setup like that itll sway them ;) | 21:11 |
| ianw | anyway, i might try and find some people to talk to .. it may be that this use-case hasn't been explained properly | 21:12 |
| fungi | greghaynes: or they'll just wonder why we're not running suse instead | 21:12 |
| greghaynes | hah, I do not object to the suse idea | 21:12 |
| ianw | dnf is quite focused on minimising things, like it's delta updates etc | 21:12 |
| ianw | which is what "normal" people want | 21:12 |
| fungi | interdiff between rpms? or just between indexes? | 21:13 |
| fungi | apt has supported incremental index updates for ages, though it's only enabled in testing/unstable | 21:13 |
| fungi | by default anyway | 21:13 |
| mordred | I find the incremental index updates to be worse | 21:13 |
| fungi | since stable changes infrequently enough to make it not useful | 21:13 |
| mordred | personally | 21:13 |
| *** amotoki_ has quit IRC | 21:14 | |
| fungi | mordred: i find them worse unless i'm updating frequently, and then i find them better | 21:14 |
| ianw | no like delta-rpms | 21:14 |
| *** pcrews has quit IRC | 21:14 | |
| fungi | there's a sweet spot where if your update frequency is too low then you're better off disabling the feature | 21:14 |
| ianw | yeah my deb system i turn that off, it's faster to download the whole file | 21:14 |
| dstufft | ianw: hi | 21:14 |
| *** ldnunes has quit IRC | 21:14 | |
| *** austin81 has left #openstack-infra | 21:15 | |
| ianw | dstufft: hi ... if you feel like looking at pip, https://github.com/pypa/pip/pull/3037 would fix devstack+f22 | 21:15 |
| *** e0ne has quit IRC | 21:15 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: create growroot element https://review.openstack.org/206636 | 21:17 |
| *** krtaylor has quit IRC | 21:18 | |
| dstufft | ianw: is pip uninstall the system provided cffi | 21:18 |
| greghaynes | SpamapS: ^ updated | 21:18 |
| dstufft | uninstalling* | 21:18 |
| *** e0ne has joined #openstack-infra | 21:19 | |
| *** flepied has joined #openstack-infra | 21:19 | |
| ianw | dstufft: hmm, yes what happened there, let me check | 21:19 |
| *** cody-somerville has joined #openstack-infra | 21:20 | |
| dstufft | ianw: IOW, if pip is uninstalling the system provided CFFI, why is it leaving behind a .so | 21:20 |
| dstufft | though I don't think that your change is wrong either, we should respect platlib | 21:20 |
| *** moravec has joined #openstack-infra | 21:20 | |
| dstufft | but I tihnk it might mask another problem | 21:20 |
| ianw | dstufft: yes, there might be a bug http://paste.openstack.org/show/422194/ <- looks like maybe it removes /cffi ... but not the .so in the directory above it? | 21:22 |
| dstufft | ianw: Ok | 21:22 |
| dstufft | that seems like wrong behavior to me | 21:22 |
| dstufft | might be CFFI's fault and not pip's though | 21:22 |
| dstufft | or Fedora's fault | 21:23 |
| dstufft | wooo | 21:23 |
| dstufft | untangling a mes | 21:23 |
| ianw | yeah, /usr/lib64/python2.7/site-packages/_cffi_backend.so remains after that... | 21:23 |
| ianw | dstufft: yeah, well that's why you're the expert. i was just wondering why that file didn't get overridden! | 21:23 |
| *** geoffarnold has quit IRC | 21:23 | |
| dstufft | since just "pip uninstall cffi" reproduces it, can you open an issue for that, and I'll merge your PR since it fixes an actual problem in that we should respect platlib when installing from wheels anyways | 21:24 |
| ianw | this has probably been around for a while, it's just the .so got to the point it breaks | 21:24 |
| *** geoffarnold has joined #openstack-infra | 21:24 | |
| *** flepied has quit IRC | 21:24 | |
| *** tiswanso has quit IRC | 21:25 | |
| ianw | dstufft: yep, will do in a bit, i'll have a quick dig and see if i find anything. thanks | 21:25 |
| dstufft | ianw: thanks, sorry for being so slow to respond | 21:27 |
| * dstufft needs a cloning machine. | 21:27 | |
| regXboi | clarkb: ping with a question question - where are the infra trusty-tahr images stored? | 21:28 |
| *** e0ne has quit IRC | 21:28 | |
| clarkb | regXboi: in the clouds we run against. rackspace and hpcloud currently | 21:29 |
| *** pc_m_ has quit IRC | 21:29 | |
| regXboi | clarkb: are they available via download to use to verify results independently? | 21:29 |
| *** mquin has joined #openstack-infra | 21:29 | |
| * regXboi is looking through the wiki and not seeing links | 21:29 | |
| clarkb | regXboi: not currently no, but you can build your own using disk image builder or via the snapshot scripts | 21:30 |
| clarkb | regXboi: in openstack-infra/project-config/tools/build-image.sh is a disk image builder wrapper to make it slightly eaier | 21:30 |
| regXboi | clarkb: ack and thanks! | 21:30 |
| fungi | regXboi: we would like to make them available for download at some point, though we only actually have possession of the dib-based images we upload, and currently we bake our access keys into them which is not so useful for downstream consumers | 21:30 |
| regXboi | fungi: also ack | 21:31 |
| *** shardy has quit IRC | 21:31 | |
| * regXboi had people asking about how to build images, so thanks | 21:31 | |
| *** thorst has quit IRC | 21:32 | |
| clarkb | it would be neat if hpcloud's images could be swifted too then we just made that container public | 21:32 |
| clarkb | that way we get easy public images (compared to rax + cdn) and you get images that are smaller than 15GB and can be booted on your laptop | 21:32 |
| fungi | yeah, i don't want to deal with serving those via apache because they're pretty large | 21:32 |
| regXboi | understood - the how to is good enough - I can point others to it :) | 21:33 |
| jeblair | fungi: i think we figured glean could handle ssh key injection, so that even if we publish our verbatim images, people can use them locally and inject their own keys on boot | 21:33 |
| *** mpopow has joined #openstack-infra | 21:33 | |
| fungi | jeblair: oh, coolness | 21:33 |
| greghaynes | Yep, as long as they are up for making a configdrive | 21:34 |
| clarkb | jeblair: yes but it does require using config drive which is clunky. There are however tools to make config drive usage saner so not the worst thing | 21:34 |
| greghaynes | It also isnt too hard to mount the image, inject a key, unmount | 21:34 |
| *** whoops has quit IRC | 21:34 | |
| jeblair | greghaynes: true; we can provide a script to automate that too | 21:35 |
| fungi | also i have a trusty-based etherpad-dev deployed at 2001:4800:7818:103:be76:4eff:fe05:f8e7 104.130.253.158 but there are a few apache-related errors in the puppet output that i need to sift through | 21:36 |
| fungi | it'll have to wait till after dinner though | 21:37 |
| jeblair | fungi: ooh cool. we'll need to figure out how to do the retry=0 thing with the websocket redirect | 21:37 |
| fungi | yep | 21:37 |
| *** klagid is now known as klagid_89 | 21:38 | |
| clarkb | oh if you are switching to trusty | 21:38 |
| clarkb | we can use the ubuntu package of nodejs I think | 21:38 |
| fungi | nice! | 21:38 |
| jeblair | ooh neat | 21:38 |
| mordred | ++ | 21:38 |
| fungi | that'll be swell | 21:38 |
| greghaynes | for now :p | 21:38 |
| jeblair | greghaynes: yeah, we might just want to move the nodejs stuff into a class or hide it behind a parameter so we can turn it back on if we need it | 21:39 |
| fungi | as for the production server, load since ops mid-cycle lunch looks not so high... i have a feeling lots of people bailed on the afternoon sessions | 21:39 |
| clarkb | jeblair: +1 | 21:39 |
| jeblair | fungi: we're also split into workgroups | 21:39 |
| greghaynes | Yep, I would expect by the next LTS we'll be back to not runing from system package | 21:40 |
| fungi | aha | 21:40 |
| clarkb | maybe I should look at writing the patch really quickly | 21:40 |
| jeblair | fungi: my guess is i'm in the largest which has 46 authors | 21:40 |
| clarkb | then fungi might want to redeploy after dinner | 21:40 |
| *** moravec has quit IRC | 21:40 | |
| openstackgerrit | Merged openstack-infra/system-config: Allow registered users to edit topics https://review.openstack.org/214628 | 21:40 |
| fungi | but yeah, if anybody else wants to hack on trusty-ifying puppet-etherpad i'll be thrilled | 21:40 |
| jeblair | i haven't noticed a problem (i saw one reconnect on the screen, but it may have been a noe-off) | 21:41 |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/puppet-cgit: Do not execute selinux commands if policy disabled https://review.openstack.org/214667 | 21:41 |
| fungi | an onoes-off | 21:41 |
| timrc | nibalizer, Thanks for the suggestion ^^ | 21:41 |
| jeblair | so i'm still optimistic about the 503+retry being the couse | 21:41 |
| jeblair | fungi: onoes :) | 21:41 |
| timrc | I forget about facts. Just in general :) | 21:41 |
| clarkb | timrc: out of curiousity, are you deploying it with selinux disabled intentionally? | 21:42 |
| *** whoops has joined #openstack-infra | 21:42 | |
| timrc | clarkb, Apparently. | 21:42 |
| clarkb | timrc: I know pleia2 put a bit of effort into making selinux work so its sad t osee others decide they need to disable it | 21:42 |
| timrc | clarkb, Isn't that what selinux is there for :)? | 21:42 |
| timrc | jk | 21:42 |
| timrc | clarkb, I'd like to, at some point in time, figure out why we had to disable it beyond "git replication didn't work with it enabled" and why we disabled it rather than put it into permissive mode. | 21:43 |
| *** Sukhdev has quit IRC | 21:43 | |
| clarkb | timrc: well we know replication works too | 21:43 |
| * timrc worked on auditd in a former life so I have a certain affinity for it. | 21:43 | |
| *** moravec has joined #openstack-infra | 21:43 | |
| clarkb | because thats how we do it | 21:43 |
| openstackgerrit | Pradeep Kilambi proposed openstack/requirements: Add jsonpath-rw-ext to global requirements https://review.openstack.org/214331 | 21:43 |
| clarkb | timrc: because my prefernece is we use the software as designed rather than build in hackarounds | 21:43 |
| timrc | clarkb, Yeah. I'm confused as to why it was disabled. Something to follow up with my colleague. | 21:44 |
| timrc | All I know is that Things assume selinux is enabled and it currently breaks us.... | 21:44 |
| timrc | clarkb, "disabled" is a valid mode in selinux though. | 21:44 |
| clarkb | timrc: yes, but not for our git mirror | 21:44 |
| *** unicell has quit IRC | 21:45 | |
| clarkb | we recently found rax stopped enforcing by default too | 21:45 |
| timrc | clarkb, So isn't that where system-config comes in? | 21:45 |
| clarkb | and this tripped over that and caught it so we could fix it | 21:45 |
| *** unicell has joined #openstack-infra | 21:45 | |
| clarkb | if however we say "well just disable it then" we wouldn't have that trip and fix | 21:45 |
| clarkb | timrc: I don't think so, we know the software works with enforcing | 21:45 |
| clarkb | so it should be enforcing | 21:45 |
| *** thiagop has quit IRC | 21:45 | |
| timrc | So I think that's a good attitude and practice, but for systems running selinux disabled which is a valid mode, the alledgly reusable module should not fall over? | 21:46 |
| clarkb | it is reusable | 21:46 |
| nibalizer | timrc: my machine doesn't have selinux_config_mode | 21:46 |
| clarkb | timrc: instead of switching to not enforcing we should fix the module to continue enforcing | 21:46 |
| nibalizer | [ruby-1.9.3-p551]$: facter | grep selinux | 21:46 |
| nibalizer | selinux => false | 21:46 |
| nibalizer | is all I get | 21:46 |
| timrc | nibalizer, I just pulled the fact from puppetdb.openstack.org... | 21:46 |
| *** glauco has quit IRC | 21:47 | |
| timrc | nibalizer, selinux_mode was empty / unused. | 21:47 |
| nibalizer | hrm | 21:47 |
| clarkb | I guess my point is the bug is that enforcing doesn't work not that we need to allow disabled selinxu | 21:47 |
| clarkb | so fix that enforcing doesn't work in whatever case that is and everyone continues to be happy | 21:47 |
| timrc | clarkb, Organizationally shouldn't the server decide whether its enforcing and then modules use that information to do this or that? | 21:48 |
| fungi | clarkb: can you reenable puppet agent on zuul once 214795 lands? if you don't get around to it, i'll try to remember to check back in after dinner | 21:48 |
| timrc | So openstack says "we're enforcing" and then the module takes the logical branch that says "do this if enforcing" *shrug* | 21:48 |
| fungi | in the meantime, heading out for a couple hours | 21:48 |
| clarkb | timrc: maybe but I don't think your change does that either? its relying on facter not config management to say or did Imisread it? | 21:48 |
| clarkb | timrc: your change is saying "accept whatever broken default rackspace give sme" | 21:49 |
| timrc | That was changed.. I had originally had a parameter which defaulted to enforcing but was asked to use a fact instaed. | 21:49 |
| clarkb | timrc: not "I explicitly want t odisable selinx" | 21:49 |
| *** minwang2 has quit IRC | 21:49 | |
| timrc | er instead* | 21:49 |
| *** signed8bit has joined #openstack-infra | 21:49 | |
| *** zeih has joined #openstack-infra | 21:49 | |
| timrc | clarkb, I see it as "do this configuration if this thing is enabled otherwise do not" :) | 21:49 |
| clarkb | timrc: right and my example from before shows that doesn't work | 21:50 |
| clarkb | because your cloud will just change it up on you and if yo udon't trip over that you will have a sad | 21:50 |
| *** glauco has joined #openstack-infra | 21:50 | |
| *** glauco_ has joined #openstack-infra | 21:51 | |
| timrc | clarkb, I'm not familiar with the selinux thing rax had... was it a matter of rackspace falling over because assumptions were being made about the environment or did disabling selinux mask a bug? | 21:51 |
| *** gordc has quit IRC | 21:52 | |
| clarkb | timrc: rax disabled it for us helpfully | 21:52 |
| clarkb | timrc: our puppet failed and we went ok great | 21:52 |
| clarkb | timrc: if your change was in we would not have noticed and would not have had enforcing selinux | 21:52 |
| jeblair | that's the only reason i knew it was disabled.. ya. | 21:52 |
| clarkb | and all that work we did would have been wasted | 21:52 |
| *** doug-fish has quit IRC | 21:53 | |
| timrc | I guess I feel like enforcement of such a thing "thou shalt use selinux" should be done in openstack-infra/system-config and not in the module? | 21:53 |
| clarkb | timrc: right I am saying that would be fine but its not a thing your change supports aiui | 21:54 |
| clarkb | timrc: yours queries facter before puppet runs, finds that its disabled, then runs with it | 21:54 |
| timrc | But look, I can probably just put these systems into permissive for now to sort out the problems, a policy will be loaded, and semanage will not barf all over the place and cause the puppet agent to cry | 21:54 |
| clarkb | regardless of what system config or the module try to do | 21:54 |
| timrc | clarkb, Well my original change was passing in a default param that would be passed in from system-config (but it can just default to enforcing too) | 21:55 |
| *** glauco has quit IRC | 21:55 | |
| timrc | Would that be more acceptable? | 21:55 |
| clarkb | I think default enforcing and don't ask facter what it thinks it should be are what should be done | 21:55 |
| timrc | clarkb, https://review.openstack.org/#/c/214667/4/manifests/init.pp | 21:55 |
| clarkb | otherwise you are letting something other than puppet decide for you | 21:55 |
| timrc | That's what I originally had but was advised to use a fact instead *shrug* | 21:56 |
| *** zeih has quit IRC | 21:56 | |
| *** mriedem has quit IRC | 21:57 | |
| *** mpopow has quit IRC | 21:58 | |
| *** moravec has quit IRC | 21:58 | |
| *** mpopow has joined #openstack-infra | 21:59 | |
| clarkb | my biggest goal is to not allow disabled through when enforcing is intended | 21:59 |
| clarkb | and we know that sometimes cloud providers change that on you | 21:59 |
| *** dprince has quit IRC | 21:59 | |
| clarkb | so silently letting that through is badness | 21:59 |
| *** krtaylor has joined #openstack-infra | 21:59 | |
| *** klagid_89 is now known as klagid | 22:00 | |
| nibalizer | ya I told tim that a fact is preferable to an enforcing flag | 22:02 |
| nibalizer | clarkb: puppet catching that selinuix was disabled is neat and all, but thats a monitoring problem not a config mgmt problem | 22:02 |
| clarkb | nibalizer: it is a config managmeent problem | 22:02 |
| nibalizer | now puppet code to cause selinux to be enforcing, that I can get behind | 22:02 |
| *** Swami has quit IRC | 22:02 | |
| clarkb | selinux being enabled or disabled is config management | 22:02 |
| nibalizer | clarkb: detection of a change in status? thats a monitoring issue | 22:03 |
| clarkb | nibalizer: think of it this way, you run the change as is expecting it to be enforcing but it comes out not enforcing because the change didn't care | 22:03 |
| clarkb | thats a config management problem | 22:03 |
| nibalizer | puppet code to set it to be enforcing or not enforcing is a puppet thing, but no one has written that code for us | 22:03 |
| *** esker has joined #openstack-infra | 22:03 | |
| clarkb | nibalizer: correct and even if they had it would breka in some cases becaues facter always runs first | 22:03 |
| clarkb | you don't get updated facts after each resource changes | 22:03 |
| clarkb | so if puppet sets enforciing you should rely on what puppet wants not what facter says | 22:04 |
| nibalizer | thats valid but the next puppet run would fix it | 22:04 |
| clarkb | you can't assume a next run | 22:04 |
| nibalizer | i hesitate to ever manage that stuff with puppet since I like reboots between changes and puppet doesn't run that | 22:04 |
| clarkb | see the image builds | 22:04 |
| *** mrunge has quit IRC | 22:04 | |
| nibalizer | right I wouldn't manage that with puppet | 22:05 |
| nibalizer | in my mind, enforcing crosses the reboot barrier | 22:05 |
| nibalizer | so if you change that state, you have to reboot | 22:05 |
| *** geoffarnold has quit IRC | 22:05 | |
| nibalizer | also, if you want a notifier that selinux has become disabled, thats a monitoring issue | 22:05 |
| *** minwang2 has joined #openstack-infra | 22:05 | |
| nibalizer | opinionated puppet configuration doesn't seem like a good replacement for monitoring checks | 22:06 |
| clarkb | I am not asking for opinionated puppet | 22:06 |
| *** geoffarnold has joined #openstack-infra | 22:06 | |
| clarkb | I am saying let puppet decide if it should be enforcing or not | 22:06 |
| clarkb | not facter | 22:06 |
| clarkb | so that way you will fail still | 22:06 |
| *** otter768 has joined #openstack-infra | 22:06 | |
| *** resker has joined #openstack-infra | 22:07 | |
| clarkb | or optionally don't fail if you have chosen for that to be the case | 22:07 |
| clarkb | but as is you get neither, instead you just get whatever you were given | 22:07 |
| clarkb | and thats a config management problem | 22:07 |
| nibalizer | facter gives you this nice globaly available variable that you can check from anywhere | 22:07 |
| clarkb | but its wrong | 22:07 |
| nibalizer | and you want to throw that away and pass parameters around | 22:07 |
| nibalizer | it can be wrong, but if it is, you have deeper problems | 22:07 |
| clarkb | and failing safe is the wrong thing in that case? | 22:08 |
| *** resker has quit IRC | 22:08 | |
| crinkle | if I understand the argument correctly I think I agree with clarkb on this one, having a parameter to make it super explicit what you want is preferable to relying on a fact | 22:08 |
| clarkb | to summarize my two issues are 1) if there is a problem with enforcing there we should fix that instead of disabling and 2) we should make it so that if we end up disabled wen we want to be enforcing we fail | 22:09 |
| *** esker has quit IRC | 22:09 | |
| clarkb | 1 is something I don't know enough about to help debug. But 2 is a known thing that happens and is good to have | 22:10 |
| timrc | How would 2 be implemented? | 22:10 |
| timrc | If we passed a parameter to the module that not "enabled" it would fall over... more gracefully? | 22:11 |
| clarkb | timrc: ya | 22:11 |
| timrc | It would prevent people from running permissive as well. | 22:11 |
| *** otter768 has quit IRC | 22:11 | |
| timrc | Which enforcing without the enforcing but all the lovely audit logs. | 22:11 |
| clarkb | timrc: or they could pass in "permissive" and be ok with that | 22:11 |
| clarkb | and if it isn't permissive fail too | 22:11 |
| timrc | That doesn't make much sense to me. | 22:11 |
| timrc | disabled is permissive without the audit logging, permissive is enabled without the enforcement... | 22:12 |
| timrc | So you're okay with people running without the policy as long as they're getting audit logs? | 22:12 |
| clarkb | you have three states right? disabled, permissive, and enforcing | 22:12 |
| nibalizer | clarkb: so part of this comes from an ease-of-use perspective | 22:12 |
| *** unicell has quit IRC | 22:12 | |
| clarkb | justbe explicit about hich of the three is expcted | 22:12 |
| clarkb | fail others | 22:12 |
| clarkb | *otherwise | 22:12 |
| *** unicell has joined #openstack-infra | 22:12 | |
| nibalizer | we don't have any documentation on how to use our modules, and even three or four of us working hard on these modules, they're still poorly tested and hard to use | 22:12 |
| *** gnuoy has quit IRC | 22:13 | |
| nibalizer | so if by inspecting the fact we can make the puppet code adapt to it's enviornment and be easier to get started with, I think we should | 22:13 |
| clarkb | nibalizer: it goes both ways, puppet not doing what I expect is a use problem | 22:13 |
| *** Sukhdev has joined #openstack-infra | 22:13 | |
| timrc | clarkb, So then you're okay with someone passing in disabled and that masking out the selinux bits? | 22:13 |
| clarkb | nibalizer: except this is a security thing and you don't want it to adapt to its environemnt | 22:13 |
| timrc | Sorry I'm pretty dense :) | 22:13 |
| *** btully has joined #openstack-infra | 22:13 | |
| clarkb | timrc: yes! what I am not ok with is letting facter decide for me | 22:13 |
| nibalizer | clarkb: and it goes back to validating a security issue is something you should be actively monitoring and alerting on | 22:13 |
| nibalizer | hosts can be failing puppet in puppetboard for weeks at a time here, it's not something that causes concern | 22:14 |
| jesusaurus | clarkb: but changing the selinux mode requires a reboot, after which facter would be correct | 22:14 |
| *** amitgandhinz has quit IRC | 22:14 | |
| *** amotoki_ has joined #openstack-infra | 22:14 | |
| clarkb | jesusaurus: but you wouldn't know to reboot | 22:14 |
| clarkb | puppet would say +1 config is good | 22:14 |
| timrc | clarkb, Cool. | 22:14 |
| clarkb | and you would move on with life | 22:15 |
| jesusaurus | true | 22:15 |
| timrc | Also changing from enforcing to permissive or disabled does not require a reboot. | 22:15 |
| timrc | But going from disabled to permissive or enforcing does as the policy needs to be reloaded. | 22:15 |
| openstackgerrit | Tim Buckley proposed openstack-infra/devstack-gate: Install and run StackViz during devstack-gate host cleanup. (WIP) https://review.openstack.org/212207 | 22:15 |
| timrc | Just an fyi ;) | 22:15 |
| *** rfolco has quit IRC | 22:15 | |
| nibalizer | the point of facter is to identify the state of the machine and inform the actions to take on it | 22:16 |
| clarkb | nibalizer: and the point of puppet is to enforce a state of the machine and inform whether or not that state was achieved | 22:17 |
| *** annegentle has quit IRC | 22:17 | |
| nibalizer | right and selinux state is not managed in puppet | 22:17 |
| nibalizer | it cannot change through a puppet run | 22:17 |
| clarkb | it can... | 22:17 |
| nibalizer | not in our configuration | 22:17 |
| clarkb | see above | 22:17 |
| *** gnuoy has joined #openstack-infra | 22:18 | |
| clarkb | nibalizer: which even if we added would be a noop in the proposed change | 22:18 |
| timrc | FWIW RHEL systems be default are enforcing aren't they? | 22:18 |
| clarkb | bceause puppet would say you want it disabled | 22:18 |
| openstackgerrit | Merged openstack-infra/project-config: Correct ansible regex varname in zuul param funcs https://review.openstack.org/214795 | 22:18 |
| timrc | Or are they permissive? | 22:18 |
| clarkb | timrc: yes | 22:18 |
| timrc | er by* | 22:19 |
| clarkb | timrc: at least as built by dib which takes a pretty base rhel/centos image and layers over the top | 22:19 |
| *** amotoki_ has quit IRC | 22:19 | |
| clarkb | its possible they have other base images with different defaults. Dib uses the cloud images iirc | 22:20 |
| timrc | Okay well I think I have a way forward at least for the upstream change. | 22:21 |
| timrc | clarkb, I agree with you that we should be getting our stuff working with enforcing. | 22:21 |
| timrc | But that is a separate issue our team needs to work out, I think. | 22:21 |
| *** esker has joined #openstack-infra | 22:21 | |
| tonyb | How do new branches within a project get created? | 22:22 |
| *** gildub has joined #openstack-infra | 22:23 | |
| *** pradk has quit IRC | 22:23 | |
| tonyb | we kinda need stable/juno in python-swiftclient (and maybe more) | 22:23 |
| clarkb | tonyb: a person with permissions to create the branch does so via the gerrit ui | 22:23 |
| tonyb | clarkb: okay cool | 22:23 |
| tonyb | clarkb: Thanks. | 22:23 |
| clarkb | tonyb: for swiftclient that is likely an openstack release manager (ttx, dhellmann) | 22:23 |
| tonyb | clarkb: Thanks I'll check the gerrit UI and see if I can confirm that, | 22:24 |
| *** chen12 has joined #openstack-infra | 22:24 | |
| clarkb | tonyb: you can't do it via git push because that requires force permissions whihc we don't allow (as that is a way to bypass review and rewrite history \o/) | 22:27 |
| *** jtrovo has quit IRC | 22:27 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-etherpad_lite: Allow system nodejs install https://review.openstack.org/214821 | 22:27 |
| clarkb | fungi: ^ something like that maybe | 22:27 |
| tonyb | clarkb: That makes sense. | 22:28 |
| *** mwagner_lap has quit IRC | 22:32 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 22:32 | |
| timrc | What's interesting about the cgit module originally is that it wrapped the include for selinux in a check for os family but AFAIK we assume that cgit is going to be installed on a Red Hat system... | 22:33 |
| timrc | Is checking for OS family even necessary? | 22:33 |
| clarkb | timrc: that was probably premature optimization, right now red hat is still the only thing with a cgit package and mor ethan 9 months of support | 22:34 |
| clarkb | (vivid added a package so maybe debian did too but its not in a debian release or ubuntu LTS aiui) | 22:34 |
| timrc | Cool well I'll leave it untouched... I'm assuming there will be some app armor policies and what not for whenever we deploy cgit to an Ubuntu LTS :) | 22:34 |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/puppet-cgit: Do not execute selinux commands if policy disabled https://review.openstack.org/214667 | 22:35 |
| *** glauco_ has quit IRC | 22:35 | |
| *** bswartz has joined #openstack-infra | 22:36 | |
| *** FallenPegasus has joined #openstack-infra | 22:36 | |
| *** shashank_hegde has quit IRC | 22:37 | |
| *** glauco_ has joined #openstack-infra | 22:37 | |
| *** dimtruck is now known as zz_dimtruck | 22:38 | |
| *** sridhar_ram1 has joined #openstack-infra | 22:38 | |
| *** sridhar_ram has quit IRC | 22:39 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 22:39 | |
| clarkb | greghaynes: http://logs.openstack.org/54/211754/7/check/gate-dsvm-nodepool-nv/1cf77ed/logs/screen-nodepool.txt.gz#_2015-08-19_22_20_43_323 the image builds in ~9 minutes | 22:40 |
| clarkb | now just need to get auth working again | 22:40 |
| *** FallenPegasus has quit IRC | 22:41 | |
| *** abdelwas has quit IRC | 22:42 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/system-config: Test that modules.env is complete https://review.openstack.org/214787 | 22:43 |
| *** ajmiller_ has joined #openstack-infra | 22:46 | |
| *** claudiub has quit IRC | 22:46 | |
| *** chen12 has quit IRC | 22:47 | |
| Daviey | won goto ##pah | 22:47 |
| *** r-daneel has quit IRC | 22:49 | |
| *** ajmiller has quit IRC | 22:49 | |
| *** baoli has joined #openstack-infra | 22:51 | |
| *** glauco_ has quit IRC | 22:51 | |
| jhesketh | Morning | 22:53 |
| clarkb | jhesketh: good morning, I have one for you https://review.openstack.org/#/c/214692/ noticed we were indexing a bunch of html in elasticsearch | 22:54 |
| *** signed8bit has quit IRC | 22:54 | |
| *** esker has quit IRC | 22:54 | |
| *** esker has joined #openstack-infra | 22:54 | |
| *** baoli has quit IRC | 22:56 | |
| *** bnemec has quit IRC | 22:56 | |
| *** geoffarnold has quit IRC | 22:57 | |
| jhesketh | clarkb: ah woops | 22:57 |
| jhesketh | Thanks for the fix, lgtm | 22:58 |
| *** otter768 has joined #openstack-infra | 22:59 | |
| openstackgerrit | Madhusudhan Kandadai proposed openstack-infra/project-config: Make lbaasv2 scenario API job voting https://review.openstack.org/214767 | 22:59 |
| *** wenlock_ has quit IRC | 23:00 | |
| openstackgerrit | Madhusudhan Kandadai proposed openstack-infra/project-config: Make lbaasv2 scenario API job voting https://review.openstack.org/214767 | 23:00 |
| *** dannywil_ has joined #openstack-infra | 23:01 | |
| *** btully has quit IRC | 23:02 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/system-config: Add bifrost inventory management procedures https://review.openstack.org/214279 | 23:03 |
| *** cody-somerville has quit IRC | 23:03 | |
| *** dannywilson has quit IRC | 23:03 | |
| *** camunoz has quit IRC | 23:05 | |
| *** camunoz has joined #openstack-infra | 23:05 | |
| *** Sukhdev has quit IRC | 23:05 | |
| *** dangers is now known as dangers_away | 23:05 | |
| *** zul has joined #openstack-infra | 23:07 | |
| *** eharney has quit IRC | 23:08 | |
| *** zul has quit IRC | 23:12 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Remove heat pin https://review.openstack.org/214348 | 23:12 |
| *** amotoki_ has joined #openstack-infra | 23:15 | |
| openstackgerrit | ewitter proposed openstack-infra/git-review: Autotopic: read from configuration file . https://review.openstack.org/208065 | 23:17 |
| *** tlian2 has joined #openstack-infra | 23:18 | |
| adam_g | where are the first places to debug a jenkins master not pulling zuul jobs from a gearman queue? the master connects fine, its executors are listed in gearman's status and the triggered job is configured in jenkins | 23:18 |
| *** mwagner_lap has joined #openstack-infra | 23:19 | |
| *** amotoki_ has quit IRC | 23:19 | |
| *** sabeen3 has quit IRC | 23:20 | |
| *** angela-s has quit IRC | 23:20 | |
| *** tlian has quit IRC | 23:20 | |
| *** tonytan4ever has quit IRC | 23:20 | |
| *** bnemec has joined #openstack-infra | 23:20 | |
| clarkb | adam_g: make sure zuul is talking to the same gearman? | 23:21 |
| clarkb | adam_g: perhaps the streams got crossed? | 23:21 |
| openstackgerrit | Madhusudhan Kandadai proposed openstack-infra/project-config: Make lbaasv2 scenario API job non-voting https://review.openstack.org/214767 | 23:22 |
| adam_g | clarkb, i see zuul stuff in the gearman server, as well. executors look like they have a triggered job associated with them there | 23:23 |
| ianw | dstufft: if around. i guess this issue doesn't hit ubuntu because they use dist-packages, rather than doing the /usr/lib + /usr/lib64 split (http://packages.ubuntu.com/trusty/amd64/python-cffi/filelist) | 23:24 |
| ianw | dstufft: however, it seems a limitation of .egg building that installed-files.txt isn't created (still parsing that code) | 23:24 |
| dstufft | ianw: yea, well less about dist-packages and more about the fact they don't split platlib and purelib | 23:25 |
| ianw | e.g. https://github.com/pypa/pip/blob/develop/pip/req/req_install.py#L859 | 23:25 |
| ianw | so i think pip just has no idea these .so's are there | 23:26 |
| dstufft | if there's no installed-file.txt or w/e then no we don't | 23:26 |
| dstufft | we're just relying on geussing | 23:26 |
| dstufft | I *think* fedora is planning on switching to pip (or has already) for handling installing python packages | 23:26 |
| dstufft | inside of rpm that is, like using pip as the build tool | 23:26 |
| dstufft | not on the end user machine | 23:27 |
| ianw | right, so i guess on both ubuntu & debian "pip uninstall cffi" of the *packaged* cffi will leave the .so behind | 23:27 |
| ianw | i mean ubuntu & fedora | 23:28 |
| dstufft | yea, probably not | 23:28 |
| *** chlong has quit IRC | 23:28 | |
| dstufft | if it was put inside of cffi/ we probably would on ubuntu | 23:28 |
| *** geoffarnold has joined #openstack-infra | 23:29 | |
| ianw | i think both would remove that directory; but yeah, it's the top-level .so | 23:30 |
| ianw | dstufft: so it's not just that the package forgets to ship installed-files.txt ... it's actually not generated at all for it to ship? | 23:30 |
| *** asettle has joined #openstack-infra | 23:31 | |
| dstufft | ianw: setuptools does not generate it by default | 23:31 |
| dstufft | and distutils does not have the capability to generate it | 23:31 |
| dstufft | pip has some heustistics to uninstall files if they are part of top-level.txt and inside that directory | 23:31 |
| dstufft | if that's the case, then it's not a real bug other than distros being distros | 23:32 |
| adam_g | clarkb, oh, i think its the fact that zuul is failing its merge check before triggering/queuing anything | 23:32 |
| dstufft | (and is partially why I recommend for distros to use pip to interface with python packages) | 23:32 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-accessbot: Fix target path for regular git clone during tests https://review.openstack.org/214828 | 23:32 |
| *** achanda has joined #openstack-infra | 23:33 | |
| *** dims_ has joined #openstack-infra | 23:33 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-ansible: Fix target path for regular git clone during tests https://review.openstack.org/214829 | 23:33 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-apparmor: Fix target path for regular git clone during tests https://review.openstack.org/214830 | 23:34 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-apps_site: Fix target path for regular git clone during tests https://review.openstack.org/214831 | 23:34 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-askbot: Fix target path for regular git clone during tests https://review.openstack.org/214832 | 23:34 |
| clarkb | adam_g: ah ya make sure you have a zuul merger running | 23:34 |
| *** geoffarnold has quit IRC | 23:34 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-asterisk: Fix target path for regular git clone during tests https://review.openstack.org/214833 | 23:34 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-bandersnatch: Fix target path for regular git clone during tests https://review.openstack.org/214834 | 23:34 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-bugdaystats: Fix target path for regular git clone during tests https://review.openstack.org/214835 | 23:34 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-bup: Fix target path for regular git clone during tests https://review.openstack.org/214836 | 23:34 |
| *** geoffarnold has joined #openstack-infra | 23:34 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-diskimage_builder: Fix target path for regular git clone during tests https://review.openstack.org/214837 | 23:34 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-drupal: Fix target path for regular git clone during tests https://review.openstack.org/214838 | 23:35 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-elastic_recheck: Fix target path for regular git clone during tests https://review.openstack.org/214839 | 23:35 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-elasticsearch: Fix target path for regular git clone during tests https://review.openstack.org/214840 | 23:35 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-etherpad_lite: Fix target path for regular git clone during tests https://review.openstack.org/214841 | 23:35 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-exim: Fix target path for regular git clone during tests https://review.openstack.org/214842 | 23:35 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-gerrit: Fix target path for regular git clone during tests https://review.openstack.org/214843 | 23:35 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-gerritbot: Fix target path for regular git clone during tests https://review.openstack.org/214844 | 23:35 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-github: Fix target path for regular git clone during tests https://review.openstack.org/214845 | 23:35 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-graphite: Fix target path for regular git clone during tests https://review.openstack.org/214846 | 23:36 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-haveged: Fix target path for regular git clone during tests https://review.openstack.org/214847 | 23:36 |
| *** dims has quit IRC | 23:36 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-httpd: Fix target path for regular git clone during tests https://review.openstack.org/214848 | 23:36 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-iptables: Fix target path for regular git clone during tests https://review.openstack.org/214849 | 23:36 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-jeepyb: Fix target path for regular git clone during tests https://review.openstack.org/214850 | 23:36 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-kerberos: Fix target path for regular git clone during tests https://review.openstack.org/214851 | 23:36 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-kibana: Fix target path for regular git clone during tests https://review.openstack.org/214852 | 23:36 |
| *** fedexo has joined #openstack-infra | 23:37 | |
| *** sharikapongubala has quit IRC | 23:38 | |
| *** sharikap_ has joined #openstack-infra | 23:38 | |
| *** dims_ has quit IRC | 23:39 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-lodgeit: Fix target path for regular git clone during tests https://review.openstack.org/214853 | 23:39 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-log_processor: Fix target path for regular git clone during tests https://review.openstack.org/214854 | 23:39 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-logrotate: Fix target path for regular git clone during tests https://review.openstack.org/214855 | 23:39 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-logstash: Fix target path for regular git clone during tests https://review.openstack.org/214856 | 23:39 |
| *** dims has joined #openstack-infra | 23:39 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-mailman: Fix target path for regular git clone during tests https://review.openstack.org/214857 | 23:39 |
| *** puranamr has quit IRC | 23:39 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-mediawiki: Fix target path for regular git clone during tests https://review.openstack.org/214858 | 23:39 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-meetbot: Fix target path for regular git clone during tests https://review.openstack.org/214859 | 23:40 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-mysql_backup: Fix target path for regular git clone during tests https://review.openstack.org/214860 | 23:40 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-nodepool: Fix target path for regular git clone during tests https://review.openstack.org/214861 | 23:40 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-openafs: Fix target path for regular git clone during tests https://review.openstack.org/214862 | 23:40 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-openstackid: Fix target path for regular git clone during tests https://review.openstack.org/214863 | 23:40 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-os_client_config: Fix target path for regular git clone during tests https://review.openstack.org/214864 | 23:40 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-packagekit: Fix target path for regular git clone during tests https://review.openstack.org/214865 | 23:40 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-pgsql_backup: Fix target path for regular git clone during tests https://review.openstack.org/214866 | 23:40 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-phabricator: Fix target path for regular git clone during tests https://review.openstack.org/214867 | 23:40 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-pip: Fix target path for regular git clone during tests https://review.openstack.org/214868 | 23:41 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-planet: Fix target path for regular git clone during tests https://review.openstack.org/214869 | 23:41 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-project_config: Fix target path for regular git clone during tests https://review.openstack.org/214870 | 23:41 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-puppet: Fix target path for regular git clone during tests https://review.openstack.org/214871 | 23:41 |
| *** zul has joined #openstack-infra | 23:41 | |
| * timrc cowers | 23:41 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-redis: Fix target path for regular git clone during tests https://review.openstack.org/214872 | 23:41 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-releasestatus: Fix target path for regular git clone during tests https://review.openstack.org/214873 | 23:41 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-reviewday: Fix target path for regular git clone during tests https://review.openstack.org/214874 | 23:41 |
| taron | I need a stampede gif for the next time this happens | 23:41 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-simpleproxy: Fix target path for regular git clone during tests https://review.openstack.org/214875 | 23:41 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-snmpd: Fix target path for regular git clone during tests https://review.openstack.org/214876 | 23:42 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-ssh: Fix target path for regular git clone during tests https://review.openstack.org/214877 | 23:42 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-ssl_cert_check: Fix target path for regular git clone during tests https://review.openstack.org/214878 | 23:42 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-statusbot: Fix target path for regular git clone during tests https://review.openstack.org/214879 | 23:42 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-storyboard: Fix target path for regular git clone during tests https://review.openstack.org/214880 | 23:42 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-subunit2sql: Fix target path for regular git clone during tests https://review.openstack.org/214881 | 23:42 |
| dstufft | ahhh | 23:42 |
| dstufft | what is going on | 23:42 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-sudoers: Fix target path for regular git clone during tests https://review.openstack.org/214882 | 23:42 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-tmpreaper: Fix target path for regular git clone during tests https://review.openstack.org/214883 | 23:42 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-ulimit: Fix target path for regular git clone during tests https://review.openstack.org/214884 | 23:42 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-unattended_upgrades: Fix target path for regular git clone during tests https://review.openstack.org/214885 | 23:43 |
| nibalizer | I have to change one line in like 60 repos | 23:43 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-unbound: Fix target path for regular git clone during tests https://review.openstack.org/214886 | 23:43 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-user: Fix target path for regular git clone during tests https://review.openstack.org/214887 | 23:43 |
| * asselin_ hopes there's no typo | 23:43 | |
| taron | it's kinda spectacular, actually | 23:43 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-vcsrepo: Fix target path for regular git clone during tests https://review.openstack.org/214888 | 23:43 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-vinz: Fix target path for regular git clone during tests https://review.openstack.org/214889 | 23:43 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-yum: Fix target path for regular git clone during tests https://review.openstack.org/214890 | 23:43 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-zanata: Fix target path for regular git clone during tests https://review.openstack.org/214891 | 23:43 |
| *** bnemec has quit IRC | 23:43 | |
| greghaynes | so much for that whole DRY thing | 23:44 |
| openstackgerrit | Victor Stinner proposed openstack/requirements: Update nose-exclude to 0.4.0 https://review.openstack.org/214892 | 23:44 |
| *** dims has quit IRC | 23:44 | |
| nibalizer | greghaynes: well building a ruby gem is fine, even planned, but not done yet | 23:44 |
| *** shashank_hegde has joined #openstack-infra | 23:44 | |
| *** sputnik13 has quit IRC | 23:45 | |
| *** bnemec has joined #openstack-infra | 23:45 | |
| fungi | clarkb: for 214821 is there a system-config change to exercise that for etherpad-dev yet? | 23:47 |
| clarkb | fungi: there isn't sorry been trying to do benefits elections and other paperworky things | 23:49 |
| clarkb | fungi: you should do them too if you haven't :) | 23:49 |
| openstackgerrit | ewitter proposed openstack-infra/git-review: Autotopic: read from configuration file . https://review.openstack.org/214895 | 23:50 |
| fungi | yeah, did them before bed last night | 23:50 |
| *** ajmiller_ has quit IRC | 23:51 | |
| *** ayoung has joined #openstack-infra | 23:51 | |
| fungi | well, _from_ bed actually | 23:51 |
| *** glauco_ has joined #openstack-infra | 23:52 | |
| *** tiswanso has joined #openstack-infra | 23:53 | |
| *** dingyichen has joined #openstack-infra | 23:53 | |
| *** geoffarn_ has joined #openstack-infra | 23:53 | |
| *** bharath has quit IRC | 23:54 | |
| *** geoffarnold has quit IRC | 23:54 | |
| *** glauco_ has quit IRC | 23:56 | |
| *** tiswanso has quit IRC | 23:58 | |
| *** erlon has quit IRC | 23:58 | |
| *** bnemec has quit IRC | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!