| *** marun has quit IRC | 00:01 | |
| *** imeerovi has joined #openstack-infra | 00:08 | |
| *** gokrokve has joined #openstack-infra | 00:09 | |
| *** jpich has joined #openstack-infra | 00:12 | |
| *** weshay has quit IRC | 00:13 | |
| *** gokrokve has quit IRC | 00:14 | |
| mordred | jogo: ok. I responded to your cycle goals thing | 00:15 |
|---|---|---|
| mordred | jogo: hopefully I won't get voted off the island | 00:15 |
| annegentle | mordred: heh | 00:15 |
| clarkb | mordred: the tribe has spoken | 00:15 |
| annegentle | mordred: I'm still formulating my response | 00:15 |
| mordred | tl;dr - end user experience in openstack SUCKS and we shoudl do nothing but fix it | 00:15 |
| annegentle | if only there was an openstack island. with beaches | 00:15 |
| mordred | annegentle: I like beaches | 00:15 |
| annegentle | mordred: how were the beaches last week? | 00:16 |
| mordred | annegentle: EXCELLENT | 00:16 |
| annegentle | mordred: and was burning man a mudpit? | 00:16 |
| annegentle | does mud burn? | 00:16 |
| mordred | annegentle: it was for a few hours ... but it is a desert, so that did not last more than half a day | 00:16 |
| mordred | annegentle: anything can burn if you try hard enough | 00:17 |
| annegentle | snor | 00:17 |
| annegentle | t | 00:17 |
| annegentle | gas mixes with dirt right? | 00:17 |
| *** dkranz has quit IRC | 00:18 | |
| clarkb | mordred: ++ (note 2 is a subset of 1 imo) | 00:19 |
| mordred | yah | 00:19 |
| anteaya | I'm enjoying imagining the collective intake of breath from the vendors | 00:29 |
| anteaya | the air just all went out of the room | 00:29 |
| *** yamamoto has joined #openstack-infra | 00:30 | |
| *** yamamoto has quit IRC | 00:34 | |
| *** oomichi has joined #openstack-infra | 00:35 | |
| *** jpich_ has joined #openstack-infra | 00:36 | |
| jogo | mordred: awesome thanks | 00:38 |
| jogo | mordred: ++ to fixing user experience | 00:38 |
| jogo | mordred: I like "less features more win" | 00:38 |
| *** jpich has quit IRC | 00:40 | |
| *** garyh has joined #openstack-infra | 00:40 | |
| *** mmaglana has joined #openstack-infra | 00:43 | |
| clarkb | mordred: you taking shots on "OMAHA"s ? | 00:45 |
| *** mmaglana_ has joined #openstack-infra | 00:45 | |
| *** dimtruck is now known as zz_dimtruck | 00:46 | |
| jogo | wow gate is empty ^_^ | 00:47 |
| *** mmaglana has quit IRC | 00:48 | |
| *** mmaglana_ has quit IRC | 00:50 | |
| bknudson | jogo: we keep rechecking but things keep failing pip installs | 00:50 |
| *** mmaglana has joined #openstack-infra | 00:50 | |
| mordred | clarkb: I do not know what you speak of? | 00:51 |
| clarkb | mordred: Manning screaming "Omaha" the quickest way to alcohol poisoning is to make it a drinking game | 00:51 |
| clarkb | bknudson: :/ I think we have somewhat proven that its internal cloud networking that is broken. Maybe we can get neutron folks to describe how we should be deploying onto it | 00:52 |
| *** mmaglana has quit IRC | 00:55 | |
| bknudson | clarkb: seems pretty random but also happening too often for us to get a review to verify. | 00:55 |
| clarkb | its not random. it is 99% of the time happening in hpcloud | 00:55 |
| *** mmaglana has joined #openstack-infra | 00:56 | |
| clarkb | so last week we added per region pypi mirrors but taht hasn't fixed the problem. so not Internet being bad but cloud networking being bad | 00:56 |
| bknudson | mordred: we had some of the discussion about "client library should contain exactly ZERO admin functions" early on in the openstack-sdk discussions | 00:57 |
| mordred | bknudson: I agree with them | 00:57 |
| mordred | bknudson: or, at the very least, there should be a clear and simple interface that lets 90% of the users do 90% of the things easily | 00:57 |
| mordred | and the hard/complex/special things can be somewhere else | 00:57 |
| mordred | because the people who just want a server do not care about them | 00:58 |
| anteaya | +1 | 00:58 |
| bknudson | mordred: I was hoping we'd end up with maybe a low-level API and a higher-level API built on it. I'm not sure what direction it went since I got too busy to help out with it. | 00:58 |
| mordred | bknudson: I believe that's what happening | 00:58 |
| mordred | right now there is only a low level API | 00:59 |
| clarkb | I do note that hpcloud b1, b3, and b5 appaer to have the most failures | 00:59 |
| clarkb | b2 and b4 are fine. I wonder if b1,3,5 are the ones we shifted load onto | 00:59 |
| jogo | fungi: the ATC tool | 01:03 |
| jogo | why not just use git logs? | 01:04 |
| jamielennox | mordred, bknudson: there is a fairly low level, API version specific interface for a number of the services, the intention is then to build a cross-version simpler API on top of that | 01:04 |
| jamielennox | an email went out very recently, part of that is asking for ideas of what the ideal higher level interface would look like, because i don't know/think it's the same as the current clients | 01:05 |
| jamielennox | if you have any ideas they would be welcomed | 01:05 |
| mordred | jamielennox: yes - I'm working up a good response to that | 01:06 |
| mordred | jamielennox: I can tell you from current experience that it is NOT what the current libs look like :) | 01:06 |
| *** zz_dimtruck is now known as dimtruck | 01:06 | |
| clarkb | jamielennox: yes please less of this spaghetti kwargs everywhere code :) | 01:06 |
| jamielennox | mordred: excellent, i'm hoping we can get together a few examples and make a decision at summit | 01:06 |
| mordred | jamielennox: I was telling dtroyer_zz the other day, I've been cooking up a lib recently that is an extraction of all of the code that infra uses as well as the code I've been writing for ansible recently | 01:07 |
| mordred | jamielennox: it currently uses the python-*client libs - but I think it might make a good straw man for the simple API - such that taking it and re-working the backend to use the low-level SDK code would be a fun exercise | 01:08 |
| mordred | jamielennox: so I'll also try to just send some ugly patches to talk about too | 01:08 |
| mordred | :) | 01:08 |
| jamielennox | mordred: cool - look forward to seeing it, i completely agree about the existing clients | 01:09 |
| *** gokrokve has joined #openstack-infra | 01:09 | |
| jamielennox | it can be hard though having messed with them for so long to come up with completely new approaches, i would love to know what new people coming to OS expect to find | 01:11 |
| jamielennox | because i'm pretty sure that boto is not the answer here either | 01:12 |
| * mordred shudders | 01:12 | |
| clarkb | jamielennox: I think the actual api matters less than having reasonable documentation so that I don't have to read nova code to figure out if this feature in python-novaclient is intended to work. And the high level api needs to cover common use cases. I want a node with a public ip. I want a node with a persistent volume | 01:13 |
| clarkb | jamielennox: doing those things should be easy and documented. What the actual client api looks like is less my concern | 01:13 |
| *** mestery_ is now known as mestery | 01:14 | |
| *** gokrokve has quit IRC | 01:14 | |
| jamielennox | clarkb: definetly a good point | 01:15 |
| jamielennox | clarkb: particularly that i'd like to care less about compute vs storage vs identity and just deal with operations on openstack | 01:15 |
| clarkb | jamielennox: yup exactly | 01:15 |
| clarkb | because as a user my intent is to have "tangible" things. not worry about what service provides which thing | 01:16 |
| clarkb | I shouldn't need to know that I talk to nova for a compute node, then I go talk to neutron for a floating ip, then I go talk to cinder for a volume and wire it all up before running config management on it | 01:16 |
| clarkb | I should just get network, cpu, and storage | 01:16 |
| jamielennox | yep, i don't see the clients going anywhere - if you know enough to know which service you need they will be available, but that's not the 90% case | 01:17 |
| *** harlowja_at_home has joined #openstack-infra | 01:22 | |
| lifeless | jamielennox: my concern is that programmers writing to the API | 01:22 |
| lifeless | jamielennox: don't get any glue we put in the 'clients' - we need to sort our stuff out server side so that the restful API is actually clean | 01:22 |
| lifeless | jamielennox: whether thats a facade in front of the whole conglomeration or something else I dunno. | 01:23 |
| clarkb | another thing that we need that is related to all this is "standardized" networking. We are currently strugglign with neutron because apparently we are doing it wrong | 01:23 |
| clarkb | well what is the correct way to be setting this stuff up? | 01:23 |
| morganfainberg | mordred, jogo ++ on ux stuff | 01:29 |
| morganfainberg | jogo, i only responded to sdague's post because he covered most of the stuff that I would have phrased in there. though, mordred's response is awesome. | 01:29 |
| *** yamamoto has joined #openstack-infra | 01:30 | |
| *** openstack_ has joined #openstack-infra | 01:31 | |
| jamielennox | lifeless: so i think the answer to that is that the clients are opinionated and start paying attention to what is published by various APIs and at what versions | 01:32 |
| jamielennox | keystone for example publishes at GET / the current version of it's API to minor level (3.3) and we should be able to know client side what that means and use it | 01:32 |
| jamielennox | and just not support things we feel are stupid like the ability to throw random stuff at an API and have that serialized to a backend somewhere | 01:33 |
| jamielennox | which is at least part of the reason we can never get out of using kwargs there | 01:33 |
| *** JadnG has quit IRC | 01:35 | |
| jamielennox | clarkb: and 'i have no idea what to do about neutron' is my answer to anything like that | 01:36 |
| mordred | lifeless: I think nobody will write to the api | 01:36 |
| lifeless | jamielennox: I think that will be nicer but still keep the balkanisation intrenched | 01:36 |
| *** yamahata has joined #openstack-infra | 01:36 | |
| lifeless | entrenched | 01:36 |
| mordred | I mean, fix the rest api, sure, but that will take 5 years and never happen | 01:38 |
| mordred | whereas we can make a lib interface that dwim pretty easily by comparison | 01:39 |
| lifeless | sure, times N languages | 01:39 |
| mordred | yup | 01:39 |
| mordred | except fog and jclouds | 01:40 |
| lifeless | they already have a thing | 01:40 |
| mordred | yup | 01:40 |
| *** yamamoto has quit IRC | 01:43 | |
| *** erlon has joined #openstack-infra | 01:47 | |
| morganfainberg | mordred, i think even with the SDK we'll be surprised how many people write to the APi. but... it'll definitely be a smaller-ish number | 01:47 |
| *** nosnos has joined #openstack-infra | 01:51 | |
| *** bhuvan has joined #openstack-infra | 01:51 | |
| *** dims has joined #openstack-infra | 01:54 | |
| *** jpich_ is now known as jpich | 01:57 | |
| *** unicell has joined #openstack-infra | 02:00 | |
| mordred | morganfainberg: I would be surprised at that ... I never want to code to rest APIs ... | 02:01 |
| *** HenryG_ is now known as HenryG | 02:01 | |
| morganfainberg | mordred, totally agree on not wanting to code to rest apis :) | 02:02 |
| morganfainberg | mordred, i'm just guessing we will have orgs that want to do it "their" way not the SDK way. it's not a huge deal, but it'll be a bit more than anyone will truely expect if the SDK is solid. | 02:02 |
| mordred | yah. this is also the reason I want to focus on 80% stuff like what clarkb was referencing | 02:03 |
| mordred | if you wanna be fancy, ossum | 02:04 |
| mordred | but if all you want is a node that works ... that should be like one function call | 02:04 |
| harlowja_at_home | mordred, lifeless u got a sec for a pbr question? | 02:04 |
| mordred | harlowja_at_home: on my phone, but I can try | 02:05 |
| harlowja_at_home | kk | 02:05 |
| harlowja_at_home | i've been trying to get the changelog included in the doc building process (to show like a history link with the changelog), it seems that i have to have the docs venv run python setup.py sdist to produce the changelog so that then the python setup.py build_sphinx command and associated stuff can include it, is that the normal way of doing this, or is there something easier? | 02:06 |
| harlowja_at_home | https://review.openstack.org/#/c/119668/ (was an attempt at this) | 02:06 |
| morganfainberg | mordred, def. cannot disagree on any front. | 02:06 |
| harlowja_at_home | http://docs-draft.openstack.org/68/119668/4/check/gate-taskflow-docs/a44796e/doc/build/html/history.html seems to though be empty, ha | 02:06 |
| mordred | there is not a better way, bit there should be | 02:07 |
| mordred | it's a function call in pbr, just not exposed except via sdist | 02:08 |
| clarkb | mordred: harlowja_at_home: this wouldn't be an issue if we went back to tox isntalling an sdist | 02:08 |
| clarkb | mordred: harlowja_at_home: which also covers the can we build an sdist question (this came up when I think it was heat that broke their sdist builds at some point) | 02:08 |
| clarkb | but its slow | 02:08 |
| clarkb | :/ | 02:08 |
| mordred | also, sdists are mostly lame anyway | 02:09 |
| mordred | except when they aren't | 02:09 |
| mordred | even still, there should be a setup | 02:09 |
| harlowja_at_home | ya, i just need it for the changelog (except that it didn't seem to get sucked in anyway, haha) - although trying this locally it does, which is odd | 02:09 |
| mordred | .py target | 02:09 |
| harlowja_at_home | mordred, thx, guess that can be a future change, now i wonder why the changelog didn't get included; probably something off there i guess | 02:12 |
| harlowja_at_home | does the doc job just run the docs venv, or is that via some other mechanism (if it didn't run that venv, that would explain why its not there) | 02:14 |
| openstackgerrit | David Shrewsbury proposed a change to stackforge/dox: Logging improvements https://review.openstack.org/119674 | 02:14 |
| clarkb | harlowja_at_home: it does not run the docs venv. docs venv is non standard and honestly I wish there was a bit more conversation about adding it so that we can do it right | 02:14 |
| clarkb | harlowja_at_home: docs jobs do `tox -evenv python setup.py build_sphinx` | 02:14 |
| harlowja_at_home | ah, hmmm | 02:15 |
| harlowja_at_home | well that would explain that | 02:15 |
| clarkb | harlowja_at_home: see https://wiki.openstack.org/wiki/ProjectTestingInterface | 02:15 |
| clarkb | the docs target is ad hoc in some projects. other projects have 'doc' | 02:15 |
| clarkb | tl;dr don't count on it | 02:15 |
| harlowja_at_home | kk | 02:15 |
| clarkb | I am open to updating the project testing interface but that conversation hasn't come up | 02:15 |
| lifeless | harlowja_at_home: shoot | 02:16 |
| harlowja_at_home | ya, i thought docs job run docs venv, and all would be merry, ha | 02:16 |
| harlowja_at_home | then my changelog inclusion plan would have worked out | 02:17 |
| lifeless | clarkb: neutron broke setup.py install | 02:17 |
| *** yamamoto has joined #openstack-infra | 02:19 | |
| lifeless | harlowja_at_home: we can add a command to do the changelog | 02:19 |
| harlowja_at_home | lifeless, can it be connected into the build_sphinx ; so that people can include that changelog in the sphinx stuff | 02:19 |
| harlowja_at_home | apparently its working (somehow) for oslo.concurrency @ https://review.openstack.org/#/c/119194/ (maybe cause they pip install themselves?) | 02:20 |
| harlowja_at_home | or it could be a setup.cfg option for [build_sphinx] changelog = 1 or something | 02:20 |
| SlickNik | clarkb / mordred: seeing some failures in the check and gate jobs where the jobs aren't able to fetch from git.openstack.org. Known issue? | 02:22 |
| anteaya | SlickNik: possibly the network issue primarly on hpcloud nodes that clarkb mentioned in scrollback | 02:22 |
| lifeless | harlowja_at_home: possibly yeah | 02:22 |
| anteaya | SlickNik: have you a log to confirm? | 02:22 |
| lifeless | harlowja_at_home: would need to make sure we don't break building docs without git etc | 02:23 |
| SlickNik | anteaya: eg. https://jenkins01.openstack.org/job/gate-nova-python26/27010/console, and eg. https://jenkins01.openstack.org/job/gate-nova-python26/27010/console | 02:23 |
| anteaya | wow that was a fast failure | 02:23 |
| SlickNik | err, sorry copy paste error: https://jenkins01.openstack.org/job/gate-python-troveclient-python27/332/ | 02:23 |
| harlowja_at_home | lifeless, agreed | 02:24 |
| anteaya | fatal: Could not read from remote repository | 02:24 |
| anteaya | hmmm | 02:24 |
| *** tomoe_ has quit IRC | 02:25 | |
| anteaya | nothing odd jumping out on the farm: http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=2 | 02:25 |
| *** otter768 has quit IRC | 02:27 | |
| anteaya | I have forgotten the command to specify where i want to clone from | 02:27 |
| anteaya | a random clone completes without a hiccup for m | 02:28 |
| SlickNik | anteaya: yup, same here — works fine for me so it's possibly related to the hpcloud network connectivity issue that clarkb mentioned earlier. | 02:28 |
| SlickNik | will keep an eye out to see if it's still happening. | 02:29 |
| SlickNik | But hopefully, 'twas just something intermittent | 02:29 |
| anteaya | we can hope | 02:29 |
| anteaya | this works but this is from gerrit: git clone ssh://anteaya@review.openstack.org:29418/openstack/python-troveclient | 02:32 |
| anteaya | oh: http://paste.openstack.org/show/107977/ | 02:34 |
| anteaya | this might just mean I hve the url incorrect | 02:34 |
| anteaya | or it might mean git05 is unhappy | 02:34 |
| anteaya | I must have the url incorrect, git01 - git05 give me the same response | 02:35 |
| anteaya | on closer inspection it looks like git03 had a hiccup but it appears to be back now: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=902&rra_id=all | 02:38 |
| *** daya_k has joined #openstack-infra | 02:41 | |
| anteaya | my url was wrong, I had to add the port number | 02:43 |
| anteaya | git clone git://git05.openstack.org:29418/openstack/python-troveclient | 02:43 |
| anteaya | worked from all 5 servers | 02:43 |
| *** _nadya_ has joined #openstack-infra | 02:50 | |
| *** rushiagr_away is now known as rushiagr | 02:52 | |
| *** dims has quit IRC | 02:56 | |
| *** oomichi is now known as oomichi_away | 02:57 | |
| *** oomichi_away has quit IRC | 03:02 | |
| *** otter768 has joined #openstack-infra | 03:02 | |
| *** baohua has quit IRC | 03:03 | |
| *** rushiagr is now known as rushiagr_away | 03:03 | |
| *** rushiagr_away is now known as rushiagr | 03:05 | |
| *** gokrokve has joined #openstack-infra | 03:09 | |
| *** bdpayne has joined #openstack-infra | 03:13 | |
| *** craigbr has joined #openstack-infra | 03:13 | |
| *** otter768 has quit IRC | 03:13 | |
| *** gokrokve has quit IRC | 03:14 | |
| *** rushiagr is now known as rushiagr_away | 03:16 | |
| *** dimtruck is now known as zz_dimtruck | 03:21 | |
| *** tomoe_ has joined #openstack-infra | 03:23 | |
| *** sressot has quit IRC | 03:24 | |
| *** imcsk8 has quit IRC | 03:25 | |
| *** imcsk8 has joined #openstack-infra | 03:25 | |
| *** stevemar has quit IRC | 03:28 | |
| openstackgerrit | Joshua Harlow proposed a change to openstack-dev/pbr: Allow for inclusion of authors and changelog when building docs https://review.openstack.org/119688 | 03:28 |
| harlowja_at_home | lifeless, mordred let me know if ^ is ok with u | 03:29 |
| harlowja_at_home | nothing to complicated | 03:31 |
| *** bdpayne has quit IRC | 03:33 | |
| *** hdd has joined #openstack-infra | 03:44 | |
| *** stevemar has joined #openstack-infra | 03:44 | |
| openstackgerrit | Julie Pichon proposed a change to openstack-infra/config: Add integration tests to the Horizon gate https://review.openstack.org/115004 | 03:47 |
| *** harlowja_at_home has quit IRC | 03:54 | |
| *** erlon has quit IRC | 04:00 | |
| *** _nadya_ has quit IRC | 04:01 | |
| *** gokrokve has joined #openstack-infra | 04:09 | |
| *** garyh has quit IRC | 04:09 | |
| *** craigbr has quit IRC | 04:10 | |
| *** rushiagr_away is now known as rushiagr | 04:11 | |
| *** craigbr has joined #openstack-infra | 04:13 | |
| *** gokrokve has quit IRC | 04:14 | |
| *** torandu has joined #openstack-infra | 04:17 | |
| *** craigbr has quit IRC | 04:18 | |
| jogo | anteaya: ping | 04:26 |
| jogo | anteaya: how do you currently track 3rd party CI and if they are running? | 04:27 |
| *** koolhead17 has joined #openstack-infra | 04:28 | |
| *** openstack_ has quit IRC | 04:30 | |
| *** baohua has joined #openstack-infra | 04:40 | |
| *** yfried has quit IRC | 04:46 | |
| *** hdd has quit IRC | 04:48 | |
| *** arnaud has joined #openstack-infra | 04:48 | |
| *** baohua has quit IRC | 04:49 | |
| *** baohua has joined #openstack-infra | 04:49 | |
| *** otherwiseguy has joined #openstack-infra | 04:51 | |
| *** cipcosma has joined #openstack-infra | 05:05 | |
| *** koolhead17 has quit IRC | 05:09 | |
| *** frank_zhou has joined #openstack-infra | 05:13 | |
| *** QuinnyPig has quit IRC | 05:16 | |
| *** QuinnyPig has joined #openstack-infra | 05:16 | |
| *** otherwiseguy has quit IRC | 05:19 | |
| *** QuinnyPig has quit IRC | 05:21 | |
| *** QuinnyPig has joined #openstack-infra | 05:22 | |
| *** tsg has quit IRC | 05:27 | |
| *** arnaud has quit IRC | 05:32 | |
| *** amotoki has joined #openstack-infra | 05:34 | |
| *** ppai has joined #openstack-infra | 05:37 | |
| *** flaper87|afk is now known as flaper87 | 05:39 | |
| *** isaacb has joined #openstack-infra | 05:43 | |
| openstackgerrit | Sumit Naiksatam proposed a change to openstack-infra/config: Create Group Based Policy Stackforge project https://review.openstack.org/119604 | 05:50 |
| openstackgerrit | Prashanth Pai proposed a change to openstack-infra/config: Add swiftonfile project to stackforge https://review.openstack.org/115250 | 05:51 |
| *** isaacb has quit IRC | 05:52 | |
| *** loki184 has joined #openstack-infra | 05:56 | |
| *** nosnos has quit IRC | 05:57 | |
| *** nosnos_ has joined #openstack-infra | 06:00 | |
| *** imeerovi has quit IRC | 06:01 | |
| *** SumitNaiksatam has quit IRC | 06:02 | |
| *** SumitNaiksatam has joined #openstack-infra | 06:03 | |
| *** koolhead17 has joined #openstack-infra | 06:03 | |
| *** isaacb has joined #openstack-infra | 06:04 | |
| *** arnaud has joined #openstack-infra | 06:07 | |
| *** koolhead17 has quit IRC | 06:08 | |
| *** gokrokve has joined #openstack-infra | 06:09 | |
| *** gokrokve has quit IRC | 06:14 | |
| *** isaacb has quit IRC | 06:16 | |
| openstackgerrit | A change was merged to stackforge/dox: Logging improvements https://review.openstack.org/119674 | 06:26 |
| *** JadnG has joined #openstack-infra | 06:26 | |
| openstackgerrit | Sumit Naiksatam proposed a change to openstack-infra/config: Create Group Based Policy Stackforge project https://review.openstack.org/119604 | 06:28 |
| SumitNaiksatam | SergeyLukjanov: hi, thanks for your review, i have uploaded a new patch set: https://review.openstack.org/119604 | 06:30 |
| *** isaacb has joined #openstack-infra | 06:30 | |
| *** yfried has joined #openstack-infra | 06:30 | |
| *** baohua has quit IRC | 06:36 | |
| yfried | BobBall_AWOL: looking for help with citrix gate | 06:36 |
| *** loki184 has quit IRC | 06:39 | |
| *** HeOS has quit IRC | 06:45 | |
| *** pkoniszewski has joined #openstack-infra | 06:50 | |
| *** koolhead17 has joined #openstack-infra | 06:52 | |
| *** mpaolino has joined #openstack-infra | 06:59 | |
| *** che-arne has quit IRC | 06:59 | |
| *** ociuhandu has quit IRC | 07:02 | |
| *** mpaolino has quit IRC | 07:04 | |
| *** jcoufal has joined #openstack-infra | 07:05 | |
| *** yolanda has joined #openstack-infra | 07:09 | |
| *** stevemar has quit IRC | 07:13 | |
| *** jpich has quit IRC | 07:14 | |
| *** arxcruz has joined #openstack-infra | 07:14 | |
| *** lttrl has joined #openstack-infra | 07:15 | |
| *** Longgeek has joined #openstack-infra | 07:16 | |
| openstackgerrit | Flavio Percoco proposed a change to stackforge/dox: Use `:20` tag in f20's DockerFile https://review.openstack.org/119704 | 07:18 |
| openstackgerrit | Flavio Percoco proposed a change to stackforge/dox: Add support for multiple images https://review.openstack.org/119705 | 07:18 |
| openstackgerrit | Flavio Percoco proposed a change to stackforge/dox: Add support for multiple images https://review.openstack.org/119705 | 07:19 |
| *** afazekas_ has joined #openstack-infra | 07:22 | |
| *** arnaud has quit IRC | 07:22 | |
| *** ihrachyshka has joined #openstack-infra | 07:22 | |
| *** e0ne has joined #openstack-infra | 07:22 | |
| *** jcoufal has quit IRC | 07:23 | |
| *** e0ne has quit IRC | 07:24 | |
| *** zul has quit IRC | 07:24 | |
| *** jcoufal has joined #openstack-infra | 07:25 | |
| *** arxcruz has quit IRC | 07:25 | |
| *** luqas has joined #openstack-infra | 07:26 | |
| *** yamamoto has quit IRC | 07:27 | |
| *** arxcruz has joined #openstack-infra | 07:29 | |
| *** ihrachyshka_ has joined #openstack-infra | 07:29 | |
| *** jistr has joined #openstack-infra | 07:29 | |
| *** ihrachyshka has quit IRC | 07:32 | |
| *** Longgeek has quit IRC | 07:33 | |
| *** ihrachyshka_ has quit IRC | 07:36 | |
| *** ihrachyshka_ has joined #openstack-infra | 07:36 | |
| *** jgallard has joined #openstack-infra | 07:37 | |
| *** MaxV has joined #openstack-infra | 07:38 | |
| *** MaxV has quit IRC | 07:40 | |
| *** pblaho has joined #openstack-infra | 07:41 | |
| *** pblaho has joined #openstack-infra | 07:41 | |
| *** Guest42286 has joined #openstack-infra | 07:45 | |
| ekarlso- | phschwartz: ping when you're around if u will today :) | 07:46 |
| openstackgerrit | yolanda.robla proposed a change to openstack-infra/jenkins-job-builder: Enable hipchat section into sample file https://review.openstack.org/119307 | 07:50 |
| *** mpaolino has joined #openstack-infra | 07:50 | |
| *** HeOS has joined #openstack-infra | 07:55 | |
| *** jlibosva has joined #openstack-infra | 07:56 | |
| *** Steap has quit IRC | 07:56 | |
| *** shardy_afk is now known as shardy | 07:56 | |
| *** jlibosva has quit IRC | 07:58 | |
| *** andreykurilin_ has joined #openstack-infra | 07:58 | |
| *** berendt has joined #openstack-infra | 07:58 | |
| *** jlibosva has joined #openstack-infra | 08:00 | |
| *** Daviey has quit IRC | 08:01 | |
| *** marun has joined #openstack-infra | 08:02 | |
| *** arxcruz has quit IRC | 08:04 | |
| *** arxcruz has joined #openstack-infra | 08:07 | |
| *** Longgeek has joined #openstack-infra | 08:07 | |
| *** derekh has joined #openstack-infra | 08:07 | |
| *** gokrokve has joined #openstack-infra | 08:09 | |
| *** yamamoto has joined #openstack-infra | 08:10 | |
| *** gokrokve has quit IRC | 08:14 | |
| *** tomoe_ has quit IRC | 08:16 | |
| *** koolhead17 has quit IRC | 08:16 | |
| *** tomoe_ has joined #openstack-infra | 08:16 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 08:18 | |
| *** koolhead17 has joined #openstack-infra | 08:18 | |
| *** Steap has joined #openstack-infra | 08:18 | |
| *** ZZelle has quit IRC | 08:19 | |
| *** ZZelle has joined #openstack-infra | 08:20 | |
| *** che-arne has joined #openstack-infra | 08:20 | |
| *** e0ne has joined #openstack-infra | 08:20 | |
| *** Daviey has joined #openstack-infra | 08:21 | |
| *** _nadya_ has joined #openstack-infra | 08:21 | |
| *** jlibosva has quit IRC | 08:21 | |
| *** yamamoto has quit IRC | 08:21 | |
| *** jlibosva has joined #openstack-infra | 08:22 | |
| *** koolhead_ has joined #openstack-infra | 08:26 | |
| *** amuller has joined #openstack-infra | 08:29 | |
| *** koolhead17 has quit IRC | 08:29 | |
| *** andreaf_ is now known as andreaf | 08:29 | |
| *** bhuvan has quit IRC | 08:31 | |
| openstackgerrit | Flavio Percoco proposed a change to stackforge/dox: Add support for multiple images https://review.openstack.org/119705 | 08:33 |
| *** marun has quit IRC | 08:34 | |
| *** KanagarajM has joined #openstack-infra | 08:43 | |
| *** loki184 has joined #openstack-infra | 08:44 | |
| *** frank_zhou has quit IRC | 08:49 | |
| *** luqas has quit IRC | 08:51 | |
| *** ildikov has joined #openstack-infra | 08:52 | |
| *** koolhead_ has quit IRC | 08:52 | |
| *** koolhead17 has joined #openstack-infra | 08:53 | |
| yfried | hi, can anyone help with citrix bot? it's failing to run on my patch | 08:53 |
| *** yamamoto has joined #openstack-infra | 09:02 | |
| *** jp_at_hp has joined #openstack-infra | 09:03 | |
| *** yamamoto has quit IRC | 09:06 | |
| SergeyLukjanov | jeblair, fungi, clarkb, if renaming will be this sept 13 - I'll be unable to drive it - it's my wedding day :) | 09:08 |
| *** gokrokve has joined #openstack-infra | 09:09 | |
| *** dguerri`afk is now known as dguerri | 09:13 | |
| *** andreykurilin_ has quit IRC | 09:13 | |
| *** tomoe_ has quit IRC | 09:13 | |
| *** tomoe_ has joined #openstack-infra | 09:13 | |
| *** gokrokve has quit IRC | 09:13 | |
| *** tomoe__ has joined #openstack-infra | 09:14 | |
| *** tomoe_ has quit IRC | 09:18 | |
| *** Guest42286 has quit IRC | 09:20 | |
| *** yamamoto has joined #openstack-infra | 09:21 | |
| *** lttrl has quit IRC | 09:23 | |
| *** zul has joined #openstack-infra | 09:24 | |
| *** Hal has joined #openstack-infra | 09:25 | |
| *** Hal is now known as Guest15849 | 09:25 | |
| *** luqas has joined #openstack-infra | 09:26 | |
| *** Guest15849 has quit IRC | 09:31 | |
| *** Guest15849 has joined #openstack-infra | 09:37 | |
| *** jcoufal has quit IRC | 09:42 | |
| *** isviridov_away is now known as isviridov | 09:45 | |
| *** Guest15849 has quit IRC | 09:46 | |
| *** rlandy has joined #openstack-infra | 09:47 | |
| *** yamamoto has quit IRC | 09:49 | |
| *** dtantsur is now known as dtantsur|lunch | 09:53 | |
| *** yamamoto has joined #openstack-infra | 09:55 | |
| openstackgerrit | Christian Berendt proposed a change to openstack-dev/cookiecutter: Remove unneeded definitions of Python Source Code Encoding https://review.openstack.org/111169 | 09:57 |
| openstackgerrit | Christian Berendt proposed a change to openstack-dev/cookiecutter: Enable hacking check H104 https://review.openstack.org/111171 | 09:58 |
| *** pblaho is now known as pblaho|afk | 09:58 | |
| *** pblaho|afk is now known as pblaho | 09:59 | |
| *** yamamoto has quit IRC | 09:59 | |
| *** e0ne has quit IRC | 10:00 | |
| *** lttrl has joined #openstack-infra | 10:02 | |
| *** luqas has quit IRC | 10:04 | |
| kashyap | I wonder if infra has plans for CLI-based interface for paste.o.o? Fedora infra has `fpaste` which one can use on remote headless servers to pastebin snippets from CLI. | 10:08 |
| *** yamahata has quit IRC | 10:09 | |
| *** gokrokve has joined #openstack-infra | 10:09 | |
| Kiall | kashyap: `pastebinit` can be pointed at it... | 10:10 |
| *** pcm_ has joined #openstack-infra | 10:10 | |
| Kiall | I'm sure other generic CLI's can too | 10:10 |
| Kiall | `echo "Test" | pastebinit -b http://paste.openstack.org/` ... http://paste.openstack.org/show/108173 | 10:11 |
| *** e0ne has joined #openstack-infra | 10:12 | |
| openstackgerrit | Boris Pavlovic proposed a change to openstack-infra/config: Set custom index.html to root of output of rally-dsvm jobs https://review.openstack.org/119663 | 10:12 |
| kashyap | Kiall, Ah, thanks for the pointer. /me looks up in Fedora repos for what provides that tool. | 10:14 |
| *** gokrokve has quit IRC | 10:14 | |
| *** jgallard has quit IRC | 10:16 | |
| *** koolhead17 has quit IRC | 10:16 | |
| *** MaxV has joined #openstack-infra | 10:20 | |
| *** yamamoto has joined #openstack-infra | 10:20 | |
| *** pblaho is now known as pblaho|afk | 10:21 | |
| *** yamamoto_ has joined #openstack-infra | 10:22 | |
| *** yamamot__ has joined #openstack-infra | 10:22 | |
| *** yamamoto_ has quit IRC | 10:22 | |
| *** yamamoto has quit IRC | 10:23 | |
| *** tomoe__ has quit IRC | 10:28 | |
| *** pelix has joined #openstack-infra | 10:30 | |
| *** jcoufal has joined #openstack-infra | 10:47 | |
| *** andreykurilin has joined #openstack-infra | 10:47 | |
| *** dizquierdo has joined #openstack-infra | 10:49 | |
| *** isviridov is now known as isviridov_away | 10:51 | |
| *** koolhead17 has joined #openstack-infra | 10:52 | |
| *** mpaolino has quit IRC | 10:54 | |
| *** daya_k has quit IRC | 10:59 | |
| *** dims has joined #openstack-infra | 11:00 | |
| *** pkoniszewski has quit IRC | 11:04 | |
| *** Guest15849 has joined #openstack-infra | 11:04 | |
| *** pkoniszewski has joined #openstack-infra | 11:04 | |
| *** yamamot__ has quit IRC | 11:06 | |
| *** ppai has quit IRC | 11:07 | |
| *** luqas has joined #openstack-infra | 11:08 | |
| *** gokrokve has joined #openstack-infra | 11:09 | |
| *** gokrokve has quit IRC | 11:14 | |
| *** Guest15849 has quit IRC | 11:15 | |
| *** yamamoto has joined #openstack-infra | 11:15 | |
| *** dims has quit IRC | 11:16 | |
| *** dims has joined #openstack-infra | 11:16 | |
| *** dims_ has joined #openstack-infra | 11:17 | |
| *** dmsimard_away is now known as dmsimard | 11:17 | |
| *** loki184 has quit IRC | 11:17 | |
| *** pblaho|afk is now known as pblaho | 11:19 | |
| *** dims has quit IRC | 11:21 | |
| *** e0ne has quit IRC | 11:22 | |
| *** ppai has joined #openstack-infra | 11:23 | |
| *** mwagner_lap has quit IRC | 11:23 | |
| *** rfolco has joined #openstack-infra | 11:24 | |
| *** yamamoto has quit IRC | 11:26 | |
| *** baoli has joined #openstack-infra | 11:27 | |
| *** baoli has joined #openstack-infra | 11:27 | |
| *** baoli has quit IRC | 11:28 | |
| *** baoli has joined #openstack-infra | 11:29 | |
| *** changbl has quit IRC | 11:34 | |
| *** luqas has quit IRC | 11:34 | |
| boris-42 | jhesketh hi | 11:38 |
| *** mbacchi has joined #openstack-infra | 11:42 | |
| *** tomoe_ has joined #openstack-infra | 11:44 | |
| *** mmedvede has joined #openstack-infra | 11:45 | |
| *** daya_k has joined #openstack-infra | 11:46 | |
| *** ppai has quit IRC | 11:47 | |
| *** yaguang has joined #openstack-infra | 11:48 | |
| *** mmaglana has quit IRC | 11:50 | |
| *** mmaglana has joined #openstack-infra | 11:51 | |
| *** unicell has quit IRC | 11:55 | |
| *** mmaglana has quit IRC | 11:55 | |
| *** yamamoto has joined #openstack-infra | 11:56 | |
| *** MaxV has quit IRC | 11:57 | |
| *** MaxV has joined #openstack-infra | 11:58 | |
| *** yamamoto has quit IRC | 12:01 | |
| *** mwagner_lap has joined #openstack-infra | 12:02 | |
| *** MaxV has quit IRC | 12:03 | |
| *** thelexx is now known as lxsli | 12:03 | |
| *** kgiusti has joined #openstack-infra | 12:03 | |
| *** yfried has quit IRC | 12:06 | |
| *** pkoniszewski has quit IRC | 12:07 | |
| *** yamamoto has joined #openstack-infra | 12:08 | |
| openstackgerrit | Flavio Percoco proposed a change to stackforge/dox: Add support for multiple images https://review.openstack.org/119705 | 12:09 |
| *** gokrokve has joined #openstack-infra | 12:09 | |
| *** nosnos_ has quit IRC | 12:13 | |
| *** gokrokve has quit IRC | 12:14 | |
| *** nosnos has joined #openstack-infra | 12:14 | |
| *** zns has joined #openstack-infra | 12:15 | |
| *** KanagarajM has quit IRC | 12:15 | |
| sdague | flaper87: on the dox hacking, how are you guys imagining multiple targets? | 12:15 |
| *** dims_ has quit IRC | 12:16 | |
| *** dims has joined #openstack-infra | 12:16 | |
| flaper87 | sdague: I just threw this idea out there: https://review.openstack.org/#/c/119705/ | 12:16 |
| flaper87 | which is pretty much how tox does it | 12:16 |
| *** weshay has joined #openstack-infra | 12:17 | |
| flaper87 | One problem is that `prep` is 1 for all images. Ideally, developers shouldn't need `prep` at all except for installing the test/project requirements | 12:17 |
| flaper87 | python-requirements* | 12:17 |
| flaper87 | This means we would probably have pre-built images per-project | 12:18 |
| *** nosnos has quit IRC | 12:18 | |
| *** aysyd has joined #openstack-infra | 12:19 | |
| flaper87 | I still think we'll need a way to specify per-image `prep` sections but we'll take care of that later on | 12:19 |
| sdague | flaper87: oh, so I was actually thinking the other direction | 12:19 |
| sdague | like zookeeper tests vs. mysql tests | 12:19 |
| *** dkranz has joined #openstack-infra | 12:20 | |
| *** zns has quit IRC | 12:20 | |
| *** mkoderer_ is now known as mkoderer | 12:20 | |
| *** dims_ has joined #openstack-infra | 12:20 | |
| *** dims has quit IRC | 12:21 | |
| *** zns has joined #openstack-infra | 12:21 | |
| *** pblaho is now known as pblaho|afk | 12:21 | |
| *** adalbas has joined #openstack-infra | 12:24 | |
| *** mmaglana has joined #openstack-infra | 12:25 | |
| *** luqas has joined #openstack-infra | 12:27 | |
| openstackgerrit | Martin Mágr proposed a change to openstack-infra/config: Packstack changes https://review.openstack.org/118333 | 12:28 |
| *** Mithrandir has quit IRC | 12:28 | |
| *** dtantsur|lunch is now known as dtantsur | 12:29 | |
| *** mmaglana has quit IRC | 12:30 | |
| *** ildikov_ has joined #openstack-infra | 12:31 | |
| *** ildikov has quit IRC | 12:34 | |
| *** dprince has joined #openstack-infra | 12:34 | |
| *** Mithrandir has joined #openstack-infra | 12:34 | |
| fungi | jogo: i'm missing context... were you talking about in regard to adding co-authored-by headers into the atc list generation? if so, sure that's the route i'd go. i can see about adding it unless someone's already working on a patch | 12:36 |
| sdague | fungi: I really thought that already was happening | 12:38 |
| *** gargola has joined #openstack-infra | 12:39 | |
| *** otherwiseguy has joined #openstack-infra | 12:40 | |
| *** bswartz has quit IRC | 12:40 | |
| fungi | sdague: i'll double-check teh script, but i don't believe that has ever been the case | 12:44 |
| fungi | seems like a reasonable addition though, i agree | 12:45 |
| *** yamahata has joined #openstack-infra | 12:45 | |
| *** yfried has joined #openstack-infra | 12:45 | |
| *** marcusvrn has joined #openstack-infra | 12:46 | |
| *** pblaho|afk is now known as pblaho | 12:47 | |
| fungi | sdague: yeah, i don't see any commit message analysis happening at http://git.openstack.org/cgit/openstack-infra/config/tree/tools/atc/email_stats.py which is the only way it would have been happening (gerrit doesn't store any metadata for arbitrary commit message header lines) | 12:50 |
| sdague | fungi: yep, fair | 12:50 |
| *** otherwiseguy has quit IRC | 12:50 | |
| *** wenlock has joined #openstack-infra | 12:50 | |
| *** radez_g0n3 is now known as radez | 12:51 | |
| *** mmaglana has joined #openstack-infra | 12:52 | |
| fungi | sdague: in fact, it looks like it's based on the change owner account, not necessarily the git author or committer | 12:52 |
| fungi | so could probably use some improvement in that regard as well | 12:52 |
| sdague | yeh | 12:52 |
| fungi | though we also don't require that the git author matches to an account in gerrit, just the committer | 12:53 |
| *** pkoniszewski has joined #openstack-infra | 12:53 | |
| *** dizquierdo has quit IRC | 12:53 | |
| fungi | so change owner might be a more accurate proxy for the commit author, given that subsequent contributors may make adjustments to the original change (leaving them as the eventual committer on the approved patchset) | 12:54 |
| *** isaacb has quit IRC | 12:55 | |
| *** zns has quit IRC | 12:55 | |
| fungi | it's probably worth clarifying at a policy level what an "active technical contributor" is (keeping in mind what sorts of information we have to make that determination) | 12:56 |
| *** mmaglana has quit IRC | 12:56 | |
| *** MaxV has joined #openstack-infra | 12:58 | |
| fungi | right now it involves being a foundation member, which implies having an account in the foundation member database, which is only enforced based on the existence of a gerrit account (via cla linkage), which then means a change owner or committer (not necessarily author or co-author since those don't have to link back to accounts) | 12:58 |
| *** lttrl has quit IRC | 12:59 | |
| *** lttrl has joined #openstack-infra | 12:59 | |
| fungi | there's also the problem that committer is immutable in git but gerrit account contact info is mutable, so by the time we analyze the data in git some contributions may fall through the cracks because of drift in registered gerrit e-mail addresses | 13:00 |
| *** zns has joined #openstack-infra | 13:01 | |
| *** pblaho is now known as pblaho|afk | 13:02 | |
| *** MaxV has quit IRC | 13:03 | |
| *** isviridov_away is now known as isviridov | 13:03 | |
| *** vhoward has joined #openstack-infra | 13:04 | |
| fungi | in fact, given the level of potential inaccuracy as well as the low voter turn-out, we might ought to reconsider our current automatic conveyance of atc status and switch it to a voluntary opt-in process (if you want to vote, there's a web form where you can stuff in one or more commit shas which are analyzed for presence of author and co-author addresses matched against your foundation member | 13:04 |
| fungi | details) | 13:04 |
| *** lttrl has quit IRC | 13:04 | |
| fungi | that solves the current problems with forcing contributors to be foundation members solely so that we can let some of them vote in technical elections | 13:05 |
| dhellmann | mordred: what's the story with sqlalchemy-migrate these days? we need https://review.openstack.org/#/c/110611/ for http://blueprints.launchpad.net/oslo.db/+spec/enable-mysql-connector if that's possible | 13:05 |
| *** bswartz has joined #openstack-infra | 13:06 | |
| *** Longgeek has quit IRC | 13:08 | |
| *** wenlock has quit IRC | 13:08 | |
| *** julim has joined #openstack-infra | 13:08 | |
| *** mpaolino has joined #openstack-infra | 13:08 | |
| *** julim has quit IRC | 13:08 | |
| *** julim has joined #openstack-infra | 13:09 | |
| *** e0ne has joined #openstack-infra | 13:09 | |
| *** otherwiseguy has joined #openstack-infra | 13:09 | |
| *** gokrokve has joined #openstack-infra | 13:09 | |
| *** dustins has joined #openstack-infra | 13:10 | |
| *** alaski_ is now known as alaski | 13:11 | |
| *** Longgeek has joined #openstack-infra | 13:11 | |
| *** pblaho|afk is now known as pblaho | 13:13 | |
| sdake | morning | 13:13 |
| *** gokrokve has quit IRC | 13:13 | |
| fungi | morning sdake! | 13:14 |
| fungi | i find that my fingers always want to tab-complete the word "morning" | 13:14 |
| *** zns has quit IRC | 13:17 | |
| *** zns has joined #openstack-infra | 13:19 | |
| *** sabeen has joined #openstack-infra | 13:20 | |
| *** MaxV has joined #openstack-infra | 13:20 | |
| *** mfer has joined #openstack-infra | 13:20 | |
| *** yolanda has quit IRC | 13:21 | |
| *** sandywalsh_ has joined #openstack-infra | 13:21 | |
| *** che-arne has quit IRC | 13:22 | |
| *** amuller_ has joined #openstack-infra | 13:23 | |
| sdague | heh | 13:23 |
| *** jgallard has joined #openstack-infra | 13:23 | |
| *** vponomaryov has quit IRC | 13:24 | |
| *** amuller has quit IRC | 13:24 | |
| *** dkliban_afk is now known as dkliban | 13:24 | |
| *** amuller__ has joined #openstack-infra | 13:24 | |
| *** amuller__ is now known as amuller | 13:24 | |
| *** sandywalsh has quit IRC | 13:24 | |
| *** annegent_ has joined #openstack-infra | 13:24 | |
| *** bknudson has quit IRC | 13:25 | |
| *** MaxV has quit IRC | 13:26 | |
| *** mriedem has joined #openstack-infra | 13:27 | |
| *** wenlock has joined #openstack-infra | 13:27 | |
| *** amuller_ has quit IRC | 13:28 | |
| *** paulrad has joined #openstack-infra | 13:28 | |
| *** MaxV has joined #openstack-infra | 13:31 | |
| *** koolhead17 has quit IRC | 13:31 | |
| *** zns has quit IRC | 13:31 | |
| *** koolhead17 has joined #openstack-infra | 13:32 | |
| *** MaxV has quit IRC | 13:32 | |
| *** MaxV has joined #openstack-infra | 13:33 | |
| *** signed8bit has joined #openstack-infra | 13:35 | |
| *** mriedem1 has joined #openstack-infra | 13:35 | |
| *** MaxV_ has joined #openstack-infra | 13:36 | |
| *** mriedem has quit IRC | 13:36 | |
| *** kgiusti has quit IRC | 13:36 | |
| *** MaxV has quit IRC | 13:36 | |
| fungi | probably a sign that i'm not entirely awake until it's no longer morning | 13:36 |
| *** nelsnelson has joined #openstack-infra | 13:37 | |
| *** koolhead17 has quit IRC | 13:37 | |
| *** kgiusti has joined #openstack-infra | 13:40 | |
| *** r-daneel has joined #openstack-infra | 13:45 | |
| *** Guest15849 has joined #openstack-infra | 13:45 | |
| *** bknudson has joined #openstack-infra | 13:46 | |
| *** yaguang has quit IRC | 13:46 | |
| *** miqui has joined #openstack-infra | 13:49 | |
| *** masayukig has quit IRC | 13:49 | |
| *** _nadya_ has quit IRC | 13:50 | |
| *** Guest15849 has quit IRC | 13:52 | |
| *** mmaglana has joined #openstack-infra | 13:52 | |
| *** doug-fish has joined #openstack-infra | 13:52 | |
| *** jaypipes has joined #openstack-infra | 13:55 | |
| *** masayukig has joined #openstack-infra | 13:55 | |
| openstackgerrit | A change was merged to openstack-infra/gitdm: Add committer details https://review.openstack.org/114842 | 13:55 |
| openstackgerrit | A change was merged to openstack-infra/reviewstats: Make pdb debugging of openreviews possible. https://review.openstack.org/118510 | 13:55 |
| openstackgerrit | A change was merged to openstack-infra/gitdm: Update James Li's affiliations https://review.openstack.org/117189 | 13:56 |
| *** mmaglana has quit IRC | 13:56 | |
| *** homeless has joined #openstack-infra | 13:57 | |
| openstackgerrit | A change was merged to openstack-infra/reviewstats: Work toward Python 3.4 support and testing https://review.openstack.org/118768 | 13:57 |
| *** vponomaryov has joined #openstack-infra | 13:58 | |
| *** salv-orlando has joined #openstack-infra | 13:58 | |
| *** paulrad has quit IRC | 13:58 | |
| *** paulrad has joined #openstack-infra | 13:58 | |
| *** gokrokve has joined #openstack-infra | 14:00 | |
| *** changbl has joined #openstack-infra | 14:01 | |
| *** markmcclain has joined #openstack-infra | 14:02 | |
| *** paulrad has quit IRC | 14:03 | |
| *** markmcclain has quit IRC | 14:03 | |
| *** otherwiseguy has quit IRC | 14:04 | |
| *** beekneemech is now known as bnemec | 14:04 | |
| *** pkoniszewski has quit IRC | 14:04 | |
| *** zns has joined #openstack-infra | 14:05 | |
| fungi | whoawaitwhat? https://review.openstack.org/119721 the neutron server consumes the neutron client? that's the sort of ouroboros which can only lead to repeated compatibility problems | 14:05 |
| *** markmcclain has joined #openstack-infra | 14:05 | |
| *** ihrachyshka_ has quit IRC | 14:06 | |
| *** baoli has quit IRC | 14:08 | |
| *** chuckC has quit IRC | 14:10 | |
| *** pblaho is now known as pblaho|afk | 14:10 | |
| *** Daviey has quit IRC | 14:10 | |
| *** baoli has joined #openstack-infra | 14:11 | |
| gilliard_ | +1 for "ouroboros" but I don't see it in that patch... | 14:11 |
| openstackgerrit | Darragh Bailey proposed a change to openstack-infra/git-review: Enable color support based on tty and config https://review.openstack.org/106617 | 14:12 |
| *** koolhead_ has joined #openstack-infra | 14:12 | |
| gilliard_ | oh now I do. | 14:12 |
| *** zz_jgrimm is now known as jgrimm | 14:12 | |
| *** ilyashakhat has joined #openstack-infra | 14:12 | |
| *** Ajaeger has joined #openstack-infra | 14:13 | |
| *** Guest15849 has joined #openstack-infra | 14:13 | |
| *** pblaho|afk is now known as pblaho | 14:14 | |
| andreykurilin | sdague, hi! do you have a bit free time to look at several my patches in requirements?:) | 14:15 |
| fungi | gilliard_: yeah, a new neutronclient release broke havana neutron... not because it didn't work as a client for connecting to old neutron servers, but because neutron was itself using neutronclient internally | 14:15 |
| *** esker has joined #openstack-infra | 14:15 | |
| fungi | /was/is | 14:15 |
| gilliard_ | and havana neutron will use the latest-available client, not the havana one? | 14:16 |
| fungi | well, there is no "havana" neutronclient | 14:16 |
| fungi | the clients aren't part of the integrated release, they just release linearly | 14:16 |
| gilliard_ | oh, OK. | 14:17 |
| gilliard_ | And the dependencies of a release aren't frozen. | 14:17 |
| *** dkranz has quit IRC | 14:18 | |
| gilliard_ | I'm more used to the maven-style of dependency mgmt where everything is frozen all the time. | 14:18 |
| fungi | gilliard_: right. at the moment we use the python clients as client interfaces and as internal communication libraries for the servers talking to each other, and expect them to be able to me comingled with client and communication library use cases on the same machine | 14:19 |
| dhellmann | fungi: apparently when oslo-messaging-ptl was renamed to oslo-messaging-release no members were added, can you put me in? https://review.openstack.org/#/admin/groups/391,members | 14:19 |
| *** tomoe_ has quit IRC | 14:20 | |
| fungi | dhellmann: that's... weird. renaming shouldn't ever remove members | 14:20 |
| *** tomoe_ has joined #openstack-infra | 14:20 | |
| dhellmann | fungi: I don't know what happened, then? | 14:20 |
| fungi | dhellmann: i've set it to include the oslo-release group now | 14:20 |
| dhellmann | thanks | 14:20 |
| fungi | dhellmann: did oslo.messaging at one point not have a separate ptl/release group and maybe recently grew one? | 14:21 |
| *** _buzz has quit IRC | 14:21 | |
| dhellmann | fungi: oh, perhaps that's it | 14:21 |
| *** zz_dimtruck is now known as dimtruck | 14:21 | |
| openstackgerrit | A change was merged to stackforge/dox: Add `--fix-missing` to trusty's Dockerfile https://review.openstack.org/119640 | 14:21 |
| openstackgerrit | A change was merged to stackforge/dox: Use `:20` tag in f20's DockerFile https://review.openstack.org/119704 | 14:21 |
| fungi | if so, the group starts out with no members and is automatically created when the acl change which introduces that new name is merged | 14:21 |
| *** Guest15849 has quit IRC | 14:22 | |
| dhellmann | yeah, that makes more sense | 14:22 |
| *** tsg has joined #openstack-infra | 14:22 | |
| *** Daviey has joined #openstack-infra | 14:23 | |
| *** garyh has joined #openstack-infra | 14:24 | |
| *** atiwari has joined #openstack-infra | 14:25 | |
| boris-42 | fungi hi | 14:25 |
| *** koolhead17 has joined #openstack-infra | 14:25 | |
| fungi | hi boris-42. have a question/request? | 14:25 |
| boris-42 | fungi ya I have very simple patch that sets custom index.html (from our repo) on rally job | 14:26 |
| *** eharney has joined #openstack-infra | 14:26 | |
| boris-42 | fungi it has +2 | 14:26 |
| boris-42 | fungi could you please take a look https://review.openstack.org/#/c/119663/ | 14:26 |
| boris-42 | fungi just one more publisher added to job | 14:26 |
| boris-42 | fungi *target* | 14:26 |
| Ajaeger | clarkb, fungi: Could you review https://review.openstack.org/119547 , please? | 14:26 |
| *** Guest15849 has joined #openstack-infra | 14:28 | |
| *** koolhead_ has quit IRC | 14:28 | |
| boris-42 | fungi thank you | 14:29 |
| *** julim has quit IRC | 14:30 | |
| *** dkranz has joined #openstack-infra | 14:30 | |
| *** david-lyle has joined #openstack-infra | 14:30 | |
| *** koolhead_ has joined #openstack-infra | 14:31 | |
| dhellmann | fungi: is there some sort of plan written down for these python 3.4 changes (https://review.openstack.org/#/c/118793/)? When is that cut-over going to happen, for example? | 14:31 |
| dhellmann | fungi: also, I'm not sure what to do about the stable branch versions of those changes | 14:31 |
| *** _buzz has joined #openstack-infra | 14:32 | |
| fungi | dhellmann: i'm going to manually run the 3.4 equivalents of any currently voting python33 jobs on a trusty node to make sure they're sane, and as soon as that's done i'll propose the layout.yaml change to replace them all | 14:32 |
| *** tonytan4ever has joined #openstack-infra | 14:33 | |
| fungi | dhellmann: as for the stable branches with python33 jobs currently voting, we either need to make sure they work with 3.4 or remove them from stable branches | 14:33 |
| *** yamahata has quit IRC | 14:33 | |
| *** superdan is now known as dansmith | 14:34 | |
| fungi | dhellmann: i'm hoping this week, now that feature freeze is done with | 14:34 |
| *** koolhea__ has joined #openstack-infra | 14:34 | |
| *** koolhead17 has quit IRC | 14:34 | |
| *** cdent has joined #openstack-infra | 14:34 | |
| fungi | dhellmann: it ends up needing to be a quick surgical strike, otherwise the situation might shift and/or the layout change will rapidly conflict with the state of the config repo | 14:35 |
| *** paulrad has joined #openstack-infra | 14:36 | |
| fungi | dhellmann: similarly, i need to test any currently voting pypy jobs on trusty and then move them to run there | 14:36 |
| fungi | dhellmann: once those two things happen, we should be able to dump our special py3k-precise nodes and get much more consistent response time on both py3k and pypy jobs | 14:37 |
| *** koolhead_ has quit IRC | 14:37 | |
| *** esker has quit IRC | 14:37 | |
| *** zns has quit IRC | 14:38 | |
| openstackgerrit | A change was merged to openstack-infra/config: Set custom index.html to root of output of rally-dsvm jobs https://review.openstack.org/119663 | 14:38 |
| dhellmann | fungi: ok, so land the changes in master quickly and then sort out stable by deciding whether to test with 3.4 or drop the test? | 14:38 |
| *** Guest15849 has quit IRC | 14:38 | |
| *** zns has joined #openstack-infra | 14:38 | |
| *** craigbr_ has joined #openstack-infra | 14:39 | |
| fungi | dhellmann: yeah, for most of the proposed master changes, those are just a convenience for devs to have the py34 env in their default tox run anywhere we previously also have py33 | 14:40 |
| fungi | hdfor a small percentage, i duplicated any special handling of py33 envs for py34 in tox.ini | 14:40 |
| *** isviridov is now known as isviridov_away | 14:40 | |
| *** paulrad has quit IRC | 14:40 | |
| *** craigbr_ has quit IRC | 14:40 | |
| fungi | dhellmann: but for the most part that can happen asynchronously to the job changes | 14:40 |
| Kiall | mordred: about? Got a sec re the openstack/governance change for openstack/designate-dashboard? | 14:40 |
| * Kiall has no clue what TZ mordred is in these days.. | 14:41 | |
| openstackgerrit | Boris Pavlovic proposed a change to openstack/requirements: Rally needs bumping python-novaclient https://review.openstack.org/119776 | 14:41 |
| boris-42 | dhellmann hi there | 14:41 |
| boris-42 | dhellmann ^ could you take a look at this | 14:41 |
| *** craigbr_ has joined #openstack-infra | 14:41 | |
| russellb | jeblair: gertty may be my new favoritest thing ever. | 14:43 |
| *** [HeOS] has joined #openstack-infra | 14:44 | |
| jeblair | russellb: aww yay! | 14:44 |
| *** julim has joined #openstack-infra | 14:44 | |
| *** julim has quit IRC | 14:44 | |
| openstackgerrit | A change was merged to stackforge/gertty: Fix crash on prev/next change https://review.openstack.org/119468 | 14:45 |
| *** julim has joined #openstack-infra | 14:45 | |
| openstackgerrit | A change was merged to stackforge/gertty: Fix another crash on prev/next change https://review.openstack.org/119476 | 14:45 |
| *** julim has quit IRC | 14:45 | |
| *** HeOS has quit IRC | 14:46 | |
| *** Guest15849 has joined #openstack-infra | 14:46 | |
| *** MaxV_ has quit IRC | 14:46 | |
| *** MaxV has joined #openstack-infra | 14:46 | |
| *** julim has joined #openstack-infra | 14:46 | |
| fungi | russellb: it is crazy useful | 14:46 |
| *** julim has quit IRC | 14:46 | |
| dhellmann | is anyone else having issues fetching from git? are the servers just really loaded or is work going on? | 14:47 |
| dhellmann | I've had a couple of times this morning where "git pull" just hung for a long time | 14:47 |
| fungi | russellb: i hate web browsers. i also have some machines i use on a regular basis where gerrit's webui is essentially unusable | 14:47 |
| mtreinish | dhellmann: yeah, I just noticed that myself | 14:47 |
| *** julim has joined #openstack-infra | 14:47 | |
| fungi | dhellmann: what is your git remote url? | 14:47 |
| russellb | yeah, feels more efficient than the web UI so far, and the offline usage <3<3<3 | 14:47 |
| *** julim has quit IRC | 14:48 | |
| dhellmann | fungi: git://git.openstack.org/openstack/cliff | 14:48 |
| fungi | dhellmann: just so i can narrow down investigation to specific propocols et cetera | 14:48 |
| jeblair | http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=2 | 14:48 |
| fungi | dhellmann: hrm, that should be lightweight... i'll look at cacti | 14:48 |
| *** julim has joined #openstack-infra | 14:48 | |
| jeblair | there's a small gap in the cacti data there, which may mean either the load on git.o.o was so high that cacti could not poll it, or there was a network interruption near git.o.o | 14:49 |
| *** Ajaeger has quit IRC | 14:49 | |
| *** julim has quit IRC | 14:49 | |
| jeblair | the second is more likely (because git.o.o is just a load balancer) | 14:49 |
| *** julim has joined #openstack-infra | 14:50 | |
| *** julim has quit IRC | 14:50 | |
| *** yamamoto has quit IRC | 14:50 | |
| *** julim has joined #openstack-infra | 14:51 | |
| *** julim has quit IRC | 14:51 | |
| openstackgerrit | Julien Danjou proposed a change to openstack-infra/config: Use python3-jobs template where possible https://review.openstack.org/110256 | 14:51 |
| *** MaxV has quit IRC | 14:51 | |
| *** julim has joined #openstack-infra | 14:52 | |
| *** lcheng_ has joined #openstack-infra | 14:52 | |
| *** julim has quit IRC | 14:52 | |
| fungi | jd__: thanks for ^ that! it's going to make my change to switch to python34 a lot simpler ;) | 14:52 |
| *** julim has joined #openstack-infra | 14:53 | |
| anteaya | jogo: hi, I don't track it, if folks need to track that they do so and let me know if there is an issue, the issue I follow up is non-compliance with requirements which can get them disabled | 14:53 |
| *** julim has quit IRC | 14:53 | |
| *** julim has joined #openstack-infra | 14:54 | |
| *** datsun180b has joined #openstack-infra | 14:54 | |
| *** julim has quit IRC | 14:54 | |
| anteaya | jogo: this is mikal's ci dashboard tool which I sucked into stackforge so people could expand it, if you want to add your last_commit tool that would be awesome: http://git.openstack.org/cgit/stackforge/radar/ | 14:54 |
| *** esker has joined #openstack-infra | 14:54 | |
| *** koolhead17 has joined #openstack-infra | 14:55 | |
| jd__ | fungi: :-) | 14:55 |
| *** julim has joined #openstack-infra | 14:55 | |
| *** julim has quit IRC | 14:55 | |
| *** esker has quit IRC | 14:55 | |
| *** jergerber has joined #openstack-infra | 14:55 | |
| *** esker has joined #openstack-infra | 14:55 | |
| anteaya | morning should be tab complete, we just need a fake user in this channel with morning as a username | 14:55 |
| dhellmann | mordred, lifeless : are we ready for a pbr release today? | 14:55 |
| *** esker has quit IRC | 14:55 | |
| fungi | jeblair: dhellmann: the git.o.o proxy doesn't currently seem to be under any load at all, so i agree it was probably a network blip | 14:55 |
| *** esker has joined #openstack-infra | 14:56 | |
| *** julim has joined #openstack-infra | 14:56 | |
| fungi | i don't see any similar gaps on the individual servers in the farm except one many hours ago on git03 | 14:56 |
| *** julim has quit IRC | 14:56 | |
| anteaya | fungi: I'm open to the conversation of making participation in elections opt-in, if you want to launch the discussion, it won't affect this round of elections but it might affect the next round | 14:56 |
| *** esker has quit IRC | 14:56 | |
| *** changbl has quit IRC | 14:56 | |
| *** jcoufal has quit IRC | 14:56 | |
| openstackgerrit | A change was merged to stackforge/gertty: Quote identifiers in migrations https://review.openstack.org/119662 | 14:56 |
| *** julim has joined #openstack-infra | 14:57 | |
| fungi | anteaya: yeah, it's a broader discussion i think, from both dev and foundation sides | 14:57 |
| *** esker has joined #openstack-infra | 14:57 | |
| *** julim has quit IRC | 14:57 | |
| *** changbl has joined #openstack-infra | 14:57 | |
| jeblair | anteaya: context? | 14:58 |
| openstackgerrit | A change was merged to stackforge/gertty: Add additional help text for openstack user/pass https://review.openstack.org/119665 | 14:58 |
| dhellmann | fungi: ok | 14:58 |
| *** julim has joined #openstack-infra | 14:58 | |
| *** julim has quit IRC | 14:58 | |
| *** koolhea__ has quit IRC | 14:58 | |
| fungi | jeblair: scrollback, 12:36 utc | 14:58 |
| *** chuckC has joined #openstack-infra | 14:59 | |
| *** julim has joined #openstack-infra | 14:59 | |
| *** maxbit has joined #openstack-infra | 14:59 | |
| *** julim has quit IRC | 14:59 | |
| jeblair | fungi: yes, we sholud do the things you say. :) | 14:59 |
| *** lcheng_ has quit IRC | 15:00 | |
| *** julim has joined #openstack-infra | 15:00 | |
| jeblair | we should decouple membership from contribution since apparently they are not actually required and it is a barrier | 15:00 |
| anteaya | yes, with whatever mechinism can facilitate the decoupling | 15:00 |
| *** marcusvrn has quit IRC | 15:01 | |
| *** lcheng_ has joined #openstack-infra | 15:02 | |
| *** tomoe__ has joined #openstack-infra | 15:03 | |
| *** koolhead_ has joined #openstack-infra | 15:04 | |
| *** koolhead17 has quit IRC | 15:04 | |
| *** koolhead17 has joined #openstack-infra | 15:05 | |
| *** lcheng__ has joined #openstack-infra | 15:05 | |
| *** yamahata has joined #openstack-infra | 15:05 | |
| craigbr_ | Can someone from the core team look at https://review.openstack.org/#/c/119094? All the chef builds are broken because of this issue | 15:05 |
| anteaya | anyone with a free hand able to re-enable 10119 varmourci vArmour CI openstack-ci-test@varmour.com | 15:05 |
| *** paulrad has joined #openstack-infra | 15:06 | |
| *** tomoe_ has quit IRC | 15:07 | |
| *** lcheng_ has quit IRC | 15:07 | |
| fungi | anteaya: done | 15:07 |
| *** koolhead_ has quit IRC | 15:08 | |
| *** enikanorov_ has joined #openstack-infra | 15:09 | |
| *** enikanorov_ has quit IRC | 15:09 | |
| *** unicell has joined #openstack-infra | 15:09 | |
| *** enikanorov_ has joined #openstack-infra | 15:10 | |
| *** paulrad has quit IRC | 15:10 | |
| *** daya_k has quit IRC | 15:11 | |
| *** jcoufal has joined #openstack-infra | 15:11 | |
| anteaya | fungi: thank you | 15:11 |
| fungi | hrm, load average on our git servers looks like it's spiking (as much as 10 over a 5-minute sample...) http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=949&rra_id=all | 15:11 |
| fungi | the load balancer may have been unresponsive to snmp queries due to a hard rate limit? was up over 300mbps when the gap appeared... http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=862&rra_id=all | 15:13 |
| *** salv-orlando has quit IRC | 15:14 | |
| *** MaxV has joined #openstack-infra | 15:15 | |
| *** stevemar has joined #openstack-infra | 15:15 | |
| jeblair | fungi: the pricing page claims "1,600Mb/s" for that class of server | 15:15 |
| fungi | hrm | 15:16 |
| fungi | well, we seem to spike to that same level consistently, which is slightly odd... http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=862&rra_id=2&view_type=&graph_start=1409584488&graph_end=1410189288 | 15:16 |
| *** afazekas_ has quit IRC | 15:17 | |
| *** MaxV has quit IRC | 15:20 | |
| mordred | craigbr_: done | 15:20 |
| *** hemna__ is now known as hemna | 15:20 | |
| craigbr_ | mordred: Thank you | 15:20 |
| mordred | craigbr_: also, fungi's information that ruby1.9.1 --version returns 1.9.3 is one of my favorite pieces of new information | 15:21 |
| fungi | mordred: oh, that's been a source of confusion in debian for years | 15:21 |
| fungi | mordred: the backstory on why is amusing in and of itself | 15:22 |
| fungi | mordred: or you can just tl;dr it as ERUBY and move on | 15:22 |
| *** MaxV has joined #openstack-infra | 15:23 | |
| mordred | fungi: oh, I was going to assume that the backstory at some point illustrated something where teh distro structure got in the way of helping | 15:23 |
| *** andreykurilin has quit IRC | 15:23 | |
| mordred | such as "we have a strict policy against chaning X in a Y type of release, so we're going to do something very strage which will confuse people for years rather than break the letter of that policy" | 15:23 |
| *** isviridov_away is now known as isviridov | 15:23 | |
| * mordred is still caffinating | 15:24 | |
| *** _buzz has quit IRC | 15:24 | |
| *** koolhead17 has quit IRC | 15:24 | |
| *** markmcclain has quit IRC | 15:26 | |
| fungi | mordred: well, it stemmed from backward compatibility in ruby interpreter releases and software being written for different interpreter versions so needing to be able to install them side by side. apparently things written for 1.8 could run on the 1.9 release so the interpreter name remained ruby1.8, but the 1.9.1 release broke backward compatibility | 15:26 |
| fungi | but software written for 1.9.1 will run fine on 1.9.3 | 15:27 |
| fungi | really 1.9.1 *should* have been released as 1.10 or 2.0 or something | 15:27 |
| *** MaxV_ has joined #openstack-infra | 15:28 | |
| *** MaxV has quit IRC | 15:28 | |
| *** Sincler has joined #openstack-infra | 15:29 | |
| openstackgerrit | A change was merged to openstack-infra/config: Fix chef gates, allow sudo for gem install and use ruby 1.9.1 https://review.openstack.org/119094 | 15:29 |
| *** gokrokve_ has joined #openstack-infra | 15:31 | |
| mordred | fungi: wait - so you're telling me that debian shipped the first release of 1.9 as ruby1.8? | 15:32 |
| mordred | and then when there was a release of 1.9 that did not work with 1.8 code, rather than just making a 1.9 package like they should have in the first place, they made a package called 1.9.1? | 15:32 |
| mordred | fungi: and that anybody thought that either of those activities made sense? | 15:33 |
| mordred | fungi: (ignoring briefly the other thing, where I agree with you, that 1.9.1 upstream should have been called 1.10 | 15:33 |
| fungi | mordred: well, apparently there was lots of software written to invoke the interpreter as ruby1.8 and when the initial 1.9 release worked with it they didn't want to go through another huge ruby transition unnecessarily | 15:34 |
| *** gokrokve has quit IRC | 15:34 | |
| fungi | apparently the transition from 1.7 to 1.8 was a fairly massive undertaking | 15:35 |
| jroll | mordred: a ruby dev would tell you 'use rvm' | 15:35 |
| jroll | mordred: (because it's all a clusterfuck) | 15:35 |
| *** paulrad has joined #openstack-infra | 15:36 | |
| fungi | mordred: the "good" news is that the ruby1.9.1 package has been removed from debian/testing so shouldn't be a source of confusion once nobody's using ubuntu trusty any longer ;) | 15:37 |
| mordred | hahaha | 15:37 |
| *** koolhead17 has joined #openstack-infra | 15:37 | |
| anteaya | ruby devs pointed tell newbies to stay away from ruby debian packaging | 15:38 |
| *** bhuvan has joined #openstack-infra | 15:38 | |
| anteaya | it is one of the things that motivated the creation of rvm | 15:38 |
| *** mmaglana has joined #openstack-infra | 15:38 | |
| anteaya | s/pointed/pointedly | 15:38 |
| mordred | distro packaging vs. language packaging is, in general, broken across the board | 15:38 |
| anteaya | no argument here | 15:38 |
| mordred | see also "don't use javascript tools and libraries like npm or bower because the distros don't really know how to package them yet" | 15:39 |
| mordred | and "go sucks because it statically compiles everything which is contrary to how the distros want to do things, so don't use it" | 15:40 |
| fungi | oh, actually the ruby1.9.1 removal transition is still not complete in unstable, so it might end up in the debian/jessie release after all https://bugs.debian.org/739611 | 15:40 |
| *** mikedillion has joined #openstack-infra | 15:40 | |
| mordred | fungi: spectacular | 15:40 |
| Shrews | mordred: fungi: did you guys know ansible has a durham office? heh, neato | 15:40 |
| mordred | Shrews: not just a durham office, they are, in fact, based completely in durham | 15:41 |
| mordred | Shrews: at the old american tobacco campus | 15:41 |
| fungi | oh, actually it was removed from testing in may, but is still in unstable because there are packages depending on it which are only in unstable | 15:41 |
| Shrews | mordred: even more neato | 15:41 |
| mordred | Shrews: the founder is a former redhat guy. | 15:41 |
| *** ildikov_ has quit IRC | 15:41 | |
| fungi | Shrews: yeah, ansible dehaan was a bunch of the other rpath linux/conary folks | 15:42 |
| Shrews | such techhub | 15:42 |
| fungi | er, was dehaan and a bunch of | 15:42 |
| *** amotoki_ has joined #openstack-infra | 15:42 | |
| fungi | anyway, he spun it off when sas bought rpath, since he had been working on ansible in his own time and it wasn't owned by rpath | 15:43 |
| *** pfallenop has quit IRC | 15:43 | |
| *** paulrad has quit IRC | 15:43 | |
| *** yamahata has quit IRC | 15:43 | |
| *** pfallenop has joined #openstack-infra | 15:43 | |
| *** mwagner_lap has quit IRC | 15:46 | |
| *** john-davidge has joined #openstack-infra | 15:47 | |
| *** salv-orlando has joined #openstack-infra | 15:48 | |
| fungi | though from what i heard through the grapevine, he moved to the bay area to take a job with cisco after the buy-out, and founded ansibleworks out there as a result. only more recently did they open the office at american tobacco | 15:51 |
| *** yamamoto has joined #openstack-infra | 15:51 | |
| *** esker has quit IRC | 15:53 | |
| clarkb | 119094 shouldnt be necessary on trusty. are we running the chef jobs on precise now? | 15:53 |
| *** jgallard has quit IRC | 15:53 | |
| *** esker has joined #openstack-infra | 15:53 | |
| jeblair | fungi, clarkb, mordred: http://status.openstack.org/elastic-recheck/ does not look like per-region mirrors have reduced the incidence of 1334550 or 1270710 or 1326813 | 15:54 |
| jeblair | fungi, clarkb, mordred: however, 'successful' matches of some of those have increased, which is weird and warrants investigation | 15:54 |
| jeblair | jogo: ^ | 15:54 |
| clarkb | jeblair: correct. hpcloud networking seems to continue its failures there | 15:55 |
| *** yamamoto has quit IRC | 15:55 | |
| *** MaxV_ has quit IRC | 15:56 | |
| *** MaxV has joined #openstack-infra | 15:56 | |
| john-davidge | Is this bug with Citrix XenServer CI currently known? | 15:56 |
| john-davidge | [ERROR] /opt/stack/new/devstack/functions-common:565 Cloning not allowed in this configuration | 15:56 |
| john-davidge | just started seeing it today | 15:56 |
| clarkb | jeblair: I think that confirms the trouble is near the nodes and not on the greater internets | 15:57 |
| *** bdpayne has joined #openstack-infra | 15:57 | |
| *** esker has quit IRC | 15:58 | |
| jeblair | http://logs.openstack.org/70/96770/8/check/gate-diskimage-builder-python27/c70089c/console.html | 15:58 |
| jeblair | that's the first example i found | 15:58 |
| *** stevemar has quit IRC | 15:58 | |
| jeblair | 2014-09-08 15:44:05.983 | error: [Errno 104] Connection reset by peer | 15:58 |
| *** stevemar has joined #openstack-infra | 15:59 | |
| *** gyee has joined #openstack-infra | 15:59 | |
| *** markmcclain has joined #openstack-infra | 15:59 | |
| anteaya | john-davidge: might I get a link to a patch where this is happening? | 16:00 |
| *** arxcruz has quit IRC | 16:00 | |
| fungi | jeblair: yeah, we were looking at those over the weekend. it does seem like maybe the one router per controller node suggestion might be the next thing to try | 16:00 |
| john-davidge | anteaya: https://review.openstack.org/#/c/87987 | 16:01 |
| *** MaxV has quit IRC | 16:01 | |
| mordred | jeblair, fungi: we can also try the suggestion of getting the 9 new routers up and going ... since that is a suggestion we've gotten from them already | 16:01 |
| fungi | mordred: yeah, that's what i meant | 16:02 |
| *** MaxV has joined #openstack-infra | 16:02 | |
| anteaya | john-davidge: which log? | 16:02 |
| jeblair | mordred: we will have 72 images in hpcloud then :( | 16:02 |
| mordred | but I'm going to send a follow up email to that guy and include you guys and let him know the problem we're currently seeing | 16:02 |
| mordred | jeblair: oh, that's a good point | 16:02 |
| john-davidge | anteaya: devstack - http://dd6b71949550285df7dc-dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/87/87987/20/25376/devstacklog.txt.gz | 16:02 |
| jeblair | mordred: i had hoped to try that _after_ we switched to using dib | 16:02 |
| mordred | jeblair: well, I'll hack on the dib patches this week | 16:02 |
| jeblair | mordred: but if we think it's the only reliable way to get networking in hpcloud, then i guess we'll have to do it first | 16:02 |
| *** zns has quit IRC | 16:03 | |
| clarkb | can we move the existing 5 first? | 16:03 |
| mordred | let me ping rick and see what he thinks about intra-hp networking issues | 16:03 |
| mordred | clarkb: what do you mean? | 16:03 |
| *** annegent_ has quit IRC | 16:03 | |
| fungi | mordred: though it sounded like the main benefit was going to be from pinning the routers to separate controllers, moreso than increasing the number of them | 16:03 |
| clarkb | we have 5 routers today. can we make them optimally placed? | 16:03 |
| fungi | right, what clarkb said | 16:03 |
| mordred | gotcha | 16:03 |
| anteaya | BobBall_AWOL: your system is broken and is about to be disabled | 16:03 |
| *** mikedillion has quit IRC | 16:04 | |
| *** jlibosva has quit IRC | 16:04 | |
| *** Guest15849 has quit IRC | 16:04 | |
| clarkb | that is simple enough todo without downtime if we have a communication method | 16:04 |
| jeblair | http://logs.openstack.org/48/119748/2/check/check-tempest-dsvm-neutron-full/8326cd5/logs/devstacklog.txt.gz | 16:04 |
| *** arnaud has joined #openstack-infra | 16:04 | |
| jeblair | clarkb, fungi: ^ that one failed several times! | 16:04 |
| *** zns has joined #openstack-infra | 16:05 | |
| anteaya | we need 10385 citrix_xenserver_ci Citrix XenServer CI openstack@citrix.com disabled please | 16:05 |
| * anteaya composes email to third-party-announce | 16:05 | |
| jeblair | clarkb, fungi: http://logs.openstack.org/32/118732/1/gate/gate-tempest-dsvm-neutron-heat-slow/5e477d0/logs/devstacklog.txt.gz | 16:05 |
| openstackgerrit | Spencer Krum proposed a change to openstack-infra/config: Adding a final setup step to install_puppet https://review.openstack.org/117659 | 16:05 |
| *** tomoe__ has quit IRC | 16:05 | |
| jeblair | clarkb, fungi: that one succeeded | 16:05 |
| john-davidge | anteaya: thanks | 16:06 |
| *** pcrews has joined #openstack-infra | 16:06 | |
| jeblair | clarkb, fungi: apparently devstack doesn't (always?) bail on pip install failures | 16:06 |
| fungi | jeblair: the first cluster of failures i analyzed on saturday affected multiple downloads in several jobs all in one neutron network in a span of ~2 minutes | 16:06 |
| jeblair | fungi: ah, so you think they are topologically and temporally clustered | 16:06 |
| anteaya | john-davidge: thank you! | 16:06 |
| *** e0ne has quit IRC | 16:06 | |
| fungi | jeblair: yeah, i'm suspecting we may find similar patterns repeated | 16:07 |
| *** Guest15849 has joined #openstack-infra | 16:07 | |
| *** ChuckC_ has joined #openstack-infra | 16:07 | |
| *** chuckC has quit IRC | 16:08 | |
| openstackgerrit | Spencer Krum proposed a change to openstack-infra/config: Enable puppet3 master bootstrap https://review.openstack.org/117604 | 16:08 |
| clarkb | also b1,3,5 seemed worst affected | 16:08 |
| anteaya | fungi: when might you have a moment to disable 10385 citrix_xenserver_ci Citrix XenServer CI openstack@citrix.com | 16:09 |
| openstackgerrit | Spencer Krum proposed a change to openstack-infra/config: Formatting updates in hiera.yaml https://review.openstack.org/117664 | 16:09 |
| *** andreaf is now known as andreaf_ | 16:09 | |
| fungi | jeblair: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2014-09-06.log around 21:46 | 16:09 |
| *** mikedillion has joined #openstack-infra | 16:09 | |
| *** MaxV has quit IRC | 16:09 | |
| fungi | anteaya: done | 16:09 |
| *** MaxV has joined #openstack-infra | 16:10 | |
| anteaya | thanks | 16:10 |
| * anteaya sends email | 16:10 | |
| jeblair | fungi: oh, are they all in b3? | 16:11 |
| *** bdpayne has quit IRC | 16:11 | |
| fungi | jeblair: in that particular incident they were, yes | 16:11 |
| jeblair | fungi: skimming logstash now, i see only b1 and b3 | 16:11 |
| fungi | jeblair: at the time those were the only hits since we had completed the cutover | 16:11 |
| *** bdpayne has joined #openstack-infra | 16:11 | |
| jeblair | incidentally, b3 took the longest to rebuild images | 16:11 |
| fungi | that seems potentially related | 16:12 |
| *** vponomaryov has left #openstack-infra | 16:13 | |
| *** isviridov is now known as isviridov_away | 16:13 | |
| *** _buzz has joined #openstack-infra | 16:13 | |
| *** rushiagr is now known as rushiagr_away | 16:14 | |
| *** MaxV has quit IRC | 16:14 | |
| *** vponomaryov has joined #openstack-infra | 16:16 | |
| dhellmann | mordred: what's the story with sqlalchemy-migrate these days? we need https://review.openstack.org/#/c/110611/ for http://blueprints.launchpad.net/oslo.db/+spec/enable-mysql-connector if that's possible | 16:16 |
| dhellmann | maybe someone else knows ^^? I haven't been involved in managing that project at all, but now it's apparently a blocker for an oslo blueprint | 16:16 |
| *** bdpayne has quit IRC | 16:16 | |
| *** pballand has quit IRC | 16:17 | |
| *** [HeOS] has quit IRC | 16:19 | |
| *** ociuhandu has joined #openstack-infra | 16:20 | |
| *** johnthetubaguy is now known as zz_johnthetubagu | 16:22 | |
| *** jistr has quit IRC | 16:22 | |
| *** pballand has joined #openstack-infra | 16:23 | |
| clarkb | https://review.openstack.org/#/admin/groups/186,members it has an independent core team | 16:23 |
| *** hdd has joined #openstack-infra | 16:24 | |
| *** daya_k has joined #openstack-infra | 16:24 | |
| *** hdd has quit IRC | 16:27 | |
| *** gokrokve has joined #openstack-infra | 16:28 | |
| *** mikedillion has quit IRC | 16:28 | |
| *** yamamoto has joined #openstack-infra | 16:30 | |
| *** mikedillion has joined #openstack-infra | 16:30 | |
| *** gokrokve_ has quit IRC | 16:31 | |
| openstackgerrit | A change was merged to openstack/requirements: Bump glanceclient version to 0.14.0 https://review.openstack.org/119556 | 16:32 |
| *** gokrokve has quit IRC | 16:32 | |
| *** _nadya_ has joined #openstack-infra | 16:33 | |
| *** bhuvan has quit IRC | 16:33 | |
| *** changbl has quit IRC | 16:34 | |
| *** yamamoto has quit IRC | 16:35 | |
| fungi | jd__: see my comment on 110256... it's unclear to me why you're adding the python3-jobs template to stackforge/octavia | 16:35 |
| jd__ | fungi: probably a rebase error | 16:35 |
| jd__ | I've done so many of those | 16:35 |
| jd__ | fungi: updated :) | 16:36 |
| openstackgerrit | Julien Danjou proposed a change to openstack-infra/config: Use python3-jobs template where possible https://review.openstack.org/110256 | 16:36 |
| jeblair | fungi: !!!!! gnus honored the ansi color escape sequences in your email! | 16:36 |
| fungi | jeblair: now i know how to annoy the crap out of you in e-mail ;) | 16:36 |
| jeblair | fungi: send html? ;) | 16:37 |
| fungi | jeblair: hah | 16:37 |
| *** yfried has quit IRC | 16:37 | |
| fungi | jeblair: i was disappointed, and then immediately relieved that mutt did not interpret the ansi escapes in my message | 16:37 |
| jeblair | hehe | 16:38 |
| fungi | jd__: approved since it already had prior +2 votes | 16:39 |
| fungi | jd__: thanks again! this will be a huge help | 16:39 |
| jd__ | fungi: while you're there, I'd need to push an old git tag to pylockfile without triggering any job release, could you do that? | 16:40 |
| jeblair | fungi: i'm sure i can (setq "disable-ansi-escape-sequences" '(eval (equal (gnus-article-from "fungi")))) or something :) | 16:40 |
| jd__ | the git repo we migrated from github had no tag at all and I'd like to have this one to keep a track of what was the last release | 16:40 |
| *** reed has joined #openstack-infra | 16:41 | |
| openstackgerrit | Spencer Krum proposed a change to openstack-infra/config: Enable puppet3 master bootstrap https://review.openstack.org/117604 | 16:41 |
| fungi | jd__: release jobs won't work for it yet anyway since its tox.ini isn't suitable to run them (there's no [testenv:venv] section in it) | 16:42 |
| openstackgerrit | A change was merged to openstack-infra/config: Create Group Based Policy Stackforge project https://review.openstack.org/119604 | 16:42 |
| jd__ | hum so I could push the tag if I had the right permission | 16:42 |
| fungi | jd__: yeah, the tarball/wheel and pypi upload jobs will try and then break horribly, so should be fine to tag | 16:43 |
| jd__ | fungi: I think i'm not in the release group for pylockfile on gerrit, can you add me? | 16:43 |
| jd__ | I mean the tag group | 16:43 |
| *** _nadya_ has quit IRC | 16:43 | |
| *** paulrad has joined #openstack-infra | 16:44 | |
| jd__ | I think it should be releated to oslo-core or something actually, not sure how it's done on other projects | 16:44 |
| openstackgerrit | Spencer Krum proposed a change to openstack-infra/config: Enable puppet3 master bootstrap https://review.openstack.org/117604 | 16:44 |
| *** Sincler has quit IRC | 16:45 | |
| jd__ | dhellmann: if you're interested ^ :) | 16:45 |
| fungi | jd__: i gather from https://review.openstack.org/117622 that it's targeting inclusion in oslo... as such i've added oslo-release to pylockfile-release and would prefer to let dhellmann add you if that's his preference | 16:46 |
| jd__ | thanks fungi! | 16:46 |
| *** maxbit has quit IRC | 16:48 | |
| *** pblaho has quit IRC | 16:48 | |
| *** paulrad has quit IRC | 16:48 | |
| *** Sincler has joined #openstack-infra | 16:50 | |
| clarkb | fungi maybe jeblairs irc client will do color too. clearly we need more color here (but we are +c) | 16:50 |
| *** bhuvan has joined #openstack-infra | 16:50 | |
| fungi | nah, he uses irssi which i seem to recall filtering embedded color by default back when i was running it. for that matter so did bitchx... the last client i remember using which allowed embedded color by default was ircii | 16:51 |
| fungi | that's been... a *very* long time | 16:52 |
| fungi | (i try not to think about how long, as it just makes me feel old) | 16:52 |
| clarkb | hrm irssi and weechat both did color for me until I fixed them | 16:53 |
| stevemar | infra folks, i'm seeing a change get consistently -1'ed because it's failing py27 job - always with the same error message: sudo: unable to resolve host bare-trusty-<some_id> does this seem familiar at all? | 16:53 |
| openstackgerrit | Mehdi Abaakouk proposed a change to stackforge/dox: Checks that docker is installed https://review.openstack.org/119814 | 16:53 |
| fungi | stevemar: that message is benign (you will see it on successful jobs too) | 16:53 |
| *** gokrokve has joined #openstack-infra | 16:53 | |
| *** e0ne has joined #openstack-infra | 16:54 | |
| stevemar | fungi, good to know | 16:54 |
| fungi | stevemar: sudo simply likes to complain when it can't resolve the system's hostname to an ip address (usually because it's missing an appropriate mapping in /etc/hosts) | 16:54 |
| fungi | stevemar: it still continues to work fine, you just can't use hostname-based rules in your sudoers files | 16:54 |
| stevemar | fungi, OK *that* makes sense, | 16:55 |
| stevemar | let me see if i can find another reason why the patch is failing | 16:55 |
| *** zns has quit IRC | 16:55 | |
| *** hdd has joined #openstack-infra | 16:56 | |
| fungi | clarkb: oh, indeed you are correct! i have colors_receive=off set explicitly in my ~/.weechat/irc.conf | 16:57 |
| fungi | maybe i used to do that in irssi as well | 16:57 |
| *** zns has joined #openstack-infra | 16:58 | |
| *** loki184 has joined #openstack-infra | 16:58 | |
| *** _nadya_ has joined #openstack-infra | 16:58 | |
| *** _nadya_ has quit IRC | 16:59 | |
| openstackgerrit | Chmouel Boudjnah proposed a change to stackforge/dox: Checks that docker is installed https://review.openstack.org/119814 | 16:59 |
| *** otherwiseguy has joined #openstack-infra | 16:59 | |
| *** atiwari has quit IRC | 17:00 | |
| *** marcoemorais has joined #openstack-infra | 17:00 | |
| *** derekh has quit IRC | 17:00 | |
| *** daya_k has quit IRC | 17:01 | |
| *** amuller has quit IRC | 17:01 | |
| JayF | Is it possible to /commit/ something back to the repo in a post job? | 17:01 |
| *** sarob has joined #openstack-infra | 17:02 | |
| JayF | i.e. if Ironic wanted to do what Nova is doing (get rid of sample config, make it something generated)... could we add a post job that would commit back the updated ironic.conf.sample? | 17:02 |
| clarkb | JayF "yes" but we do it by proposing new changes/patchsets | 17:02 |
| mordred | dhellmann: have we not managed to move more things to alembic? | 17:03 |
| *** _buzz has quit IRC | 17:03 | |
| mordred | dhellmann: I thought us taking over sqlalchemy-migrate was intented to be a short term bridge to us finalizing the transition to alembic? | 17:03 |
| JayF | clarkb: so in this case, we'd likely just end up with a bonus patch that has to be merged with almost every other patch :( got it | 17:03 |
| fungi | JayF: basically a post job could regenerate the config, check to see if it differs from what's in the branch already, and then propose a patch if it differs | 17:03 |
| *** loki184 has quit IRC | 17:03 | |
| *** annegent_ has joined #openstack-infra | 17:04 | |
| JayF | So the solution is somewhere in the middle then? Maybe a non-voting job to check if config matches, then something in post that would propose back anything to make the config consistent | 17:04 |
| JayF | so you'd lose the times you have to rebase just to fix the sample config, but in most cases the conf file would be updated in the normal patch | 17:04 |
| *** maxbit has joined #openstack-infra | 17:04 | |
| clarkb | so that is spscifically why nova works the way it does | 17:05 |
| clarkb | that is tge way it was done | 17:05 |
| clarkb | it broke everything | 17:05 |
| fungi | JayF: probably just drop the check job about the config changing | 17:05 |
| clarkb | fungi no :) we did that in the past and it is terrible | 17:05 |
| fungi | JayF: since it will generally report failure until someone gets around to merging the update | 17:05 |
| clarkb | so rather that commit it at all it is just generated | 17:06 |
| fungi | clarkb: my preferred solution is that it's generated as part of the documentation instead, but lots of people seemed to be opposed to that suggestion | 17:06 |
| *** rushiagr_away is now known as rushiagr | 17:06 | |
| jeblair | tagged gertty 1.0.1 | 17:06 |
| JayF | We just have a lot of folks in Ironic (myself included) who appreciate being able to see the conf sample file via a web browser (aka git) as well as seeing the config file diffs as valuable | 17:07 |
| clarkb | JayF thats fine but there will be tons of broken | 17:07 |
| JayF | Yeah, there's tons of broken the way it is now too :) | 17:07 |
| fungi | jeblair: awesome! upgrading | 17:07 |
| clarkb | and most have decided that correct config at any point in time is better than broken | 17:07 |
| JayF | Yeah, there's tons of broken the way it is now too :) ... for instance: https://review.openstack.org/119816 | 17:07 |
| jeblair | https://pypi.python.org/pypi/gertty/1.0.1 | 17:08 |
| JayF | (patch for Ironic to fix pep8 jobs... just a commit of the conf file) | 17:08 |
| mordred | jeblair, clarkb, fungi: you know - the region-b mirror is in a different tenant than the nodepool nodes, so I think that means that the network traffic is going to go through those virtual routers just like traffic to anything on the internet | 17:09 |
| *** sarob has quit IRC | 17:09 | |
| *** yamamoto has joined #openstack-infra | 17:09 | |
| clarkb | mordred probably | 17:09 |
| fungi | mordred: right, i expected so | 17:09 |
| mordred | perhaps it really wants to be a node in the nodepool tenant and we want to have nodepool nodes talk to it over the 10. address to avoid virtual routers? | 17:09 |
| clarkb | JayF right stop testing that is the answer | 17:09 |
| *** sarob has joined #openstack-infra | 17:10 | |
| clarkb | JayF the underlying issue is that arbitrary deps can change your config | 17:10 |
| jeblair | mordred: the intent was to avoid internet breakage, not so much hpcloud breakage | 17:10 |
| clarkb | if we fix that these problems mostly go away | 17:10 |
| mordred | right. but if the breakage wasnt' actually the internet and it was the outbound traffic through the virtual routers that provide that for us | 17:10 |
| jeblair | mordred: traffic crossing a router is not something that one generally expects to be unreliable | 17:10 |
| *** _nadya_ has joined #openstack-infra | 17:10 | |
| jeblair | mordred: yeah, then i think we've identified a problem that we can help hpcloud fix | 17:11 |
| jeblair | mordred: but i don't actually think it's appropriate to design around that | 17:11 |
| jeblair | mordred: that's basically completely giving up on a working network at all | 17:11 |
| fungi | mordred: i would consider that a trouble ticket worth opening with hpcloud... they can't say "oh, well we have no control over packet loss once it leaves our systems" | 17:11 |
| mordred | jeblair: why not? we design around deficiencies in clouds all the time | 17:11 |
| jeblair | mordred: this is not a deficiency in a piece of software, this is a _very_ broken network. | 17:12 |
| *** gyee has quit IRC | 17:12 | |
| mordred | I think we spend a lot of effort working under the assumption that clouds do not work, and we mitigate appropriately once we've learned what reality is like | 17:12 |
| fungi | mordred: until now, we've been unable to say for sure it was a network problem within a specific provider, because we were seeing it with connections crossing the greater internet | 17:12 |
| mordred | jeblair: sure. but DNS also doesn't work so we started running our own | 17:12 |
| openstackgerrit | p-draigbrady proposed a change to stackforge/gertty: Add help text for HTTP user/pass https://review.openstack.org/119828 | 17:12 |
| jeblair | mordred: i don't think we should have to do that either. | 17:12 |
| mordred | jeblair: I agree - but we do | 17:12 |
| fungi | now we have something we can take back to hpcloud and say "this is broken" | 17:12 |
| jeblair | mordred: however, hpcloud refused to fix that problem | 17:12 |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack/requirements: Update oslo.utils to our juno rc1 version https://review.openstack.org/119829 | 17:13 |
| mordred | they may or may not fix this problem - but I am writing an email to the network guy and including you on it | 17:13 |
| openstackgerrit | p-draigbrady proposed a change to stackforge/gertty: Add help text for HTTP user/pass https://review.openstack.org/119828 | 17:13 |
| mordred | as for me though, I'm going to assume that it's not going to get fixed at the cloud level, because my experience so far has taught me that it won't be | 17:14 |
| mordred | email sent | 17:14 |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack/requirements: Update oslo.utils to latest version https://review.openstack.org/119829 | 17:14 |
| *** harlowja_away is now known as harlowja | 17:14 | |
| clarkb | a big difference here is without layer 3 networking how do we expect anything to work? | 17:14 |
| jeblair | clarkb: exactly | 17:14 |
| clarkb | this is fundamental and must be fixed | 17:14 |
| *** yamamoto has quit IRC | 17:14 | |
| mordred | we don't expect anything to work | 17:15 |
| clarkb | otherwise you are useless | 17:15 |
| mordred | we go out of our way to never talk to the internet during tests | 17:15 |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack/requirements: Update oslo.serialization to latest version https://review.openstack.org/119830 | 17:15 |
| mordred | we've already assumed that nothing is ever going to work | 17:15 |
| clarkb | this isnt the internet | 17:15 |
| clarkb | it is layer 3 routing within hpcloud | 17:15 |
| mordred | I believe that between tenants might need to be considered to be "the internet" | 17:16 |
| clarkb | if we want nodes to be able to talk to each other within a tenant across networks this must work | 17:16 |
| *** Morgan_ has joined #openstack-infra | 17:16 | |
| *** tsg has quit IRC | 17:16 | |
| *** baoli has quit IRC | 17:17 | |
| *** _nadya_ has quit IRC | 17:17 | |
| *** atiwari has joined #openstack-infra | 17:19 | |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack/requirements: Update oslo.messaging to latest version https://review.openstack.org/119831 | 17:19 |
| *** praneshp has joined #openstack-infra | 17:19 | |
| fungi | and if it's a neutron reliability problem, getting fixes upstreamed so that we, say, don't run into them later when we start using neutron network in rackspace or other providers, would be wonderful | 17:19 |
| Morgan_ | clarkb: have a question for you, if we (keystone) want to run tests against a live ldap, does it make sense to have a test just for keystone that does functional testing in a devstack? Or another full devstack-gate? Or something else? (Cc sdague ) | 17:19 |
| clarkb | functional is probably a good place to start | 17:20 |
| fungi | Morgan_: is keystone's behavior expected to change outwardly (from the perspective of other services) when using ldap? fi not, then functional testing would be the way to go | 17:20 |
| clarkb | tempest shouldnt care what the backend is. | 17:20 |
| *** MaxV has joined #openstack-infra | 17:20 | |
| clarkb | fungi if it is that is hopefully a bug :) | 17:20 |
| fungi | clarkb: my thought as well | 17:20 |
| Morgan_ | fungi: it shouldn't change much (a little but it's all deployer choices). Read only ldap vs read/write | 17:21 |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack/requirements: Update oslo.i18n to latest version https://review.openstack.org/119832 | 17:21 |
| Morgan_ | It really is an outlier in that regard. Eg not directly managing users vs directly managing users. | 17:21 |
| fungi | on the other hand, if keystone and some other openstack component were designed to share an ldap database and coordinate things between one another within it, then that would be fodder for integration tests | 17:21 |
| Morgan_ | Right don't think that is / will be the case for the foreseeable future | 17:22 |
| *** maxbit has quit IRC | 17:22 | |
| *** changbl has joined #openstack-infra | 17:22 | |
| *** SumitNaiksatam has quit IRC | 17:22 | |
| fungi | or if keystone is intended to behave differently from the perspective of other services when used with an ldap backend | 17:22 |
| fungi | but yes this sounds like functional testing is what you want | 17:22 |
| Morgan_ | Ok I'll look at setting up a functional gate job and get an install with ldap under experimental until we stabilize it. | 17:23 |
| Morgan_ | Thnx. | 17:23 |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack/requirements: Update oslo.config to latest rc1 version https://review.openstack.org/119833 | 17:23 |
| *** bdpayne has joined #openstack-infra | 17:23 | |
| *** MarkAtwood has joined #openstack-infra | 17:24 | |
| Morgan_ | It's been on my "we really need this" list for a while | 17:24 |
| *** markmcclain has quit IRC | 17:24 | |
| *** MaxV has quit IRC | 17:25 | |
| Morgan_ | Oh. I looked into pbr building tr sample config. Pbr can't hook into some setup commands well. It would be easier to make setup.py do sample config generation directly unless we really don't want that kind of logic in setup.py | 17:26 |
| openstackgerrit | A change was merged to openstack-infra/config: Use python3-jobs template where possible https://review.openstack.org/110256 | 17:26 |
| openstackgerrit | K Jonathan Harker proposed a change to openstack-infra/config: Clean up bashate failures https://review.openstack.org/118944 | 17:26 |
| Morgan_ | Setup does weird things like instatiate new commands and run them outside of where pbr wraps them. I'd like to make sample config on-demand but it is a bit of a headache. | 17:27 |
| *** zns has quit IRC | 17:28 | |
| jesusaurus | nibalizer: have you done any work around splitting out an initial module yet? | 17:28 |
| *** gyee has joined #openstack-infra | 17:29 | |
| *** Guest15849 has quit IRC | 17:29 | |
| *** baoli has joined #openstack-infra | 17:30 | |
| *** changbl has quit IRC | 17:32 | |
| *** yfried has joined #openstack-infra | 17:32 | |
| *** annegent_ has quit IRC | 17:34 | |
| *** IAX has quit IRC | 17:34 | |
| *** IAX7 has quit IRC | 17:34 | |
| *** markmcclain has joined #openstack-infra | 17:35 | |
| *** mwagner_lap has joined #openstack-infra | 17:36 | |
| *** aysyd has quit IRC | 17:36 | |
| *** SumitNaiksatam has joined #openstack-infra | 17:38 | |
| *** aysyd has joined #openstack-infra | 17:39 | |
| *** esker has joined #openstack-infra | 17:39 | |
| *** skelpter1 has joined #openstack-infra | 17:40 | |
| *** ildikov has joined #openstack-infra | 17:41 | |
| *** paulrad has joined #openstack-infra | 17:43 | |
| mordred | Morgan_: we REALLY don't want logic in setup.py | 17:44 |
| morganfainberg | mordred, figured. | 17:44 |
| clarkb | jesusaurus: we split out storyboard, but that one was a bit different | 17:44 |
| *** emagana has joined #openstack-infra | 17:45 | |
| morganfainberg | mordred, unfortunately setuptools is uuuuuugly :( i'll see if i can figure out how to hook things into the dynamic commands but... it was not looking promising | 17:45 |
| *** Ryan_Lane has joined #openstack-infra | 17:45 | |
| *** [HeOS] has joined #openstack-infra | 17:45 | |
| clarkb | morganfainberg: mordred: pbr does it with the test command, though I suppose that is already a thing in setuptools? | 17:45 |
| *** gyee has quit IRC | 17:46 | |
| * mordred on the phone, let me read the scrollback in a sec | 17:46 | |
| *** IAX has joined #openstack-infra | 17:47 | |
| morganfainberg | clarkb, the issue is in cases like develop, etc it creates the command 'build_py' or similar on the fly, and you can't do hooks around those. also it doesn't let you hook into develop, etc. and for the most part we need the package installed to create the sample config. we could probably do something totally different though to get sample configs built. | 17:47 |
| *** paulrad has quit IRC | 17:47 | |
| dhellmann | mordred: no, not yet. I'm hoping with oslo.db in a good state next cycle we'll be able to do that, but that's going to be another cross-project discussion | 17:48 |
| *** alexpilotti has joined #openstack-infra | 17:48 | |
| *** maxbit has joined #openstack-infra | 17:49 | |
| *** annegent_ has joined #openstack-infra | 17:50 | |
| openstackgerrit | Oscar Romero (homeless) proposed a change to openstack-infra/jeepyb: Adding 'allow-https' parameter to projects config https://review.openstack.org/117636 | 17:50 |
| *** bdpayne has quit IRC | 17:50 | |
| openstackgerrit | Oscar Romero (homeless) proposed a change to openstack-infra/jeepyb: Adding 'allow-https' parameter to projects config https://review.openstack.org/117636 | 17:51 |
| krtaylor | anteaya, you are chair for today's meeting right? | 17:51 |
| anteaya | I am | 17:51 |
| *** bdpayne has joined #openstack-infra | 17:51 | |
| krtaylor | anteaya, thanks, just checking :) | 17:51 |
| krtaylor | anteaya, I can take next week if you want, you have run a few in arow now | 17:51 |
| anteaya | okay thanks | 17:52 |
| anteaya | it is yours | 17:52 |
| krtaylor | we should get to every other week or something | 17:52 |
| anteaya | let's do clumps | 17:52 |
| anteaya | or whenever you want to take one | 17:52 |
| krtaylor | anteaya, sure, that works too | 17:52 |
| anteaya | thanks | 17:52 |
| krtaylor | I'll run a few starting next week | 17:52 |
| anteaya | I'm more of a clumps kind of person | 17:52 |
| anteaya | thanks | 17:52 |
| *** mpaolino has quit IRC | 17:53 | |
| *** _buzz has joined #openstack-infra | 17:54 | |
| *** cdent_ has joined #openstack-infra | 17:54 | |
| dhellmann | hmm, does search not work in our wiki? | 17:54 |
| anteaya | it doesn't work well | 17:54 |
| dhellmann | "An error has occurred while searching: We could not complete your search due to a temporary problem. Please try again later" | 17:54 |
| *** zns has joined #openstack-infra | 17:54 | |
| anteaya | I do site:wiki.openstack.org terms in duckduckgo myself | 17:55 |
| anteaya | ah | 17:55 |
| anteaya | haven't seen that before | 17:55 |
| dhellmann | not a high priority, I'll open a bug | 17:55 |
| clarkb | hrm ryan did do updates semi recently. I wonder if we need to udpate the es version | 17:55 |
| adam_g | clarkb, if you get a min i topic'ed the stuff we need to get the grenade sideways stuff rolling https://review.openstack.org/#/q/topic:ironic_infra,n,z | 17:55 |
| anteaya | I wonder if that might be an artifact of a change Ryan_Lane made a week ago or so | 17:55 |
| clarkb | anteaya: ya I am guessing we need to update elasticsearch | 17:55 |
| anteaya | dhellmann: might if I ask what you were searching for? | 17:55 |
| anteaya | clarkb: ah | 17:56 |
| dhellmann | anteaya: I tried "sqlalchemy", "sqlalchemy-migrate", and then "oslo" | 17:56 |
| *** cdent has quit IRC | 17:56 | |
| *** cdent_ is now known as cdent | 17:56 | |
| anteaya | error on all three searches? | 17:56 |
| Ryan_Lane | oh, crap | 17:56 |
| Ryan_Lane | sorry | 17:56 |
| Ryan_Lane | I think it's necessary to run some maintenance scripts | 17:56 |
| Ryan_Lane | since I upgraded the version of the search extension | 17:57 |
| anteaya | hey Ryan_Lane | 17:57 |
| anteaya | ah | 17:57 |
| Ryan_Lane | I always forget about that | 17:57 |
| anteaya | that would do it | 17:57 |
| Ryan_Lane | we should document the upgrade steps in the docs | 17:57 |
| anteaya | isn't it nice Doug helped us to find that | 17:57 |
| anteaya | :D | 17:57 |
| dhellmann | Ryan_Lane: https://bugs.launchpad.net/openstack-ci/+bug/1366915 | 17:57 |
| Ryan_Lane | heh | 17:57 |
| uvirtbot | Launchpad bug 1366915 in openstack-ci "wiki search returning error message" [Undecided,New] | 17:57 |
| nibalizer | jesusaurus: https://review.openstack.org/#/c/119543/ | 17:57 |
| Ryan_Lane | I can fix this when I get home, but I can also probably find docs right now for you | 17:57 |
| openstackgerrit | Jeremy Stanley proposed a change to stackforge/gertty: Display version in help dialog title https://review.openstack.org/119846 | 17:57 |
| *** koolhead17 has quit IRC | 17:57 | |
| anteaya | Ryan_Lane: thanks | 17:58 |
| Ryan_Lane | https://git.wikimedia.org/blob/mediawiki%2Fextensions%2FCirrusSearch.git/HEAD/README#L121 | 17:59 |
| anteaya | thanks | 17:59 |
| Ryan_Lane | you run that from <current-slot>/extensions/CirrusSearch | 17:59 |
| *** _nadya_ has joined #openstack-infra | 18:00 | |
| fungi | Ryan_Lane: anteaya: dhellmann: i can take care of it now | 18:00 |
| *** mrmartin has joined #openstack-infra | 18:00 | |
| Ryan_Lane | let me know if you run into issues | 18:00 |
| fungi | Ryan_Lane: which of those three options do you believe we need after your most recent update? | 18:01 |
| mordred | morganfainberg: ok. I'm back ... you want to run tests with a config is the thing you're trying to solve? | 18:01 |
| *** john-davidge has quit IRC | 18:01 | |
| *** _buzz_ has joined #openstack-infra | 18:01 | |
| *** _buzz has quit IRC | 18:02 | |
| clarkb | adam_g: https://review.openstack.org/#/c/112134/6 I don't understand what that has to do with cinder | 18:02 |
| Ryan_Lane | fungi: I'd guess 2 | 18:02 |
| morganfainberg | mordred, well what i was trying to solve was removing the sample.config from the tree but guarantee it was generated on setup, so setup develop would have the keystone config in tree, same for when someone does sdist or bdist, the sample config would be there for them to grab if they wanted (packaging). This solves the 'sample config is out of date' issue. | 18:03 |
| fungi | Ryan_Lane: okay, thanks... giving that a shot now | 18:03 |
| clarkb | adam_g: it doesn't touch the sideways job at all | 18:03 |
| *** dane_leblanc has joined #openstack-infra | 18:03 | |
| Ryan_Lane | cool | 18:03 |
| morganfainberg | mordred, it's a very very minor low prio thing, but we handle sample configs differently in many projects and it would be nice to have them back to consistent without needing to gate on them being up-to-date. | 18:04 |
| adam_g | clarkb, the current check-tempest-dsvm-ironic can't run without cinder (or at least, it blew up when it was disabled last time) | 18:04 |
| clarkb | adam_g: right but that change doesn't do anything with cinder? | 18:04 |
| adam_g | clarkb, the future ironic tempest job, and the grenade job, will need cinder disabled. | 18:04 |
| adam_g | clarkb, we cant do that till https://review.openstack.org/#/c/112134/6 | 18:04 |
| fungi | Ryan_Lane: is it safe to run those as root, or is there a specific user i need to run them as? | 18:05 |
| adam_g | clarkb, which will allow https://review.openstack.org/115803 | 18:05 |
| morganfainberg | mordred, my thought was "hey pbr might do this for us with some stuff in setup.cfg" - but setuptools is a bit wonky. | 18:05 |
| mordred | morganfainberg: ok. so yeah, that sounds like a thing like how we generate AUTHORS and ChangeLog | 18:05 |
| Ryan_Lane | www-data should be safe | 18:05 |
| Ryan_Lane | I think it's fine to run as root, though | 18:05 |
| clarkb | adam_g: and that is because we need to trim out the virtual jobs? | 18:05 |
| mordred | morganfainberg: it's actually not terrible to implement if you know what it is that you want do make | 18:05 |
| openstackgerrit | Joshua Harlow proposed a change to openstack-infra/config: Allow usage of customized venvs for docs building https://review.openstack.org/119851 | 18:05 |
| *** ociuhandu_ has joined #openstack-infra | 18:06 | |
| *** sarob has quit IRC | 18:06 | |
| morganfainberg | mordred, except authors doesn't require the code to be in the active python sys.path. | 18:06 |
| *** ociuhandu_ has left #openstack-infra | 18:06 | |
| *** ericpeterson has joined #openstack-infra | 18:06 | |
| morganfainberg | mordred, the entry points actually need to be fully realized in the venv/system to make it work (depending on project). it might not be worth the headache. | 18:06 |
| mordred | morganfainberg: http://git.openstack.org/cgit/openstack-dev/pbr/tree/pbr/packaging.py#n624 | 18:07 |
| mordred | morganfainberg: hrm. | 18:07 |
| adam_g | clarkb, sort of. we're just replacing the check-tempest-dsvm-ironic with the virtual job and renaming. that will still use the TEMPEST_REGEX to avoid the cinder tests while its still enabled in features.yaml | 18:07 |
| mordred | morganfainberg: so, how important is the setup.py develop usecase? | 18:07 |
| mordred | morganfainberg: if it does it for sdist - is that good enough? | 18:07 |
| adam_g | clarkb, let me jot down the order of operations in a pad somewhere. | 18:07 |
| morganfainberg | mordred, we use it in devstack. do we care if we have a sample config in devstack? | 18:08 |
| *** TravT has joined #openstack-infra | 18:08 | |
| mordred | morganfainberg: ah - gotcha | 18:08 |
| mordred | morganfainberg: so, we'd need to install keystone first, so that the entry points would be available for us to know what it is that we want to install | 18:08 |
| clarkb | adam_g: I am just trying to figure out if this is a hard requirement and it doesn't sound like it | 18:08 |
| morganfainberg | mordred, yeah i think i'll just table this till later on, we've survived until now, we can revisit in K | 18:09 |
| mordred | morganfainberg: let me noodle on it in my head | 18:09 |
| ericpeterson | question on jjb, around the scm setup of remotes.... following http://ci.openstack.org/jenkins-job-builder/scm.html When I add more remotes, how do I give the remotes a name??? | 18:09 |
| *** yamamoto has joined #openstack-infra | 18:09 | |
| morganfainberg | mordred, sounds good. no real rush. was just a "hey maybe we can fix this nicely" thought | 18:09 |
| jogo | anteaya: ahh thanks, I can make lastcomment take a list of names so you can check to see if a whole bunch of systems are running quickly | 18:09 |
| morganfainberg | and on the topic of "make things better for deployers/packagers/end users" :) | 18:10 |
| mordred | morganfainberg: yah. seems like the type of thing pbr would want to be able to know how to do | 18:10 |
| fungi | Ryan_Lane: thanks... so when i do 'sudo -u www-data php updateSearchIndexConfig.php --reindexAndRemoveOk --indexIdentifier now' it throws warnings and bails like http://paste.openstack.org/show/108410 | 18:10 |
| anteaya | jogo: that would be awesome | 18:10 |
| *** bdpayne has quit IRC | 18:10 | |
| anteaya | jogo: can you tie it into radar or help me to? | 18:10 |
| jogo | anteaya: where is radar run currently? | 18:10 |
| openstackgerrit | Jay Faulkner proposed a change to openstack-infra/config: Fix typo causing failure in IPA post job https://review.openstack.org/119853 | 18:11 |
| anteaya | jogo: stackforge | 18:11 |
| *** bdpayne has joined #openstack-infra | 18:11 | |
| JayF | I'm sorry but I had a typo caused breakage in the IPA post job -- fix is here https://review.openstack.org/119853 -- should be a quick review as I'm just correcting the filename. Apologies again for the first patch being wrong... | 18:11 |
| jogo | anteaya: as in is radar being run activly somewhere? not where is the source hosted | 18:11 |
| Ryan_Lane | fungi: I'd try to go with option 1, then | 18:12 |
| anteaya | jogo: mikal is running it | 18:12 |
| Ryan_Lane | I also wonder what version of ES is currently required.... | 18:12 |
| anteaya | jogo: that is the only instance I know of | 18:12 |
| Ryan_Lane | "1.3.2 and above are all fine." | 18:12 |
| openstackgerrit | Mehdi Abaakouk proposed a change to stackforge/dox: Checks that docker is installed https://review.openstack.org/119814 | 18:13 |
| *** MarkAtwood has quit IRC | 18:13 | |
| mordred | JayF: weird. you have a last name | 18:13 |
| fungi | Ryan_Lane: "Looks like the index has more than one identifier. You should delete all | 18:13 |
| fungi | but the one of them currently active. Here is the list: openstack_wiki_content_1410199733,openstack_wiki_content_1410199743,openstack_wiki_content_1410199557,openstack_wiki_content_first" | 18:13 |
| JayF | mordred: I guess I'm used to it by now, I've always has a last name. | 18:14 |
| *** yamamoto has quit IRC | 18:14 | |
| clarkb | ericpeterson: you may not be able to. do you need that name for something? | 18:14 |
| clarkb | ericpeterson: if you list them it should do that right thing iirc | 18:14 |
| JayF | ty mordred fungi | 18:14 |
| *** jcoufal has quit IRC | 18:14 | |
| Ryan_Lane | fungi: umm. I have no idea how to handle that | 18:15 |
| *** tonytan4ever has quit IRC | 18:15 | |
| mordred | dhellmann: ugh. ok | 18:15 |
| Ryan_Lane | one sec. I'll ask | 18:15 |
| dhellmann | mordred: we had some issues making both work together, so projects not already on alembic didn't want to adopt it. I think we have fixed that now, so next we have to convince everyone to actually make the switch. | 18:16 |
| mordred | dhellmann: the migration path involves having both work at the same time? that seems scary | 18:17 |
| ericpeterson | thanks clarkb | 18:17 |
| dhellmann | mordred: we run sqlalchemy-migrate, then alembic; then some day we delete all of the old sqlalchemy-migrate migrations and only need to run alembic | 18:17 |
| *** david-lyle has quit IRC | 18:17 | |
| *** lcheng__ has quit IRC | 18:18 | |
| *** ^d has joined #openstack-infra | 18:19 | |
| ^d | Ryan_Lane said somebody was looking for some help with Cirrus/Elastic for MW? | 18:19 |
| *** david-lyle has joined #openstack-infra | 18:20 | |
| fungi | ^d: yeah | 18:20 |
| fungi | ^d: i tried https://git.wikimedia.org/blob/mediawiki%2Fextensions%2FCirrusSearch.git/HEAD/README#L121 option 1A but am getting an error about having multiple index identifiers | 18:20 |
| JayF | fungi: mordred: So I'm just waiting for "Last reconfigured:" at the bottom of Zuul status to be AFTER that merge to test with a patch, correct? | 18:20 |
| fungi | ^d: http://paste.openstack.org/show/108426/ | 18:21 |
| ^d | Hmmm | 18:21 |
| harlowja | clarkb does https://review.openstack.org/#/c/119851/ seem reasonable to u? (allowing those who want to use there own docs venv the ability to) | 18:21 |
| fungi | ^d: just curious how to know for sure which one i want (the one with the latest epoch time) and how to remove the others | 18:22 |
| clarkb | harlowja: no, I think we update the standard. otherwise what is the standard for? | 18:22 |
| *** garyh has quit IRC | 18:22 | |
| clarkb | harlowja: then make everyone stick to it. that change only makes it more confusing | 18:22 |
| harlowja | clarkb fair enough :) | 18:22 |
| fungi | ^d: er, should have been a question... do i necessarily want to keep the one with the latest epoch time, or is there some other way of determining which one is supposed to be active? | 18:22 |
| ^d | The one with the latest epoch is definitely the one you're wanting. | 18:23 |
| fungi | okay, good | 18:23 |
| fungi | ^d: so then just curious how to delete the others | 18:23 |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/devstack-gate: Add tempest-lib to the projects list https://review.openstack.org/119862 | 18:23 |
| mordred | harlowja: I agree with clarkb - and I think we should change the standard, and I think that the standard should be a venv named docs | 18:23 |
| mordred | and we should add one everywhere | 18:23 |
| ^d | fungi: Could do it manually. Issue some curl -XDELETE's at the ES instance. | 18:23 |
| harlowja | mordred standard change it is then, wfm | 18:24 |
| mordred | maybe this is my way to get my super-ATC status | 18:24 |
| *** jp_at_hp has quit IRC | 18:25 | |
| JayF | super-ATC? | 18:25 |
| harlowja | mordred 50 + changes to all the projects are all yours ;) | 18:25 |
| fungi | JayF: contributor to projects in ~all programs | 18:25 |
| JayF | That sounds... horrifying | 18:25 |
| clarkb | adam_g: one small thing in https://review.openstack.org/#/c/112134/ | 18:26 |
| fungi | JayF: it's the freakish nightmare most of the horizontal effort contributors live with every day | 18:26 |
| clarkb | its like when you play don't starve and the shadows steal your fire | 18:26 |
| clarkb | you are good for a while but if you don't pick flowers bad things happen | 18:27 |
| JayF | There was a funny bit in ;login magazine recently with a good quote: | 18:27 |
| adam_g | clarkb, so there are two related threads of work. 1) migrate away from virtual ironic and TEMPEST_REGEX to a regular vanilla looking devstack job 2) sideways grenade, which requires a vanilla tempest run to pass. 2 depends on 1. 1 requires disabling cinder via features.yaml. doing so breaks ironics gate currently, 112134 is the migration to avoid that | 18:27 |
| JayF | "Systems programmers take care of the bear menace" | 18:27 |
| *** _buzz_ has quit IRC | 18:27 | |
| JayF | I think that applies to you guys | 18:27 |
| clarkb | adam_g: oh I didn't realize that dependency existed but I guess that makes sense since grenade doesn't let you turn all the knobs | 18:28 |
| *** robemcallister has joined #openstack-infra | 18:28 | |
| adam_g | clarkb, if we go with 112134, we are free to disable cinder since we'd be using the regex hack temporarily. ocne disabled, we can use the experimental job in 118700 to make sure the vanilla tempest stuff is reliable and stable, and then migrate off of the regex crap | 18:29 |
| *** lcheng_ has joined #openstack-infra | 18:29 | |
| clarkb | adam_g: will https://review.openstack.org/#/c/118700/3/modules/openstack_project/files/jenkins_job_builder/config/devstack-gate.yaml need to be rebased on 112134 to use the common builder? | 18:29 |
| adam_g | all the while grenade starts passing | 18:29 |
| *** vhoward has left #openstack-infra | 18:30 | |
| *** zns has quit IRC | 18:30 | |
| fungi | ^d: thanks. that's probably getting too deep into es management for my current level of familiarity | 18:30 |
| fungi | clarkb: can you translate? | 18:30 |
| adam_g | clarkb, that depends. jroll has a patch dependent on the common builder to also test IPA agent deployment, which i think is better than copy/pasting boiler plate, IMO | 18:30 |
| clarkb | fungi: its pretty simple. we have a cron to do it for logstash to delete old data. you can look at that cron. I will get al ink | 18:30 |
| ^d | fungi: `curl -XDELETE host:9200/index_name_you_want_to_drop` | 18:31 |
| ^d | Pretty straightforward. | 18:31 |
| fungi | clarkb: oh, no worries--i'll look in the crontab | 18:31 |
| ^d | :) | 18:31 |
| clarkb | fungi: but basically you tell es to delete things via curl. if you want to gui it you can hook up es head to the wiki cron | 18:31 |
| fungi | ^d: ahh, i'll give that a shot--thanks! | 18:31 |
| clarkb | fungi: note the crontab on es02 is what you want | 18:31 |
| clarkb | er hook up es head to the wiki es | 18:31 |
| *** ildikov_ has joined #openstack-infra | 18:31 | |
| JayF | ES Head plugin +++ | 18:31 |
| ^d | I tried Kopf recently. Like head only a little prettier. | 18:32 |
| fungi | clarkb: oh, neat. i didn't think about trying es head or bigdesk on the wiki server | 18:32 |
| clarkb | JayF: I actually don't run any of them as plugins because yay no auth. but its really easy to run locally and forward to server | 18:32 |
| *** rushiagr is now known as rushiagr_away | 18:32 | |
| clarkb | JayF: then you basically have ssh auth for control | 18:32 |
| clarkb | I am told auth is coming at some point in es | 18:32 |
| JayF | clarkb: I run them as plugins... but we don't open the port so you have to ssh tunnel it anyway. So pretty much same deal :) | 18:32 |
| clarkb | that will be a great day | 18:33 |
| ^d | There's an authz/authn plugin for ES. | 18:33 |
| ^d | I dunno anyone using it though. | 18:33 |
| fungi | ^d: thanks for the api delete calls... that seems to have gotten it back on track | 18:34 |
| ^d | you're welcome! | 18:34 |
| *** craigbr_ has quit IRC | 18:34 | |
| *** ildikov has quit IRC | 18:34 | |
| *** ericpeterson has left #openstack-infra | 18:34 | |
| openstackgerrit | Adam Gandelman proposed a change to openstack-infra/config: Consolidate and rename Ironic jobs https://review.openstack.org/112134 | 18:34 |
| fungi | Ryan_Lane: anteaya: dhellmann: reindexing seems to be underway now. i'll test it out when it finishes and give you a heads up if it appears to be working thereafter | 18:35 |
| ^d | JayF: The best plugin for ES is probably https://github.com/wikimedia/search-repository-swift, but I'm biased :) | 18:35 |
| openstackgerrit | Jamie Finnigan proposed a change to openstack-infra/config: Adding Bandit project to StackForge https://review.openstack.org/119865 | 18:35 |
| anteaya | fungi: thanks | 18:36 |
| clarkb | ^d: the README doesn't tell me what it does :) | 18:36 |
| clarkb | does it store the indexes in swift? | 18:36 |
| ^d | Snapshots in swift. | 18:36 |
| ^d | They already had a hdfs and gridfs plugin. | 18:36 |
| clarkb | hrm that may be a good alternative to deleting older indexes. however we already do all the terabytes | 18:37 |
| clarkb | might not be very fast | 18:37 |
| ^d | They're incremental. | 18:37 |
| ^d | So might not be too bad after initial dump. | 18:37 |
| clarkb | swift supports incremental operations? | 18:37 |
| *** tsg has joined #openstack-infra | 18:37 | |
| clarkb | oh the snapshots themselves are incremental | 18:37 |
| ^d | Yeah | 18:38 |
| *** annegent_ has quit IRC | 18:38 | |
| Ryan_Lane | oh, wow, that's pretty cool | 18:38 |
| ^d | I've run it on prod on testwiki and it works :) | 18:38 |
| dhellmann | fungi: thanks! | 18:39 |
| clarkb | I will definitely have to take a look at using it | 18:40 |
| fungi | Ryan_Lane: "Indexed a total of 4564 pages at 29/second" but i'm still getting "An error has occurred while searching: We could not complete your search due to a temporary problem." when i try to search for things | 18:40 |
| clarkb | as it may make our rolling off old indexes less painful | 18:40 |
| fungi | Ryan_Lane: is there anything else which needs doing/restarting? | 18:40 |
| Ryan_Lane | hm | 18:40 |
| *** daya_k has joined #openstack-infra | 18:40 | |
| Ryan_Lane | ^d: ^^ ? | 18:40 |
| Ryan_Lane | I wouldn't think so | 18:40 |
| fungi | apache? php-fpm? | 18:42 |
| *** MarkAtwood has joined #openstack-infra | 18:42 | |
| fungi | i'm trying things i don't think anyone has searched for recently, so hopefully isn't running into a cached negative response of some sort... | 18:42 |
| fungi | restarted both apache2 and php5-fpm just in case, but no change | 18:44 |
| fungi | elasticsearch too | 18:44 |
| clarkb | adam_g: ok I am +2 on the cinder change and the config change it depends on. did you decide if that other config change needs to be rebased on the first one? | 18:44 |
| *** esker has quit IRC | 18:45 | |
| ^d | Grrr, anything in apache error log? | 18:46 |
| ^d | That's a vague response and I hate it. | 18:46 |
| ^d | (our own fault) | 18:46 |
| jogo | so oomkiller is back | 18:46 |
| jogo | http://logs.openstack.org/12/115212/5/check/check-tempest-dsvm-full/11a1af6/logs/syslog.txt.gz#_Sep__8_12_10_46 | 18:46 |
| openstackgerrit | A change was merged to openstack-infra/config: Fix typo causing failure in IPA post job https://review.openstack.org/119853 | 18:46 |
| *** dangers_away is now known as dangers | 18:48 | |
| *** daya_k has quit IRC | 18:48 | |
| fungi | ^d: Search backend error during full_text search for 'jenkins' after 124. SearchPhaseExecutionException[Failed to execute phase [dfs], all shards failed] [Called from CirrusSearch\\ElasticsearchIntermediary::failure in /srv/mediawiki/slot0/extensions/CirrusSearch/includes/ElasticsearchIntermediary.php at line 97] in /srv/mediawiki/slot0/includes/debug/MWDebug.php on line 302 | 18:48 |
| fungi | ^d: i'm guessing elasticsearch is unhappy with me | 18:48 |
| ^d | Ewww. I think we need a Nik. | 18:48 |
| *** jerryz has joined #openstack-infra | 18:49 | |
| *** mikedillion has quit IRC | 18:49 | |
| clarkb | jogo: looks like nova agent invoked it and mysqld was sacrificed | 18:49 |
| jogo | clarkb: heh yeah nova-agent is rax evilness | 18:50 |
| *** manybubbles has joined #openstack-infra | 18:50 | |
| manybubbles | hi | 18:50 |
| jogo | this is the bug mtreinish found I think | 18:50 |
| adam_g | clarkb, it shouldn't. the second (118700) is required to set TEMPEST_CONCURRENCY, but adds that experimental job to prove the parallel tempest testing is stable before cutting over to it for the main jobs | 18:50 |
| fungi | manybubbles: it's a mediawiki party in here | 18:50 |
| clarkb | jogo: well yes, but at that point the next malloc would have caused it | 18:50 |
| manybubbles | its a mediawiki party everywhere ^d and I go | 18:50 |
| clarkb | jogo: so nova-agent is just noise really. | 18:50 |
| clarkb | adam_g: right but it doesn't use the standard builder | 18:50 |
| *** openstackgerrit has quit IRC | 18:51 | |
| mtreinish | clarkb, jogo: yeah mysqld always seems to be sacrificed | 18:51 |
| jogo | mtreinish: so we are running out of memory in the gate | 18:51 |
| jogo | clarkb: query: Cannot set up guest memory 'pc.ram': Cannot allocate memory | 18:51 |
| jogo | err | 18:51 |
| jogo | message:"oom-killer" | 18:51 |
| jogo | wrong bug | 18:51 |
| adam_g | clarkb, what is the standard builder? | 18:51 |
| mtreinish | jogo: I think it's because that run had the ceilo notification tests enabled | 18:51 |
| jogo | mtreinish: interesting | 18:52 |
| clarkb | adam_g: the one you add in your other change | 18:52 |
| jogo | mtreinish: so when 8GB of memory isn't enough | 18:52 |
| jogo | sigh | 18:52 |
| mtreinish | I do wish dstat showed the top memory consumers too | 18:52 |
| fungi | manybubbles: so... i'm getting errors in the apache log when i try to search, and they look like http://paste.openstack.org/show/108428/ | 18:52 |
| clarkb | mtreinish: oomkiller shows you | 18:52 |
| fungi | manybubbles: this is even after blowing away and regenerating the index from scratch | 18:53 |
| *** robemcallister has quit IRC | 18:53 | |
| clarkb | mtreinish: jogo: the rss column is the resident set size | 18:53 |
| clarkb | mtreinish: jogo: I think it is in kilobytes | 18:53 |
| adam_g | clarkb, no, it shouldn't be using that. | 18:53 |
| clarkb | adam_g: ok | 18:53 |
| manybubbles | fungi: k. to which version have you upgraded? | 18:54 |
| adam_g | clarkb, that will go away once we get rid of the regex crap, or will just be reconfigured to look more like the more standard parallel one being added in 118700 | 18:54 |
| manybubbles | and which version of elasticsearch are you using | 18:54 |
| fungi | manybubbles: to which version of mediawiki or which version of elasticsearch? | 18:54 |
| *** jeblair-shout has joined #openstack-infra | 18:54 | |
| fungi | ahh, both. checking | 18:54 |
| manybubbles | fungi: all the versions! | 18:54 |
| jogo | mtreinish: we can make it show that | 18:54 |
| adam_g | clarkb, sorry for the confusion | 18:54 |
| manybubbles | fungi: ok - pretty now | 18:55 |
| manybubbles | new | 18:55 |
| mtreinish | clarkb: It was more to show it over the whole run, not just when things blow up | 18:55 |
| mtreinish | but it is interesting to look at when things fall apart | 18:55 |
| mordred | clarkb, harlowja: https://review.openstack.org/119875 | 18:55 |
| manybubbles | fungi: did you branch this from one of the wmf branches? | 18:55 |
| fungi | manybubbles: 1.24wmf19 https://wiki.openstack.org/wiki/Special:Version | 18:55 |
| mordred | jeblair: ^^ you too | 18:55 |
| fungi | manybubbles: not sure... Ryan_Lane did the upgrade | 18:55 |
| fungi | manybubbles: but presumably | 18:56 |
| harlowja | mordred cool, i was just about to send a ML mail about that, just so people are aware | 18:56 |
| manybubbles | fungi: yeah - if its wmf19 then that is what is on wikipedia now | 18:56 |
| mordred | I have submitted 4 changes to governance, 2 to import the current project testing interface, one to update it to match reality, and one to add a docs env | 18:56 |
| fungi | manybubbles: looks like es 1.1.1 | 18:56 |
| manybubbles | fungi: yeah - you should upgrade to 1.3.2 | 18:56 |
| fungi | manybubbles: aha! okay, i'll dig into possibilities there | 18:56 |
| fungi | clarkb: sounds like maybe you were right ;) | 18:56 |
| clarkb | fungi: puppet can do it via a parameter | 18:56 |
| jeblair | jeblair-shout: hi | 18:56 |
| clarkb | fungi: if you want to make that change and have it do the upgrade for you | 18:56 |
| manybubbles | modern versions of cirrus use groovy instead of mvel and groovy is only available in 1.3.X | 18:56 |
| *** jeblair-shout has quit IRC | 18:57 | |
| mtreinish | jogo, clarkb: like java is the #2 ram consumer | 18:57 |
| clarkb | mtreinish: ya | 18:57 |
| manybubbles | fungi: you can see the query its making: https://wiki.openstack.org/w/index.php?search=test&fulltext=Search&cirrusDumpQuery=yes | 18:57 |
| clarkb | mtreinish: actually no, its apache | 18:57 |
| manybubbles | you could just copy that curl -XPOST that elasticsearch and mediawiki wouldn't be in the way at all | 18:57 |
| clarkb | mtreinish: then nova api | 18:58 |
| manybubbles | like, if you thought mediawiki was eating an error or something (because, you know, things happen) | 18:58 |
| jeblair | mordred: are you sure we want to support something other than simply build_sphinx? | 18:58 |
| clarkb | and the vms | 18:58 |
| *** wendar_ is now known as wendar | 18:58 | |
| fungi | manybubbles: that's an excellent troubleshooting tip. thanks | 18:58 |
| mtreinish | clarkb: oops, yeah looking at the wrong column | 18:58 |
| manybubbles | fungi: there are lots of nice debugging things in the version you have | 18:58 |
| clarkb | java is up there too though | 18:58 |
| jeblair | mordred: (is there a current need for something other than that? i thought most folks wanted a doc env just to make it easier, but didn't need to actually do any extra work) | 18:58 |
| mordred | jeblair: it seems folks may want to do proprocessing or the like | 18:59 |
| manybubbles | fungi: this dumps what Elasticsearch has in the index for a page: https://wiki.openstack.org/wiki/Heat?action=cirrusdump | 18:59 |
| clarkb | in particular harlowja wanted to generated cahngelog to be included in docs | 18:59 |
| mordred | jeblair: and it's been useful to have an interface entrypoint like that for unittests | 18:59 |
| jogo | what is hava? | 19:00 |
| harlowja | ya, same interface for all the things would be great | 19:00 |
| mordred | basically, "make sure there is a tox -edocs and that it results in html docs going into a dir called docs/build" | 19:00 |
| jogo | mtreinish: looks like the libvirt issue is related | 19:00 |
| manybubbles | fungi: it also proves you can connect to elasticsearch and there is stuff in it | 19:00 |
| jogo | mtreinish: https://bugs.launchpad.net/nova/+bug/1366931 | 19:00 |
| uvirtbot | Launchpad bug 1366931 in nova "libvirtError: internal error: process exited while connecting to monitor: Cannot set up guest memory 'pc.ram': Cannot allocate memory" [Undecided,Confirmed] | 19:00 |
| harlowja | mordred http://lists.openstack.org/pipermail/openstack-dev/2014-September/045381.html (feel free to add anything i guess) | 19:00 |
| fungi | manybubbles: yep, awesome | 19:02 |
| fungi | Ryan_Lane: clarkb: https://review.openstack.org/119876 upgrades elasticsearch on wiki.o.o | 19:02 |
| fungi | also openstackgerrit bot seems to have wandered off... checking in on it now | 19:03 |
| jogo | mtreinish: lets move the coversation to -qa | 19:03 |
| mtreinish | clarkb: actually it looks like there are 2 procs named 'python' which are each eating more than an individual nova-api worker. (sort is useful...) | 19:03 |
| clarkb | fungi: we should double check that we are firewalled off too as that was an attack vector iirc (pretty sure we are firewalled there though so not a problem) | 19:03 |
| clarkb | mtreinish: those are your test processes | 19:03 |
| fungi | clarkb: looking now | 19:03 |
| mtreinish | clarkb: oh, right because we invoke them with python -m | 19:04 |
| *** mikedillion has joined #openstack-infra | 19:04 | |
| fungi | clarkb: ssh, http, https from everywhere, snmp from a couple specific sources. all other ipv4/ipv6 ingress rejected | 19:05 |
| clarkb | fungi: perfect | 19:05 |
| fungi | so sayeth ip{,6}tables -L | 19:05 |
| clarkb | 9200-9400 is blocked so we are good | 19:05 |
| *** ^d is now known as ^demon|lunch | 19:06 | |
| fungi | gerritbot restarted on review.o.o, should return to us momentarily | 19:07 |
| jogo | mordred: did you know we run zookeeper in dsvm now | 19:07 |
| jogo | mordred: the more you know | 19:07 |
| *** openstackgerrit has joined #openstack-infra | 19:07 | |
| *** tonytan4ever has joined #openstack-infra | 19:07 | |
| clarkb | jogo: we run it on all of our unittest slaves too | 19:08 |
| jogo | clarkb: in devstack it turns into a memory hunry java monster | 19:08 |
| *** marcoemorais has quit IRC | 19:09 | |
| jogo | clarkb: why in unittest slaves? | 19:09 |
| *** yamamoto has joined #openstack-infra | 19:09 | |
| fungi | jogo: knowing is half the battle | 19:09 |
| clarkb | for testing? iirc harlowja and jd__ wanted it to test tooz and things? | 19:09 |
| jogo | ah | 19:09 |
| *** marcoemorais has joined #openstack-infra | 19:10 | |
| harlowja | yuppers | 19:10 |
| harlowja | although i can fake most of zookeeper out with https://github.com/yahoo/Zake | 19:10 |
| jogo | fungi mordred: so for dsvm Sahara requires it | 19:10 |
| *** yamamoto has quit IRC | 19:11 | |
| harlowja | saharas usage is probably different than [taskflow, tooz] usage i would guess | 19:11 |
| *** yamamoto has joined #openstack-infra | 19:11 | |
| jogo | harlowja: hadoop requires it | 19:11 |
| harlowja | ya, that would make sense :) | 19:11 |
| fungi | yeah, i expect it does | 19:11 |
| fungi | incestuous apache fun | 19:12 |
| clarkb | fungi: we have no footing to stand on while making fun of that :) | 19:12 |
| harlowja | :) | 19:12 |
| openstackgerrit | Edward Raigosa (wenlock) proposed a change to openstack-infra/config: provide an option in plugin to pre-update a plugin with puppet https://review.openstack.org/104652 | 19:12 |
| fungi | clarkb: we are all about some of that, yessiree | 19:13 |
| openstackgerrit | Edward Raigosa (wenlock) proposed a change to openstack-infra/config: give install_modules options for loading requirements externally https://review.openstack.org/117892 | 19:13 |
| openstackgerrit | Edward Raigosa (wenlock) proposed a change to openstack-infra/config: lsb_release is missing for debian setup https://review.openstack.org/119245 | 19:13 |
| *** mestery has quit IRC | 19:13 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Add query for bug 1366931 https://review.openstack.org/119879 | 19:13 |
| uvirtbot | Launchpad bug 1366931 in nova "libvirtError: internal error: process exited while connecting to monitor: Cannot set up guest memory 'pc.ram': Cannot allocate memory" [Undecided,Confirmed] https://launchpad.net/bugs/1366931 | 19:13 |
| *** mestery has joined #openstack-infra | 19:14 | |
| *** mestery has quit IRC | 19:15 | |
| *** Sukhdev has joined #openstack-infra | 19:15 | |
| *** yamamoto has quit IRC | 19:15 | |
| *** mestery has joined #openstack-infra | 19:15 | |
| *** emagana has quit IRC | 19:15 | |
| *** jcoufal has joined #openstack-infra | 19:16 | |
| *** garyh has joined #openstack-infra | 19:16 | |
| *** emagana has joined #openstack-infra | 19:16 | |
| *** terryw has joined #openstack-infra | 19:17 | |
| *** pblaho has joined #openstack-infra | 19:18 | |
| adam_g | clarkb, any objection to making the experimental job i'm adding in 118700 a non-voting job on ironic instead? | 19:19 |
| *** otherwiseguy has quit IRC | 19:19 | |
| *** SumitNaiksatam has left #openstack-infra | 19:19 | |
| clarkb | adam_g: only if you expect this to take a long time. Do we expect it to just work? | 19:19 |
| *** _buzz has joined #openstack-infra | 19:19 | |
| clarkb | I assume you will work it and make it pass so no hard exception unless that assumption is terrible | 19:20 |
| *** emagana has quit IRC | 19:20 | |
| *** SumitNaiksatam has joined #openstack-infra | 19:20 | |
| *** baoli has quit IRC | 19:21 | |
| adam_g | clarkb, it should just work with that other stuff merged. once i manually hacked in the required changes: http://logs.openstack.org/15/118515/15/experimental/check-grenade-dsvm-ironic-sideways/d581408/logs/testr_results.html.gz | 19:21 |
| *** emagana has joined #openstack-infra | 19:22 | |
| *** andreykurilin has joined #openstack-infra | 19:22 | |
| *** SumitNaiksatam has left #openstack-infra | 19:22 | |
| *** marcoemorais has quit IRC | 19:22 | |
| adam_g | clarkb, ill mark 118700 as WIP and wait till that other stuff is in | 19:22 |
| *** marcoemorais has joined #openstack-infra | 19:23 | |
| openstackgerrit | Mark Vanderwiel proposed a change to openstack-infra/config: Set ruby and gem default to 1.9.1 for cookbook jobs on precise https://review.openstack.org/119884 | 19:23 |
| *** zns has joined #openstack-infra | 19:23 | |
| *** zns has joined #openstack-infra | 19:23 | |
| *** SumitNaiksatam has joined #openstack-infra | 19:24 | |
| clarkb | adam_g: ok | 19:24 |
| clarkb | adam_g: I am +2 on all of the other changes with that topic | 19:24 |
| markvan | fungi: ping, still having issues with Ruby on precise, but getting closer. I would like to confirm a couple assumptions I have made. | 19:25 |
| clarkb | markvan: fungi: is there a reason we are using precise instead of trusty? | 19:25 |
| *** SumitNaiksatam has left #openstack-infra | 19:26 | |
| markvan | clarkb: yeah, we are using the latest berkshelf 3.x and it's only support on precise at the moment because of ugly dependencies. That's being worked, but would be ready for a while yet. | 19:26 |
| adam_g | clarkb, cool, thanks. the baguettes are on me in paris. | 19:26 |
| fungi | clarkb: i gather the jobs originally used trusty and have been switched to precise because puppet 2.7 isn't well suited to trusty versions of things | 19:26 |
| *** penguinRaider has joined #openstack-infra | 19:26 | |
| fungi | markvan: ahh, so it was new berkshelf not working on trusty? | 19:26 |
| *** SumitNaiksatam has joined #openstack-infra | 19:27 | |
| markvan | fungi: yeah, that was the trigger that started this. We need some of the features and stability in berkshelf 3.x for latest cookbooks. | 19:27 |
| clarkb | I see | 19:27 |
| clarkb | adam_g: no problem. now we need to bribe another core and split the baguettes | 19:28 |
| markvan | fungi: clarkb I pusked up another patch https://review.openstack.org/#/c/119884/1 | 19:28 |
| *** yfried has quit IRC | 19:28 | |
| markvan | fungi: clarkb: it's making the assumption that both ruby1.9.1 and update-alternatives is installed. Can you comfirm that by running a "update-alternatives --list ruby" on a precise node? | 19:29 |
| clarkb | markvan: they should be installed | 19:29 |
| clarkb | we used update alternatives on the slaves for other things | 19:29 |
| markvan | clarkb: ok, cool, then I should be on the right track here, at least for precise. | 19:30 |
| clarkb | turns out ant on precise depends on java6 and not java6|7 so we had to monkey patch that on precise | 19:30 |
| clarkb | it was good fun :) | 19:30 |
| fungi | update-alternatives is basically impossible to not find on any debian derivative distro | 19:30 |
| *** doug-fish has left #openstack-infra | 19:31 | |
| clarkb | we do allow pushing via https now on our gerrit right? | 19:31 |
| mordred | we do? | 19:31 |
| clarkb | zigo could in theory use that as an alternative to ssh over 29418? | 19:31 |
| clarkb | mordred: I think we do | 19:31 |
| mordred | clarkb: when did that start? | 19:31 |
| clarkb | mordred: when we upgraded gerrit | 19:32 |
| mordred | oh, weird | 19:32 |
| * clarkb tries to figure out a definitive answer | 19:32 | |
| anteaya | clarkb: would be easier than getting the chinese government to allow the ip | 19:32 |
| clarkb | anteaya: probably. I am going to give it a go with the sandbox repo | 19:32 |
| anteaya | cool | 19:32 |
| zigo | anteaya: I wouldn't bet on that !!! | 19:32 |
| anteaya | hahaha | 19:32 |
| fungi | clarkb: i *believe* the support for it is well baked in git-review now too... would be interesting to confirm whether it can be used entirely without ssh access now | 19:32 |
| markvan | fungi: clarkb: ok, thx. My patch is then basically just trying to set the ruby and gem for 1.9.x. | 19:32 |
| clarkb | markvan: yup +2 | 19:33 |
| markvan | fungi: you once posted the packge list for the precise nodes, can you post that link again, would like to double check a few things. | 19:33 |
| fungi | markvan: oh, i can probably dig it up out of my channel log | 19:33 |
| fungi | just a sec | 19:33 |
| zigo | fungi: Any idea on what version? | 19:33 |
| zigo | (or how to do it...) | 19:34 |
| clarkb | zigo: latest version. you have to set your gerrit remote to be https | 19:34 |
| clarkb | zigo: I am sorting it out now and can give details shortly | 19:34 |
| zigo | Cheers. | 19:34 |
| markvan | fungi: clarkb: ty. the cookbook team is looking ahead to what it will take to get to trusty with ruby and berkshelf (or Chef SDK). | 19:34 |
| fungi | zigo: 1.24 (maybe 1.23 had some support for it but i think it was incomplete) | 19:34 |
| zigo | fungi: I have 1.24 (in fact, I maintain the package in Debian... :P) | 19:35 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add query for bug 1366931 https://review.openstack.org/119879 | 19:35 |
| uvirtbot | Launchpad bug 1366931 in nova "libvirtError: internal error: process exited while connecting to monitor: Cannot set up guest memory 'pc.ram': Cannot allocate memory" [Undecided,Confirmed] https://launchpad.net/bugs/1366931 | 19:35 |
| *** craigbr has joined #openstack-infra | 19:36 | |
| fungi | zigo: yep, i remember. thanks again for keeping up that package | 19:37 |
| * zigo goes to sleep, it's nearly 4am here... :( | 19:38 | |
| clarkb | zigo: https://review.openstack.org/#/c/119891/ | 19:38 |
| *** _nadya_ has quit IRC | 19:38 | |
| clarkb | zigo: ok I will respond to your thread with what I have learned | 19:38 |
| *** amcrn has joined #openstack-infra | 19:40 | |
| *** doug-fish has joined #openstack-infra | 19:40 | |
| *** paulrad has joined #openstack-infra | 19:40 | |
| *** salv-orlando has quit IRC | 19:40 | |
| fungi | clarkb: i assume you have to authenticate with a gerrit http api password? | 19:42 |
| clarkb | yup | 19:42 |
| *** baoli has joined #openstack-infra | 19:43 | |
| *** paulrad has quit IRC | 19:44 | |
| *** annegent_ has joined #openstack-infra | 19:45 | |
| clarkb | fungi: zigo sent | 19:46 |
| *** emagana has quit IRC | 19:47 | |
| *** baoli has quit IRC | 19:49 | |
| *** wenlock has quit IRC | 19:51 | |
| *** wenlock has joined #openstack-infra | 19:51 | |
| *** emagana_ has joined #openstack-infra | 19:51 | |
| *** wenlock has quit IRC | 19:51 | |
| *** wenlock has joined #openstack-infra | 19:51 | |
| *** baoli has joined #openstack-infra | 19:52 | |
| ekarlso- | phschwartz: < is he back yet ? :) | 19:52 |
| phschwartz | ekarlso-: I am here. Haven't looked in #openstack-infra today. Been busy with a pressing change internal here. | 19:53 |
| phschwartz | ekarlso-: whats up? | 19:53 |
| phschwartz | fungi: did you ping me the other day? did jroll help you or is there still an issue? | 19:53 |
| *** jgcampbell300 has quit IRC | 19:54 | |
| fungi | phschwartz: yeah, we figured it out... turns out someone accidentally launched some servers in the wrong tenant and didn't realize it | 19:54 |
| openstackgerrit | A change was merged to openstack-infra/config: Upgrade wiki to use elasticsearch 1.3.2 https://review.openstack.org/119876 | 19:55 |
| phschwartz | fungi: ah | 19:55 |
| ekarlso- | phschwartz: did you do some stuff with zuul + github? | 19:55 |
| phschwartz | fungi: how has the quota been going with the new version of code out in all regions? | 19:55 |
| fungi | phschwartz: the error+delete cruft is no longer impeding us, so kudos! | 19:55 |
| phschwartz | ekarlso-: I have, currently using it in a test environment here to allow zuul to trigger from a pull request in github | 19:55 |
| jroll | phschwartz: wait, is the quota sync issue fixed with the new code? | 19:56 |
| phschwartz | fungi: :) and the neutron team here is working on the underlying issue so the redeletes arent needed (even though nodepool does it behind the scenes) | 19:56 |
| phschwartz | fungi: also looks like our api traffic for the infra tenant went down 20% so that is a plus :) | 19:56 |
| fungi | phschwartz: yep, very awesome | 19:57 |
| *** ZZelle_ has joined #openstack-infra | 19:57 | |
| fungi | phschwartz: that's presumably gained from all those retries we were doing which would never succeed | 19:57 |
| phschwartz | jroll: no, different issue, this is related to jogo's fix that johannes and I found that leaves instances in error+deleting with no way to get around it. The fix is in upstream, but was delayed into production for on_metal | 19:58 |
| phschwartz | fungi: correct. | 19:58 |
| ekarlso- | phschwartz: would you care to share that ? :) | 19:58 |
| jroll | phschwartz: ah, I see | 19:58 |
| phschwartz | ekarlso-: I don't have the time at the moment to sanitize it from internal things that are hardcoded in the code at the moment. I will try to do it tonight so I can pass it along. | 19:58 |
| jroll | phschwartz: onmetal delayed the fix that already went out, or the quota fixes? | 19:58 |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Some third-party.rst cleanup https://review.openstack.org/119893 | 19:58 |
| jroll | (regardless, sorry for delaying) | 19:59 |
| openstackgerrit | A change was merged to stackforge/gertty: Add help text for HTTP user/pass https://review.openstack.org/119828 | 19:59 |
| phschwartz | jroll: The fix that already went out. Basically putting the decorator for task_state reset back into the api delete call. | 19:59 |
| openstackgerrit | A change was merged to stackforge/gertty: Display version in help dialog title https://review.openstack.org/119846 | 19:59 |
| ekarlso- | phschwartz: is it really baked in or ? | 19:59 |
| ekarlso- | I wanna use it for the VyOS project | 19:59 |
| jroll | phschwartz: right, thanks | 20:00 |
| phschwartz | ekarlso-: mine was a PoC so I didn't add the calls to pull things like api_key for github out of a config and hard coded it and user data in the triger. I have to clean that all out and set it to pull it from a config before I can put it out there. | 20:00 |
| ekarlso- | phschwartz: ping me when u got something somewhere : ) | 20:01 |
| ekarlso- | would be awesome! | 20:01 |
| phschwartz | ekarlso-: will do, it will most likely be in a patch in gerrit so I can point you to it when it is out there. | 20:01 |
| *** dprince has quit IRC | 20:02 | |
| openstackgerrit | A change was merged to openstack-infra/infra-specs: Multiple Data Dirs proposal https://review.openstack.org/100363 | 20:02 |
| *** gyee has joined #openstack-infra | 20:03 | |
| *** sarob has joined #openstack-infra | 20:04 | |
| *** dtantsur is now known as dtantsur|afk | 20:04 | |
| openstackgerrit | Adam Gandelman proposed a change to openstack-infra/config: Consolidate and rename Ironic jobs https://review.openstack.org/112134 | 20:05 |
| adam_g | clarkb, ^ gah | 20:06 |
| *** zns has quit IRC | 20:06 | |
| clarkb | silly new projects | 20:06 |
| clarkb | ok I am grabbing lunch then hopefully diving into proper code review | 20:07 |
| *** markmcclain has quit IRC | 20:08 | |
| *** _nadya_ has joined #openstack-infra | 20:09 | |
| *** yamamoto has joined #openstack-infra | 20:09 | |
| *** e0ne has quit IRC | 20:09 | |
| mordred | phschwartz: if you just xxxx out your keys and submit the patch, I'll be happy to work on the "pull from config" part | 20:09 |
| *** berendt has quit IRC | 20:09 | |
| *** MarkAtwood has quit IRC | 20:09 | |
| *** mrmartin has quit IRC | 20:11 | |
| dims_ | mriedem1: jogo: can you please add couple of oslo sync that fix bugs reported against nova to your queue? https://review.openstack.org/#/c/119586/ https://review.openstack.org/#/c/119813/ | 20:11 |
| jeblair | nibalizer: is http://git.openstack.org/cgit/openstack-infra/infra-specs/tree/specs/public_hiera.rst#n3 correct? | 20:12 |
| jeblair | nibalizer: it claims that you own the copyright, rather than your employer. | 20:12 |
| openstackgerrit | Adam Gandelman proposed a change to openstack-infra/config: Adds support for Ironic parallel Tempest testing https://review.openstack.org/118700 | 20:13 |
| nibalizer | should I re-do it to be (c) HP? | 20:13 |
| *** yamamoto has quit IRC | 20:13 | |
| nibalizer | i kinda just did that, let me go find a different HP Spec | 20:14 |
| *** cipcosma has quit IRC | 20:14 | |
| jroll | I don't understand why we make copyright lines anyway, when the foundation owns it :/ | 20:14 |
| jeblair | nibalizer: unless you have a special employment contract, you're probably in the same boat as most of us, yeah, should probably just be hp | 20:14 |
| jeblair | jroll: what makes you think the foundation holds the copyright on the work we do? | 20:14 |
| *** vladan has quit IRC | 20:15 | |
| mriedem1 | dims_: yeah | 20:15 |
| jroll | jeblair: I thought that's what the CLA does, I may be wrong | 20:15 |
| *** spiffxp_ has quit IRC | 20:15 | |
| jeblair | jroll: almost no one fully understands the CLA, including those of us who have spent quite a lot of time trying to. but we're pretty sure that's not one of the things it does. :) | 20:15 |
| jroll | huh, interesting | 20:16 |
| Kiall | I thought the CLA gave the OpenStack Foundation an unlimited / unrestricted right to use and redistribute, rather than gives them the copyright.. But.. As jeblair says.. Who knows... | 20:16 |
| nibalizer | jeblair: okay ill make a patch to fix it | 20:16 |
| jroll | jeblair: so, say, a file that rackspace made. HP adds a bunch of code to that. who owns the new code? | 20:16 |
| *** spiffxp_ has joined #openstack-infra | 20:16 | |
| jeblair | jroll: so welcome to the club of "developers who have agreed to something we don't fully understand". we have _many_ members! you are in good company! :) | 20:16 |
| *** kgiusti has left #openstack-infra | 20:16 | |
| jroll | jeblair: does rackspace own it, because the copyright line says rackspace? | 20:16 |
| jroll | jeblair: I thought that was all software devs :) | 20:16 |
| jeblair | Kiall: my current understand is fairly close to what you have said, yes | 20:17 |
| nibalizer | its apache2 so 'ownership' is .... ehhh | 20:17 |
| jroll | right. hm | 20:17 |
| *** Shrews has quit IRC | 20:17 | |
| *** Shrews has joined #openstack-infra | 20:17 | |
| jeblair | jroll: the authors (in this case, generally companies since we are doing work-for-hire for them) own their respective parts of those files | 20:18 |
| jroll | right, ok | 20:18 |
| jroll | thanks :) | 20:18 |
| clarkb | other CLAs do come with copyright attribution but this one doesn't | 20:20 |
| Kiall | http://i.imgur.com/qghwtzE.png <-- That's the bit that makes be think it's a usage grant, rather than ownership transfer | 20:20 |
| clarkb | so beware that if you have signed other CLAs $org may actually get copyright | 20:20 |
| mordred | jroll: generally speaking, if you, as the author of a bunch of changes to a file that previously listed Rackspace in the copyright line, feel that you have made changes worthy of indicating copyright ownership - you can add a copyright line for yourself (or your employer as the case may be appropriate) | 20:20 |
| mordred | jroll: so in general, in the case you mention, HP should probably add an HP line | 20:20 |
| jroll | mordred: right on. more curious than anything | 20:21 |
| mordred | jroll: totally. it's an area full of grey :) | 20:21 |
| jeblair | Kiall: yep, the foundation, as best as we understand, has rights that go far beyond what's in the apache license. so while most of us receive the software under that license (from whom we receive it is not entirely clear); the foundation can do almost whatever they want with it. | 20:21 |
| jroll | mordred: as usual :) | 20:21 |
| *** vladan has joined #openstack-infra | 20:22 | |
| mordred | jeblair: to be fair, most of _us_ can also do almost whatever we want with it too, since it is Apache ... | 20:22 |
| Kiall | jeblair: Yep, we both agree ;) Just pointing to the section that makes me think we don't transfer copyright :) | 20:22 |
| mordred | jeblair: but I agree with your assessment | 20:22 |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Some third-party.rst cleanup https://review.openstack.org/119893 | 20:23 |
| *** erlon has joined #openstack-infra | 20:26 | |
| anteaya | Kiall: I was just about to review your patches | 20:27 |
| *** r-daneel has quit IRC | 20:27 | |
| anteaya | Kiall: where are we with the discussion with david-lyle about the way forward? | 20:27 |
| anteaya | Kiall: or russellb's suggestion for a ml thread? | 20:27 |
| *** r-daneel has joined #openstack-infra | 20:28 | |
| *** robemcallister has joined #openstack-infra | 20:28 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/infra-specs: Add config repo split spec https://review.openstack.org/110730 | 20:28 |
| Kiall | anteaya: Getting the discussion stared on the ML has falling off list today, I've asked ttx to take it off tomorrows TC agenda, so we can discuss on-list first. | 20:29 |
| *** jergerber has quit IRC | 20:29 | |
| anteaya | Kiall: okay, I will hold off reviewing until we have the discussion | 20:29 |
| anteaya | thanks | 20:29 |
| jeblair | fungi, clarkb: ^ that was a minor change to add 2 files that fungi suggested | 20:30 |
| Kiall | anteaya: no problem | 20:30 |
| *** gpocentek has quit IRC | 20:30 | |
| *** doug-fish has left #openstack-infra | 20:30 | |
| openstackgerrit | A change was merged to openstack-infra/config: Set ruby and gem default to 1.9.1 for cookbook jobs on precise https://review.openstack.org/119884 | 20:30 |
| openstackgerrit | A change was merged to openstack-infra/infra-specs: Add docs publishing spec https://review.openstack.org/110793 | 20:30 |
| *** gpocentek has joined #openstack-infra | 20:31 | |
| annegent_ | woowoo on that merge! ^^ L( | 20:32 |
| annegent_ | er that was meant to be a :) but capital L hijacked it | 20:32 |
| *** sbadia has quit IRC | 20:32 | |
| *** ^demon|lunch is now known as ^d_ | 20:33 | |
| *** bdpayne_ has joined #openstack-infra | 20:33 | |
| anteaya | capital L | 20:33 |
| anteaya | always getting in the way | 20:33 |
| jeblair | this misunderstanding has been brought to you by the capital letter L | 20:34 |
| anteaya | one one letter L | 20:34 |
| anteaya | ha ha ha ha | 20:34 |
| anteaya | *thunder and lightening* | 20:35 |
| *** chuckC has joined #openstack-infra | 20:35 | |
| *** ChuckC_ has quit IRC | 20:35 | |
| *** bdpayne has quit IRC | 20:36 | |
| *** sbadia has joined #openstack-infra | 20:36 | |
| *** ^d_ is now known as ^d | 20:36 | |
| mordred | jeblair: btw - out of all of the repos we have, 11 need to have their doc env renamed to docs, 9 need one added. the rest either already have a docs env, or don't have a docs dir | 20:38 |
| mattoliverau | Lol, sesame st humour, is that what you all get up to while us Aussies sleep :p | 20:39 |
| mordred | jeblair: _all_ of the integrated projects have a docs | 20:39 |
| *** gpocentek has quit IRC | 20:39 | |
| *** gpocentek has joined #openstack-infra | 20:40 | |
| anteaya | mattoliverau: :D | 20:40 |
| *** virmitio has joined #openstack-infra | 20:40 | |
| jeblair | mordred: ack | 20:40 |
| anteaya | mattoliverau: that and so much more, and good morning | 20:40 |
| mattoliverau | Lol, I knew if I slept I'd miss out on things! morning :) | 20:41 |
| *** zns has joined #openstack-infra | 20:42 | |
| *** robemcallister has quit IRC | 20:42 | |
| *** robemcallister has joined #openstack-infra | 20:43 | |
| *** miqui has quit IRC | 20:43 | |
| *** nelsnelson has quit IRC | 20:43 | |
| fungi | jeblair: Kiall: jroll: mordred: also notable is that work-for-hire copyright ownership is apparently only the case in some jurisdictions. from what i gather quite a few european countries default to the employee owning the copyright and granting potential exclusive use to their employers | 20:44 |
| *** robemcallister is now known as rmcall | 20:44 | |
| *** mrmartin has joined #openstack-infra | 20:44 | |
| *** annegent_ has quit IRC | 20:44 | |
| anteaya | mattoliverau: :D | 20:45 |
| mattoliverau | Just boarding a plane so phone is going off for a while, be back soon. :) | 20:45 |
| jeblair | fungi: yep! it's so exciting! | 20:45 |
| *** doude has quit IRC | 20:45 | |
| mrmartin | re | 20:46 |
| anteaya | mattoliverau: safe flight | 20:46 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/gear: Rename doc environment to docs https://review.openstack.org/119908 | 20:47 |
| openstackgerrit | Alessandro Pilotti proposed a change to openstack-infra/config: Adds cloudbase-init to StackForge https://review.openstack.org/119909 | 20:47 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/jenkins-job-builder: Rename doc environment to docs https://review.openstack.org/119910 | 20:47 |
| fungi | also, *some* employers in the usa allow some employees to own copyright for their work during business hours (red hat apparently offers this as an option) | 20:47 |
| mordred | fungi: wait - are you saying something bout murica? | 20:47 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/zuul: Rename doc environment to docs https://review.openstack.org/119911 | 20:47 |
| fungi | mordred: yes, land of the lawyers and home of corporations who are people | 20:48 |
| *** HenryG has quit IRC | 20:48 | |
| *** MaxV has joined #openstack-infra | 20:48 | |
| Kiall | fungi: Yep - Isn't that why we have the I-CLA and C-CLA? :) | 20:49 |
| *** ajo has quit IRC | 20:49 | |
| *** rmcall has quit IRC | 20:50 | |
| *** markmcclain has joined #openstack-infra | 20:50 | |
| mordred | Kiall: nope. the reason we have those is that we had those when Rackspace owned things and it was perpetuated | 20:50 |
| *** cnesa10 has joined #openstack-infra | 20:50 | |
| Kiall | Oh.. Fair enough so | 20:50 |
| clarkb | also somehow nasa owns copyright | 20:51 |
| openstackgerrit | Monty Taylor proposed a change to stackforge/gertty: Rename doc environment to docs https://review.openstack.org/119914 | 20:51 |
| mrmartin | fungi: hi, what is the easiest way to add a release tag to the openstackid project? and who have the right to do it? | 20:51 |
| jeblair | clarkb: right, which they can't actually do | 20:51 |
| openstackgerrit | Doug Hellmann proposed a change to openstack-infra/config: Publicize patches sent to openstack/governance https://review.openstack.org/119918 | 20:51 |
| clarkb | jeblair: right | 20:51 |
| *** paulrad has joined #openstack-infra | 20:52 | |
| openstackgerrit | Alessandro Pilotti proposed a change to openstack-infra/config: Adds cloudbase-init to StackForge https://review.openstack.org/119909 | 20:52 |
| anteaya | fungi: and women who don't exist | 20:52 |
| *** terryw has quit IRC | 20:53 | |
| openstackgerrit | Monty Taylor proposed a change to stackforge/python-jenkins: Rename doc environment to docs https://review.openstack.org/119921 | 20:53 |
| clarkb | mrmartin: https://review.openstack.org/#/admin/groups/257,members members of that group can push signed tags to gerrit | 20:53 |
| *** rmcall has joined #openstack-infra | 20:53 | |
| clarkb | for that project | 20:54 |
| fungi | mrmartin: according to https://review.openstack.org/#/admin/projects/openstack-infra/openstackid,access signed tags can be pushed by openstackid-release group members, who are you and the infra-core team | 20:54 |
| mrmartin | so Sebastian can do it | 20:54 |
| fungi | er, yeah, not you but smarcet | 20:54 |
| anteaya | https://review.openstack.org/#/admin/groups/257,members | 20:55 |
| *** iax7 has joined #openstack-infra | 20:55 | |
| *** zns has quit IRC | 20:55 | |
| *** lcheng_ has quit IRC | 20:55 | |
| mordred | clarkb: sigh. the set of patches I just sent in get me exactly zero ATC status anywhere new :( | 20:55 |
| *** lcheng_ has joined #openstack-infra | 20:55 | |
| *** lcheng_ has quit IRC | 20:56 | |
| clarkb | mordred: oh no | 20:56 |
| mordred | clarkb: I know! how else am I going to game the system??? | 20:56 |
| clarkb | mordred: whitespace cleanup patces | 20:56 |
| mordred | clarkb: GOLDEN! | 20:56 |
| *** garyh has quit IRC | 20:57 | |
| clarkb | fungi: did you see that git review bug from today? /me digs it up | 20:57 |
| mordred | clarkb: or, I suppose, changing testenv:pep8 to testenv:style everwhere ... | 20:57 |
| *** yamamoto has joined #openstack-infra | 20:57 | |
| *** zns has joined #openstack-infra | 20:57 | |
| Kiall | mordred: BTW the trick with pointless whitespace cleanup patches is to ensure it conflicts with EVERY OTHER change queued for review | 20:57 |
| *** emagana_ has quit IRC | 20:57 | |
| Kiall | don't forget ;) | 20:57 |
| fungi | clarkb: about unicode elipses? | 20:58 |
| fungi | skimmed, did not triage | 20:58 |
| clarkb | fungi: ya the windows thing | 20:58 |
| nibalizer | we need that livegrep thing | 20:58 |
| clarkb | ok I can't find it anymore... but glad you at least saw it | 20:58 |
| nibalizer | so we can search the codebase for unicode snowman | 20:58 |
| clarkb | nibalizer: did you seem my jjb change to add some? | 20:58 |
| mordred | nibalizer: oh, right. I was going to follow up on that livegrep patch a while back ... | 20:58 |
| nibalizer | clarkb: i didn't | 20:59 |
| clarkb | looks like it merged. anyways added snowmen to test that jjb supports unicopde | 20:59 |
| nibalizer | excellent | 20:59 |
| nibalizer | borrowing from rails, there kinda | 20:59 |
| *** annegent_ has joined #openstack-infra | 21:00 | |
| *** HenryG has joined #openstack-infra | 21:00 | |
| anteaya | nibalizer: did you get your blkperl to submit a new patch for livegrep? | 21:00 |
| nibalizer | anteaya: i don't think so | 21:00 |
| anteaya | :( | 21:01 |
| nibalizer | he's in mad interviews all day these days so may not do it | 21:01 |
| nibalizer | i should do it | 21:01 |
| nibalizer | but other things | 21:01 |
| nibalizer | ;( | 21:01 |
| *** tgohad has joined #openstack-infra | 21:01 | |
| nibalizer | er :( | 21:01 |
| anteaya | yeah :( | 21:01 |
| *** emagana has joined #openstack-infra | 21:01 | |
| anteaya | but yay for blkperl and his mad interviews | 21:01 |
| anteaya | may he get what he wants | 21:01 |
| mordred | clarkb: you know what fails the snowman test? the solaris filesystem | 21:02 |
| nibalizer | mordred: oh i have a good one on that | 21:02 |
| clarkb | mordred: I wouldn't be surprised if a lot of file systems fail that test | 21:02 |
| nibalizer | so nfs to linux clients from solaris | 21:02 |
| clarkb | we should try fat | 21:02 |
| nibalizer | linux clinet is very confused about ntp, thinks its the future, writes a file that is older than 2038 | 21:02 |
| *** tsg has quit IRC | 21:02 | |
| mrmartin | fungi: and what is the proper way to add myself as a group member to openstackid with access to tag creation? | 21:02 |
| nibalizer | solairs can't stat the file on its own filesystem | 21:02 |
| nibalizer | segfaults | 21:03 |
| mordred | dhellmann: we could make the next release of pbr be 1.0 | 21:03 |
| fungi | mrmartin: generally you would just need confirmation from smarcet, preferably along with him asking to be removed if he's not going to do it himself | 21:03 |
| dhellmann | mordred: that would make me happy, but it looks like we still have a lot in flight right now | 21:03 |
| mordred | dhellmann: it hasn't had much churn other than lifeless version cleanup - and it's certainly in wide use | 21:03 |
| dhellmann | mordred: the semver stuff lifeless is working on, in particular | 21:03 |
| *** stevemar has quit IRC | 21:03 | |
| clarkb | mordred: did the version thing throwing an exception get sorted out for you? | 21:04 |
| *** mriedem1 is now known as mriedem | 21:04 | |
| mrmartin | fungi: ok, I got it, but does it require some infra config change? | 21:04 |
| dhellmann | I sort of doubt that's going to land this cycle, so maybe that's a post 1.0 feature | 21:04 |
| mordred | dhellmann: oh, I thought that had all landed - let me go look at that stack | 21:04 |
| mordred | clarkb: lifeless tells me he and ttx have a plan | 21:04 |
| *** stevemar has joined #openstack-infra | 21:04 | |
| *** baoli has quit IRC | 21:05 | |
| dhellmann | mordred: tbh, I haven't been focusing on pbr very much this cycle and some of that automation feels interesting but unecessary | 21:05 |
| *** melwitt has joined #openstack-infra | 21:05 | |
| *** mmedvede has quit IRC | 21:05 | |
| dhellmann | mordred: perhaps there's background I just don't know about | 21:05 |
| fungi | mrmartin: just requires one of the gerrit admins (myself, mordred, clarkb, jeblair, SergeyLukjanov) to add you to that group. no config change needed | 21:05 |
| lifeless | hi | 21:05 |
| lifeless | whats the about ? | 21:05 |
| dhellmann | mordred: I think the *fixes* landed, but not all of the "make me a new version number" stuff | 21:05 |
| lifeless | whats *this* about | 21:05 |
| *** amcrn has quit IRC | 21:05 | |
| fungi | mrmartin: or preferably, smarcet can add you to that group himself | 21:05 |
| mrmartin | fungi, thanks, I'll drop a mail to smarcet about this | 21:05 |
| dhellmann | lifeless: can pbr be version 1.0 and what's the status of the semver stuff | 21:06 |
| lifeless | there is a crucial issue we need to finish fixing before doing 1.0.0 | 21:06 |
| mordred | lifeless: current state of pbr semver | 21:06 |
| lifeless | the semver stuff has a long tail and as you say much of the tail isn't needed | 21:06 |
| *** pelix has quit IRC | 21:06 | |
| lifeless | the patch to ignore *bad tags* is needed | 21:06 |
| lifeless | thats two up in the stack last I checked | 21:06 |
| mordred | lifeless: what's the critical? | 21:06 |
| *** zns has quit IRC | 21:06 | |
| dhellmann | lifeless: this one? https://review.openstack.org/#/c/114403/ | 21:07 |
| lifeless | yes | 21:07 |
| lifeless | with the interesting and fun python 3.3 issue I haven't tracked down yet | 21:07 |
| mrmartin | fungi: we have a single master branch there, I found this guide: https://wiki.openstack.org/wiki/ReleaseTeam/How_To_Release, is the "Manually push new tag on that branch" required to add / push the new release tag? | 21:08 |
| *** mwagner_lap has quit IRC | 21:08 | |
| *** tsg has joined #openstack-infra | 21:08 | |
| lifeless | mordred: the current state is that if someone does a git tag of 'fred' we blow up rather than ignoring 'fred'. Current released pbr creates a version called 'fred' which is 100% bogus, but doesn't blow up. We shouldn't blow up there. | 21:08 |
| fungi | mrmartin: the more general documentation is https://wiki.openstack.org/wiki/GerritJenkinsGit#Tagging_a_Release | 21:08 |
| *** zns has joined #openstack-infra | 21:08 | |
| lifeless | mordred: and I mean literally 'fred', not 'some arbitrary version' - strings that are not versions | 21:09 |
| *** tgohad has quit IRC | 21:10 | |
| *** ociuhandu has quit IRC | 21:10 | |
| *** arborism has joined #openstack-infra | 21:10 | |
| *** arborism is now known as amcrn | 21:11 | |
| mordred | lifeless: yah. grok | 21:11 |
| mordred | lifeless: and I agree- we shoudl not blow up | 21:11 |
| *** bswartz has quit IRC | 21:12 | |
| anteaya | fungi: any reason for the first two lines to be there in this acl file? https://review.openstack.org/#/c/118333/2/modules/openstack_project/files/gerrit/acls/stackforge/packstack.config | 21:13 |
| *** tonytan4ever has quit IRC | 21:13 | |
| anteaya | fungi: I don't think they need to be there but I am doubting myself | 21:13 |
| jeblair | mordred, clarkb: i'm woring on a reply about the hpcloud router thing | 21:14 |
| mordred | jeblair: cool | 21:14 |
| *** dkranz has quit IRC | 21:14 | |
| jeblair | mordred, clarkb: what's involved on our side if he moves them? should we spin down our use of the pseudo-providers associated with the routers he's moving? | 21:15 |
| jeblair | mordred, clarkb: because, do we expect a brief, full network outage as it happens? | 21:15 |
| *** Sukhdev has quit IRC | 21:15 | |
| clarkb | jeblair: yes there will be network outage. so I think process our side would be to set quota to zerp for a pseudo provider, let that fall to zero, then move it and reenable | 21:16 |
| clarkb | rinse and repeat | 21:16 |
| jeblair | clarkb: also, just double checking, our router names == our pseudo-provider names, right? so hpcloud-b5 is openstackjenkins2-router5? | 21:16 |
| jeblair | clarkb: and hpcloud-b1 is openstackjenkins2-router[nothing]? | 21:16 |
| clarkb | or as an alternative, spin up 5 new routers and networks, have them plce them properly, then change the psuedo providers all at once | 21:16 |
| fungi | anteaya: that allows their core team to create new branches. changes are they'd be better off restricting that to their release team | 21:16 |
| clarkb | jeblair: ya, we got the digitless network by default | 21:16 |
| clarkb | jeblair: so I didn't bother adding a digit | 21:16 |
| *** marcoemorais has quit IRC | 21:17 | |
| jeblair | clarkb: i actually kind of want to spin down some of hp to reduce the error incidence anyway, so maybe let's do that. | 21:18 |
| *** TravT has quit IRC | 21:18 | |
| clarkb | jeblair: sounds good to me | 21:19 |
| anteaya | fungi: I will make that suggestion | 21:19 |
| *** weshay has quit IRC | 21:19 | |
| lifeless | mordred: I'm fine with blowing up when we've got incompatible requirements from the user, but versions like 'fred.dev1.g123123' were never intended ;) | 21:20 |
| jeblair | clarkb: how many ips do we have in a network? 256ish? think we can bump each other pseudo-provider by some amount? 66 would keep us at capacity. | 21:22 |
| jeblair | that's "+66". | 21:22 |
| *** mrmartin has quit IRC | 21:22 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Reduce hpcloud-b1 and b2 usage to 0 https://review.openstack.org/119933 | 21:23 |
| jeblair | clarkb, fungi, mordred: ^ strawman | 21:23 |
| jeblair | clarkb, fungi, mordred: also, errors trailed off by 1500 utc today. | 21:24 |
| openstackgerrit | Ramy Asselin proposed a change to openstack-infra/config: Log jenkins job builder errors on failure. https://review.openstack.org/119934 | 21:25 |
| anteaya | fungi: are we encouraging folks to use py34 instead of py33 for stackforge yet? https://review.openstack.org/#/c/119909/2/modules/openstack_project/files/zuul/layout.yaml | 21:27 |
| *** david-lyle has quit IRC | 21:28 | |
| *** cnesa10 has quit IRC | 21:29 | |
| *** mfer has quit IRC | 21:29 | |
| jeblair | anteaya: we don't encourage anything for stackforge | 21:31 |
| nibalizer | is it fair to say we encourage them to use trusty or be trusty compatible? | 21:31 |
| EmilienM | mordred: I wonder if dox could be used for Automated integration testing in puppet modules | 21:31 |
| anteaya | jeblair: very good | 21:32 |
| fungi | anteaya: i'll be submitting a mass changeover as soon as i'm done confirming voting jobs for official projects, but note that https://review.openstack.org/110256 merged so hopefully projects are using the python3-jobs template in layout.yaml now | 21:32 |
| clarkb | jeblair: I think the dhpc range is a bit smaller than 256 due to ips reservered for other things but not a ton smaller | 21:33 |
| anteaya | fungi: thanks, I will keep an eye out for that | 21:34 |
| jeblair | nibalizer, anteaya: stackforge is a self-service system that lets people use the openstack development infrastructure; projects are welcome to do whatever they want. they probably _should_ do what the rest of openstack is doing, because we add and drop testing platforms according to what it needs. | 21:34 |
| jeblair | nibalizer, anteaya: but the intent is very explicitly that the infra team is not responsible for what happens there. it is very explicitly out of scope for things that we sink our time into. :) | 21:35 |
| *** SpamapS_ is now known as SpamapS | 21:35 | |
| *** SpamapS has quit IRC | 21:35 | |
| *** SpamapS has joined #openstack-infra | 21:35 | |
| jeblair | having said that, we're nice folks and like to talk about this stuff and fungi is even nicer to propose all those changes. ;) | 21:35 |
| *** yamahata has joined #openstack-infra | 21:35 | |
| *** jcoufal has quit IRC | 21:35 | |
| *** bdpayne_ has quit IRC | 21:35 | |
| *** yamahata has quit IRC | 21:36 | |
| *** annegent_ has quit IRC | 21:36 | |
| *** yamahata has joined #openstack-infra | 21:36 | |
| jeblair | so depending on exactly what anteaya was asking, the answer is probably "infra has no opinion; addressing that issue is not required for a complete review of the change in question" or "yeah, there's in general a big switch to py34 underway and it might be worth mentioning it to them so they know about it". | 21:37 |
| *** bdpayne has joined #openstack-infra | 21:37 | |
| *** pblaho has quit IRC | 21:37 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Trim jenkins::slave package installations further https://review.openstack.org/119936 | 21:37 |
| clarkb | SergeyLukjanov: jogo sdague ^ | 21:38 |
| clarkb | that will install zk only on the nodes that need it | 21:38 |
| jeblair | anteaya, nibalizer: anyway, this is all overwhelming enough as it is, i just want to make sure folks know that we're only responsible for 112 projects, not 328. :) | 21:38 |
| *** flaper87 is now known as flaper87|afk | 21:38 | |
| jeblair | clarkb: that being the case, +66 nodes is probably okay, yeah? | 21:39 |
| clarkb | jeblair: yup should be fine | 21:39 |
| anteaya | jeblair: message recieved | 21:39 |
| mordred | EmilienM: I'm sure that it could! | 21:39 |
| jeblair | clarkb, fungi, mordred: speedy review of https://review.openstack.org/#/c/119933/ please? then i'll ask that b1 and b2 be moved | 21:39 |
| anteaya | and fungi is a nice guy to tidy things up | 21:39 |
| clarkb | jeblair: reviewing now | 21:39 |
| mordred | jeblair: on it | 21:39 |
| mordred | +@ | 21:40 |
| mordred | +2 | 21:40 |
| mordred | that is | 21:40 |
| EmilienM | mordred: so I'm definitely interested to work on it. If you have 2 min, the context: http://lists.openstack.org/pipermail/openstack-infra/2014-September/001913.html | 21:40 |
| clarkb | jeblair: you should be able to double check the dhcp ranges if you are worried about it | 21:40 |
| clarkb | of course the tricky part if figuring out hwo to do that. | 21:40 |
| clarkb | give me a minute and I will see if I can figure it out | 21:40 |
| mordred | EmilienM: we've spun up a channel ... #dox ... that you might want to join | 21:40 |
| SergeyLukjanov | jogo, fungi, mordred, harlowja, fwiw Sahara doesn't require any additional software on the host | 21:41 |
| *** paulrad has quit IRC | 21:41 | |
| jogo | SergeyLukjanov: ack that was a red herring sorry for alarmin you | 21:42 |
| * mordred throws cat at SergeyLukjanov just for good measure | 21:42 | |
| *** paulrad has joined #openstack-infra | 21:42 | |
| anteaya | SergeyLukjanov: hi | 21:42 |
| anteaya | so your wedding is the 13th yeah? | 21:42 |
| anteaya | SergeyLukjanov: so yay for the 13th | 21:42 |
| SergeyLukjanov | jogo, yeah, just making sure that sahara is still in the gate ;) | 21:42 |
| anteaya | and I'll try to remember to embarass you on irc on that date too | 21:42 |
| anteaya | just for the logs | 21:42 |
| mtreinish | SergeyLukjanov: heh, I wouldn't let anyone pull it out without telling you first :) | 21:43 |
| *** tgohad has joined #openstack-infra | 21:43 | |
| clarkb | jeblair: looks like .2 to .254 are in the pool so we are fine | 21:43 |
| clarkb | jeblair: neutron subnet-list | 21:43 |
| *** MaxV has quit IRC | 21:44 | |
| SergeyLukjanov | anteaya, yup, it's sept 13 ;) | 21:44 |
| *** mriedem1 has joined #openstack-infra | 21:44 | |
| SergeyLukjanov | mtreinish, thx :) | 21:44 |
| anteaya | SergeyLukjanov: yay | 21:44 |
| anteaya | :D | 21:44 |
| anteaya | DinaBelova: yay | 21:45 |
| SergeyLukjanov | anteaya, but I'm 100% sure that I'll not be in irc this day | 21:45 |
| pleia2 | shouldn't be on irc on your wedding day :) | 21:45 |
| SergeyLukjanov | otherwise DinaBelova will kill me | 21:45 |
| *** mriedem has quit IRC | 21:45 | |
| anteaya | SergeyLukjanov: yes she will | 21:45 |
| anteaya | but one for the logs, so you can read scrollback | 21:45 |
| *** tsg has quit IRC | 21:46 | |
| *** mikedillion has quit IRC | 21:46 | |
| anteaya | mriedem1: so one of the ci systems is blocked in china | 21:46 |
| mordred | SergeyLukjanov: I duno - I kinda feel like you guys should get married in an IRC meeting ... | 21:46 |
| anteaya | clarkb: I dont' think third party ci accounts can use http | 21:46 |
| jeblair | clarkb, mordred, fungi: cool then we're all set. when 119933 merges ("Two ones, ha ha ha. Two nines, ha, ha, ha. Two threes, ha ha ha."), i'll let rick know that he can move openstackjenkins2-router and openstackjenkins2-router2 an hour after that. | 21:46 |
| anteaya | ha ha ha | 21:47 |
| SergeyLukjanov | mordred :) | 21:47 |
| fungi | thanks, count | 21:47 |
| * anteaya pictures the count wearing a fedora, vest, and bowtie | 21:47 | |
| *** paulrad has quit IRC | 21:47 | |
| mriedem1 | anteaya: yeah | 21:47 |
| anteaya | and looking snappy | 21:47 |
| mriedem1 | db2 ci is in china | 21:47 |
| clarkb | jeblair: reading email are those the two we want to move? | 21:47 |
| anteaya | mriedem1: hmmmm | 21:47 |
| mriedem1 | anteaya: i forwarded the ML thread to the maintainers | 21:47 |
| mriedem1 | since right now i have to head out for awhile :) | 21:47 |
| anteaya | mriedem1: so I don't think third party ci systems can use http | 21:47 |
| jeblair | clarkb: please double check, but that's the conclusion i came to. :) | 21:47 |
| anteaya | mriedem1: kk, thanks for confirming | 21:47 |
| clarkb | jeblair: oh yup Imisread the jenkins2 username | 21:48 |
| anteaya | mriedem1: I didnt' know this was the case | 21:48 |
| mriedem1 | anteaya: no idea, their alternative was moving stuff to the US | 21:48 |
| jeblair | clarkb: i'm assuming that he wants to move any two routers that are on the same host as another router | 21:48 |
| fungi | anteaya: yeah, afaik the gerrit event stream is only accessible via ssh | 21:48 |
| clarkb | jeblair: yup tat was my assumption | 21:48 |
| clarkb | jeblair: and 1 and 2 are in that boat | 21:48 |
| DinaBelova | mordred :D lol | 21:48 |
| anteaya | mriedem1: hmmm, well hopefully one of their maintainers will at least show up in infra, so we can talk and see if there is another way | 21:48 |
| *** dims_ has quit IRC | 21:48 | |
| clarkb | mordred: jeblair: the answer of use a mirror per router is a bit crazy though | 21:49 |
| *** dims has joined #openstack-infra | 21:49 | |
| clarkb | we can cross that bridge when we get there | 21:49 |
| clarkb | I think that may have been a network pun | 21:50 |
| *** sarob has quit IRC | 21:50 | |
| * mordred throws wet cat at clarkb | 21:50 | |
| mordred | DinaBelova: all of your family knows how to join an IRC meeting of course, right? :) | 21:50 |
| jeblair | clarkb, mordred, fungi: it sounds like the major issue is that the virtual routers are overloaded. mostly because of a bad tenant sharing the host that two of our routers are on... | 21:50 |
| *** alkari has quit IRC | 21:50 | |
| *** alkari has joined #openstack-infra | 21:51 | |
| mordred | jeblair: yah | 21:51 |
| jeblair | clarkb, mordred, fungi: and somewhat less so because _we_ are sharing a host (by having 2 of our routers on it) | 21:51 |
| anteaya | mordred: will you be officiating? at teh DinaBelova SergeyLukjanov irc wedding? | 21:51 |
| *** alkari has quit IRC | 21:51 | |
| *** pcm_ has quit IRC | 21:51 | |
| fungi | jeblair: unless... we... are the "bad tenant"? | 21:51 |
| *** ^d has left #openstack-infra | 21:51 | |
| mordred | fungi: nope, there is amazingly someone apparently worse than us | 21:52 |
| jeblair | clarkb, mordred, fungi: so fixing the bad tenant is one thing (i'm guessing that may have happened earlier, based on lowered error counts), but us moving may help too | 21:52 |
| * fungi is amazed | 21:52 | |
| *** emagana has quit IRC | 21:52 | |
| nibalizer | just an fyi, we're about to move github.com/nibalizer/puppet-module-puppetboard to github.com/puppet-community/module-puppetboard, github claims that this won't break anything | 21:52 |
| fungi | jeblair: yeah, though doesn't prevent another from taking its place, as history has taught us repeatedly | 21:52 |
| jeblair | at the _very_ least, it makes us more diversified in the bad neighbor case in the future | 21:52 |
| jeblair | and moving to 9 routers will make us even more diversified | 21:53 |
| mordred | jeblair: maybe we shoudl move to 18 routers | 21:53 |
| mordred | jeblair: or or or - router per host!!! | 21:53 |
| fungi | you beat me to it | 21:53 |
| * fungi was about to propose that as a nodepool optimization | 21:53 | |
| *** sarob has joined #openstack-infra | 21:53 | |
| clarkb | I can just imagine that quota request. we need 600 routers! | 21:53 |
| jeblair | hehe | 21:53 |
| mordred | we could do 2 routers per host, and then attach a floating ip from each network to the host and multi-home them | 21:53 |
| *** dims has quit IRC | 21:53 | |
| anteaya | nibalizer: let's see what really happens | 21:53 |
| clarkb | oh also we should double ceck that 9 routers won't need a quota bump (it shouldn't iirc bceause i asked for 10 and got them) | 21:54 |
| fungi | we promise we'll never use more routers than we have instances | 21:54 |
| anteaya | fungi: ha ha ha | 21:54 |
| clarkb | jeblair: mordred: fungi: another thing to consider is shifting load to west | 21:54 |
| jeblair | except it's not really the virtual router that's overloaded, it's the host upon which the virtual router runs that's overloaded | 21:54 |
| clarkb | so add another 5 routers there | 21:54 |
| sdague | mordred: dox question, how do you envision target setting for different things like zookeeper vs. mysql | 21:54 |
| clarkb | jeblair: mordred fungi: then halve the resources on our existing 5 networks | 21:54 |
| clarkb | mordred: any idea if that is feasible? | 21:54 |
| mordred | sdague: similar to tox - -epy27-ish, I think | 21:55 |
| jeblair | mordred: can we attach to multiple public networks? | 21:55 |
| mordred | jeblair: I do not know - worth checking? | 21:55 |
| *** dane_leblanc has quit IRC | 21:55 | |
| clarkb | jeblair: no I think there is only one public network in theat cloud | 21:55 |
| clarkb | moving back into west is something we should be doing regardless right? | 21:55 |
| mordred | clarkb: each of our subnets/routers presents a public network | 21:55 |
| jeblair | mordred: because using multiple virtual routers (which we know will be on different physical hosts) actually would help with this problem. | 21:55 |
| clarkb | mordred: but its just Ext-Net they hook into | 21:55 |
| clarkb | which is some arbitrary thing we have no insight into aiui | 21:56 |
| mordred | jeblair: yeah- it would be an interesting thing to try - it would CERTAINLY mean adding neutron awareness to nodepool | 21:56 |
| jeblair | mordred: and we don't actually care that we would NAT-out through different ips | 21:56 |
| jeblair | mordred: (until we use afs, then we might care; we'd at least have to think harder about it) | 21:56 |
| mordred | jeblair: but AFS will also solve the problem | 21:56 |
| *** dims has joined #openstack-infra | 21:56 | |
| jeblair | mordred: udp ftw? :) | 21:56 |
| clarkb | I do like the idea of splitting into west as part of this rather than doubling our network/router count in east | 21:56 |
| clarkb | because we get more redundancy that way | 21:56 |
| jeblair | clarkb: yes; are they ready for that? | 21:57 |
| clarkb | jeblair: I don't know | 21:57 |
| sdague | mordred: ok, it seemed like there was only 1 prep section in the yaml | 21:57 |
| mordred | sdague: I do want to make sure we can sanely a) do daily simple things easily and b) express slightly more complex things like "I want a zookeeper env, I want a mysql env, I want to run py27 workload on each" | 21:57 |
| mordred | sdague: I think flaper87|afk and Shrews are poking at that at the moment perhaps | 21:57 |
| sdague | mordred: sure | 21:57 |
| sdague | ok | 21:57 |
| sdague | I'm going to play with this a little bit tomorrow to figure out if this is the right seed element for nova functional tests | 21:58 |
| sdague | I have a couple of good use cases for functional tests we should have, and am going to figure out what infrastructure we need to actually tackle them | 21:58 |
| *** emagana has joined #openstack-infra | 21:59 | |
| clarkb | mordred: who should I/we ask about moving into west? | 21:59 |
| jeblair | sdague: i'm very interested and excited about the dox work, but if we can avoid making functional testing depend on it, that would be swell | 21:59 |
| clarkb | mordred: is that ulf? | 21:59 |
| *** maxbit has quit IRC | 21:59 | |
| *** tgohad has quit IRC | 22:00 | |
| jeblair | sdague: how do you think it might help nova func testing? | 22:00 |
| mordred | clarkb: ulf is certainly a good person to ask | 22:00 |
| *** datsun180b has quit IRC | 22:00 | |
| sdague | jeblair: mostly, it means you could run real services on a laptop, instead of requiring a vm, and not muck everything else up | 22:01 |
| *** homeless has quit IRC | 22:01 | |
| clarkb | sdague: I don't know if yo ucaught the discussion yesterday but I will continue to use VMs | 22:01 |
| *** eharney has quit IRC | 22:01 | |
| clarkb | sdague: docker isn't a good sandbox env imo | 22:01 |
| clarkb | it solves other problems | 22:01 |
| sdague | clarkb: that's fair | 22:01 |
| *** homeless has joined #openstack-infra | 22:02 | |
| sdague | I just want to play with a couple of different approaches here to figure out what's actually going to be helpful for people to run and debug | 22:02 |
| *** dims has quit IRC | 22:03 | |
| sdague | anyway, there will be some exploration here for a bit to come up with a workable model | 22:03 |
| mordred | yup | 22:03 |
| mordred | that's my POV at the moment too | 22:03 |
| *** dims has joined #openstack-infra | 22:03 | |
| *** marcoemorais has joined #openstack-infra | 22:03 | |
| *** wenlock has quit IRC | 22:03 | |
| mordred | folks in the world have done things that are worth poking at - they may solve problems, they may not | 22:03 |
| *** emagana has quit IRC | 22:04 | |
| jeblair | mordred: what's the docker in docker situation like? | 22:04 |
| *** sarob has quit IRC | 22:04 | |
| *** Sukhdev has joined #openstack-infra | 22:05 | |
| *** ZZelle_ has quit IRC | 22:05 | |
| *** jpich has joined #openstack-infra | 22:05 | |
| mordred | jeblair: I do not know - I'd imagine it's on par with whatever lxc in lxc is like? | 22:06 |
| jeblair | because i also worry about the test infrastructure affecting test results, so i'm not certain we'd want to run docker in ci | 22:06 |
| clarkb | jeblair: that was actually how the stuff I asked about yesterday came up in my head | 22:07 |
| jeblair | sdague: oh so this is for zookeeper? | 22:07 |
| clarkb | I was thinking about how our sudo checks would potentially change | 22:07 |
| jeblair | cause i mean, we added sudo support to deal with this | 22:07 |
| clarkb | and went down the rabbit hole | 22:07 |
| jeblair | why don't we just install zookeeper when running the nova unit tests? | 22:07 |
| *** sarob has joined #openstack-infra | 22:08 | |
| clarkb | jeblair: we already install it everywhere | 22:08 |
| mordred | jeblair: we can totally do that ... the question is, how does that translate to something a dev can easily reproduce locally | 22:08 |
| clarkb | (literally everywhere, https://review.openstack.org/#/c/119936/ addresses that) | 22:08 |
| *** dims has quit IRC | 22:08 | |
| mordred | jeblair: one of the nice things about tox is that the thing we run in CI can also be the thing the dev runs locally | 22:08 |
| jeblair | sdague: wait, then what was the problem you mentioned on the thread? | 22:09 |
| clarkb | jeblair: I think it was client bindings | 22:09 |
| clarkb | which aren't necessary aiui | 22:09 |
| clarkb | harlowja: ^ | 22:09 |
| jeblair | mordred: except that i don't know that we want to use containers in CI | 22:10 |
| mordred | jeblair: I don't know that we want to do that either | 22:10 |
| jeblair | mordred: i think people have have gotten that impression from that thread :( | 22:11 |
| mordred | jeblair: I don't know that we _don't_ ... I feel there is a ton to learn before making a concrete suggestion in either direction | 22:11 |
| mordred | jeblair: nod. I'll follow up | 22:11 |
| mordred | my main focus with dox is honestly dev workstation | 22:11 |
| jeblair | 22:08 < mordred> jeblair: one of the nice things about tox is that the thing we run in CI can also be the thing the dev runs locally | 22:11 |
| mordred | yes | 22:11 |
| jeblair | mordred: i'm having trouble reconciling those two :( | 22:11 |
| mordred | I would love it if we can do a thing that would get us closer to having the same stuff run in both places | 22:12 |
| mordred | but if we're sudo installing various things on unittest nodes before tests, which makes sense | 22:12 |
| *** stevemar has quit IRC | 22:12 | |
| mordred | then we're a step away from tox being the encapsulation of what's running on the dev laptop already | 22:12 |
| mordred | because there are things that are expressed in the puppet or the jenkins jobs taht are not expressed in teh tox.ini | 22:13 |
| sdague | clarkb: the client bindings are still required | 22:13 |
| *** miqui has joined #openstack-infra | 22:13 | |
| sdague | there is an alternate pure python set of bindings that maybe you could port the code to | 22:13 |
| mordred | _maybe_ an answer to that is just to also express those things ina docker snippet so that there is an easy way for a dev to run close to the same thing locally | 22:13 |
| sdague | but no one is signed up for that | 22:13 |
| jeblair | sdague: what needs to happen for the zookeeper tests to run? | 22:13 |
| clarkb | sdague: I thought they had ported that I guess I was mistaken | 22:13 |
| sdague | clarkb: nope, the interface is different | 22:14 |
| anteaya | zaro where are we with these changes? https://review.openstack.org/#/q/status:open+project:openstack-infra/gerrit+branch:openstack/2.8.4+topic:ModifyAccount,n,z | 22:14 |
| sdague | jeblair: we need to install the python-zookeeper module | 22:14 |
| sdague | which is all C code | 22:14 |
| jeblair | clarkb: and that's not the thing you say is installed everywhere already? | 22:15 |
| clarkb | jeblair: no zookeeper the server is installed already | 22:15 |
| clarkb | jeblair: and that was installed to test the tooz stuff which is the python native lib | 22:15 |
| jeblair | sdague: no-site-packages will prevent us from using python-zookeeper if it's installed anyway, right? | 22:16 |
| clarkb | jeblair: correct. | 22:16 |
| clarkb | I think what sdague really needs is the -dev package needed to link against when pip installs | 22:16 |
| anteaya | who would know how close hpcloud is to the tip of master? | 22:16 |
| jeblair | clarkb: yeah, that was my next question | 22:16 |
| jeblair | clarkb: because pip should download and compile it, right? | 22:16 |
| clarkb | jeblair: yup | 22:17 |
| jeblair | clarkb: but the -dev package is not installed | 22:17 |
| jeblair | ? | 22:17 |
| clarkb | ya I think that is the issue | 22:17 |
| mordred | oh,well, installing -dev packages on hosts is pretty easy | 22:17 |
| jeblair | clarkb, sdague: so we can add the -dev package to the slave manifest | 22:17 |
| clarkb | libzookeeper-mt-dev is proably what we want | 22:18 |
| jeblair | yeah, i'm not trying to rain on anyone's parade here; i'm just trying to minimize the dependency chain because we have quite long enough chains as it is :) | 22:18 |
| *** jgrimm is now known as zz_jgrimm | 22:18 | |
| mordred | jeblair: but chains are sexy | 22:19 |
| jeblair | so i'd rather not see "we need docker in order to test zookeeper" when it's clearly not the case (regardless of whether docker would make testing zookeeper easier in some situations) | 22:19 |
| jeblair | mordred: i got that from the thread too | 22:19 |
| mordred | jeblair: yah. I do not think we need docker to test anything - we have a cloud | 22:20 |
| *** jmeridth has joined #openstack-infra | 22:20 | |
| *** dimtruck is now known as zz_dimtruck | 22:21 | |
| jeblair | mordred: right, and we decided a while ago not to re-use nodes for both reproducibility and security purposes | 22:22 |
| jeblair | mordred: and docker (ie, linux containers) aren't secure sandboxes, so i'd expect us to continue to spin up/destroy nodes at least as long as that was the case (things are apparently improving there) | 22:23 |
| jeblair | (regardless of whether we _also_ ran docker on them) | 22:23 |
| *** emagana has joined #openstack-infra | 22:23 | |
| *** ociuhandu has joined #openstack-infra | 22:23 | |
| mordred | yes | 22:23 |
| mordred | I completely agree | 22:24 |
| jeblair | mordred: it seems like it's the _specification_ that's important here... | 22:24 |
| fungi | i thought the argument was that (some) devs didn't want python-zookeeper in test-requirements.txt because it would require they install zookeeper so that pip would be able to compile the bindings | 22:24 |
| mordred | I think that if we use docker in our gate at any point in time, we will still want single use nodes | 22:24 |
| mordred | I think fungi's thing is the cruz | 22:24 |
| mordred | it's not about zookeeper in the gate | 22:24 |
| jeblair | fungi: thank you :) | 22:24 |
| mordred | it's about zookeeper on dev laptops | 22:24 |
| *** mwagner_lap has joined #openstack-infra | 22:24 | |
| mordred | and dealing with that | 22:24 |
| mordred | especially for folks who do things like run osx | 22:24 |
| clarkb | mordred: docker doesn't solve osx iether... I mean we can pretend I guess | 22:25 |
| jerryz | clarkb: is http backend option for zuul merger available now? i am worried that china unicom blocking ssh port would affect zuul in china. | 22:25 |
| fungi | so ideally there would be an "optional" version of test-requirements.txt for things which are opportunistically tested but which some devs may not want to install the system prerequisites | 22:25 |
| mordred | jeblair: one of the (admitedly minor) wins we could get, is that with docker image layers, we can, like we do with devstack and git, pre-cache all or almost all of it in the local cache during the prep step | 22:26 |
| clarkb | jerryz: I don't think that change has merged | 22:26 |
| clarkb | jerryz: it needs additional testing and i haven't had time to write it because it will require new features in the test framework | 22:26 |
| fungi | jerryz: also, did that solve the lack of gerrit stream-events via http? | 22:26 |
| mordred | jeblair: and then the devs can use the _same_ image locally, also with caching ... but this is about 100 steps in the future with a ton of viability questions | 22:26 |
| jerryz | fungi: yeah. | 22:26 |
| fungi | interesting | 22:27 |
| clarkb | my change doesn't | 22:27 |
| anteaya | jerryz: you aren't part of an ibm ci group are you? | 22:27 |
| clarkb | you still need ssh zuul to gerrit | 22:27 |
| jerryz | anteaya: no | 22:27 |
| openstackgerrit | Emilien Macchi proposed a change to stackforge/dox: First implementation of Puppet unit testing https://review.openstack.org/119943 | 22:27 |
| *** emagana has quit IRC | 22:27 | |
| anteaya | jerryz: okay thanks | 22:27 |
| ianw | crinkle: you mentioned the release of https://github.com/puppetlabs/puppetlabs-postgresql/releases was due last week, did that not happen? | 22:28 |
| jeblair | mordred: what are you thoughts about clarkb's point about osx? | 22:28 |
| nibalizer | ianw: i believe that master is broken so they don't feel comfortable releasing right now | 22:28 |
| clarkb | jeblair: there is apparently a thing in osx that will run docker in a linux vm for you | 22:28 |
| nibalizer | but she can fill in the details | 22:28 |
| openstackgerrit | A change was merged to openstack-infra/config: Reduce hpcloud-b1 and b2 usage to 0 https://review.openstack.org/119933 | 22:28 |
| clarkb | jeblair: which sort of ends up solving the problem in the most round about way :) | 22:29 |
| nibalizer | clarkb: lots of people use the boot2docker vm in various hypervisors | 22:29 |
| fungi | that seems like a crazy situation | 22:29 |
| *** emagana has joined #openstack-infra | 22:30 | |
| fungi | people using containers to avoid hypervisor overhead, causing people to use a particular container manager, causing people who run platforms with no container support to run said containers in a vm under a hypervisor... | 22:30 |
| jerryz | clarkb: ok. we will figure it out. We have been forced to be experts on by passing the GFW since long ago. | 22:30 |
| *** amcrn_ has joined #openstack-infra | 22:30 | |
| jeblair | mordred: so there's also the uncertainty around how containers might impact the tests themselves, which i admit is totally fud now, except that it might have an impact on cinder, and it might have an impact if we start testing docker itself. | 22:31 |
| jeblair | mordred: that's just something to keep in mind as we explore | 22:31 |
| mordred | jeblair: yes indeed. | 22:31 |
| nibalizer | fungi: but its all okay right because vmware is fasssssst | 22:32 |
| mordred | jeblair: so, I think the osx thing is not an issue - osx people seem very comfortable with docker in general via whatever that thing is | 22:32 |
| jeblair | mordred: wow :) | 22:32 |
| mordred | jeblair: and the other thing - I don't really think this has any place in integration/devstack | 22:32 |
| *** amcrn has quit IRC | 22:32 | |
| jeblair | mordred: but it's being considered for functional testing | 22:32 |
| mordred | but yeah - I mean, basically there is a really nice potential workflow and a TON of questions | 22:32 |
| *** cdent has quit IRC | 22:33 | |
| jeblair | mordred: which is like devstack but with less stack. | 22:33 |
| *** paulrad has joined #openstack-infra | 22:33 | |
| mordred | yup | 22:33 |
| sdague | the right answer might be to refactor devstack to do dev env setup and not just service setup, as much of the logic is already captured there | 22:34 |
| sdague | and the run isolation could be determined external | 22:34 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Trim jenkins::slave package installations further https://review.openstack.org/119936 | 22:34 |
| ianw | nibalizer: you mean the ci failures? | 22:34 |
| jeblair | sdague: yeah, i think that gets us to functional testing most quickly (is a good idea in general anyway) and doesn't prevent any future work in this area | 22:35 |
| nibalizer | ianw: yea, plus beaker failures too i think | 22:35 |
| nibalizer | Hunner: maybe knows | 22:35 |
| sdague | anyway, I need to go play with some power tools for a bit, and do non virtual hacking before dinner. Talk to folks tomorrow. | 22:35 |
| mordred | local on-laptop repeatability and the way that the caching works is the nicest part | 22:35 |
| mordred | sdague: enjoy! | 22:35 |
| *** paulrad has quit IRC | 22:36 | |
| *** bhuvan has quit IRC | 22:36 | |
| *** paulrad has joined #openstack-infra | 22:36 | |
| jeblair | mordred: yeah, it's mapping that to CI that i'm concerned about; i'm not sure we're going to get anything from docker and so am not excited about running it in ci; it seems to make the environment more complex than needed | 22:36 |
| clarkb | jeblair: except clearly this is the future so we must use it >_> | 22:37 |
| clarkb | that must be my cue to go sort out apartment situation. back later | 22:37 |
| *** tsg has joined #openstack-infra | 22:37 | |
| *** bhuvan has joined #openstack-infra | 22:38 | |
| *** tgohad has joined #openstack-infra | 22:39 | |
| Hunner | ianw: Yeah, beaker tests had some sticky bits when changing the port from one value to another on debian platforms, and we couldn't figure it out by last week :( | 22:39 |
| Hunner | Err, the tests were fine. It's just the module and how the debian init scripts work that was the issue | 22:39 |
| *** tgohad__ has joined #openstack-infra | 22:39 | |
| ianw | Hunner: is the failure in https://travis-ci.org/puppetlabs/puppetlabs-postgresql/jobs/34741310 fixed? that seems to have been breaking since "strict_variables" in https://github.com/puppetlabs/puppetlabs-postgresql/pulls | 22:40 |
| *** paulrad has quit IRC | 22:40 | |
| *** tsg has quit IRC | 22:41 | |
| *** tgohad has quit IRC | 22:42 | |
| *** sarob has quit IRC | 22:43 | |
| *** sarob has joined #openstack-infra | 22:44 | |
| jogo | sdague: I think I have an os-loganalyze bug | 22:44 |
| jogo | sdague: where do I File it | 22:44 |
| *** wenlock has joined #openstack-infra | 22:45 | |
| ianw | Hunner: "rake spec" -> "170 examples, 115 failures" ... so clearly it needs more setup than clone, run :( | 22:45 |
| *** skelpter1 has quit IRC | 22:46 | |
| *** gokrokve has quit IRC | 22:48 | |
| *** bknudson has quit IRC | 22:49 | |
| *** tomoe_ has joined #openstack-infra | 22:49 | |
| *** dmsimard is now known as dmsimard_away | 22:49 | |
| Hunner | ianw: https://github.com/puppetlabs/puppetlabs-postgresql/pull/497 so I'll see if that fixes the unit tests | 22:49 |
| *** asettle has quit IRC | 22:51 | |
| jogo | sdague: https://bugs.launchpad.net/openstack-ci/+bug/1367021 | 22:52 |
| uvirtbot | Launchpad bug 1367021 in openstack-ci "os-loganalyze incorrectly rendering logs" [Undecided,New] | 22:52 |
| *** sarob has quit IRC | 22:53 | |
| jhesketh | Morning | 22:54 |
| anteaya | morning jhesketh | 22:55 |
| *** marcoemorais has quit IRC | 22:55 | |
| *** marcoemorais has joined #openstack-infra | 22:55 | |
| anteaya | I again feel we should have a fake user morning in the channel so tab complete will work | 22:55 |
| anteaya | but they we would get morning: jhesketh | 22:55 |
| *** paulrad has joined #openstack-infra | 22:56 | |
| *** marcoemorais has quit IRC | 22:56 | |
| *** marcoemorais has joined #openstack-infra | 22:56 | |
| crinkle | ianw: postgresql did not happen, we had trouble with jenkins, hoping for this week | 22:56 |
| crinkle | ianw: sorry :( | 22:56 |
| openstackgerrit | Elizabeth K. Joseph proposed a change to openstack-infra/publications: Update slides for Fossetcon https://review.openstack.org/118918 | 22:57 |
| harlowja | clarkb seems ok, how does one move to using a thick slave? | 22:58 |
| clarkb | harlowja you are already using them | 22:59 |
| *** dustins has quit IRC | 22:59 | |
| harlowja | cool | 22:59 |
| harlowja | thx :) | 22:59 |
| *** skelpter has joined #openstack-infra | 22:59 | |
| *** tomoe_ has quit IRC | 23:01 | |
| *** amcrn_ is now known as amcrn | 23:01 | |
| *** tomoe_ has joined #openstack-infra | 23:01 | |
| *** emagana has quit IRC | 23:02 | |
| *** emagana has joined #openstack-infra | 23:02 | |
| *** alexpilotti has quit IRC | 23:02 | |
| *** pcrews has quit IRC | 23:03 | |
| *** skelpter has quit IRC | 23:03 | |
| *** marcoemorais1 has joined #openstack-infra | 23:04 | |
| *** _buzz has quit IRC | 23:04 | |
| *** atiwari has quit IRC | 23:05 | |
| *** pcrews has joined #openstack-infra | 23:05 | |
| *** marcoemorais1 has quit IRC | 23:06 | |
| *** _buzz has joined #openstack-infra | 23:06 | |
| *** marcoemorais1 has joined #openstack-infra | 23:06 | |
| *** emagana has quit IRC | 23:06 | |
| *** virmitio has quit IRC | 23:07 | |
| *** marcoemorais has quit IRC | 23:08 | |
| *** flaviof_zzz has joined #openstack-infra | 23:08 | |
| *** dmsimard_away is now known as dmsimard | 23:09 | |
| *** emagana has joined #openstack-infra | 23:09 | |
| *** wenlock has quit IRC | 23:09 | |
| *** signed8bit has quit IRC | 23:12 | |
| fungi | jeblair: regarding your comment on 110730,2 about layout-dev.yaml being a fit, i based that on the fact that you included review-dev.projects.yaml. in what ways do their inclusion/exclusion differ? maybe i'm still misunderstanding the purpose of the split after all... | 23:12 |
| *** Longgeek has quit IRC | 23:14 | |
| *** markmcclain has quit IRC | 23:14 | |
| jeblair | fungi: huh, well that should probably be consistent :) | 23:15 |
| ianw | Hunner: thanks :) | 23:15 |
| *** bswartz has joined #openstack-infra | 23:15 | |
| *** Sincler has quit IRC | 23:16 | |
| fungi | clarkb: the elasticsearch upgrade change seems not to have actually done anything on wiki.o.o (mediawiki is still reporting 1.1.1 present even though i restarted the service for good measure... digging deeper now) | 23:17 |
| *** penguinRaider has quit IRC | 23:17 | |
| clarkb | fungi: hrm, it should check if the deb exists and if not download, verify sha1, then install | 23:17 |
| fungi | ohhh... defunct puppet processes | 23:17 |
| fungi | since may | 23:18 |
| clarkb | wow | 23:18 |
| clarkb | and it uses the apt provider to determine if it needs to do any of those steps | 23:18 |
| *** bswartz has quit IRC | 23:18 | |
| *** bswartz has joined #openstack-infra | 23:18 | |
| fungi | someone ran 'puppet agent disable' (instead of --disable) and it was still hanging around in the process list | 23:19 |
| clarkb | whoops | 23:19 |
| fungi | hrm... though seems it was still actually applying updates. no outstanding delta | 23:20 |
| fungi | dpkg -l claims elasticsearch 1.3.2 is installed | 23:21 |
| *** yamamoto has quit IRC | 23:21 | |
| fungi | https://wiki.openstack.org/wiki/Special:Version disagrees | 23:21 |
| *** yamamoto has joined #openstack-infra | 23:21 | |
| clarkb | fungi: has it been restarted? | 23:21 |
| clarkb | the package maybe doesn't do that anymore | 23:22 |
| fungi | yeah, i manually restarted it | 23:22 |
| fungi | also restarted php5-fpm and apache2 again just for good measure | 23:22 |
| *** paulrad has quit IRC | 23:23 | |
| *** paulrad has joined #openstack-infra | 23:23 | |
| *** paulrad_ has joined #openstack-infra | 23:24 | |
| *** paulrad has quit IRC | 23:24 | |
| fungi | aha, though according to my terminal history when i first logged in ps showed 1.1.1 running and when i restarted the daemon ps showed it as 1.3.2 thereafter | 23:25 |
| *** yamamoto has quit IRC | 23:25 | |
| clarkb | oh good | 23:25 |
| *** yamamoto has joined #openstack-infra | 23:25 | |
| clarkb | but the wiki search is still broken? maybe we need to reindex again? | 23:25 |
| fungi | so yeah, neither puppet nor deb mainscripts restarted it automagically | 23:25 |
| *** craigbr has quit IRC | 23:25 | |
| fungi | i can reindex again, sure | 23:25 |
| *** sarob has joined #openstack-infra | 23:26 | |
| *** hemna is now known as hemna_ | 23:26 | |
| clarkb | ya I think Iremember that the es debs were not good debs in that they do not do the debian thing of restarting services now | 23:26 |
| fungi | rebuilding now | 23:26 |
| clarkb | they did in the past but "fixed" that behavior | 23:26 |
| fungi | s/mainscripts/maintscripts/ | 23:27 |
| *** gokrokve has joined #openstack-infra | 23:28 | |
| clarkb | btw Ifixed the issue with https://review.openstack.org/#/c/119936 so it passes jenkins now | 23:28 |
| fungi | clarkb: bingo! es upgrade followed by reindex seems to have been the golden ticket | 23:30 |
| *** tsg has joined #openstack-infra | 23:30 | |
| clarkb | woot | 23:30 |
| *** tgohad__ has quit IRC | 23:30 | |
| fungi | though strangely the mw version page still reports an older es | 23:30 |
| clarkb | fungi: odd | 23:31 |
| fungi | well, at this point the primary objective is achieved, so i'll close the bug | 23:31 |
| *** asettle has joined #openstack-infra | 23:32 | |
| *** tgohad has joined #openstack-infra | 23:32 | |
| *** tsg has quit IRC | 23:35 | |
| *** yamahata has quit IRC | 23:37 | |
| *** emagana has quit IRC | 23:39 | |
| *** luqas has quit IRC | 23:40 | |
| *** itzikb has joined #openstack-infra | 23:43 | |
| *** bdpayne has quit IRC | 23:44 | |
| *** arnaud has quit IRC | 23:44 | |
| *** amotoki_ has quit IRC | 23:44 | |
| *** luqas has joined #openstack-infra | 23:44 | |
| *** yaguang has joined #openstack-infra | 23:45 | |
| *** bdpayne has joined #openstack-infra | 23:45 | |
| *** jaypipes has quit IRC | 23:46 | |
| *** stevemar has joined #openstack-infra | 23:48 | |
| *** aysyd has quit IRC | 23:48 | |
| *** bhuvan has quit IRC | 23:48 | |
| *** weshay has joined #openstack-infra | 23:49 | |
| *** tomoe__ has joined #openstack-infra | 23:50 | |
| *** amotoki_ has joined #openstack-infra | 23:50 | |
| *** amotoki_ has quit IRC | 23:51 | |
| *** sarob_ has joined #openstack-infra | 23:52 | |
| *** gokrokve has quit IRC | 23:53 | |
| *** tomoe_ has quit IRC | 23:53 | |
| *** chuckC has quit IRC | 23:56 | |
| *** rmcall has quit IRC | 23:56 | |
| *** rfolco has quit IRC | 23:57 | |
| *** chuckC has joined #openstack-infra | 23:57 | |
| *** rmcall has joined #openstack-infra | 23:57 | |
| *** unicell has quit IRC | 23:59 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Add Python 3.4 and PyPy to Ubuntu Trusty slaves https://review.openstack.org/118859 | 23:59 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Add non-voting gate-git-review-python34 job https://review.openstack.org/118860 | 23:59 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Update StackForge documentation to recommend py34 https://review.openstack.org/118861 | 23:59 |
| *** chuckC has quit IRC | 23:59 | |
| *** paulrad_ has quit IRC | 23:59 | |
| *** dims has joined #openstack-infra | 23:59 | |
| *** dangers is now known as dangers_away | 23:59 | |
| *** paulrad has joined #openstack-infra | 23:59 | |
| *** _buzz_ has joined #openstack-infra | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
