*** aorourke_ has quit IRC | 00:00 | |
asselin | Thelo, I don't know what went wrong... | 00:03 |
---|---|---|
*** Swami has quit IRC | 00:03 | |
asselin | this is weird too: BadHTTPException: Error communicating with server[http://localhost:8080/] | 00:04 |
asselin | can you wget that url as nodepool user? | 00:04 |
Thelo | asselin: ok, thanks I will search more | 00:04 |
*** kzaitsev_mb has quit IRC | 00:04 | |
Thelo | no permission denied | 00:06 |
*** thorst has joined #openstack-infra | 00:07 | |
*** bharathm has quit IRC | 00:07 | |
Thelo | paste.openstack.org/show/483353/ | 00:07 |
*** bharathm has joined #openstack-infra | 00:08 | |
asselin | wrong url | 00:08 |
asselin | http://localhost:8080/ | 00:08 |
*** nelsnelson has joined #openstack-infra | 00:11 | |
Thelo | paste.openstack.org/show/483354/ | 00:12 |
Thelo | my bad | 00:12 |
*** zz_dimtruck is now known as dimtruck | 00:13 | |
asselin | in /var/lib/jenkins grep for 2f541bcd-a553-4614-9d61-ddc7d121d4aa. do you know where that ID is coming from? any of your config files? | 00:14 |
*** thorst has quit IRC | 00:15 | |
*** nelsnelson has quit IRC | 00:16 | |
Thelo | ./nodes/d-p-c-local_01-11/config.xml: <credentialsId>2f541bcd-a553-4614-9d61-ddc7d121d4aa</credentialsId> | 00:17 |
Thelo | from there | 00:17 |
Thelo | thats the node I am trying to ssh to | 00:17 |
openstackgerrit | Ramy Asselin proposed openstack-infra/system-config: Update third party docs link to published docs. https://review.openstack.org/265481 | 00:18 |
*** ayoung has quit IRC | 00:19 | |
asselin | Thelo, what do you mean by "node your trying to ssh to? | 00:19 |
asselin | can you provide the full path to that file? | 00:19 |
Thelo | asselin: d-p-c-local... is the node jenkins fails to ssh | 00:19 |
asselin | the crendetials should be on the jenkins master, which is not the d-p-c-local node | 00:20 |
*** baoli_ has quit IRC | 00:20 | |
Thelo | the full path is /var/lib/jenkins/nodes/d-p-c-local_01-11/config.xml ( on the jenkins master) | 00:21 |
*** ybathia has quit IRC | 00:21 | |
asselin | ok i see...this is not what I'm expecting | 00:21 |
asselin | there should be a credentials.xml file in /var/lib/jenkins | 00:22 |
Thelo | there is, and I filled the common.yaml with the id specified in that file | 00:22 |
*** bharathm has quit IRC | 00:24 | |
*** esker has joined #openstack-infra | 00:24 | |
*** bharathm has joined #openstack-infra | 00:24 | |
asselin | rerun puppet to be sure everything is up-to-date with your configuration file | 00:25 |
*** esker has quit IRC | 00:28 | |
openstackgerrit | Ramy Asselin proposed openstack-infra/puppet-openstackci: Remove contrib/README.md https://review.openstack.org/265483 | 00:29 |
Thelo | paste.openstack.org/show/483355/ | 00:30 |
Thelo | asselin: Same issue: should I restart nodepool/jenkins? | 00:31 |
clarkb | looking at fail rates on ovh and monasca, manilla, and ironic seem to fail the mostish | 00:32 |
asselin | Thelo, yes | 00:32 |
*** sabeen3 has quit IRC | 00:33 | |
clarkb | mtreinish: feature idea for the dashboard, compare pass/fail rates of specific jobs between clouds | 00:33 |
clarkb | mtreinish: I do not know how difficult that would be to do, but that would tell you if the job is just unreliable everywhree or specific to a single cloud | 00:33 |
Thelo | asselin: do I need to start them as a particular user? or root is fine? | 00:33 |
asselin | you need to be root, but when started as a service, they start as the user specified in the /etc/init.d/ file | 00:34 |
clarkb | hrm I guess if I click on a job I can sort of see that | 00:34 |
clarkb | does anyone know if there are job log links in the health dashborad? | 00:35 |
clarkb | sc68cal: mtreinish ^ | 00:35 |
*** Sukhdev has quit IRC | 00:36 | |
Thelo | asselin: cold it be because I created the node before changing the security things in jenkins? | 00:36 |
*** Ryan_Lane has joined #openstack-infra | 00:37 | |
Ryan_Lane | -_- I'm trying to add a plugin to bandit and seriously just can't figure out how | 00:38 |
clarkb | Ryan_Lane: I have little info on that other than to say its not flake8 | 00:38 |
Ryan_Lane | using setuptools and/or pbr is such a pain | 00:38 |
clarkb | Ryan_Lane: so the plugin system is different | 00:38 |
Ryan_Lane | basically it's telling me that I need to make a setup.py and install it via pip or something? | 00:38 |
asselin | Thelo, it could be... | 00:38 |
asselin | Thelo, out of curiosity, do you need security enabled? | 00:39 |
clarkb | Ryan_Lane: it may use entrypoints, if that is the case yes, you need to install it to the entrypoint so that it gets imported at runtime | 00:39 |
sc68cal | clarkb: not sure, but I don't think so | 00:39 |
clarkb | Ryan_Lane: you may be able to just copy pasta some code to the correctpath as a workaround | 00:39 |
*** Sukhdev has joined #openstack-infra | 00:39 | |
Ryan_Lane | this assumes a pretty good understanding of python | 00:39 |
*** alkhodos has quit IRC | 00:39 | |
Ryan_Lane | more than I have and I know python pretty well. it wouldn't hurt to have proper docs for this :( | 00:40 |
clarkb | ya readme confirms they use entrypoints | 00:40 |
Ryan_Lane | yeah. I don't know how that works | 00:40 |
*** sputnik13 has quit IRC | 00:40 | |
clarkb | Ryan_Lane: basically its creates an alias for modules, functions, or classes at some path | 00:40 |
Ryan_Lane | it's like the least often used thing for any python dev. it's something you setup once for a project and never do again. seems like an odd choice as the default method of including plugins | 00:40 |
clarkb | Ryan_Lane: so ifyou have mybandit.plugin.foo you alias bandit.plugins.foo to that | 00:41 |
*** salv-orlando has quit IRC | 00:41 | |
clarkb | Ryan_Lane: its sort of hte pythony way of doing plugins | 00:41 |
Thelo | asselin: no I dont | 00:41 |
mtreinish | clarkb: job links are the next step: https://review.openstack.org/264440 and https://review.openstack.org/264383 | 00:41 |
clarkb | mtreinish: oh cool, maybe I iwll just look at this closer next week then :) | 00:41 |
*** salv-orlando has joined #openstack-infra | 00:42 | |
mtreinish | and doing the comparison is a good idea, the data is all there, but I don't know what the ui would look like or how to write it | 00:42 |
asselin | Thelo, I suggest you try setting it up first w/o security...especially given the issues you're having. | 00:42 |
clarkb | Ryan_Lane: https://pythonhosted.org/setuptools/setuptools.html#dynamic-discovery-of-services-and-plugins are the python/setuptools docs | 00:42 |
mtreinish | I was doing similar things manually in the subunit2sql-graph tool, but that was all manual and static | 00:42 |
Thelo | asselin: so far I run a single node in node pool if I delete this slave in jenkins it will create a new one right? | 00:43 |
openstackgerrit | James E. Blair proposed openstack-infra/grafyaml: Add support for interval template type https://review.openstack.org/265487 | 00:43 |
clarkb | mtreinish: you have pass, fail, and percent columns, maybe add another colume for global fail percent | 00:43 |
asselin | Thelo, yes, that's what nodepool does, keeps nodes around according to your min and max set in your configuration | 00:43 |
Ryan_Lane | clarkb: I'm writing a plugin. is there any way for me to just have a plugins directory with the python code and either pass in some config or a commandline arg to say "hey, look in this location"? | 00:44 |
Thelo | asselin: So if I go to global security manaement then uncheck enable security is it enough? | 00:44 |
Ryan_Lane | or am I going to need to run some installer every time? | 00:44 |
jeblair | pabelanger: https://review.openstack.org/265487 for your evening's interntainment as well :) (that turned out to be a bit of a rabbit hole) | 00:44 |
asselin | Thelo, perhaps | 00:44 |
clarkb | Ryan_Lane: I think that you may have to run the installer each time, but I am not super familiar with the implementation and if there is a simpler way to work with it | 00:45 |
*** sridhar_ram has quit IRC | 00:45 | |
asselin | Thelo, I never disabled it...but I usuaully just set it up w/o security | 00:45 |
clarkb | Ryan_Lane: dstufft and/or lifeless may know | 00:45 |
mtreinish | clarkb: that'd probably be another query/rest call for each job but that actually shouldnt be too slow | 00:45 |
mtreinish | give me a min, I've had enough beer already to try some js | 00:45 |
*** sridhar_ram has joined #openstack-infra | 00:46 | |
clarkb | mtreinish: or even stdev from global | 00:46 |
Ryan_Lane | I get why it works this way (so that you can just install python packages or pip), but without proper docs this is like a middle finger to devs | 00:47 |
clarkb | Ryan_Lane: you want more docs in bandit or setuptools? | 00:47 |
Ryan_Lane | do you folks miss my rants? been a while since I had a good one in openstack :) | 00:47 |
Ryan_Lane | clarkb: bandit for how to do dev | 00:47 |
Ryan_Lane | for plugins | 00:47 |
Ryan_Lane | if it's going to use setuptools, that's fine, but linking to setuptool's docs isn't helpful | 00:47 |
Ryan_Lane | because it's like a book | 00:48 |
clarkb | ah well, bandit tends to ignore any of my advice so maybe I can't help much there, but dstufft and lifeless and Nakato seem pretty receptive to making setuptools easier to work with | 00:48 |
Ryan_Lane | seems bandit uses pbr | 00:48 |
clarkb | Ryan_Lane: pbr is unrelated to this (mostly) | 00:49 |
clarkb | its an upstream setuptools and pkg_resources utility that pbr happens to support | 00:49 |
Ryan_Lane | well, I'm trying to use bandit itself as an example | 00:49 |
Ryan_Lane | since it adds the entrypoints I need | 00:49 |
clarkb | your plugins do not need to use pbr, they can setup entry points with a vanilla setup.py | 00:49 |
jeblair | Ryan_Lane: sigmavirus24_awa may also be helpful. i mean, when he's not "awa". :) | 00:49 |
*** mtanino has quit IRC | 00:51 | |
*** ZZelle has quit IRC | 00:53 | |
jeblair | Ryan_Lane: but i _think_ what you would do is something like this in vanilla setup.py: http://paste.openstack.org/show/483356/ | 00:54 |
Ryan_Lane | then I do a pip install . ? | 00:55 |
jeblair | Ryan_Lane: yep | 00:55 |
clarkb | it is possible that bandit may need to be preinstalled or be a dep | 00:56 |
clarkb | not sure if entrypoints will write to a path that doens't already exist | 00:56 |
jeblair | i also don't know the answer to that | 00:56 |
*** tzn has joined #openstack-infra | 00:57 | |
jeblair | Ryan_Lane: oops, i truncated a line: http://paste.openstack.org/show/483357/ | 00:57 |
* Ryan_Lane nods | 00:57 | |
jeblair | Ryan_Lane: it's supposed to have a function name on the end | 00:57 |
*** rguillebert has joined #openstack-infra | 00:58 | |
*** markvoelker has quit IRC | 01:02 | |
openstackgerrit | James E. Blair proposed openstack-infra/grafyaml: Add support for interval template type https://review.openstack.org/265487 | 01:02 |
*** eil397 has quit IRC | 01:03 | |
Ryan_Lane | well, finally got that | 01:03 |
*** sridhar_ram has quit IRC | 01:04 | |
*** ujuc has joined #openstack-infra | 01:07 | |
*** ujuc has quit IRC | 01:07 | |
*** thorst has joined #openstack-infra | 01:12 | |
*** otter768 has joined #openstack-infra | 01:16 | |
*** hdd has quit IRC | 01:17 | |
*** FallenPegasus has joined #openstack-infra | 01:18 | |
*** ddieterly has quit IRC | 01:18 | |
*** thorst has quit IRC | 01:20 | |
*** otter768 has quit IRC | 01:21 | |
*** mriedem has joined #openstack-infra | 01:29 | |
*** jerryz has quit IRC | 01:33 | |
*** tzn has quit IRC | 01:33 | |
*** mriedem is now known as mriedem_away | 01:36 | |
*** dims_ has quit IRC | 01:36 | |
*** dims has joined #openstack-infra | 01:36 | |
*** esker has joined #openstack-infra | 01:38 | |
*** markvoelker has joined #openstack-infra | 01:40 | |
*** esker has quit IRC | 01:42 | |
*** bpokorny has quit IRC | 01:44 | |
mtreinish | clarkb: you can test this out locally: https://review.openstack.org/#/c/265494 | 01:44 |
mtreinish | but it'll be too slow in practice the extra api calls add too slow | 01:45 |
*** Sukhdev has quit IRC | 01:45 | |
mtreinish | I'll have to come up with a non-braindead way to get the data | 01:45 |
*** arxcruz has quit IRC | 01:45 | |
*** dimtruck is now known as zz_dimtruck | 01:47 | |
*** EricGonc_ has quit IRC | 01:48 | |
*** sabeen1 has joined #openstack-infra | 01:51 | |
*** hdd has joined #openstack-infra | 02:00 | |
*** harlowja_at_home has quit IRC | 02:00 | |
*** pickle_ has joined #openstack-infra | 02:03 | |
*** pickle_ has left #openstack-infra | 02:03 | |
*** daemontool has quit IRC | 02:04 | |
*** daemontool has joined #openstack-infra | 02:05 | |
*** asselin has quit IRC | 02:06 | |
*** daemontool has quit IRC | 02:07 | |
*** daemontool has joined #openstack-infra | 02:09 | |
*** zz_dimtruck is now known as dimtruck | 02:09 | |
*** daemontool has quit IRC | 02:11 | |
*** daemontool has joined #openstack-infra | 02:12 | |
*** esker has joined #openstack-infra | 02:14 | |
*** daemontool has quit IRC | 02:16 | |
*** thorst has joined #openstack-infra | 02:17 | |
*** daemontool has joined #openstack-infra | 02:17 | |
*** esker has quit IRC | 02:18 | |
*** ddieterly has joined #openstack-infra | 02:19 | |
*** rossella_s has quit IRC | 02:22 | |
*** rossella_s has joined #openstack-infra | 02:22 | |
*** FallenPegasus has quit IRC | 02:22 | |
*** ddieterly has quit IRC | 02:24 | |
*** thorst has quit IRC | 02:25 | |
*** dims has quit IRC | 02:37 | |
*** FallenPegasus has joined #openstack-infra | 02:37 | |
*** unicell has quit IRC | 02:41 | |
*** tzn has joined #openstack-infra | 02:49 | |
lifeless | Ryan_Lane: if the plugin system you are using is entry points based, you have to have the metadata it consults on disk in the python path (and that metadata is egg info / dist info files) | 02:52 |
lifeless | jeblair: clarkb: ^ | 02:52 |
lifeless | Ryan_Lane: since those files are created by setup.py, or included in wheels, you need to use your build system to create them, yes. | 02:52 |
*** daemontool has quit IRC | 02:54 | |
*** daemontool has joined #openstack-infra | 02:55 | |
*** daemontool has quit IRC | 02:56 | |
*** daemontool has joined #openstack-infra | 02:57 | |
*** daemontool has quit IRC | 03:00 | |
*** daemontool has joined #openstack-infra | 03:01 | |
*** bharathm has quit IRC | 03:02 | |
*** cburgess_ has joined #openstack-infra | 03:07 | |
*** notmyname_ has joined #openstack-infra | 03:09 | |
*** adreznec_ has joined #openstack-infra | 03:10 | |
*** tzn has quit IRC | 03:11 | |
*** rhe00 has quit IRC | 03:11 | |
*** odlD2 has quit IRC | 03:11 | |
*** dstanek has quit IRC | 03:11 | |
*** notmyname has quit IRC | 03:11 | |
*** changbl has quit IRC | 03:11 | |
*** lxsli has quit IRC | 03:11 | |
*** ajmiller has quit IRC | 03:11 | |
*** julim has quit IRC | 03:11 | |
*** masayukig has quit IRC | 03:11 | |
*** alex_xu has quit IRC | 03:11 | |
*** adreznec has quit IRC | 03:11 | |
*** persia has quit IRC | 03:11 | |
*** cburgess has quit IRC | 03:11 | |
*** Swanson has quit IRC | 03:11 | |
*** tonyb has quit IRC | 03:11 | |
*** mikal has quit IRC | 03:11 | |
*** nijaba has quit IRC | 03:11 | |
*** hrubi has quit IRC | 03:11 | |
*** crinkle has quit IRC | 03:11 | |
*** _fortis has quit IRC | 03:11 | |
*** dangers_away has quit IRC | 03:11 | |
*** mika has quit IRC | 03:11 | |
*** mkoderer has quit IRC | 03:11 | |
*** sgordon has quit IRC | 03:11 | |
*** flaper87 has quit IRC | 03:11 | |
*** beisner has quit IRC | 03:11 | |
*** andrearosa has quit IRC | 03:11 | |
*** dulek has quit IRC | 03:11 | |
*** tcammann_ has quit IRC | 03:11 | |
*** notmyname_ is now known as notmyname | 03:11 | |
*** nelsnelson has joined #openstack-infra | 03:12 | |
*** rhallisey has quit IRC | 03:16 | |
*** otter768 has joined #openstack-infra | 03:17 | |
*** ajmiller has joined #openstack-infra | 03:19 | |
*** ddieterly has joined #openstack-infra | 03:20 | |
*** dstanek has joined #openstack-infra | 03:22 | |
*** jerryz has joined #openstack-infra | 03:22 | |
*** tzn has joined #openstack-infra | 03:22 | |
*** rhe00 has joined #openstack-infra | 03:22 | |
*** odlD2 has joined #openstack-infra | 03:22 | |
*** andrearosa has joined #openstack-infra | 03:22 | |
*** changbl has joined #openstack-infra | 03:22 | |
*** lxsli has joined #openstack-infra | 03:22 | |
*** julim has joined #openstack-infra | 03:22 | |
*** masayukig has joined #openstack-infra | 03:22 | |
*** alex_xu has joined #openstack-infra | 03:22 | |
*** Swanson has joined #openstack-infra | 03:22 | |
*** mikal has joined #openstack-infra | 03:22 | |
*** nijaba has joined #openstack-infra | 03:22 | |
*** hrubi has joined #openstack-infra | 03:22 | |
*** crinkle has joined #openstack-infra | 03:22 | |
*** _fortis has joined #openstack-infra | 03:22 | |
*** dangers_away has joined #openstack-infra | 03:22 | |
*** mika has joined #openstack-infra | 03:22 | |
*** mkoderer has joined #openstack-infra | 03:22 | |
*** sgordon has joined #openstack-infra | 03:22 | |
*** flaper87 has joined #openstack-infra | 03:22 | |
*** beisner has joined #openstack-infra | 03:22 | |
*** dulek has joined #openstack-infra | 03:22 | |
*** tcammann_ has joined #openstack-infra | 03:22 | |
*** tzn has quit IRC | 03:22 | |
*** otter768 has quit IRC | 03:22 | |
*** persia has joined #openstack-infra | 03:22 | |
*** thorst has joined #openstack-infra | 03:22 | |
*** ddieterly has quit IRC | 03:25 | |
*** tonyb has joined #openstack-infra | 03:25 | |
*** ddieterly has joined #openstack-infra | 03:26 | |
*** esker has joined #openstack-infra | 03:26 | |
*** yamahata_ has quit IRC | 03:29 | |
*** thorst has quit IRC | 03:30 | |
*** esker has quit IRC | 03:30 | |
*** baoli has joined #openstack-infra | 03:34 | |
*** rguillebert has quit IRC | 03:37 | |
*** EricGonczer_ has joined #openstack-infra | 03:42 | |
*** mudassirlatif has quit IRC | 03:42 | |
*** kashyap has quit IRC | 03:42 | |
*** sabeen1 has quit IRC | 03:46 | |
*** markvoelker has quit IRC | 03:47 | |
*** sabeen1 has joined #openstack-infra | 03:47 | |
*** EricGonczer_ has quit IRC | 03:47 | |
*** Qiming has quit IRC | 03:55 | |
*** FallenPegasus has quit IRC | 04:01 | |
*** dimtruck is now known as zz_dimtruck | 04:07 | |
*** salv-orl_ has joined #openstack-infra | 04:09 | |
*** salv-orlando has quit IRC | 04:12 | |
*** tzn has joined #openstack-infra | 04:19 | |
openstackgerrit | Merged openstack/requirements: Updated from generate-constraints https://review.openstack.org/263592 | 04:22 |
*** daemontool_ has joined #openstack-infra | 04:28 | |
*** daemontool has quit IRC | 04:28 | |
*** thorst has joined #openstack-infra | 04:30 | |
*** baoli has quit IRC | 04:32 | |
*** thorst has quit IRC | 04:34 | |
*** gyee has quit IRC | 04:45 | |
*** markvoelker has joined #openstack-infra | 04:47 | |
*** tzn has quit IRC | 04:52 | |
*** markvoelker has quit IRC | 04:53 | |
*** ddieterly has quit IRC | 04:54 | |
*** fawadkhaliq has joined #openstack-infra | 04:57 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add DB API method to get failure rate for jobs by run_metadata https://review.openstack.org/265507 | 05:03 |
*** Keedya has joined #openstack-infra | 05:11 | |
*** Keedya has quit IRC | 05:13 | |
*** otter768 has joined #openstack-infra | 05:18 | |
*** otter768 has quit IRC | 05:22 | |
*** thorst has joined #openstack-infra | 05:32 | |
*** daemontool_ has quit IRC | 05:38 | |
*** daemontool has joined #openstack-infra | 05:39 | |
*** thorst has quit IRC | 05:39 | |
*** daemontool has quit IRC | 05:40 | |
*** daemontool has joined #openstack-infra | 05:40 | |
*** salv-orl_ has quit IRC | 05:41 | |
*** salv-orlando has joined #openstack-infra | 05:42 | |
*** FallenPegasus has joined #openstack-infra | 05:44 | |
openstackgerrit | Merged openstack/requirements: Add kosmos to projects.txt https://review.openstack.org/263318 | 05:51 |
*** unicell has joined #openstack-infra | 05:55 | |
*** [1]Thelo has joined #openstack-infra | 05:55 | |
*** ddieterly has joined #openstack-infra | 05:57 | |
*** Thelo has quit IRC | 05:57 | |
*** [1]Thelo is now known as Thelo | 05:57 | |
*** tzn has joined #openstack-infra | 05:58 | |
*** ddieterly has quit IRC | 06:02 | |
*** bharathm has joined #openstack-infra | 06:03 | |
*** aopincar has joined #openstack-infra | 06:04 | |
*** bharathm has quit IRC | 06:07 | |
*** markvoelker has joined #openstack-infra | 06:14 | |
*** aopincar has quit IRC | 06:16 | |
*** markvoelker has quit IRC | 06:18 | |
*** piet has joined #openstack-infra | 06:19 | |
*** rossella_s has quit IRC | 06:22 | |
*** rossella_s has joined #openstack-infra | 06:22 | |
*** tobiash has quit IRC | 06:25 | |
*** vgridnev has joined #openstack-infra | 06:26 | |
*** tobiash has joined #openstack-infra | 06:27 | |
*** aopincar has joined #openstack-infra | 06:28 | |
*** mudassirlatif has joined #openstack-infra | 06:30 | |
*** FallenPegasus has quit IRC | 06:31 | |
*** FallenPegasus has joined #openstack-infra | 06:32 | |
*** tzn has quit IRC | 06:32 | |
*** piet has quit IRC | 06:36 | |
*** thorst has joined #openstack-infra | 06:37 | |
*** mudassirlatif has quit IRC | 06:39 | |
*** yamahata_ has joined #openstack-infra | 06:40 | |
*** toabctl has quit IRC | 06:43 | |
*** aopincar has quit IRC | 06:43 | |
*** jerryz has quit IRC | 06:44 | |
*** toabctl has joined #openstack-infra | 06:44 | |
*** thorst has quit IRC | 06:45 | |
*** mudassirlatif has joined #openstack-infra | 06:46 | |
*** yamahata_ has quit IRC | 06:49 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/265516 | 06:53 |
*** daemontool has quit IRC | 06:55 | |
*** ddieterly has joined #openstack-infra | 06:58 | |
*** ddieterly has quit IRC | 07:03 | |
*** _nadya_ has joined #openstack-infra | 07:13 | |
*** yamahata has joined #openstack-infra | 07:14 | |
*** FallenPegasus has quit IRC | 07:17 | |
*** e0ne has joined #openstack-infra | 07:17 | |
*** _nadya_ has quit IRC | 07:18 | |
*** _nadya_ has joined #openstack-infra | 07:24 | |
*** e0ne has quit IRC | 07:24 | |
*** grassass has quit IRC | 07:27 | |
*** mrmartin has joined #openstack-infra | 07:37 | |
*** thorst has joined #openstack-infra | 07:42 | |
*** tzn has joined #openstack-infra | 07:49 | |
*** thorst has quit IRC | 07:50 | |
*** tzn has quit IRC | 07:53 | |
*** ddieterly has joined #openstack-infra | 07:59 | |
*** fawadkhaliq has quit IRC | 08:01 | |
*** mudassirlatif has quit IRC | 08:02 | |
*** ddieterly has quit IRC | 08:03 | |
*** kdas_ has quit IRC | 08:04 | |
*** aopincar has joined #openstack-infra | 08:05 | |
*** _nadya_ has quit IRC | 08:05 | |
*** hdd has quit IRC | 08:06 | |
*** mrmartin has quit IRC | 08:09 | |
*** markvoelker has joined #openstack-infra | 08:14 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix setup_commit_message for proposal bot https://review.openstack.org/265517 | 08:15 |
*** AJaeger has joined #openstack-infra | 08:15 | |
*** sabeen1 has quit IRC | 08:16 | |
*** mrmartin has joined #openstack-infra | 08:16 | |
*** mrmartin has quit IRC | 08:18 | |
*** markvoelker has quit IRC | 08:19 | |
AJaeger | FYI, today's translation import failed in some cases, should be fixed by 265517 ^ | 08:19 |
*** aopincar has quit IRC | 08:29 | |
*** aopincar has joined #openstack-infra | 08:33 | |
*** AJaeger has quit IRC | 08:39 | |
*** aopincar has quit IRC | 08:42 | |
*** thorst has joined #openstack-infra | 08:47 | |
*** thorst has quit IRC | 08:55 | |
*** yamahata has quit IRC | 08:56 | |
*** tzn has joined #openstack-infra | 08:57 | |
*** ddieterly has joined #openstack-infra | 08:59 | |
*** tzn has quit IRC | 09:02 | |
*** ddieterly has quit IRC | 09:04 | |
*** fawadkhaliq has joined #openstack-infra | 09:10 | |
*** otter768 has joined #openstack-infra | 09:20 | |
*** otter768 has quit IRC | 09:24 | |
*** mrmartin has joined #openstack-infra | 09:32 | |
*** uberjay has quit IRC | 09:47 | |
*** uberjay has joined #openstack-infra | 09:47 | |
*** thorst has joined #openstack-infra | 09:52 | |
*** tzn has joined #openstack-infra | 09:58 | |
*** thorst has quit IRC | 10:00 | |
*** ddieterly has joined #openstack-infra | 10:00 | |
*** tzn has quit IRC | 10:03 | |
*** ddieterly has quit IRC | 10:05 | |
*** mrmartin has quit IRC | 10:06 | |
*** kdas_ has joined #openstack-infra | 10:06 | |
*** salv-orl_ has joined #openstack-infra | 10:09 | |
*** salv-orlando has quit IRC | 10:12 | |
*** kdas_ has quit IRC | 10:12 | |
*** Daisy has joined #openstack-infra | 10:14 | |
*** markvoelker has joined #openstack-infra | 10:15 | |
*** mrmartin has joined #openstack-infra | 10:17 | |
*** esker has joined #openstack-infra | 10:18 | |
*** markvoelker has quit IRC | 10:20 | |
*** esker has quit IRC | 10:23 | |
*** boris-42 has quit IRC | 10:23 | |
*** Daisy has quit IRC | 10:30 | |
*** Daisy has joined #openstack-infra | 10:30 | |
*** e0ne has joined #openstack-infra | 10:34 | |
*** Daisy has quit IRC | 10:35 | |
*** vgridnev has quit IRC | 10:36 | |
*** thorst has joined #openstack-infra | 10:57 | |
*** tzn has joined #openstack-infra | 10:58 | |
*** ddieterly has joined #openstack-infra | 11:01 | |
*** Qiming has joined #openstack-infra | 11:02 | |
*** tzn has quit IRC | 11:02 | |
*** thorst has quit IRC | 11:05 | |
*** ddieterly has quit IRC | 11:07 | |
*** Vivek has quit IRC | 11:09 | |
*** Vivek has joined #openstack-infra | 11:09 | |
*** Vivek is now known as Guest91320 | 11:10 | |
*** dims has joined #openstack-infra | 11:12 | |
*** dims has quit IRC | 11:13 | |
*** otter768 has joined #openstack-infra | 11:20 | |
*** otter768 has quit IRC | 11:25 | |
*** esker has joined #openstack-infra | 11:40 | |
*** dims has joined #openstack-infra | 11:46 | |
*** markvoelker has joined #openstack-infra | 12:01 | |
*** thorst has joined #openstack-infra | 12:02 | |
*** ddieterly has joined #openstack-infra | 12:03 | |
*** markvoelker has quit IRC | 12:06 | |
*** ddieterly has quit IRC | 12:08 | |
*** thorst has quit IRC | 12:10 | |
*** mrmartin has quit IRC | 12:16 | |
*** tzn has joined #openstack-infra | 12:24 | |
*** esker has quit IRC | 12:32 | |
*** e0ne has quit IRC | 12:42 | |
*** markvoelker has joined #openstack-infra | 13:02 | |
*** ddieterly has joined #openstack-infra | 13:04 | |
*** markvoelker has quit IRC | 13:06 | |
*** thorst has joined #openstack-infra | 13:07 | |
*** dims has quit IRC | 13:08 | |
*** ddieterly has quit IRC | 13:09 | |
*** esker has joined #openstack-infra | 13:10 | |
*** dims has joined #openstack-infra | 13:10 | |
*** moravec has quit IRC | 13:12 | |
*** thorst has quit IRC | 13:14 | |
*** esker has quit IRC | 13:16 | |
*** baoli has joined #openstack-infra | 13:19 | |
*** otter768 has joined #openstack-infra | 13:21 | |
*** otter768 has quit IRC | 13:26 | |
*** rguillebert has joined #openstack-infra | 13:44 | |
*** esker has joined #openstack-infra | 13:48 | |
*** treaki_ has joined #openstack-infra | 13:53 | |
*** ddieterly has joined #openstack-infra | 14:02 | |
*** baoli has quit IRC | 14:06 | |
*** thorst has joined #openstack-infra | 14:12 | |
openstackgerrit | Merged openstack-infra/project-config: Fix setup_commit_message for proposal bot https://review.openstack.org/265517 | 14:15 |
*** AJaeger has joined #openstack-infra | 14:16 | |
AJaeger | thanks, fungi! | 14:16 |
fungi | an example of how a mistyped depends-on can go wrong... https://review.openstack.org/254853 | 14:18 |
fungi | it merged while the patch it claimed to depend on still hasn't | 14:19 |
*** kaisers has quit IRC | 14:19 | |
*** thorst has quit IRC | 14:19 | |
*** kaisers has joined #openstack-infra | 14:20 | |
*** mrmartin has joined #openstack-infra | 14:20 | |
fungi | mordred: https://review.openstack.org/166821 added openstack-infra/ansible-build-image to governance back in march/april without any details, and that repo doesn't seem to exist. should we delete that? | 14:21 |
AJaeger | good catch, fungi. | 14:22 |
AJaeger | catches I mean... | 14:22 |
*** fawadkhaliq has quit IRC | 14:23 | |
fungi | AJaeger: there's plenty more. my replacement atc listing script warns about repos in governance missing from gerrit, so i'm going back through git history and submitting cleanup/corrections | 14:23 |
AJaeger | Ah, that's how you spot them ;) | 14:23 |
fungi | i've already submitted a couple obvious ones to the governance repo with a topic of "corrections" but have plenty more to dig through as i get time this weekend | 14:25 |
AJaeger | fungi, for modred's change: https://review.openstack.org/#/c/166547/ | 14:25 |
fungi | thanks AJaeger! | 14:26 |
fungi | i probably should have done a gerrit search for that repo name in commit messages. i'll do that on any others i turn up | 14:26 |
AJaeger | for For 254853, the project-config change just needs some review love... | 14:27 |
*** dims has quit IRC | 14:29 | |
*** krtaylor has quit IRC | 14:35 | |
*** tzn has quit IRC | 14:35 | |
*** zeih has joined #openstack-infra | 14:36 | |
openstackgerrit | Sam Yaple proposed openstack-infra/project-config: Add check-requirements for ekko https://review.openstack.org/265553 | 14:43 |
openstackgerrit | Sam Yaple proposed openstack/requirements: Add ekko to projects.txt https://review.openstack.org/265554 | 14:44 |
*** krtaylor has joined #openstack-infra | 14:47 | |
*** EricGonczer_ has joined #openstack-infra | 14:57 | |
*** markvoelker has joined #openstack-infra | 15:02 | |
*** tzn has joined #openstack-infra | 15:05 | |
*** lascii has quit IRC | 15:07 | |
*** dims has joined #openstack-infra | 15:07 | |
*** markvoelker has quit IRC | 15:08 | |
*** weshay has quit IRC | 15:11 | |
*** piet has joined #openstack-infra | 15:13 | |
*** tristanC_ is now known as tristanC | 15:14 | |
*** markvoelker has joined #openstack-infra | 15:15 | |
*** thorst has joined #openstack-infra | 15:17 | |
*** otter768 has joined #openstack-infra | 15:22 | |
*** hdd has joined #openstack-infra | 15:22 | |
*** thorst has quit IRC | 15:24 | |
openstackgerrit | Sam Yaple proposed openstack-infra/project-config: Add python3-jobs to ekko https://review.openstack.org/265557 | 15:26 |
*** otter768 has quit IRC | 15:27 | |
*** thorst has joined #openstack-infra | 15:28 | |
*** hdd has quit IRC | 15:32 | |
*** piet has quit IRC | 15:33 | |
*** dslevin_ has quit IRC | 15:34 | |
*** weshay has joined #openstack-infra | 15:38 | |
*** mrmartin has quit IRC | 15:38 | |
*** otter768 has joined #openstack-infra | 15:41 | |
*** hdd has joined #openstack-infra | 15:44 | |
*** dims has quit IRC | 15:47 | |
*** zeih has quit IRC | 15:48 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Make translation scripts more robust https://review.openstack.org/265560 | 15:50 |
*** tzn has quit IRC | 15:52 | |
*** dims has joined #openstack-infra | 15:52 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-specs: [WIP] Improve translation setup https://review.openstack.org/262545 | 15:55 |
*** [1]Thelo has joined #openstack-infra | 15:56 | |
*** otter768 has quit IRC | 15:56 | |
*** Thelo has quit IRC | 15:58 | |
*** [1]Thelo is now known as Thelo | 15:58 | |
*** dims has quit IRC | 16:02 | |
openstackgerrit | Merged openstack-infra/grafyaml: Add support for seriesOverrides https://review.openstack.org/265458 | 16:04 |
pabelanger | jeblair: Hmm, I thought setting valueName = current would help with that for sparklines, but never dug deeper. | 16:05 |
pabelanger | jeblair: will checkout the custom query in a bit, looked a little lastnight was scared :) | 16:06 |
*** mrmartin has joined #openstack-infra | 16:08 | |
*** salv-orlando has joined #openstack-infra | 16:09 | |
*** EricGonczer_ has quit IRC | 16:10 | |
*** dkranz has joined #openstack-infra | 16:10 | |
*** otter768 has joined #openstack-infra | 16:11 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-specs: [WIP] Improve translation setup https://review.openstack.org/262545 | 16:11 |
*** salv-orl_ has quit IRC | 16:12 | |
*** baoli has joined #openstack-infra | 16:18 | |
*** sshnaidm has joined #openstack-infra | 16:19 | |
*** baoli has quit IRC | 16:23 | |
*** Qiming has quit IRC | 16:26 | |
*** ddieterly has quit IRC | 16:29 | |
*** hurgleburgler has joined #openstack-infra | 16:32 | |
*** yamahata has joined #openstack-infra | 16:32 | |
*** dslev has joined #openstack-infra | 16:37 | |
*** otter768 has quit IRC | 16:38 | |
hurgleburgler | Do the groups listed in the gerrit/acls/openstack/ config files need to map to a Launchpad group? | 16:39 |
AJaeger | hurgleburgler: not at all | 16:42 |
AJaeger | hurgleburgler: those are only for gerrit | 16:42 |
hurgleburgler | Here's a goofy question then :) How do I find out who is in one those gerrit groups and how to get people added? | 16:43 |
*** mudassirlatif has joined #openstack-infra | 16:44 | |
AJaeger | hurgleburgler: find out: Go to review.openstack.org, login, | 16:44 |
AJaeger | click on projects, List - this will get you to https://review.openstack.org/#/admin/projects/ | 16:44 |
AJaeger | filter for the project you want | 16:44 |
AJaeger | like https://review.openstack.org/#/admin/projects/openstack-infra/project-config | 16:45 |
hurgleburgler | k | 16:45 |
AJaeger | and then click on Access | 16:45 |
AJaeger | and click on project-config-core - will get you to https://review.openstack.org/#/admin/groups/459,members | 16:45 |
hurgleburgler | Ah hah | 16:45 |
AJaeger | Administration: infra adds the first person and that person can use the above link to add/remove others | 16:45 |
hurgleburgler | How can I get the first person added to : https://review.openstack.org/#/admin/groups/1233,members | 16:46 |
hurgleburgler | Is there a ticket I need to open or just ask in here? | 16:46 |
*** otter768 has joined #openstack-infra | 16:46 | |
AJaeger | let me dig a bit for the creation fo that repo... | 16:46 |
hurgleburgler | it was here: https://review.openstack.org/#/c/259239/8/gerrit/acls/openstack/openstack-ux.config | 16:47 |
AJaeger | yep | 16:47 |
openstackgerrit | Merged openstack-infra/project-config: Grafana: Add max server line to node graph https://review.openstack.org/265459 | 16:47 |
AJaeger | and here's what our manual says: http://docs.openstack.org/infra/manual/creators.html#verify-the-gerrit-review-permissions and http://docs.openstack.org/infra/manual/creators.html#update-the-gerrit-group-members | 16:48 |
AJaeger | You can either ask here - just leave a notice and hope that one of the infra admins will read it or send an email to openstack-infra. State the review that added the group (259239) as well as your name and email address | 16:49 |
AJaeger | hurgleburgler: I'm not an admin, so can't help with that step | 16:49 |
hurgleburgler | gotcha :) thank you AJaeger! | 16:50 |
*** tzn has joined #openstack-infra | 16:53 | |
*** mudassirlatif has quit IRC | 17:01 | |
*** mrmartin has quit IRC | 17:02 | |
*** otter768 has quit IRC | 17:02 | |
*** edmondsw has joined #openstack-infra | 17:06 | |
openstackgerrit | James E. Blair proposed openstack-infra/grafyaml: Add support for interval template type https://review.openstack.org/265487 | 17:08 |
openstackgerrit | James E. Blair proposed openstack-infra/grafyaml: Add support for template query https://review.openstack.org/250893 | 17:08 |
jeblair | pabelanger: ^ rebased to dodge the filename conflict | 17:09 |
jeblair | (whee! i just multi-reviewed both of those changes with that comment :) | 17:10 |
fungi | one of my friends' daughters is in college and needs somewhere to run a demo of something she wrote as a student project (apparently the university she attends doesn't have any complimentary iaas/paas for them to use). anybody know if there are any public clouds who offer comped low-quota accounts or discounted rates for students? seems like it would be a thing... | 17:12 |
fungi | for bonus story points, it's written in python/flask/sqlite (maybe i can convince her to apply for an openstack outreachy or gsoc slot!) | 17:15 |
*** markvoelker has quit IRC | 17:15 | |
jeblair | fungi: i know a place that will run any code you upload for a short amount of time... does she need it to run more than 120 minutes? ;) | 17:15 |
fungi | heh | 17:15 |
fungi | just keep hitting recheck and write a devstack plugin to update dyndns | 17:16 |
jeblair | fungi: https://www.pythonanywhere.com/ ? | 17:17 |
jeblair | dunno about sql there | 17:17 |
*** Daisy has joined #openstack-infra | 17:17 | |
jeblair | (never used it) | 17:17 |
fungi | interesting idea. i'll pass it along | 17:17 |
jeblair | there's 512MB of 'private file storage' so maybe | 17:18 |
*** mrmartin has joined #openstack-infra | 17:19 | |
jeblair | fungi: also https://www.reddit.com/r/flask/comments/2321oc/easiest_and_fastest_way_to_host_flask_python/ | 17:19 |
jeblair | oh look, openshift is on that list :) | 17:20 |
fungi | jeblair: cool, thanks! | 17:20 |
*** yamahata has quit IRC | 17:21 | |
*** Daisy has quit IRC | 17:21 | |
fungi | is openshift openstack these days or is it still rh doing their own thing | 17:22 |
*** niska has quit IRC | 17:22 | |
*** ddieterly has joined #openstack-infra | 17:22 | |
*** ddieterl_ has joined #openstack-infra | 17:23 | |
*** ddieterly has quit IRC | 17:23 | |
jeblair | no idea, but this exists: https://github.com/redhat-openstack/openshift-on-openstack | 17:27 |
*** tzn has quit IRC | 17:27 | |
*** ddieterly has joined #openstack-infra | 17:28 | |
clarkb | for the longest time the public offering was hosted on aws using a selinuxy container mechanism | 17:29 |
clarkb | I am not sure if that has changed for the public service | 17:30 |
*** ddieterl_ has quit IRC | 17:31 | |
clarkb | fungi nibalizer may have some ideas as he still works closely with psu | 17:32 |
*** niska has joined #openstack-infra | 17:32 | |
*** fawadkhaliq has joined #openstack-infra | 17:36 | |
*** mrmartin has quit IRC | 17:37 | |
docaedo | AJaeger: is the first patch associated with https://review.openstack.org/#/c/261858/ working nicely? I'm hopeful you can remove the WIP from it soon :) | 17:37 |
*** tzn has joined #openstack-infra | 17:38 | |
*** mrmartin has joined #openstack-infra | 17:38 | |
*** baoli has joined #openstack-infra | 17:39 | |
*** edmondsw has quit IRC | 17:42 | |
*** baoli has quit IRC | 17:44 | |
*** piet has joined #openstack-infra | 17:47 | |
*** mrmartin has quit IRC | 17:53 | |
*** dkranz has quit IRC | 17:53 | |
*** tzn has quit IRC | 17:54 | |
*** dkranz has joined #openstack-infra | 17:56 | |
*** piet has quit IRC | 17:58 | |
*** piet has joined #openstack-infra | 17:59 | |
*** ccowleyunix has joined #openstack-infra | 18:05 | |
*** ccowleyunix has quit IRC | 18:07 | |
AJaeger | docaedo: the patch merged yesterday, I needed to fix something and expect to remove the WIP from it tomorrow ;) | 18:11 |
docaedo | AJaeger: cool, thanks! Also thanks for the refactor on that | 18:12 |
AJaeger | docaedo: I noticed you put your patch on top of that, will take care that your one goes in smoothly... | 18:13 |
*** e0ne has joined #openstack-infra | 18:13 | |
*** dims has joined #openstack-infra | 18:13 | |
docaedo | AJaeger: ok thanks, and if I can do anything to help just let me know | 18:13 |
AJaeger | docaedo: will do, thanks | 18:14 |
docaedo | AJaeger: np | 18:14 |
*** markvoelker has joined #openstack-infra | 18:16 | |
*** rguillebert has quit IRC | 18:17 | |
*** mrmartin has joined #openstack-infra | 18:17 | |
*** markvoelker has quit IRC | 18:21 | |
*** rossella_s has quit IRC | 18:22 | |
*** rossella_s has joined #openstack-infra | 18:22 | |
*** e0ne has quit IRC | 18:22 | |
*** rfolco has joined #openstack-infra | 18:23 | |
*** dims has quit IRC | 18:26 | |
openstackgerrit | James E. Blair proposed openstack-infra/grafyaml: Add support for interval template type https://review.openstack.org/265487 | 18:27 |
openstackgerrit | James E. Blair proposed openstack-infra/grafyaml: Add support for template query https://review.openstack.org/250893 | 18:27 |
*** e0ne has joined #openstack-infra | 18:28 | |
*** rfolco has quit IRC | 18:29 | |
*** e0ne has quit IRC | 18:32 | |
nibalizer | fungi: if you apply for github education discount, then you also get $50 in digital ocean credit | 18:32 |
nibalizer | im realizing now we should probably poke at least one openstack cloud to match | 18:33 |
*** bpokorny has joined #openstack-infra | 18:36 | |
*** tzn has joined #openstack-infra | 18:38 | |
*** bpokorny has quit IRC | 18:39 | |
*** tzn has quit IRC | 18:43 | |
mordred | nibalizer: if only we worked for a company that had one of those | 18:45 |
*** rfolco has joined #openstack-infra | 18:49 | |
*** mrmartin has quit IRC | 18:52 | |
*** piet has quit IRC | 18:54 | |
*** rfolco has quit IRC | 18:58 | |
*** fawadkhaliq has quit IRC | 18:59 | |
*** bpokorny has joined #openstack-infra | 19:03 | |
*** otter768 has joined #openstack-infra | 19:03 | |
*** kzaitsev_mb has joined #openstack-infra | 19:06 | |
*** otter768 has quit IRC | 19:08 | |
*** piet has joined #openstack-infra | 19:11 | |
*** dkranz has quit IRC | 19:18 | |
fungi | nibalizer: thanks, passing it along | 19:23 |
fungi | public service announcement: free (even if tiny) accounts for students means you've indoctrinated new customers in just a few years | 19:24 |
*** piet has quit IRC | 19:25 | |
*** piet has joined #openstack-infra | 19:30 | |
*** thorst has quit IRC | 19:30 | |
*** kzaitsev_mb has quit IRC | 19:32 | |
*** armax has quit IRC | 19:33 | |
*** bpokorny has quit IRC | 19:33 | |
*** tzn has joined #openstack-infra | 19:40 | |
mrodden | qq, where does http://status.openstack.org//openstack-health/#/ get all the data from, and is it something i could access / mine ? | 19:42 |
*** armax has joined #openstack-infra | 19:42 | |
clarkb | mrodden: from a subunit2sql database, it is publicly availabel via logstash.openstack.org on port 3306 | 19:43 |
mrodden | clarkb: sweet thanks | 19:44 |
clarkb | it is mydwl | 19:44 |
clarkb | er mysql | 19:44 |
mrodden | lol, for a second i was worried it was some mysql fork | 19:45 |
mrodden | "mydwl" | 19:45 |
*** mrmartin has joined #openstack-infra | 19:45 | |
*** EricGonczer_ has joined #openstack-infra | 19:45 | |
clarkb | just phone typing fail | 19:46 |
*** mrmartin has quit IRC | 19:46 | |
*** piet has quit IRC | 19:46 | |
*** armax_ has joined #openstack-infra | 19:47 | |
*** armax has quit IRC | 19:49 | |
*** armax_ is now known as armax | 19:49 | |
*** piet has joined #openstack-infra | 19:51 | |
*** EricGonczer_ has quit IRC | 19:54 | |
*** jerryz has joined #openstack-infra | 20:01 | |
*** piet has quit IRC | 20:07 | |
*** ddieterly has quit IRC | 20:08 | |
*** _nadya_ has joined #openstack-infra | 20:09 | |
*** tzn has quit IRC | 20:12 | |
*** markvoelker has joined #openstack-infra | 20:17 | |
*** markvoelker has quit IRC | 20:21 | |
*** moravec has joined #openstack-infra | 20:23 | |
*** yolanda has quit IRC | 20:23 | |
*** yolanda has joined #openstack-infra | 20:23 | |
*** thorst has joined #openstack-infra | 20:27 | |
*** hdd has quit IRC | 20:29 | |
*** maishsk has joined #openstack-infra | 20:37 | |
*** kzaitsev_mb has joined #openstack-infra | 20:39 | |
*** kzaitsev_mb has quit IRC | 20:44 | |
*** Sukhdev has joined #openstack-infra | 20:48 | |
*** maishsk has quit IRC | 20:51 | |
*** maishsk_ has joined #openstack-infra | 20:51 | |
*** thorst has quit IRC | 20:51 | |
*** zz_dimtruck is now known as dimtruck | 21:00 | |
*** _nadya_ has quit IRC | 21:00 | |
*** maishsk_ has quit IRC | 21:01 | |
*** Sukhdev has quit IRC | 21:04 | |
*** otter768 has joined #openstack-infra | 21:04 | |
mrodden | holy crap you guys have a lot of data... | 21:08 |
*** jerryz has quit IRC | 21:08 | |
*** otter768 has quit IRC | 21:08 | |
*** dims has joined #openstack-infra | 21:09 | |
*** ddieterly has joined #openstack-infra | 21:09 | |
*** maishsk has joined #openstack-infra | 21:13 | |
*** ddieterly has quit IRC | 21:14 | |
*** kzaitsev_mb has joined #openstack-infra | 21:18 | |
*** armax has quit IRC | 21:29 | |
*** armax has joined #openstack-infra | 21:29 | |
*** tzn has joined #openstack-infra | 21:31 | |
*** dims has quit IRC | 21:31 | |
*** nelsnelson has quit IRC | 21:33 | |
*** nelsnelson has joined #openstack-infra | 21:34 | |
*** dimtruck is now known as zz_dimtruck | 21:37 | |
fungi | mrodden: and that's a fairly time-limited dataset too. though mtreinish is still working on better ways to expire that stuff | 21:51 |
mrodden | time-limited? | 21:52 |
fungi | something like 3 or 6 months retention on the raw per-test statistics. i don't remember exactly | 21:52 |
*** eharney has quit IRC | 21:52 | |
mrodden | oh k | 21:52 |
mrodden | its not actually the full set of "jobs" that i was looking for either | 21:52 |
mrodden | must be a subset of voting | 21:53 |
*** piet has joined #openstack-infra | 21:53 | |
fungi | if you want job-level granularity instead of test-level, then graphite.openstack.org may be more what you need | 21:53 |
mrodden | graphite just does metrics though | 21:53 |
fungi | and you can ask graphite for json dumps of raw data too | 21:54 |
fungi | yeah, not sure what you're seeking exactly | 21:54 |
mrodden | basically any and all jobs that get reported into Gerrit... | 21:54 |
mrodden | i'm less interested in 3rd party at the moment | 21:54 |
mrodden | i might have to firehose the gerrit stream | 21:55 |
*** nelsnels_ has joined #openstack-infra | 21:55 | |
fungi | graphite should have pass/fail and duration on all jobs, i think | 21:55 |
fungi | zuul is continuously reporting into statsd for that stuff | 21:55 |
mrodden | i would like to get the artifacts though | 21:55 |
mrodden | well a link to them | 21:56 |
mrodden | like subunit2sql captures | 21:56 |
mrodden | thats a big part for drill down | 21:56 |
*** nelsnelson has quit IRC | 21:56 | |
mrodden | does Zuul have an event stream? | 21:56 |
mrodden | actually i have an idea... | 21:59 |
clarkb | gerrit has an event stresm | 21:59 |
*** maishsk has quit IRC | 21:59 | |
mrodden | yeah | 21:59 |
clarkb | we do already index all the logs for 10 days above debug level | 22:00 |
mrodden | its scary when you hook up to it though | 22:00 |
clarkb | yes, "all jobs and artifacts" is quitr a bit number | 22:00 |
clarkb | I think its ~18TB of compressed artifacts per year | 22:00 |
mrodden | i'm gonna need a bigger.... file server | 22:01 |
mrodden | or something | 22:01 |
clarkb | and a 10 day index eats about 3TB | 22:01 |
clarkb | and thats not including debug | 22:01 |
mrodden | elasticsearch numbers? | 22:01 |
clarkb | ya thats elasticsearch | 22:02 |
mrodden | ah, that thing has about a 30-50% overhead on the base data | 22:02 |
mrodden | lucene indexes.... | 22:02 |
fungi | we're going to need a bigger boat | 22:02 |
mrodden | it r fast though | 22:02 |
clarkb | all this to say, we do quite a bit of hosting of this stuff already, would be happy to do more I am sure | 22:03 |
clarkb | rather than having you buy a bigger fileserver | 22:03 |
mrodden | lol | 22:03 |
mrodden | if anything i'd just start stashing it in an object store somewhere while i work on it | 22:04 |
mrodden | thats cheap | 22:04 |
*** tzn has quit IRC | 22:04 | |
fungi | openstack infra... let us be your fileserver | 22:04 |
clarkb | I mean we already have to host it... | 22:04 |
clarkb | the data is public | 22:04 |
mrodden | yeah i'm going to store only the excess that i need | 22:04 |
mrodden | which should help | 22:04 |
*** piet has quit IRC | 22:04 | |
mrodden | i don't really need the logs | 22:04 |
mrodden | i'm not interested in full text search | 22:05 |
fungi | do you just need better indexing to the raw artifacts we have? | 22:05 |
clarkb | mrodden: what are you trying to do? | 22:05 |
mrodden | well | 22:05 |
mrodden | building a seachable graph that will allow people to match up tests and changes and patches in better ways and search it | 22:05 |
fungi | that sounds like a better dashboard to our stored logs | 22:06 |
mrodden | exactly | 22:06 |
clarkb | amd possibly already being addressed in the heslth dashboard | 22:06 |
fungi | which i think there are at least two designs already partly done for and somewhat stagnating | 22:06 |
clarkb | mtreinish: had linked a couple changes for indexing back to logs | 22:06 |
fungi | or, yeah, the health dashboard was heading in that direction too | 22:06 |
mrodden | yeah its sort of me taking my internal thing and dropping it into openstack proper now | 22:07 |
clarkb | basically go from test to log rather than change to log | 22:07 |
mrodden | there are other things too, like who is testing, did results differ | 22:08 |
*** eharney has joined #openstack-infra | 22:08 | |
clarkb | but the dataset it addresses is limiyed because we need a bigger computer | 22:09 |
*** piet has joined #openstack-infra | 22:09 | |
clarkb | (and maybe not mysql, not sure if that discussion went anywhere) | 22:09 |
*** salv-orl_ has joined #openstack-infra | 22:09 | |
mrodden | what other than mysql | 22:09 |
mrodden | thats sort of almost maximally efficient when it comes to searching... | 22:10 |
mrodden | structured data | 22:10 |
clarkb | ya I think there us somr disagreement on whethet or not a relational db is the best fit | 22:10 |
*** ddieterly has joined #openstack-infra | 22:10 | |
clarkb | but right now the biggest mysql we can run has 500gb of disk | 22:11 |
mrodden | i used ES + mongodb in my first iteration | 22:11 |
*** maishsk has joined #openstack-infra | 22:11 | |
mrodden | i would drop mongo | 22:11 |
mrodden | it is garbage. | 22:11 |
mrodden | was looking at the json stuff in postgres, since they posted impressive numbers | 22:12 |
mrodden | but the heavy lifting is done by ES still | 22:12 |
clarkb | ES is nice because it scales horizontally well but does have some relatively high overhead | 22:12 |
mrodden | its not too bad if you control what you index | 22:12 |
*** salv-orlando has quit IRC | 22:12 | |
mrodden | it also has upper limits | 22:12 |
mrodden | i have seen them. | 22:12 |
clarkb | well its a huge jvm | 22:12 |
mrodden | lol you mean, in memory store huge JVM | 22:13 |
clarkb | its not an in memory store | 22:13 |
mrodden | true it puts them on disk, but it gets it performance by being mostly in memory | 22:13 |
mrodden | just like mysql gets those numbers with query caching | 22:14 |
clarkb | sure on the rwad side more memory helps | 22:14 |
mrodden | the tuning guide for ES was prett eye opening | 22:15 |
mrodden | vm.swappiness = 0 is kind of scary | 22:15 |
clarkb | I think the total memory difference between ES and subunit2mysql right now is 350GB or so | 22:15 |
*** ddieterly has quit IRC | 22:15 | |
*** e0ne has joined #openstack-infra | 22:15 | |
mrodden | meaning, the entire ES cluster vs the mysql server? | 22:16 |
clarkb | yes | 22:16 |
mrodden | makes sense | 22:16 |
mrodden | i mean, b-tree indexes are fully optimized for disc access | 22:17 |
*** markvoelker has joined #openstack-infra | 22:18 | |
mrodden | otherwise binary trees are best if you can do everything in memory | 22:18 |
mrodden | lucene indexes are optimized for text search, but i'm pretty sure they benefit from being in memory vs disc | 22:18 |
mrodden | mysql indexes default to btree still i believe... | 22:19 |
clarkb | they do, each field is fully loaded into memory to do a query iirc | 22:19 |
mrodden | yeah | 22:19 |
mrodden | mysql does tricks for its speedups | 22:20 |
mrodden | just like ES | 22:20 |
mrodden | but ES more relies on them for its performance | 22:20 |
*** maishsk has quit IRC | 22:20 | |
mrodden | s/them/memory/ | 22:20 |
mrodden | anyway | 22:20 |
mrodden | both are faster than mongo in practice i've found... | 22:21 |
mrodden | :) | 22:21 |
clarkb | which is one part of scaling es, any individual field across any indexes you search must fit in memory | 22:21 |
clarkb | for us timestamps are killer, and are the current limiting factor to 10days | 22:21 |
*** piet has quit IRC | 22:22 | |
*** rossella_s has quit IRC | 22:22 | |
*** rossella_s has joined #openstack-infra | 22:22 | |
mrodden | everything has a timestamp and it would be many different values, so yeah | 22:22 |
mrodden | make sense | 22:22 |
clarkb | ya and oslo just bumoed resolution | 22:22 |
*** markvoelker has quit IRC | 22:22 | |
clarkb | so far more uniqur values, I actually meant to ask them to bump it back down because microsecond resolutjon with python seems sillu | 22:23 |
mrodden | yeah lol | 22:23 |
clarkb | (it was millisecond) | 22:23 |
mrodden | maybe to standardize with other ISO format? | 22:23 |
clarkb | maybe, I havent tracked the change down | 22:24 |
mrodden | pretty sure you can safely drop anything after a second though | 22:24 |
mrodden | is the ES api for logstash open somewhere? | 22:26 |
mrodden | wanted to look at the indexes | 22:26 |
clarkb | yes, http://logstash.openstack.org/elasticsearch | 22:26 |
*** maishsk has joined #openstack-infra | 22:26 | |
mrodden | erm... 404? | 22:27 |
clarkb | the proxy limits it to a set of read only operations | 22:27 |
mrodden | oh k | 22:27 |
clarkb | thats the root | 22:27 |
mrodden | got it | 22:29 |
clarkb | cluster health, index listing, and queries should all work | 22:29 |
*** dfflanders has joined #openstack-infra | 22:29 | |
clarkb | we point kibana at it and that works as does elastic-recheck | 22:30 |
*** thorst has joined #openstack-infra | 22:32 | |
mrodden | http://logstash.openstack.org/elasticsearch/logstash-2015.01.07/_mappings :( | 22:32 |
*** dfflanders has quit IRC | 22:33 | |
mrodden | what do you use for index listing? | 22:33 |
clarkb | _cat/indices ? | 22:34 |
mrodden | thought i tried that... | 22:34 |
mrodden | 404 | 22:35 |
clarkb | I tend to hit it via complete api so it is possible we are just missing some things | 22:35 |
mrodden | yeah | 22:35 |
mrodden | i can search and cluster health | 22:35 |
clarkb | the joys of software that dont support authentication | 22:35 |
mrodden | inorite... | 22:35 |
mrodden | i think i just drop everything that isn't a GET unless you HTTP auth on my other one | 22:35 |
*** e0ne has quit IRC | 22:35 | |
clarkb | I can make a note to punch more holes next week | 22:35 |
*** thorst has quit IRC | 22:36 | |
*** thorst has joined #openstack-infra | 22:36 | |
*** thorst has quit IRC | 22:41 | |
*** zz_dimtruck is now known as dimtruck | 22:42 | |
*** dimtruck is now known as zz_dimtruck | 22:43 | |
*** EricGonczer_ has joined #openstack-infra | 22:48 | |
*** ozamiatin has quit IRC | 22:48 | |
crinkle | clarkb: it turns out the mysql_grant type just has an 'options' parameter that can take ['GRANT'] that does what we want | 22:57 |
crinkle | it's not part of the 'privileges' param like i assumed | 22:57 |
crinkle | so we probably don't need to resort to the exec | 22:57 |
clarkb | crinkle gotcha we only need to add ut tothat one if block if you want to update thr change | 22:58 |
clarkb | I dont think it merged | 22:58 |
crinkle | clarkb: only that one if block? the other grants don't need all + grant? | 22:59 |
clarkb | no, because those grants are db specific, its the differemce betweem getting a login and getting root essentially | 22:59 |
clarkb | you only need the extra perms when getting rootified | 22:59 |
crinkle | clarkb: got it, i'll go ahead and fix up that patch if that's okay with you? | 23:00 |
clarkb | ya thats fine | 23:01 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Allow openstack_citest 'grant option' privilege https://review.openstack.org/265348 | 23:04 |
*** dims has joined #openstack-infra | 23:05 | |
*** ddieterly has joined #openstack-infra | 23:11 | |
*** dims has quit IRC | 23:14 | |
*** ddieterly has quit IRC | 23:17 | |
*** yolanda has quit IRC | 23:18 | |
*** yolanda has joined #openstack-infra | 23:19 | |
*** tzn has joined #openstack-infra | 23:22 | |
*** flepied has quit IRC | 23:24 | |
*** markvoelker has joined #openstack-infra | 23:33 | |
*** markvoelker has quit IRC | 23:38 | |
*** flepied has joined #openstack-infra | 23:42 | |
*** EricGonczer_ has quit IRC | 23:49 | |
*** tzn has quit IRC | 23:55 | |
*** ozamiatin has joined #openstack-infra | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!