| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Create and upload wheels https://review.openstack.org/56760 | 00:01 |
|---|---|---|
| mordred | sasha shoudl be happier about that ^^ | 00:02 |
| *** AlexF has joined #openstack-infra | 00:03 | |
| *** VijayT has joined #openstack-infra | 00:08 | |
| *** alexpilotti has quit IRC | 00:12 | |
| *** jcooley_ has quit IRC | 00:13 | |
| *** jcooley_ has joined #openstack-infra | 00:14 | |
| *** thuc has quit IRC | 00:17 | |
| *** thuc has joined #openstack-infra | 00:17 | |
| *** idella4 has joined #openstack-infra | 00:18 | |
| *** dims has quit IRC | 00:18 | |
| *** thuc has quit IRC | 00:22 | |
| *** gsamfira has joined #openstack-infra | 00:28 | |
| *** jcooley_ has quit IRC | 00:28 | |
| *** jcooley_ has joined #openstack-infra | 00:29 | |
| *** gokrokve has joined #openstack-infra | 00:32 | |
| openstackgerrit | A change was merged to openstack/requirements: WSME: update to 0.6 https://review.openstack.org/71732 | 00:34 |
| *** jcooley_ has quit IRC | 00:34 | |
| *** jcooley_ has joined #openstack-infra | 00:35 | |
| *** dcramer_ has quit IRC | 00:35 | |
| *** dims has joined #openstack-infra | 00:35 | |
| *** sarob has joined #openstack-infra | 00:37 | |
| *** sarob has quit IRC | 00:43 | |
| *** jasondotstar has quit IRC | 00:44 | |
| *** morganfainberg_Z is now known as morganfainberg | 00:47 | |
| *** sarob has joined #openstack-infra | 00:47 | |
| *** dcramer_ has joined #openstack-infra | 00:48 | |
| *** sarob has quit IRC | 00:52 | |
| *** dcramer_ has quit IRC | 00:53 | |
| *** malini_afk is now known as malini | 00:54 | |
| *** jcooley_ has quit IRC | 00:57 | |
| *** jcooley_ has joined #openstack-infra | 00:58 | |
| *** gokrokve has quit IRC | 01:00 | |
| *** jcooley_ has quit IRC | 01:03 | |
| *** jasondotstar has joined #openstack-infra | 01:10 | |
| *** gsamfira has quit IRC | 01:14 | |
| *** gsamfira has joined #openstack-infra | 01:14 | |
| *** gsamfira has joined #openstack-infra | 01:15 | |
| openstackgerrit | A change was merged to openstack/requirements: Add oslo.version to the list of projects https://review.openstack.org/71931 | 01:17 |
| *** yamahata_ has joined #openstack-infra | 01:22 | |
| *** banix has joined #openstack-infra | 01:24 | |
| *** idella4 has quit IRC | 01:25 | |
| *** oanufriev has quit IRC | 01:29 | |
| *** rwsu has quit IRC | 01:29 | |
| *** openstackgerrit has quit IRC | 01:29 | |
| *** atiwari has quit IRC | 01:29 | |
| *** ogelbukh has quit IRC | 01:29 | |
| *** jaypipes has quit IRC | 01:29 | |
| *** yamahata__ has quit IRC | 01:29 | |
| *** uvirtbot has quit IRC | 01:30 | |
| *** zul has quit IRC | 01:35 | |
| *** jaypipes has joined #openstack-infra | 01:36 | |
| *** atiwari has joined #openstack-infra | 01:36 | |
| *** ogelbukh has joined #openstack-infra | 01:37 | |
| *** rwsu has joined #openstack-infra | 01:37 | |
| *** sarob has joined #openstack-infra | 01:41 | |
| *** sarob has quit IRC | 01:46 | |
| *** uvirtbot has joined #openstack-infra | 01:50 | |
| *** banix has quit IRC | 01:54 | |
| *** morganfainberg is now known as morganfainberg_Z | 02:03 | |
| *** gokrokve has joined #openstack-infra | 02:05 | |
| *** nati_ueno has joined #openstack-infra | 02:06 | |
| *** malini is now known as malini_afk | 02:08 | |
| *** gokrokve has quit IRC | 02:09 | |
| *** dstanek has joined #openstack-infra | 02:15 | |
| *** AlexF has quit IRC | 02:24 | |
| *** westmaas_ is now known as westmaas | 02:28 | |
| *** nati_ueno has quit IRC | 02:30 | |
| *** nati_ueno has joined #openstack-infra | 02:31 | |
| *** dstanek has quit IRC | 02:33 | |
| *** Hunner has quit IRC | 02:33 | |
| *** nati_uen_ has joined #openstack-infra | 02:34 | |
| *** nati_ueno has quit IRC | 02:35 | |
| *** nati_uen_ has quit IRC | 02:38 | |
| *** nati_ueno has joined #openstack-infra | 02:39 | |
| *** Hunner has joined #openstack-infra | 02:39 | |
| *** sarob has joined #openstack-infra | 02:41 | |
| *** nati_ueno has quit IRC | 02:42 | |
| *** nati_ueno has joined #openstack-infra | 02:42 | |
| *** gaelL has quit IRC | 02:47 | |
| *** sarob has quit IRC | 02:47 | |
| *** nati_ueno has quit IRC | 02:48 | |
| *** nati_ueno has joined #openstack-infra | 02:50 | |
| *** mriedem has quit IRC | 02:51 | |
| *** gaelL has joined #openstack-infra | 02:52 | |
| *** CaptTofu has joined #openstack-infra | 02:55 | |
| *** jasondotstar has quit IRC | 03:04 | |
| *** harlowja_away is now known as harlowja | 03:13 | |
| *** mestery__ is now known as mestery | 03:14 | |
| *** lttrl has joined #openstack-infra | 03:17 | |
| *** nati_ueno has quit IRC | 03:21 | |
| *** harlowja has quit IRC | 03:23 | |
| *** harlowja has joined #openstack-infra | 03:23 | |
| *** dstanek has joined #openstack-infra | 03:27 | |
| *** banix has joined #openstack-infra | 03:30 | |
| *** lttrl has quit IRC | 03:32 | |
| *** sarob has joined #openstack-infra | 03:45 | |
| *** sarob has quit IRC | 03:49 | |
| *** CaptTofu has quit IRC | 03:52 | |
| *** cody-somerville has joined #openstack-infra | 03:55 | |
| *** cody-somerville has quit IRC | 03:55 | |
| *** cody-somerville has joined #openstack-infra | 03:55 | |
| *** banix has quit IRC | 04:05 | |
| *** gokrokve has joined #openstack-infra | 04:31 | |
| *** sarob has joined #openstack-infra | 04:45 | |
| *** gokrokve has quit IRC | 04:49 | |
| *** ok_delta has joined #openstack-infra | 04:52 | |
| *** sarob has quit IRC | 04:52 | |
| *** gokrokve has joined #openstack-infra | 04:53 | |
| *** sarob has joined #openstack-infra | 04:55 | |
| *** sarob has quit IRC | 04:59 | |
| *** markwash has joined #openstack-infra | 05:02 | |
| *** markwash has quit IRC | 05:14 | |
| *** VijayT has quit IRC | 05:22 | |
| *** pcrews has joined #openstack-infra | 05:37 | |
| *** nati_ueno has joined #openstack-infra | 05:42 | |
| *** pcrews has quit IRC | 05:43 | |
| *** jcooley_ has joined #openstack-infra | 05:46 | |
| *** nati_ueno has quit IRC | 05:46 | |
| *** jcooley_ has quit IRC | 05:50 | |
| *** CaptTofu has joined #openstack-infra | 05:53 | |
| *** CaptTofu has quit IRC | 05:58 | |
| *** Ryan_Lane has quit IRC | 06:16 | |
| *** gokrokve has quit IRC | 06:24 | |
| *** banix has joined #openstack-infra | 06:25 | |
| *** gokrokve has joined #openstack-infra | 06:32 | |
| *** gokrokve_ has joined #openstack-infra | 06:36 | |
| *** banix has quit IRC | 06:36 | |
| *** gokrokve has quit IRC | 06:37 | |
| *** Ryan_Lane has joined #openstack-infra | 06:45 | |
| *** sarob has joined #openstack-infra | 06:49 | |
| *** sarob has quit IRC | 06:56 | |
| *** sarob has joined #openstack-infra | 06:59 | |
| *** sarob has quit IRC | 07:04 | |
| *** morganfainberg_Z is now known as morganfainberg | 07:08 | |
| *** gokrokve_ has quit IRC | 07:10 | |
| *** Hunner has quit IRC | 07:22 | |
| *** Hunner has joined #openstack-infra | 07:25 | |
| *** yolanda has joined #openstack-infra | 07:32 | |
| *** markwash has joined #openstack-infra | 07:32 | |
| *** gokrokve has joined #openstack-infra | 07:40 | |
| *** gokrokve_ has joined #openstack-infra | 07:43 | |
| *** gokrokv__ has joined #openstack-infra | 07:44 | |
| *** gokrokve has quit IRC | 07:45 | |
| *** gokrokve_ has quit IRC | 07:47 | |
| *** VijayT has joined #openstack-infra | 07:49 | |
| *** gokrokv__ has quit IRC | 07:49 | |
| *** sarob has joined #openstack-infra | 07:52 | |
| *** e0ne has joined #openstack-infra | 07:53 | |
| *** CaptTofu has joined #openstack-infra | 07:54 | |
| *** sarob has quit IRC | 07:57 | |
| *** CaptTofu has quit IRC | 07:59 | |
| *** nicedice has joined #openstack-infra | 08:03 | |
| *** nicedice_ has quit IRC | 08:03 | |
| *** zhiyan has joined #openstack-infra | 08:05 | |
| *** lttrl has joined #openstack-infra | 08:06 | |
| *** rlandy has joined #openstack-infra | 08:11 | |
| *** harlowja is now known as harlowja_away | 08:14 | |
| *** DinaBelova_ is now known as DinaBelova | 08:15 | |
| *** lttrl has quit IRC | 08:19 | |
| *** AlexF has joined #openstack-infra | 08:20 | |
| *** AlexF has quit IRC | 08:22 | |
| *** VijayT has quit IRC | 08:23 | |
| *** salv-orlando has quit IRC | 08:24 | |
| *** markwash has quit IRC | 08:25 | |
| *** Ryan_Lane has quit IRC | 08:27 | |
| *** DinaBelova is now known as DinaBelova_ | 08:40 | |
| *** gokrokve has joined #openstack-infra | 08:45 | |
| *** zhiyan1 has joined #openstack-infra | 08:45 | |
| *** zhiyan has quit IRC | 08:46 | |
| *** gokrokve has quit IRC | 08:49 | |
| *** sarob has joined #openstack-infra | 08:53 | |
| *** e0ne has quit IRC | 08:58 | |
| *** oubiwann_ has quit IRC | 08:58 | |
| *** e0ne has joined #openstack-infra | 08:59 | |
| *** sarob has quit IRC | 09:00 | |
| *** ok_delta has quit IRC | 09:01 | |
| *** sarob has joined #openstack-infra | 09:03 | |
| *** zhiyan1 has quit IRC | 09:06 | |
| *** sarob has quit IRC | 09:08 | |
| *** morganfainberg is now known as morganfainberg_Z | 09:15 | |
| *** salv-orlando has joined #openstack-infra | 09:17 | |
| *** e0ne has quit IRC | 09:22 | |
| *** gokrokve has joined #openstack-infra | 09:43 | |
| *** nati_ueno has joined #openstack-infra | 09:46 | |
| *** gokrokve has quit IRC | 09:48 | |
| *** nati_ueno has quit IRC | 09:54 | |
| *** CaptTofu has joined #openstack-infra | 09:55 | |
| *** nati_ueno has joined #openstack-infra | 09:55 | |
| *** sarob has joined #openstack-infra | 09:56 | |
| *** nati_ueno has quit IRC | 09:57 | |
| *** CaptTofu has quit IRC | 10:00 | |
| *** sarob has quit IRC | 10:01 | |
| *** SpamapS has quit IRC | 10:06 | |
| *** mestery_ has joined #openstack-infra | 10:08 | |
| *** mestery has quit IRC | 10:10 | |
| *** flaper87|afk is now known as flaper87 | 10:12 | |
| *** SpamapS has joined #openstack-infra | 10:13 | |
| *** gokrokve has joined #openstack-infra | 10:43 | |
| *** DeeJay1 has joined #openstack-infra | 10:44 | |
| *** ttx has quit IRC | 10:45 | |
| *** ttx has joined #openstack-infra | 10:45 | |
| *** ttx has quit IRC | 10:45 | |
| *** ttx has joined #openstack-infra | 10:45 | |
| DeeJay1 | hi, I have a question about running periodic jobs, as far as I can see right now they are run once a day, am I right? | 10:46 |
| *** gokrokve has quit IRC | 10:48 | |
| *** ttx has quit IRC | 10:48 | |
| *** ttx has joined #openstack-infra | 10:48 | |
| *** ttx has quit IRC | 10:48 | |
| *** ttx has joined #openstack-infra | 10:48 | |
| *** salv-orlando has quit IRC | 10:49 | |
| *** ttx has quit IRC | 10:49 | |
| *** ttx has joined #openstack-infra | 10:50 | |
| *** ttx has quit IRC | 10:50 | |
| *** ttx has joined #openstack-infra | 10:50 | |
| *** sarob has joined #openstack-infra | 10:57 | |
| *** sarob has quit IRC | 11:04 | |
| *** sarob has joined #openstack-infra | 11:07 | |
| *** boris-42_ has joined #openstack-infra | 11:11 | |
| *** boris-42 has quit IRC | 11:11 | |
| *** sarob has quit IRC | 11:12 | |
| *** gokrokve has joined #openstack-infra | 11:43 | |
| *** gokrokve has quit IRC | 11:48 | |
| *** CaptTofu has joined #openstack-infra | 11:55 | |
| *** CaptTofu has quit IRC | 11:56 | |
| *** CaptTofu_ has joined #openstack-infra | 11:56 | |
| *** salv-orlando has joined #openstack-infra | 11:56 | |
| *** sarob has joined #openstack-infra | 12:00 | |
| *** CaptTofu_ has quit IRC | 12:01 | |
| *** yolanda has quit IRC | 12:03 | |
| *** sarob has quit IRC | 12:05 | |
| *** idella4 has joined #openstack-infra | 12:14 | |
| *** CaptTofu has joined #openstack-infra | 12:14 | |
| *** gokrokve has joined #openstack-infra | 12:43 | |
| *** jasondotstar has joined #openstack-infra | 12:46 | |
| *** alexpilotti has joined #openstack-infra | 12:48 | |
| *** gokrokve has quit IRC | 12:48 | |
| *** sarob has joined #openstack-infra | 13:01 | |
| *** yamahata has quit IRC | 13:08 | |
| *** sarob has quit IRC | 13:08 | |
| *** yamahata has joined #openstack-infra | 13:09 | |
| *** david-lyle has quit IRC | 13:11 | |
| *** sarob has joined #openstack-infra | 13:11 | |
| *** CaptTofu has quit IRC | 13:12 | |
| *** sarob has quit IRC | 13:15 | |
| *** DinaBelova_ is now known as DinaBelova | 13:16 | |
| *** nijaba_ has quit IRC | 13:18 | |
| *** nijaba has joined #openstack-infra | 13:18 | |
| *** nijaba has joined #openstack-infra | 13:18 | |
| SergeyLukjanov | DeeJay1, hi, there a several periodic jobs pipelines - periodic, periodic-stable and periodic-qa (https://github.com/openstack-infra/config/blob/master/modules/openstack_project/files/zuul/layout.yaml#L116) | 13:28 |
| SergeyLukjanov | DeeJay1, all of them are daily jobs (as you can see in cron expression) | 13:28 |
| DeeJay1 | SergeyLukjanov: I feared so :( what are the opinions on running some jobs hourly/bi hourly? We'd like to synchronise the translation jobs for the manuals more often to provide translators with a possibility to review their translations in a "finished" product | 13:32 |
| SergeyLukjanov | DeeJay1, I think that you could add separated periodic-i18n pipeline that will run sync jobs hourly | 13:33 |
| DeeJay1 | SergeyLukjanov: hmm, good idea :) ok so I'll prepare a patch then and put it up for review | 13:34 |
| SergeyLukjanov | DeeJay1, I think that's a correct solution for your problem | 13:34 |
| * DeeJay1 wishes it would be easier to self setup zuul for testing purposes... | 13:35 | |
| SergeyLukjanov | DeeJay1, it have good enough docs - http://ci.openstack.org/zuul/ | 13:39 |
| *** gokrokve has joined #openstack-infra | 13:43 | |
| *** idella4 has quit IRC | 13:43 | |
| *** mriedem has joined #openstack-infra | 13:49 | |
| *** sarob has joined #openstack-infra | 14:04 | |
| *** talluri has joined #openstack-infra | 14:09 | |
| *** sarob has quit IRC | 14:09 | |
| *** weshay has joined #openstack-infra | 14:12 | |
| *** banix has joined #openstack-infra | 14:20 | |
| *** nijaba has quit IRC | 14:28 | |
| *** alexpilotti has quit IRC | 14:29 | |
| *** jasondotstar has quit IRC | 14:29 | |
| *** alexpilotti has joined #openstack-infra | 14:30 | |
| *** nijaba has joined #openstack-infra | 14:32 | |
| *** nijaba has quit IRC | 14:32 | |
| *** nijaba has joined #openstack-infra | 14:32 | |
| *** alexpilotti has quit IRC | 14:34 | |
| DeeJay1 | can anyone take a look at https://review.openstack.org/#/c/70574/ ? | 14:40 |
| *** senk has quit IRC | 14:41 | |
| *** flaper87 is now known as flaper87|afk | 14:41 | |
| *** flaper87|afk is now known as flaper87 | 14:41 | |
| *** senk_ has joined #openstack-infra | 14:42 | |
| *** dims has quit IRC | 14:47 | |
| *** dims has joined #openstack-infra | 14:48 | |
| *** ryanpetrello has joined #openstack-infra | 14:52 | |
| *** lttrl has joined #openstack-infra | 14:56 | |
| *** nijaba has quit IRC | 14:56 | |
| *** nijaba has joined #openstack-infra | 14:57 | |
| *** nijaba has joined #openstack-infra | 14:57 | |
| *** banix has quit IRC | 14:58 | |
| *** sarob has joined #openstack-infra | 15:05 | |
| *** ryanpetrello has quit IRC | 15:07 | |
| *** jasondotstar has joined #openstack-infra | 15:08 | |
| *** sarob has quit IRC | 15:11 | |
| *** nijaba has quit IRC | 15:13 | |
| *** sarob has joined #openstack-infra | 15:15 | |
| *** nijaba has joined #openstack-infra | 15:16 | |
| *** e0ne has joined #openstack-infra | 15:17 | |
| *** dizquierdo has joined #openstack-infra | 15:19 | |
| *** sarob has quit IRC | 15:20 | |
| *** DinaBelova is now known as DinaBelova_ | 15:21 | |
| *** DinaBelova_ is now known as DinaBelova | 15:24 | |
| *** alexpilotti has joined #openstack-infra | 15:28 | |
| *** alexpilotti has quit IRC | 15:32 | |
| SpamapS | mordred: you mentioned on facebook that python libraries are releasing breaking stuff. Any specific example? | 15:32 |
| fungi | DeeJay1: right now the publishers for that job only seem to grab contents from generated/{lang}/install-guide/target/docbkx/webhelp (so i'm not sure why you're copying the doc/pom.xml into generated/{lang}/ | 15:32 |
| fungi | DeeJay1: also, where do the common, glossary and user-guide docbook files end up? | 15:33 |
| *** ryanpetrello has joined #openstack-infra | 15:33 | |
| DeeJay1 | fungi: they are included in the install-guide, as they're it's requirements | 15:33 |
| fungi | SpamapS: setuptools and boto | 15:34 |
| *** ryanpetrello has quit IRC | 15:34 | |
| DeeJay1 | fungi: so to have a complete install guide you need to process those 3 first | 15:34 |
| DeeJay1 | fungi: as for the pom, well, we need to have the same tree as in the untranslated directory as it includes some maven directives | 15:35 |
| SpamapS | ah ok that likely isn't what is breaking my heat engine | 15:35 |
| fungi | DeeJay1: oh! i see, that's in prebuilders, and then the maven builder actually uses that | 15:35 |
| * DeeJay1 is trying to wrap his head around zuul to make something like https://github.com/deejay1/openstack-jobs | 15:35 | |
| fungi | DeeJay1: lgtm | 15:35 |
| fungi | SpamapS: there may be more--those are just the ones i happen to be aware of | 15:36 |
| DeeJay1 | fungi: thx, one less failing build then ;) | 15:38 |
| *** talluri has quit IRC | 15:41 | |
| DeeJay1 | does zuul support variables for project definitions in layout.yaml the same way as jenkins job builder does? eg can I do https://github.com/deejay1/openstack-jobs/blob/master/job.yaml at least for the {lang} part? | 15:43 |
| fungi | DeeJay1: zuul has recently grown some templating for its layout file. let me get you an example from production... | 15:46 |
| fungi | DeeJay1: see the project-templates list http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml#n151 | 15:47 |
| fungi | DeeJay1: you can basically define a list of jobs there which you want to apply consistently to multiple projects differing by name | 15:48 |
| fungi | DeeJay1: then you apply it to the list of templates for each project you want to use it on, for example http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml#n492 | 15:49 |
| fungi | DeeJay1: that adds jobs like gate-ceilometer-pep8, gate-ceilometer-python26, gate-ceilometer-python27 and so on | 15:50 |
| DeeJay1 | fungi: yeah, I didn't notice at first that you can use multiple templates on a project, now I only have to make my zuul install to work for some testing purposes... | 15:50 |
| *** banix has joined #openstack-infra | 15:51 | |
| mordred | morning fungi | 15:51 |
| fungi | good mordred, morning | 15:52 |
| fungi | DeeJay1: in addition to the http://ci.openstack.org/zuul/ SergeyLukjanov linked, you can also get some ideas from http://ci.openstack.org/zuul.html (about the setup of our production server), and http://ci.openstack.org/running-your-own.html#stage-4-zuul (part of an infra test setup walkthrough) | 15:53 |
| fungi | we seem to have lost openstackgerrit again :/ | 15:54 |
| fungi | fixing | 15:54 |
| *** openstackgerrit has joined #openstack-infra | 15:55 | |
| fungi | welcome back, openstackgerrit | 15:55 |
| fungi | you've been away since... 2014-02-09 01:29:59 <-- openstackgerrit (~openstack@review.openstack.org) has quit (*.net *.split) | 15:56 |
| fungi | roughly 14.5 hours | 15:56 |
| DeeJay1 | fungi: ahhh, reading time ;) | 15:57 |
| *** DinaBelova is now known as DinaBelova_ | 15:58 | |
| bknudson | is there some way I can get Jenkins to generate a coverage report for a change? | 16:02 |
| bknudson | I can find it in the post report for a change that's merged, but what about a change that's in review? | 16:03 |
| bknudson | I'd like to show that a change I'm making raises the coverage | 16:04 |
| *** talluri has joined #openstack-infra | 16:07 | |
| *** sarob has joined #openstack-infra | 16:08 | |
| *** alexpilotti has joined #openstack-infra | 16:08 | |
| *** banix has quit IRC | 16:09 | |
| *** portante has joined #openstack-infra | 16:12 | |
| *** sarob has quit IRC | 16:13 | |
| portante | clarkb: have you played with nested vs parent/child documents in es? | 16:13 |
| portante | I am looking at sar data and it has variable records for cpu-load-all, disk, network, serial, and was thinking of using nested objects | 16:14 |
| openstackgerrit | David Caro proposed a change to openstack-infra/jenkins-job-builder: Added config options to not overwrite jobs desc https://review.openstack.org/52080 | 16:19 |
| openstackgerrit | David Caro proposed a change to openstack-infra/jenkins-job-builder: Added config options to not overwrite jobs desc https://review.openstack.org/52080 | 16:24 |
| *** DinaBelova_ is now known as DinaBelova | 16:26 | |
| *** markmcclain has joined #openstack-infra | 16:32 | |
| *** markmcclain has quit IRC | 16:36 | |
| *** markwash has joined #openstack-infra | 16:40 | |
| *** nijaba has quit IRC | 16:44 | |
| *** nijaba has joined #openstack-infra | 16:45 | |
| *** nijaba has joined #openstack-infra | 16:45 | |
| *** salv-orlando has quit IRC | 16:54 | |
| fungi | bknudson: the project in question would need to have a coverage job defined in check or experimental pipelines | 16:55 |
| *** e0ne has quit IRC | 16:56 | |
| fungi | bknudson: the former would cause coverage reports for every patchset uploaded on every change and also for rechecks | 16:56 |
| fungi | bknudson: the latter might make sense though (leave a 'check experimental' comment to generate a coverage report) | 16:56 |
| bknudson | fungi: thanks. I'll give check experimental a try. | 16:57 |
| fungi | bknudson: well, you'd need to add a coverage job to that project's experimental pipeline first | 16:57 |
| fungi | in zuul's layout.yaml | 16:57 |
| fungi | http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml | 16:58 |
| *** rlandy has quit IRC | 17:03 | |
| *** sarob has joined #openstack-infra | 17:09 | |
| *** sarob has quit IRC | 17:16 | |
| *** markwash has quit IRC | 17:18 | |
| *** sarob has joined #openstack-infra | 17:19 | |
| *** mestery_ is now known as mestery | 17:19 | |
| *** gokrokve has quit IRC | 17:20 | |
| *** gokrokve has joined #openstack-infra | 17:20 | |
| *** sarob has quit IRC | 17:23 | |
| openstackgerrit | Brant Knudson proposed a change to openstack-infra/config: Keystone coverage report in experimental https://review.openstack.org/72151 | 17:23 |
| *** DinaBelova is now known as DinaBelova_ | 17:23 | |
| *** dizquierdo has quit IRC | 17:24 | |
| *** banix has joined #openstack-infra | 17:28 | |
| *** mlipchuk has joined #openstack-infra | 17:28 | |
| *** markmcclain has joined #openstack-infra | 17:32 | |
| *** rwsu has quit IRC | 17:32 | |
| mordred | fungi: in nodepool scripts - it looks like we're double-dipping on the caching | 17:33 |
| mordred | fungi: prepare_node.sh uses cache_git_repos.py to pretty much grab everything - and then there's still a hardcoded list in prepare_node_devstack.sh | 17:33 |
| mordred | fungi: am I just missing something? | 17:33 |
| *** atiwari has quit IRC | 17:34 | |
| openstackgerrit | A change was merged to openstack/requirements: Add decorator to the global requirements https://review.openstack.org/69364 | 17:34 |
| *** markmcclain has quit IRC | 17:37 | |
| *** Nithya has quit IRC | 17:39 | |
| *** dstanek has quit IRC | 17:47 | |
| *** atiwari has joined #openstack-infra | 17:47 | |
| *** DeeJay1 has quit IRC | 17:55 | |
| *** atiwari has quit IRC | 17:55 | |
| *** DinaBelova_ is now known as DinaBelova | 17:55 | |
| *** denis_makogon_ has joined #openstack-infra | 17:56 | |
| *** gokrokve has quit IRC | 17:58 | |
| *** banix has quit IRC | 18:03 | |
| *** talluri has quit IRC | 18:04 | |
| *** denis_makogon_ has quit IRC | 18:08 | |
| *** yolanda has joined #openstack-infra | 18:10 | |
| *** DinaBelova is now known as DinaBelova_ | 18:12 | |
| *** sarob has joined #openstack-infra | 18:12 | |
| *** harlowja_away is now known as harlowja | 18:13 | |
| *** salv-orlando has joined #openstack-infra | 18:13 | |
| *** mriedem has quit IRC | 18:16 | |
| *** sarob has quit IRC | 18:17 | |
| *** yolanda has quit IRC | 18:20 | |
| *** yolanda has joined #openstack-infra | 18:22 | |
| *** DinaBelova_ is now known as DinaBelova | 18:23 | |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Add logging to jeepyb https://review.openstack.org/72158 | 18:26 |
| *** gokrokve has joined #openstack-infra | 18:26 | |
| *** oubiwann_ has joined #openstack-infra | 18:26 | |
| anteaya | fungi: my first attempt at following your suggestion in the bug report: https://bugs.launchpad.net/openstack-ci/+bug/1245905 | 18:27 |
| uvirtbot | Launchpad bug 1245905 in openstack-ci "manage-projects needs to write its logging somewhere" [Medium,In progress] | 18:28 |
| anteaya | which I probably have wrong since I put it in the puppet exec for jeepyb, I will keep looking for the puppet exec for manage-projects | 18:28 |
| *** andre__ has joined #openstack-infra | 18:29 | |
| *** markmcclain has joined #openstack-infra | 18:33 | |
| *** markmcclain1 has joined #openstack-infra | 18:35 | |
| *** markmcclain has quit IRC | 18:35 | |
| *** gokrokve has quit IRC | 18:35 | |
| *** banix has joined #openstack-infra | 18:36 | |
| *** banix has quit IRC | 18:37 | |
| anteaya | I'm grepping for a manage-projects exec in config and so far coming up empty | 18:39 |
| *** markmcclain1 has quit IRC | 18:39 | |
| *** lttrl has quit IRC | 18:41 | |
| *** lttrl has joined #openstack-infra | 18:42 | |
| anteaya | I'm wondering if this cron job is the intended target: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/gerrit/manifests/remotes.pp | 18:46 |
| anteaya | meh, I'll add that too then | 18:47 |
| *** salv-orlando_ has joined #openstack-infra | 18:48 | |
| *** salv-orlando has quit IRC | 18:50 | |
| *** salv-orlando_ is now known as salv-orlando | 18:50 | |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Add logging to manage-projects https://review.openstack.org/72158 | 18:50 |
| *** salv-orlando has quit IRC | 18:52 | |
| *** senk_ has quit IRC | 18:57 | |
| *** NikitaKonovalov_ is now known as NikitaKonovalov | 19:00 | |
| mordred | anteaya: we have removed manage-projects from being run automatically by puppet | 19:01 |
| *** NikitaKonovalov is now known as NikitaKonovalov_ | 19:01 | |
| mordred | because of some operational issues with it | 19:01 |
| mordred | so you will not find the place in puppet where it's run | 19:01 |
| *** dkehn__ has joined #openstack-infra | 19:03 | |
| *** jasondotstar has quit IRC | 19:03 | |
| *** dkehn__ has quit IRC | 19:05 | |
| *** dkehn__ has joined #openstack-infra | 19:05 | |
| *** dkehn_ has quit IRC | 19:05 | |
| *** dkehn has quit IRC | 19:06 | |
| mordred | fungi: if you get bored: https://review.openstack.org/#/c/70933/2 | 19:06 |
| *** dkehn has joined #openstack-infra | 19:07 | |
| anteaya | mordred: that would explain that | 19:08 |
| anteaya | however I have stuck my hand up in the air for helping you with: https://bugs.launchpad.net/openstack-ci/+bug/1242569 | 19:09 |
| uvirtbot | Launchpad bug 1242569 in openstack-ci "manage-projects error on new project creation" [Critical,In progress] | 19:09 |
| mordred | anteaya: excellent. | 19:09 |
| anteaya | which needs, as a first action, some logging, as pointed out by jeblair in the bug report comments as well as reiterated at last week's meeting | 19:09 |
| anteaya | so, here I am, such as I am, trying to shoehorn some logging in | 19:10 |
| anteaya | are you up for some direction and guidance? | 19:10 |
| anteaya | or are you otherwise occupied | 19:10 |
| anteaya | like with washing your hair and socks | 19:10 |
| mordred | anteaya: not at this moment- but I do find the idea of giving such direction and guidance a good idea | 19:10 |
| mordred | hair and socks | 19:10 |
| anteaya | preferably not together, but who am I to judge | 19:10 |
| anteaya | okay | 19:11 |
| anteaya | once you are sporting clean hair and socks, do ping | 19:11 |
| anteaya | I'm sporting a silk turban and listening to the debussy ballade | 19:11 |
| anteaya | and would like to do my best to keep my word regarding manage-projects | 19:12 |
| *** sarob has joined #openstack-infra | 19:13 | |
| *** banix has joined #openstack-infra | 19:19 | |
| openstackgerrit | A change was merged to openstack-infra/config: No longer grant third-party voting initially https://review.openstack.org/72012 | 19:19 |
| *** sarob has quit IRC | 19:19 | |
| *** gokrokve has joined #openstack-infra | 19:20 | |
| *** NikitaKonovalov_ is now known as NikitaKonovalov | 19:21 | |
| fungi | mordred: not sure whether you've seen bug 1277495 but i'm wondering whether we should recommend projects stop overriding LC_ALL in tox.ini (temporarily) or let them be broken until we upgrade infra to newer virtualenv/pip? | 19:21 |
| uvirtbot | Launchpad bug 1277495 in openstack-ci "python33 jobs are breaking" [Critical,In progress] https://launchpad.net/bugs/1277495 | 19:21 |
| *** sarob has joined #openstack-infra | 19:23 | |
| *** sarob has quit IRC | 19:27 | |
| mordred | fungi: why were we overriding LC_ALL in tox.ini in the first place? | 19:28 |
| *** DinaBelova is now known as DinaBelova_ | 19:29 | |
| fungi | mordred: your cache_git_repos.py vs prepare_devstack.sh the latter looks like it's older and needs to be cleaned up to not clone repos, though they're cloning into different places (/opt/git vs ~jenkins/workspace-cache) so we probably need to make sure nothing is using the latter any longer | 19:31 |
| *** markmcclain has joined #openstack-infra | 19:34 | |
| fungi | anteaya: hopefully logoutput on the exec helps. if not, we could ad a python logging config for manage-projects and set it to look for that to determine where to write a log | 19:34 |
| *** andre__ has quit IRC | 19:35 | |
| *** mlipchuk has quit IRC | 19:35 | |
| *** mlipchuk has joined #openstack-infra | 19:37 | |
| anteaya | fungi: do you mean going with logoutput on the jeepyb exec? on the patch I just abandoned? | 19:37 |
| anteaya | I never did find a manage-projects exec, and I believe mordred is telling me it is currently non-existant, having been removed | 19:39 |
| *** markmcclain has quit IRC | 19:39 | |
| fungi | anteaya: yeah, it's not currently being run because of the bugs we encountered. to test it one of us would probably revert the removal change in a puppet dev environment and apply your proposed change, then update puppet agent from that on review.o.o with a pending project config update, then check the syslog to see if puppet got any more verbose about the manage-projects run | 19:41 |
| fungi | mordred: good question re: lc_all in tox.ini... i'll se what git blame has to say | 19:41 |
| anteaya | fungi: could I see the removal change? | 19:43 |
| anteaya | I can unabandon my patch then, if you think it might have some value | 19:44 |
| *** VijayT has joined #openstack-infra | 19:47 | |
| *** jasondotstar has joined #openstack-infra | 19:47 | |
| *** atiwari has joined #openstack-infra | 19:48 | |
| anteaya | In the mean time, I will check the furnace | 19:48 |
| * anteaya puts on her coat and boots and heads out into the snow | 19:48 | |
| *** harlowja is now known as harlowja_away | 19:53 | |
| fungi | mordred: short answer is you added it with minimal explanation... https://review.openstack.org/#/c/18633/12/tox.ini | 19:57 |
| fungi | cargo cult? | 19:57 |
| fungi | anteaya: you're looking for https://review.openstack.org/66692 | 19:59 |
| fungi | anteaya: you could propose a revert of that with 72158 rebased on top of it if you wanted | 20:00 |
| anteaya | fungi: I am | 20:04 |
| anteaya | I got distracted by: https://review.openstack.org/#/c/72012/1 | 20:04 |
| anteaya | yay | 20:04 |
| *** marun has joined #openstack-infra | 20:04 | |
| fungi | anteaya: i found that by just skimming the commit log for openstack-infra/config | 20:05 |
| anteaya | yes that was where I was looking and found 72012 | 20:05 |
| anteaya | I was so busy celebrating I didn't get further | 20:05 |
| anteaya | do you think 72158 could go as is with both files? or should I lose the logging with the cron job file | 20:07 |
| fungi | anteaya: i suspect the logoutput option doesn't really do anything for cron entries | 20:08 |
| fungi | since they get run by cron, and are merely installed to the crontab by puppet | 20:08 |
| anteaya | okay, I will remove the cron file | 20:08 |
| *** e0ne has joined #openstack-infra | 20:09 | |
| anteaya | I'm thinking how I do that, I think I just edit the file back to the way it was, correct, and then git stops tracking it? | 20:10 |
| fungi | sure | 20:10 |
| fungi | that should work fine | 20:10 |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Revert "Stop running manage-projects" https://review.openstack.org/72178 | 20:10 |
| fungi | anteaya: and make sure to set the patches for this to work-in-progress until we know they'll actually tell us something useful | 20:12 |
| fungi | since i merged https://review.openstack.org/72012 earlier and haven't run manage-projects yet, i'm interested to give it a try and see what sort of logging we get with your patch | 20:13 |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Add logging to manage-projects https://review.openstack.org/72158 | 20:13 |
| *** locke105 has joined #openstack-infra | 20:13 | |
| fungi | and also, it IS the weekend, so don't feel like you have to work on this right now, if you have other stuff to be doing | 20:14 |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Revert "Stop running manage-projects" https://review.openstack.org/72178 | 20:14 |
| *** jhesketh_ has quit IRC | 20:14 | |
| *** alexpilotti has quit IRC | 20:14 | |
| anteaya | fungi: okay, WIP | 20:15 |
| anteaya | yeah i missed the end of last week and want to see if I can get the pieces figured out in my head | 20:15 |
| anteaya | but I will stop if I need to | 20:15 |
| * fungi calls this month's meeting of workaholics anonymous to order | 20:16 | |
| *** AlexF has joined #openstack-infra | 20:16 | |
| anteaya | ha ha ha | 20:16 |
| *** sarob has joined #openstack-infra | 20:16 | |
| anteaya | not so anonymous | 20:16 |
| fungi | workaholics pseudonymous doesn't have the same ring to it | 20:17 |
| *** AlexF has quit IRC | 20:18 | |
| *** sarob has quit IRC | 20:21 | |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Add logging to manage-projects https://review.openstack.org/72158 | 20:21 |
| anteaya | fungi: that is true | 20:21 |
| anteaya | yay, I got the revert as a dependency on my patch | 20:22 |
| anteaya | which was my goal | 20:22 |
| fungi | good work! | 20:22 |
| anteaya | thanks | 20:22 |
| anteaya | i rebased the reversion, which was unnecessary | 20:22 |
| fungi | it's fine | 20:22 |
| anteaya | but oh well | 20:22 |
| anteaya | at least it didn't do bad things | 20:23 |
| fungi | consider it a learning experience | 20:23 |
| anteaya | thanks | 20:23 |
| anteaya | I learned that the rebase button rebases the current patch on master | 20:24 |
| anteaya | I think | 20:24 |
| anteaya | and nothing else | 20:24 |
| fungi | it's relatively braindead, yes | 20:24 |
| anteaya | but it doesn't cause much harm | 20:24 |
| fungi | you can rebase it yourself and resubmit from the git command line just about as quickly | 20:25 |
| fungi | so much so that i often forget that button is there | 20:25 |
| *** miqui has joined #openstack-infra | 20:27 | |
| *** jhesketh_ has joined #openstack-infra | 20:27 | |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Add logging to manage-projects https://review.openstack.org/72158 | 20:28 |
| *** alexpilotti has joined #openstack-infra | 20:28 | |
| *** atiwari has quit IRC | 20:28 | |
| *** CaptTofu has joined #openstack-infra | 20:29 | |
| anteaya | I had never used that button before, but I figured hey it is Sunday, let's see what this does | 20:29 |
| anteaya | plus it was my own patch | 20:29 |
| fungi | yeah, experiment away | 20:29 |
| anteaya | so I think that I am ready to have that patch taken for a test drive when you are ready, fungi | 20:29 |
| anteaya | do you want me to mark both of them WIP while you test? | 20:29 |
| fungi | please | 20:29 |
| fungi | i don't think the logoutput is strictly needed on the install_jeepyb exec, but it can't hurt | 20:30 |
| anteaya | done | 20:30 |
| * fungi plays around with these patches | 20:30 | |
| *** gokrokve has quit IRC | 20:30 | |
| anteaya | I can remove it if it is too much logging | 20:30 |
| *** gokrokve has joined #openstack-infra | 20:31 | |
| fungi | there's no such thing | 20:31 |
| fungi | well, okay, some of the debug logging we had on jenkins (or was it zuul?) for a while was filling up filesystems, but that's an entire other level of too much | 20:32 |
| openstackgerrit | Sean M. Collins proposed a change to openstack-infra/elastic-recheck: Remove query for 1270212 - marked as resolved https://review.openstack.org/72180 | 20:34 |
| *** markmcclain has joined #openstack-infra | 20:35 | |
| *** gokrokve has quit IRC | 20:35 | |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/config: Add logs about the pypi mirror https://review.openstack.org/71949 | 20:36 |
| anteaya | ha ha ha | 20:37 |
| dims | did i just add more logging? :) | 20:38 |
| anteaya | yes I don't imagine a terabyte's worth coming out of that lever | 20:38 |
| anteaya | did you? | 20:38 |
| fungi | dims: the only thing better than logging is documentation ;) | 20:38 |
| dims | just kidding, added 2 lines :) | 20:38 |
| anteaya | I did but you might have too | 20:38 |
| anteaya | you did | 20:38 |
| fungi | anteaya: he's talking about https://review.openstack.org/71949 | 20:38 |
| fungi | yeah | 20:39 |
| anteaya | yes | 20:39 |
| anteaya | nice echos | 20:39 |
| anteaya | no copyright notices or anything | 20:39 |
| *** markmcclain has quit IRC | 20:39 | |
| dims | :) | 20:39 |
| anteaya | :D | 20:39 |
| mordred | fungi: I betcha I was trying to make sure that local locale weren't doing weird thigns to tests | 20:39 |
| mordred | fungi: but that doesn't make any sense - if that's an issue, it should be handled in a test fixture | 20:40 |
| *** mriedem has joined #openstack-infra | 20:40 | |
| mordred | fungi: so, I vote we just remove all of teh LC_ and LANG stuff from tox.ini | 20:40 |
| fungi | mordred: well, they weren't, at least until setuptools added non-ascii content in its pkg-info file, which pip < 1.5 seems unable to cope with in c locale | 20:40 |
| *** atiwari has joined #openstack-infra | 20:41 | |
| fungi | mordred: if you could update bug 1277495 with that suggestion, i'm certain the patches will flow | 20:41 |
| uvirtbot | Launchpad bug 1277495 in openstack-ci "python33 jobs are breaking" [Critical,In progress] https://launchpad.net/bugs/1277495 | 20:41 |
| dims | fungi, 1.1.1-maint patches from Daniel worked like a charm. So all we now need is zul's folks to pick up the patches for UCA - fyi | 20:42 |
| anteaya | I think I will do something else for a bit | 20:42 |
| fungi | dims: excellent news--thanks! | 20:43 |
| dims | fungi, the other thing on my plate was oslo.vmware setup, is this https://review.openstack.org/#/c/70761/ a manual operation or automated? | 20:43 |
| *** krtaylor has quit IRC | 20:44 | |
| * dims back in a bit | 20:46 | |
| fungi | dims: once it's approved, it's a manually-triggered automated process at the moment (because our triggering mechanism seems to silently do bad things to it, which is the reason for anteaya's logging patches above) | 20:46 |
| dims | cool. thanks | 20:46 |
| *** krtaylor has joined #openstack-infra | 20:47 | |
| *** gokrokve has joined #openstack-infra | 20:50 | |
| openstackgerrit | Gabriele Cerami proposed a change to openstack-infra/jenkins-job-builder: Added support for python virtualenv plugin https://review.openstack.org/71926 | 20:52 |
| *** gokrokve has quit IRC | 20:53 | |
| *** krtaylor has quit IRC | 20:53 | |
| mordred | fungi: commented | 20:53 |
| * fungi waits for lp to catch up with reality | 20:55 | |
| *** elasticio has joined #openstack-infra | 20:55 | |
| *** elasticio is now known as Guest97974 | 20:55 | |
| *** krtaylor has joined #openstack-infra | 20:55 | |
| *** CaptTofu has quit IRC | 20:56 | |
| *** NikitaKonovalov is now known as NikitaKonovalov_ | 20:59 | |
| fungi | mordred: if you commented on bug 1277495 then lp still hasn't updated :/ | 21:06 |
| uvirtbot | Launchpad bug 1277495 in openstack-ci "python33 jobs are breaking" [Critical,In progress] https://launchpad.net/bugs/1277495 | 21:06 |
| *** jamielennox|away is now known as jamielennox | 21:07 | |
| mordred | fungi: I tried | 21:10 |
| mordred | fungi: there we go | 21:10 |
| mordred | it failed before | 21:10 |
| mordred | because, you know, accepting a comment is hard | 21:11 |
| fungi | heh. thanks mordred! | 21:11 |
| *** mriedem has quit IRC | 21:12 | |
| *** yolanda has quit IRC | 21:12 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Add replication key for gerrit from hiera https://review.openstack.org/70933 | 21:13 |
| mordred | fungi: ^^ I took out that blank line - sorry bout that | 21:13 |
| fungi | mordred: oh, thanks! i was in favor of the patch regardless, but all's the better | 21:15 |
| *** sarob has joined #openstack-infra | 21:17 | |
| fungi | mordred: on the manage-projects front, i've cherry-picked anteaya's stack onto head^1 and am letting it run before i apply my acl edit... since that basically undid the acl patch from before it triggered an manage_projects exec refresh and i'm almost certain this is taking long enough it will be bumping up against the 10-minute timeout | 21:19 |
| *** Guest97974 has quit IRC | 21:19 | |
| *** elasticio_ has joined #openstack-infra | 21:19 | |
| *** elasticio_ is now known as Guest89718 | 21:20 | |
| *** e0ne has quit IRC | 21:20 | |
| *** Guest89718 has quit IRC | 21:24 | |
| *** sarob has quit IRC | 21:24 | |
| *** elasticio__ has joined #openstack-infra | 21:24 | |
| *** elasticio__ has joined #openstack-infra | 21:24 | |
| fungi | "notice: Finished catalog run in 752.08 seconds" | 21:25 |
| mordred | fungi: nice | 21:25 |
| mordred | fungi: btw: https://review.openstack.org/#/c/62187/9/modules/openstack_project/manifests/review.pp | 21:25 |
| fungi | i think puppet agent not in --test would probably have timed it out | 21:25 |
| mordred | fungi: is that a bug? how is that working? | 21:25 |
| mordred | I think that shoudl have .erb on the end of it? | 21:25 |
| fungi | mordred: i fixed it later in another patch, i believe | 21:26 |
| * fungi finds | 21:26 | |
| *** sarob has joined #openstack-infra | 21:27 | |
| fungi | mordred: https://review.openstack.org/#/c/70450/1/modules/openstack_project/manifests/review.pp | 21:29 |
| fungi | because you're right, it didn't work | 21:29 |
| mordred | fungi: :) | 21:29 |
| mordred | fungi: k. awesome | 21:29 |
| mordred | thanks! | 21:29 |
| fungi | discovered that when i went to troubleshoot something else on review.o.o and puppet was broken | 21:29 |
| fungi | you're welcome! | 21:29 |
| clarkb | so we seem to be losing indexed logs due to CRM114 timeouts | 21:30 |
| fungi | clarkb: does that mean we should scale up the workers? | 21:30 |
| clarkb | I *think* that the 4 CRM114 processes are sharing files and it may not be built for that | 21:30 |
| fungi | ohhh... contention | 21:30 |
| clarkb | fungi: no, I think the workers are interfering with each other | 21:31 |
| *** sarob has quit IRC | 21:31 | |
| fungi | that makes some sense actually | 21:31 |
| clarkb | I am going to try an experiment on logstash-worker01, going to stop the 4 workers there and give them new working dirs (copies of the existing ones) | 21:31 |
| clarkb | going to stop puppet on that host and do it by hand, will puppettize if it helps | 21:32 |
| *** bknudson has quit IRC | 21:32 | |
| fungi | k | 21:32 |
| *** markmcclain has joined #openstack-infra | 21:35 | |
| mordred | ++ | 21:39 |
| * mordred supports clarkb | 21:39 | |
| *** markmcclain has quit IRC | 21:40 | |
| clarkb | hrm that doesn't seem to have helped | 21:43 |
| *** jasondotstar has quit IRC | 21:43 | |
| *** jasondotstar has joined #openstack-infra | 21:44 | |
| *** dims has quit IRC | 21:45 | |
| *** gokrokve has joined #openstack-infra | 21:49 | |
| *** e0ne has joined #openstack-infra | 21:51 | |
| *** CaptTofu has joined #openstack-infra | 21:53 | |
| *** gokrokve has quit IRC | 21:55 | |
| *** CaptTofu has quit IRC | 21:59 | |
| *** dripton has quit IRC | 22:05 | |
| *** dripton has joined #openstack-infra | 22:05 | |
| clarkb | I now think we are running into some fun buffer issue between crm114 and subprocess.Popen's pipe objects | 22:09 |
| *** mattoliverau has joined #openstack-infra | 22:10 | |
| mattoliverau | Morning all | 22:11 |
| *** jasondotstar has quit IRC | 22:14 | |
| *** VijayT has quit IRC | 22:16 | |
| *** sarob has joined #openstack-infra | 22:20 | |
| *** e0ne has quit IRC | 22:20 | |
| fungi | clarkb: are we overrunning the default length for the pipe's buffer maybe? | 22:20 |
| clarkb | fungi: maybe? popen by default is unbuffered I thought | 22:21 |
| clarkb | I have tried changing it to a line buffer | 22:21 |
| *** mriedem has joined #openstack-infra | 22:21 | |
| *** sarob has quit IRC | 22:24 | |
| *** alexpilotti has quit IRC | 22:29 | |
| *** nati_ueno has joined #openstack-infra | 22:32 | |
| clarkb | fungi: well I give up for now, I have returned it to its previous state | 22:36 |
| *** markmcclain has joined #openstack-infra | 22:36 | |
| clarkb | puppet is running | 22:36 |
| clarkb | and now to return to my regularly scheduled weekend | 22:37 |
| clarkb | jeblair: if you get an early start tomorrow do you mind poking at it too? I think you are most familiar with that code | 22:37 |
| clarkb | jeblair: tl;dr is look for CRM114 timeout exceptions in the worker logs, you will see what is happening | 22:37 |
| *** mlipchuk has quit IRC | 22:38 | |
| openstackgerrit | Matthew Oliver proposed a change to openstack-infra/config: Nodepool image logs accessible via HTTP https://review.openstack.org/71190 | 22:39 |
| *** CaptTofu has joined #openstack-infra | 22:41 | |
| *** markmcclain has quit IRC | 22:41 | |
| *** jasondotstar has joined #openstack-infra | 22:42 | |
| *** elasticio__ has quit IRC | 22:44 | |
| *** david-lyle has joined #openstack-infra | 22:48 | |
| mordred | clarkb: would you mind looking at https://review.openstack.org/#/c/70933/ ? I need one more +2 on it | 22:49 |
| *** alexpilotti has joined #openstack-infra | 22:49 | |
| *** dizquierdo has joined #openstack-infra | 22:50 | |
| *** gokrokve has joined #openstack-infra | 22:50 | |
| *** jasondotstar has quit IRC | 22:52 | |
| *** flaper87 is now known as flaper87|afk | 22:54 | |
| *** gokrokve has quit IRC | 22:55 | |
| *** Ryan_Lane has joined #openstack-infra | 23:00 | |
| *** Ryan_Lane has quit IRC | 23:00 | |
| *** Ryan_Lane has joined #openstack-infra | 23:00 | |
| *** krtaylor has quit IRC | 23:01 | |
| *** alexpilotti has quit IRC | 23:02 | |
| *** krtaylor has joined #openstack-infra | 23:05 | |
| *** mriedem has quit IRC | 23:05 | |
| clarkb | mordred: +2 but not approved because I don't have time to babysit | 23:10 |
| *** gokrokve has joined #openstack-infra | 23:11 | |
| mordred | clarkb: k. thanks | 23:11 |
| *** e0ne has joined #openstack-infra | 23:12 | |
| *** gokrokve_ has joined #openstack-infra | 23:14 | |
| openstackgerrit | Russell Bryant proposed a change to openstack-infra/reviewstats: Show 15 oldest in single project results https://review.openstack.org/72186 | 23:14 |
| *** nati_ueno has quit IRC | 23:15 | |
| *** gokrokve has quit IRC | 23:15 | |
| openstackgerrit | A change was merged to openstack-infra/reviewstats: Show 15 oldest in single project results https://review.openstack.org/72186 | 23:16 |
| *** ianw has quit IRC | 23:16 | |
| fungi | well, i've unearthed a few issues with manage-projects... | 23:17 |
| *** CaptTofu has quit IRC | 23:18 | |
| fungi | it's definitely consistently taking well over 10 minutes for a full run (at least when triggered under a puppet refresh) so we'll either need to speed it way up or significantly increase the timeout | 23:18 |
| fungi | i'm also hitting github api rate limit errors on a somewhat regular basis | 23:19 |
| *** krtaylor has quit IRC | 23:19 | |
| *** krtaylor has joined #openstack-infra | 23:20 | |
| fungi | "For requests using Basic Authentication or OAuth, you can make up to 5,000 requests per hour." http://developer.github.com/v3/#rate-limiting | 23:20 |
| *** sarob has joined #openstack-infra | 23:20 | |
| fungi | apparently a single full manage-projects run represents a substantial fraction of 5000 authenticated github api calls | 23:21 |
| *** dhellmann has quit IRC | 23:23 | |
| clarkb | I am further stumped by the crm114 thing, I figured might be that crm114 is dying without writing to stdout hence the timeout but it isn't spitting out anything to stderr if that is the case | 23:24 |
| clarkb | so really going to weekend now | 23:24 |
| clarkb | logstash-worker01 should be back to normal | 23:24 |
| *** dhellmann has joined #openstack-infra | 23:25 | |
| fungi | oh, and gerritlib patch incoming. it doesn't know how to create groups with spaces in their names :( | 23:25 |
| mordred | fungi: I've been thinking that we shoudl split manage-projects into two things | 23:26 |
| mordred | fungi: one that does the creation / project management stuff - one that does the upstream tracking stuff | 23:27 |
| *** sarob has quit IRC | 23:27 | |
| mordred | fungi: I'm going to land taht change above and babysit a run of it to make sure not-fail | 23:28 |
| fungi | mordred: sounds sane | 23:28 |
| fungi | mordred: okay, i'll get review.o.o back into sync with production puppet and the agent started back up | 23:29 |
| fungi | just need a few more minutes for this last run to complete testing the gerritlib change i think i need | 23:30 |
| mordred | fungi: oh - yes. indeed. :) OR - you keep doing your thing and ignore me | 23:30 |
| *** sarob has joined #openstack-infra | 23:31 | |
| *** gokrokve_ has quit IRC | 23:31 | |
| mordred | fungi: actually - get it back into sync, but don't start the agent | 23:33 |
| mordred | fungi: that way I can hand-run puppet and watch to make sure I don't blow something away by accident | 23:33 |
| *** jhesketh_ has quit IRC | 23:33 | |
| *** ianw has joined #openstack-infra | 23:34 | |
| fungi | mordred: okie dokie | 23:34 |
| *** sarob has quit IRC | 23:35 | |
| fungi | also i confirmed anteaya's proposed patch does output the script stdout/stderr to the puppet agent --test output at least (no idea whether the same will make it into syslog) | 23:36 |
| *** markmcclain has joined #openstack-infra | 23:37 | |
| fungi | sync'ing back up to master now | 23:38 |
| fungi | mordred: okay, all back to normal except with puppet agent still stopped | 23:41 |
| mordred | cool. thanks! | 23:41 |
| clarkb | bug 1278210 has been submitted for the logstash crm114 derps | 23:42 |
| uvirtbot | Launchpad bug 1278210 in openstack-ci "CRM114 timeouts preventing logs from being indexed" [High,Triaged] https://launchpad.net/bugs/1278210 | 23:42 |
| *** markmcclain has quit IRC | 23:42 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/gerritlib: Quote group names in case of spaces https://review.openstack.org/72188 | 23:43 |
| mordred | fungi: +2 ^^ | 23:44 |
| openstackgerrit | A change was merged to openstack-infra/config: Add replication key for gerrit from hiera https://review.openstack.org/70933 | 23:45 |
| fungi | mordred: thanks! it's already tested... https://review.openstack.org/#/admin/groups/270,info | 23:45 |
| fungi | but i did back it out on review.o.o after i was done | 23:45 |
| mordred | fungi: omg. the current short-sha of openstack-infra/config ... | 23:46 |
| mordred | is 45beef2 | 23:46 |
| fungi | ha! | 23:46 |
| fungi | gitsha, it's what's for dinner | 23:46 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Remove .ssh from openstack_project::review https://review.openstack.org/72189 | 23:49 |
| mordred | fungi: ^^ that. sorry, I tested the patch locally at HP - but we're not using the o_p review manifests, so I did not catch the duplication | 23:50 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Remove .ssh from openstack_project::review https://review.openstack.org/72189 | 23:51 |
| fungi | you are faster than i. +2 now that it's rebased | 23:51 |
| mordred | :) | 23:53 |
| mordred | I just tested it via mordred environment | 23:53 |
| mordred | and it works | 23:53 |
| fungi | awesomesauce | 23:53 |
| *** harlowja_away is now known as harlowja | 23:54 | |
| openstackgerrit | A change was merged to openstack-infra/config: Remove .ssh from openstack_project::review https://review.openstack.org/72189 | 23:56 |
| mordred | fungi: I'd like to re-enable puppet agent on review - how did you disable it? | 23:58 |
| fungi | mordred: i stopped the daemon using its initscript (as root 'invoke-rc.d puppet stop') | 23:59 |
| fungi | remember not to start the puppet agent daemon using sudo because of broken mysql module | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!