| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove fedora-26 nodesets https://review.openstack.org/565914 | 00:00 |
|---|---|---|
| *** wendar has quit IRC | 00:07 | |
| ianw | ok, initial backup of review01 all done | 00:11 |
| ianw | core/signal.c: In function ‘uwsgi_register_signal’: | 00:15 |
| ianw | in my day, gcc outputted plain old ascii, and that's the way we liked it | 00:16 |
| pabelanger | :) | 00:16 |
| ianw | we wore an onion on our belt, which was the style at the time ... | 00:16 |
| *** lbragstad has quit IRC | 00:17 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove legacy-ubuntu-xenial-3-node https://review.openstack.org/565918 | 00:18 |
| *** dingyichen has joined #openstack-infra | 00:20 | |
| ianw | it might be worth figuring out how to get uwsgi doing linux any wheels. it's not something i've looked at before | 00:21 |
| *** wendar has joined #openstack-infra | 00:23 | |
| *** mriedem_inlaws has quit IRC | 00:23 | |
| clarkb | aiui the basic idea is you build them against a really minimal rhel5 like base set of libs | 00:24 |
| clarkb | and they have a docker image they publish to build thrm in | 00:25 |
| pabelanger | clarkb: you might be looking a ze02 which is old format, ze02_openstack_org is right one | 00:25 |
| pabelanger | also, do you mind a review on https://review.openstack.org/564506/ to fix gerrit periodic jobs | 00:25 |
| ianw | clarkb: right, i'm assuming someone has plugged this into github releases/travis-ci etc | 00:26 |
| ianw | fungi: when around, https://review.openstack.org/#/c/541791/ is a little fix for git-review and later gerrits. we still can't really test later gerrits with git-review because of https://review.openstack.org/#/c/552288/ but the change is probably worth review | 00:29 |
| ianw | https://github.com/joerick/cibuildwheel looks promising | 00:30 |
| *** yamamoto has joined #openstack-infra | 00:36 | |
| ianw | and to wrap it up ... https://github.com/unbit/uwsgi/blob/54f6d87aea896eff3ae3410758faed69fb170690/.travis.yml#L37 is why it's all too hard i guess. too many libraries. if only there was a concise and portable way those libraries could be listed, perhaps in a formatted text file with the project | 00:36 |
| pabelanger | IRK | 00:39 |
| pabelanger | IKR* | 00:39 |
| pabelanger | speaking of wheels, I just pushed up https://github.com/Infinidat/munch/pull/32 to have munch start producing them | 00:39 |
| *** mriedem has joined #openstack-infra | 00:41 | |
| *** yamamoto has quit IRC | 00:41 | |
| *** camunoz has quit IRC | 00:44 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-website master: WIP: Add logo and move menu to top right https://review.openstack.org/565909 | 00:45 |
| *** r-daneel has joined #openstack-infra | 00:46 | |
| ianw | sudo $apxs -i -c mod_proxy_uwsgi.c <--- ok, so that's my confusion over uwsgi ... we're actually building the apache module directly. i knew there was something odd | 00:46 |
| *** r-daneel_ has joined #openstack-infra | 00:49 | |
| *** r-daneel has quit IRC | 00:50 | |
| *** r-daneel_ is now known as r-daneel | 00:50 | |
| pabelanger | clarkb: corvus: fungi: following up here, I am not 100% but I think the job results table on review is now missing: https://review.openstack.org/#/c/565550/ | 00:53 |
| pabelanger | i am not exactly sure where to look to confirm that | 00:53 |
| clarkb | it loads js in the header content for the website | 00:55 |
| clarkb | I would start by opening your browser debugger and see if that js is loaded | 00:55 |
| pabelanger | hmm, see a syntax error | 00:57 |
| pabelanger | Syntax error, unrecognized expression: :visible: | 00:57 |
| pabelanger | lets see what the googles says | 00:58 |
| pabelanger | libjs-jquery 1.11.3+dfsg-4 | 00:59 |
| pabelanger | is now installed | 00:59 |
| pabelanger | maybe we're now using removed function | 00:59 |
| tristanC | pabelanger: for this version, you need to have ':visible' without the trailing ':' | 01:02 |
| clarkb | huh | 01:02 |
| clarkb | its in system-config iirc if you want to push a patch tristanC | 01:02 |
| clarkb | or pabelanger | 01:03 |
| pabelanger | I'm trying to see if I can test that in browser | 01:03 |
| pabelanger | but have no idea what I am doing :) | 01:03 |
| tristanC | clarkb: but the question is why the previous server had a different jquery installed? | 01:03 |
| *** sai_ has quit IRC | 01:03 | |
| clarkb | tristanC: probably because it was an older version of ubuntu | 01:04 |
| pabelanger | ya, trusty was 1.7.2+dfsg-2ubuntu1 | 01:05 |
| *** threestrands has joined #openstack-infra | 01:05 | |
| *** sai_ has joined #openstack-infra | 01:06 | |
| pabelanger | I can fix system-config, but unsure how to test it | 01:06 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/system-config master: hideci: fix compatibility with jquery>=v1.11 https://review.openstack.org/565924 | 01:06 |
| *** r-daneel has quit IRC | 01:06 | |
| pabelanger | tristanC: thanks +2 | 01:06 |
| *** yamahata has quit IRC | 01:08 | |
| clarkb | +2 as well but nit approving as I cant watch it this evening | 01:08 |
| clarkb | need to make dinner | 01:08 |
| pabelanger | ianw: maybe if you have time^ otherwise, I'll have time first thing in the morning | 01:09 |
| ianw | pabelanger: oh, yep, i'll watch it when it goes through | 01:10 |
| pabelanger | great | 01:12 |
| *** aeng has joined #openstack-infra | 01:13 | |
| *** zhangfei has joined #openstack-infra | 01:18 | |
| *** Guest10014 is now known as jlvillal | 01:19 | |
| *** namnh has joined #openstack-infra | 01:31 | |
| *** namnh has quit IRC | 01:31 | |
| *** rosmaita has quit IRC | 01:32 | |
| *** Nil_ has quit IRC | 01:34 | |
| *** yamamoto has joined #openstack-infra | 01:38 | |
| *** dpawlik has joined #openstack-infra | 01:44 | |
| *** yamamoto has quit IRC | 01:44 | |
| openstackgerrit | Merged openstack-infra/system-config master: hideci: fix compatibility with jquery>=v1.11 https://review.openstack.org/565924 | 01:47 |
| *** dpawlik has quit IRC | 01:48 | |
| *** yamamoto has joined #openstack-infra | 01:50 | |
| *** r-daneel has joined #openstack-infra | 01:53 | |
| *** gcb has joined #openstack-infra | 02:00 | |
| *** hongbin has joined #openstack-infra | 02:12 | |
| *** annp has joined #openstack-infra | 02:12 | |
| tristanC | ianw: not sure why, but gerrit may still be referencing the old hidejs script, perhaps a gerrit restart would fix this | 02:15 |
| *** psachin has joined #openstack-infra | 02:17 | |
| *** lbragstad has joined #openstack-infra | 02:24 | |
| *** dchen has joined #openstack-infra | 02:35 | |
| mnaser | tristanC: I think we need to wait for puppet to do a pass on infra which happens every hour or so to update that file | 02:44 |
| tristanC | mnaser: the file has been updated, but for somereason gerrit is adding the md5sum of the previous version | 02:51 |
| *** mriedem has quit IRC | 02:52 | |
| *** spsurya has joined #openstack-infra | 02:54 | |
| ianw | tristanC: oh, hmmm, i think i know something about that, but i can't remember what that is :) let me check my logs | 03:02 |
| ianw | Jun 17 12:33:54 <jhesketh> ianw: right, sometimes that doesn't work and we don't know why | 03:05 |
| ianw | Jun 17 12:34:07 <jhesketh> ianw: the solution is to just touch the header | 03:05 |
| *** honza has quit IRC | 03:06 | |
| tristanC | ianw: do you want a noop review on the GerritHeader or can you touch it through ssh? | 03:09 |
| *** dpawlik has joined #openstack-infra | 03:10 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/system-config master: hideci: touch the GerritSiteHeader https://review.openstack.org/565944 | 03:10 |
| ianw | tristanC: ok, just did that :) i think it's looking happier | 03:12 |
| *** dpawlik has quit IRC | 03:14 | |
| ianw | heh, we alreay have the reload i suggested in the puppet | 03:19 |
| *** nicolasbock has quit IRC | 03:21 | |
| *** ramishra has joined #openstack-infra | 03:32 | |
| *** hamzy has joined #openstack-infra | 03:34 | |
| *** eernst has joined #openstack-infra | 03:34 | |
| *** udesale has joined #openstack-infra | 03:36 | |
| *** Gorian has quit IRC | 03:36 | |
| *** namnh has joined #openstack-infra | 03:38 | |
| *** Gorian has joined #openstack-infra | 03:41 | |
| *** zhangfei has quit IRC | 03:41 | |
| *** hongbin has quit IRC | 03:42 | |
| dmsimard | pabelanger: just got a sudo failure for gerrit wanting to do a touch on hideci.js ? | 03:44 |
| dmsimard | on review01 | 03:44 |
| *** lpetrut has joined #openstack-infra | 03:44 | |
| *** jogo has quit IRC | 03:45 | |
| *** janki has joined #openstack-infra | 03:47 | |
| *** jogo has joined #openstack-infra | 03:50 | |
| *** jogo has joined #openstack-infra | 03:50 | |
| *** eernst has quit IRC | 03:52 | |
| *** zhangfei has joined #openstack-infra | 03:53 | |
| *** eernst has joined #openstack-infra | 03:57 | |
| *** jchhatbar has joined #openstack-infra | 04:00 | |
| *** germs has quit IRC | 04:02 | |
| *** janki has quit IRC | 04:03 | |
| openstackgerrit | Merged openstack-infra/zuul master: Update documentation URLs https://review.openstack.org/565910 | 04:11 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Don't create db accounts unencrypted https://review.openstack.org/565948 | 04:15 |
| *** kjackal has joined #openstack-infra | 04:17 | |
| *** lpetrut has quit IRC | 04:18 | |
| *** eernst has quit IRC | 04:20 | |
| *** lpetrut has joined #openstack-infra | 04:21 | |
| *** ykarel has joined #openstack-infra | 04:27 | |
| *** jpena|off has quit IRC | 04:29 | |
| *** ssbarnea has quit IRC | 04:29 | |
| *** weshay has quit IRC | 04:29 | |
| *** rasca has quit IRC | 04:30 | |
| *** rnoriega_ has quit IRC | 04:31 | |
| *** haleyb_ has quit IRC | 04:31 | |
| *** betherly_ has quit IRC | 04:31 | |
| *** dmanchad has quit IRC | 04:31 | |
| *** radez has quit IRC | 04:31 | |
| *** jpena|off has joined #openstack-infra | 04:31 | |
| *** pabelanger has quit IRC | 04:31 | |
| *** nhicher has quit IRC | 04:31 | |
| *** ltomasbo has quit IRC | 04:31 | |
| *** rook has quit IRC | 04:31 | |
| *** ssbarnea has joined #openstack-infra | 04:32 | |
| *** pabelanger has joined #openstack-infra | 04:32 | |
| *** pgadiya has joined #openstack-infra | 04:32 | |
| *** nhicher has joined #openstack-infra | 04:32 | |
| *** rnoriega has joined #openstack-infra | 04:33 | |
| *** radez has joined #openstack-infra | 04:33 | |
| *** dchen has quit IRC | 04:34 | |
| *** pgadiya has quit IRC | 04:34 | |
| *** haleyb has joined #openstack-infra | 04:34 | |
| *** rook has joined #openstack-infra | 04:34 | |
| *** rook is now known as Guest94983 | 04:34 | |
| *** weshay has joined #openstack-infra | 04:35 | |
| *** betherly_ has joined #openstack-infra | 04:35 | |
| *** rasca has joined #openstack-infra | 04:36 | |
| *** dchen has joined #openstack-infra | 04:36 | |
| *** dmanchad has joined #openstack-infra | 04:38 | |
| *** ianychoi_ has joined #openstack-infra | 04:38 | |
| *** gema has quit IRC | 04:40 | |
| *** gema has joined #openstack-infra | 04:41 | |
| *** ianychoi has quit IRC | 04:41 | |
| *** gyee has quit IRC | 04:41 | |
| *** lpetrut has quit IRC | 04:43 | |
| *** links has joined #openstack-infra | 04:46 | |
| ianw | dmsimard: ahhh, that would explain it! | 04:55 |
| *** sree_ has joined #openstack-infra | 04:56 | |
| *** sree_ is now known as Guest41888 | 04:57 | |
| ianw | dmsimard: oh, no it wouldn't. yeah that was me | 04:57 |
| ianw | i was thinking somehow the puppet call doing that might have been running as gerrit2 | 04:57 |
| *** Guest41888 has quit IRC | 04:57 | |
| *** dhajare has joined #openstack-infra | 04:59 | |
| *** e0ne has joined #openstack-infra | 05:03 | |
| *** e0ne has quit IRC | 05:03 | |
| *** aeng has quit IRC | 05:04 | |
| *** yamahata has joined #openstack-infra | 05:06 | |
| *** markvoelker has quit IRC | 05:08 | |
| *** dchen has quit IRC | 05:11 | |
| *** dpawlik has joined #openstack-infra | 05:11 | |
| *** dpawlik has quit IRC | 05:15 | |
| *** dchen has joined #openstack-infra | 05:19 | |
| *** dingyichen has quit IRC | 05:20 | |
| *** dchen has quit IRC | 05:20 | |
| *** dingyichen has joined #openstack-infra | 05:20 | |
| *** Douhet has quit IRC | 05:26 | |
| *** armaan has joined #openstack-infra | 05:28 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Add tox-py36 jobs https://review.openstack.org/565881 | 05:31 |
| *** sree_ has joined #openstack-infra | 05:34 | |
| *** sree_ is now known as Guest22258 | 05:34 | |
| *** wolverineav has joined #openstack-infra | 05:34 | |
| *** iranzo has joined #openstack-infra | 05:36 | |
| *** quiquell|off is now known as quiquell|rover | 05:45 | |
| *** quiquell|rover is now known as quiquell | 05:46 | |
| *** pcichy has joined #openstack-infra | 05:51 | |
| *** wolverineav has quit IRC | 05:52 | |
| *** jtomasek has quit IRC | 05:59 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/565966 | 06:02 |
| *** dchen has joined #openstack-infra | 06:06 | |
| *** dingyichen has quit IRC | 06:08 | |
| *** markvoelker has joined #openstack-infra | 06:09 | |
| *** jtomasek has joined #openstack-infra | 06:11 | |
| *** Douhet has joined #openstack-infra | 06:14 | |
| *** andreas_s has joined #openstack-infra | 06:16 | |
| openstackgerrit | Merged openstack-infra/zuul master: Don't create db accounts unencrypted https://review.openstack.org/565948 | 06:18 |
| *** jtomasek has quit IRC | 06:18 | |
| *** jtomasek has joined #openstack-infra | 06:19 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul master: Do not fail so early on missing required-projects https://review.openstack.org/565973 | 06:19 |
| *** dchen has quit IRC | 06:21 | |
| *** dingyichen has joined #openstack-infra | 06:21 | |
| openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/565966 | 06:21 |
| *** kjackal has quit IRC | 06:23 | |
| *** aojea has joined #openstack-infra | 06:25 | |
| *** kjackal has joined #openstack-infra | 06:29 | |
| *** lpetrut has joined #openstack-infra | 06:29 | |
| *** dhajare has quit IRC | 06:37 | |
| *** markvoelker has quit IRC | 06:44 | |
| *** dhajare has joined #openstack-infra | 06:51 | |
| *** eumel8 has joined #openstack-infra | 06:52 | |
| *** pcaruana has joined #openstack-infra | 06:53 | |
| *** rcernin has quit IRC | 06:58 | |
| *** threestrands has quit IRC | 06:58 | |
| *** ccamacho has joined #openstack-infra | 06:58 | |
| *** ianychoi_ is now known as ianychoi | 07:00 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: WIP: test required project not found error https://review.openstack.org/565979 | 07:07 |
| *** sshnaidm|rover has quit IRC | 07:08 | |
| *** dpawlik has joined #openstack-infra | 07:12 | |
| *** quiquell is now known as quiquell|afk | 07:12 | |
| *** jbadiapa has joined #openstack-infra | 07:16 | |
| *** dpawlik has quit IRC | 07:16 | |
| *** dhajare has quit IRC | 07:17 | |
| *** tesseract has joined #openstack-infra | 07:18 | |
| *** kjackal has quit IRC | 07:25 | |
| *** kjackal has joined #openstack-infra | 07:25 | |
| *** florianf has joined #openstack-infra | 07:28 | |
| *** tosky has joined #openstack-infra | 07:29 | |
| *** quiquell|afk is now known as quiquell | 07:29 | |
| *** ssbarnea_ has joined #openstack-infra | 07:30 | |
| *** ssbarnea_ has quit IRC | 07:31 | |
| *** Hal has joined #openstack-infra | 07:35 | |
| *** jpena|off is now known as jpena | 07:35 | |
| *** Hal is now known as Guest94375 | 07:35 | |
| *** ykarel is now known as ykarel|lunch | 07:38 | |
| *** markvoelker has joined #openstack-infra | 07:41 | |
| *** alexchadin has joined #openstack-infra | 07:43 | |
| *** ssbarnea_ has joined #openstack-infra | 07:44 | |
| *** zhangfei has quit IRC | 07:45 | |
| *** apetrich_ has joined #openstack-infra | 07:50 | |
| *** amoralej|off is now known as amoralej | 07:50 | |
| *** dhajare has joined #openstack-infra | 07:54 | |
| *** jpich has joined #openstack-infra | 07:55 | |
| *** sshnaidm|rover has joined #openstack-infra | 07:55 | |
| *** electrofelix has joined #openstack-infra | 07:57 | |
| *** zhangfei has joined #openstack-infra | 07:58 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Don't validate references for excluded config items https://review.openstack.org/565973 | 07:58 |
| *** hs365 has joined #openstack-infra | 08:05 | |
| *** ramishra_ has joined #openstack-infra | 08:06 | |
| *** ramishra has quit IRC | 08:07 | |
| *** shardy has joined #openstack-infra | 08:08 | |
| *** hs366 has quit IRC | 08:09 | |
| *** gfidente has joined #openstack-infra | 08:13 | |
| *** gfidente has joined #openstack-infra | 08:13 | |
| *** markvoelker has quit IRC | 08:13 | |
| *** yamahata has quit IRC | 08:14 | |
| *** wolverineav has joined #openstack-infra | 08:15 | |
| *** lucas-afk is now known as lucasagomes | 08:17 | |
| *** ykarel|lunch is now known as ykarel | 08:25 | |
| *** wolverineav has quit IRC | 08:27 | |
| *** alexchad_ has joined #openstack-infra | 08:27 | |
| *** wolverineav has joined #openstack-infra | 08:28 | |
| *** alexchadin has quit IRC | 08:31 | |
| *** e0ne has joined #openstack-infra | 08:31 | |
| *** wolverineav has quit IRC | 08:32 | |
| *** derekh has joined #openstack-infra | 08:36 | |
| *** hs365 has quit IRC | 08:39 | |
| *** hs367 has joined #openstack-infra | 08:39 | |
| *** dingyichen has quit IRC | 08:42 | |
| *** links has quit IRC | 08:43 | |
| *** links has joined #openstack-infra | 08:44 | |
| *** Guest22258 has quit IRC | 08:45 | |
| *** hemna_ has quit IRC | 08:46 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Only emit parent-change-enqueued if needed https://review.openstack.org/563194 | 08:48 |
| *** namnh has quit IRC | 08:48 | |
| *** namnh has joined #openstack-infra | 08:48 | |
| *** slaweq has quit IRC | 08:56 | |
| *** slaweq has joined #openstack-infra | 08:57 | |
| *** jrist has quit IRC | 08:57 | |
| *** dbecker has joined #openstack-infra | 08:58 | |
| *** jrist has joined #openstack-infra | 09:01 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add tox-py36 job https://review.openstack.org/565884 | 09:03 |
| *** markvoelker has joined #openstack-infra | 09:10 | |
| *** apetrich_ has quit IRC | 09:11 | |
| *** dpawlik has joined #openstack-infra | 09:13 | |
| *** dpawlik has quit IRC | 09:17 | |
| openstackgerrit | Merged openstack-infra/zuul master: Trivial: Update pypi url to new url https://review.openstack.org/563248 | 09:27 |
| *** zoli is now known as zoli|lunch | 09:30 | |
| *** khappone has joined #openstack-infra | 09:32 | |
| *** khappone_ has quit IRC | 09:36 | |
| *** pbourke has joined #openstack-infra | 09:42 | |
| openstackgerrit | Tobias Urdin proposed openstack-infra/system-config master: Add puppetlabs apt puppet5 pool https://review.openstack.org/565867 | 09:43 |
| *** markvoelker has quit IRC | 09:44 | |
| *** yolanda_ has joined #openstack-infra | 09:49 | |
| *** yolanda has quit IRC | 09:51 | |
| *** yolanda has joined #openstack-infra | 09:56 | |
| *** yolanda_ has quit IRC | 09:59 | |
| *** ramishra_ has quit IRC | 10:02 | |
| *** yolanda has quit IRC | 10:02 | |
| *** ramishra has joined #openstack-infra | 10:03 | |
| *** alexchad_ has quit IRC | 10:07 | |
| *** Guest94375 has quit IRC | 10:10 | |
| *** namnh has quit IRC | 10:11 | |
| *** pcichy has quit IRC | 10:12 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Extend github testing using app auth https://review.openstack.org/563297 | 10:12 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Test parent-change-enqueued with github https://review.openstack.org/563242 | 10:12 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Optionally record created github clients in tests https://review.openstack.org/563402 | 10:12 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Limit search scope of getChangesDependingOn to tenant https://review.openstack.org/563196 | 10:13 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Remove getPullBySha from FakeGithubConnection https://review.openstack.org/563416 | 10:13 |
| *** kjackal has quit IRC | 10:14 | |
| *** yolanda has joined #openstack-infra | 10:15 | |
| *** yamamoto has quit IRC | 10:21 | |
| *** yolanda has quit IRC | 10:25 | |
| *** verdurin has joined #openstack-infra | 10:28 | |
| *** nicolasbock has joined #openstack-infra | 10:31 | |
| *** edmondsw has joined #openstack-infra | 10:31 | |
| *** edmondsw has quit IRC | 10:36 | |
| *** yamamoto has joined #openstack-infra | 10:37 | |
| *** yolanda has joined #openstack-infra | 10:39 | |
| *** annp has quit IRC | 10:40 | |
| *** markvoelker has joined #openstack-infra | 10:41 | |
| *** alexchadin has joined #openstack-infra | 10:44 | |
| *** alexchadin has quit IRC | 10:49 | |
| *** dtantsur|afk is now known as dtantsur | 10:50 | |
| *** alexchadin has joined #openstack-infra | 10:54 | |
| *** jpena is now known as jpena|lunch | 10:58 | |
| *** slaweq has quit IRC | 10:58 | |
| *** apetrich_ has joined #openstack-infra | 11:00 | |
| *** apetrich has quit IRC | 11:05 | |
| *** persia has joined #openstack-infra | 11:06 | |
| openstackgerrit | Luke Hinds proposed openstack-infra/project-config master: Ends project gating for Bandit https://review.openstack.org/566028 | 11:09 |
| *** lucasagomes is now known as lucas-hungry | 11:10 | |
| *** apetrich_ has quit IRC | 11:10 | |
| *** slaweq has joined #openstack-infra | 11:10 | |
| *** zoli|lunch is now known as zoli | 11:13 | |
| *** markvoelker has quit IRC | 11:14 | |
| *** slaweq has quit IRC | 11:15 | |
| *** zhangfei has quit IRC | 11:18 | |
| *** jcoufal has joined #openstack-infra | 11:22 | |
| *** kjackal has joined #openstack-infra | 11:28 | |
| *** hs367 has quit IRC | 11:28 | |
| *** panda|off is now known as panda|lunch | 11:33 | |
| *** kjackal has quit IRC | 11:36 | |
| *** kjackal has joined #openstack-infra | 11:36 | |
| *** ldnunes has joined #openstack-infra | 11:39 | |
| *** yamamoto has quit IRC | 11:48 | |
| *** rosmaita has joined #openstack-infra | 11:48 | |
| *** eharney has quit IRC | 11:49 | |
| *** jamesmcarthur has joined #openstack-infra | 11:52 | |
| *** salv-orlando has joined #openstack-infra | 11:53 | |
| *** amoralej is now known as amoralej|off | 11:53 | |
| *** amoralej|off is now known as amoralej|lunch | 11:54 | |
| *** yamamoto has joined #openstack-infra | 11:55 | |
| *** yamamoto_ has joined #openstack-infra | 11:56 | |
| *** quiquell is now known as quiquell|lunch | 11:56 | |
| *** yamamoto_ has quit IRC | 11:57 | |
| *** salv-orlando has quit IRC | 11:58 | |
| *** yamamoto_ has joined #openstack-infra | 11:59 | |
| *** yamamoto has quit IRC | 12:00 | |
| *** armaan has quit IRC | 12:00 | |
| *** armaan has joined #openstack-infra | 12:01 | |
| *** wolverineav has joined #openstack-infra | 12:01 | |
| *** yamamoto_ has quit IRC | 12:02 | |
| *** kjackal has quit IRC | 12:03 | |
| *** sshnaidm|rover is now known as sshnaidm|rover|a | 12:08 | |
| *** sshnaidm|rover|a is now known as sshnaidm|rover | 12:09 | |
| *** gcb has quit IRC | 12:09 | |
| *** tpsilva has joined #openstack-infra | 12:11 | |
| *** jpena|lunch is now known as jpena | 12:11 | |
| *** markvoelker has joined #openstack-infra | 12:11 | |
| *** yamamoto has joined #openstack-infra | 12:13 | |
| *** quiquell|lunch is now known as quiquell | 12:16 | |
| *** edmondsw has joined #openstack-infra | 12:16 | |
| *** lucas-hungry is now known as lucasagomes | 12:16 | |
| *** panda|lunch is now known as panda | 12:17 | |
| *** apetrich has joined #openstack-infra | 12:19 | |
| *** markvoelker has quit IRC | 12:20 | |
| *** markvoelker has joined #openstack-infra | 12:20 | |
| *** yamamoto has quit IRC | 12:20 | |
| *** yamamoto has joined #openstack-infra | 12:21 | |
| *** yamamoto has quit IRC | 12:26 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Improve test output on assertHistory fail https://review.openstack.org/566048 | 12:28 |
| *** njohnston has quit IRC | 12:29 | |
| *** njohnston has joined #openstack-infra | 12:31 | |
| *** rlandy has joined #openstack-infra | 12:34 | |
| openstackgerrit | Fatih Degirmenci proposed openstack-infra/zuul master: Add CentOS 7 environment setup instructions https://review.openstack.org/564948 | 12:39 |
| *** Hal has joined #openstack-infra | 12:52 | |
| *** kgiusti has joined #openstack-infra | 12:52 | |
| *** Hal is now known as Guest59082 | 12:52 | |
| *** armaan has quit IRC | 12:54 | |
| openstackgerrit | Luke Hinds proposed openstack-infra/project-config master: Ends project gating for Bandit https://review.openstack.org/566028 | 12:55 |
| *** nicolasbock has quit IRC | 12:57 | |
| *** yolanda has quit IRC | 12:57 | |
| *** beagles is now known as beagles_mtg | 12:57 | |
| *** psachin has quit IRC | 12:59 | |
| *** kjackal has joined #openstack-infra | 13:00 | |
| *** jchhatbar has quit IRC | 13:02 | |
| *** bobh has joined #openstack-infra | 13:05 | |
| *** honza has joined #openstack-infra | 13:06 | |
| *** honza is now known as Guest95224 | 13:07 | |
| *** zoli is now known as zoli|afk | 13:07 | |
| *** Guest95224 is now known as honza_ | 13:07 | |
| *** zoli|afk is now known as zoli | 13:07 | |
| *** slaweq has joined #openstack-infra | 13:10 | |
| *** yamamoto has joined #openstack-infra | 13:11 | |
| *** yolanda has joined #openstack-infra | 13:11 | |
| *** dpawlik has joined #openstack-infra | 13:12 | |
| *** nicolasbock has joined #openstack-infra | 13:14 | |
| *** Goneri has joined #openstack-infra | 13:14 | |
| *** slaweq has quit IRC | 13:16 | |
| *** dpawlik has quit IRC | 13:17 | |
| *** yamamoto has quit IRC | 13:17 | |
| *** yamamoto has joined #openstack-infra | 13:17 | |
| *** slaweq has joined #openstack-infra | 13:19 | |
| *** mriedem has joined #openstack-infra | 13:20 | |
| *** dhill_ has joined #openstack-infra | 13:20 | |
| *** yamamoto has quit IRC | 13:22 | |
| *** amoralej|lunch is now known as amoralej | 13:26 | |
| *** ykarel is now known as ykarel|away | 13:27 | |
| *** eumel8 has quit IRC | 13:28 | |
| *** VW has joined #openstack-infra | 13:30 | |
| *** agopi has quit IRC | 13:31 | |
| *** eharney has joined #openstack-infra | 13:32 | |
| *** ykarel|away has quit IRC | 13:32 | |
| *** dayou_ has joined #openstack-infra | 13:44 | |
| *** pcichy has joined #openstack-infra | 13:46 | |
| *** ssbarnea_ has quit IRC | 13:59 | |
| *** rajinir has joined #openstack-infra | 14:00 | |
| *** annp has joined #openstack-infra | 14:02 | |
| *** jamesmcarthur has quit IRC | 14:02 | |
| *** agopi has joined #openstack-infra | 14:02 | |
| *** esberglu has joined #openstack-infra | 14:06 | |
| *** hemna_ has joined #openstack-infra | 14:06 | |
| *** eernst has joined #openstack-infra | 14:07 | |
| *** andreas_s has quit IRC | 14:10 | |
| *** beagles_mtg is now known as beagles | 14:13 | |
| *** andreas_s has joined #openstack-infra | 14:14 | |
| esberglu | Hi! PowerVM CI has been having connection issues between jenkins and nodepool nodes. | 14:16 |
| esberglu | Seeing errors like here https://wiki.jenkins.io/display/JENKINS/Remoting+issue | 14:16 |
| esberglu | This started happening after upgrading our cloud from ocata to queens | 14:17 |
| esberglu | Anyone here run into this before or have any ideas? | 14:18 |
| *** yolanda has quit IRC | 14:19 | |
| *** yamamoto has joined #openstack-infra | 14:20 | |
| *** honza_ is now known as honza | 14:21 | |
| *** rkukura has joined #openstack-infra | 14:22 | |
| *** apetrich has quit IRC | 14:23 | |
| *** esberglu has quit IRC | 14:23 | |
| pabelanger | you may want to try in #openstack-third-party-ci to see if any others have seen this issue, we haven't been running jenkins for a while now. | 14:24 |
| *** hongbin has joined #openstack-infra | 14:24 | |
| *** sshnaidm|rover is now known as sshnaidm|afk | 14:26 | |
| *** mikal has quit IRC | 14:27 | |
| fungi | i was about to suggest it could be related to the gerrit ip address change, but they're already gone | 14:31 |
| fungi | and they don't appear to have popped into #openstack-third-party-ci yet either | 14:32 |
| *** esberglu has joined #openstack-infra | 14:34 | |
| *** pabelanger has quit IRC | 14:35 | |
| *** pabelanger has joined #openstack-infra | 14:35 | |
| *** esberglu_ has joined #openstack-infra | 14:36 | |
| *** r-daneel has quit IRC | 14:36 | |
| *** dayou_ has quit IRC | 14:37 | |
| *** germs has joined #openstack-infra | 14:38 | |
| *** germs has quit IRC | 14:38 | |
| *** germs has joined #openstack-infra | 14:38 | |
| *** kaisers has quit IRC | 14:38 | |
| *** germs has quit IRC | 14:39 | |
| *** kaisers has joined #openstack-infra | 14:39 | |
| *** germs has joined #openstack-infra | 14:39 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add promote pipeline https://review.openstack.org/566089 | 14:40 |
| *** esberglu has quit IRC | 14:40 | |
| fungi | ooh! | 14:40 |
| *** esberglu_ is now known as esberglu | 14:40 | |
| rcarrillocruz | o_O | 14:42 |
| rcarrillocruz | i'm curious about ^ | 14:42 |
| *** kiennt26 has joined #openstack-infra | 14:43 | |
| *** yamamoto has quit IRC | 14:46 | |
| *** _d34dh0r53_ is now known as d34dh0r53 | 14:46 | |
| fungi | hrm, looking back more carefully at what esberglu said, it was between jenkins and slaves, not jenkins and gerrit, so not going to be related to the gerrit maintenance yesterday anyway | 14:48 |
| *** alexchadin has quit IRC | 14:49 | |
| *** mikal has joined #openstack-infra | 14:50 | |
| mnaser | hey infra, is there a document about where the pre-cached files in images are located? | 14:53 |
| *** yolanda has joined #openstack-infra | 14:53 | |
| mnaser | hitting timeouts downloading cirros so want to know where it's located, we're checking /home/zuul/cache/files/cirros-0.4.0-x86_64-disk.img presently | 14:53 |
| *** afazekas_ has quit IRC | 14:54 | |
| *** Nil_ has joined #openstack-infra | 14:58 | |
| *** afazekas has joined #openstack-infra | 14:58 | |
| *** r-daneel has joined #openstack-infra | 14:59 | |
| openstackgerrit | Merged openstack-infra/project-config master: Ends project gating for Bandit https://review.openstack.org/566028 | 15:00 |
| *** yamahata has joined #openstack-infra | 15:00 | |
| *** links has quit IRC | 15:06 | |
| pabelanger | mnaser: /opt/cache/files/ | 15:07 |
| pabelanger | mnaser: you can see our build logs: http://nb01.openstack.org/centos-7-0000009028.log | 15:07 |
| *** jamesmcarthur has joined #openstack-infra | 15:09 | |
| mnaser | pabelanger: oh, sweet, thank you | 15:11 |
| *** dhajare has quit IRC | 15:12 | |
| mnaser | pabelanger: https://review.openstack.org/566095 Switch to using the cached version of CirrOS thanks ;) | 15:13 |
| *** dpawlik has joined #openstack-infra | 15:13 | |
| *** slaweq has quit IRC | 15:17 | |
| *** dpawlik has quit IRC | 15:17 | |
| *** annp has quit IRC | 15:20 | |
| *** janki has joined #openstack-infra | 15:24 | |
| *** ccamacho has quit IRC | 15:24 | |
| *** ccamacho1 has joined #openstack-infra | 15:24 | |
| *** andreas_s has quit IRC | 15:27 | |
| *** andreas_s has joined #openstack-infra | 15:28 | |
| *** pblaho has quit IRC | 15:31 | |
| *** apetrich has joined #openstack-infra | 15:33 | |
| *** ccamacho1 has quit IRC | 15:35 | |
| *** andreas_s has quit IRC | 15:37 | |
| *** e0ne has quit IRC | 15:40 | |
| mwhahaha | hey folks, can someone add the tripleo-core to the tripleo-ha-utils group in gerrit for me? we added the repo but we forgot to ask to have someone added to it | 15:40 |
| *** slaweq has joined #openstack-infra | 15:40 | |
| *** felipemonteiro__ has joined #openstack-infra | 15:41 | |
| *** andreas_s has joined #openstack-infra | 15:42 | |
| *** ssbarnea_ has joined #openstack-infra | 15:43 | |
| *** yamamoto has joined #openstack-infra | 15:44 | |
| *** felipemonteiro_ has quit IRC | 15:45 | |
| *** auristor1 has quit IRC | 15:47 | |
| *** gyee has joined #openstack-infra | 15:47 | |
| *** auristor has joined #openstack-infra | 15:49 | |
| *** pcaruana has quit IRC | 15:50 | |
| *** bdodd has joined #openstack-infra | 15:52 | |
| clarkb | mwhahaha: looking | 15:54 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: WIP: Add fedora mirror to nodepool dsvm jobs https://review.openstack.org/566102 | 15:55 |
| clarkb | mwhahaha: done | 15:55 |
| mwhahaha | clarkb: thanks | 15:55 |
| *** yamamoto has quit IRC | 15:55 | |
| *** hamzy has quit IRC | 15:56 | |
| *** andreas_s has quit IRC | 15:56 | |
| *** kiennt26 has quit IRC | 15:57 | |
| *** panda is now known as panda|off | 15:57 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-website master: Add logo and move menu to top right https://review.openstack.org/565909 | 16:01 |
| *** andreas_s has joined #openstack-infra | 16:01 | |
| *** quiquell is now known as quiquell|off | 16:02 | |
| *** yolanda has quit IRC | 16:06 | |
| *** andreas_s has quit IRC | 16:10 | |
| openstackgerrit | Merged openstack-infra/zuul master: Don't validate references for excluded config items https://review.openstack.org/565973 | 16:11 |
| *** yamahata has quit IRC | 16:12 | |
| openstackgerrit | Merged openstack-infra/zuul-website master: Replace background image https://review.openstack.org/565908 | 16:15 |
| *** felipemonteiro__ has quit IRC | 16:17 | |
| *** felipemonteiro_ has joined #openstack-infra | 16:17 | |
| weshay | corvus, thanks for fixing up zuul w/ regards to the python-tripleoclient :) | 16:17 |
| *** pbourke has quit IRC | 16:17 | |
| weshay | repo | 16:17 |
| *** pbourke has joined #openstack-infra | 16:19 | |
| clarkb | pabelanger: as a followup to your question about java 8 and memory re review.o.o yesterday. Melody reports what appears to be really good memory consumption after a day of use. mean use is 10GB and max is 20GB | 16:20 |
| clarkb | pabelanger: we should keep an eye on it but that looks good to start | 16:20 |
| *** andreas_s has joined #openstack-infra | 16:20 | |
| *** lpetrut_ has joined #openstack-infra | 16:21 | |
| pabelanger | clarkb: do you remember the numbers on java 7? | 16:22 |
| clarkb | pabelanger: not for ~18 hours after a restart but steady state was basically max at the limit of assigned heap space ~48GB with gc going up and down not too far below that | 16:23 |
| clarkb | pabelanger: checking what the numbers look like in a week or two will probably be a good indicator | 16:23 |
| pabelanger | yah, lets hope it holds out! | 16:23 |
| corvus | weshay: np, thanks for finding the bug :) | 16:24 |
| *** lpetrut has quit IRC | 16:25 | |
| *** lpetrut_ has quit IRC | 16:26 | |
| clarkb | pabelanger: iirc melody shoves all this data in /tmp so we lost the old content when we moved servers. We can try to extract the old data if we really need it but I don't think we do (since new server isn't acting improperly) | 16:27 |
| *** ramishra has quit IRC | 16:27 | |
| *** tesseract has quit IRC | 16:28 | |
| *** hongbin has quit IRC | 16:28 | |
| *** hongbin has joined #openstack-infra | 16:29 | |
| *** slaweq has quit IRC | 16:29 | |
| *** slaweq has joined #openstack-infra | 16:29 | |
| *** slaweq has quit IRC | 16:30 | |
| pabelanger | Yah, rolling forward seems like a fine idea | 16:30 |
| *** andreas_s has quit IRC | 16:35 | |
| *** jd_ has quit IRC | 16:38 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove legacy-ubuntu-xenial-3-node https://review.openstack.org/565918 | 16:44 |
| pabelanger | one step forward to removing another legacy node from ozj | 16:45 |
| *** andreas_s has joined #openstack-infra | 16:49 | |
| *** yamahata has joined #openstack-infra | 16:50 | |
| *** notmyname has quit IRC | 16:50 | |
| *** jamesmcarthur has quit IRC | 16:50 | |
| *** thedac has quit IRC | 16:51 | |
| clarkb | corvus: does our use of github project zuul config exclusions mean we should prioritize a scheduler restart for 565973? | 16:51 |
| clarkb | corvus: I think we've largely avoided trouble by those projects not having zuul configs of their own at this point? | 16:51 |
| *** notmyname has joined #openstack-infra | 16:51 | |
| *** pfalleno1 has quit IRC | 16:51 | |
| *** pfallenop has joined #openstack-infra | 16:52 | |
| *** yolanda has joined #openstack-infra | 16:53 | |
| *** jamesmcarthur has joined #openstack-infra | 16:54 | |
| *** rpioso is now known as rpioso|eat | 16:55 | |
| *** andreas_s has quit IRC | 16:55 | |
| clarkb | maybe that means it isn't urgent for us | 16:56 |
| *** thedac has joined #openstack-infra | 16:56 | |
| *** jamesmcarthur has quit IRC | 16:57 | |
| *** tesseract has joined #openstack-infra | 16:57 | |
| *** derekh has quit IRC | 16:59 | |
| *** yolanda_ has joined #openstack-infra | 17:01 | |
| *** jpena is now known as jpena|off | 17:01 | |
| *** dtantsur is now known as dtantsur|afk | 17:02 | |
| *** shardy has quit IRC | 17:03 | |
| *** hamzy has joined #openstack-infra | 17:03 | |
| clarkb | infra-root I'd appreciate your thoughts on https://review.openstack.org/#/c/564338/ mordred may find that particularly interesting. Basicalyl remove localhost from default kick.sh host list to avoid inadverdent restoration of puppeting | 17:03 |
| *** yolanda has quit IRC | 17:04 | |
| *** yolanda has joined #openstack-infra | 17:05 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: WIP: Add fedora mirror to nodepool dsvm jobs https://review.openstack.org/566102 | 17:05 |
| *** lucasagomes is now known as lucas-afk | 17:08 | |
| *** yolanda_ has quit IRC | 17:08 | |
| mordred | clarkb: ++ | 17:09 |
| *** jpich has quit IRC | 17:10 | |
| *** slaweq has joined #openstack-infra | 17:11 | |
| pabelanger | wfm | 17:11 |
| corvus | clarkb: let's say we should definitely do it by eod friday :) | 17:12 |
| corvus | (restart) | 17:13 |
| *** dpawlik has joined #openstack-infra | 17:14 | |
| *** ssbarnea_ has quit IRC | 17:14 | |
| clarkb | corvus: ok | 17:15 |
| *** slaweq has quit IRC | 17:16 | |
| *** e0ne has joined #openstack-infra | 17:16 | |
| *** trown is now known as trown|lunch | 17:17 | |
| *** dpawlik has quit IRC | 17:18 | |
| *** e0ne has quit IRC | 17:18 | |
| *** dhajare has joined #openstack-infra | 17:22 | |
| *** janki has quit IRC | 17:24 | |
| *** jd_ has joined #openstack-infra | 17:25 | |
| *** tesseract has quit IRC | 17:25 | |
| *** jamesmcarthur has joined #openstack-infra | 17:26 | |
| *** jamesmcarthur has quit IRC | 17:34 | |
| *** e0ne has joined #openstack-infra | 17:37 | |
| *** shaner has quit IRC | 17:41 | |
| *** florianf has quit IRC | 17:41 | |
| *** shaner has joined #openstack-infra | 17:42 | |
| *** spsurya has quit IRC | 17:42 | |
| *** VW_ has joined #openstack-infra | 17:46 | |
| *** shaner has quit IRC | 17:48 | |
| *** VW has quit IRC | 17:49 | |
| *** VW_ has quit IRC | 17:50 | |
| *** VW has joined #openstack-infra | 17:50 | |
| *** udesale has quit IRC | 17:50 | |
| openstackgerrit | Merged openstack-infra/project-config master: Adding networking-ansible to the project list https://review.openstack.org/565370 | 17:50 |
| *** Guest94983 is now known as rook | 17:54 | |
| *** jd_ has quit IRC | 17:56 | |
| *** jd_ has joined #openstack-infra | 17:56 | |
| *** zoli is now known as zoli|goe | 17:57 | |
| *** zoli|goe is now known as zoli|gone | 17:57 | |
| *** zoli|gone is now known as zoli | 17:58 | |
| *** kjackal has quit IRC | 18:07 | |
| *** kjackal has joined #openstack-infra | 18:07 | |
| *** SumitNaiksatam has joined #openstack-infra | 18:08 | |
| *** shaner has joined #openstack-infra | 18:10 | |
| *** VW has quit IRC | 18:15 | |
| *** kjackal has quit IRC | 18:15 | |
| *** shaner has quit IRC | 18:15 | |
| *** VW has joined #openstack-infra | 18:16 | |
| *** VW_ has joined #openstack-infra | 18:17 | |
| *** VW has quit IRC | 18:17 | |
| *** SumitNaiksatam has quit IRC | 18:18 | |
| frickler | ouch, sounds like spectre isn't over yet https://www.heise.de/ct/artikel/Exclusive-Spectre-NG-Multiple-new-Intel-CPU-flaws-revealed-several-serious-4040648.html | 18:19 |
| clarkb | frickler: that picture makes me think I'm better off not knowing :) | 18:19 |
| Ng | Oh good. Days of IRC highlights for me from that one ;) | 18:20 |
| Ng | Thanks Intel! | 18:20 |
| *** yolanda has quit IRC | 18:20 | |
| *** aojea has quit IRC | 18:21 | |
| *** VW_ has quit IRC | 18:22 | |
| *** shaner has joined #openstack-infra | 18:22 | |
| frickler | Ng: sorry, didn't even notice your nick before | 18:22 |
| Ng | np, I’m used to it ;) | 18:22 |
| Ng | At least rsyslog mostly replaces syslog-ng | 18:23 |
| anteaya | Ng, have a told you before you selected a horrible nick | 18:23 |
| Ng | anteaya: 14 year old me has no regrets | 18:23 |
| anteaya | ha ha ha | 18:23 |
| *** auristor has quit IRC | 18:24 | |
| *** jamesmcarthur has joined #openstack-infra | 18:26 | |
| fungi | i don't recall you being especially spectre-like anyway | 18:27 |
| *** auristor has joined #openstack-infra | 18:27 | |
| dhellmann | config-core: can I get another review on this patch to create the constellations repo? I don't mind waiting to set up the publishing jobs until pkovar gives a +1 on the second patch but I would like to move ahead with setting up the review team while we have some momentum on it. https://review.openstack.org/#/c/565498/ | 18:29 |
| *** trown|lunch is now known as trown | 18:29 | |
| clarkb | oh good I've already reviewed it | 18:30 |
| dhellmann | yes, thanks, clarkb | 18:30 |
| clarkb | fwiw I've been trying to make semi regular passes through project-config and ozj reviews so that AJaeger_away doesn't have to do it all | 18:30 |
| mnaser | dhellmann: +A and we can leave the one above of it once we decide on ownership of the group | 18:30 |
| dhellmann | mnaser : perfect, thanks! | 18:31 |
| *** jamesmcarthur has quit IRC | 18:31 | |
| mnaser | ill make some project config passes i guess | 18:31 |
| dhellmann | that's all "decided" we just need to document it properly with pkovar's +1 on that second patch | 18:31 |
| mnaser | dhellmann: perfect, sounds good | 18:31 |
| mnaser | dhellmann: feel free to ping me when we're at that stage | 18:31 |
| dhellmann | cool, thanks | 18:31 |
| *** dhajare has quit IRC | 18:33 | |
| openstackgerrit | Anita Kuno proposed openstack-infra/system-config master: This patch impliments the survey spec: I3c389596373b94459a32a4e540d514a2941acbb1 https://review.openstack.org/557979 | 18:33 |
| *** rpioso|eat is now known as rpioso | 18:34 | |
| *** pcrews has quit IRC | 18:34 | |
| anteaya | fungi but he is very next generation | 18:34 |
| *** auristor has quit IRC | 18:35 | |
| *** yolanda has joined #openstack-infra | 18:35 | |
| *** pcrews has joined #openstack-infra | 18:36 | |
| openstackgerrit | Merged openstack-infra/project-config master: create constellations repository https://review.openstack.org/565498 | 18:37 |
| *** felipemonteiro__ has joined #openstack-infra | 18:39 | |
| *** amoralej is now known as amoralej|off | 18:42 | |
| *** felipemonteiro_ has quit IRC | 18:42 | |
| *** iranzo has quit IRC | 18:42 | |
| *** auristor has joined #openstack-infra | 18:43 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool master: Fix test patching of clouds.yaml file locations https://review.openstack.org/566138 | 18:47 |
| *** auristor has quit IRC | 18:53 | |
| *** shaner has joined #openstack-infra | 18:53 | |
| *** rkukura has quit IRC | 18:54 | |
| *** eharney has quit IRC | 18:54 | |
| *** jamesmcarthur has joined #openstack-infra | 18:57 | |
| *** jamesmcarthur has quit IRC | 19:01 | |
| mordred | look it's an Ng | 19:01 |
| Ng | hey mordred :) | 19:02 |
| *** hashar has joined #openstack-infra | 19:04 | |
| *** openstackgerrit has quit IRC | 19:05 | |
| mnaser | hmm | 19:06 |
| mnaser | openstackgerrit died? | 19:06 |
| clarkb | certainly looks like closed connection and not a channel part | 19:07 |
| clarkb | pabelanger: ^ is that related to your gerrit stuff? | 19:07 |
| pabelanger | I haven't done anything with gerrit today | 19:13 |
| pabelanger | let me look | 19:13 |
| pabelanger | mnaser: clarkb: I still see gerritbot running on review01.o.o | 19:15 |
| *** dpawlik has joined #openstack-infra | 19:15 | |
| pabelanger | maybe just left channel because of limit? | 19:16 |
| pabelanger | I see it in #tripleo | 19:16 |
| pabelanger | I think it will join back when a new review is pushed up | 19:16 |
| *** VW has joined #openstack-infra | 19:18 | |
| *** openstackgerrit has joined #openstack-infra | 19:19 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: DNM - testing gerritbot https://review.openstack.org/566146 | 19:19 |
| pabelanger | mnaser: clarkb: yah, that looks to be it | 19:19 |
| *** dpawlik has quit IRC | 19:19 | |
| clarkb | huh ut shows as connection closed? maybe that is the bot supplied message | 19:20 |
| *** felipemonteiro_ has joined #openstack-infra | 19:21 | |
| *** felipemonteiro__ has quit IRC | 19:21 | |
| *** slaweq has joined #openstack-infra | 19:21 | |
| *** slaweq has quit IRC | 19:22 | |
| *** slaweq has joined #openstack-infra | 19:22 | |
| *** jamesmcarthur has joined #openstack-infra | 19:23 | |
| *** jamesmcarthur has quit IRC | 19:24 | |
| *** jamesmcarthur has joined #openstack-infra | 19:24 | |
| *** ssbarnea_ has joined #openstack-infra | 19:29 | |
| *** zzzeek_ has quit IRC | 19:35 | |
| *** zzzeek has joined #openstack-infra | 19:37 | |
| *** jamesmcarthur has quit IRC | 19:38 | |
| *** stevebaker has quit IRC | 19:47 | |
| *** pcichy has quit IRC | 19:49 | |
| *** stevebaker has joined #openstack-infra | 19:49 | |
| *** eharney has joined #openstack-infra | 19:49 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool master: Fix test patching of clouds.yaml file locations https://review.openstack.org/566138 | 19:50 |
| *** gfidente has quit IRC | 19:52 | |
| *** camunoz has joined #openstack-infra | 19:52 | |
| *** ssbarnea_ has quit IRC | 19:54 | |
| *** ssbarnea_ has joined #openstack-infra | 19:55 | |
| dhellmann | it looks like the openstack/constellations repo was created, but gerrit doesn't know about it. That's not how I remember things going before, did something go wrong? | 20:05 |
| dhellmann | https://review.openstack.org/#/admin/projects/?filter=openstack%252Fconstellations | 20:05 |
| dhellmann | the new group doesn't exist, either, but I can clone the empty repo | 20:05 |
| clarkb | dhellmann: where are you cloning from? | 20:08 |
| dhellmann | https://git.openstack.org/openstack/constellations | 20:08 |
| dhellmann | git says "warning: You appear to have cloned an empty repository." and it is and should be | 20:08 |
| clarkb | we set up the repo on the git mirrors first so that gerrit can replicate into them. I'm guessing the gerrit side of the creation failed. I'll take a look | 20:09 |
| dhellmann | clarkb : the usual answer here is that I wasn't patient enough for some job to finish | 20:09 |
| dhellmann | I don't know what job to be looking for though :-) | 20:09 |
| *** VW_ has joined #openstack-infra | 20:10 | |
| clarkb | puppet drives this. And it appears to be quite broken | 20:10 |
| clarkb | pabelanger: ^ I think this is fallout from our migration of the server | 20:10 |
| dhellmann | oh, right, I forgot about that | 20:11 |
| clarkb | http://paste.openstack.org/show/720321/ couple of issues there | 20:11 |
| *** VW has quit IRC | 20:13 | |
| *** e0ne has quit IRC | 20:15 | |
| clarkb | infra-root ^ I'm a bit confused by that. The manage_projects logs show that its cloning things into /opt/lib/jeepyb for its cache but if I look in that dir there isn't any content | 20:17 |
| clarkb | also I think paramiko in jeepyb is leaking ssh connections. I'm going to start by fixing that one as its more clear to me | 20:19 |
| *** wolverineav has quit IRC | 20:19 | |
| *** wolverineav has joined #openstack-infra | 20:20 | |
| *** agopi is now known as agopi|out | 20:23 | |
| pabelanger | looking | 20:23 |
| *** wolverineav has quit IRC | 20:24 | |
| pabelanger | 2018-05-03 06:36:19,746: jeepyb.utils - INFO - Executing command: git clone ssh://review01.openstack.org:29418/openstack-infra/gerritbot /opt/lib/jeepyb/openstack-infra/gerritbot | 20:24 |
| pabelanger | I wonder if that needs to be review.o.o | 20:24 |
| *** auristor has joined #openstack-infra | 20:25 | |
| clarkb | I think at least part of the problem is our project caceh file is out of date | 20:26 |
| clarkb | because it was in /opt so didn't get copied in the volume move | 20:26 |
| clarkb | so we're rebuilding taht from scratch | 20:26 |
| pabelanger | Ah, I see | 20:26 |
| clarkb | and in doing so we're leaking enough resources that things go boom | 20:27 |
| clarkb | I still don't understand the fsck failures. We didn't have them thena ll of a sedden they started. Maybe the clones over ssh are at fault? | 20:27 |
| *** agopi|out has quit IRC | 20:27 | |
| clarkb | I'm only a little concerned that the bad cache data might cause us to overwrite a repo | 20:27 |
| pabelanger | yah, I think we fix paramiko first, we most not be closing the sessing on __del__, which was needed 2.0+ | 20:28 |
| pabelanger | we had that issue on nodepool a while back | 20:29 |
| *** VW_ has quit IRC | 20:29 | |
| corvus | yeah sounds like that one again | 20:29 |
| clarkb | ya we aren't I'm working on that patch now | 20:29 |
| *** VW has joined #openstack-infra | 20:30 | |
| *** kgiusti has left #openstack-infra | 20:30 | |
| *** weshay is now known as weshay|rover | 20:30 | |
| *** VW has quit IRC | 20:30 | |
| *** VW has joined #openstack-infra | 20:31 | |
| corvus | clarkb: i too think we need to answer the question "are we about to (or have we already) pushed old project data to gerrit?" | 20:31 |
| corvus | i'm looking at code/logs trying to figure that out | 20:32 |
| clarkb | corvus: thanks, my initial reading was that we didn't | 20:32 |
| clarkb | but we should double check | 20:32 |
| corvus | clarkb: do you know why we didn't? | 20:32 |
| clarkb | corvus: ya we do a listProjects and then only create projects if not in the list projects | 20:32 |
| clarkb | and I think we only push data if we've created the project | 20:33 |
| clarkb | so as long as ls-projects returns an accurate and compelte list I think we are ok | 20:33 |
| corvus | clarkb: but the congress-tempest-plugin failed only 1 line before "push_to_gerrit" | 20:33 |
| clarkb | oh the shutil rm tree there may explain why those dirs are not on disk | 20:34 |
| corvus | clarkb: oh, you reckon make_local_copy will have returned None for the push_string for that, so we won't do the push | 20:34 |
| clarkb | maybe? | 20:35 |
| clarkb | I'm not sure I'm a fan of how complicated it is to figure out if jeepyb will overwrite data :/ | 20:35 |
| *** eernst has quit IRC | 20:36 | |
| clarkb | but also those clones should be from gerrit so would be a short window where it may delete things | 20:36 |
| *** eernst has joined #openstack-infra | 20:36 | |
| clarkb | basically would require us to clone, zuul to merge a patch, then for us to push back over as if that patch wasn't merged | 20:36 |
| corvus | the log has no 'git push'es other than to refs/meta/config | 20:36 |
| clarkb | cool | 20:37 |
| *** kjackal has joined #openstack-infra | 20:37 | |
| corvus | and yeah... apparently we really do delete the repo at the end of the process | 20:39 |
| corvus | (in the finally clause in manage_projects.py) | 20:39 |
| corvus | so that explains the empty dirs | 20:39 |
| openstackgerrit | Clark Boylan proposed openstack-infra/gerritlib master: Close ssh connections when done with them https://review.openstack.org/566157 | 20:39 |
| clarkb | I think ^ may be the simplest fix for the ssh problems | 20:40 |
| clarkb | untested thoguh. I guess I'll test it locally | 20:40 |
| corvus | clarkb: i think the only remaining question is what about the fsck? a local clone of congress-tempest-plugin and git fsck works | 20:40 |
| clarkb | corvus: maybe the clone is failing due to the ssh connection limit | 20:41 |
| clarkb | but we aren't raising there and so it continues | 20:41 |
| corvus | clarkb: plausible | 20:42 |
| corvus | clarkb: yeah, i don't think we check the output of the clone command | 20:42 |
| corvus | clarkb: i'm satisfied that the ssh connection fix is the only one needed | 20:43 |
| clarkb | gerritlib is not python3 safe in case anyone was wondering | 20:44 |
| clarkb | but it created an error and netstat says my connection went to TIME_WAIT so I think that means the explciit close is working | 20:45 |
| clarkb | I'll redo with python2 and double check | 20:45 |
| clarkb | ya it seems to work locally | 20:47 |
| pabelanger | will we need to tag a new release for jeepby to pick it up? | 20:48 |
| clarkb | pabelanger: new gerritlib release then update the lib on review.o.o | 20:48 |
| pabelanger | kk | 20:48 |
| clarkb | then probably manually invoke manage-projects against constellations and that congress project and make sure both sets of fails are happy then run it against the entire list? | 20:48 |
| clarkb | corvus: your ssh fix is only needed satisfaction implies you don't think we'll affect gerrit side state inappropriately? | 20:49 |
| pabelanger | clarkb: +1 to order | 20:50 |
| clarkb | we might also need to clear out the leaked ssh connections | 20:50 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool master: Use openstacksdk instead of os-client-config https://review.openstack.org/566158 | 20:50 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool master: Remove use of six https://review.openstack.org/566159 | 20:50 |
| clarkb | though those may go away when the process quits | 20:50 |
| pabelanger | clarkb: I'll have to duck out here in a few minutes, but will be back in a few hours to help if needed | 20:51 |
| clarkb | ok | 20:51 |
| *** andreas_s has joined #openstack-infra | 20:53 | |
| *** hamzy has quit IRC | 20:53 | |
| openstackgerrit | Merged openstack-infra/gerritlib master: Close ssh connections when done with them https://review.openstack.org/566157 | 20:54 |
| clarkb | looks like we would want an 0.8.1 release | 20:54 |
| clarkb | anyone else want to give that the greenlight and I'll go find my key? | 20:55 |
| clarkb | (or want to do additional testing first?) | 20:55 |
| mordred | clarkb: 0.8.1 release sounds good to me | 20:56 |
| *** andreas_s has quit IRC | 20:57 | |
| clarkb | I'm also going to put review01 back into the emergency file now so that we don't have new projects or project updates interfere with untangling this | 20:58 |
| clarkb | that is done | 20:58 |
| corvus | clarkb: correct, i think we're safe to resume operations with that fix | 21:00 |
| corvus | clarkb: agree regarding release | 21:00 |
| clarkb | 0.8.1 tag pushed. | 21:03 |
| *** agopi|out has joined #openstack-infra | 21:03 | |
| clarkb | I'll work on updating gerritlib and running manage projects one project at a time for a couple projects to build confidence in it then I guess run it against the entire set | 21:04 |
| clarkb | (would appreciate extra eyeballs on that process while I do it) | 21:04 |
| *** trown is now known as trown|outtypewww | 21:06 | |
| *** VW_ has joined #openstack-infra | 21:07 | |
| clarkb | going to run pip install -U /opt/jeepyb since that apepars to be how we would normally update gerritlib | 21:10 |
| *** VW has quit IRC | 21:11 | |
| clarkb | unrelated but apparently the kernel runs a charger_manager process thing | 21:11 |
| clarkb | super useful in the cloud | 21:11 |
| *** wolverineav has joined #openstack-infra | 21:12 | |
| *** VW_ has quit IRC | 21:13 | |
| *** dtruong_ has quit IRC | 21:13 | |
| ianw | pabelanger: if you get a sec want to look at puppetlabs puppet5 mirror in https://review.openstack.org/#/c/565867/2 ... i can babysit a run of it to be sure | 21:13 |
| *** Goneri has quit IRC | 21:14 | |
| *** ldnunes has quit IRC | 21:15 | |
| *** edmondsw has quit IRC | 21:15 | |
| clarkb | pip doesn/t see 0.8.1 yet so that isn't working. Also noticed that becuse we weren't installing newer gerritlib it upgraded paramiko to >2.0.0 when gerritlib has < 2.0.0 in its requirements | 21:16 |
| *** dpawlik has joined #openstack-infra | 21:16 | |
| clarkb | whihc may be source of the problem | 21:16 |
| *** edmondsw has joined #openstack-infra | 21:16 | |
| *** dpawlik has quit IRC | 21:21 | |
| *** edmondsw has quit IRC | 21:21 | |
| clarkb | ok if I passed --no-cache-dir it found the newer gerritlib | 21:21 |
| clarkb | I'm going to run `/usr/local/bin/manage-projects -v -l /var/log/manage_projects.log openstack/congress-tempest-plugin` momentarily | 21:22 |
| clarkb | ok that seemed to work. Going to run the aboe command but swapping project out for constellations | 21:26 |
| *** esberglu has quit IRC | 21:26 | |
| clarkb | dhellmann: ok I think that sorted out your repo | 21:27 |
| clarkb | infra-root you ready for me to run it without a project restriction and let it update teh cache info for all the projects? | 21:27 |
| dhellmann | clarkb : it does seem to have. Can you add me to https://review.openstack.org/#/admin/groups/1904,members when things settle down, please | 21:28 |
| clarkb | dhellmann: ya I actually found a bug though | 21:28 |
| clarkb | dhellmann: http://git.openstack.org/cgit/openstack/constellations/tree/.gitreview#n2 should be review.o.o not review01.o.o | 21:28 |
| clarkb | dhellmann: you'll probably want to make that your first commit. Sorry | 21:28 |
| dhellmann | np, I can do that as soon as I have permission to land something :-) | 21:29 |
| dhellmann | https://review.openstack.org/566169 | 21:30 |
| clarkb | dhellmann: done | 21:30 |
| *** jtomasek has quit IRC | 21:30 | |
| clarkb | I'm going to sort that out before running it against the whole list in case ther are other new projects that need that fix | 21:30 |
| dhellmann | clarkb ty | 21:31 |
| * fungi is back... isp at the house has been offline for >1.5 hours already but wireless modem is working in a pinch | 21:33 | |
| clarkb | fungi: I'll have a patch for you to review momentarily | 21:33 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Fix the gerrit-host used by jeepyb config https://review.openstack.org/566170 | 21:35 |
| clarkb | infra-root ^ that should fix jeepyb manage_projects writing the wrong gerrit host value in .gitreview files | 21:36 |
| clarkb | we'll want that in before doing any more manage projects runs | 21:36 |
| *** esberglu has joined #openstack-infra | 21:39 | |
| fungi | cool, caught up with scrollback and reviewing now. exciting hour i missed! | 21:39 |
| clarkb | I guess I'll have to manually apply that change once it merges since I have the host in the emergency file | 21:44 |
| clarkb | openstack/networking-ansible is another new project yet to be created. I will test ^ on that to make sure its happy and makes a correct .gitreview | 21:51 |
| *** yamamoto has joined #openstack-infra | 21:53 | |
| tonyb | I know it's not really an infra question, but are y'all aware of any problems with login.ubuntu.com ? I'm trying to login (duh) and I keep getting "Bad bot, go away! Request aborted." | 21:55 |
| * tonyb is not a bot! | 21:55 | |
| *** jcoufal has quit IRC | 21:55 | |
| *** wolverineav has quit IRC | 21:55 | |
| clarkb | tonyb: you are the first person to report anything. Try incognito mode maybe? | 21:56 |
| clarkb | if it persists you may need to ask canonical/launchpad directly | 21:56 |
| *** kjackal has quit IRC | 21:56 | |
| tonyb | clarkb: okay same deal, so I'll ask canonical | 21:57 |
| fungi | tonyb: i highly recomment #launchpad | 21:57 |
| *** yamamoto has quit IRC | 21:57 | |
| tonyb | fungi: thanks | 21:59 |
| fungi | recommend too | 21:59 |
| tonyb | Is this right? http://git.openstack.org/cgit/openstack/constellations/tree/.gitreview#n2 | 22:04 |
| tonyb | my clone/update all the things script didn't like it | 22:05 |
| clarkb | tonyb: no, see scrollback :) tldr the move of the gerrit server updated the config in a bad way and I just fixed it above | 22:05 |
| clarkb | or rather think it is fixed and new projects shouldn't have that problem I will confirm on openstack/networking-ansible once it merges | 22:05 |
| tonyb | clarkb: Oh okay. Oh look there it is sorry | 22:06 |
| *** eharney has quit IRC | 22:06 | |
| clarkb | tonyb: dhellmann has a patch up to fix it in that particular project | 22:06 |
| tonyb | clarkb: cool. I'll just rm -rf my clone and let it do the right thiing on the next run | 22:06 |
| dhellmann | I approved it, so it should merge | 22:06 |
| dhellmann | although I guess we need zuul to know about that repo first? | 22:06 |
| clarkb | dhellmann: ya you may need to get that in first | 22:06 |
| dhellmann | let me split the patch that adds the publishing job out so we can get the no-op jobs | 22:07 |
| *** rcernin has joined #openstack-infra | 22:07 | |
| *** hashar has quit IRC | 22:08 | |
| openstackgerrit | Merged openstack-infra/system-config master: Fix the gerrit-host used by jeepyb config https://review.openstack.org/566170 | 22:08 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: add basic jobs for constellations repository https://review.openstack.org/565499 | 22:09 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: publish constellations https://review.openstack.org/566176 | 22:09 |
| dhellmann | clarkb , tonyb : ^^ | 22:09 |
| *** mriedem is now known as mrjazzercise | 22:09 | |
| dhellmann | clarkb : it seems I'm missing something there, but I don't know what | 22:10 |
| dhellmann | which is the "main configuration file"? | 22:10 |
| clarkb | dhellmann: I think because gerrit failed to create the project when we tried to tell zuul about it zuul also didn't get the memo | 22:10 |
| dhellmann | aha | 22:10 |
| clarkb | corvus: ^ can you confirm and is the proper action there to reload the zuul-scheduler? | 22:10 |
| *** bobh has quit IRC | 22:11 | |
| clarkb | let me create the new ansible project before we do that though | 22:11 |
| *** eernst has quit IRC | 22:11 | |
| clarkb | ok that one had an upstream so wouldn't test making a .gitreview | 22:14 |
| clarkb | but it seems to have worked | 22:15 |
| fungi | so we're probably in the clear now? | 22:15 |
| fungi | (for approving more new projects i mean) | 22:15 |
| clarkb | fungi: no we need to do a full run of manage projects and make sure it doesn't push anything unexpected | 22:15 |
| fungi | oh, got it | 22:16 |
| clarkb | then we have to remove review01 from the emergency file | 22:16 |
| clarkb | then we should make sure zuul is aware of these new projects | 22:16 |
| fungi | seems like the next step is a safe one anyway | 22:16 |
| clarkb | fungi: you are round if I run the full manage projects now? | 22:16 |
| *** eernst has joined #openstack-infra | 22:16 | |
| clarkb | fungi: ya corvus reviewed the code and doesn't expect the lack fo a cache to cause us problems | 22:16 |
| fungi | i am (working from a wireless modem but around) | 22:16 |
| * fungi shakes fist at flaky island isp | 22:16 | |
| clarkb | ok I'm going to run it and it will log to the normal log file if you want to tail that | 22:16 |
| clarkb | I did get /usr/local/lib/python2.7/dist-packages/paramiko/client.py:685: UserWarning: Unknown ssh-rsa host key for [review.openstack.org]:29418 | 22:17 |
| clarkb | did pabelanger's update of the ssh host keys merge? | 22:17 |
| fungi | i thought so... checking | 22:17 |
| clarkb | I'll wait on the main run | 22:17 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-website master: Add community page https://review.openstack.org/566179 | 22:17 |
| clarkb | fungi: basically we want to do a foreground run to make sure that the ssh connection leak is gone and that we don't push anything unexpected | 22:18 |
| corvus | clarkb: yes, a full scheduler reload (sighup) should take care ofi t | 22:19 |
| corvus | clarkb: want me to do that now? | 22:19 |
| clarkb | corvus: I think it is safe to do now ya (the two known outstanding projects are in | 22:19 |
| * dhellmann read sighup as "sigh up" | 22:20 | |
| corvus | now i'll never read it any other way | 22:20 |
| clarkb | fungi: looks like the ssh host keys were for zuul | 22:21 |
| clarkb | fungi: gerrit doesn't seem to have gotten that. I think I'll manually accept the key for now? | 22:21 |
| dhellmann | funny, it it had been all caps I would have probably just matched the pattern without really reading it :-) | 22:21 |
| fungi | https://review.openstack.org/565864 hasn't merged, but that only seems to cover review.o.o known_hosts entries for zuul servers? | 22:22 |
| corvus | if you don't yell the signals in all caps, the app might not hear them | 22:22 |
| clarkb | fungi: ya that | 22:22 |
| fungi | clarkb: i suppose accept it for now, but it would be good to figure out if we've puppeted that file | 22:23 |
| *** slaweq has quit IRC | 22:23 | |
| clarkb | hrm seems like its accepted at least from here | 22:23 |
| fungi | clarkb: oh! | 22:23 |
| clarkb | let me try rerun manage_projects against a single node and see if I get the same warning | 22:23 |
| fungi | this is a connection to localhost | 22:24 |
| fungi | i be we just never puppeted it at all | 22:24 |
| clarkb | fungi: yes but not via the name localhost | 22:24 |
| clarkb | ya wouldn't surprise me | 22:24 |
| fungi | right, but it's not an address change it's complaining about | 22:24 |
| clarkb | I'm going to rerun against constellations which should be a noop but it should still ssh to determine that | 22:24 |
| fungi | i think it must have been manually accepted on previous gerrit servers and so lost when we moved to a new one | 22:24 |
| fungi | cool | 22:25 |
| clarkb | ya no warning this time. I think because the ip and key matched just the name chagned it may have auto accepted? | 22:25 |
| corvus | dhellmann, clarkb: 2018-05-03 22:25:29,062 INFO zuul.Scheduler: Full reconfiguration complete | 22:25 |
| corvus | dhellmann: should be good to recheck | 22:25 |
| * dhellmann crosses his fingers | 22:26 | |
| clarkb | fungi: corvus you good for me to run manage_projects against all the projects now? | 22:26 |
| corvus | clarkb: ++ | 22:26 |
| clarkb | ok I'll have ti write to the normal log file so you can easily watch it | 22:26 |
| clarkb | it is running | 22:27 |
| fungi | sounds good, but fair warning, i have to move my wireless modem to a different machine if i want to be able to ssh into openstack servers (only takes a few minutes so happy to if/when needed) | 22:27 |
| clarkb | looks like it is updating acls in puppet-* repos | 22:28 |
| fungi | i should work out a solution for just plugging the wireless modem into my openbsd firewall here at the house, but worried christine would try to netflix through it then ;) | 22:28 |
| clarkb | I'm not sure what we changed there | 22:28 |
| clarkb | I guess I can check the git log | 22:28 |
| corvus | clarkb: i thought it was doing that to all the repos earlier | 22:29 |
| clarkb | corvus: it was | 22:29 |
| clarkb | corvus: it may just be nooping too? | 22:29 |
| corvus | yeah maybe? | 22:29 |
| clarkb | https://git.openstack.org/cgit/openstack-infra/puppet-redis/commit/project.config?h=refs/meta/config&id=682b315f13a06f4eae591ed00573a653e53afef9 | 22:30 |
| fungi | i take it no change to the last modified timestamp of any files in the git repo on disk? | 22:30 |
| clarkb | fungi: its definitely updating the git repo meta/config ref | 22:30 |
| *** rlandy is now known as rlandy|bbl | 22:30 | |
| fungi | ahh | 22:30 |
| clarkb | that diff looks ok to me | 22:31 |
| corvus | yeah i just saw the same in the bashate config | 22:31 |
| corvus | https://git.openstack.org/cgit/openstack-dev/bashate/commit/project.config?h=refs/meta/config&id=8e4b4a9852d7dcce78261a2ecf691e808f3df2e4 | 22:31 |
| corvus | i guess we're killing all tabs for some reason | 22:31 |
| fungi | oh, right, gerrit helpfully indents the configuration for you | 22:31 |
| corvus | what's with allowSuperproject? | 22:31 |
| fungi | and is adding that superproject entry for the openstack/openstack repo | 22:31 |
| fungi | which we maybe ought to look into ditching | 22:32 |
| corvus | is that going to break openstack/openstack? | 22:32 |
| clarkb | https://git.openstack.org/cgit/openstack-infra/puppet-redis/commit/project.config?h=refs/meta/config&id=e10bb73871ee339d338e2da8af5d6499d4f2da87 | 22:32 |
| clarkb | looks like gerrit added it itself | 22:32 |
| corvus | fungi: it's removing that entry, right? | 22:32 |
| clarkb | corvus: yes it is removing the entry | 22:32 |
| clarkb | corvus: it may break openstack/openstack | 22:32 |
| fungi | jeepyb is removing it i believe, yes | 22:32 |
| clarkb | I think we want to manage that directly either way so not the end of the world | 22:32 |
| fungi | though openstack/openstack has been fairly broken for years i thought | 22:32 |
| clarkb | we'll just have to add it back in if necessary | 22:32 |
| corvus | so it was added july 2017, and now it's being removed (presumably because there's no cache) | 22:32 |
| fungi | when we determined that there was no good way to extend it to cover additional repositoires | 22:33 |
| corvus | fungi: i thought it's just been plugging along | 22:33 |
| fungi | oh, has it? how have we been adding new openstack deliverables to it? last time i tried, the change sat there indefinitely because it's not a reviewable project | 22:34 |
| corvus | though, to be fair, it looks like it only has project-config? | 22:34 |
| corvus | fungi: well, at one point it was the release manager's job to add things | 22:34 |
| clarkb | corvus: ya I think because there is no cache we don't have the data to say this project is up to date which means check directly and since there is a delta between what gerrit has and what we have in config its pushing what we have in config over what gerrit has | 22:34 |
| corvus | fungi: if they have abdicated, i'm unaware | 22:34 |
| fungi | best i could figure out we had to amend the submodules list in openstack/openstack which we don't have a good way to do | 22:34 |
| *** slaweq has joined #openstack-infra | 22:35 | |
| corvus | https://review.openstack.org/#/admin/projects/openstack/openstack,access | 22:35 |
| fungi | but maybe the way is something other than code review? | 22:35 |
| corvus | i thought it was code review | 22:35 |
| corvus | my guess is that no one cares, and the people who know about it think it's broken. and regardless of whether they were before, they're about to be right. :) | 22:36 |
| clarkb | https://git.openstack.org/cgit/openstack/openstack/commit/?id=ae3bc0ff7f7141d6f95da57a982fcfaeb3828f94 looks like its updating things from more than project-config | 22:36 |
| corvus | (personally, i still think it's a neat idea, and perhaps it would make sense to put project submodules in there grouped by constellation -- thereby solving the "what goes in there?" problem) | 22:38 |
| clarkb | corvus: and if we do that explicitly add the allow super project config to the canonical config | 22:38 |
| fungi | mmm, yeah looks like openstack/openstack has the noop-jobs template so should in theory be reviewable | 22:38 |
| clarkb | it is a bit annoying that gerrit would silentyl rewrite that for you behind the scenes | 22:38 |
| corvus | at any rate, i reckon someone should fix it or kill it :) | 22:38 |
| dmsimard | infra-root: oi, ara 0.15.0 is tagged. I'll babysit executors and logs.o.o. | 22:38 |
| corvus | clarkb: yeah, i suspect we never noticed that, and therefore, probably any project that *used* to be in openstack/openstack silently got dropped if/when someone updated its acl file | 22:39 |
| clarkb | other than that I've not seen anything in the logs indicating weirdness. Alsocinder is done and a spot check of that repo manually looks happy | 22:39 |
| clarkb | corvus: ya | 22:39 |
| fungi | https://review.openstack.org/344585 appears to be the most recent attempt to update openstack/openstack | 22:41 |
| fungi | but yeah, the fact that adding submodule configuration in one repo updates the config of another repo to add a superproject section runs sort of at odds with how we've got manage-projects designed | 22:42 |
| * mordred suggested we consider updating openstack/openstack as part of the release process to the release team recently, but it was more of a "hey, maybe we shoudl think about this" | 22:42 | |
| clarkb | `grep push /var/log/manage_projects.log | grep -v meta` shows only networking-ansible and constellations which is good | 22:42 |
| dhellmann | mordred : I'm not against the idea, I would just like to know that someone actually uses it before we go to the trouble. | 22:43 |
| mordred | yah - totally | 22:43 |
| *** felipemonteiro__ has joined #openstack-infra | 22:43 | |
| dhellmann | for some reason I thought we were updating that repo every time something in the integrated gate merged | 22:44 |
| *** felipemonteiro__ has quit IRC | 22:44 | |
| *** felipemonteiro__ has joined #openstack-infra | 22:44 | |
| mordred | yah - that's a thing that goes on - but managing the submodules that are in it is another story | 22:45 |
| fungi | the integrated gate queue is sort of a nebulous thing given that it's partly defined by job matching | 22:45 |
| dhellmann | yeah | 22:45 |
| mordred | and it's not really things in the integrated gate - the last time we updated the submodules list in that repo it was "every official openstack repo" | 22:45 |
| mordred | so everything in the integrated gate - plus many other things | 22:46 |
| fungi | it would make more sense to define openstack/openstack based on governance metadata or release metadata | 22:46 |
| mordred | yup | 22:46 |
| fungi | so all official deliverables with this set of governance tags, or all official deliverables with these release models | 22:46 |
| * fungi waves kermit arms | 22:47 | |
| mordred | that was the most recent idea we discussed - make a thing that was driven by governance metadata that updated the submodules in the repo as things changed - and potentially do something with release metadata around release time so that we can cut a rocky branch in openstack/openstack that contains the set of projects that were official for rocky | 22:47 |
| mordred | fungi: yup | 22:47 |
| dhellmann | we should probably also work into the definition how we think it's useful for someone to consume it | 22:47 |
| *** felipemonteiro_ has quit IRC | 22:47 | |
| clarkb | my extra paranoia has me rereading jeepyb and make_local_copy also seems to do the right thing if the project is in projects list | 22:47 |
| mordred | dhellmann: the most recent use I found for openstack/openstack was as a replacement git repo for the cncf thing that showed activity dashboard for various cloud related things | 22:48 |
| mordred | the repo they used for openstack was "openstack/nova" - which is obviously incorrect | 22:48 |
| dhellmann | they needed a mono-repo for that? | 22:48 |
| dhellmann | ah | 22:48 |
| clarkb | and gerrit ls-projects seems to return all 1911 repos without needing paging so I think we are ok there | 22:48 |
| mordred | their tool was, in the state it was in, designed to think of the world only in terms of mono-repos | 22:48 |
| mordred | I don't think we need to design systems here around tools other people use to track stats that are not meaningful | 22:49 |
| dhellmann | not too surprising | 22:49 |
| clarkb | it is a little scary to me that we rely on ls-projects and not a direct check if $project exists | 22:49 |
| clarkb | but maybe ls-projects is good enough | 22:49 |
| mordred | but it's a use | 22:49 |
| clarkb | does anyone know if ls-projects can eventually paginate? | 22:50 |
| mordred | clarkb: I do not know | 22:50 |
| corvus | clarkb: i don't know for sure, but because it's not returning structured data, i wouldn't *expect* it to | 22:50 |
| clarkb | corvus: thats a good point | 22:51 |
| corvus | clarkb: there are... however, 'start' and 'limit' options. so i guess it's theoretically possible. | 22:51 |
| clarkb | https://review.openstack.org/Documentation/cmd-ls-projects.html doesn't seem to hae start? | 22:53 |
| corvus | weird: ssh review gerrit ls-projects --help | 22:54 |
| corvus | --start (-S) CNT : number of projects to skip | 22:54 |
| clarkb | huh | 22:54 |
| clarkb | the --limit in the docs at least is realtive to the beginning | 22:54 |
| clarkb | so not proper paging if that is the case | 22:54 |
| clarkb | looking at the list of api commands over ssh ls-projects is likely most appropriate for checking this info too | 22:56 |
| clarkb | so jeepby probably doesn't need an update to use something else | 22:56 |
| clarkb | we are into the openstack/m's | 22:57 |
| clarkb | we should probably run it one more time after this run to make sure it noops as expected so that it will end up under the puppet run timeout | 22:58 |
| clarkb | then we can reenable puppet | 22:58 |
| *** threestrands has joined #openstack-infra | 22:59 | |
| *** tpsilva has quit IRC | 23:00 | |
| fungi | if we really, really, really get worried that ls-projects might return an incomplete list at some length in the future, we could add a double-check for a specific project name only when it's not returned in the list | 23:01 |
| fungi | that way we at least don't query gerrit thousands of times | 23:01 |
| clarkb | ya | 23:01 |
| fungi | or take it as a sign to rewrite jeepyb to use the rest api | 23:03 |
| clarkb | it also helps that we auto clean out upstreams now | 23:03 |
| clarkb | since usptream probably poses the most dangerous state instruction to jeepyb in this situation (as its basically saying go get your code from over there) | 23:03 |
| clarkb | its doing noav now | 23:04 |
| *** felipemonteiro__ has quit IRC | 23:04 | |
| *** rpioso is now known as rpioso|afk | 23:05 | |
| *** hongbin has quit IRC | 23:06 | |
| corvus | if we use the rest api, we will certainly need to paginate | 23:07 |
| clarkb | noav takes a long time to clone I expect it will take a long time to fsck too | 23:07 |
| clarkb | (which is why we have the cache) | 23:08 |
| *** gouthamr has quit IRC | 23:08 | |
| clarkb | nova looked ok | 23:09 |
| fungi | yeah, the rest api would need pagination, but at least then it's known and explicit | 23:09 |
| *** rajinir has quit IRC | 23:09 | |
| clarkb | I'm going to step away for a couple minutes while this is going I've not seen anything weird. let me know if you do | 23:09 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-website master: Switch to Open Sans font https://review.openstack.org/566185 | 23:10 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-website master: Change tagline to dark blue https://review.openstack.org/566186 | 23:10 |
| *** gouthamr has joined #openstack-infra | 23:10 | |
| *** slaweq has quit IRC | 23:13 | |
| *** dpawlik has joined #openstack-infra | 23:14 | |
| clarkb | we are about 3/4 of the way through the list at this point | 23:17 |
| *** dpawlik has quit IRC | 23:18 | |
| *** gouthamr has quit IRC | 23:18 | |
| *** dmellado has quit IRC | 23:19 | |
| clarkb | dhellmann: I've approved the constellations job add and can recheck the gitreview fix if necessary | 23:19 |
| *** stevebaker has quit IRC | 23:20 | |
| corvus | clarkb, fungi: can you take a look at https://review.openstack.org/566089 when you have a sec? | 23:21 |
| corvus | i'd like to make a version of a docs job which, rather than rebuilding in post, uses the artifact already built in gate. | 23:22 |
| clarkb | corvus: neat, basically copying the draft content to the afs fs? | 23:22 |
| corvus | clarkb: well, i figured we'd stash it on logs.o.o or tarballs.o.o, indexed by change number | 23:23 |
| clarkb | ah | 23:23 |
| *** masber has joined #openstack-infra | 23:23 | |
| openstackgerrit | Merged openstack-infra/project-config master: add basic jobs for constellations repository https://review.openstack.org/565499 | 23:23 |
| corvus | basically, if you just drop the build id from the log url, you get a gate artifact repository | 23:24 |
| corvus | (last build wins; though we might need to clear out the previous build before uploading) | 23:25 |
| fungi | corvus: cool, i looked at 566089 earlier but out of context it wasn't clear to me whether demonstration meant you were ready to merge it. sorry i didn't follow up asking for clarification | 23:27 |
| clarkb | less than 200 hundred projects to go now | 23:28 |
| corvus | fungi: sorry for vagueness, yeah, i mostly meant to indicate that i wanted to set this up with one job to try out the concept and have no current plans to make any sweeping changes | 23:29 |
| clarkb | oh you know what I'm a derp | 23:30 |
| clarkb | the constellations change to add pep8 won't pass either | 23:30 |
| * clarkb decides to focus on the one thing at a time, manage_projects | 23:30 | |
| clarkb | til there is a project called whereto | 23:31 |
| fungi | you can thank dhellmann for that one too ;) | 23:33 |
| fungi | (i think?) | 23:33 |
| openstackgerrit | Merged openstack-infra/project-config master: Add promote pipeline https://review.openstack.org/566089 | 23:33 |
| clarkb | ok its done | 23:33 |
| clarkb | the only pushes logged were for the two new projects when i ran the script manually | 23:34 |
| clarkb | I'm going to rerun it now after double checking the cache file | 23:34 |
| fungi | sounds good | 23:35 |
| clarkb | ok the one weird thing I see is some projects looks like those that were able to run with the half broken ssh and the ones I just created have created-in-github set to false | 23:36 |
| clarkb | but at least for constellations it exists on github | 23:36 |
| clarkb | looks like we only set that flag to true if we've actually created the repo in github | 23:38 |
| clarkb | I'm going to guess that the exceptions borked that state but since it is actually in github we won't flip that flag | 23:38 |
| clarkb | the side effect of this is we will run github things against these projects every time we run manage projects | 23:39 |
| clarkb | mordred: corvus fungi dare I manually edit the cache file to set created-in-github to true? | 23:39 |
| fungi | if this is intended to be a persistent cache, then yeah either than or try to copy in the old one from now defunct review.o.o | 23:40 |
| fungi | s/than/that/ | 23:40 |
| corvus | looking | 23:40 |
| corvus | at this point, copying won't work, it'll have the same problem | 23:40 |
| clarkb | ya especialyl for the new projects | 23:40 |
| corvus | clarkb: agree with your assesment. i think fix is to set created in the cache object inside create_update_github_project | 23:42 |
| corvus | clarkb: and also, yes, for now manually edit the cache | 23:42 |
| clarkb | ok I'm going to manually edit the cache file then I'll run against a small number of edited projects before doing another full run | 23:43 |
| clarkb | /opt/lib/jeepyb/project.cache.bak is a backup of existing cache state | 23:43 |
| clarkb | we can diff against that to see if I did anything silly | 23:43 |
| clarkb | ok I did a vim substition, 96 lines replaced. Diff lgtm anyone else want to read it before I rerun a couple of these? | 23:46 |
| corvus | clarkb: why so many? | 23:47 |
| corvus | i thought it was just the 2 new projects | 23:47 |
| *** eernst has quit IRC | 23:47 | |
| clarkb | corvus: two were from the new projects. The others were the half successful runs when ssh was half working I think | 23:47 |
| clarkb | corvus: its the first ~94 projects in the list | 23:47 |
| corvus | clarkb: okay; spot checking a bunch of those, all of them seem like they should have the flag set. so, lgtm. | 23:48 |
| clarkb | ok I'm going to check the two new projects first then will do an openstack-dev project and an openstack-infra project before rerunning everything | 23:48 |
| clarkb | hrm it flipped the value back for constellations | 23:49 |
| clarkb | this may have actually been a long standing bug | 23:50 |
| clarkb | I think those flipped because they ran more than once | 23:50 |
| clarkb | ya that is what happened I think | 23:50 |
| clarkb | I'll still run against the other ones to confirm that behavior and get comfy with it then I'll do a global run and we can fix this separately | 23:51 |
| *** gouthamr has joined #openstack-infra | 23:51 | |
| *** dmellado has joined #openstack-infra | 23:51 | |
| clarkb | ya they all do that so fairly convinced its a long standing bug | 23:53 |
| clarkb | I'm going to go ahead and do a second global run now to make sure its largely a noop | 23:53 |
| clarkb | and it looks clean | 23:54 |
| clarkb | I've got to go get the grill started now and make dinner | 23:54 |
| clarkb | I'm happy to keep review01 in the emergency file until morning when we can watch it unless ianw wants to remove it | 23:54 |
| corvus | clarkb: why didn't all the projects get it set to false? | 23:55 |
| clarkb | corvus: they appear to all be false now? | 23:56 |
| corvus | clarkb: shouldn't they all have been false before your vim replace? | 23:56 |
| clarkb | but previously there was no cache data for the projects and they were crashing due to the ssh problem before they could get updated info which would set them to true, then the next run would set them to false | 23:56 |
| clarkb | corvus: because that run was the first run for most of those projects according to the cache they all got set to true after that first one | 23:56 |
| clarkb | (they weren't in the cache previously basically) | 23:56 |
| corvus | clarkb: how did they get set to true? i don't see a path that sets created to true unless either it is actually created, or gerrit is added to the team | 23:57 |
| clarkb | corvus: it was logging adding gerrit to the team | 23:58 |
| clarkb | so I'm guessing that is related | 23:58 |
| corvus | hrm. wonder why gerrit wasn't in the team? | 23:58 |
| clarkb | because the cache was empty | 23:58 |
| corvus | clarkb: oh i see now | 23:58 |
| corvus | well | 23:58 |
| corvus | clarkb: it checks github before adding it | 23:59 |
| clarkb | it does seem to check against whether or not gerrit is in the team for actually adding gerrit | 23:59 |
| clarkb | but not for setting created to true | 23:59 |
| clarkb | but that log line is what was emitted so curious | 23:59 |
| corvus | so i agree that if the cache is false, it will update the cache, but it shouldn't log adding the team... exactly | 23:59 |
| *** yamamoto has joined #openstack-infra | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!