| *** ijw has quit IRC | 00:04 | |
| *** agopi_ has quit IRC | 00:09 | |
| *** agopi_ has joined #openstack-infra | 00:09 | |
| *** armaan has joined #openstack-infra | 00:18 | |
| *** bobh has joined #openstack-infra | 00:20 | |
| *** olaph1 is now known as olaph | 00:27 | |
| *** dhill_ has joined #openstack-infra | 00:36 | |
| *** armax has joined #openstack-infra | 00:37 | |
| corvus | i'm going to perform a full zuul restart now | 00:42 |
|---|---|---|
| corvus | i'll save queues, stop all mergers and executors, then restart the scheduler. i'll delete all the git repos from the mergers (to clear out zuul refs) and restart them. then, i'll fix all the executor hostnames, delete their git repos, and reboot them. | 00:46 |
| corvus | okay, scheduler,web,fingergw are restarted, so we should start getting events now | 00:52 |
| corvus | working on mergers now | 00:52 |
| corvus | i'm going to align the merger hostnames too | 00:56 |
| corvus | rebooting mergers | 00:58 |
| *** ijw has joined #openstack-infra | 01:01 | |
| corvus | oh fun fact. apparently zuul will only wait 300 seconds for its initial cat job to return, and if it doesn't, startup fails. we can probably make that better. | 01:04 |
| corvus | i'll be restarting the scheduler again in a moment. | 01:04 |
| *** xarses_ has quit IRC | 01:04 | |
| *** ijw has quit IRC | 01:06 | |
| *** dhill_ has quit IRC | 01:06 | |
| *** claudiub|2 has quit IRC | 01:06 | |
| *** salv-orlando has joined #openstack-infra | 01:08 | |
| corvus | scheduler, fingergw, web, and mergers are all up | 01:10 |
| corvus | i'm clearing out stale builds on ze04, then i'll reboot the executors | 01:11 |
| fungi | if you need an extra pair of hands, i'm around | 01:11 |
| corvus | fungi: thanks. i think it's mostly waiting at this point. | 01:12 |
| *** bobh has quit IRC | 01:12 | |
| *** salv-orlando has quit IRC | 01:12 | |
| corvus | /var/run/zuul wasn't created on the mergers; i think we need to add creating that to their init script | 01:13 |
| StevenK | Because /var/run is now a tmpfs? | 01:14 |
| corvus | yep | 01:14 |
| corvus | we used to rely on puppet creating it | 01:14 |
| corvus | i *think* we fixed this for the executors, but maybe not mergers | 01:14 |
| *** yamahata has joined #openstack-infra | 01:15 | |
| fungi | mostly just hacking and watching max headroom in the background | 01:16 |
| corvus | yep, i see it in the executor init script. so they should come up when i reboot them. which is now. | 01:16 |
| corvus | i think zuul is something like 25% through loading it's config. it goes much slower with a cold git repo cache and only 8 mergers. we're about to bump it to 18 mergers -- with a cold git repo cache. | 01:17 |
| corvus | all mergers and executors have consistent hostnames and are online | 01:18 |
| corvus | btw, if you visit http://zuul.openstack.org/ you'll see a new message | 01:19 |
| fungi | just got to the scene in episode 3 where blank reg describes a book as a "nonvolatile storage medium, very rare" | 01:19 |
| corvus | "Tenant openstack isn't ready" is a new thing that it returns when it hasn't loaded the initial config. | 01:19 |
| fungi | nifty! | 01:20 |
| fungi | and helpful on the (hopefully increasingly rare?) occasion of a restart | 01:20 |
| corvus | thank goodness the word 'tenant' is in there | 01:21 |
| fungi | yes, if for no other reason than to annoy the word police | 01:21 |
| corvus | grafana says there are 3 merge jobs left... i hope they aren't clones timing out :/ | 01:23 |
| corvus | hrm, they seem to have bombed. | 01:23 |
| corvus | i think we get to restart again | 01:23 |
| fungi | :( | 01:23 |
| corvus | i think we'll need to catch ECLOUD errors on startup and retry those merge jobs :| | 01:25 |
| corvus | but should be noticably faster this time | 01:26 |
| *** edmondsw has joined #openstack-infra | 01:26 | |
| fungi | now i want an ECLAIR | 01:26 |
| *** yamamoto has joined #openstack-infra | 01:28 | |
| *** yamamoto has quit IRC | 01:28 | |
| *** bobh has joined #openstack-infra | 01:29 | |
| corvus | i'm a little worried... | 01:29 |
| corvus | socket.gethostname() | 01:30 |
| corvus | 'zm01' | 01:30 |
| *** edmondsw has quit IRC | 01:30 | |
| corvus | i'm pretty sure that's what it's going to pass along to the streaming gateway | 01:30 |
| corvus | i did what we agreed should be done as described in this message: http://lists.openstack.org/pipermail/openstack-infra/2018-January/005761.html | 01:32 |
| corvus | so if we like the current hostname situation, i think we're going to have to change zuul so it gets the fqdn | 01:32 |
| fungi | how is it resolving its hostname for that? socket.gethostname()? | 01:34 |
| corvus | yep | 01:34 |
| fungi | k | 01:34 |
| fungi | there seems to be a socket.getfqdn() which may be a viable drop-in alternative | 01:35 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Use getfqdn instead of gethostname https://review.openstack.org/540623 | 01:35 |
| corvus | fungi: yep, and it returns the right thing on our hosts | 01:35 |
| fungi | heh ;) | 01:35 |
| corvus | that seems much safer | 01:35 |
| fungi | i feel qualified to review this | 01:35 |
| corvus | startup bombed again | 01:36 |
| *** yamamoto has joined #openstack-infra | 01:37 | |
| fungi | puh | 01:38 |
| fungi | is it incrementally warming the cache? | 01:39 |
| corvus | yeah. there's a possibility all of the git clones are having an effect on gerrit, and cloning nova may be legitimately taking longer than 5 minutes in some cases. i can't confirm which job actually timed out, so hard to know for sure. | 01:40 |
| *** agopi__ has joined #openstack-infra | 01:41 | |
| *** yamamoto has quit IRC | 01:43 | |
| *** agopi_ has quit IRC | 01:44 | |
| corvus | maybe i should warm the cache for nova, at least | 01:44 |
| *** yamamoto has joined #openstack-infra | 01:47 | |
| corvus | yeah, it's not possible to clone nova under current load within the timeout window. i think we need to tune our timeouts a bit more. | 01:58 |
| corvus | i'm manually cloning it on all the hosts now, but am still waiting for some jobs to timeout | 01:58 |
| *** ijw has joined #openstack-infra | 02:02 | |
| *** olaph has quit IRC | 02:03 | |
| *** olaph has joined #openstack-infra | 02:05 | |
| *** timothyb89 has quit IRC | 02:06 | |
| corvus | i'm going to restart gerrit too | 02:06 |
| *** dhill_ has joined #openstack-infra | 02:07 | |
| *** ijw has quit IRC | 02:07 | |
| *** yamamoto has quit IRC | 02:07 | |
| corvus | it seemed especially heavily loaded | 02:08 |
| corvus | nova is cloned on all the executors/mergers, and gerrit is starting up | 02:08 |
| corvus | starting zuul again | 02:16 |
| *** ijw has joined #openstack-infra | 02:25 | |
| *** ijw has quit IRC | 02:27 | |
| *** dhill_ has quit IRC | 02:34 | |
| *** bobh has quit IRC | 02:41 | |
| corvus | and it's up | 02:48 |
| dmsimard | corvus: gerrit pushes all refs to git.o.o right ? From reading you it seems zuul clones from review.o.o | 02:50 |
| dmsimard | I guess replication is not instantaneous but might be okay for warm up purposes | 02:51 |
| corvus | dmsimard: yes. i have to run now, but that's not by accident. | 02:51 |
| dmsimard | np, have a nice weekend | 02:51 |
| corvus | infra-root: log streaming will be broken until we merge https://review.openstack.org/540623 and restart executors | 02:52 |
| *** yamamoto has joined #openstack-infra | 03:08 | |
| *** salv-orlando has joined #openstack-infra | 03:08 | |
| *** salv-orlando has quit IRC | 03:13 | |
| *** edmondsw has joined #openstack-infra | 03:14 | |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config master: Update Zun's project definition https://review.openstack.org/540628 | 03:15 |
| *** yamamoto has quit IRC | 03:18 | |
| *** edmondsw has quit IRC | 03:19 | |
| *** benj_ has quit IRC | 03:23 | |
| *** ijw has joined #openstack-infra | 03:27 | |
| *** benj_ has joined #openstack-infra | 03:28 | |
| *** ijw has quit IRC | 03:29 | |
| *** agopi__ has quit IRC | 03:33 | |
| *** timothyb89 has joined #openstack-infra | 03:34 | |
| *** yamahata has quit IRC | 03:45 | |
| *** timothyb89 has quit IRC | 03:47 | |
| *** timothyb89 has joined #openstack-infra | 03:49 | |
| *** yamamoto has joined #openstack-infra | 03:54 | |
| *** yamamoto has quit IRC | 03:54 | |
| *** kota_ has quit IRC | 04:00 | |
| *** kota_ has joined #openstack-infra | 04:04 | |
| *** bhavik1 has joined #openstack-infra | 04:15 | |
| *** bhavik1 has quit IRC | 04:17 | |
| *** ijw_ has joined #openstack-infra | 04:32 | |
| *** dhajare has joined #openstack-infra | 04:42 | |
| *** agopi__ has joined #openstack-infra | 04:52 | |
| *** yamamoto has joined #openstack-infra | 04:55 | |
| *** yamamoto has quit IRC | 05:04 | |
| *** germs has joined #openstack-infra | 05:07 | |
| *** salv-orlando has joined #openstack-infra | 05:09 | |
| *** salv-orlando has quit IRC | 05:14 | |
| *** markvoelker has quit IRC | 05:18 | |
| *** agopi__ has quit IRC | 05:36 | |
| *** germs has quit IRC | 05:40 | |
| *** olaph1 has joined #openstack-infra | 05:42 | |
| *** olaph has quit IRC | 05:43 | |
| *** auristor has quit IRC | 05:56 | |
| *** auristor has joined #openstack-infra | 06:00 | |
| *** edwarnicke_ has joined #openstack-infra | 06:07 | |
| *** Ng__ has joined #openstack-infra | 06:08 | |
| *** mrhillsman_ has joined #openstack-infra | 06:08 | |
| *** rajinir_ has joined #openstack-infra | 06:08 | |
| *** icey_ has joined #openstack-infra | 06:08 | |
| *** kuromagi has joined #openstack-infra | 06:08 | |
| *** vipuls has joined #openstack-infra | 06:11 | |
| *** trown has joined #openstack-infra | 06:11 | |
| *** tlbr_ has joined #openstack-infra | 06:13 | |
| *** amotoki_ has joined #openstack-infra | 06:13 | |
| *** manfred has joined #openstack-infra | 06:13 | |
| *** patriciadomin_ has joined #openstack-infra | 06:14 | |
| *** sdake_ has joined #openstack-infra | 06:14 | |
| *** sdake_ has quit IRC | 06:14 | |
| *** sdake_ has joined #openstack-infra | 06:14 | |
| *** dmanchado has joined #openstack-infra | 06:14 | |
| *** xinni9e_ has joined #openstack-infra | 06:14 | |
| *** _ari__ has joined #openstack-infra | 06:14 | |
| *** otherwiseguy_ has joined #openstack-infra | 06:14 | |
| *** edwarnicke has quit IRC | 06:15 | |
| *** sdake has quit IRC | 06:15 | |
| *** nibz has quit IRC | 06:15 | |
| *** Ng has quit IRC | 06:15 | |
| *** ari[m] has quit IRC | 06:15 | |
| *** mdbooth has quit IRC | 06:15 | |
| *** kuromagi^ has quit IRC | 06:15 | |
| *** gaurangt has quit IRC | 06:15 | |
| *** trown|outtypewww has quit IRC | 06:15 | |
| *** gridinv has quit IRC | 06:15 | |
| *** gtmanfred has quit IRC | 06:15 | |
| *** vipul has quit IRC | 06:15 | |
| *** amotoki has quit IRC | 06:15 | |
| *** robcresswell has quit IRC | 06:15 | |
| *** rajinir has quit IRC | 06:15 | |
| *** icey has quit IRC | 06:15 | |
| *** mrhillsman has quit IRC | 06:15 | |
| *** mrmartin has quit IRC | 06:15 | |
| *** otherwiseguy has quit IRC | 06:15 | |
| *** patriciadomin has quit IRC | 06:15 | |
| *** _ari_ has quit IRC | 06:15 | |
| *** nhandler has quit IRC | 06:15 | |
| *** jbryce has quit IRC | 06:15 | |
| *** tlbr has quit IRC | 06:15 | |
| *** SpamapS has quit IRC | 06:15 | |
| *** xinni9e has quit IRC | 06:15 | |
| *** fbouliane has quit IRC | 06:15 | |
| *** dmanchad has quit IRC | 06:15 | |
| *** wfoster has quit IRC | 06:15 | |
| *** Ng__ is now known as Ng | 06:15 | |
| *** manfred is now known as gtmanfred | 06:15 | |
| *** edwarnicke_ is now known as edwarnicke | 06:15 | |
| *** dmanchado is now known as dmanchad | 06:15 | |
| *** mrhillsman_ is now known as mrhillsman | 06:15 | |
| *** rajinir_ is now known as rajinir | 06:15 | |
| *** icey_ is now known as icey | 06:15 | |
| *** wfoster has joined #openstack-infra | 06:15 | |
| *** fbouliane has joined #openstack-infra | 06:15 | |
| *** gaurangt has joined #openstack-infra | 06:16 | |
| *** nhandler has joined #openstack-infra | 06:17 | |
| *** bandini has quit IRC | 06:18 | |
| *** bandini has joined #openstack-infra | 06:20 | |
| *** mdbooth has joined #openstack-infra | 06:22 | |
| *** nibz has joined #openstack-infra | 06:22 | |
| *** SpamapS has joined #openstack-infra | 06:22 | |
| *** gridinv has joined #openstack-infra | 06:23 | |
| *** ari[m] has joined #openstack-infra | 06:24 | |
| *** yamamoto has joined #openstack-infra | 06:33 | |
| *** agopi__ has joined #openstack-infra | 06:35 | |
| *** yamamoto has quit IRC | 06:40 | |
| openstackgerrit | Merged openstack-infra/zuul master: Use getfqdn instead of gethostname https://review.openstack.org/540623 | 06:44 |
| tobiash | infra-root: you may want to restart executors to get that in ^ | 06:45 |
| *** edmondsw has joined #openstack-infra | 06:50 | |
| *** edmondsw has quit IRC | 06:54 | |
| *** oidgar has joined #openstack-infra | 07:07 | |
| *** salv-orlando has joined #openstack-infra | 07:10 | |
| *** salv-orlando has quit IRC | 07:15 | |
| *** oidgar has joined #openstack-infra | 07:17 | |
| *** kmalloc has quit IRC | 07:17 | |
| *** markvoelker has joined #openstack-infra | 07:19 | |
| *** d0ugal has quit IRC | 07:26 | |
| *** yamamoto has joined #openstack-infra | 07:35 | |
| *** yamamoto has quit IRC | 07:37 | |
| *** olaph has joined #openstack-infra | 07:40 | |
| *** agopi__ has quit IRC | 07:41 | |
| *** olaph1 has quit IRC | 07:41 | |
| openstackgerrit | Merged openstack-infra/project-config master: Expose serial keyword to base-test playbook https://review.openstack.org/526708 | 07:49 |
| *** salv-orlando has joined #openstack-infra | 07:53 | |
| *** markvoelker has quit IRC | 07:53 | |
| *** slaweq has joined #openstack-infra | 07:55 | |
| openstackgerrit | Merged openstack-infra/project-config master: Use new periodic tox with-master jobs https://review.openstack.org/540592 | 07:55 |
| *** salv-orlando has quit IRC | 07:59 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Set remote url on every getRepo in merger https://review.openstack.org/535716 | 08:10 |
| *** jbryce has joined #openstack-infra | 08:14 | |
| *** mrmartin has joined #openstack-infra | 08:15 | |
| *** tesseract has joined #openstack-infra | 08:16 | |
| *** robcresswell has joined #openstack-infra | 08:16 | |
| *** edmondsw has joined #openstack-infra | 08:39 | |
| *** snapiri has quit IRC | 08:40 | |
| *** edmondsw has quit IRC | 08:43 | |
| *** d0ugal has joined #openstack-infra | 08:58 | |
| *** slaweq has quit IRC | 09:08 | |
| *** yamamoto has joined #openstack-infra | 09:11 | |
| *** yamamoto has quit IRC | 09:14 | |
| *** yamamoto has joined #openstack-infra | 09:21 | |
| *** yamamoto has quit IRC | 09:26 | |
| *** ijw_ has quit IRC | 09:26 | |
| *** slaweq_ has joined #openstack-infra | 09:38 | |
| *** claudiub|2 has joined #openstack-infra | 09:40 | |
| *** markvoelker has joined #openstack-infra | 09:50 | |
| *** slaweq_ has quit IRC | 09:53 | |
| *** gixxer1k has joined #openstack-infra | 09:56 | |
| *** slaweq has joined #openstack-infra | 09:57 | |
| *** pcichy has joined #openstack-infra | 10:06 | |
| *** yamamoto has joined #openstack-infra | 10:06 | |
| *** pcichy has quit IRC | 10:07 | |
| *** pcichy has joined #openstack-infra | 10:07 | |
| *** pcichy has quit IRC | 10:10 | |
| *** yamamoto has quit IRC | 10:11 | |
| *** pcichy has joined #openstack-infra | 10:12 | |
| *** ijw has joined #openstack-infra | 10:22 | |
| *** markvoelker has quit IRC | 10:24 | |
| *** edmondsw has joined #openstack-infra | 10:27 | |
| *** ijw has quit IRC | 10:27 | |
| *** yamamoto has joined #openstack-infra | 10:27 | |
| *** edmondsw has quit IRC | 10:32 | |
| *** yamamoto has quit IRC | 10:34 | |
| *** dhajare has quit IRC | 10:39 | |
| *** yamamoto has joined #openstack-infra | 10:41 | |
| *** yamamoto has quit IRC | 10:43 | |
| *** yamamoto has joined #openstack-infra | 10:45 | |
| *** yamamoto has quit IRC | 10:47 | |
| *** slaweq has quit IRC | 10:50 | |
| AJaeger | config-core, could you review https://review.openstack.org/#/c/540593/ , please? Just removes now unused jobs.. | 10:53 |
| *** olaph1 has joined #openstack-infra | 10:56 | |
| *** olaph has quit IRC | 10:57 | |
| *** markvoelker has joined #openstack-infra | 11:21 | |
| *** xinliang has quit IRC | 11:23 | |
| *** ijw has joined #openstack-infra | 11:23 | |
| *** slaweq has joined #openstack-infra | 11:25 | |
| *** ijw has quit IRC | 11:28 | |
| *** snapiri has joined #openstack-infra | 11:29 | |
| *** larainema has quit IRC | 11:33 | |
| *** xinliang has joined #openstack-infra | 11:34 | |
| *** slaweq has quit IRC | 11:43 | |
| *** yamamoto has joined #openstack-infra | 11:45 | |
| *** slaweq has joined #openstack-infra | 11:53 | |
| *** markvoelker has quit IRC | 11:54 | |
| *** edmondsw has joined #openstack-infra | 12:15 | |
| *** edmondsw has quit IRC | 12:19 | |
| *** ijw has joined #openstack-infra | 12:24 | |
| *** dhajare has joined #openstack-infra | 12:24 | |
| *** ijw has quit IRC | 12:29 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Refactor method node_list in status.py https://review.openstack.org/540325 | 12:42 |
| *** armaan has quit IRC | 12:49 | |
| *** armaan_ has joined #openstack-infra | 12:49 | |
| *** markvoelker has joined #openstack-infra | 12:50 | |
| *** slaweq has quit IRC | 12:54 | |
| *** olaph1 is now known as olaph | 12:58 | |
| *** slaweq has joined #openstack-infra | 13:11 | |
| *** dhajare has quit IRC | 13:20 | |
| *** markvoelker has quit IRC | 13:24 | |
| *** slaweq_ has joined #openstack-infra | 13:27 | |
| *** slaweq has quit IRC | 13:30 | |
| AJaeger | mordred: I think you can abandon https://review.openstack.org/#/c/539625 - another change merged to fix it and removed all the stat calls... | 13:45 |
| *** bhavik1 has joined #openstack-infra | 13:51 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Fix openstack-tox-py35-with-ovsdbapp-master for vmware-nsx https://review.openstack.org/540647 | 13:55 |
| *** slaweq has joined #openstack-infra | 13:57 | |
| *** slaweq_ has quit IRC | 13:58 | |
| *** bhavik1 has quit IRC | 14:01 | |
| *** slaweq_ has joined #openstack-infra | 14:01 | |
| *** edmondsw has joined #openstack-infra | 14:03 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Temporarily disable windmill voting jobs https://review.openstack.org/540650 | 14:03 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Revert "Temporarily disable windmill voting jobs" https://review.openstack.org/540651 | 14:03 |
| *** slaweq has quit IRC | 14:04 | |
| AJaeger | pabelanger: please review those two changes above ^. I need them for https://review.openstack.org/540609 - to remove run-tox.sh | 14:04 |
| *** dsariel has quit IRC | 14:06 | |
| *** armaan_ has quit IRC | 14:07 | |
| *** edmondsw has quit IRC | 14:08 | |
| *** dhill_ has joined #openstack-infra | 14:10 | |
| *** slaweq_ has quit IRC | 14:15 | |
| *** slaweq has joined #openstack-infra | 14:15 | |
| *** dhajare has joined #openstack-infra | 14:17 | |
| pabelanger | corvus: re: 540623 maybe also add 'search openstack.org' to /etc/resolv.conf as option too? | 14:19 |
| *** sshnaidm|off has quit IRC | 14:20 | |
| pabelanger | infra-root: tobiash: I'll take care of restarting zuul-executors now | 14:24 |
| *** slaweq has quit IRC | 14:25 | |
| pabelanger | okay, ze01 is working | 14:26 |
| pabelanger | finger 6c5283b8a71647b18c7143df947538ad@zuul.openstack.org | 14:27 |
| pabelanger | I'll do others now | 14:27 |
| AJaeger | pabelanger: do you agree with my windmill job changes - or have another suggestion? | 14:31 |
| pabelanger | AJaeger: they are in bad shape right now, I'm going to spend some time this week to fix them up | 14:32 |
| pabelanger | okay, zuul-executors to to be streaming now | 14:34 |
| AJaeger | pabelanger: shall I WIP my change for now? windmill is not yet the last one... | 14:34 |
| pabelanger | AJaeger: Sure, WIP for now | 14:35 |
| AJaeger | pabelanger: ok, will do - and then let's discuss later the week based on how far you come... thanks | 14:35 |
| AJaeger | pabelanger: if you have time, could you +2A https://review.openstack.org/540593, please? Just removes now unused jobs | 14:36 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove legacy with-X-master tox periodic jobs https://review.openstack.org/540593 | 14:48 |
| *** snapiri has quit IRC | 14:52 | |
| *** olaph1 has joined #openstack-infra | 14:55 | |
| AJaeger | thanks, fungi ^ | 14:56 |
| fungi | it was an easy one to review | 14:57 |
| *** olaph has quit IRC | 14:58 | |
| *** dhill_ has quit IRC | 14:58 | |
| *** dhill_ has joined #openstack-infra | 14:58 | |
| *** dhill_ has joined #openstack-infra | 14:59 | |
| AJaeger | I'll have some a bit more complex ones as well if you like - will ask tomorrow for them ;) | 15:00 |
| fungi | sure, thanks for the migration effort! | 15:00 |
| *** dhill_ has quit IRC | 15:00 | |
| *** dhill_ has joined #openstack-infra | 15:01 | |
| AJaeger | thanks | 15:01 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove unused jenkins/scripts/run-tox-* scripts https://review.openstack.org/540594 | 15:01 |
| *** zzzeek has quit IRC | 15:05 | |
| *** zzzeek has joined #openstack-infra | 15:06 | |
| *** sshnaidm|off has joined #openstack-infra | 15:11 | |
| *** dsariel has joined #openstack-infra | 15:19 | |
| *** markvoelker has joined #openstack-infra | 15:20 | |
| *** yamamoto has quit IRC | 15:24 | |
| *** alex_xu has quit IRC | 15:25 | |
| *** alex_xu has joined #openstack-infra | 15:26 | |
| fungi | prometheanfire: you were right, looks like python.org does have a mailman 3 deployment, they just haven't moved all their lists to it yet. i just subscribed to https://mail.python.org/mm3/mailman3/lists/pypi-announce.python.org/ on it though | 15:28 |
| *** dhill_ has quit IRC | 15:30 | |
| *** dhill_ has joined #openstack-infra | 15:31 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove jobs from project-config-example https://review.openstack.org/540658 | 15:38 |
| dmsimard | Anyone seen that before ? http://paste.openstack.org/raw/660921/ from http://logs.openstack.org/53/540653/1/check/ara-integration-debian-py27-2.2.3.0/7db60c6/ara/result/5c017420-6a09-4d35-841f-4ac11a573d6e/ | 15:40 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove legacy project-config jobs https://review.openstack.org/540659 | 15:40 |
| dmsimard | Getting failures in ARA's integration test only on debian, rest of the distros are fine | 15:40 |
| dmsimard | I don't think the failure is because of that but I found the error kind of weird | 15:41 |
| *** armax has quit IRC | 15:45 | |
| *** armax has joined #openstack-infra | 15:45 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove jenkins/scripts/run-tox.sh https://review.openstack.org/540609 | 15:46 |
| *** amotoki_ is now known as amotoki | 15:46 | |
| *** edmondsw has joined #openstack-infra | 15:51 | |
| *** markvoelker has quit IRC | 15:53 | |
| *** oidgar has quit IRC | 15:54 | |
| *** edmondsw has quit IRC | 15:56 | |
| *** kmalloc has joined #openstack-infra | 15:59 | |
| *** olaph has joined #openstack-infra | 16:02 | |
| mordred | dmsimard: looking | 16:02 |
| dmsimard | mordred: btw just confirming that error has nothing to do with the test failure | 16:02 |
| dmsimard | mordred: regression in ansible that was eventually fixed | 16:02 |
| *** markvoelker has joined #openstack-infra | 16:03 | |
| *** olaph1 has quit IRC | 16:03 | |
| mordred | dmsimard: awesome. and yah - that error happens from pip and it happens all the time because we make repos without a remote | 16:04 |
| mordred | it's just a warning though, not a real issue | 16:04 |
| dmsimard | never noticed it before | 16:06 |
| dmsimard | ¯\_(ツ)_/¯ | 16:06 |
| *** gixxer1k has quit IRC | 16:06 | |
| dmsimard | going to try and spend some time on ara in the near future... been all over the place except on ara | 16:06 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Replace sphinx_check_warning_is_error.py with ini lookup https://review.openstack.org/528812 | 16:15 |
| mordred | dmsimard: it's been a busy period :) | 16:15 |
| *** slaweq has joined #openstack-infra | 16:15 | |
| *** mriedem has joined #openstack-infra | 16:16 | |
| fungi | dmsimard: mordred: i believe clarkb has a pr against pip to "fix" that mostly benign error | 16:19 |
| clarkb | ya its been ignored by upstream after the first round of comments and since been rebased at least onceto fix conflicts | 16:20 |
| *** dhill_ has quit IRC | 16:21 | |
| clarkb | I think there are or were unrelated test failures | 16:21 |
| *** dhill_ has joined #openstack-infra | 16:21 | |
| dmsimard | clarkb: yeah was definitely a red herring in my case | 16:22 |
| fungi | pip has the mistaken assumption that any package installed from a git repo will have a remote named "origin" | 16:24 |
| *** yamamoto has joined #openstack-infra | 16:25 | |
| fungi | there are a variety of reasons that might not happen, but the way zuul pushes repositories onto our job nodes is one | 16:25 |
| *** tosky has joined #openstack-infra | 16:25 | |
| *** dhill_ has quit IRC | 16:29 | |
| *** dhill_ has joined #openstack-infra | 16:30 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add new zuul executor metrics https://review.openstack.org/540665 | 16:35 |
| *** yamamoto has quit IRC | 16:36 | |
| *** slaweq has quit IRC | 16:36 | |
| *** Goneri has joined #openstack-infra | 16:42 | |
| *** armax has quit IRC | 16:44 | |
| AJaeger | btw. should we retire project-config-example? https://review.openstack.org/540658 removes a few jobs from it that don't work anymore | 16:44 |
| *** Goneri has quit IRC | 16:51 | |
| *** bobh has joined #openstack-infra | 16:51 | |
| *** wolverineav has joined #openstack-infra | 16:53 | |
| *** pbourke has quit IRC | 16:59 | |
| *** pbourke has joined #openstack-infra | 17:01 | |
| AJaeger | corvus: we have low load, do you want to start your project name stanza submissions again? | 17:01 |
| corvus | AJaeger: i'll wait until later today or early tomorrow, so we don't have a monday morning approval rush | 17:02 |
| AJaeger | ok | 17:02 |
| AJaeger | I think later today is safe... | 17:03 |
| *** slaweq has joined #openstack-infra | 17:03 | |
| *** dsariel has quit IRC | 17:09 | |
| openstackgerrit | Akihiro Motoki proposed openstack-infra/infra-manual master: Correct django template pattern in babel-django.cfg https://review.openstack.org/540668 | 17:10 |
| *** HeOS has joined #openstack-infra | 17:10 | |
| *** d0ugal has quit IRC | 17:15 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove kolla-kubernetes legacy jobs https://review.openstack.org/540670 | 17:22 |
| *** HeOS has quit IRC | 17:23 | |
| *** olaph1 has joined #openstack-infra | 17:25 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove in-tree kolla-kubernetes jobs https://review.openstack.org/540671 | 17:26 |
| *** olaph has quit IRC | 17:27 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add new zuul executor metrics https://review.openstack.org/540665 | 17:27 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove in-tree kolla-kubernetes jobs https://review.openstack.org/540671 | 17:32 |
| * AJaeger sighs - seeing a project that imported all their zuul jobs but used .zuul.d/legacy.yml which is ignored by Zuul and thus the new tests are never used. | 17:33 | |
| *** slaweq has quit IRC | 17:37 | |
| *** slaweq has joined #openstack-infra | 17:38 | |
| *** edmondsw has joined #openstack-infra | 17:39 | |
| *** slaweq has quit IRC | 17:42 | |
| *** edmondsw has quit IRC | 17:44 | |
| *** rossella_s has quit IRC | 17:55 | |
| *** hongbin has joined #openstack-infra | 17:57 | |
| *** wolverineav has quit IRC | 18:02 | |
| *** e0ne has joined #openstack-infra | 18:03 | |
| *** olaph has joined #openstack-infra | 18:08 | |
| *** dhajare has quit IRC | 18:09 | |
| *** olaph1 has quit IRC | 18:09 | |
| *** d0ugal has joined #openstack-infra | 18:25 | |
| *** wolverineav has joined #openstack-infra | 18:33 | |
| *** wolverineav has quit IRC | 18:37 | |
| *** armaan has joined #openstack-infra | 18:44 | |
| mordred | AJaeger: wait - why is legacy.yml ignored by zuul? | 18:46 |
| *** markvoelker has quit IRC | 18:49 | |
| *** tesseract has quit IRC | 18:50 | |
| AJaeger | mordred: https://docs.openstack.org/infra/zuul/user/config.html#configuration-items states "In the case of a zuul.d directory, Zuul recurses the directory and extends the configuration using all the .yaml files in the sorted path order." | 18:52 |
| AJaeger | mordred: didn't check code - but the docs confirm what I see | 18:53 |
| mordred | AJaeger: yah. I now grok the issue | 18:53 |
| AJaeger | Btw. could somebody review https://review.openstack.org/540596 (infra-ansible), please? | 18:54 |
| *** armaan has quit IRC | 18:58 | |
| *** wolverineav has joined #openstack-infra | 19:03 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Allow .yml extensions for user config files https://review.openstack.org/540676 | 19:05 |
| *** wolverineav has quit IRC | 19:08 | |
| AJaeger | mordred: is there a difference between centos-7-2-node and legacy-centos-7-2-node? Do we tread the legacy nodes somehow special? | 19:08 |
| AJaeger | mordred: we have also tripleo-ipsec/zuul.d/layout.yml ;/ | 19:09 |
| * AJaeger fixes | 19:10 | |
| *** dsariel has joined #openstack-infra | 19:16 | |
| *** wolverineav has joined #openstack-infra | 19:17 | |
| clarkb | AJaeger: I think legacy uses primary and subnode but non legacy is mkre specific like controller and compute | 19:17 |
| *** wolverineav has quit IRC | 19:21 | |
| AJaeger | clarkb: thanks. | 19:22 |
| AJaeger | pabelanger: I rebased my change on top of yours seeing the good progress you make ;) | 19:26 |
| prometheanfire | fungi: :D | 19:27 |
| *** edmondsw has joined #openstack-infra | 19:27 | |
| *** dave-mccowan has joined #openstack-infra | 19:27 | |
| *** d0ugal has quit IRC | 19:29 | |
| *** edmondsw has quit IRC | 19:32 | |
| *** d0ugal has joined #openstack-infra | 19:33 | |
| *** sshnaidm|off is now known as sshnaidm | 19:37 | |
| *** yamahata has joined #openstack-infra | 19:38 | |
| *** armaan has joined #openstack-infra | 19:43 | |
| openstackgerrit | Merged openstack-infra/project-config master: Update Zun's project definition https://review.openstack.org/540628 | 19:46 |
| *** armaan has quit IRC | 19:47 | |
| *** ijw has joined #openstack-infra | 19:51 | |
| *** ijw_ has joined #openstack-infra | 19:52 | |
| *** wolverineav has joined #openstack-infra | 19:53 | |
| *** ijw has quit IRC | 19:56 | |
| *** hongbin has quit IRC | 19:56 | |
| *** wolverineav has quit IRC | 19:58 | |
| *** hongbin has joined #openstack-infra | 20:01 | |
| *** ijw_ has quit IRC | 20:02 | |
| pabelanger | woot. complex inventory now works as expected: http://logs.openstack.org/39/519539/34/check/windmill-ubuntu-xenial/ba41e19/job-output.txt.gz | 20:07 |
| pabelanger | 6 hosts for ansible, but actually just a single node | 20:07 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Allow .yml extensions for user config files https://review.openstack.org/540676 | 20:17 |
| *** wolverineav has joined #openstack-infra | 20:17 | |
| *** wolverineav has quit IRC | 20:21 | |
| *** tosky has quit IRC | 20:47 | |
| AJaeger | pabelanger: Great! | 20:49 |
| *** tosky has joined #openstack-infra | 20:50 | |
| *** armaan has joined #openstack-infra | 20:56 | |
| *** ijw has joined #openstack-infra | 21:00 | |
| *** ijw has quit IRC | 21:07 | |
| *** timothyb89 has quit IRC | 21:08 | |
| *** edmondsw has joined #openstack-infra | 21:16 | |
| *** hongbin has quit IRC | 21:16 | |
| *** hongbin has joined #openstack-infra | 21:17 | |
| *** edmondsw has quit IRC | 21:20 | |
| *** olaph has quit IRC | 21:23 | |
| *** olaph has joined #openstack-infra | 21:23 | |
| *** hongbin has quit IRC | 21:24 | |
| *** hongbin has joined #openstack-infra | 21:25 | |
| *** aeng has joined #openstack-infra | 21:30 | |
| openstackgerrit | Merged openstack-dev/hacking master: Disambiguate the hacking rules for third party imports https://review.openstack.org/434306 | 21:33 |
| *** yamahata has quit IRC | 21:41 | |
| openstackgerrit | Merged openstack-dev/hacking master: Drop py34 target in tox.ini https://review.openstack.org/538731 | 21:44 |
| openstackgerrit | Frank Kloeker proposed openstack-infra/openstack-zuul-jobs master: [WIP] docs sitemap generation automation https://review.openstack.org/524862 | 21:50 |
| *** bobh has quit IRC | 21:53 | |
| *** armaan has quit IRC | 21:55 | |
| *** hongbin has quit IRC | 21:56 | |
| openstackgerrit | Merged openstack-dev/hacking master: Updated from global requirements https://review.openstack.org/520377 | 21:57 |
| *** ijw has joined #openstack-infra | 21:59 | |
| *** ijw has quit IRC | 22:03 | |
| *** rkukura has joined #openstack-infra | 22:03 | |
| *** ijw has joined #openstack-infra | 22:03 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/openstack-zuul-jobs master: [WIP] docs sitemap generation automation https://review.openstack.org/524862 | 22:15 |
| openstackgerrit | Lingxian Kong proposed openstack-infra/project-config master: Migrate to Storyboard for Qinling related projects https://review.openstack.org/540681 | 22:23 |
| *** ijw has quit IRC | 22:26 | |
| *** dsariel has quit IRC | 22:27 | |
| *** slaweq has joined #openstack-infra | 22:30 | |
| *** hongbin has joined #openstack-infra | 22:34 | |
| *** ijw has joined #openstack-infra | 22:35 | |
| *** slaweq has quit IRC | 22:35 | |
| *** wolverineav has joined #openstack-infra | 22:39 | |
| *** ijw has quit IRC | 22:40 | |
| *** mriedem has quit IRC | 22:40 | |
| *** wolverineav has quit IRC | 22:44 | |
| *** e0ne has quit IRC | 22:50 | |
| *** hongbin has quit IRC | 22:54 | |
| *** rossella_s has joined #openstack-infra | 23:02 | |
| *** edmondsw has joined #openstack-infra | 23:04 | |
| *** ijw has joined #openstack-infra | 23:06 | |
| *** edmondsw has quit IRC | 23:08 | |
| *** rossella_s has quit IRC | 23:08 | |
| *** rossella_s has joined #openstack-infra | 23:09 | |
| *** ijw has quit IRC | 23:10 | |
| *** ijw has joined #openstack-infra | 23:10 | |
| *** ijw has quit IRC | 23:11 | |
| *** rossella_s has quit IRC | 23:13 | |
| *** rossella_s has joined #openstack-infra | 23:14 | |
| *** rcernin has joined #openstack-infra | 23:15 | |
| *** ijw has joined #openstack-infra | 23:17 | |
| pabelanger | How are we suggesting projects collect logs from nodes? Do we have something generic AtM? | 23:20 |
| *** ijw has quit IRC | 23:22 | |
| *** ijw has joined #openstack-infra | 23:24 | |
| *** ijw has quit IRC | 23:26 | |
| *** rossella_s has quit IRC | 23:28 | |
| *** rossella_s has joined #openstack-infra | 23:30 | |
| *** ijw has joined #openstack-infra | 23:33 | |
| *** ijw has quit IRC | 23:34 | |
| *** ijw has joined #openstack-infra | 23:35 | |
| *** ijw has quit IRC | 23:36 | |
| *** ijw has joined #openstack-infra | 23:37 | |
| *** rossella_s has quit IRC | 23:38 | |
| *** ijw has quit IRC | 23:38 | |
| *** rossella_s has joined #openstack-infra | 23:40 | |
| *** ijw has joined #openstack-infra | 23:46 | |
| *** ijw has quit IRC | 23:48 | |
| *** wolverineav has joined #openstack-infra | 23:50 | |
| *** stakeda has joined #openstack-infra | 23:50 | |
| *** nibz is now known as nibalizer | 23:52 | |
| *** wolverineav has quit IRC | 23:54 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!