| *** heyongli has quit IRC | 00:00 | |
| *** heyongli has joined #openstack-infra | 00:00 | |
| *** olaph has quit IRC | 00:01 | |
| clarkb | it almost looks like the zuul executor process thinks it is getting a command and exiting 0 as a result | 00:02 |
|---|---|---|
| clarkb | (but thats mostly me inferring that from code and exit status) | 00:02 |
| *** ijw_ has quit IRC | 00:04 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Fix sphinx publishing https://review.openstack.org/530790 | 00:05 |
| *** dave-mccowan has joined #openstack-infra | 00:06 | |
| clarkb | ok I think I have figured it out /etc/default/zuul-executor says PIDFILE is /var/run/zuul/executor.pid but /var/run/zuul does not exist | 00:08 |
| clarkb | https://review.openstack.org/#/c/521680/ made that change | 00:09 |
| *** heyongli has quit IRC | 00:10 | |
| *** heyongli has joined #openstack-infra | 00:10 | |
| clarkb | ze01 has a /var/run/zuul and puppet-zuul init.pp certainly should create one | 00:11 |
| clarkb | confused at why ze04 doesn't have one given when that change merged | 00:12 |
| *** e0ne has quit IRC | 00:14 | |
| *** xarses_ has quit IRC | 00:14 | |
| *** jlk has quit IRC | 00:14 | |
| mordred | clarkb: yah - I'd be willing to be it hit EFUND | 00:14 |
| *** olaph has joined #openstack-infra | 00:14 | |
| clarkb | ok theory time on ze04, when it was shutdown it tried to stop the zuul service which rm's /var/run/zuul even though there is no zuul service running | 00:16 |
| clarkb | and now puppet hasn't run due to the credentials problem | 00:16 |
| clarkb | oh wait it only rm's the pidfile not the dir | 00:16 |
| clarkb | now I am really confused | 00:16 |
| clarkb | corvus: you made the changes to move pidfiles around, any ideas ^? | 00:17 |
| clarkb | mordred: is your french better than mine? do you want to go looking for emails? | 00:18 |
| clarkb | I'm going to robustify the init script handling of the pidfile paths | 00:18 |
| mordred | clarkb: I feel like there is a new human who is in IRC who is not jean-daniel who is now busy and stuff | 00:19 |
| mordred | clarkb: but I do not remember which human it was | 00:19 |
| *** heyongli has quit IRC | 00:20 | |
| *** heyongli has joined #openstack-infra | 00:20 | |
| clarkb | mordred: damien rannou? | 00:23 |
| clarkb | mordred: might also be nice to hvae it log a warning then generate inventory for the other clouds that it can talk to | 00:24 |
| clarkb | rather than just completely fail? I can actually see argument going either way on that | 00:25 |
| *** jamesdenton has joined #openstack-infra | 00:26 | |
| *** ihrachys has quit IRC | 00:26 | |
| *** ijw has joined #openstack-infra | 00:26 | |
| *** ijw has joined #openstack-infra | 00:26 | |
| mordred | well - the ansible inventory is *supposed* to not completely fail if just one of the clouds fail - or at least that's configurable | 00:26 |
| *** mriedem has quit IRC | 00:29 | |
| *** heyongli has quit IRC | 00:30 | |
| *** heyongli has joined #openstack-infra | 00:31 | |
| *** edmondsw has joined #openstack-infra | 00:31 | |
| *** mlavalle has quit IRC | 00:32 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-zuul master: Don't assume pidfile location https://review.openstack.org/530820 | 00:32 |
| clarkb | mordred: I think it is completely failing fwiw | 00:32 |
| clarkb | I think this new change will make ze04 work more reliably | 00:32 |
| clarkb | I still don't know why it broke in the first place though | 00:32 |
| clarkb | I'm approving the ovh disabling | 00:35 |
| *** edmondsw has quit IRC | 00:36 | |
| clarkb | that should stabilize CI then we just hae to followup and stabilize ansible | 00:36 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Slack driver https://review.openstack.org/530521 | 00:39 |
| corvus | clarkb: /var/run is a tmpfs on xenial; we may need the init script to create it for us. i think your change may be the best fix. | 00:40 |
| *** heyongli has quit IRC | 00:41 | |
| clarkb | corvus: ah that would explain it, thanks | 00:41 |
| *** heyongli has joined #openstack-infra | 00:41 | |
| corvus | i'm guessing executors starting after boot is just wonky / racy with puppet | 00:41 |
| openstackgerrit | Merged openstack-infra/project-config master: Disable OVH https://review.openstack.org/530817 | 00:41 |
| clarkb | with ^ I think the urgency around sorting out ovh drops. I've got to figure out storage in garage in a few so not sure I'll be able to followup with ovh today | 00:44 |
| clarkb | but I'm not sure puppet is applying anyways so we may have to manually apply that | 00:45 |
| clarkb | any objects to me manually applying the disable ovh change to nl02 really quick? | 00:45 |
| clarkb | *any objections | 00:45 |
| * clarkb hears none and does that really quick | 00:47 | |
| clarkb | #status log openstackci-ovh accounts are not working and ovh hosted mirrors are not pinging. The accounts breaking appears to prevent ansible puppet from running (due to failed inventory) this needs to be sorted out. | 00:49 |
| openstackstatus | clarkb: finished logging | 00:49 |
| clarkb | #status log openstackci-ovh accounts are not working and ovh hosted mirrors are not pinging. We have removed OVH from nodepool via 530817 and this change has been manually applied (see previous message for why ansible puppet is not working) | 00:49 |
| openstackstatus | clarkb: finished logging | 00:49 |
| clarkb | #status log no zuul-executor is running on ze04 currently. /var/run/ is a tmpfs on xenial so /var/run/zuul does not exist on ze04 after a reboot preventing zuul-executor from starting. https://review.openstack.org/530820 is the proposed fix | 00:50 |
| openstackstatus | clarkb: finished logging | 00:50 |
| *** heyongli has quit IRC | 00:51 | |
| *** heyongli has joined #openstack-infra | 00:51 | |
| *** larainema has joined #openstack-infra | 00:53 | |
| *** xarses_ has joined #openstack-infra | 00:53 | |
| *** caphrim007_ has joined #openstack-infra | 00:53 | |
| *** caphrim00_ has joined #openstack-infra | 00:55 | |
| *** caphrim007_ has quit IRC | 00:55 | |
| openstackgerrit | Merged openstack-infra/puppet-mailman master: Alias $name in mailman site for vhost templating https://review.openstack.org/529893 | 00:55 |
| openstackgerrit | Merged openstack-infra/puppet-mailman master: Fix multisite archive paths https://review.openstack.org/529894 | 00:55 |
| openstackgerrit | Merged openstack-infra/puppet-mailman master: Export MAILMAN_SITE_DIR in init script https://review.openstack.org/529895 | 00:56 |
| *** caphrim007 has quit IRC | 00:57 | |
| *** cuongnv has joined #openstack-infra | 00:57 | |
| *** kiennt26 has joined #openstack-infra | 00:57 | |
| *** caphrim00_ has quit IRC | 01:00 | |
| *** xarses_ has quit IRC | 01:00 | |
| *** heyongli has quit IRC | 01:01 | |
| *** heyongli has joined #openstack-infra | 01:01 | |
| jhesketh | clarkb: left a query in 530820 for you | 01:04 |
| jhesketh | clarkb: but thinking about the pid's more, just removing the PIDFILE would let us use /var/lib/zuul/service.pid instead of having a dir for each service which imo would be an improvement | 01:04 |
| corvus | jhesketh: that's the case in zuulv3. the init script supports both by setting PIDFILE in /etc/default/zuul-{service} only for zuulv3 (and uses the value in the init script for zuulv2) | 01:05 |
| *** rlandy|ruck is now known as rlandy|ruck|bbl | 01:06 | |
| jhesketh | ah cool. I'm +2 on the change, but just removing just $PIDFILE is still somewhat neater if we wanted to iterate on it | 01:07 |
| *** cshastri has joined #openstack-infra | 01:08 | |
| *** xarses_ has joined #openstack-infra | 01:08 | |
| corvus | ++ | 01:08 |
| *** markvoelker has quit IRC | 01:08 | |
| *** lamt` has quit IRC | 01:10 | |
| *** catintheroof has quit IRC | 01:10 | |
| *** catintheroof has joined #openstack-infra | 01:11 | |
| *** heyongli has quit IRC | 01:11 | |
| *** heyongli has joined #openstack-infra | 01:12 | |
| *** slaweq has joined #openstack-infra | 01:13 | |
| *** catintheroof has quit IRC | 01:15 | |
| *** gyee has quit IRC | 01:16 | |
| *** slaweq has quit IRC | 01:18 | |
| *** xarses_ has quit IRC | 01:20 | |
| *** heyongli has quit IRC | 01:22 | |
| *** heyongli has joined #openstack-infra | 01:22 | |
| mordred | clarkb: http://logs.openstack.org/68/530768/1/gate/build-openstack-sphinx-docs/9a4e88c/job-output.txt.gz#_2018-01-03_00_52_58_182349 | 01:22 |
| mordred | clarkb: I *thnk* that ran before we landed the sphinx changes | 01:22 |
| mordred | clarkb: so I'm rechecking | 01:23 |
| mordred | clarkb: but thought I'd point it out in case it's a canary of larger issues | 01:23 |
| *** esberglu has quit IRC | 01:26 | |
| *** Apoorva_ has joined #openstack-infra | 01:27 | |
| *** Apoorva has quit IRC | 01:30 | |
| *** Apoorva_ has quit IRC | 01:32 | |
| *** heyongli has quit IRC | 01:32 | |
| *** heyongli has joined #openstack-infra | 01:32 | |
| *** dave-mccowan has quit IRC | 01:34 | |
| *** heyongli has quit IRC | 01:42 | |
| *** heyongli has joined #openstack-infra | 01:42 | |
| *** namnh has joined #openstack-infra | 01:46 | |
| *** tonyb has quit IRC | 01:47 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Slack driver https://review.openstack.org/530521 | 01:47 |
| *** tonyb has joined #openstack-infra | 01:49 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Add a plugin interface for drivers https://review.openstack.org/524620 | 01:49 |
| *** xarses_ has joined #openstack-infra | 01:52 | |
| *** heyongli has quit IRC | 01:52 | |
| *** heyongli has joined #openstack-infra | 01:53 | |
| *** dave-mccowan has joined #openstack-infra | 01:55 | |
| *** heyongli has quit IRC | 02:03 | |
| *** heyongli has joined #openstack-infra | 02:03 | |
| *** markvoelker has joined #openstack-infra | 02:05 | |
| *** caphrim007 has joined #openstack-infra | 02:08 | |
| *** andreww has joined #openstack-infra | 02:08 | |
| *** pahuang has quit IRC | 02:11 | |
| *** caphrim007 has quit IRC | 02:12 | |
| *** xarses_ has quit IRC | 02:12 | |
| *** heyongli has quit IRC | 02:13 | |
| *** heyongli has joined #openstack-infra | 02:13 | |
| *** annp has joined #openstack-infra | 02:14 | |
| *** dave-mccowan has quit IRC | 02:18 | |
| *** dave-mccowan has joined #openstack-infra | 02:19 | |
| *** edmondsw has joined #openstack-infra | 02:19 | |
| *** heyongli has quit IRC | 02:23 | |
| *** heyongli has joined #openstack-infra | 02:23 | |
| *** edmondsw has quit IRC | 02:24 | |
| *** markmcclain has quit IRC | 02:25 | |
| *** ijw has quit IRC | 02:25 | |
| *** gouthamr has quit IRC | 02:27 | |
| *** yamahata has quit IRC | 02:30 | |
| *** iyamahat has quit IRC | 02:30 | |
| *** andreww has quit IRC | 02:31 | |
| *** heyongli has quit IRC | 02:33 | |
| *** heyongli has joined #openstack-infra | 02:34 | |
| clarkb | we cant remove $PIDFILE can we? would break v2 | 02:38 |
| *** owalsh_ has joined #openstack-infra | 02:42 | |
| *** heyongli has quit IRC | 02:44 | |
| *** heyongli has joined #openstack-infra | 02:44 | |
| *** owalsh has quit IRC | 02:45 | |
| *** heyongli has quit IRC | 02:54 | |
| *** heyongli has joined #openstack-infra | 02:54 | |
| *** pahuang has joined #openstack-infra | 02:57 | |
| *** xinliang has quit IRC | 02:57 | |
| *** heyongli has quit IRC | 03:04 | |
| *** heyongli has joined #openstack-infra | 03:04 | |
| *** markmcclain has joined #openstack-infra | 03:05 | |
| *** xinliang has joined #openstack-infra | 03:10 | |
| *** xinliang has joined #openstack-infra | 03:10 | |
| *** heyongli has quit IRC | 03:14 | |
| *** heyongli has joined #openstack-infra | 03:15 | |
| *** flwang has quit IRC | 03:16 | |
| *** flwang has joined #openstack-infra | 03:17 | |
| *** Apoorva has joined #openstack-infra | 03:23 | |
| *** Apoorva has quit IRC | 03:24 | |
| *** heyongli has quit IRC | 03:25 | |
| *** heyongli has joined #openstack-infra | 03:25 | |
| *** Apoorva has joined #openstack-infra | 03:25 | |
| *** caphrim007 has joined #openstack-infra | 03:28 | |
| *** gongysh has joined #openstack-infra | 03:28 | |
| *** rhallisey has quit IRC | 03:30 | |
| *** masber has quit IRC | 03:32 | |
| *** markmcclain has quit IRC | 03:33 | |
| *** ramishra has joined #openstack-infra | 03:33 | |
| *** heyongli has quit IRC | 03:35 | |
| *** heyongli has joined #openstack-infra | 03:35 | |
| *** rlandy|ruck|bbl is now known as rlandy|ruck | 03:38 | |
| *** liujiong has joined #openstack-infra | 03:38 | |
| *** gcb has quit IRC | 03:44 | |
| *** nicolasbock has quit IRC | 03:44 | |
| *** heyongli has quit IRC | 03:45 | |
| *** heyongli has joined #openstack-infra | 03:45 | |
| *** ykarel has joined #openstack-infra | 03:49 | |
| *** heyongli has quit IRC | 03:55 | |
| *** heyongli has joined #openstack-infra | 03:56 | |
| *** hongbin has joined #openstack-infra | 03:59 | |
| *** heyongli has quit IRC | 04:06 | |
| *** heyongli has joined #openstack-infra | 04:06 | |
| *** edmondsw has joined #openstack-infra | 04:07 | |
| *** edmondsw has quit IRC | 04:12 | |
| *** udesale has joined #openstack-infra | 04:15 | |
| *** heyongli has quit IRC | 04:16 | |
| *** heyongli has joined #openstack-infra | 04:16 | |
| *** gmann has joined #openstack-infra | 04:19 | |
| *** Apoorva has quit IRC | 04:20 | |
| *** masber has joined #openstack-infra | 04:21 | |
| *** Apoorva has joined #openstack-infra | 04:21 | |
| *** Apoorva has quit IRC | 04:25 | |
| *** heyongli has quit IRC | 04:26 | |
| *** heyongli has joined #openstack-infra | 04:26 | |
| *** rlandy|ruck has quit IRC | 04:29 | |
| *** hemna_ has quit IRC | 04:29 | |
| *** Apoorva has joined #openstack-infra | 04:30 | |
| *** heyongli has quit IRC | 04:36 | |
| *** heyongli has joined #openstack-infra | 04:37 | |
| *** heyongli has quit IRC | 04:47 | |
| *** heyongli has joined #openstack-infra | 04:47 | |
| *** links has joined #openstack-infra | 04:48 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: Add linters job and role https://review.openstack.org/530682 | 04:49 |
| *** psachin has joined #openstack-infra | 04:55 | |
| *** heyongli has quit IRC | 04:57 | |
| *** heyongli has joined #openstack-infra | 04:57 | |
| *** xarses_ has joined #openstack-infra | 04:57 | |
| *** links has quit IRC | 04:58 | |
| *** markmcclain has joined #openstack-infra | 05:01 | |
| *** links has joined #openstack-infra | 05:03 | |
| *** dave-mccowan has quit IRC | 05:06 | |
| *** heyongli has quit IRC | 05:07 | |
| *** heyongli has joined #openstack-infra | 05:07 | |
| *** pgadiya has joined #openstack-infra | 05:09 | |
| openstackgerrit | Merged openstack-infra/project-config master: Use sphinx_output_suffix https://review.openstack.org/530791 | 05:09 |
| *** yamamoto has joined #openstack-infra | 05:10 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove legacy beaker jobs from Puppet OpenStack modules https://review.openstack.org/530807 | 05:13 |
| *** Apoorva has quit IRC | 05:14 | |
| *** heyongli has quit IRC | 05:17 | |
| *** heyongli has joined #openstack-infra | 05:18 | |
| *** gongysh has quit IRC | 05:26 | |
| *** heyongli has quit IRC | 05:28 | |
| *** heyongli has joined #openstack-infra | 05:28 | |
| *** annp has quit IRC | 05:30 | |
| *** namnh has quit IRC | 05:30 | |
| *** annp has joined #openstack-infra | 05:31 | |
| *** namnh has joined #openstack-infra | 05:31 | |
| *** cuongnv has quit IRC | 05:34 | |
| *** kiennt26 has quit IRC | 05:34 | |
| *** daidv has quit IRC | 05:34 | |
| *** kiennt26 has joined #openstack-infra | 05:34 | |
| *** cuongnv has joined #openstack-infra | 05:34 | |
| *** daidv has joined #openstack-infra | 05:35 | |
| *** heyongli has quit IRC | 05:38 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: python-upload-pypi: only run on success https://review.openstack.org/530174 | 05:38 |
| *** heyongli has joined #openstack-infra | 05:38 | |
| *** gcb has joined #openstack-infra | 05:42 | |
| *** dmsimard has quit IRC | 05:42 | |
| *** dmsimard has joined #openstack-infra | 05:42 | |
| *** armaan has joined #openstack-infra | 05:45 | |
| *** daidv has quit IRC | 05:45 | |
| *** daidv has joined #openstack-infra | 05:46 | |
| AJaeger | clarkb, mordred : My change for publishing works - https://docs.openstack.org/infra/zuul-jobs/ was just updated. | 05:46 |
| AJaeger | clarkb, mordred : Could either of you remove the extra html directories, please? | 05:46 |
| *** zhurong has joined #openstack-infra | 05:47 | |
| *** heyongli has quit IRC | 05:48 | |
| *** heyongli has joined #openstack-infra | 05:48 | |
| AJaeger | clarkb, mordred : /afs/.openstack.org/docs/openstack-helm/html and /afs/.openstack.org/docs/infra/zuul-jobs/html - and similar on developer-docs. So, something like: rm -rf /afs/.openstack.org/docs/*/html /afs/.openstack.org/docs/infra/*/html and rm -rf /afs/.openstack.org/developer-docs/api-ref/*/html /afs/.openstack.org/developer-docs/api-guide/*/html | 05:49 |
| *** pcichy_ has joined #openstack-infra | 05:53 | |
| *** edmondsw has joined #openstack-infra | 05:56 | |
| *** heyongli has quit IRC | 05:58 | |
| *** heyongli has joined #openstack-infra | 05:59 | |
| *** edmondsw has quit IRC | 06:00 | |
| *** aeng has quit IRC | 06:03 | |
| *** heyongli has quit IRC | 06:09 | |
| *** heyongli has joined #openstack-infra | 06:09 | |
| *** masber has quit IRC | 06:13 | |
| openstackgerrit | Merged openstack-dev/cookiecutter master: Update Python versions only py27 and 35 https://review.openstack.org/530009 | 06:17 |
| *** cshastri has quit IRC | 06:18 | |
| *** eumel8 has joined #openstack-infra | 06:19 | |
| *** heyongli has quit IRC | 06:19 | |
| *** heyongli has joined #openstack-infra | 06:19 | |
| *** markvoelker has quit IRC | 06:28 | |
| *** heyongli has quit IRC | 06:29 | |
| *** heyongli has joined #openstack-infra | 06:29 | |
| *** armax has quit IRC | 06:30 | |
| *** armax has joined #openstack-infra | 06:30 | |
| *** armax has quit IRC | 06:31 | |
| *** armax has joined #openstack-infra | 06:32 | |
| *** armax has quit IRC | 06:32 | |
| *** cshastri has joined #openstack-infra | 06:33 | |
| *** armax has joined #openstack-infra | 06:33 | |
| *** armax has quit IRC | 06:34 | |
| *** coolsvap has joined #openstack-infra | 06:35 | |
| *** heyongli has quit IRC | 06:39 | |
| *** esberglu has joined #openstack-infra | 06:40 | |
| *** heyongli has joined #openstack-infra | 06:40 | |
| *** esberglu has quit IRC | 06:40 | |
| *** esberglu has joined #openstack-infra | 06:40 | |
| *** yamamoto has quit IRC | 06:49 | |
| *** heyongli has quit IRC | 06:50 | |
| *** heyongli has joined #openstack-infra | 06:50 | |
| *** dhajare has joined #openstack-infra | 06:59 | |
| *** heyongli has quit IRC | 07:00 | |
| *** heyongli has joined #openstack-infra | 07:00 | |
| AJaeger | #status log We stopped publishing documents on the 23rd of December by accident, this is fixed now. Publishing to docs.o.o and developer.o.o is workinging again. If you miss a document publish, the next merge should publish... | 07:01 |
| openstackstatus | AJaeger: finished logging | 07:01 |
| *** gongysh has joined #openstack-infra | 07:09 | |
| *** pcaruana has joined #openstack-infra | 07:09 | |
| *** dhajare_ has joined #openstack-infra | 07:10 | |
| *** heyongli has quit IRC | 07:10 | |
| *** heyongli has joined #openstack-infra | 07:10 | |
| *** david-lyle has quit IRC | 07:12 | |
| *** david-lyle has joined #openstack-infra | 07:12 | |
| *** dhajare has quit IRC | 07:13 | |
| *** dhajare_ has quit IRC | 07:19 | |
| *** heyongli has quit IRC | 07:20 | |
| *** heyongli has joined #openstack-infra | 07:21 | |
| *** rcernin has quit IRC | 07:25 | |
| *** markmcclain has quit IRC | 07:30 | |
| *** heyongli has quit IRC | 07:31 | |
| *** heyongli has joined #openstack-infra | 07:31 | |
| *** markmcclain has joined #openstack-infra | 07:32 | |
| *** cshastri has quit IRC | 07:34 | |
| *** cshastri has joined #openstack-infra | 07:35 | |
| *** yamamoto has joined #openstack-infra | 07:38 | |
| *** heyongli has quit IRC | 07:41 | |
| *** heyongli has joined #openstack-infra | 07:41 | |
| *** edmondsw has joined #openstack-infra | 07:44 | |
| *** slaweq has joined #openstack-infra | 07:47 | |
| *** florianf has joined #openstack-infra | 07:47 | |
| *** edmondsw has quit IRC | 07:48 | |
| *** yamamoto has quit IRC | 07:49 | |
| *** jtomasek has joined #openstack-infra | 07:49 | |
| *** jtomasek has quit IRC | 07:50 | |
| *** jtomasek has joined #openstack-infra | 07:51 | |
| *** heyongli has quit IRC | 07:51 | |
| *** heyongli has joined #openstack-infra | 07:51 | |
| *** gongysh has quit IRC | 07:52 | |
| *** e0ne has joined #openstack-infra | 07:57 | |
| *** hongbin has quit IRC | 08:01 | |
| *** heyongli has quit IRC | 08:01 | |
| *** heyongli has joined #openstack-infra | 08:02 | |
| *** armaan has quit IRC | 08:04 | |
| *** liujiong has quit IRC | 08:04 | |
| *** liujiong has joined #openstack-infra | 08:05 | |
| *** armaan has joined #openstack-infra | 08:05 | |
| *** tesseract has joined #openstack-infra | 08:05 | |
| *** heyongli has quit IRC | 08:12 | |
| *** heyongli has joined #openstack-infra | 08:12 | |
| *** medy has joined #openstack-infra | 08:15 | |
| *** medy has quit IRC | 08:16 | |
| *** apetrich has quit IRC | 08:16 | |
| *** medy has joined #openstack-infra | 08:16 | |
| *** apetrich has joined #openstack-infra | 08:16 | |
| *** medy has quit IRC | 08:18 | |
| *** medy has joined #openstack-infra | 08:18 | |
| *** medy has quit IRC | 08:19 | |
| *** medy has joined #openstack-infra | 08:19 | |
| *** medy has quit IRC | 08:21 | |
| *** medy has joined #openstack-infra | 08:21 | |
| *** heyongli has quit IRC | 08:22 | |
| *** medy has quit IRC | 08:22 | |
| *** heyongli has joined #openstack-infra | 08:22 | |
| *** medy has joined #openstack-infra | 08:22 | |
| *** e0ne has quit IRC | 08:23 | |
| *** medy has quit IRC | 08:24 | |
| *** medy has joined #openstack-infra | 08:24 | |
| *** medy has quit IRC | 08:25 | |
| *** medy has joined #openstack-infra | 08:25 | |
| *** medy has quit IRC | 08:27 | |
| *** ech042 has joined #openstack-infra | 08:27 | |
| *** medy has joined #openstack-infra | 08:27 | |
| *** medy has quit IRC | 08:28 | |
| *** medy has joined #openstack-infra | 08:28 | |
| *** markvoelker has joined #openstack-infra | 08:29 | |
| *** medy has quit IRC | 08:29 | |
| *** hashar has joined #openstack-infra | 08:29 | |
| *** heyongli has quit IRC | 08:32 | |
| *** heyongli has joined #openstack-infra | 08:32 | |
| *** gmann has quit IRC | 08:33 | |
| *** heyongli has quit IRC | 08:42 | |
| *** heyongli has joined #openstack-infra | 08:43 | |
| *** armaan has quit IRC | 08:48 | |
| *** armaan has joined #openstack-infra | 08:48 | |
| *** yamamoto has joined #openstack-infra | 08:49 | |
| *** heyongli has quit IRC | 08:53 | |
| *** heyongli has joined #openstack-infra | 08:53 | |
| *** jascott1 has quit IRC | 08:53 | |
| *** jascott1 has joined #openstack-infra | 08:54 | |
| AJaeger | frickler: good morning and happy new year! If you have time for reviews, please tackle some on the list I prepared on https://etherpad.openstack.org/p/Nvt3ovbn5x | 08:55 |
| *** yamamoto has quit IRC | 08:57 | |
| *** jascott1 has quit IRC | 08:59 | |
| *** gmann has joined #openstack-infra | 09:00 | |
| *** heyongli has quit IRC | 09:03 | |
| *** heyongli has joined #openstack-infra | 09:03 | |
| *** markvoelker has quit IRC | 09:03 | |
| *** jpich has joined #openstack-infra | 09:05 | |
| *** heyongli has quit IRC | 09:13 | |
| *** heyongli has joined #openstack-infra | 09:13 | |
| *** dhajare has joined #openstack-infra | 09:16 | |
| *** derekh has joined #openstack-infra | 09:17 | |
| *** erlon has joined #openstack-infra | 09:20 | |
| *** cshastri has quit IRC | 09:21 | |
| *** e0ne has joined #openstack-infra | 09:21 | |
| *** cshastri has joined #openstack-infra | 09:21 | |
| *** heyongli has quit IRC | 09:23 | |
| *** heyongli has joined #openstack-infra | 09:24 | |
| *** dbecker has joined #openstack-infra | 09:25 | |
| *** shardy has joined #openstack-infra | 09:27 | |
| *** d0ugal has quit IRC | 09:27 | |
| *** d0ugal has joined #openstack-infra | 09:28 | |
| *** d0ugal has quit IRC | 09:28 | |
| *** d0ugal has joined #openstack-infra | 09:28 | |
| *** edmondsw has joined #openstack-infra | 09:32 | |
| *** dhajare has quit IRC | 09:33 | |
| *** heyongli has quit IRC | 09:34 | |
| *** heyongli has joined #openstack-infra | 09:34 | |
| *** dhajare has joined #openstack-infra | 09:34 | |
| *** mgoddard has joined #openstack-infra | 09:36 | |
| *** ykarel_ has joined #openstack-infra | 09:37 | |
| *** dhajare has quit IRC | 09:37 | |
| *** edmondsw has quit IRC | 09:37 | |
| *** erlon has quit IRC | 09:38 | |
| *** ykarel has quit IRC | 09:39 | |
| *** lucas-afk is now known as lucasagomes | 09:40 | |
| *** ykarel_ is now known as ykarel | 09:40 | |
| *** dhajare has joined #openstack-infra | 09:44 | |
| *** heyongli has quit IRC | 09:44 | |
| *** heyongli has joined #openstack-infra | 09:44 | |
| *** liujiong has quit IRC | 09:51 | |
| *** dhajare has quit IRC | 09:51 | |
| *** yamamoto has joined #openstack-infra | 09:53 | |
| *** dhajare has joined #openstack-infra | 09:53 | |
| *** heyongli has quit IRC | 09:54 | |
| *** heyongli has joined #openstack-infra | 09:54 | |
| *** ralonsoh has joined #openstack-infra | 10:00 | |
| *** dhajare has quit IRC | 10:00 | |
| *** markvoelker has joined #openstack-infra | 10:01 | |
| *** numans is now known as numans_afk | 10:02 | |
| *** heyongli has quit IRC | 10:04 | |
| *** heyongli has joined #openstack-infra | 10:05 | |
| *** ralonsoh_ has joined #openstack-infra | 10:06 | |
| *** ralonsoh has quit IRC | 10:06 | |
| *** kiennt26 has quit IRC | 10:06 | |
| *** cuongnv has quit IRC | 10:07 | |
| *** pcaruana has quit IRC | 10:09 | |
| *** pcaruana has joined #openstack-infra | 10:10 | |
| *** pbourke has quit IRC | 10:10 | |
| *** pbourke has joined #openstack-infra | 10:10 | |
| *** namnh has quit IRC | 10:11 | |
| *** dhajare has joined #openstack-infra | 10:11 | |
| *** armaan has quit IRC | 10:12 | |
| *** armaan has joined #openstack-infra | 10:13 | |
| *** heyongli has quit IRC | 10:15 | |
| *** heyongli has joined #openstack-infra | 10:15 | |
| *** dhajare_ has joined #openstack-infra | 10:20 | |
| frickler | AJaeger: happy new year for you, too. Is it intended that the new pti docs build should also affect stable branches? I proposed https://review.openstack.org/530859 after seeing a failure in devstack stable/pike but I'd like to confirm that this is the intended way to proceed | 10:20 |
| *** annp has quit IRC | 10:21 | |
| *** owalsh has joined #openstack-infra | 10:21 | |
| *** ykarel is now known as ykarel|lunch | 10:21 | |
| AJaeger | frickler: yes, it does affect stable branches as well - I hope there're not that many of these issues. | 10:21 |
| *** dhajare has quit IRC | 10:22 | |
| AJaeger | frickler: so, your change is fine. Thanks! | 10:22 |
| *** owalsh_ has quit IRC | 10:22 | |
| AJaeger | frickler: another broken docs job - since Zuul v3 conversion - is fixed with https://review.openstack.org/#/c/530239/ - grenade | 10:23 |
| *** heyongli has quit IRC | 10:25 | |
| *** heyongli has joined #openstack-infra | 10:25 | |
| *** hjensas has joined #openstack-infra | 10:25 | |
| *** dhajare_ has quit IRC | 10:26 | |
| *** claudiub has joined #openstack-infra | 10:26 | |
| frickler | AJaeger: hmm, looking at https://review.openstack.org/#/q/topic:updated-pti+%28status:open+OR+status:merged%29 it seems that quite a few of those will need cherry-picks. might be non-trivial too if req caps are different for older stable branches, didn't check that yet. | 10:27 |
| chandankumar | frickler: Hello & Happy new year :-) | 10:28 |
| chandankumar | frickler: https://review.openstack.org/526865 , https://review.openstack.org/528672 can we get this merged? | 10:28 |
| *** andreww has joined #openstack-infra | 10:29 | |
| *** armaan has quit IRC | 10:29 | |
| *** armaan has joined #openstack-infra | 10:30 | |
| *** andreww has quit IRC | 10:30 | |
| hjensas | When I have circular dependencies. e.g https://review.openstack.org/#/c/526480/4 and https://review.openstack.org/#/c/471969/ - both depend on each-other. CI does not run jobs it seems, there is no feedback. How is this supposed to work? | 10:30 |
| frickler | hjensas: it isn't, you must change your dependencies | 10:30 |
| *** xarses_ has quit IRC | 10:32 | |
| *** andreww has joined #openstack-infra | 10:32 | |
| hjensas | frickler: so I cannot have both depend on eachother? In that case I will have to lobby and get agreement to temporarily remove tests, merge that, merge the change and then merge updated tests ... I guess I'am off to lobby then. :) | 10:34 |
| *** markvoelker has quit IRC | 10:34 | |
| frickler | hjensas: we cannot merge two changes simultaneously, one has to go first, so circular dependencies won't allow any patch to merge | 10:35 |
| *** heyongli has quit IRC | 10:35 | |
| *** heyongli has joined #openstack-infra | 10:35 | |
| *** wolverineav has joined #openstack-infra | 10:39 | |
| AJaeger | frickler, yes, in those cases backports might need some tweaking. | 10:40 |
| openstackgerrit | Merged openstack-infra/project-config master: Added initial jobs for telemetry tempest plugin https://review.openstack.org/526865 | 10:40 |
| AJaeger | frickler: replied on https://review.openstack.org/#/c/530239/ | 10:40 |
| *** armaan has quit IRC | 10:43 | |
| *** armaan has joined #openstack-infra | 10:44 | |
| *** wolverineav has quit IRC | 10:44 | |
| *** heyongli has quit IRC | 10:45 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add new repo for Blazar tempest plugin https://review.openstack.org/528672 | 10:45 |
| *** heyongli has joined #openstack-infra | 10:46 | |
| *** verdurin has quit IRC | 10:49 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove devstack-gate specific tox jobs https://review.openstack.org/528554 | 10:50 |
| AJaeger | frickler: thanks for reviewing! Fixed ^ | 10:50 |
| openstackgerrit | Lee Yarwood proposed openstack-infra/project-config master: Avoid running tempest-full on stable/pike https://review.openstack.org/530894 | 10:53 |
| *** jascott1 has joined #openstack-infra | 10:55 | |
| *** heyongli has quit IRC | 10:56 | |
| *** priteau has joined #openstack-infra | 10:56 | |
| *** sshnaidm|afk is now known as sshnaidm | 10:56 | |
| *** heyongli has joined #openstack-infra | 10:56 | |
| *** jkilpatr has quit IRC | 11:00 | |
| *** verdurin has joined #openstack-infra | 11:01 | |
| *** hashar has quit IRC | 11:05 | |
| *** heyongli has quit IRC | 11:06 | |
| *** zhurong has quit IRC | 11:06 | |
| *** heyongli has joined #openstack-infra | 11:06 | |
| *** ykarel|lunch is now known as ykarel | 11:07 | |
| *** heyongli has quit IRC | 11:16 | |
| *** heyongli has joined #openstack-infra | 11:16 | |
| *** edmondsw has joined #openstack-infra | 11:20 | |
| *** edmondsw has quit IRC | 11:24 | |
| *** heyongli has quit IRC | 11:26 | |
| *** heyongli has joined #openstack-infra | 11:27 | |
| *** rfolco has joined #openstack-infra | 11:30 | |
| *** markvoelker has joined #openstack-infra | 11:31 | |
| *** nicolasbock has joined #openstack-infra | 11:36 | |
| *** edmondsw has joined #openstack-infra | 11:36 | |
| *** heyongli has quit IRC | 11:37 | |
| *** heyongli has joined #openstack-infra | 11:37 | |
| *** heyongli has quit IRC | 11:47 | |
| *** heyongli has joined #openstack-infra | 11:47 | |
| *** jkilpatr has joined #openstack-infra | 11:49 | |
| *** armaan has quit IRC | 11:54 | |
| *** armaan has joined #openstack-infra | 11:54 | |
| *** tosky has joined #openstack-infra | 11:56 | |
| *** heyongli has quit IRC | 11:57 | |
| *** heyongli has joined #openstack-infra | 11:57 | |
| *** cshastri has quit IRC | 11:58 | |
| *** markvoelker has quit IRC | 12:05 | |
| *** smatzek has joined #openstack-infra | 12:07 | |
| *** heyongli has quit IRC | 12:07 | |
| *** heyongli has joined #openstack-infra | 12:08 | |
| *** sambetts|afk is now known as sambetts | 12:09 | |
| *** gcb has quit IRC | 12:09 | |
| *** gcb has joined #openstack-infra | 12:12 | |
| *** dhajare has joined #openstack-infra | 12:12 | |
| *** edmondsw has quit IRC | 12:15 | |
| *** heyongli has quit IRC | 12:18 | |
| *** heyongli has joined #openstack-infra | 12:18 | |
| *** dhajare has quit IRC | 12:21 | |
| *** yamamoto has quit IRC | 12:24 | |
| *** cshastri has joined #openstack-infra | 12:26 | |
| *** heyongli has quit IRC | 12:28 | |
| *** gcb has quit IRC | 12:28 | |
| *** jkilpatr has quit IRC | 12:28 | |
| *** heyongli has joined #openstack-infra | 12:28 | |
| *** gcb has joined #openstack-infra | 12:31 | |
| *** cshastri has quit IRC | 12:34 | |
| *** lucasagomes is now known as lucas-hungry | 12:34 | |
| *** dhajare has joined #openstack-infra | 12:37 | |
| fungi | #status log manually started apache2 service on ask.o.o, seems to have crashed/failed to correctly restart during log rotation | 12:37 |
| openstackstatus | fungi: finished logging | 12:37 |
| *** heyongli has quit IRC | 12:38 | |
| *** heyongli has joined #openstack-infra | 12:38 | |
| *** dhajare has quit IRC | 12:46 | |
| *** shardy is now known as shardy_mtg | 12:48 | |
| *** heyongli has quit IRC | 12:48 | |
| *** heyongli has joined #openstack-infra | 12:49 | |
| *** pcrews has quit IRC | 12:49 | |
| *** sdague has joined #openstack-infra | 12:49 | |
| *** yamamoto has joined #openstack-infra | 12:56 | |
| *** yamamoto has quit IRC | 12:56 | |
| *** shardy_mtg is now known as shardy | 12:58 | |
| *** catintheroof has joined #openstack-infra | 12:58 | |
| *** dhajare has joined #openstack-infra | 12:59 | |
| *** heyongli has quit IRC | 12:59 | |
| *** heyongli has joined #openstack-infra | 12:59 | |
| *** catintheroof has quit IRC | 12:59 | |
| *** catintheroof has joined #openstack-infra | 12:59 | |
| *** rlandy has joined #openstack-infra | 13:00 | |
| *** rlandy is now known as rlandy|ruck|mtg | 13:00 | |
| *** markvoelker has joined #openstack-infra | 13:02 | |
| *** tlam has joined #openstack-infra | 13:02 | |
| *** wolverineav has joined #openstack-infra | 13:03 | |
| *** pgadiya has quit IRC | 13:05 | |
| *** jcoufal has joined #openstack-infra | 13:05 | |
| *** heyongli has quit IRC | 13:09 | |
| *** heyongli has joined #openstack-infra | 13:09 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/openstack-zuul-jobs master: Make sure we only run tempest-full on master https://review.openstack.org/530915 | 13:11 |
| *** armaan has quit IRC | 13:13 | |
| *** armaan has joined #openstack-infra | 13:13 | |
| *** edmondsw has joined #openstack-infra | 13:13 | |
| *** pgadiya has joined #openstack-infra | 13:15 | |
| *** edmondsw has quit IRC | 13:18 | |
| *** markvoelker has quit IRC | 13:19 | |
| *** heyongli has quit IRC | 13:19 | |
| *** heyongli has joined #openstack-infra | 13:19 | |
| *** Goneri has quit IRC | 13:19 | |
| *** markvoelker has joined #openstack-infra | 13:20 | |
| *** dhajare has quit IRC | 13:22 | |
| *** yolanda__ has joined #openstack-infra | 13:25 | |
| *** yamamoto has joined #openstack-infra | 13:28 | |
| *** yolanda has quit IRC | 13:29 | |
| *** heyongli has quit IRC | 13:29 | |
| *** psachin has quit IRC | 13:29 | |
| *** heyongli has joined #openstack-infra | 13:30 | |
| *** rhallisey has joined #openstack-infra | 13:31 | |
| *** lucas-hungry is now known as lucasagomes | 13:32 | |
| *** yamamoto has quit IRC | 13:33 | |
| *** jaypipes has joined #openstack-infra | 13:35 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/system-config master: Update SSH key for shrews https://review.openstack.org/530918 | 13:37 |
| *** trown|outtypewww is now known as trown | 13:37 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/system-config master: Update SSH key for shrews https://review.openstack.org/530918 | 13:37 |
| openstackgerrit | Frank Kloeker proposed openstack-infra/system-config master: Add Frank Kloeker to manifests/users.pp https://review.openstack.org/530920 | 13:38 |
| *** psachin has joined #openstack-infra | 13:39 | |
| *** heyongli has quit IRC | 13:40 | |
| *** heyongli has joined #openstack-infra | 13:40 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/system-config master: Installation of i18n-checksite.openstack.org https://review.openstack.org/487936 | 13:41 |
| *** jkilpatr has joined #openstack-infra | 13:42 | |
| *** psachin has quit IRC | 13:43 | |
| *** panda|pto is now known as panda | 13:48 | |
| *** heyongli has quit IRC | 13:50 | |
| *** dave-mccowan has joined #openstack-infra | 13:50 | |
| *** heyongli has joined #openstack-infra | 13:50 | |
| *** mriedem has joined #openstack-infra | 13:52 | |
| *** rlandy|ruck|mtg is now known as rlandy|ruck | 13:53 | |
| *** links has quit IRC | 13:57 | |
| *** heyongli has quit IRC | 14:00 | |
| *** heyongli has joined #openstack-infra | 14:00 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/system-config master: Update SSH key for shrews https://review.openstack.org/530918 | 14:01 |
| Shrews | silly missing comma | 14:01 |
| *** fanzhang has quit IRC | 14:10 | |
| *** fanzhang has joined #openstack-infra | 14:10 | |
| *** heyongli has quit IRC | 14:10 | |
| *** heyongli has joined #openstack-infra | 14:11 | |
| *** Goneri has joined #openstack-infra | 14:12 | |
| *** sdake has quit IRC | 14:12 | |
| *** sdake has joined #openstack-infra | 14:13 | |
| *** sdake has quit IRC | 14:13 | |
| *** sdake has joined #openstack-infra | 14:13 | |
| *** swest has joined #openstack-infra | 14:15 | |
| *** Goneri has quit IRC | 14:16 | |
| *** mriedem has quit IRC | 14:17 | |
| *** heyongli has quit IRC | 14:21 | |
| *** heyongli has joined #openstack-infra | 14:21 | |
| *** hongbin has joined #openstack-infra | 14:21 | |
| *** smatzek has quit IRC | 14:24 | |
| *** smatzek has joined #openstack-infra | 14:25 | |
| *** pgadiya has quit IRC | 14:25 | |
| *** yamamoto has joined #openstack-infra | 14:28 | |
| AJaeger | infra-root, https://review.openstack.org/#/c/528672/ merged 4 hours ago but the new repo blazar-tempest-plugin is still not created. Do we have a stuck puppet? | 14:28 |
| *** HeOS has joined #openstack-infra | 14:29 | |
| *** smatzek has quit IRC | 14:29 | |
| *** rkukura has quit IRC | 14:30 | |
| *** heyongli has quit IRC | 14:31 | |
| *** heyongli has joined #openstack-infra | 14:31 | |
| *** ykarel is now known as ykarel|afk | 14:32 | |
| *** yamamoto has quit IRC | 14:32 | |
| *** Goneri has joined #openstack-infra | 14:33 | |
| *** Goneri has quit IRC | 14:34 | |
| *** HeOS has quit IRC | 14:36 | |
| *** edmondsw has joined #openstack-infra | 14:37 | |
| *** mriedem has joined #openstack-infra | 14:41 | |
| *** heyongli has quit IRC | 14:41 | |
| *** heyongli has joined #openstack-infra | 14:41 | |
| Shrews | AJaeger: i'm no puppet expert, but the puppet log has: 2018-01-03 14:31:58,710 p=8965 u=root | ERROR! Attempted to execute "/etc/ansible/hosts/openstack" as inventory script: Inventory script (/etc/ansible/hosts/openstack) had an execution error: | 14:42 |
| Shrews | keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. | 14:42 |
| *** sshnaidm is now known as sshnaidm|mtg | 14:42 | |
| Shrews | which certainly doesn't seem good | 14:42 |
| frickler | AJaeger: Shrews: oh, that might be the ovh account issue still | 14:43 |
| *** ramishra has quit IRC | 14:43 | |
| AJaeger | Argh ;( What can we do? | 14:43 |
| AJaeger | Shrews: thanks for checking | 14:43 |
| Shrews | the entire puppet_run_all.log is that traceback | 14:43 |
| frickler | probably need to disable ovh for the time being or find out what happened to that account | 14:44 |
| *** bobh has joined #openstack-infra | 14:44 | |
| frickler | maybe clarkb, corvus or fungi would know more | 14:44 |
| Shrews | 2018-01-03 00:49:11 UTC openstackci-ovh accounts are not working and ovh hosted mirrors are not pinging. The accounts breaking appears to prevent ansible puppet from running (due to failed inventory) this needs to be sorted out. | 14:45 |
| Shrews | from infra status wiki | 14:45 |
| *** yamamoto has joined #openstack-infra | 14:46 | |
| *** yamamoto has quit IRC | 14:46 | |
| frickler | Shrews: yes, I think someone was going to contact ovh about this, hopefully there will be a reply waiting in an inbox | 14:46 |
| pabelanger | we likey have to remove ovh from clouds.yaml too, or fix dynamic inventory to not bomb on bad credentials | 14:47 |
| AJaeger | let's wait for clarkb or fungi to chime in here - and advice whether we should not merge certain changes | 14:47 |
| *** Goneri has joined #openstack-infra | 14:51 | |
| *** Goneri has quit IRC | 14:51 | |
| *** heyongli has quit IRC | 14:51 | |
| *** heyongli has joined #openstack-infra | 14:52 | |
| *** ianychoi has quit IRC | 14:53 | |
| *** hjensas has quit IRC | 14:54 | |
| *** slaweq has quit IRC | 14:54 | |
| pabelanger | sure, until ovh comes back, ansible wheel will just be broken. Wonder if our credentials expired again | 14:55 |
| frickler | AJaeger: I think we should delay creating new repos at least | 14:56 |
| *** rlandy|ruck is now known as rlandy|ruck|mtg | 14:56 | |
| frickler | pabelanger: oh, did that happen already? someone guessed credits went out, but a simple pw expiration might be even more plausible | 14:56 |
| Shrews | anyone want to poke https://review.openstack.org/530789 along for us? | 14:57 |
| pabelanger | frickler: IIRC, the last time this happened, our account was disabled because coupon code expired. Would make sense if that happened again being start of 2018 | 14:57 |
| Shrews | just opens the finger port on zuulv3 | 14:57 |
| pabelanger | +3 | 14:58 |
| Shrews | w00t | 14:58 |
| *** pcichy_ has quit IRC | 14:58 | |
| *** pcichy_ has joined #openstack-infra | 14:58 | |
| *** eharney has joined #openstack-infra | 14:59 | |
| AJaeger | frickler: yeah - we should. Let me WIP the one that I'm aware of right now... | 15:01 |
| *** slaweq has joined #openstack-infra | 15:01 | |
| *** heyongli has quit IRC | 15:02 | |
| *** heyongli has joined #openstack-infra | 15:02 | |
| * AJaeger just removed his +2 and added comment | 15:03 | |
| *** pcichy_ has quit IRC | 15:03 | |
| *** pcichy_ has joined #openstack-infra | 15:03 | |
| *** slaweq has quit IRC | 15:05 | |
| *** rkukura has joined #openstack-infra | 15:05 | |
| *** Apoorva has joined #openstack-infra | 15:06 | |
| *** abelur_ has quit IRC | 15:07 | |
| *** Goneri has joined #openstack-infra | 15:08 | |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Deprecate testr and nose integration https://review.openstack.org/518224 | 15:10 |
| stephenfin | dhellmann: Fancy hitting that one too (added a missing reno) | 15:10 |
| stephenfin | ? | 15:10 |
| *** smatzek has joined #openstack-infra | 15:10 | |
| *** heyongli has quit IRC | 15:12 | |
| *** heyongli has joined #openstack-infra | 15:12 | |
| *** udesale has quit IRC | 15:13 | |
| *** martinkopec has joined #openstack-infra | 15:13 | |
| *** armax has joined #openstack-infra | 15:19 | |
| openstackgerrit | Merged openstack-infra/system-config master: Open finger port for zuulv3 https://review.openstack.org/530789 | 15:21 |
| *** slaweq has joined #openstack-infra | 15:21 | |
| mordred | frickler, Shrews, AJaeger, pabelanger: morning - yes, I think disabling ovh from the puppetmaster ansible inventory clouds.yaml is the right thing to do for now | 15:21 |
| *** heyongli has quit IRC | 15:22 | |
| *** heyongli has joined #openstack-infra | 15:22 | |
| *** armax has quit IRC | 15:23 | |
| *** links has joined #openstack-infra | 15:25 | |
| *** coolsvap has quit IRC | 15:25 | |
| *** slaweq has quit IRC | 15:26 | |
| *** devananda has joined #openstack-infra | 15:27 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Remove ovh from clouds.yaml files https://review.openstack.org/530944 | 15:28 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Revert "Remove ovh from clouds.yaml files" https://review.openstack.org/530945 | 15:29 |
| pabelanger | infra-root: ^ removes OVH from clouds.yaml and revert, until we can address auth errors | 15:30 |
| *** links has quit IRC | 15:30 | |
| *** slaweq has joined #openstack-infra | 15:32 | |
| *** heyongli has quit IRC | 15:32 | |
| *** heyongli has joined #openstack-infra | 15:33 | |
| *** abelur_ has joined #openstack-infra | 15:33 | |
| *** jascott1 has quit IRC | 15:34 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/system-config master: Add Frank Kloeker to manifests/users.pp https://review.openstack.org/530920 | 15:35 |
| *** slaweq has quit IRC | 15:36 | |
| openstackgerrit | Alex Krzos proposed openstack-infra/grafyaml master: Add Grafana URL and API Key to GrafYaml CLI https://review.openstack.org/530949 | 15:38 |
| *** heyongli has quit IRC | 15:43 | |
| *** heyongli has joined #openstack-infra | 15:43 | |
| frickler | pabelanger: +3, might need to be applied manually though? | 15:43 |
| *** gmann has quit IRC | 15:43 | |
| pabelanger | Yah, I can take care of that in a few minutes | 15:45 |
| pabelanger | then confirm wheel is working again | 15:45 |
| pabelanger | also, pypi mirror looks to be happy again. | 15:45 |
| *** sshnaidm|mtg is now known as sshnaidm | 15:46 | |
| *** yamamoto has joined #openstack-infra | 15:46 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/system-config master: Add Frank Kloeker to manifests/users.pp https://review.openstack.org/530920 | 15:48 |
| mtreinish | clarkb: I mean it's still technically an issue, but we were able to work around it with those 2 patches | 15:49 |
| *** heyongli has quit IRC | 15:53 | |
| *** heyongli has joined #openstack-infra | 15:53 | |
| *** yamamoto has quit IRC | 15:54 | |
| *** armaan has quit IRC | 15:55 | |
| *** armaan has joined #openstack-infra | 15:55 | |
| *** ramishra has joined #openstack-infra | 15:55 | |
| *** martinkopec has quit IRC | 15:55 | |
| *** armax has joined #openstack-infra | 15:57 | |
| *** slaweq has joined #openstack-infra | 15:58 | |
| *** petevg has joined #openstack-infra | 16:00 | |
| *** ramishra has quit IRC | 16:02 | |
| *** heyongli has quit IRC | 16:03 | |
| *** heyongli has joined #openstack-infra | 16:03 | |
| openstackgerrit | Merged openstack-infra/system-config master: Remove ovh from clouds.yaml files https://review.openstack.org/530944 | 16:04 |
| *** jkilpatr has quit IRC | 16:06 | |
| *** rlandy|ruck|mtg is now known as rlandy | 16:07 | |
| *** dims has quit IRC | 16:09 | |
| pabelanger | okay, I've manually applied ^ to puppetmaster.o.o, waiting for crontab onw | 16:09 |
| pabelanger | now* | 16:09 |
| *** dims has joined #openstack-infra | 16:10 | |
| *** panda is now known as panda|rover | 16:11 | |
| *** heyongli has quit IRC | 16:13 | |
| *** heyongli has joined #openstack-infra | 16:14 | |
| pabelanger | and ansible wheel is running now | 16:18 |
| *** openstackgerrit has quit IRC | 16:19 | |
| *** jkilpatr has joined #openstack-infra | 16:20 | |
| clarkb | pabelanger: frickler ya I tried to capture the state of things via #status log before going to family stuff | 16:20 |
| clarkb | got the ci things sorted but our deploymwnt stuff was still sad | 16:20 |
| *** ykarel|afk is now known as ykarel | 16:21 | |
| *** slaweq has quit IRC | 16:22 | |
| AJaeger | clarkb: sorry, didn't realise that puppet was broken and thus we could not create new repos | 16:22 |
| *** jkilpatr has quit IRC | 16:22 | |
| *** jkilpatr has joined #openstack-infra | 16:23 | |
| mriedem | zuulv3 question - there is a change in nova to port an experimental queue job over to the nova repo https://review.openstack.org/#/c/514309/ - should i be able to run 'check experimental' on this to see the job def run there before we actually merge the nova patch? | 16:23 |
| *** mgoddard has quit IRC | 16:23 | |
| *** heyongli has quit IRC | 16:24 | |
| *** heyongli has joined #openstack-infra | 16:24 | |
| *** dave-mccowan has quit IRC | 16:24 | |
| AJaeger | mriedem: yes! | 16:24 |
| *** gouthamr has joined #openstack-infra | 16:24 | |
| mriedem | ok, just not seeing that happen yet | 16:24 |
| mriedem | maybe i'm impatient | 16:24 |
| AJaeger | mriedem: yeah, please wait - see "Queue lengths: 29 events, 0 management events, 105 results." | 16:25 |
| AJaeger | let's Zuul go over the queue first... | 16:25 |
| *** dave-mccowan has joined #openstack-infra | 16:26 | |
| AJaeger | clarkb: could you put https://review.openstack.org/#/c/528819 and https://review.openstack.org/#/c/528554/ on your review queue, please? That allows to use standard py27/py35 jobs on devstack-gate. | 16:27 |
| *** Goneri has quit IRC | 16:28 | |
| clarkb | AJaeger: ya I'll take a look | 16:28 |
| AJaeger | thanks | 16:28 |
| *** openstackgerrit has joined #openstack-infra | 16:29 | |
| openstackgerrit | boden proposed openstack-infra/project-config master: add neutron-lib master periodic job to vmware-nsx https://review.openstack.org/530957 | 16:29 |
| *** slaweq has joined #openstack-infra | 16:33 | |
| *** mlavalle has joined #openstack-infra | 16:33 | |
| *** heyongli has quit IRC | 16:34 | |
| *** heyongli has joined #openstack-infra | 16:34 | |
| mlavalle | Hi, recently this was merged https://review.openstack.org/#/c/529661. Does the group has to be configured now so I can manage it? | 16:34 |
| *** pcaruana has quit IRC | 16:35 | |
| openstackgerrit | boden proposed openstack-infra/project-config master: add neutron-lib master periodic job to vmware-nsx https://review.openstack.org/530957 | 16:35 |
| *** tlam has quit IRC | 16:35 | |
| *** tlam has joined #openstack-infra | 16:35 | |
| mordred | mlavalle: I've added you to the group, you should be able to manage membership now | 16:37 |
| mordred | mlavalle: https://review.openstack.org/#/admin/groups/1856,members | 16:37 |
| *** slaweq has quit IRC | 16:38 | |
| mlavalle | mordred: yeap, I can manage it now. Thanks! | 16:38 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Handle invalid build UUID in finger gateway https://review.openstack.org/530963 | 16:40 |
| *** hemna_ has joined #openstack-infra | 16:40 | |
| *** caphrim007 has quit IRC | 16:42 | |
| *** caphrim007 has joined #openstack-infra | 16:42 | |
| *** Goneri has joined #openstack-infra | 16:43 | |
| *** heyongli has quit IRC | 16:44 | |
| *** heyongli has joined #openstack-infra | 16:44 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Always generate ara reports for integration tests https://review.openstack.org/526590 | 16:45 |
| corvus | dmsimard: what's the status of the ara middleware? | 16:46 |
| *** caphrim007 has quit IRC | 16:46 | |
| frickler | AJaeger: pabelanger: blazar-tempest-plugin seems to have been created now, also imported correctly | 16:47 |
| AJaeger | frickler: thanks! | 16:47 |
| *** mgoddard has joined #openstack-infra | 16:47 | |
| AJaeger | mriedem: now the change is in experimental queue | 16:47 |
| dmsimard | corvus: https://review.openstack.org/#/c/513874/ and https://review.openstack.org/#/c/513868/ are pending review, and I'm refreshing things around to wrap up https://review.openstack.org/#/c/513866/ | 16:47 |
| corvus | dmsimard: okay. i worry about piecemeal adding ara back in without doing that. | 16:50 |
| mriedem | AJaeger: yup, thanks | 16:50 |
| dmsimard | corvus: that's just for the infra integration jobs which don't run all that much. | 16:51 |
| *** trown is now known as trown|lunch | 16:52 | |
| AJaeger | config-core, I have put up some changes that are ready to merge at https://etherpad.openstack.org/p/Nvt3ovbn5x - reviews are appreciated to reduce the backlog. | 16:53 |
| *** heyongli has quit IRC | 16:54 | |
| *** heyongli has joined #openstack-infra | 16:55 | |
| *** catintheroof has quit IRC | 16:55 | |
| clarkb | AJaeger: corvus the project-config chang ethat depends on the zuul.yaml update in devstack-gate shouldn't be approved until after the devstack-gate change merges right? | 16:57 |
| clarkb | or does it not matter? | 16:57 |
| clarkb | I guess thats a case where we just reapprove it | 16:58 |
| *** gyee has joined #openstack-infra | 16:58 | |
| corvus | clarkb: yeah, i left the vote so anyone can just recheck it or whatever | 16:58 |
| *** yee37931 has joined #openstack-infra | 16:59 | |
| *** yee379 has quit IRC | 17:00 | |
| *** yee379 has joined #openstack-infra | 17:00 | |
| *** mgoddard has left #openstack-infra | 17:01 | |
| AJaeger | clarkb, corvus, I'll add my own +A once the dependencies are merged - thanks for reviews! | 17:01 |
| *** Apoorva has quit IRC | 17:01 | |
| *** yee37931 has quit IRC | 17:01 | |
| mriedem | weird, this bug was reported by openstack-infra for a patch which doesn't actually have DocImpact in the commit message | 17:03 |
| mriedem | https://bugs.launchpad.net/nova/+bug/1740259 | 17:03 |
| openstack | Launchpad bug 1740259 in OpenStack Compute (nova) " Document testing guide for new API contributions" [Undecided,New] | 17:03 |
| mriedem | oh nvm there it is | 17:03 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove name from project stanza https://review.openstack.org/530970 | 17:04 |
| *** heyongli has quit IRC | 17:05 | |
| *** slaweq has joined #openstack-infra | 17:05 | |
| *** heyongli has joined #openstack-infra | 17:05 | |
| *** felipemonteiro has joined #openstack-infra | 17:06 | |
| AJaeger | mordred, clarkb : what do you think about removing the html directories from the wrong docs publishing? See my comment in backscroll from earlier today with details, please | 17:07 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Make sure we only run tempest-full on master https://review.openstack.org/530915 | 17:07 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Strip /r from build UUID in fingergw https://review.openstack.org/530973 | 17:09 |
| *** slaweq has quit IRC | 17:09 | |
| *** kaisers has quit IRC | 17:10 | |
| *** e0ne has quit IRC | 17:12 | |
| *** slaweq has joined #openstack-infra | 17:13 | |
| *** heyongli has quit IRC | 17:15 | |
| *** heyongli has joined #openstack-infra | 17:15 | |
| *** kaisers has joined #openstack-infra | 17:15 | |
| *** smatzek has quit IRC | 17:16 | |
| *** yamamoto has joined #openstack-infra | 17:16 | |
| *** smatzek has joined #openstack-infra | 17:17 | |
| *** jpich has quit IRC | 17:18 | |
| *** smatzek_ has joined #openstack-infra | 17:19 | |
| *** smatzek__ has joined #openstack-infra | 17:20 | |
| *** yamamoto has quit IRC | 17:21 | |
| *** smatzek has quit IRC | 17:21 | |
| *** smatzek_ has quit IRC | 17:23 | |
| *** smatzek__ has quit IRC | 17:24 | |
| *** smatzek has joined #openstack-infra | 17:25 | |
| *** heyongli has quit IRC | 17:25 | |
| *** heyongli has joined #openstack-infra | 17:25 | |
| *** tlam has quit IRC | 17:26 | |
| *** tlam has joined #openstack-infra | 17:26 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-zuul master: Don't assume pidfile location https://review.openstack.org/530820 | 17:27 |
| clarkb | corvus: jhesketh frickler ^ I think that addresses the comments on the previous patchset. Would like to get something fixing this in today so that we can handle zuul executor restarts | 17:27 |
| *** andreww has quit IRC | 17:28 | |
| clarkb | AJaeger: we probably should, is the docs/*/html going to not be too greedy? | 17:28 |
| clarkb | AJaeger: I guess on the afs docs server you should never have foo/html but always foo/latest or foo/branchname? | 17:29 |
| *** yamamoto has joined #openstack-infra | 17:29 | |
| *** devananda has quit IRC | 17:31 | |
| mordred | clarkb: did we wind up with any foo/latest/html ? | 17:33 |
| clarkb | mordred: we ended up with foo/html/latest | 17:34 |
| mordred | clarkb: gotcha | 17:34 |
| clarkb | I don't know of any foo/latest/html | 17:34 |
| mordred | clarkb: so yah - I think docs/*/html seems decent | 17:34 |
| *** yamamoto has quit IRC | 17:34 | |
| *** heyongli has quit IRC | 17:35 | |
| mordred | clarkb, AJaeger: http://paste.openstack.org/show/637463/ | 17:36 |
| *** heyongli has joined #openstack-infra | 17:36 | |
| AJaeger | mordred: that looks fine to remove | 17:36 |
| AJaeger | and similar docs/infra/*/html | 17:36 |
| AJaeger | and developer-docs/api-ref/*/html and developer-docs/api-guide/*/html , please | 17:37 |
| *** tesseract has quit IRC | 17:38 | |
| *** slaweq_ has joined #openstack-infra | 17:40 | |
| *** caphrim007 has joined #openstack-infra | 17:40 | |
| *** caphrim007 has quit IRC | 17:40 | |
| clarkb | AJaeger: mordred based on my knowledge of the problem I agree the list in the paste should be safe to remove | 17:40 |
| *** caphrim007 has joined #openstack-infra | 17:41 | |
| *** lucasagomes is now known as lucas-afk | 17:42 | |
| *** arxcruz is now known as arxcruz|ruck | 17:44 | |
| *** andrewbogott has left #openstack-infra | 17:45 | |
| *** heyongli has quit IRC | 17:46 | |
| *** heyongli has joined #openstack-infra | 17:46 | |
| AJaeger | mordred: one more docs job to fix (grenade - broken since zuul v3 switch) - could you review https://review.openstack.org/#/c/530239/ , please? | 17:47 |
| *** smatzek has quit IRC | 17:47 | |
| *** jascott1 has joined #openstack-infra | 17:47 | |
| *** smatzek has joined #openstack-infra | 17:51 | |
| *** smatzek has quit IRC | 17:51 | |
| AJaeger | and one change to mention doc/requirements in infra-manual: https://review.openstack.org/#/c/522642 | 17:51 |
| *** smatzek has joined #openstack-infra | 17:51 | |
| clarkb | AJaeger: for the grenade one can we just add a patch to grenade that adds docs/requirements.txt intsead? | 17:53 |
| AJaeger | clarkb: no, won't help | 17:53 |
| AJaeger | clarkb: the problem is that grenade needs an extra invocation | 17:54 |
| clarkb | gotcha | 17:54 |
| AJaeger | "bash tools/build_docs.sh" is needed | 17:54 |
| AJaeger | clarkb: we do not generate https://docs.openstack.org/grenade/latest/grenade.sh.html anymore | 17:55 |
| AJaeger | it looks so ugly, we could also just say, we're not doing it ;) | 17:55 |
| clarkb | oh right it had the code as docs thing that wasn't sphinx | 17:55 |
| clarkb | I've approved both changes | 17:55 |
| *** Apoorva has joined #openstack-infra | 17:55 | |
| AJaeger | thanks, clarkb ! | 17:55 |
| *** heyongli has quit IRC | 17:56 | |
| *** Apoorva has quit IRC | 17:56 | |
| *** heyongli has joined #openstack-infra | 17:56 | |
| *** ykarel has quit IRC | 17:57 | |
| *** jascott1 has quit IRC | 17:58 | |
| openstackgerrit | Merged openstack-infra/infra-manual master: Mention doc/requirements.txt https://review.openstack.org/522642 | 17:58 |
| *** jascott1 has joined #openstack-infra | 17:58 | |
| *** jascott1 has quit IRC | 17:59 | |
| *** liusheng has quit IRC | 17:59 | |
| *** Swami has joined #openstack-infra | 17:59 | |
| *** yamamoto has joined #openstack-infra | 17:59 | |
| mordred | clarkb: so, I feel kind of stupid atm ... I have forgotten how to kinit/aklog to our AFS cell | 17:59 |
| *** jascott1 has joined #openstack-infra | 17:59 | |
| mordred | clarkb: and I couldn't find notes in the openafs doc - could you help me out, then I'll update the docs? | 18:00 |
| *** derekh has quit IRC | 18:00 | |
| *** ech042 has quit IRC | 18:00 | |
| *** liusheng has joined #openstack-infra | 18:00 | |
| clarkb | mordred: hrm ya I typically have to rtfm myself | 18:00 |
| * clarkb looks | 18:00 | |
| *** Apoorva has joined #openstack-infra | 18:00 | |
| *** ihrachys has joined #openstack-infra | 18:01 | |
| clarkb | mordred: https://docs.openstack.org/infra/system-config/afs.html#client-configuration isn't working? | 18:01 |
| clarkb | mordred: note that you hsould need the admin user not your regular user if deleting things | 18:02 |
| *** slaweq has quit IRC | 18:02 | |
| *** Apoorva has quit IRC | 18:02 | |
| *** Apoorva_ has joined #openstack-infra | 18:02 | |
| mordred | clarkb: do I havea mordred/admin@OPENSTACK.ORG ? | 18:02 |
| *** jkilpatr has quit IRC | 18:03 | |
| clarkb | mordred: you should if you set up your accounts properly :) | 18:03 |
| mordred | yes! so I do - that's where my confusion was : | 18:03 |
| mordred | I'm going to run 'rm -rf /afs/.openstack.org/docs/*/html' now | 18:03 |
| *** jkilpatr has joined #openstack-infra | 18:03 | |
| openstackgerrit | Merged openstack-infra/project-config master: Fix grenade docs jobs https://review.openstack.org/530239 | 18:04 |
| clarkb | also the docs say its username.admin not username/admin but I suppose that may be arbitrary or its extra special and / becomes . and vice versa? | 18:04 |
| AJaeger | mordred: thanks. Please cleanup the rest as well... | 18:04 |
| mordred | clarkb: 'kinit mordred/admin@OPENSTACK.ORG' worked for me | 18:04 |
| *** yamamoto has quit IRC | 18:04 | |
| *** armaan has quit IRC | 18:06 | |
| *** heyongli has quit IRC | 18:06 | |
| *** heyongli has joined #openstack-infra | 18:06 | |
| mordred | clarkb, AJaeger: first command done - I'm now going to do: mordred@files02:/afs/.openstack.org$ rm -rf docs/infra/*/html developer-docs/api-ref/*/html developer-docs/api-guide/*/html | 18:07 |
| AJaeger | results of first ocmmand were fine, hope the rest will be as well ;) | 18:07 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove publish-openstack-python-branch-tarball from steth https://review.openstack.org/529317 | 18:07 |
| clarkb | mordred: and the doc vos release cron will handle that for you so you shouldn't have to worry about that step (it runs every 5 minutes) | 18:08 |
| mordred | cool | 18:08 |
| mordred | clarkb, AJaeger: done | 18:10 |
| *** shardy has quit IRC | 18:10 | |
| clarkb | thanks | 18:11 |
| clarkb | pabelanger: mordred we haven't sent mail or otherwise pinged ovh yet have we? | 18:11 |
| mordred | clarkb: oh - crap, no | 18:12 |
| mordred | ttx: you around? | 18:12 |
| mordred | ttx: we have an issue with one of our OVH accounts and can't remember who the correct contact is now (I mean, I could just ping jean-daniel, but I think we were supposed to ping someone else now?) | 18:12 |
| *** armaan has joined #openstack-infra | 18:13 | |
| clarkb | I want to say fungi dealt with this last time so may have the details? | 18:13 |
| AJaeger | thanks, mordred ! | 18:13 |
| pabelanger | clarkb: I have not, but agree we should | 18:13 |
| *** slaweq_ has quit IRC | 18:13 | |
| *** yolanda__ is now known as yolanda | 18:14 | |
| dmsimard | there might be an upcoming spam wave | 18:14 |
| dmsimard | seeing different reports in #freenode | 18:15 |
| clarkb | #zuul just got hit but mnaser was on top of it | 18:15 |
| *** slaweq_ has joined #openstack-infra | 18:15 | |
| pabelanger | #openstack-requirements now | 18:16 |
| *** yamamoto has joined #openstack-infra | 18:16 | |
| *** yamamoto has quit IRC | 18:16 | |
| dmsimard | did we agree on turning on +r temporarily ? | 18:16 |
| dmsimard | I can do it.. | 18:16 |
| pabelanger | what is the syntax we are using to kick ban now? | 18:16 |
| *** heyongli has quit IRC | 18:16 | |
| *** heyongli has joined #openstack-infra | 18:17 | |
| clarkb | dmsimard: we sorted out the shade redirect issue? if so I think its fine | 18:17 |
| mnaser | i think #status letting folks know we're going +r and doing it is ++ | 18:17 |
| pabelanger | https://docs.openstack.org/infra/system-config/irc.html#banning-disruptive-users | 18:17 |
| clarkb | mnaser: +1 | 18:17 |
| dmsimard | pabelanger: /kickban wfm | 18:17 |
| johnsom | They are in openstack-security too | 18:18 |
| lbragstad | ++ | 18:18 |
| edmondsw | if someone knows how to ban an irc account... see what's happening in #openstack-security | 18:18 |
| dmsimard | mnaser: I'll turn on +r | 18:18 |
| pabelanger | looking | 18:18 |
| mnaser | dmsimard: go for it | 18:18 |
| mordred | clarkb: ok - I have sent jean-daniel a message - both about the account and asking who our contact is supposed to be | 18:18 |
| clarkb | mordred: thanks! | 18:18 |
| clarkb | I'm currently going through the zuulv3 issues etherpad now that yesterdays fires seem to largely be addressed | 18:19 |
| mordred | clarkb: I have done it via private twitter, which is how I normally communicate with him, so I didn't CC anyone on it - but I'll share his response | 18:19 |
| clarkb | corvus: when you have a moment I think the changes needed for lists.o.o being removed from emergency merged and the ansible puppetry is working again if you want to remove that from emergency today | 18:20 |
| *** ChanServ sets mode: +r | 18:20 | |
| clarkb | corvus: but double check me on that | 18:20 |
| *** slaweq_ has quit IRC | 18:20 | |
| mordred | dmsimard: +r means people have to be logged in with nickserv to talk, right? | 18:21 |
| clarkb | mordred: yes | 18:21 |
| mnaser | "Prevents users who are not identified to services from joining the channel." | 18:21 |
| mnaser | directly from https://freenode.net/kb/answer/channelmodes | 18:21 |
| mordred | kk. we should maybe make a doc entry about how to register/login with nickserv that we can point people to when they ask questions | 18:22 |
| mnaser | we can send people to https://freenode.net/kb/answer/registration ? | 18:22 |
| dmsimard | mordred: no, to join the channel | 18:22 |
| lbragstad | i assume we don't have +r on all the time because it's a higher barrier to entry for people to communicate with us? | 18:22 |
| mordred | dmsimard: ah - to join the channel | 18:23 |
| corvus | i don't think we've considered making it permanent, only temporary during these waves. but yes. | 18:23 |
| dmsimard | lbragstad: yes | 18:23 |
| mordred | mnaser: yes - I think pointing people to that would be great ... | 18:23 |
| clarkb | mordred: on https://etherpad.openstack.org/p/zuulv3-issues if you grep for Zara there is an entry about the storyboard js draft builds behaving differently. Was that addressed as part of your js job fixes that went in recently? | 18:23 |
| dmsimard | lbragstad: we discussed this briefly at the infra meeting yesterday, keeping +r on is ideally not something we want to be doing | 18:23 |
| mordred | clarkb: oh - I don't think so - lemme go poke | 18:24 |
| dmsimard | so right now we have me sending 186 msg to chanserv and being locked out of freenode for 3 minutes while it runs :p | 18:24 |
| * lbragstad nods | 18:24 | |
| mnaser | lol | 18:24 |
| mnaser | given thats its only temporary, i would suggest using the command which updates the topic in channels to mention reference the registration link and explain the reason behind it | 18:24 |
| mnaser | so an alert status is probably what im trying to suggest | 18:25 |
| clarkb | mordred: ok I'm not sure its urgent but probably should be converted to a bug instead. I'm just trying to go through the current list and clear out what is no longer valid | 18:25 |
| corvus | mnaser: we can send a notice without changing the topic, or we can send a notice and change the topic. | 18:25 |
| AJaeger | clarkb: I expect that it was addressed by mordred | 18:25 |
| mnaser | but actually, nevermind, if folks can even join the channel, that doesn't really help them | 18:25 |
| clarkb | then we can make bugs out of the rest | 18:25 |
| * mnaser votes to keep #openstack and #openstack-infra without +r just in case people come in and ask "why cant i join this channel" | 18:25 | |
| mnaser | +r will not let them join so they won't know why they cant join | 18:26 |
| corvus | mnaser: it doesn't help new users joining, though it does increase awareness and may help develop "peer-support" | 18:26 |
| corvus | mnaser: it == announcing the change in channels ^ | 18:26 |
| lbragstad | unless they read our specific irc documentation (which might be a long shot) | 18:26 |
| *** heyongli has quit IRC | 18:27 | |
| *** e0ne has joined #openstack-infra | 18:27 | |
| AJaeger | clarkb: just removed two items that are fixed now | 18:27 |
| clarkb | AJaeger: thanks | 18:27 |
| mnaser | corvus: you are right, hence suggesting leaving the big primary channels like #openstack-infra and #openstack -r and we can address any problems directly | 18:27 |
| dmsimard | #status log (dmsimard) +r applied to channels to mitigate ongoing freenode spam wave: http://paste.openstack.org/raw/629168/ | 18:27 |
| openstackstatus | dmsimard: finished logging | 18:27 |
| AJaeger | should we #status notice? | 18:27 |
| dmsimard | mnaser: eh I would even add openstack-dev in that | 18:27 |
| mnaser | sure, just a few ones that we know we have our eyes on | 18:28 |
| dmsimard | https://freenode.net/kb/answer/extbans has something interesting about "extbans" | 18:32 |
| dmsimard | especially $j -- Takes an exact channel name (no wildcards or globbing) as its parameter and matches any user who is banned from that channel. Due to caching by the server, a change to the target channel's ban list may not immediately affect a user's ability to send to the channel using $j. | 18:32 |
| dmsimard | my understanding is that perhaps we could ban users in #openstack-infra (for example) and then have that applied globally across all openstack channels or something to that effect | 18:33 |
| dmsimard | not really sure how it works | 18:33 |
| dmsimard | but it beats kickbanning users across ~200 channels | 18:33 |
| tosky | it does not beat the global k-lining from freenode admins | 18:34 |
| dmsimard | https://freenode.net/news/new-extban-j has an example | 18:34 |
| dmsimard | tosky: yeah but we can't kline, so.. | 18:34 |
| clarkb | corvus: we fixed the zuul windowing problem with gate resets not being handled properly right? | 18:35 |
| corvus | clarkb: yep | 18:35 |
| tosky | dmsimard: no, but you can discuss and cooperate with freenode admins and their bot | 18:35 |
| dmsimard | tosky: we've been, but they're not always around (nor are we) | 18:35 |
| dmsimard | if you have ideas on how to best mitigate this we're all listening :) | 18:35 |
| *** kgiusti has joined #openstack-infra | 18:36 | |
| tosky | dmsimard: but I think that it's more when they are around (and then they can help with k-lining can help); fallback to extended ban | 18:37 |
| *** trown|lunch is now known as trown|outtypewww | 18:37 | |
| tosky | dmsimard: did you try to discuss this on a more formal level (even freenode as project vs openstack as project) to see if some power can be delegated? | 18:38 |
| dmsimard | tosky: the problem is mostly around the amount of channels we have, we're not in all of them (especially considering the maximum channel limit) | 18:38 |
| corvus | apparently it's possible to quiet unidentified. that may be a little better than +r, as it lets people join, and then a notice saying "due to spam, users must be identified to speak" would be visible. however, it would mean that folks already joined wouldn't be able to speak. | 18:40 |
| *** jkilpatr has quit IRC | 18:40 | |
| dmsimard | tosky: I don't know if we've formally reached out to them | 18:40 |
| tosky | dmsimard: it may be useful (at least with some more power to k-lining bot) | 18:41 |
| tosky | maybe | 18:41 |
| dmsimard | corvus: I know of +m which mutes non-voiced (+) users, what's the mode to quiet unidentified ? | 18:41 |
| corvus | dmsimard: https://superuser.com/questions/591513/irc-cannot-send-to-channel-ruby-lang/596473 | 18:41 |
| corvus | dmsimard: basically +q with a $a extban | 18:41 |
| dmsimard | tosky: I don't think they'd grant us some form of kline but anything to help us manage the amount of channels we have would be welcome (lift the limit on channel count for specific users/bots?) | 18:42 |
| corvus | dmsimard, tosky: we have asked about lifting the channel limit, the answer is 'no'. | 18:42 |
| tosky | corvus: that maybe a technical limitation; I think we are talking about something different here | 18:43 |
| corvus | tosky: is was directly replying to dmsimard's suggestion. | 18:43 |
| corvus | s/is/i/ | 18:43 |
| tosky | oh, oki | 18:44 |
| *** felipemonteiro has quit IRC | 18:44 | |
| dmsimard | corvus: I'm not sure if the message can be customized for +q, though -- seems like a generic "Cannot send to channel" | 18:46 |
| dmsimard | oh, you mean a #status notice | 18:46 |
| *** yamamoto has joined #openstack-infra | 18:46 | |
| *** jlk has joined #openstack-infra | 18:48 | |
| corvus | dmsimard: ya | 18:51 |
| *** jascott1 has quit IRC | 18:51 | |
| dmsimard | I don't know, +r is less invasive.. perhaps ? unidentified people can talk during +r | 18:51 |
| dmsimard | I'm also not clear on the delta of accessbot vs statusbot | 18:52 |
| corvus | dmsimard: yeah. +r is better for people in channel, +q better for users joining. | 18:52 |
| corvus | dmsimard: accessbot is a script. statusbot is a bot. | 18:52 |
| dmsimard | corvus: right, I know that -- but there's a delta in the list of channels in each ? because statusbot can't be in more than 120+ channels | 18:53 |
| corvus | dmsimard: accessbot is not a long running process, it runs to completion and exists. statusbot stays around. | 18:53 |
| corvus | dmsimard: yeah, i think statusbot is just not getting added to new channels. | 18:53 |
| dmsimard | what I'm trying to say is that we're turning on +r everywhere but then the notice doesn't end up reaching everywhere | 18:53 |
| corvus | dmsimard: if we were to send a notice, yes, that would be the case. | 18:53 |
| corvus | (i've only seen logs, so far, not notices) | 18:54 |
| dmsimard | right, was going with your example of +q and notice | 18:54 |
| *** yamamoto has quit IRC | 18:54 | |
| corvus | obviously, statusbot should be everywhere. | 18:54 |
| * dmsimard needs 48h instead of 24h to do the stuff he wants to do | 18:55 | |
| corvus | so we need another account, or to have it do channel-hopping (which, erm, has its downsides) | 18:55 |
| clarkb | there is also potential that old channels can be cleaned up that are no longer used | 18:56 |
| dmsimard | tbh there's a lot of channels in the accessbot list that made me go "what?" | 18:56 |
| dmsimard | like #cerberus-project or #openstack-ailuropoda and there's a bunch of others | 18:57 |
| dmsimard | #openstack-foxnut .. | 18:58 |
| *** caphrim007 has quit IRC | 19:00 | |
| *** hashar has joined #openstack-infra | 19:00 | |
| *** caphrim007 has joined #openstack-infra | 19:03 | |
| *** dhill__ has quit IRC | 19:05 | |
| *** jhesketh has quit IRC | 19:08 | |
| *** jhesketh has joined #openstack-infra | 19:11 | |
| *** armax has quit IRC | 19:14 | |
| mordred | dmsimard, clarkb, corvus: I just went off into a nerd-snipe hole and wrote some quick irc content for infra-manual (about to push up patch) - while doing it, it occured to me that maybe we should make a something that renders accessbot/channels.yaml to a list that we publish to eavesdrop.o.o for a better list of "what channels are available/where do I look for $foo" | 19:15 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Strip \r from build UUID in fingergw https://review.openstack.org/530973 | 19:15 |
| corvus | mordred: yeah, there's a wiki page which is out of date. that sounds like an improvement. | 19:16 |
| mordred | corvus: it also seemed to me that we could allow people to put a description in the accessbot/channels.yaml to be used in that web page, but also to be used as the channel topic and stuff - so that when things need to reset the topic (like after a borked meetbot) there's a record of what it should be - perhaps | 19:17 |
| mordred | corvus: because I *definitely* want to spend the time to implement that | 19:18 |
| * mordred shuts up | 19:18 | |
| *** hashar has quit IRC | 19:25 | |
| *** tlam has quit IRC | 19:33 | |
| *** hashar has joined #openstack-infra | 19:34 | |
| *** pcaruana has joined #openstack-infra | 19:45 | |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Test that -1 works for infinite quota https://review.openstack.org/529231 | 19:45 |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: requirements: remove paramiko <2.0 cap https://review.openstack.org/528719 | 19:49 |
| *** yamamoto has joined #openstack-infra | 19:56 | |
| *** dave-mccowan has quit IRC | 19:56 | |
| *** pcaruana has quit IRC | 19:59 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/infra-manual master: Update tox env to match zuul PTI https://review.openstack.org/530999 | 19:59 |
| openstackgerrit | Monty Taylor proposed openstack-infra/infra-manual master: Add some information about OpenStack IRC usage https://review.openstack.org/531000 | 19:59 |
| fungi | clarkb: pabelanger: ovh e-mails us if our voucher is expiring (filtered into INBOX.clouds.ovh at our infra-root address) | 19:59 |
| *** sambetts is now known as sambetts|afk | 20:00 | |
| fungi | however the messages (now in english after i fiddled with account settings) aren't especially illuminating | 20:00 |
| clarkb | fungi: ah thanks for looking | 20:00 |
| clarkb | mordred has apparently pinged jean daniel on the twitters | 20:00 |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Remove name from project stanza https://review.openstack.org/530970 | 20:01 |
| *** rhallisey has quit IRC | 20:02 | |
| fungi | looks like its just routine e-mails in there at the moment, nothing indicating account voucher expiration | 20:02 |
| fungi | pabelanger: mordred; ^ | 20:02 |
| mordred | clarkb, fungi: yah - no response yet, but it is evening/night there | 20:02 |
| mordred | fungi: nod | 20:02 |
| * fungi is still travelling today, apologies for delays | 20:02 | |
| clarkb | fungi: I hear your forecast for tomorrow isn't very fun | 20:03 |
| fungi | well, i'm home-ish now, we're just getting settled in to weather the coming storm | 20:03 |
| *** florianf has quit IRC | 20:07 | |
| *** e0ne has quit IRC | 20:09 | |
| *** Jeffrey4l has quit IRC | 20:11 | |
| *** Jeffrey4l has joined #openstack-infra | 20:24 | |
| *** dangers_away has quit IRC | 20:32 | |
| *** hashar has quit IRC | 20:32 | |
| *** pcichy_ has quit IRC | 20:38 | |
| *** jbadiapa has quit IRC | 20:48 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: WIP: Test Ansible 2.4 again https://review.openstack.org/531009 | 20:49 |
| *** portdirect has quit IRC | 20:50 | |
| *** portdirect has joined #openstack-infra | 20:50 | |
| openstackgerrit | Antoine Musso proposed openstack-infra/zuul master: Do not import paramiko before daemonization https://review.openstack.org/531012 | 20:55 |
| *** ociuhandu has joined #openstack-infra | 20:55 | |
| *** eharney has quit IRC | 20:55 | |
| openstackgerrit | Antoine Musso proposed openstack-infra/zuul master: Do not import paramiko before daemonization https://review.openstack.org/531012 | 20:55 |
| *** ociuhandu has quit IRC | 20:56 | |
| *** armax has joined #openstack-infra | 20:59 | |
| *** hemna_ has quit IRC | 21:02 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Handle invalid build UUID in finger gateway https://review.openstack.org/530963 | 21:05 |
| corvus | dmsimard, fungi, clarkb, mordred, mnaser: i did some thinking about the irc situation, and some experimentation, and i've tried to outline a holistic solution to the several related irc problems we have: https://etherpad.openstack.org/p/1hZAhUDKLh | 21:14 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Allow Ansible 2.4 https://review.openstack.org/531009 | 21:14 |
| *** bgmccollum has quit IRC | 21:16 | |
| *** Apoorva_ has quit IRC | 21:16 | |
| dmsimard | corvus: we had a brief flashback to a previous discussion about errbot yesterday, I didn't even know there was a spiritual successor to supybot :D | 21:16 |
| corvus | dmsimard: yeah, i'm keen on errbot, but we have the meetbot and config stuff all worked out for supybot/limnoria, so this gets us to a happy place faster. | 21:17 |
| corvus | dmsimard: limnoria is what freenode uses for sigyn, their spam-fighting bot | 21:18 |
| mriedem | are these logs going to be moved back up to their old position at some point? http://logs.openstack.org/33/266633/4/check/tempest-full/1c4979f/controller/logs/ | 21:18 |
| dmsimard | yeah it's a shame, I searched to see if there was already some sort of meeting plugin already written for errbot but couldn't find anything worthwhile | 21:18 |
| mriedem | i.e. sans the 'controller' subdir? | 21:18 |
| mriedem | the logging directory structure change has messed up the log analyze tool | 21:19 |
| dmsimard | mriedem: that's how multinode logs are | 21:19 |
| dmsimard | (assuming that's a multinode job) | 21:19 |
| mriedem | not 3 weeks ago | 21:19 |
| mriedem | it's not | 21:19 |
| openstackgerrit | Clark Boylan proposed openstack-infra/openstack-zuul-jobs master: Only copy openafs centos rpms if we built them https://review.openstack.org/531018 | 21:19 |
| mriedem | "controller" is a new thing | 21:19 |
| mriedem | the controller logs just used to be under logs/ | 21:19 |
| dmsimard | huh, usually it should be under logs/ here yeah http://logs.openstack.org/33/266633/4/check/tempest-full/1c4979f/ | 21:20 |
| corvus | mriedem: we may want to ping andreaf about that, but i'd be inclined to support accepting that as the new normal so we better support multinode jobs and don't have as much difference between them and single nodes. | 21:20 |
| *** bgmccollum has joined #openstack-infra | 21:20 | |
| dmsimard | corvus: the logs are not properly nested under logs/ I think is the problem | 21:20 |
| clarkb | pabelanger: https://review.openstack.org/531018 may interest you as it cleans up a job issue that was easier to just fix than go and file a storyboard bug for | 21:21 |
| mriedem | i'm guessing this is intentional for multinode http://logs.openstack.org/33/266633/4/check/devstack-multinode/87dc069/ | 21:21 |
| mriedem | where you have controller/ and compute1/ | 21:21 |
| dmsimard | mriedem: sure, but I'd expect those to be nested under logs/ but it may have gotten lost somewhere in the process | 21:21 |
| mriedem | whereas before we had logs/ with the control node logs in there, and the compute logs under subnode1 | 21:21 |
| dmsimard | i.e, logs/controller, logs/compute1 | 21:21 |
| *** smatzek has quit IRC | 21:21 | |
| mriedem | oh i see what you're saying | 21:22 |
| *** edmondsw has quit IRC | 21:22 | |
| dmsimard | mriedem: subnode1 is no longer a thing, the name of the directory is whatever the name of the ansible node was | 21:22 |
| pabelanger | mriedem: dmsimard: we do some magic fetch-tox-output for single / multinode jobs: http://git.openstack.org/cgit/openstack-infra/zuul-jobs/tree/roles/fetch-tox-output/tasks/main.yaml could do the same in devstack on single node | 21:22 |
| mriedem | trying to figure out where it breaks down in http://git.openstack.org/cgit/openstack-infra/os-loganalyze/tree/os_loganalyze/ | 21:22 |
| pabelanger | clarkb: +2 | 21:23 |
| dmsimard | corvus: TIL about sigyn | 21:25 |
| dmsimard | wow, it's huge. | 21:27 |
| *** dhill_ has joined #openstack-infra | 21:27 | |
| corvus | dmsimard: she's shown up in our channels occasionally | 21:33 |
| dmsimard | I have my chat client hide a lot of superfluous messages (such as join/parts) unless they say something, keeps my chat tidy :) | 21:33 |
| corvus | well, we notice when she banned our bots. freenode whitelisted them after that. | 21:34 |
| *** jtomasek has quit IRC | 21:34 | |
| dmsimard | ouch | 21:37 |
| openstackgerrit | Alex Krzos proposed openstack-infra/grafyaml master: Add support to change the default time filter range https://review.openstack.org/530798 | 21:42 |
| *** gouthamr has quit IRC | 21:42 | |
| *** e0ne has joined #openstack-infra | 21:43 | |
| *** kgiusti has left #openstack-infra | 21:43 | |
| *** hongbin has quit IRC | 21:46 | |
| *** Goneri has quit IRC | 21:51 | |
| *** abelur_ has quit IRC | 21:51 | |
| *** jcoufal has quit IRC | 21:56 | |
| *** e0ne has quit IRC | 21:59 | |
| *** e0ne has joined #openstack-infra | 22:02 | |
| *** eharney has joined #openstack-infra | 22:04 | |
| *** rcernin has joined #openstack-infra | 22:05 | |
| *** priteau has quit IRC | 22:05 | |
| *** e0ne has quit IRC | 22:08 | |
| *** e0ne has joined #openstack-infra | 22:12 | |
| *** e0ne has quit IRC | 22:14 | |
| EmilienM | pabelanger: can you confirm there is no mirror for puppetlabs repos? I couldn't find it | 22:15 |
| *** wolverineav has quit IRC | 22:17 | |
| *** e0ne has joined #openstack-infra | 22:28 | |
| *** bobh has quit IRC | 22:32 | |
| *** bobh has joined #openstack-infra | 22:33 | |
| clarkb | corvus: before today ends can we get puppet running on lists.o.o? I'm happy to do the emergency list removal and help watch things but want to make sure you are around too since it was fairly complicated set of changes | 22:36 |
| jlk | Hey all, I've changed the contact email address in ubuntu one, and also launchpad. Does anything need to be changed in gerrit / zuul ? | 22:37 |
| *** bobh has quit IRC | 22:38 | |
| jlk | hrm, things look normal, so I'm guessing not | 22:39 |
| clarkb | jlk: if that resulted in a new openid for you then it may cause gerrit to create a new account for you when you login | 22:39 |
| jlk | It does not seem to | 22:39 |
| jlk | (have created a new openid) | 22:39 |
| corvus | clarkb: i'll kick that host manually and verify it looks good | 22:40 |
| clarkb | jlk: then you should be fine | 22:41 |
| jlk | groovy | 22:41 |
| *** dhill_ has quit IRC | 22:43 | |
| corvus | clarkb: the manual puppet run did nothing unexpected. i will remove from emergency now | 22:45 |
| clarkb | corvus: thanks | 22:45 |
| corvus | #status log removed lists.openstack.org from emergency file since all required puppet fixes have landed | 22:46 |
| corvus | clarkb: https://googleprojectzero.blogspot.com/2018/01/reading-privileged-memory-with-side.html | 22:49 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/system-config master: Add Puppetlabs mirror for Ubuntu Xenial https://review.openstack.org/531030 | 22:50 |
| clarkb | corvus: it beings! | 22:51 |
| clarkb | *begins | 22:51 |
| corvus | it's so bad it has two names: spectre and meltdown | 22:52 |
| clarkb | and one affects more than just intel cpus | 22:54 |
| clarkb | which is I guess why kpti is being applied across all of the things | 22:55 |
| *** rlandy is now known as rlandy|bbl | 22:58 | |
| *** ralonsoh_ has quit IRC | 23:03 | |
| clarkb | no usn yet | 23:03 |
| *** swest has quit IRC | 23:03 | |
| clarkb | corvus: also the branded page https://meltdownattack.com/ implies meltdown is only a problme when coupled with xen but your link has them using kvm guests to attack hypervisors | 23:05 |
| *** e0ne has quit IRC | 23:09 | |
| *** eumel8 has quit IRC | 23:09 | |
| *** ijw has joined #openstack-infra | 23:14 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Support cross-source dependencies https://review.openstack.org/530806 | 23:14 |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Move commands to the base testenv https://review.openstack.org/528819 | 23:19 |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Fix setup_project checking out eol with branch name https://review.openstack.org/523925 | 23:19 |
| clarkb | corvus: https://review.openstack.org/#/c/530820/ is the other outstanding item I have from the catching up on things post holidays list from yesterday | 23:21 |
| clarkb | that should address comments on the init script stuff for zuul services | 23:21 |
| *** sshnaidm is now known as sshnaidm|afk | 23:22 | |
| *** mlavalle has quit IRC | 23:26 | |
| corvus | +3 | 23:29 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/system-config master: Add Puppetlabs mirror for Ubuntu Xenial https://review.openstack.org/531030 | 23:35 |
| *** esberglu has quit IRC | 23:38 | |
| openstackgerrit | Merged openstack-infra/puppet-zuul master: Don't assume pidfile location https://review.openstack.org/530820 | 23:47 |
| *** tosky has quit IRC | 23:49 | |
| clarkb | EmilienM: what is PC1? | 23:50 |
| EmilienM | clarkb: puppet-agent | 23:50 |
| clarkb | EmilienM: so you only want to mirror the agent not puppet itself? | 23:54 |
| EmilienM | well, since puppet4 puppet itself is the agent | 23:55 |
| EmilienM | afik | 23:55 |
| clarkb | oh interesting so pc1 is different versions of stuff. looking at packages.gz pc1 includes all the things it isn't just the agent | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!