| *** stakeda has quit IRC | 00:00 | |
| *** bobh has quit IRC | 00:02 | |
| *** tosky has quit IRC | 00:11 | |
| *** thorst has joined #openstack-infra | 00:16 | |
| *** sree has joined #openstack-infra | 00:17 | |
| *** thorst has quit IRC | 00:21 | |
| *** mancdaz has joined #openstack-infra | 00:22 | |
| *** sree has quit IRC | 00:22 | |
| *** sshnaidm is now known as sshnaidm|off | 00:30 | |
| *** david-lyle has joined #openstack-infra | 00:30 | |
| *** david-lyle has quit IRC | 00:31 | |
| *** david-lyle has joined #openstack-infra | 00:31 | |
| *** aeng has quit IRC | 00:34 | |
| *** yuanying_ has quit IRC | 00:43 | |
| *** yuanying has joined #openstack-infra | 00:43 | |
| *** salv-orlando has joined #openstack-infra | 00:44 | |
| ianw | pabelanger: chased down why centos is seeing too many epel failures; oops ... https://review.openstack.org/525017 | 00:46 |
|---|---|---|
| *** salv-orlando has quit IRC | 00:49 | |
| *** sboyron has quit IRC | 00:50 | |
| *** ramishra has joined #openstack-infra | 00:51 | |
| *** aeng has joined #openstack-infra | 00:51 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix yum command for TLS job https://review.openstack.org/525018 | 00:52 |
| *** thorst has joined #openstack-infra | 00:52 | |
| *** thorst has quit IRC | 00:57 | |
| *** slaweq has joined #openstack-infra | 00:59 | |
| *** psachin has joined #openstack-infra | 00:59 | |
| *** slaweq has quit IRC | 01:03 | |
| openstackgerrit | Merged openstack-infra/system-config master: Upgrade translate-dev.o.o to Zanata 4.3.1 https://review.openstack.org/524400 | 01:05 |
| *** aeng has quit IRC | 01:08 | |
| *** aeng has joined #openstack-infra | 01:09 | |
| *** dhill_ has quit IRC | 01:11 | |
| *** jascott1 has quit IRC | 01:11 | |
| *** liujiong has joined #openstack-infra | 01:12 | |
| *** cshastri has joined #openstack-infra | 01:17 | |
| *** edmondsw has joined #openstack-infra | 01:19 | |
| *** cshastri has quit IRC | 01:22 | |
| *** edmondsw has quit IRC | 01:24 | |
| *** annp has quit IRC | 01:27 | |
| *** thorst has joined #openstack-infra | 01:27 | |
| *** yamahata has quit IRC | 01:28 | |
| *** thorst has quit IRC | 01:28 | |
| *** thorst has joined #openstack-infra | 01:29 | |
| *** thorst has quit IRC | 01:30 | |
| *** claudiub has quit IRC | 01:35 | |
| *** salv-orlando has joined #openstack-infra | 01:45 | |
| *** yamamoto has joined #openstack-infra | 01:45 | |
| *** salv-orlando has quit IRC | 01:49 | |
| *** pahuang has quit IRC | 01:49 | |
| *** dhinesh has joined #openstack-infra | 01:51 | |
| *** pahuang has joined #openstack-infra | 01:52 | |
| *** gmann_afk is now known as gmann | 01:54 | |
| *** jamesmcarthur has joined #openstack-infra | 02:00 | |
| *** thorst has joined #openstack-infra | 02:01 | |
| *** thorst has quit IRC | 02:06 | |
| *** sree has joined #openstack-infra | 02:08 | |
| openstackgerrit | Kazunori Shinohara proposed openstack-infra/project-config master: Set up translation for Heat Dashboard https://review.openstack.org/525028 | 02:09 |
| *** sree_ has joined #openstack-infra | 02:10 | |
| *** thorst has joined #openstack-infra | 02:10 | |
| *** sree_ is now known as Guest25159 | 02:10 | |
| *** Guest25159 has quit IRC | 02:12 | |
| *** kiennt26 has joined #openstack-infra | 02:13 | |
| *** sree has quit IRC | 02:14 | |
| *** thorst has quit IRC | 02:14 | |
| kazsh | Hi Infra root, could you kindly review my change for Heat Dashboard, I would like to set up translation for our project, thank you ! | 02:20 |
| kazsh | https://review.openstack.org/#/c/525028/ | 02:20 |
| *** pbourke_ has quit IRC | 02:22 | |
| *** Apoorva has quit IRC | 02:23 | |
| *** pbourke_ has joined #openstack-infra | 02:24 | |
| *** jamesmcarthur has quit IRC | 02:26 | |
| *** jamesmcarthur has joined #openstack-infra | 02:27 | |
| *** daidv has joined #openstack-infra | 02:28 | |
| ianw | eumel8: the translate-dev changes have merged (it's already in emergency). i'm going to do a manual run, follow along the guide and see what happens. i'm logging everything in screen sessions | 02:33 |
| *** cuongnv has joined #openstack-infra | 02:34 | |
| *** askb has joined #openstack-infra | 02:44 | |
| *** salv-orlando has joined #openstack-infra | 02:45 | |
| *** jamesmcarthur has quit IRC | 02:47 | |
| *** jamesmcarthur has joined #openstack-infra | 02:48 | |
| *** cshastri has joined #openstack-infra | 02:49 | |
| *** salv-orlando has quit IRC | 02:50 | |
| *** mat128 has joined #openstack-infra | 02:54 | |
| *** jamesmcarthur has quit IRC | 02:57 | |
| *** jamesmcarthur has joined #openstack-infra | 02:59 | |
| *** dhinesh has quit IRC | 03:01 | |
| *** dhinesh has joined #openstack-infra | 03:01 | |
| *** mat128 has quit IRC | 03:04 | |
| *** edmondsw has joined #openstack-infra | 03:07 | |
| *** edmondsw has quit IRC | 03:12 | |
| *** thorst has joined #openstack-infra | 03:17 | |
| *** sree has joined #openstack-infra | 03:20 | |
| *** thorst has quit IRC | 03:22 | |
| *** bobh has joined #openstack-infra | 03:25 | |
| *** jamesmcarthur has quit IRC | 03:31 | |
| *** edmondsw has joined #openstack-infra | 03:32 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config master: networking-midonet: Remove some of legacy jobs https://review.openstack.org/522465 | 03:32 |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/openstack-zuul-jobs master: Remove legacy novaclient jobs https://review.openstack.org/522102 | 03:35 |
| *** edmondsw has quit IRC | 03:36 | |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/openstack-zuul-jobs master: Remove legacy novaclient jobs https://review.openstack.org/522102 | 03:37 |
| *** slaweq has joined #openstack-infra | 03:46 | |
| *** salv-orlando has joined #openstack-infra | 03:46 | |
| *** slaweq has quit IRC | 03:50 | |
| *** salv-orlando has quit IRC | 03:51 | |
| *** yamamoto has quit IRC | 03:53 | |
| *** yamamoto has joined #openstack-infra | 03:55 | |
| *** thorst has joined #openstack-infra | 03:57 | |
| *** bhavik1 has joined #openstack-infra | 03:57 | |
| *** thorst has quit IRC | 04:02 | |
| *** ykarel has joined #openstack-infra | 04:02 | |
| ianw | eumel8 / clarkb: https://etherpad.openstack.org/p/zanata_upgrade_4xx ... so we're basically up to setup 8 (reindex, testing). i'll leave it at that, afaict 4.3.1 seems to be responding ok. few terse notes from myself down the bottom but nothing major | 04:10 |
| *** annp has joined #openstack-infra | 04:10 | |
| *** jascott1 has joined #openstack-infra | 04:11 | |
| *** bhavik1 has quit IRC | 04:12 | |
| *** bhavik1 has joined #openstack-infra | 04:12 | |
| *** links has joined #openstack-infra | 04:13 | |
| *** yamahata has joined #openstack-infra | 04:21 | |
| *** sree has quit IRC | 04:23 | |
| *** udesale has joined #openstack-infra | 04:25 | |
| *** bobh has quit IRC | 04:25 | |
| *** sree has joined #openstack-infra | 04:25 | |
| *** udesale has joined #openstack-infra | 04:25 | |
| *** jamesmcarthur has joined #openstack-infra | 04:26 | |
| *** jamesmcarthur has quit IRC | 04:30 | |
| *** adisky_ has joined #openstack-infra | 04:31 | |
| *** aeng has quit IRC | 04:33 | |
| eumel8 | ianw: good morning :) | 04:35 |
| ianw | eumel8: i hope it's not too early | 04:36 |
| *** thorst has joined #openstack-infra | 04:37 | |
| eumel8 | ianw: early start, early end of working day :) | 04:41 |
| *** thorst has quit IRC | 04:41 | |
| eumel8 | ianw: what I can see, upgrade was sucessfully. good job, so far | 04:42 |
| eumel8 | ianw: one think is the page not found error after openid login. I had this in my tests also, but I don't know if this is an error or an feature. We have to ask Zanata guys. | 04:45 |
| ianw | eumel8: ok ... i did see the 404 page until i applied the sql update for anonymous login, if that helps | 04:46 |
| *** salv-orlando has joined #openstack-infra | 04:47 | |
| *** yamamoto_ has joined #openstack-infra | 04:47 | |
| openstackgerrit | Brian Rosmaita proposed openstack-infra/project-config master: Remove legacy jobs for python-glanceclient https://review.openstack.org/525044 | 04:48 |
| openstackgerrit | Brian Rosmaita proposed openstack-infra/openstack-zuul-jobs master: Remove python-glanceclient legacy jobs https://review.openstack.org/525046 | 04:48 |
| *** aeng has joined #openstack-infra | 04:49 | |
| *** yamamoto has quit IRC | 04:51 | |
| eumel8 | ianw: I know. But if you klick then left on dashboard, everything works fine | 04:52 |
| *** salv-orlando has quit IRC | 04:52 | |
| *** rosmaita has quit IRC | 04:52 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/system-config master: Refresh Zanata admin user list https://review.openstack.org/525048 | 04:57 |
| eumel8 | ianw: btw, whats your zanata account? You can add them there ^^ | 04:57 |
| *** edmondsw has joined #openstack-infra | 04:58 | |
| ianw | eumel8: i believe ianw | 04:59 |
| eumel8 | ianw: sure? didn't found it on translate.o.o. | 05:00 |
| ianw | umm, no not 100% sure :) | 05:02 |
| *** edmondsw has quit IRC | 05:03 | |
| *** janki has joined #openstack-infra | 05:05 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Cache zanata cli tools https://review.openstack.org/525050 | 05:07 |
| openstackgerrit | Frank Kloeker proposed openstack-infra/system-config master: Refresh Zanata admin user list https://review.openstack.org/525048 | 05:09 |
| openstackgerrit | Anusha Ramineni proposed openstack-infra/project-config master: Add new repo for congress tempest plugin https://review.openstack.org/525052 | 05:09 |
| *** thorst has joined #openstack-infra | 05:10 | |
| *** dhinesh has quit IRC | 05:10 | |
| eumel8 | ianw: okay, we will try it. Unfortunatelly we've lost the admin privileges on dev server, so I added my second account there. | 05:11 |
| *** gcb has joined #openstack-infra | 05:11 | |
| ianw | eumel8: hmm, translate.o.o says my account is not active, tries to send me an email i'm and i'm not getting it | 05:12 |
| eumel8 | will look... | 05:12 |
| ianw | SMTP error from remote mail server after RCPT TO:<iwienand@redhat.com>: 451 4.7.1 Greylisting in action, please come back in 00:05:00 | 05:12 |
| eumel8 | ianw: ok, fucking greylisting. I activated manually ;) | 05:15 |
| *** thorst has quit IRC | 05:15 | |
| ianw | eumel8: cool, thanks | 05:15 |
| *** jaosorior has joined #openstack-infra | 05:16 | |
| *** anthonyper has quit IRC | 05:29 | |
| *** zhurong has joined #openstack-infra | 05:31 | |
| *** andymccr has quit IRC | 05:32 | |
| *** dsariel has quit IRC | 05:33 | |
| *** andymccr has joined #openstack-infra | 05:33 | |
| *** cloudnull has quit IRC | 05:33 | |
| *** anthonyper has joined #openstack-infra | 05:33 | |
| *** thorst has joined #openstack-infra | 05:37 | |
| *** anthonyper has quit IRC | 05:38 | |
| *** cloudnull has joined #openstack-infra | 05:40 | |
| *** pgadiya has joined #openstack-infra | 05:40 | |
| *** pgadiya has quit IRC | 05:40 | |
| *** thorst has quit IRC | 05:42 | |
| *** anthonyper has joined #openstack-infra | 05:42 | |
| *** thorst has joined #openstack-infra | 05:45 | |
| *** salv-orlando has joined #openstack-infra | 05:48 | |
| *** honza has quit IRC | 05:48 | |
| *** honza has joined #openstack-infra | 05:48 | |
| *** honza is now known as Guest46858 | 05:48 | |
| *** thorst has quit IRC | 05:50 | |
| openstackgerrit | zhufl proposed openstack-infra/elastic-recheck master: Remove "Initializing SSH connection to" message from query https://review.openstack.org/519546 | 05:50 |
| *** salv-orlando has quit IRC | 05:53 | |
| openstackgerrit | Anusha Ramineni proposed openstack-infra/project-config master: Add new repo for congress tempest plugin https://review.openstack.org/525052 | 05:59 |
| *** liujiong has quit IRC | 06:00 | |
| *** clarkb has quit IRC | 06:02 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/525061 | 06:03 |
| *** liujiong has joined #openstack-infra | 06:05 | |
| *** jtomasek has joined #openstack-infra | 06:08 | |
| *** gongysh has joined #openstack-infra | 06:15 | |
| *** thorst has joined #openstack-infra | 06:24 | |
| *** thorst has quit IRC | 06:29 | |
| *** yamahata has quit IRC | 06:31 | |
| *** xinliang has quit IRC | 06:32 | |
| *** clarkb has joined #openstack-infra | 06:33 | |
| *** jbadiapa has joined #openstack-infra | 06:33 | |
| *** salv-orlando has joined #openstack-infra | 06:40 | |
| *** slaweq has joined #openstack-infra | 06:41 | |
| *** xinliang has joined #openstack-infra | 06:44 | |
| *** xinliang has quit IRC | 06:44 | |
| *** xinliang has joined #openstack-infra | 06:44 | |
| *** slaweq has quit IRC | 06:45 | |
| *** edmondsw has joined #openstack-infra | 06:46 | |
| *** edmondsw has quit IRC | 06:51 | |
| *** cody-somerville has quit IRC | 06:56 | |
| *** thorst has joined #openstack-infra | 06:57 | |
| *** zhurong has quit IRC | 06:57 | |
| *** thorst has quit IRC | 07:01 | |
| *** cody-somerville has joined #openstack-infra | 07:09 | |
| *** ralonsoh has joined #openstack-infra | 07:13 | |
| *** zhurong has joined #openstack-infra | 07:20 | |
| *** askb_ has joined #openstack-infra | 07:25 | |
| *** askb_ has quit IRC | 07:29 | |
| *** askb_ has joined #openstack-infra | 07:34 | |
| *** thorst has joined #openstack-infra | 07:36 | |
| *** thorst has quit IRC | 07:41 | |
| *** shardy has joined #openstack-infra | 07:48 | |
| *** cody-somerville has quit IRC | 07:49 | |
| *** rcernin has quit IRC | 07:49 | |
| *** dbecker has joined #openstack-infra | 07:50 | |
| *** florianf has joined #openstack-infra | 07:50 | |
| *** kjackal_ has joined #openstack-infra | 07:51 | |
| *** ccamacho has joined #openstack-infra | 07:55 | |
| *** cody-somerville has joined #openstack-infra | 08:02 | |
| *** dmellado has quit IRC | 08:06 | |
| *** dmellado has joined #openstack-infra | 08:08 | |
| *** kzaitsev_pi has quit IRC | 08:08 | |
| *** dingyichen has quit IRC | 08:10 | |
| *** jtomasek has quit IRC | 08:11 | |
| *** jtomasek has joined #openstack-infra | 08:11 | |
| *** slaweq has joined #openstack-infra | 08:11 | |
| *** e0ne has joined #openstack-infra | 08:12 | |
| *** tesseract has joined #openstack-infra | 08:13 | |
| *** kzaitsev_pi has joined #openstack-infra | 08:14 | |
| *** dmellado has quit IRC | 08:18 | |
| *** dmellado has joined #openstack-infra | 08:18 | |
| *** zhurong has quit IRC | 08:20 | |
| *** andreas_s has joined #openstack-infra | 08:21 | |
| *** pcaruana has joined #openstack-infra | 08:23 | |
| *** [HeOS] has quit IRC | 08:25 | |
| *** Hal has joined #openstack-infra | 08:28 | |
| *** martinkopec has joined #openstack-infra | 08:31 | |
| *** salv-orlando has quit IRC | 08:32 | |
| *** salv-orlando has joined #openstack-infra | 08:32 | |
| *** sree_ has joined #openstack-infra | 08:32 | |
| *** sree_ is now known as Guest25372 | 08:33 | |
| *** sree has quit IRC | 08:35 | |
| *** edmondsw has joined #openstack-infra | 08:35 | |
| *** rcernin has joined #openstack-infra | 08:35 | |
| *** salv-orlando has quit IRC | 08:36 | |
| *** claudiub has joined #openstack-infra | 08:39 | |
| *** edmondsw has quit IRC | 08:40 | |
| *** sshnaidm|off is now known as sshnaidm|rover | 08:40 | |
| openstackgerrit | Le Hou proposed openstack-infra/infra-manual master: Gerrit generate Http password can`t contain "/" https://review.openstack.org/525096 | 08:41 |
| *** sboyron has joined #openstack-infra | 08:46 | |
| *** apetrich has quit IRC | 08:47 | |
| *** yamamoto_ has quit IRC | 08:47 | |
| *** jpena|off is now known as jpena | 08:48 | |
| *** rossella_s has joined #openstack-infra | 08:48 | |
| *** salv-orlando has joined #openstack-infra | 08:50 | |
| *** e0ne has quit IRC | 08:50 | |
| *** ykarel is now known as ykarel|lunch | 08:52 | |
| *** jpich has joined #openstack-infra | 08:53 | |
| *** claudiub has quit IRC | 08:57 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix yum command for TLS job https://review.openstack.org/525018 | 08:57 |
| *** yamamoto has joined #openstack-infra | 08:58 | |
| *** armaan has joined #openstack-infra | 08:59 | |
| *** zhurong has joined #openstack-infra | 09:02 | |
| *** claudiub has joined #openstack-infra | 09:04 | |
| *** pblaho has joined #openstack-infra | 09:05 | |
| *** gongysh has quit IRC | 09:07 | |
| *** Guest13268 is now known as zigo | 09:09 | |
| *** rossella_s has quit IRC | 09:11 | |
| *** cody-somerville has quit IRC | 09:12 | |
| *** rossella_s has joined #openstack-infra | 09:13 | |
| *** sboyron has quit IRC | 09:21 | |
| *** Guest25372 has quit IRC | 09:24 | |
| *** sree has joined #openstack-infra | 09:24 | |
| *** gongysh has joined #openstack-infra | 09:25 | |
| *** bhavik1 has quit IRC | 09:27 | |
| *** rossella_s has quit IRC | 09:27 | |
| *** sboyron has joined #openstack-infra | 09:29 | |
| *** sree has quit IRC | 09:29 | |
| *** rossella_s has joined #openstack-infra | 09:31 | |
| *** armaan has quit IRC | 09:31 | |
| *** lucas-afk is now known as lucasagomes | 09:31 | |
| *** dsariel has joined #openstack-infra | 09:31 | |
| *** shu-mutou-AWAY has quit IRC | 09:32 | |
| *** alexchadin has joined #openstack-infra | 09:32 | |
| *** armaan has joined #openstack-infra | 09:33 | |
| *** sboyron has quit IRC | 09:38 | |
| *** derekh has joined #openstack-infra | 09:38 | |
| *** sree has joined #openstack-infra | 09:40 | |
| *** jascott1 has quit IRC | 09:40 | |
| *** jascott1 has joined #openstack-infra | 09:41 | |
| *** claudiub has quit IRC | 09:41 | |
| *** jascott1 has quit IRC | 09:46 | |
| *** ganso has joined #openstack-infra | 09:49 | |
| *** slaweq has quit IRC | 09:49 | |
| *** slaweq has joined #openstack-infra | 09:50 | |
| *** slaweq has quit IRC | 09:50 | |
| *** apetrich has joined #openstack-infra | 09:55 | |
| *** slaweq has joined #openstack-infra | 09:56 | |
| *** ykarel|lunch is now known as ykarel | 09:59 | |
| *** Guest46858 is now known as honza | 10:00 | |
| *** hashar has joined #openstack-infra | 10:05 | |
| *** alexchadin has quit IRC | 10:05 | |
| *** liujiong has quit IRC | 10:06 | |
| *** hashar has quit IRC | 10:09 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Send logs size to grahite site https://review.openstack.org/481159 | 10:10 |
| *** cuongnv has quit IRC | 10:10 | |
| *** sree has quit IRC | 10:13 | |
| *** alexchadin has joined #openstack-infra | 10:13 | |
| *** sree has joined #openstack-infra | 10:13 | |
| *** tosky has joined #openstack-infra | 10:14 | |
| *** kiennt26 has quit IRC | 10:15 | |
| *** sree has quit IRC | 10:18 | |
| *** sree has joined #openstack-infra | 10:19 | |
| *** [HeOS] has joined #openstack-infra | 10:21 | |
| *** sree has quit IRC | 10:23 | |
| *** ianychoi_ is now known as ianychoi | 10:24 | |
| *** electrofelix has joined #openstack-infra | 10:24 | |
| *** giblet is now known as gibi | 10:25 | |
| *** zhurong has quit IRC | 10:26 | |
| *** ldnunes has joined #openstack-infra | 10:26 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Send graphite stats from ARA https://review.openstack.org/480121 | 10:28 |
| *** yamamoto has quit IRC | 10:31 | |
| *** annp has quit IRC | 10:33 | |
| *** cshastri has quit IRC | 10:38 | |
| *** andreas_s has quit IRC | 10:42 | |
| *** andreas_s has joined #openstack-infra | 10:43 | |
| *** slaweq_ has joined #openstack-infra | 10:43 | |
| *** armaan has quit IRC | 10:45 | |
| *** sambetts|afk is now known as sambetts | 10:47 | |
| *** slaweq_ has quit IRC | 10:48 | |
| openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/525061 | 10:50 |
| *** gmann is now known as gmann_afk | 10:52 | |
| *** rfolco has joined #openstack-infra | 10:54 | |
| *** armaan has joined #openstack-infra | 10:54 | |
| *** andreas_s has quit IRC | 10:56 | |
| *** armaan has quit IRC | 10:57 | |
| *** ralonsoh has quit IRC | 10:58 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: add /{tenant}/jobs route https://review.openstack.org/503270 | 11:00 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: add /{tenant}/builds route https://review.openstack.org/466561 | 11:00 |
| *** e0ne has joined #openstack-infra | 11:01 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: Publish deploy guide updates for all branches https://review.openstack.org/525154 | 11:02 |
| *** ralonsoh has joined #openstack-infra | 11:03 | |
| *** andreas_s has joined #openstack-infra | 11:06 | |
| *** armaan has joined #openstack-infra | 11:06 | |
| *** Zachary has joined #openstack-infra | 11:09 | |
| Zachary | Zachary> $ git log | grep "ovs mech: bind only if user request switchdev" | 11:10 |
| Zachary | <Zachary> Merge "ovs mech: bind only if user request switchdev" | 11:10 |
| Zachary | <Zachary> ovs mech: bind only if user request switchdev | 11:10 |
| Zachary | why zull merge again ? | 11:10 |
| *** raissa has joined #openstack-infra | 11:11 | |
| *** raissa has quit IRC | 11:13 | |
| *** raissa has joined #openstack-infra | 11:14 | |
| *** raissa has quit IRC | 11:14 | |
| *** gongysh has quit IRC | 11:14 | |
| *** raissa has joined #openstack-infra | 11:15 | |
| *** raissa has quit IRC | 11:15 | |
| *** raissa has joined #openstack-infra | 11:16 | |
| *** yamamoto has joined #openstack-infra | 11:16 | |
| *** raissa has quit IRC | 11:16 | |
| *** raissa has joined #openstack-infra | 11:16 | |
| *** raissa has joined #openstack-infra | 11:17 | |
| *** raissa has quit IRC | 11:17 | |
| *** alexchadin has quit IRC | 11:19 | |
| *** andreas_s has quit IRC | 11:19 | |
| *** alexchadin has joined #openstack-infra | 11:20 | |
| *** andreas_s has joined #openstack-infra | 11:20 | |
| *** andreas_s has quit IRC | 11:24 | |
| *** alexchadin has quit IRC | 11:30 | |
| *** alexchadin has joined #openstack-infra | 11:30 | |
| *** dtantsur|afk is now known as dtantsur | 11:30 | |
| *** finucannot is now known as stephenfin | 11:31 | |
| *** raissa has joined #openstack-infra | 11:34 | |
| *** jesusaur has quit IRC | 11:38 | |
| *** andreas_s has joined #openstack-infra | 11:44 | |
| *** shardy has quit IRC | 11:44 | |
| *** jesusaur has joined #openstack-infra | 11:45 | |
| *** shardy has joined #openstack-infra | 11:45 | |
| *** andreas_s has quit IRC | 11:46 | |
| *** andreas_s has joined #openstack-infra | 11:46 | |
| *** jkilpatr has joined #openstack-infra | 11:52 | |
| *** jesusaur has quit IRC | 11:52 | |
| *** jesusaur has joined #openstack-infra | 11:55 | |
| *** smatzek has joined #openstack-infra | 11:56 | |
| *** jpena is now known as jpena|lunch | 11:57 | |
| *** jkilpatr has quit IRC | 11:57 | |
| Wei_Liu | infra-core: hello | 12:02 |
| *** jesusaur has quit IRC | 12:02 | |
| Wei_Liu | infra-core: in our local CI environment, the gerrit IP is changed, and I apply this change to my zuul.conf, it worked for zuul-server, but it did not take effect to zuul-merger, zuul-merger is still using the old IP of gerrit server. Is there the cache for zuul-merger? | 12:05 |
| *** jesusaur has joined #openstack-infra | 12:06 | |
| *** lennyb__ has quit IRC | 12:07 | |
| openstackgerrit | Thierry Carrez proposed openstack/ptgbot master: Remove ethercalc support https://review.openstack.org/525167 | 12:09 |
| openstackgerrit | Thierry Carrez proposed openstack/ptgbot master: Specify and load event schedule https://review.openstack.org/525168 | 12:09 |
| openstackgerrit | Thierry Carrez proposed openstack/ptgbot master: Rooms are now called Tracks https://review.openstack.org/525169 | 12:09 |
| *** gcb has quit IRC | 12:10 | |
| *** lucasagomes is now known as lucas-hungry | 12:10 | |
| *** makowals has joined #openstack-infra | 12:10 | |
| *** jkilpatr has joined #openstack-infra | 12:10 | |
| *** apetrich has quit IRC | 12:10 | |
| *** edmondsw has joined #openstack-infra | 12:11 | |
| eumel8 | https://devbranch.openstack.org/join/register - is there a way to get credentials? | 12:12 |
| *** edmondsw has quit IRC | 12:16 | |
| *** vickyc has joined #openstack-infra | 12:19 | |
| openstackgerrit | Thierry Carrez proposed openstack/ptgbot master: Specify and load event schedule https://review.openstack.org/525168 | 12:20 |
| openstackgerrit | Thierry Carrez proposed openstack/ptgbot master: Rooms are now called Tracks https://review.openstack.org/525169 | 12:20 |
| *** armaan has quit IRC | 12:20 | |
| *** armaan has joined #openstack-infra | 12:20 | |
| *** wolverineav has joined #openstack-infra | 12:20 | |
| *** ethfci has joined #openstack-infra | 12:23 | |
| *** bobh has joined #openstack-infra | 12:26 | |
| *** bobh has quit IRC | 12:30 | |
| *** rcernin has quit IRC | 12:31 | |
| *** derekh has quit IRC | 12:36 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Create a test matrix role https://review.openstack.org/524402 | 12:37 |
| *** bobh has joined #openstack-infra | 12:37 | |
| openstackgerrit | Saad Zaher proposed openstack-infra/project-config master: Remove freezer-api legacy jobs https://review.openstack.org/525175 | 12:37 |
| openstackgerrit | Saad Zaher proposed openstack-infra/openstack-zuul-jobs master: Remove freezer-api legacy jobs https://review.openstack.org/525176 | 12:40 |
| openstackgerrit | Saad Zaher proposed openstack-infra/project-config master: Remove freezer-api legacy jobs https://review.openstack.org/525175 | 12:41 |
| *** rhallisey has joined #openstack-infra | 12:43 | |
| *** alexchadin has quit IRC | 12:44 | |
| Wei_Liu | infra-core: in our local CI environment, the gerrit IP is changed, and I apply this change to my zuul.conf, it worked for zuul-server, but it did not take effect to zuul-merger, zuul-merger is still using the old IP of gerrit server. Is there the cache for zuul-merger? | 12:49 |
| *** pblaho has quit IRC | 12:49 | |
| *** links has quit IRC | 12:54 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Remove alien_list command https://review.openstack.org/525177 | 12:57 |
| *** Zachary has quit IRC | 12:58 | |
| *** sboyron has joined #openstack-infra | 12:59 | |
| *** jesusaur has quit IRC | 13:00 | |
| *** dprince has joined #openstack-infra | 13:02 | |
| *** jesusaur has joined #openstack-infra | 13:02 | |
| *** dtantsur is now known as dtantsur|lunch | 13:03 | |
| *** jpena|lunch is now known as jpena | 13:04 | |
| *** rosmaita has joined #openstack-infra | 13:06 | |
| *** trown|outtypewww has quit IRC | 13:06 | |
| *** trown has joined #openstack-infra | 13:07 | |
| *** alexchadin has joined #openstack-infra | 13:07 | |
| *** sboyron has quit IRC | 13:07 | |
| *** salv-orlando has quit IRC | 13:07 | |
| *** salv-orlando has joined #openstack-infra | 13:08 | |
| *** lucas-hungry is now known as lucasagomes | 13:08 | |
| *** jaypipes has joined #openstack-infra | 13:08 | |
| *** salv-orlando has quit IRC | 13:12 | |
| *** niedbalski_ is now known as niedbalski | 13:13 | |
| *** niedbalski has quit IRC | 13:13 | |
| *** niedbalski has joined #openstack-infra | 13:13 | |
| *** bobh has quit IRC | 13:20 | |
| *** bobh has joined #openstack-infra | 13:20 | |
| *** slaweq_ has joined #openstack-infra | 13:21 | |
| *** ramishra has quit IRC | 13:22 | |
| *** edmondsw has joined #openstack-infra | 13:23 | |
| *** ykarel_ has joined #openstack-infra | 13:24 | |
| *** bobh has quit IRC | 13:26 | |
| *** slaweq_ has quit IRC | 13:26 | |
| *** ykarel has quit IRC | 13:26 | |
| *** armaan has quit IRC | 13:29 | |
| *** armaan has joined #openstack-infra | 13:30 | |
| *** ykarel__ has joined #openstack-infra | 13:30 | |
| *** links has joined #openstack-infra | 13:31 | |
| *** rlandy has joined #openstack-infra | 13:32 | |
| *** ykarel_ has quit IRC | 13:32 | |
| *** armaan has quit IRC | 13:32 | |
| *** armaan has joined #openstack-infra | 13:33 | |
| *** janki has quit IRC | 13:33 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Create a test matrix role https://review.openstack.org/524402 | 13:33 |
| *** kiennt26 has joined #openstack-infra | 13:33 | |
| *** jcoufal has joined #openstack-infra | 13:33 | |
| *** yamahata has joined #openstack-infra | 13:34 | |
| *** myoung|ruck has quit IRC | 13:35 | |
| *** lihi has quit IRC | 13:35 | |
| *** oanson has quit IRC | 13:35 | |
| *** sai has quit IRC | 13:35 | |
| *** sai has joined #openstack-infra | 13:36 | |
| *** ykarel_ has joined #openstack-infra | 13:37 | |
| *** lihi has joined #openstack-infra | 13:37 | |
| *** oanson has joined #openstack-infra | 13:37 | |
| *** dtantsur|lunch is now known as dtantsur | 13:38 | |
| *** myoung has joined #openstack-infra | 13:39 | |
| *** ykarel__ has quit IRC | 13:40 | |
| *** kgiusti has joined #openstack-infra | 13:40 | |
| *** Goneri has joined #openstack-infra | 13:40 | |
| *** rossella_s has quit IRC | 13:41 | |
| *** edmondsw has quit IRC | 13:43 | |
| *** hongbin has joined #openstack-infra | 13:43 | |
| *** rossella_s has joined #openstack-infra | 13:44 | |
| *** kgiusti has left #openstack-infra | 13:45 | |
| *** jamesdenton has joined #openstack-infra | 13:48 | |
| *** myoung is now known as myoung|ruck | 13:48 | |
| *** apetrich has joined #openstack-infra | 13:50 | |
| *** pblaho has joined #openstack-infra | 13:50 | |
| *** ykarel_ has quit IRC | 13:51 | |
| *** ykarel has joined #openstack-infra | 13:51 | |
| *** kgiusti has joined #openstack-infra | 13:51 | |
| *** jkilpatr has quit IRC | 13:53 | |
| *** hongbin has quit IRC | 13:58 | |
| *** thorst has joined #openstack-infra | 13:59 | |
| *** hongbin has joined #openstack-infra | 13:59 | |
| *** yamahata has quit IRC | 13:59 | |
| *** slaweq_ has joined #openstack-infra | 14:02 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Create a test matrix role https://review.openstack.org/524402 | 14:04 |
| *** slaweq_ has quit IRC | 14:06 | |
| *** yamamoto_ has joined #openstack-infra | 14:08 | |
| *** salv-orlando has joined #openstack-infra | 14:08 | |
| *** hongbin has quit IRC | 14:11 | |
| *** fultonj has joined #openstack-infra | 14:11 | |
| *** yamamoto has quit IRC | 14:11 | |
| *** rossella_s has quit IRC | 14:12 | |
| *** salv-orlando has quit IRC | 14:13 | |
| *** felipemonteiro has joined #openstack-infra | 14:15 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:16 | |
| *** dizquierdo has joined #openstack-infra | 14:20 | |
| *** yamamoto_ has quit IRC | 14:20 | |
| *** felipemonteiro has quit IRC | 14:20 | |
| *** apetrich has quit IRC | 14:21 | |
| *** alexchadin has quit IRC | 14:22 | |
| *** apetrich has joined #openstack-infra | 14:22 | |
| *** jkilpatr has joined #openstack-infra | 14:23 | |
| *** dhill_ has joined #openstack-infra | 14:25 | |
| *** kgiusti has left #openstack-infra | 14:26 | |
| *** gcb has joined #openstack-infra | 14:27 | |
| *** sboyron has joined #openstack-infra | 14:28 | |
| *** makowals has quit IRC | 14:28 | |
| *** kgiusti has joined #openstack-infra | 14:29 | |
| *** yamamoto has joined #openstack-infra | 14:29 | |
| *** smatzek has quit IRC | 14:31 | |
| *** smatzek has joined #openstack-infra | 14:31 | |
| *** makowals has joined #openstack-infra | 14:32 | |
| *** jkilpatr has quit IRC | 14:35 | |
| *** yamamoto has quit IRC | 14:35 | |
| *** jamesmcarthur has joined #openstack-infra | 14:36 | |
| *** smatzek has quit IRC | 14:36 | |
| *** dizquierdo has quit IRC | 14:37 | |
| *** ykarel is now known as ykarel|away | 14:38 | |
| *** dhill_ has quit IRC | 14:38 | |
| *** ramishra has joined #openstack-infra | 14:39 | |
| *** dhill_ has joined #openstack-infra | 14:40 | |
| *** kiennt26 has quit IRC | 14:42 | |
| *** ykarel|away has quit IRC | 14:43 | |
| *** sboyron has quit IRC | 14:46 | |
| *** jkilpatr has joined #openstack-infra | 14:46 | |
| *** thorst has quit IRC | 14:46 | |
| *** thorst has joined #openstack-infra | 14:48 | |
| *** dizquierdo has joined #openstack-infra | 14:49 | |
| *** sboyron has joined #openstack-infra | 14:51 | |
| *** yamamoto has joined #openstack-infra | 14:52 | |
| *** gouthamr has joined #openstack-infra | 14:52 | |
| *** psachin has quit IRC | 14:53 | |
| *** mat128 has joined #openstack-infra | 14:55 | |
| *** salv-orlando has joined #openstack-infra | 14:57 | |
| *** mat128 has quit IRC | 14:57 | |
| *** esberglu has joined #openstack-infra | 14:58 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Remove debug config of unbound since it's enabled https://review.openstack.org/525228 | 14:58 |
| *** smatzek has joined #openstack-infra | 14:59 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Remove debug config of unbound since it's enabled https://review.openstack.org/525228 | 15:01 |
| *** sboyron has quit IRC | 15:03 | |
| *** thorst has quit IRC | 15:03 | |
| *** bobh has joined #openstack-infra | 15:03 | |
| *** caphrim007 has quit IRC | 15:04 | |
| *** yamamoto has quit IRC | 15:04 | |
| *** jkilpatr has quit IRC | 15:07 | |
| *** links has quit IRC | 15:10 | |
| *** edmondsw has joined #openstack-infra | 15:13 | |
| *** ijw has quit IRC | 15:14 | |
| stephenfin | AJaeger_: So I've done some investigation on that strange 'tempest-dsvm-neutron-src-oslo.versionedobjects' test here and have some questions https://review.openstack.org/#/c/514309/3/.zuul.yaml | 15:14 |
| *** florianf is now known as florianf|afk | 15:14 | |
| dmsimard | stephenfin: AJaeger_is travelling this week iirc, maybe I can help ? | 15:15 |
| stephenfin | dmsimard: Oh, thanks for the info. If you have time, that would great :) | 15:15 |
| dmsimard | stephenfin: I'm not familiar with your problem so I might need some additional context but sure, go ahead | 15:16 |
| stephenfin | dmsimard: Sweet. So, context is we have that oddly named job that only nova seemed to be calling, so I went and moved it to the nova repo | 15:17 |
| *** edmondsw has quit IRC | 15:18 | |
| stephenfin | I've been rooting through the project-config repo to find out what it actually does (the description field will be a godsend going forward) and I think I might have got things slightly wrong | 15:18 |
| stephenfin | It seems there was some wildcarding going on as part of a broader 'lib-forward-testing' job, per here (old commit) https://github.com/openstack-infra/project-config/blob/ac96f9543/zuul/layout.yaml#L297-L301 | 15:20 |
| stephenfin | dmsimard: I'm not sure yet how that '{name}' attribute get's populated, but I assume that anything that was running that 'lib-forward-testing' job was running this with name=oslo.config? | 15:21 |
| stephenfin | Or at least _someone_ other than nova would have this job running | 15:22 |
| dmsimard | stephenfin: ok, give me a few | 15:23 |
| pabelanger | Just running into town this morning for an errand. Should be back online in 90mins or so | 15:23 |
| *** mat128 has joined #openstack-infra | 15:23 | |
| *** thorst has joined #openstack-infra | 15:24 | |
| *** rbrndt has joined #openstack-infra | 15:24 | |
| *** yamamoto has joined #openstack-infra | 15:25 | |
| *** yamamoto has quit IRC | 15:25 | |
| *** martinkopec has quit IRC | 15:26 | |
| *** esberglu_ has joined #openstack-infra | 15:27 | |
| *** snapiri has quit IRC | 15:27 | |
| *** CrayZee has joined #openstack-infra | 15:28 | |
| *** thorst has quit IRC | 15:29 | |
| *** esberglu has quit IRC | 15:29 | |
| *** martinkopec has joined #openstack-infra | 15:30 | |
| *** armax has joined #openstack-infra | 15:30 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 15:33 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 15:33 |
| *** wolverineav has quit IRC | 15:34 | |
| *** jamesmcarthur has quit IRC | 15:35 | |
| *** wolverineav has joined #openstack-infra | 15:36 | |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-specs master: Add a spec for top-level project hosting https://review.openstack.org/524024 | 15:38 |
| AJaeger_ | stephenfin: lib-forward-testing was not run on nova. | 15:38 |
| *** ramishra has quit IRC | 15:38 | |
| AJaeger_ | I see that gate-tempest-dsvm-neutron-src-oslo.versionedobjects-ubuntu-xenial was run on nova | 15:38 |
| *** adarazs is now known as adarazs_afk | 15:39 | |
| *** jamesmcarthur has joined #openstack-infra | 15:39 | |
| *** apetrich has quit IRC | 15:40 | |
| AJaeger_ | stephenfin: now rereading what you say - and thanks dmsimard for jumping in. It lookes like the idea here is to run nova with oslo.versionedobjects master to find any problems. | 15:41 |
| AJaeger_ | stephenfin: see change https://review.openstack.org/#/c/232672/ for introduction fo it | 15:43 |
| * AJaeger_ disappears again | 15:43 | |
| *** jkilpatr has joined #openstack-infra | 15:44 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove implied playbook extensions https://review.openstack.org/525239 | 15:44 |
| *** hashar has joined #openstack-infra | 15:46 | |
| stephenfin | AJaeger_: Thanks for the info, AJaeger_ :) | 15:46 |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Create a test matrix role https://review.openstack.org/524402 | 15:48 |
| *** hongbin has joined #openstack-infra | 15:48 | |
| *** bhavik1 has joined #openstack-infra | 15:49 | |
| stephenfin | dmsimard, AJaeger_: Ok, so I _guess_ the '{name}' attribute is populated here https://github.com/openstack-infra/project-config/blob/ac96f9543/jenkins/jobs/projects.yaml#L2227-L2238 | 15:50 |
| *** andreas_s has quit IRC | 15:50 | |
| *** sboyron has joined #openstack-infra | 15:51 | |
| stephenfin | Which would mean that the job for oslo.versionedobjects (o.v.o) is run against the o.v.o repo too | 15:51 |
| stephenfin | ...and nova, because that explicitly calls it, but nothing else | 15:51 |
| openstackgerrit | Thierry Carrez proposed openstack/ptgbot master: Rooms are now called Tracks https://review.openstack.org/525169 | 15:51 |
| openstackgerrit | Thierry Carrez proposed openstack/ptgbot master: Specify and load event schedule https://review.openstack.org/525168 | 15:51 |
| *** andreas_s has joined #openstack-infra | 15:51 | |
| stephenfin | So the job should probably live in the o.v.o repo after all and I should just call it from nova | 15:51 |
| stephenfin | actually, it should probably live in central repo seeing as there's nothing specific to o.v.o about it (hence the possibility to wildcard stuff) | 15:52 |
| sshnaidm|rover | cores, pabelanger can you please check pypi mirror? All tripleo jobs fail because can't find python-cinderclient: https://bugs.launchpad.net/tripleo/+bug/1736184 | 15:53 |
| openstack | Launchpad bug 1736184 in tripleo "CI: TripleO jobs fail because not finding pytjon-cinderclient in PyPi mirror" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 15:53 |
| *** slaweq is now known as slaweq_ | 15:53 | |
| jeblair | stephenfin: yes, in jjb, that's how {name} is populated -- when a job-template is attached to a project, it gets the project name. in zuul's layout.yaml, it's similar, {name} is also interpolated when a project-template is attached to a project | 15:53 |
| *** gcb has quit IRC | 15:53 | |
| *** makowals has quit IRC | 15:55 | |
| dmsimard | infra-root: it looks like something's wrong with the tripleo pypi mirror. Works in BHS1 ovh region: http://mirror.bhs1.ovh.openstack.org/pypi/simple/python-cinderclient/ but not in TripleO region: http://mirror.regionone.tripleo-test-cloud-rh1.openstack.org/pypi/simple/python-cinderclient/ | 15:55 |
| dmsimard | Example error: http://logs.openstack.org/28/525228/2/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/d356eb7/job-output.txt.gz#_2017-12-04_15_19_13_434493 | 15:55 |
| *** esberglu_ has quit IRC | 15:56 | |
| *** vhosakot has joined #openstack-infra | 15:56 | |
| *** esberglu has joined #openstack-infra | 15:56 | |
| stephenfin | jeblair: Excellent. Thank you :) | 15:57 |
| fungi | dmsimard: found in dmesg... [Mon Dec 4 13:27:21 2017] *** Cache partition is FULL - Decrease cachesize!!! *** | 15:57 |
| jbryce | jeblair fungi clarkb: thanks for the help getting the new mailman server up on friday. when it came up, mailman wouldn't start because it didn't have a sitelist configured. i added a list ("mailman") and then the service started fine. wondering if that should get noted somewhere or get plugged back into the manifest or something? i know we don't create a lot of mailman servers, but just didn't want that final | 15:57 |
| jbryce | step to get lost | 15:57 |
| *** trown is now known as trown|brb | 15:58 | |
| stephenfin | In that case, I'll drop that job from the nova patch as it should probably stay central. It seems pretty general-purpose | 15:58 |
| *** david-lyle has quit IRC | 15:58 | |
| fungi | jbryce: it's almost certainly a missing bit in our configuration management, yes. thanks for pointing that out! i'll get it added | 15:58 |
| *** makowals has joined #openstack-infra | 15:58 | |
| *** david-lyle has joined #openstack-infra | 15:59 | |
| fungi | proof that we haven't bootstrapped a new mailman server from that in a long time (if ever?) | 15:59 |
| jbryce | well if that's the only piece missing, it wasn't too far off = ) | 15:59 |
| stephenfin | Though the comments in the commit that added the test suggests it should probably be removed now, given that neutron is now the default | 15:59 |
| stephenfin | https://github.com/openstack-infra/project-config/commit/c64b7819ca56715ea0a4b2dd215e7a1bec8db239 | 15:59 |
| stephenfin | s/test/job | 15:59 |
| *** slaweq_ has quit IRC | 16:00 | |
| *** yamamoto has joined #openstack-infra | 16:00 | |
| *** andreas_s has quit IRC | 16:00 | |
| fungi | jbryce: it wasn't the only missing piece, i also had to adjust some puppet resource dependency ordering between the apache service and enabling apache modules... but yes very close i agree | 16:00 |
| *** andreas_s has joined #openstack-infra | 16:01 | |
| jeblair | jbryce, fungi: oh, thanks! we'll be making more mailman sites soon (if not servers) -- i'm planning on starting work on that this week, i'll see if i can't figure out a way to solve that in puppet automatically | 16:01 |
| jbryce | fungi: oh right. i saw that. | 16:01 |
| *** sdague has joined #openstack-infra | 16:01 | |
| jeblair | fungi: do you have pending changes related to that i should review / include in the work i'm about to start? | 16:01 |
| dmsimard | fungi: thanks -- so out of disk space ? | 16:01 |
| jbryce | jeblair: i just ran this and then killed and restarted mailman service: sudo /var/lib/mailman/bin/newlist mailman; sudo /var/lib/mailman/bin/config_list -i /var/lib/mailman/data/sitelist.cfg mailman | 16:01 |
| jeblair | jbryce: thanks | 16:02 |
| fungi | jeblair: nah, we got the apache ordering fix merged quickly (single core review, but it's the most recent commit in puppet-mailman if you want to look it over). basically copied the dependency ordering fix i had previously applied for similar issues in puppet-mediawiki | 16:02 |
| jeblair | fungi: sounds good, thx | 16:02 |
| *** armaan has quit IRC | 16:02 | |
| jbryce | jeblair: it was an interactive command that needed a couple of parameters which i'm sure could be passed in (mostly list owner email address i believe) | 16:03 |
| *** slaweq_ has joined #openstack-infra | 16:03 | |
| *** armaan has joined #openstack-infra | 16:03 | |
| jeblair | jbryce: yeah, i'm wondering if the normal puppet mailing list construct can handle that. that'll probably be the first thing i try. | 16:04 |
| jbryce | jeblair, fungi: while we're talking about these things, i had a question on irc logging. for new project channels do you think a separate eavesdrop server would be necessary or do you think just dropping them into the existing structure works? i see #zuul is there already for instance | 16:05 |
| fungi | dmsimard: yeah, rootfs on that vm is 99gb in size and 98% full. it has no other local block devices | 16:05 |
| *** bhavik1 has quit IRC | 16:06 | |
| dmsimard | fungi: anything obvious standing out ? logs ? does it have less disk than other mirrors ? | 16:06 |
| *** jkilpatr has quit IRC | 16:07 | |
| *** trown|brb is now known as trown | 16:07 | |
| fungi | dmsimard: well, we use cinder elsewhere but that's not an option in tripleo-test-cloud-rh1 afaik | 16:07 |
| *** jkilpatr has joined #openstack-infra | 16:07 | |
| fungi | dmsimard: i'm currently attempting to find where most of the utilization lies | 16:07 |
| jeblair | jbryce, fungi: i think in the long run, we probably want to add vhosts to eavesdrop.o.o. and we need to add another logging bot account for another reason anyway -- our current one is close to or at the maximum number of channels it can reside in. but for now, i was thinking the branding impact of the irc log server was not as substantial so did not include it in my first pass of services to update. | 16:07 |
| *** slaweq_ has quit IRC | 16:08 | |
| fungi | jeblair: i did an inventory when we readded the diversity wg's channel, and yeah we're about 10 channels shy of filling it up | 16:08 |
| fungi | as of last week i think | 16:08 |
| *** armaan has quit IRC | 16:09 | |
| *** ramishra has joined #openstack-infra | 16:09 | |
| *** dbecker has quit IRC | 16:09 | |
| *** mriedem has joined #openstack-infra | 16:09 | |
| fungi | jeblair: and i agree, trivial enough to do name-based virtual hosting for multiple meetbots so the logs can be presented from different domain names. hardest part is going to be making the puppet-meetbot module handle multiple bots i expect | 16:09 |
| dmsimard | fungi: ok let me know if I can help, this is impacting all jobs in the check-tripleo pipeline. | 16:12 |
| mordred | jeblair: speaking of irc channels - once a channel is retired, we should remove it from accessbot too, yeah? | 16:12 |
| *** CrayZee has quit IRC | 16:12 | |
| jeblair | mordred: optional, i'd say (it doesn't have the channel count limit). if you think openstack irc ops may need to do something to it in the future, maybe leave it in? if you want to completely forget about it forever, maybe drop it? | 16:14 |
| mordred | jeblair: kk. thanks | 16:14 |
| mordred | jeblair: mostly wanted to make sure we weren't eating available channel limit needlessly | 16:14 |
| jeblair | ++ | 16:14 |
| fungi | the only real impact from accessbot perspective is as that list grows ever longer it will take longer for it to iterate through checking all the channels | 16:15 |
| *** sboyron has quit IRC | 16:15 | |
| fungi | but i doubt we'd ever reach a point where we have enough retired channels as a significant proportion of active channels for that to be worth addressing | 16:15 |
| jbryce | well i will go ahead and add #kata-dev for now and if i get any time i'll try to look at the puppet piece to see if i can move the multiple meetbot set up forward | 16:17 |
| *** CrayZee has joined #openstack-infra | 16:17 | |
| fungi | jbryce: sounds great--thanks! | 16:20 |
| *** yamamoto has quit IRC | 16:22 | |
| *** slaweq_ has joined #openstack-infra | 16:25 | |
| *** dizquierdo has quit IRC | 16:26 | |
| *** edmondsw has joined #openstack-infra | 16:26 | |
| stephenfin | jeblair: You said {name} is interpolated when the project is attached to a project. I assume that's via the ZUUL_SHORT_PROJECT_NAME attribute? | 16:26 |
| fungi | dmsimard: a little slow-going, but i've tracked it down to being split about half in afs cache and half in the apache proxy cache | 16:27 |
| stephenfin | *when the project-template is attached | 16:27 |
| jeblair | stephenfin: yes, in zuul it's the short name. in jjb it's whatever the project name is, but we only used the short names in jjb | 16:27 |
| dmsimard | fungi: ok, thanks for the update! | 16:27 |
| *** camunoz has joined #openstack-infra | 16:27 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add ansible-role-k8s-glance to zuul.d https://review.openstack.org/524131 | 16:28 |
| *** thorst has joined #openstack-infra | 16:28 | |
| stephenfin | jeblair: Perfect. So if I'm calling a job from another project then that wouldn't be correct. Is there a pattern to overriding it in that case? | 16:29 |
| jeblair | stephenfin: in zuulv2, you would just not use the project template and actually spell out the job name. (none of this applied to v3) | 16:29 |
| openstackgerrit | Jonathan Bryce proposed openstack-infra/system-config master: Enable logging on #kata-dev https://review.openstack.org/525246 | 16:29 |
| jeblair | s/applied/applies/ | 16:30 |
| *** wolverineav has quit IRC | 16:30 | |
| fungi | dmsimard: utilization seems roughly on par with that of mirror.iad.rax, except that we have separate cinder volumes for /var/cache/apache2 and /var/cache/openafs there | 16:31 |
| stephenfin | jeblair: And for zuulv3? I think I want to call the 'tempest-dsvm-neutron-src' test but if I do so from nova, I assume ZUUL_SHORT_PROJECT_NAME will be set to nova instead of oslo.versionedobjects https://github.com/openstack-infra/openstack-zuul-jobs/blob/master/playbooks/legacy/tempest-dsvm-neutron-src/run.yaml#L38 | 16:31 |
| *** caphrim007 has joined #openstack-infra | 16:31 | |
| fungi | dmsimard: i think the hope was that the variety of jobs on the tripleo cloud was substantially lower such that it would have less to cache... and i suppose that was true for a while anyway but now we've just reached the limit. we can temporarily expire some stuff on it, but likely need to rebuild it with a bigger rootfs | 16:32 |
| dmsimard | fungi: hopefully the rh1 cloud days are counted | 16:32 |
| *** martinkopec has quit IRC | 16:33 | |
| *** ramishra has quit IRC | 16:33 | |
| stephenfin | Though I've no idea how it's being set correctly for the specific o.v.o job right now when run by nova. Maybe a bug? https://github.com/openstack-infra/openstack-zuul-jobs/blob/master/playbooks/legacy/tempest-dsvm-neutron-src-oslo.versionedobjects/run.yaml#L39 | 16:33 |
| *** armax has quit IRC | 16:33 | |
| *** thorst has quit IRC | 16:33 | |
| *** armax has joined #openstack-infra | 16:34 | |
| fungi | dmsimard: there's an htcacheclean running since ~1.5 hours ago which i think is taking up some of the slack, but i guess we outstrip it now betwee runs | 16:34 |
| fungi | er, between | 16:34 |
| *** martinkopec has joined #openstack-infra | 16:34 | |
| clarkb | fungi: we've had this problem before and I thought the way we were addressing it was to clean to half our cache space | 16:35 |
| clarkb | fungi: does the htcacheclean command show you what it is trying to clean down to? I THink it is part of the command line | 16:35 |
| fungi | 40960M | 16:35 |
| fungi | so basically 40gib | 16:35 |
| mordred | stephenfin: so - the autoconverted legacy jobs are a bit weird, in that we set a bunch of legacy ZUUL_ vars and other things | 16:36 |
| *** caphrim007 has quit IRC | 16:36 | |
| clarkb | fungi: ok so that is working as expected, but still not keeping up | 16:36 |
| fungi | it's been running for over 1.5 hours, so yeah takes some time to clear out | 16:37 |
| *** caphrim007 has joined #openstack-infra | 16:38 | |
| *** caphrim007 has quit IRC | 16:38 | |
| mordred | stephenfin: but it kind of depends on the job content and what it's designed to do - in the case of legacy-tempest-dsvm-neutron-src, it's already designed to be triggered by multiple different projects | 16:38 |
| clarkb | infra-root, it would be great to schedule the virtual sprint to upgrade our control plane during tomorrow's meeting. If you get a chance today or before the meeting can you fill in https://ethercalc.openstack.org/mz3gyl7kn62d if you plan to participate? | 16:38 |
| *** caphrim007 has joined #openstack-infra | 16:38 | |
| *** slaweq_ has quit IRC | 16:40 | |
| stephenfin | mordred: Right. My understanding of this now is that previously got the 'tempest-dsvm-neutron-src-{name}' job and that was run for most of the libraries, which subbed in the library name for {name} | 16:40 |
| fungi | /var/cache/apache2 currently has 45858mb in it according to du, so htcacheclean has at least another 5gb to delete still | 16:41 |
| clarkb | fungi: what is using the other 50GB? | 16:41 |
| stephenfin | and then you'd some special cases like nova which called the tests explicitly (tempest-dsvm-neutron-src-oslo.versionedobjects in this case) | 16:41 |
| stephenfin | Those special cases have become multiple separate jobs as part of the migration. I'm wondering if we can remove the separate jobs and unify on one again | 16:42 |
| fungi | clarkb: afs | 16:42 |
| mordred | stephenfin: yes. very much so - and I think working towards doing that would be *way* more better | 16:42 |
| *** myoung|ruck is now known as myoung|ruck|bbl | 16:42 | |
| clarkb | fungi: nice | 16:43 |
| clarkb | fungi: so I think afs consuming disk like that is potentially a new behavior | 16:43 |
| fungi | clarkb: the mirror instance in the tripleo cloud just has a single 100gb filesystem as its rootfs, and no cinder support there if memory serves. so aside from limping it along it would need a rebuild with a larger flavor i expect | 16:43 |
| *** gyee has joined #openstack-infra | 16:43 | |
| stephenfin | mordred: I fear this is where you tell me they'd have to be rewritten as zuulv3 jobs to do that though, heh | 16:43 |
| clarkb | fungi: afs was using only a couple gigabytes in the past iirc | 16:43 |
| *** jpena is now known as jpena|brb | 16:43 | |
| stephenfin | zuulv3-native, even | 16:43 |
| clarkb | might be worth checking up on what changed there | 16:43 |
| clarkb | but ya if valid caching in afs then probably bigger flavor is the option | 16:43 |
| fungi | clarkb: we upped the max cache size when we added cinder volumes everywhere else | 16:43 |
| fungi | but the mirror in the tripleo cloud wasn't caching nearly as much variety of data at the time and we knew it would be going away, so decided to ignore it rather than rebuild | 16:44 |
| *** danpawlik_ has quit IRC | 16:45 | |
| mordred | stephenfin: yup! http://git.openstack.org/cgit/openstack/python-openstackclient/tree/.zuul.yaml#n151 is a good example of a devstack job used for openstackclient integratoin testing to cross-test openstackclient's functional tests with other repos and that can be (and is) used/triggered by other repos | 16:46 |
| *** danpawlik_ has joined #openstack-infra | 16:46 | |
| openstackgerrit | Luigi Toscano proposed openstack-infra/openstack-zuul-jobs master: Add heat-tempest-plugin to PROJECTS, required by heat https://review.openstack.org/525251 | 16:47 |
| *** yamamoto has joined #openstack-infra | 16:51 | |
| clarkb | as a heads up apparently today is kids dentist day so I will be popping out for a few hours in a bit | 16:52 |
| eumel8 | clarkb: just to mention, translate-dev update was sucessful in the morning. 4.3.1 is running and currently we test it during the week. | 16:52 |
| clarkb | eumel8: ya I saw ianw mentioned it was done and seemed to be working. Let me know how the testing goes btu that is exciting | 16:53 |
| clarkb | mriedem: dmsimard did we get anywhere with that nova libguestfs thing? | 16:53 |
| *** adarazs_afk is now known as adarazs | 16:53 | |
| mriedem | clarkb: i was still seeing the failure in the centos job even once force_tcg was fixed | 16:54 |
| eumel8 | clarkb: its is. if you have time for review & merge: https://review.openstack.org/#/c/525048/ I adjusted the admin list on both server | 16:54 |
| mriedem | https://review.openstack.org/#/c/524750/ | 16:54 |
| clarkb | mriedem: interesting so possibly not entirely virt related | 16:54 |
| mriedem | clarkb: i suspect eventlet | 16:54 |
| dmsimard | mriedem, clarkb: I added a comment in https://review.openstack.org/#/c/524748/ | 16:56 |
| *** esberglu has quit IRC | 16:56 | |
| dmsimard | I also did a recheck in https://review.openstack.org/#/c/524750/ | 16:56 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] split playbooks https://review.openstack.org/525252 | 16:56 |
| dmsimard | it seems like the fix generates a new problem | 16:56 |
| dmsimard | brb | 16:56 |
| clarkb | dmsimard: the best kind of fix | 16:57 |
| *** jascott1 has joined #openstack-infra | 16:57 | |
| *** esberglu has joined #openstack-infra | 16:58 | |
| *** artom has joined #openstack-infra | 16:58 | |
| mriedem | dmsimard: those are just the same tests failing for i think the same reason yes? | 16:58 |
| mriedem | did you check the n-cpu logs? | 16:58 |
| mriedem | when i looked on friday, things were still failing the same way, but the force_tcg backend setting was applied correctly | 16:58 |
| artom | So https://github.com/openstack/nova-specs seems stale | 16:58 |
| mriedem | clarkb answered in -nova, known issue | 16:59 |
| *** jkilpatr has quit IRC | 17:00 | |
| *** kmalloc has joined #openstack-infra | 17:01 | |
| *** yamamoto has quit IRC | 17:01 | |
| *** nhicher has quit IRC | 17:01 | |
| *** kjackal_ has quit IRC | 17:01 | |
| *** kjackal has quit IRC | 17:01 | |
| *** slaweq_ has joined #openstack-infra | 17:02 | |
| *** thorst has joined #openstack-infra | 17:02 | |
| openstackgerrit | Stephen Finucane proposed openstack-infra/openstack-zuul-jobs master: Remove legacy jobs in nova https://review.openstack.org/514310 | 17:05 |
| openstackgerrit | Stephen Finucane proposed openstack-infra/project-config master: Remove legacy jobs in nova https://review.openstack.org/514311 | 17:05 |
| *** slaweq_ has quit IRC | 17:06 | |
| fungi | infra-root: anybody know who manually started a `htcacheclean -l300M` on the tripleo mirror back on wednesday? | 17:06 |
| clarkb | not I | 17:06 |
| *** jascott1 has quit IRC | 17:07 | |
| fungi | infra-root: nevermind, i think this is the built-in one since it's for a different path | 17:07 |
| *** wolverineav has joined #openstack-infra | 17:07 | |
| fungi | interesting that it doesn't terminate even though that path is empty | 17:09 |
| *** slaweq_ has joined #openstack-infra | 17:09 | |
| stephenfin | mordred: I cheated a put a big TODO in the code. Writing a zuulv3-native job is a step to far for today, heh https://review.openstack.org/514310 | 17:09 |
| stephenfin | *and put | 17:09 |
| *** felipemonteiro_ has quit IRC | 17:09 | |
| mordred | stephenfin: :) fair - there's a good amount of the work already done so far that andreaf has been driving, so once you get around to it it's certainly not going to be writing one from scratch :) | 17:10 |
| *** nhicher has joined #openstack-infra | 17:10 | |
| *** nhicher has quit IRC | 17:12 | |
| *** nhicher has joined #openstack-infra | 17:12 | |
| *** dizquierdo has joined #openstack-infra | 17:13 | |
| *** slaweq_ has quit IRC | 17:14 | |
| *** andreas_s has quit IRC | 17:14 | |
| *** andreas_s has joined #openstack-infra | 17:14 | |
| pabelanger | back, catching up on backscroll | 17:15 |
| clarkb | fungi: you've been doing sb migration stuff, when you get a chance I think https://review.openstack.org/523937 will interest you (fixes some doc bugs around adding stuff to sb) | 17:15 |
| *** kjackal has joined #openstack-infra | 17:15 | |
| *** kjackal_ has joined #openstack-infra | 17:15 | |
| *** slaweq_ has joined #openstack-infra | 17:15 | |
| pabelanger | fungi: yah, the htcacheclean -l300M is the default settings from apache. We likey can update puppet for the mirror to either remove it or colapse our crontab clean into it | 17:17 |
| mordred | infra-root: just landed the last python-*client removal patch in shade - as of the next release there will no longer be any python-*client depends. it's worth noting because shade *was* pulling in python-openstackclient as a transitive depend before | 17:17 |
| *** udesale has quit IRC | 17:17 | |
| pabelanger | mordred: woot | 17:18 |
| tosky | mordred: yay! | 17:19 |
| clarkb | sshnaidm|rover: I checked log processor logs and the errors.txt files do show up. The problem is this http://logs.openstack.org/96/525196/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/92fb3a3/logs/subnode-2/var/log/extra/errors.txt.gz?level=INFO using the level selection results in an empty file. If you drop the ?level=INFO you get the data | 17:19 |
| clarkb | sshnaidm|rover: and the log processors all pull using level=INFO | 17:20 |
| openstackgerrit | John L. Villalovos proposed openstack-infra/irc-meetings master: Move ironic-bare-metal meeting to the #openstack-ironic channel https://review.openstack.org/525259 | 17:20 |
| *** slaweq_ has quit IRC | 17:20 | |
| dmsimard | mordred: that's pretty awesome | 17:20 |
| clarkb | sshnaidm|rover: so we'll need to teach os-loganalyze to treat that file properly or something | 17:20 |
| *** tesseract has quit IRC | 17:20 | |
| mordred | dmsimard: ++ | 17:21 |
| openstackgerrit | John L. Villalovos proposed openstack-infra/irc-meetings master: Move ironic-bare-metal meeting to the #openstack-ironic channel https://review.openstack.org/525259 | 17:21 |
| *** andreas_s has quit IRC | 17:23 | |
| dmsimard | mriedem, clarkb: I don't think we're seeing the same errors with the new patch, no -- we're seeing many more tempest failures, and outside of OVH, too. | 17:24 |
| *** jpena|brb is now known as jpena | 17:25 | |
| dmsimard | before the fix, we had ~8 failures on OVH, now we're seeing ~74 outside of OVH | 17:25 |
| mriedem | ok, i'm not in a place to dig into this right now | 17:25 |
| dmsimard | before: http://logs.openstack.org/46/523646/1/check/legacy-tempest-dsvm-neutron-full-centos-7/5bf092c/job-output.txt#_2017-11-29_03_02_38_031436 | 17:25 |
| mriedem | suggest hitting up kashyap in -nova | 17:26 |
| dmsimard | after: http://logs.openstack.org/50/524750/1/check/legacy-tempest-dsvm-neutron-full-centos-7/a7f051e/job-output.txt.gz#_2017-12-04_15_25_13_211317 | 17:26 |
| *** rlandy is now known as rlandy|brb | 17:26 | |
| dmsimard | mriedem: ok, I'll head there, thanks | 17:26 |
| *** slaweq_ has joined #openstack-infra | 17:26 | |
| fungi | pabelanger: dmsimard: i've freed up a few gb of headroom on the mirror and restarted the openafs-client service, but ls says the /afs/openstack.org/mirror/pypi/web/simple/p/python-cinderclient directory doesn't exist... not sure what additional steps are needed to get it to reevaluate that | 17:27 |
| fungi | from mirror.iad.rax i can see the index.html file in that directory, but from mirror.regionone.tripleo-test-cloud-rh1 i get "cannot access ... No such file or directory" | 17:28 |
| fungi | jeblair: mordred: ^ any idea what else is needed to get openafs-client back on track there? | 17:29 |
| *** slaweq_ has quit IRC | 17:31 | |
| fungi | stop openafs-client, unload and reload the openafs lkm, and then start the service again? | 17:32 |
| pabelanger | fungi: I think I had to use fs flushvolme on the pypi directory | 17:32 |
| pabelanger | let me check | 17:32 |
| *** dsariel has quit IRC | 17:32 | |
| *** jamesmcarthur has quit IRC | 17:34 | |
| *** dbecker has joined #openstack-infra | 17:34 | |
| *** jamesmcarthur has joined #openstack-infra | 17:34 | |
| clarkb | elasticsearch and logstash worker disk usage continues to look happy so I think we have indeed largely corrected the major issues there | 17:34 |
| pabelanger | fungi: yah, I did: | 17:35 |
| pabelanger | fs flushvolume /afs/openstack.org/mirror/pypi/ | 17:35 |
| pabelanger | fs flushvolume /afs/openstack.org/mirror/pypi/web/packages/f4/ | 17:35 |
| pabelanger | last time there was cache issues on tripleo mirror | 17:35 |
| fungi | why packages/f4? was there a specific package you were clearing there? | 17:35 |
| pabelanger | fungi: yah | 17:35 |
| fungi | so we basically need to play whack-a-mole with any files missing from the cache as identified from subsequent failing job logs? | 17:36 |
| dmsimard | er, the first command wouldn't repopulate everything ? | 17:37 |
| *** andreas_s has joined #openstack-infra | 17:37 | |
| dmsimard | there can be any number of missing packages :/ | 17:37 |
| fungi | the first command did indeed get http://mirror.regionone.tripleo-test-cloud-rh1.openstack.org/pypi/simple/python-cinderclient/ loading for me again, at least | 17:37 |
| *** ralonsoh has quit IRC | 17:38 | |
| fungi | likely at the expense of making the entire pypi mirror cache cold in tripleo cloud | 17:38 |
| pabelanger | http://docs.openafs.org/Reference/1/fs_flushvolume.html | 17:38 |
| jeblair | fungi, dmsimard: yes, that's how i read the docs. pabelanger, i don't know why a second command would be necessary. | 17:38 |
| pabelanger | looks like there is a way to flush all data in working directory | 17:38 |
| pabelanger | jeblair: yah, it is possible I didn't use it correctly | 17:38 |
| jeblair | pabelanger: any chance you used "fs flush" instead of "fs flushvolume" ? | 17:39 |
| jeblair | fungi: i missed what happened to cause the problem | 17:39 |
| dmsimard | fungi: great, we'll run a round a recheck and let you know if it seems to have resolved it, thanks ! | 17:39 |
| jeblair | fungi: oh, wait, i think i see the history in scrollback | 17:40 |
| *** rlandy|brb is now known as rlandy | 17:40 | |
| pabelanger | jeblair: fs flushvolume according to history on tripleo-test-cloud-rh1 mirror | 17:40 |
| fungi | jeblair: limited rootfs on that instance housing the caches for afs and apache, and they eventually filled up the rootfs because htcacheclean wasn't keeping up with the churn | 17:40 |
| pabelanger | this was a while ago | 17:40 |
| *** thorst_ has joined #openstack-infra | 17:41 | |
| fungi | likely partly due to slow i/o for that rootfs too making htcacheclean take a very long time to complete | 17:41 |
| *** slaweq_ has joined #openstack-infra | 17:42 | |
| fungi | it's set to trigger at the start of each hour but taking over 2 hours to run | 17:42 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - zuul/tripleo-ci-dsvm: remove required-projects https://review.openstack.org/525265 | 17:42 |
| fungi | and apparently tripleo jobs want more than 40gb of space in the apache proxy cache | 17:42 |
| *** thorst has quit IRC | 17:44 | |
| fungi | we can't add more space so the options are: 1. reduce cache sizes across all our mirrors, 2. adjust our config management so we can reduce cache sizes just for this server, 3. rebuild the server with a flavor allocating a larger rootfs, 4. wait for this cloud to go away ("rsn" supposedly) | 17:44 |
| *** andreas_s has quit IRC | 17:46 | |
| *** kjackal_ has quit IRC | 17:46 | |
| *** kjackal has quit IRC | 17:46 | |
| *** andreas_s has joined #openstack-infra | 17:46 | |
| *** slaweq_ has quit IRC | 17:47 | |
| pabelanger | fungi: 4, then 1 would be my vote. This server shouldn't be around much longer as I understand it | 17:47 |
| clarkb | #status log cleaned out old unused crm114 data dirs on logstash worker nodes using `sudo find /var/lib/crm114 -mtime +7 -delete` as recent changes to crm114 scripts mean we've collapsed those data dirs into a much smaller set at different paths ignoring the old data. | 17:49 |
| *** felipemonteiro has joined #openstack-infra | 17:49 | |
| clarkb | I noticed that ^ was needed when checking disk usage on the logstash workers | 17:49 |
| *** lucasagomes is now known as lucas-afk | 17:49 | |
| sshnaidm|rover | clarkb, hmm.. didn't know about this levelINFO thing | 17:49 |
| clarkb | basically the old paths we were using would never be touched anymore and were consuming non zero disk space so I cleaned thenm out | 17:49 |
| *** Hal has quit IRC | 17:49 | |
| *** armax has quit IRC | 17:49 | |
| clarkb | sshnaidm|rover: we don't index DEBUG because the data set is too large so we use that level=INFO option to filter out debug early | 17:50 |
| *** felipemonteiro_ has joined #openstack-infra | 17:50 | |
| sshnaidm|rover | clarkb, what if I'll prepend all lines with "ERROR" prefix right after a timestamp | 17:50 |
| clarkb | I'm not identified as of last night is that why status log didn't work? | 17:50 |
| clarkb | #status log cleaned out old unused crm114 data dirs on logstash worker nodes using `sudo find /var/lib/crm114 -mtime +7 -delete` as recent changes to crm114 scripts mean we've collapsed those data dirs into a much smaller set at different paths ignoring the old data. | 17:51 |
| openstackstatus | clarkb: finished logging | 17:51 |
| *** jkilpatr has joined #openstack-infra | 17:51 | |
| *** thorst_ has quit IRC | 17:51 | |
| clarkb | sshnaidm|rover: the level is already in there which is what I think is confusing os-loganalyze, you'll need to look at that tool to see how to unconfuse it though | 17:51 |
| clarkb | sshnaidm|rover: it may be the it is detecting the file format but then the file name isn't in the whitelist? in which case maybe we should drop the whitelist entirely? I don't know | 17:52 |
| sshnaidm|rover | clarkb, yeah, I think it expects for log prefix right after a timestamp, and I have there log name.. | 17:52 |
| clarkb | sshnaidm|rover: there are tests with real log files in the repo too which could be manipulated to reproduce this locally | 17:53 |
| clarkb | that may be the easiest way to check | 17:53 |
| fungi | #status log Manually pruned some larger Apache cache entries and flushed the pypi volume cache on mirror.regionone.tripleo-test-cloud-rh1.openstack.org following a full root filesystem event | 17:53 |
| openstackstatus | fungi: finished logging | 17:53 |
| *** felipemonteiro has quit IRC | 17:54 | |
| *** armax has joined #openstack-infra | 17:54 | |
| sshnaidm|rover | clarkb, thanks, will check it | 17:54 |
| *** Apoorva has joined #openstack-infra | 17:55 | |
| *** jamesmcarthur has quit IRC | 17:56 | |
| *** andreas_s has quit IRC | 18:00 | |
| *** trown is now known as trown|lunch | 18:00 | |
| clarkb | ok I've got to pop out now to shuttle the kids to and from the dentist. I'll be back in the afternoon | 18:01 |
| dmsimard | jeblair: o/ | 18:02 |
| *** thorst has joined #openstack-infra | 18:02 | |
| jeblair | dmsimard: doesn't tripleo use zuul? | 18:03 |
| clarkb | before I go the other thing I noticed on crm114 front was devstacklog_txt_2017-12-04-162513_summary is a file pattern we will need to collapse further | 18:03 |
| dmsimard | jeblair: it does, in OpenStack and in RDO, however there are two other environments that run third-party CI that are pure jenkins. | 18:04 |
| *** martinkopec has quit IRC | 18:04 | |
| *** ihrachys has joined #openstack-infra | 18:04 | |
| dmsimard | They trigger off the Jenkins gerrit trigger plugin. | 18:04 |
| *** slaweq_ has joined #openstack-infra | 18:04 | |
| *** jamesmcarthur has joined #openstack-infra | 18:04 | |
| dmsimard | For that reason, TripleO wrote something that would allow jobs that'd run from Jenkins to check out Depended-on patches | 18:04 |
| *** hashar is now known as hasharAway | 18:05 | |
| jeblair | dmsimard: we're going to change the syntax of depends-on very soon. it would be good to start work on replacing those jenkins systems with zuul asap. | 18:06 |
| dmsimard | If only it was that easy :) | 18:06 |
| *** thorst has quit IRC | 18:07 | |
| dmsimard | I get what you're saying btw, I'm the first who would be happy to have Zuul everywhere but there's politics and other things in the way. | 18:08 |
| *** dtantsur is now known as dtantsur|afk | 18:08 | |
| *** jamesmcarthur has quit IRC | 18:08 | |
| *** slaweq_ has quit IRC | 18:09 | |
| *** jamesmcarthur has joined #openstack-infra | 18:09 | |
| jeblair | dmsimard: well, i'm happy for any third-party ci folks to join us in working on zuul. but, of course, it's not a requirement that third-party ci's reporting on openstack projects run zuul. | 18:10 |
| pabelanger | infra-root: I'd like to start working on zookeeper replacement servers, if you have time to add https://review.openstack.org/524267/ to your review pipeline. The idea would be to launch new zk cluster, then join nodepool.o.o, ensure data is good, then update everything to use it. Then we can take nodepool.o.o offline | 18:11 |
| jeblair | dmsimard: however, zuul is the ci system for official openstack projects such as tripleo. to the extent that zuul runs tripleo jobs, we should ensure they are using zuul correctly. that means letting zuul set up the git repos. | 18:12 |
| *** slaweq_ has joined #openstack-infra | 18:13 | |
| jeblair | dmsimard: it is unclear to me at this point whether we're discussing openstack's zuul running on tripleo or not. | 18:13 |
| *** e0ne has quit IRC | 18:13 | |
| *** apetrich has joined #openstack-infra | 18:14 | |
| *** thorst has joined #openstack-infra | 18:15 | |
| jeblair | (i'm confused how we got from zuul-cloner (which suggests the presense of a zuul) to a tool that independently parses depends-on) | 18:17 |
| *** slaweq_ has quit IRC | 18:17 | |
| *** rbrndt has quit IRC | 18:18 | |
| *** jamesmcarthur has quit IRC | 18:19 | |
| *** mriedem has quit IRC | 18:19 | |
| dmsimard | jeblair: We were discussing the long list of required-projects and how the vast majority of those were not necessary unless zuul-cloner was involved, which was later found to not be involved and instead relied on this part of code which independently retrieves the depends-on in order to work outside of a Zuul environment | 18:19 |
| dmsimard | I'm admittedly not very familiar with these bits in the first place so I went off on a wrong assumption to begin with | 18:19 |
| *** Mutter has joined #openstack-infra | 18:20 | |
| *** jamesmcarthur has joined #openstack-infra | 18:20 | |
| *** jpena is now known as jpena|away | 18:20 | |
| *** thorst has quit IRC | 18:20 | |
| jeblair | dmsimard: so are the tripleo jobs running in openstack's zuul doing independent depends-on fetching? | 18:22 |
| *** Mutter has quit IRC | 18:22 | |
| dmsimard | EmilienM and I are going to straighten some of that out, he has a WIP patch to see what we really need out of required-projects, on my end I'm going to try and look why TripleO is still running devstack-gate and help with the transition from zuul-cloner to required-projects | 18:22 |
| *** sshnaidm|rover is now known as sshnaidm|off | 18:23 | |
| *** salv-orlando has quit IRC | 18:23 | |
| *** salv-orlando has joined #openstack-infra | 18:24 | |
| *** thorst has joined #openstack-infra | 18:24 | |
| jeblair | dmsimard: just speculating -- devstack-gate used to be the main method of performing multi-repo setup, so its use may very well date back to that, but of course could be replaced with required-projects now. | 18:25 |
| pabelanger | last I looked at DLRN, it had some bits to try and checkout a git based on ZUUL_CHANGES: http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/build-test-packages | 18:26 |
| pabelanger | there is some logic around zuul_deps and jenkins_deps ansible libraries | 18:26 |
| dmsimard | pabelanger: yeah, that's what I'm looking at but I'm not 100% understanding what it does | 18:27 |
| pabelanger | but agree, that code should be disabled in the gate and now just use the repos placed on disk my zuulv3 | 18:27 |
| pabelanger | basically, if they detect a change in ZUUL_CHANGES to nova, lets say, they need to use the git repo to build the package over using the prebuilt from trunk.rdoproject.org | 18:28 |
| pabelanger | but, that's about all I know | 18:28 |
| *** tosky has quit IRC | 18:28 | |
| dmsimard | that's my high level understanding as well | 18:28 |
| *** salv-orlando has quit IRC | 18:28 | |
| dmsimard | While I understand that ideally we'd run zuul everywhere, we don't currently have that luxury -- and I'm torn because while it seems to me that it's a legitimate use case, the way it's done could probably be better | 18:29 |
| jeblair | i think using zuul.items to detect whether a dependency is there and an rpm needs to be built or an existing one can be used is a good idea. | 18:30 |
| *** sambetts is now known as sambetts|afk | 18:30 | |
| dmsimard | and if that var isn't there, fallback git+checkout ? | 18:31 |
| jeblair | dmsimard: well, i'm assuming it can use a prebuilt rpm in that case | 18:31 |
| jeblair | dmsimard: so iiuc, in this case nova would *not* need to be a required project. | 18:31 |
| dmsimard | yeah, it can, if there's no depends-on, nothing of this happens and it installs from latest RDO trunk repositories | 18:31 |
| dmsimard | right | 18:32 |
| jeblair | so you're *either* using pre-built rpm, or you're using zuul-prepared git repo for dependent change to make a new one. never just checking out HEAD. | 18:32 |
| jeblair | detecting that case using zuul.items is a good idea -- that's an anticipated use of that variable | 18:33 |
| dmsimard | needs a bit of work to get there but we can do that. | 18:33 |
| *** Apoorva has quit IRC | 18:33 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config master: Add an openstack/self-healing-sig repository https://review.openstack.org/525270 | 18:34 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config master: Add system-required for openstack/self-healing-sig https://review.openstack.org/525271 | 18:34 |
| *** Apoorva has joined #openstack-infra | 18:34 | |
| *** fultonj has quit IRC | 18:35 | |
| *** jascott1 has joined #openstack-infra | 18:37 | |
| *** fultonj has joined #openstack-infra | 18:37 | |
| *** thorst has quit IRC | 18:38 | |
| *** salv-orlando has joined #openstack-infra | 18:39 | |
| *** thorst has joined #openstack-infra | 18:41 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/project-config master: Add log-classify project https://review.openstack.org/522139 | 18:42 |
| *** thorst has quit IRC | 18:43 | |
| *** aviau has quit IRC | 18:43 | |
| *** rwellum has quit IRC | 18:44 | |
| *** rwellum has joined #openstack-infra | 18:44 | |
| *** jpena|away is now known as jpena|off | 18:48 | |
| *** CrayZee1 has joined #openstack-infra | 18:48 | |
| *** CrayZee1 has quit IRC | 18:48 | |
| *** jpich has quit IRC | 18:48 | |
| *** snapiri has joined #openstack-infra | 18:51 | |
| *** slaweq_ has joined #openstack-infra | 18:52 | |
| *** armax has quit IRC | 18:55 | |
| *** slaweq_ has quit IRC | 18:57 | |
| mhayden | would it make sense to mirror a small set of packages from a COPR (like Fedora/CentOS version of PPA) or use a reverse proxy? trying to figure out what makes the most sense | 18:57 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: WIP: Add finger gateway https://review.openstack.org/525276 | 18:58 |
| dmsimard | mhayden: is that anything RDO can help with perhaps ? | 19:01 |
| *** erlon has joined #openstack-infra | 19:01 | |
| *** raissa has quit IRC | 19:02 | |
| *** sdague has quit IRC | 19:03 | |
| *** tosky has joined #openstack-infra | 19:04 | |
| *** e0ne has joined #openstack-infra | 19:04 | |
| *** fultonj has quit IRC | 19:06 | |
| *** e0ne has quit IRC | 19:08 | |
| *** e0ne has joined #openstack-infra | 19:10 | |
| *** adisky_ has quit IRC | 19:10 | |
| *** snapiri has left #openstack-infra | 19:13 | |
| *** fultonj has joined #openstack-infra | 19:14 | |
| *** andreas_s has joined #openstack-infra | 19:17 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add command socket support to zuul-merger https://review.openstack.org/523197 | 19:17 |
| *** trown|lunch is now known as trown | 19:18 | |
| *** gouthamr has quit IRC | 19:20 | |
| *** rossella_s has joined #openstack-infra | 19:20 | |
| *** rbrndt has joined #openstack-infra | 19:20 | |
| *** ldnunes has quit IRC | 19:20 | |
| *** myoung|ruck|bbl is now known as myoung|ruck | 19:21 | |
| *** auggy has quit IRC | 19:22 | |
| openstackgerrit | Gage Hugo proposed openstack-infra/project-config master: Remove legacy jobs from Keystone https://review.openstack.org/524232 | 19:24 |
| openstackgerrit | Gage Hugo proposed openstack-infra/project-config master: Remove legacy jobs from Keystone https://review.openstack.org/524232 | 19:27 |
| *** armax has joined #openstack-infra | 19:29 | |
| *** liusheng has quit IRC | 19:29 | |
| *** liusheng has joined #openstack-infra | 19:29 | |
| *** rwsu has quit IRC | 19:29 | |
| *** rossella_s has quit IRC | 19:30 | |
| *** slaweq_ has joined #openstack-infra | 19:32 | |
| *** ldnunes has joined #openstack-infra | 19:32 | |
| *** jkilpatr has quit IRC | 19:34 | |
| *** andreas_s has quit IRC | 19:35 | |
| openstackgerrit | Gage Hugo proposed openstack-infra/openstack-zuul-jobs master: Remove legacy jobs in Keystone https://review.openstack.org/524237 | 19:37 |
| *** slaweq_ has quit IRC | 19:37 | |
| *** gouthamr has joined #openstack-infra | 19:37 | |
| *** mriedem has joined #openstack-infra | 19:39 | |
| *** thorst has joined #openstack-infra | 19:42 | |
| mhayden | dmsimard: well, within openstack-ansible we use some LXC packages from thm's COPR repository | 19:42 |
| mhayden | but the fedora infra moves are happening this week | 19:42 |
| mhayden | ;) | 19:43 |
| dmsimard | infra moves ? | 19:43 |
| mhayden | i'm not sure red hat has much of an interest in LXC ;) | 19:43 |
| mhayden | dmsimard: https://status.fedoraproject.org/q4maint.html | 19:43 |
| dmsimard | interesting | 19:43 |
| mhayden | that's a good word for it ;) | 19:43 |
| dmsimard | I don't think a reverse proxy will help if the upstream is down for a week | 19:44 |
| dmsimard | Mirroring a COPR is.. unheard of | 19:44 |
| mhayden | agreed | 19:44 |
| dmsimard | pabelanger: ^ ? | 19:44 |
| mhayden | we could just build the RPM ourselves in the gate -- it's fairly quick, but annoying | 19:45 |
| *** gouthamr has quit IRC | 19:45 | |
| *** andreas_s has joined #openstack-infra | 19:45 | |
| *** dave-mccowan has joined #openstack-infra | 19:45 | |
| openstackgerrit | Jeremy Stanley proposed openstack-dev/pbr master: Support Description-Content-Type metadata https://review.openstack.org/521658 | 19:46 |
| *** artom has quit IRC | 19:47 | |
| pabelanger | dmsimard: mhayden: propose it and lets see, at first glance, I'm not sure we'd want to reverse proxy cache another build system where we can just build them in the gate like you said | 19:48 |
| mhayden | yeah, it's a fairly small RPM, but we have to drag down a bunch of development packages to build it | 19:49 |
| pabelanger | Maybe worth the time now to push on it for fedora, like you said | 19:50 |
| pabelanger | otherwise, people deploying would also need to depend on this COPR repo | 19:51 |
| *** thorst has quit IRC | 19:51 | |
| *** florianf|afk is now known as florianf | 19:55 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - zuul/tripleo-ci-dsvm: remove required-projects https://review.openstack.org/525265 | 19:57 |
| *** e0ne has quit IRC | 19:59 | |
| *** bobh has quit IRC | 19:59 | |
| *** Apoorva has quit IRC | 19:59 | |
| *** slaweq_ has joined #openstack-infra | 20:02 | |
| *** andreas_s has quit IRC | 20:03 | |
| *** armaan has joined #openstack-infra | 20:03 | |
| *** ldnunes has quit IRC | 20:03 | |
| *** thorst has joined #openstack-infra | 20:04 | |
| *** slaweq__ has joined #openstack-infra | 20:05 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Use ansible-playbook in place of quickstart.sh https://review.openstack.org/525294 | 20:06 |
| *** slaweq_ has quit IRC | 20:07 | |
| *** priteau has joined #openstack-infra | 20:08 | |
| *** e0ne has joined #openstack-infra | 20:09 | |
| *** slaweq__ has quit IRC | 20:09 | |
| *** Apoorva has joined #openstack-infra | 20:11 | |
| *** sdague has joined #openstack-infra | 20:12 | |
| *** slaweq__ has joined #openstack-infra | 20:13 | |
| priteau | Hello. For blazar-dashboard jobs, we need to add horizon as a "required-projects" to avoid failures. The dependency was added to all jobs, including pre-release and release jobs that run release-openstack-python-without-pypi. Is it actually useful for this job? | 20:15 |
| priteau | I am asking because I would like to switch to using the "release-openstack-server" template and wondering if I still need to define the dependency | 20:16 |
| *** dhill_ has quit IRC | 20:18 | |
| *** matbu has joined #openstack-infra | 20:22 | |
| *** dhill_ has joined #openstack-infra | 20:23 | |
| *** rwsu has joined #openstack-infra | 20:25 | |
| *** signed8bit has joined #openstack-infra | 20:33 | |
| *** slaweq_ has joined #openstack-infra | 20:33 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Create a test matrix role https://review.openstack.org/524402 | 20:33 |
| *** armaan has quit IRC | 20:34 | |
| mordred | priteau: that's a good question ... I think we should not need it for those - we've rolled out the change to stop using tox for building tarballs, which means the dependency issue shouldn't be a problem | 20:35 |
| *** bobh has joined #openstack-infra | 20:35 | |
| ianw | on the etherpad sprint page, "X" means available? | 20:36 |
| priteau | mordred: Thanks. Is there a way to test the release jobs without actually pushing a new release? | 20:36 |
| *** gouthamr has joined #openstack-infra | 20:36 | |
| ianw | clarkb; want to poke at https://review.openstack.org/#/c/525048/ and i'll apply to translate-dev? | 20:37 |
| mordred | priteau: not at the moment, no - that's a thing that hopefully will get better in the next week or two | 20:37 |
| priteau | Nice, looking forward to it | 20:37 |
| *** slaweq_ has quit IRC | 20:39 | |
| *** slaweq_ has joined #openstack-infra | 20:40 | |
| openstackgerrit | Pierre Riteau proposed openstack-infra/project-config master: Use templates instead of (pre-)release jobs for Blazar repos https://review.openstack.org/525305 | 20:41 |
| *** salv-orlando has quit IRC | 20:43 | |
| *** salv-orlando has joined #openstack-infra | 20:43 | |
| *** salv-orlando has quit IRC | 20:45 | |
| *** salv-orlando has joined #openstack-infra | 20:45 | |
| *** armaan has joined #openstack-infra | 20:45 | |
| *** slaweq_ has quit IRC | 20:45 | |
| pabelanger | ianw: yah, avaiable | 20:46 |
| ianw | pabelanger: and presumably the dates are EST ? | 20:47 |
| pabelanger | ianw: I think they are UTC, I took them from release schedule | 20:47 |
| ianw | well i mean when it will be actually worked on i guess | 20:48 |
| pabelanger | ianw: yah, we have decided on the start times yet | 20:49 |
| clarkb | ok back from dentist run | 20:49 |
| clarkb | ianw: ya taking a look | 20:49 |
| clarkb | ianw: lgtm | 20:50 |
| clarkb | ianw: I didn't approve it as unsure what puppetry state is on dev server | 20:50 |
| ianw | clarkb: both translate & translate-dev were already in emergency | 20:50 |
| ianw | and there they remain :) | 20:50 |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Create a test matrix role https://review.openstack.org/524402 | 20:51 |
| *** jaosorior has quit IRC | 20:51 | |
| *** thorst has quit IRC | 20:56 | |
| clarkb | ianw: do you know if there is any reason to index the devstack summary log if we are already indexing the full devstack log? | 20:56 |
| clarkb | ianw: is the full log a proper superset of the summary log? | 20:56 |
| ianw | umm, that's like echo_summary or something, which pretty sure it goes everywhere ... checking | 20:57 |
| ianw | yeah, it does | 20:58 |
| ianw | so, no need to specifically index the summary file i'd say | 20:58 |
| clarkb | ++ I'll get a patch up to exclude it | 20:58 |
| ianw | what ends up in there has always been a bit arbitrary and weird anyway, i'm not convinced it's that useful | 20:59 |
| ianw | but, historical reasons, i guess :) | 20:59 |
| pabelanger | I'm going to try and bring zk01.o.o online using https://review.openstack.org/524267/ as xenial | 21:00 |
| pabelanger | to see if puppet modules are new enough | 21:00 |
| *** rockyg has joined #openstack-infra | 21:00 | |
| pabelanger | but first, need to step outside for school bus | 21:01 |
| *** thorst has joined #openstack-infra | 21:02 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Create a test matrix role https://review.openstack.org/524402 | 21:03 |
| *** armaan has quit IRC | 21:04 | |
| ianw | infra-root: would anyone mind a poke at https://review.openstack.org/#/c/524456/ (f27 mirror). i'll babysit an update; but this will let me get f27 into dib & do a dib release too | 21:04 |
| mordred | ianw: lgtm | 21:04 |
| *** shardy has quit IRC | 21:05 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add log-classify project https://review.openstack.org/522139 | 21:06 |
| *** thorst has quit IRC | 21:07 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Don't index the devstack summary logs https://review.openstack.org/525310 | 21:07 |
| clarkb | ianw: ^ there is the summary removal change | 21:07 |
| clarkb | ianw: and +2'd the f27 change | 21:08 |
| ianw | thanks, will do that in a little | 21:10 |
| *** slaweq_ has joined #openstack-infra | 21:10 | |
| *** slaweq_ has quit IRC | 21:15 | |
| *** thorst has joined #openstack-infra | 21:17 | |
| clarkb | pabelanger: commented on the zk change, let me know if that makes sense (or doesn't) | 21:18 |
| *** kgiusti has left #openstack-infra | 21:18 | |
| *** nicolasbock has joined #openstack-infra | 21:19 | |
| *** thorst has quit IRC | 21:20 | |
| *** thorst has joined #openstack-infra | 21:21 | |
| *** smatzek has quit IRC | 21:23 | |
| AJaeger_ | fugni, see https://review.openstack.org/#/c/522544/ - there's a sig list already... | 21:23 |
| AJaeger_ | fungi: sorry for the typo ^ | 21:23 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add log-classify project https://review.openstack.org/522139 | 21:25 |
| fungi | AJaeger_: yeah, that's the repo i was saying we'd track it in, but the sigs themselves haven't (yet) been added in there other than the initial meta-sig | 21:26 |
| *** yamahata has joined #openstack-infra | 21:26 | |
| fungi | AJaeger_: soon they'll all get added to http://git.openstack.org/cgit/openstack/governance-sigs/tree/sigs.yaml | 21:26 |
| *** rwsu has quit IRC | 21:29 | |
| AJaeger_ | fungi: I thought https://review.openstack.org/#/c/522544/1/reference/sigs-repos.yaml is the list | 21:29 |
| AJaeger_ | that's how I understood ttx' commit | 21:29 |
| AJaeger_ | fungi, if that is really not the case, let's go ahead and clean up later... | 21:30 |
| *** yamahata has quit IRC | 21:32 | |
| fungi | AJaeger_: ahh, thanks, i'd missed that. still, looks like http://git.openstack.org/cgit/openstack/governance/tree/reference/sigs-repos.yaml doesn't have any entries besides the meta-sig either... i'll try and get some clarification | 21:32 |
| *** jkilpatr has joined #openstack-infra | 21:33 | |
| *** kjackal_ has joined #openstack-infra | 21:34 | |
| *** kjackal has joined #openstack-infra | 21:34 | |
| AJaeger_ | fungi, your repo is the first sig repo after that | 21:35 |
| openstackgerrit | Sean McGinnis proposed openstack-infra/zuul-jobs master: Fix variable name in npm-publish job https://review.openstack.org/525326 | 21:36 |
| *** thorst has quit IRC | 21:36 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add zk01-03 servers to cluster zookeeper https://review.openstack.org/524267 | 21:37 |
| pabelanger | clarkb: ^fixes your comment | 21:37 |
| *** efoley has joined #openstack-infra | 21:37 | |
| clarkb | pabelanger: +2 thanks | 21:39 |
| *** pcaruana has quit IRC | 21:39 | |
| pabelanger | ianw: ++ might want to hold the fedora mirror lock then land 524456 | 21:40 |
| clarkb | we fixed the ical for meeting publishing right? | 21:40 |
| clarkb | (I'm going through the zuulv3 issues etherpad and updating it) | 21:41 |
| *** rockyg has quit IRC | 21:41 | |
| dmsimard | Reading https://docs.openstack.org/infra/system-config/third_party.html#requirements -- it says "A third-party system may only leave one comment per patch set (unless it is retriggered)." | 21:41 |
| AJaeger_ | clarkb: care to PTL review https://review.openstack.org/522139 - the log-classify addition, please? | 21:41 |
| dmsimard | That means we can't post a comment to mention that we are starting third party jobs ? | 21:42 |
| *** dbecker has quit IRC | 21:42 | |
| clarkb | AJaeger_: will do | 21:42 |
| AJaeger_ | clarkb: yes, ical publishing was fixed - at least one change merged, didn't verify | 21:42 |
| AJaeger_ | dmsimard: correct | 21:42 |
| *** rhallisey has quit IRC | 21:43 | |
| AJaeger_ | dmsimard: a few did this in the past (not sure whether still) and it'S really annoying | 21:43 |
| dmsimard | Is there a way to bend the rules at the discretion of a project ? I understand that nova, cinder and neutron patches might not want 1000 comments from their 50 third party CIs | 21:43 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config master: Add an openstack/self-healing-sig repository https://review.openstack.org/525270 | 21:43 |
| clarkb | AJaeger_: comparing what is on eavesdrop to what was in the etherpad I think it is working | 21:44 |
| fungi | AJaeger_: ^ updated in the meantime | 21:44 |
| *** dprince has quit IRC | 21:44 | |
| *** mat128 has quit IRC | 21:44 | |
| openstackgerrit | Merged openstack-infra/project-config master: Don't index the devstack summary logs https://review.openstack.org/525310 | 21:44 |
| smcginnis | dmsimard: I've found it best if multiple accounts are created instead. | 21:44 |
| smcginnis | Otherwise with the UI filtering, only the last CI comment shows up. | 21:44 |
| AJaeger_ | fungi: +2 - don't know which PTL to ask for review ;) | 21:45 |
| smcginnis | At least, in the table near the top. They would still be visible if you toggle the CI button. | 21:45 |
| *** jtomasek has quit IRC | 21:45 | |
| fungi | AJaeger_: right. i've replied to the e-mail thread at any rate so the sig organizer can find and object to it if concerned | 21:45 |
| dmsimard | smcginnis: yeah.. the problem we have right now is that people don't know if there are third party CI jobs running and they're important | 21:45 |
| dmsimard | smcginnis: we've seen regressions merge because humans did not wait for the results to come back | 21:46 |
| smcginnis | dmsimard: We've had it happen a few times in Cinder, but usually if there's a problem it's pretty visible in the table. | 21:46 |
| *** slaweq_ has joined #openstack-infra | 21:46 | |
| smcginnis | dmsimard: Or are your CI's not formatting their comments right to show up there? | 21:46 |
| *** hasharAway has quit IRC | 21:46 | |
| dmsimard | smcginnis: they are, but the results don't show up until the job's finished running | 21:47 |
| smcginnis | dmsimard: Oh, so are you thinking making them comment when they start, then update when they end? | 21:47 |
| dmsimard | smcginnis: yeah. "Hi I'm so and so, starting check jobs" ... "Hi I'm so so, here are the results" | 21:47 |
| *** jamesmca_ has joined #openstack-infra | 21:48 | |
| smcginnis | dmsimard: I suppose you could. And I suppose it's probably at the PTL's discretion. | 21:48 |
| andreaf | jeblair, mordred: do you have any zuul pre-built way on handling python dependencies for ansible modules? | 21:48 |
| AJaeger_ | dmsimard: but that's a social problem - people can ignore it either way... | 21:48 |
| fungi | dmsimard: AJaeger_: honestly, where third-party-ci guidelines are concerned, there are really two major kinds... those operated by the development team for the project but testing features they can't reasonably test upstream, and those operated by outside groups as advisory feedback to projects... since we rely on teams complaining about third-party ci systems doing things they don't like, the former | 21:48 |
| fungi | is really open for just about any setup as long as it doesn't cause problems for us as the sysadmins for the system | 21:48 |
| smcginnis | dmsimard: But I would recommend just more discipline on the core's part to not approve things until there are results available. | 21:48 |
| smcginnis | I know that's easier said than done some times though. | 21:48 |
| dmsimard | I realize that for projects with a lot of third party CIs (cinder, nova, neutron..) posting two comments each could be problematic | 21:49 |
| dmsimard | smcginnis: yeah, technical solutions to social problems ? :) | 21:49 |
| smcginnis | dmsimard: ;) | 21:49 |
| *** ccamacho has quit IRC | 21:49 | |
| clarkb | jeblair: for issues with jobs at https://etherpad.openstack.org/p/zuulv3-issues There is the "Jobs are still being run on the patch that removes them" item which I think is a known issue with branch matchers. Were we doing any work on that or should that be marked "done". Also there is "patch stuck in zuul gate queue with jobs stuck in queue for extended period of time" which I think was the window | 21:49 |
| clarkb | thing you fixed late last week? | 21:49 |
| dmsimard | fungi: makes sense | 21:50 |
| jeblair | dmsimard: comment spam from ci systems was enough of a problem when there were very few ci systems that the hideci.js stuff was written. that means that basically no one has seen comments like that for a long time. | 21:50 |
| fungi | dmsimard: granted, _we_ upstream also don't post comments when we start testing a change, except once it's approved and enqueued into the gate | 21:50 |
| *** thorst has joined #openstack-infra | 21:50 | |
| dmsimard | fungi: right | 21:50 |
| andreaf | jeblair, mordred: I need to get PyYAML available to my custom modules but it's failing with the system package - I can setup a virtualenv and set ansible_python_interpreter to it for the role but I was hoping something simpler exists | 21:50 |
| dmsimard | jeblair: yeah, I remember the days before hideci :D | 21:51 |
| mordred | andreaf: no, unfortunately not. | 21:51 |
| jeblair | fungi: that is 80% due to a technical reason (to clear the vote), and only 20% due to a social one (is zuul working?) | 21:51 |
| clarkb | https://review.openstack.org/#/c/516740/ is the patch to change how we install ara on executors so that it is kept up to date if others want to review that one | 21:51 |
| andreaf | https://review.openstack.org/#/c/524402/ | 21:51 |
| *** slaweq_ has quit IRC | 21:51 | |
| *** jamesmcarthur has quit IRC | 21:51 | |
| fungi | jeblair: great point | 21:51 |
| jeblair | clarkb: re the second thing: yeas, should be window thing and can be cleared | 21:52 |
| jeblair | clarkb: let me research the first thing | 21:52 |
| clarkb | andreaf: you need pyyaml running on the remote nodes? | 21:52 |
| andreaf | mordred: ok... trying to fix https://review.openstack.org/#/c/524402/... i guess I will need the virtual env then | 21:52 |
| andreaf | clarkb: yeah | 21:52 |
| clarkb | andreaf: we've used a virtualenv for the zuul cloner shim | 21:52 |
| andreaf | clarkb: since zuul does not allow me to run it on local | 21:52 |
| clarkb | so that method has precedent | 21:52 |
| andreaf | clarkb: ok thanks I guess I'll do the same then | 21:53 |
| jeblair | clarkb: re the first thing: i think so many things have changed since then it's hard to evaluate whether it's relevant. i don't think it should be a problem at this point. i'd like to clear it and say report if it happens again. | 21:53 |
| clarkb | jeblair: wfm | 21:54 |
| *** rossella_s has joined #openstack-infra | 21:54 | |
| *** thorst has quit IRC | 21:54 | |
| *** trown is now known as trown|outtypewww | 21:54 | |
| *** mriedem has quit IRC | 21:56 | |
| *** slaweq__ has quit IRC | 21:58 | |
| jeblair | zuul meeting now in #openstack-meeting-alt | 22:00 |
| *** Apoorva_ has joined #openstack-infra | 22:02 | |
| *** gouthamr has quit IRC | 22:04 | |
| *** jamesmca_ has quit IRC | 22:05 | |
| *** Apoorva has quit IRC | 22:05 | |
| *** rcernin has joined #openstack-infra | 22:07 | |
| *** jcoufal has quit IRC | 22:07 | |
| *** thorst has joined #openstack-infra | 22:10 | |
| *** myoung|ruck is now known as myoung|ruck|bbl | 22:11 | |
| *** myoung|ruck|bbl is now known as myoung|ruck | 22:11 | |
| *** wolverineav has quit IRC | 22:13 | |
| *** jamesmcarthur has joined #openstack-infra | 22:13 | |
| *** jamesmcarthur has quit IRC | 22:13 | |
| *** jamesmcarthur has joined #openstack-infra | 22:13 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Move send_command() into ZuulApp https://review.openstack.org/523211 | 22:14 |
| *** thorst has quit IRC | 22:14 | |
| *** salv-orlando has quit IRC | 22:15 | |
| *** salv-orlando has joined #openstack-infra | 22:15 | |
| *** ganso has quit IRC | 22:18 | |
| *** kjackal_ has quit IRC | 22:19 | |
| *** kjackal has quit IRC | 22:19 | |
| *** slaweq_ has joined #openstack-infra | 22:19 | |
| *** salv-orlando has quit IRC | 22:20 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add zk01-03 servers to cluster zookeeper https://review.openstack.org/524267 | 22:21 |
| *** adam_g has quit IRC | 22:22 | |
| *** adam_g has joined #openstack-infra | 22:24 | |
| *** slaweq_ has quit IRC | 22:24 | |
| *** bobh has quit IRC | 22:26 | |
| *** bobh has joined #openstack-infra | 22:26 | |
| *** bobh has quit IRC | 22:26 | |
| *** rwsu has joined #openstack-infra | 22:27 | |
| *** salv-orlando has joined #openstack-infra | 22:27 | |
| *** aeng_ has joined #openstack-infra | 22:32 | |
| *** Apoorva_ has quit IRC | 22:33 | |
| *** aeng_ has quit IRC | 22:33 | |
| *** armax has quit IRC | 22:33 | |
| *** mat128 has joined #openstack-infra | 22:33 | |
| *** Apoorva has joined #openstack-infra | 22:33 | |
| *** armax has joined #openstack-infra | 22:36 | |
| ianw | jeblair: also, https://review.openstack.org/#/c/514119/ is at the root of a whole stack of patches to complete the _project -> project transition; i believe it's ok to go when ready | 22:52 |
| *** felipemonteiro_ has quit IRC | 22:53 | |
| *** mat128 has quit IRC | 22:53 | |
| openstackgerrit | Merged openstack-infra/system-config master: Remove Fedora 25, add Fedora 27 mirror https://review.openstack.org/524456 | 22:53 |
| *** thorst has joined #openstack-infra | 22:53 | |
| *** priteau has quit IRC | 22:54 | |
| *** jamesmcarthur has quit IRC | 22:55 | |
| *** slaweq_ has joined #openstack-infra | 22:57 | |
| *** thorst has quit IRC | 22:58 | |
| *** jamesmca_ has joined #openstack-infra | 22:59 | |
| jeblair | ianw: oh thanks! i have to run now, i'll work on pushing those through soon | 23:00 |
| *** aeng has quit IRC | 23:01 | |
| *** slaweq_ has quit IRC | 23:02 | |
| *** hjensas has quit IRC | 23:06 | |
| *** gouthamr has joined #openstack-infra | 23:08 | |
| *** bobh has joined #openstack-infra | 23:09 | |
| *** florianf has quit IRC | 23:14 | |
| *** aeng has joined #openstack-infra | 23:18 | |
| *** esberglu has quit IRC | 23:18 | |
| *** esberglu has joined #openstack-infra | 23:19 | |
| *** esberglu has quit IRC | 23:23 | |
| *** dizquierdo has quit IRC | 23:26 | |
| *** gmann_afk is now known as gmann | 23:27 | |
| *** esberglu has joined #openstack-infra | 23:31 | |
| *** dhinesh has joined #openstack-infra | 23:32 | |
| *** thorst has joined #openstack-infra | 23:33 | |
| *** thorst has quit IRC | 23:33 | |
| *** slaweq_ has joined #openstack-infra | 23:35 | |
| *** dhinesh_ has joined #openstack-infra | 23:36 | |
| *** dhinesh has quit IRC | 23:37 | |
| *** efoley has quit IRC | 23:38 | |
| *** rossella_s has quit IRC | 23:38 | |
| *** dizquierdo has joined #openstack-infra | 23:38 | |
| *** armax has quit IRC | 23:38 | |
| *** yamamoto has joined #openstack-infra | 23:38 | |
| *** smatzek has joined #openstack-infra | 23:38 | |
| *** esberglu has quit IRC | 23:39 | |
| *** e0ne has quit IRC | 23:39 | |
| *** slaweq_ has quit IRC | 23:40 | |
| *** aeng has quit IRC | 23:41 | |
| *** efried is now known as efried_cya_wed | 23:41 | |
| *** slaweq_ has joined #openstack-infra | 23:42 | |
| *** smatzek has quit IRC | 23:43 | |
| *** signed8bit is now known as signed8bit_Zzz | 23:43 | |
| *** signed8bit_Zzz has quit IRC | 23:44 | |
| openstackgerrit | Merged openstack-infra/system-config master: Refresh Zanata admin user list https://review.openstack.org/525048 | 23:44 |
| *** thorst has joined #openstack-infra | 23:45 | |
| *** signed8bit has joined #openstack-infra | 23:46 | |
| *** slaweq_ has quit IRC | 23:46 | |
| ianw | #status log mirror.fedora afs volume was >95% full; upped it to 300000000. | 23:47 |
| ianw | #status log mirror.fedora afs volume was >95% full; upped it to 300000000. | 23:47 |
| openstackstatus | ianw: finished logging | 23:47 |
| * ianw not sure why znc sometimes loses track of nickserv | 23:48 | |
| clarkb | my connection died last night | 23:49 |
| clarkb | and I had to re identify too | 23:49 |
| *** thorst has quit IRC | 23:49 | |
| *** thorst has joined #openstack-infra | 23:51 | |
| *** dingyichen has joined #openstack-infra | 23:51 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - zuul/tripleo-ci-dsvm: remove required-projects https://review.openstack.org/525265 | 23:53 |
| *** armax has joined #openstack-infra | 23:53 | |
| *** aeng has joined #openstack-infra | 23:55 | |
| *** thorst has quit IRC | 23:55 | |
| *** gouthamr has quit IRC | 23:56 | |
| *** rbrndt has quit IRC | 23:57 | |
| openstackgerrit | Michael Johnson proposed openstack-infra/project-config master: Add release notes job to python-octaviaclient https://review.openstack.org/525347 | 23:58 |
| *** gouthamr has joined #openstack-infra | 23:58 | |
| *** hongbin has quit IRC | 23:59 | |
| *** felipemonteiro has joined #openstack-infra | 23:59 | |
| *** ianychoi has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!