| *** heyongli has quit IRC | 00:03 | |
| *** heyongli has joined #openstack-infra | 00:03 | |
| *** edmondsw has joined #openstack-infra | 00:07 | |
| *** yolanda__ has joined #openstack-infra | 00:09 | |
| melwitt | does anyone know what has happened to the reviewday instance at http://status.openstack.org/reviews and whether it could be fixed (if I could help fix it?). it says last refreshed at 2018-02-02 | 00:10 |
|---|---|---|
| *** edmondsw has quit IRC | 00:12 | |
| *** hongbin has joined #openstack-infra | 00:13 | |
| *** yolanda_ has quit IRC | 00:13 | |
| *** heyongli has quit IRC | 00:13 | |
| *** heyongli has joined #openstack-infra | 00:14 | |
| *** hemna_ has joined #openstack-infra | 00:23 | |
| *** heyongli has quit IRC | 00:23 | |
| *** heyongli has joined #openstack-infra | 00:24 | |
| *** mpjetta has quit IRC | 00:29 | |
| *** heyongli has quit IRC | 00:34 | |
| *** hemna_ has quit IRC | 00:34 | |
| *** heyongli has joined #openstack-infra | 00:34 | |
| *** jamesmcarthur has quit IRC | 00:39 | |
| *** claudiub has quit IRC | 00:40 | |
| *** heyongli has quit IRC | 00:44 | |
| *** rh-jelabarre has quit IRC | 00:44 | |
| *** heyongli has joined #openstack-infra | 00:44 | |
| *** njohnston has quit IRC | 00:45 | |
| *** njohnston has joined #openstack-infra | 00:46 | |
| *** rh-jelabarre has joined #openstack-infra | 00:46 | |
| *** mpjetta has joined #openstack-infra | 00:47 | |
| *** oanson has quit IRC | 00:54 | |
| *** heyongli has quit IRC | 00:54 | |
| *** heyongli has joined #openstack-infra | 00:55 | |
| *** oanson has joined #openstack-infra | 00:55 | |
| *** roman_g_ has quit IRC | 00:56 | |
| *** heyongli has quit IRC | 01:04 | |
| *** heyongli has joined #openstack-infra | 01:05 | |
| *** heyongli has quit IRC | 01:15 | |
| *** heyongli has joined #openstack-infra | 01:15 | |
| *** jamesmcarthur has joined #openstack-infra | 01:15 | |
| *** ianychoi_ is now known as ianychoi | 01:16 | |
| *** heyongli has quit IRC | 01:25 | |
| *** heyongli has joined #openstack-infra | 01:25 | |
| *** heyongli has quit IRC | 01:35 | |
| *** heyongli has joined #openstack-infra | 01:36 | |
| *** yamahata has quit IRC | 01:39 | |
| *** iyamahat has quit IRC | 01:40 | |
| *** sthussey has quit IRC | 01:41 | |
| *** gyee has quit IRC | 01:45 | |
| *** heyongli has quit IRC | 01:45 | |
| *** heyongli has joined #openstack-infra | 01:46 | |
| *** zhangfei has joined #openstack-infra | 01:48 | |
| *** yolanda_ has joined #openstack-infra | 01:51 | |
| *** agopi has joined #openstack-infra | 01:54 | |
| *** yolanda__ has quit IRC | 01:54 | |
| *** edmondsw has joined #openstack-infra | 01:55 | |
| *** heyongli has quit IRC | 01:56 | |
| *** heyongli has joined #openstack-infra | 01:56 | |
| *** yolanda__ has joined #openstack-infra | 01:59 | |
| *** edmondsw has quit IRC | 02:00 | |
| *** yolanda_ has quit IRC | 02:02 | |
| *** heyongli has quit IRC | 02:06 | |
| *** heyongli has joined #openstack-infra | 02:06 | |
| *** heyongli has quit IRC | 02:16 | |
| *** graphene has quit IRC | 02:16 | |
| *** heyongli has joined #openstack-infra | 02:17 | |
| *** graphene has joined #openstack-infra | 02:18 | |
| *** annp has joined #openstack-infra | 02:19 | |
| *** heyongli has quit IRC | 02:26 | |
| *** heyongli has joined #openstack-infra | 02:27 | |
| *** jamesmcarthur has quit IRC | 02:28 | |
| *** jamesmcarthur has joined #openstack-infra | 02:33 | |
| *** yamamoto has quit IRC | 02:33 | |
| *** heyongli has quit IRC | 02:37 | |
| *** heyongli has joined #openstack-infra | 02:37 | |
| openstackgerrit | Fatema Khalid Sherif proposed openstack-infra/storyboard-webclient master: Expose ordering criteria in search UI https://review.openstack.org/577870 | 02:37 |
| *** psachin` has joined #openstack-infra | 02:40 | |
| *** heyongli has quit IRC | 02:47 | |
| *** heyongli has joined #openstack-infra | 02:47 | |
| *** yamamoto has joined #openstack-infra | 02:47 | |
| ianw | melwitt: looking ... | 02:49 |
| *** jamesmcarthur has quit IRC | 02:52 | |
| ianw | melwitt: look like process has been stuck for a rather long time | 02:52 |
| ianw | reviewd+ 11746 1 0 Feb02 ? 00:00:15 python bin/reviewday -o /srv/static/reviewday | 02:52 |
| *** yamamoto has quit IRC | 02:53 | |
| *** udesale has joined #openstack-infra | 02:55 | |
| *** heyongli has quit IRC | 02:57 | |
| *** heyongli has joined #openstack-infra | 02:58 | |
| ianw | bugdaystats, which is supposed to run out of cron every 30 minutes has also been similarly stuck | 02:59 |
| *** yamamoto has joined #openstack-infra | 03:03 | |
| ianw | #status log old reviewday and bugday processes on status.o.o manually killed, normal runs should resume | 03:05 |
| openstackstatus | ianw: finished logging | 03:05 |
| *** yamamoto has quit IRC | 03:07 | |
| *** heyongli has quit IRC | 03:07 | |
| *** heyongli has joined #openstack-infra | 03:08 | |
| *** jamesmcarthur has joined #openstack-infra | 03:11 | |
| *** jamesmcarthur has quit IRC | 03:16 | |
| *** heyongli has quit IRC | 03:18 | |
| *** yamamoto has joined #openstack-infra | 03:18 | |
| *** heyongli has joined #openstack-infra | 03:18 | |
| *** yamamoto has quit IRC | 03:22 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: wip: add github event filter debug https://review.openstack.org/580547 | 03:23 |
| *** yamahata has joined #openstack-infra | 03:26 | |
| *** heyongli has quit IRC | 03:28 | |
| *** heyongli has joined #openstack-infra | 03:28 | |
| *** yamamoto has joined #openstack-infra | 03:33 | |
| *** yamamoto has quit IRC | 03:37 | |
| *** heyongli has quit IRC | 03:38 | |
| *** heyongli has joined #openstack-infra | 03:39 | |
| *** jamesmcarthur has joined #openstack-infra | 03:43 | |
| *** edmondsw has joined #openstack-infra | 03:43 | |
| *** cjloader has joined #openstack-infra | 03:44 | |
| *** aeng has joined #openstack-infra | 03:44 | |
| *** edmondsw has quit IRC | 03:48 | |
| *** ramishra has joined #openstack-infra | 03:48 | |
| *** cjloader has quit IRC | 03:48 | |
| *** heyongli has quit IRC | 03:48 | |
| *** heyongli has joined #openstack-infra | 03:49 | |
| *** lpetrut_ has joined #openstack-infra | 03:49 | |
| *** hongbin has quit IRC | 03:52 | |
| *** Bhujay has joined #openstack-infra | 03:57 | |
| *** Bhujay has quit IRC | 03:58 | |
| *** Bhujay has joined #openstack-infra | 03:58 | |
| *** Bhujay has quit IRC | 03:58 | |
| *** Bhujay has joined #openstack-infra | 03:59 | |
| *** heyongli has quit IRC | 03:59 | |
| *** heyongli has joined #openstack-infra | 03:59 | |
| *** Bhujay has quit IRC | 03:59 | |
| *** Bhujay has joined #openstack-infra | 04:00 | |
| *** diablo_rojo has quit IRC | 04:02 | |
| *** aeng has quit IRC | 04:09 | |
| *** heyongli has quit IRC | 04:09 | |
| *** heyongli has joined #openstack-infra | 04:09 | |
| *** graphene has quit IRC | 04:17 | |
| *** ykarel|away has joined #openstack-infra | 04:18 | |
| *** ykarel|away is now known as ykarel | 04:18 | |
| *** graphene has joined #openstack-infra | 04:19 | |
| *** heyongli has quit IRC | 04:19 | |
| *** heyongli has joined #openstack-infra | 04:20 | |
| *** heyongli has quit IRC | 04:29 | |
| *** heyongli has joined #openstack-infra | 04:30 | |
| *** yamamoto has joined #openstack-infra | 04:34 | |
| *** lpetrut_ has quit IRC | 04:36 | |
| *** yamamoto has quit IRC | 04:38 | |
| *** yamamoto has joined #openstack-infra | 04:38 | |
| *** andreas_s has joined #openstack-infra | 04:39 | |
| *** heyongli has quit IRC | 04:40 | |
| *** heyongli has joined #openstack-infra | 04:40 | |
| *** lpetrut_ has joined #openstack-infra | 04:41 | |
| *** andreas_s has quit IRC | 04:44 | |
| *** tianhui has joined #openstack-infra | 04:47 | |
| openstackgerrit | Hironori Shiina proposed openstack/diskimage-builder master: Add expected semicolons for dhclient.conf https://review.openstack.org/580556 | 04:47 |
| *** tianhui_ has quit IRC | 04:49 | |
| *** heyongli has quit IRC | 04:50 | |
| *** heyongli has joined #openstack-infra | 04:50 | |
| *** lpetrut_ has quit IRC | 04:51 | |
| *** heyongli has quit IRC | 05:00 | |
| *** heyongli has joined #openstack-infra | 05:01 | |
| *** cshastri has joined #openstack-infra | 05:02 | |
| *** jamesmcarthur has quit IRC | 05:04 | |
| *** pcichy has joined #openstack-infra | 05:09 | |
| *** heyongli has quit IRC | 05:10 | |
| *** heyongli has joined #openstack-infra | 05:11 | |
| *** janki has joined #openstack-infra | 05:20 | |
| *** heyongli has quit IRC | 05:21 | |
| *** heyongli has joined #openstack-infra | 05:21 | |
| *** dhajare has joined #openstack-infra | 05:27 | |
| *** lpetrut_ has joined #openstack-infra | 05:28 | |
| *** heyongli has quit IRC | 05:31 | |
| *** heyongli has joined #openstack-infra | 05:31 | |
| openstackgerrit | Masahito Muroi proposed openstack-infra/project-config master: Add releasenote job to python-blazarclient https://review.openstack.org/580559 | 05:31 |
| *** edmondsw has joined #openstack-infra | 05:31 | |
| *** lpetrut_ has quit IRC | 05:34 | |
| *** armaan has joined #openstack-infra | 05:35 | |
| *** quiquell|off is now known as quiquell | 05:35 | |
| *** edmondsw has quit IRC | 05:36 | |
| *** andreas_s has joined #openstack-infra | 05:37 | |
| *** masber has joined #openstack-infra | 05:39 | |
| *** yamahata has quit IRC | 05:39 | |
| *** yamahata has joined #openstack-infra | 05:40 | |
| *** armaan has quit IRC | 05:40 | |
| *** armaan has joined #openstack-infra | 05:41 | |
| *** pgadiya has joined #openstack-infra | 05:41 | |
| *** pgadiya has quit IRC | 05:41 | |
| *** heyongli has quit IRC | 05:41 | |
| *** heyongli has joined #openstack-infra | 05:42 | |
| *** armaan has quit IRC | 05:47 | |
| *** armaan has joined #openstack-infra | 05:47 | |
| *** yolanda_ has joined #openstack-infra | 05:48 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Add test with unresolvable static node https://review.openstack.org/580063 | 05:50 |
| *** iyamahat has joined #openstack-infra | 05:50 | |
| *** heyongli has quit IRC | 05:51 | |
| *** yolanda__ has quit IRC | 05:52 | |
| *** heyongli has joined #openstack-infra | 05:52 | |
| *** kjackal has joined #openstack-infra | 05:56 | |
| *** adreznec has quit IRC | 05:57 | |
| *** adreznec has joined #openstack-infra | 05:58 | |
| *** iyamahat has quit IRC | 06:01 | |
| *** heyongli has quit IRC | 06:02 | |
| *** heyongli has joined #openstack-infra | 06:02 | |
| *** yamahata has quit IRC | 06:04 | |
| *** iranzo has joined #openstack-infra | 06:04 | |
| *** nicolasbock has joined #openstack-infra | 06:08 | |
| *** heyongli has quit IRC | 06:12 | |
| *** heyongli has joined #openstack-infra | 06:12 | |
| *** dpawlik has joined #openstack-infra | 06:19 | |
| *** heyongli has quit IRC | 06:22 | |
| *** heyongli has joined #openstack-infra | 06:23 | |
| *** lpetrut has joined #openstack-infra | 06:32 | |
| *** heyongli has quit IRC | 06:32 | |
| *** heyongli has joined #openstack-infra | 06:33 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Fix relaunch attempts when hitting quota errors https://review.openstack.org/536930 | 06:39 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Fix relaunch attempts when hitting quota errors https://review.openstack.org/536930 | 06:41 |
| *** heyongli has quit IRC | 06:43 | |
| *** heyongli has joined #openstack-infra | 06:43 | |
| *** dmellado has joined #openstack-infra | 06:46 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Fix race at shutdown https://review.openstack.org/580564 | 06:46 |
| *** heyongli has quit IRC | 06:53 | |
| *** heyongli has joined #openstack-infra | 06:53 | |
| *** quiquell is now known as quiquell|bbl | 06:58 | |
| *** kjackal has quit IRC | 07:02 | |
| *** heyongli has quit IRC | 07:03 | |
| *** heyongli has joined #openstack-infra | 07:04 | |
| *** ccamacho has quit IRC | 07:08 | |
| *** ccamacho has joined #openstack-infra | 07:08 | |
| *** yolanda_ is now known as yolanda | 07:12 | |
| *** heyongli has quit IRC | 07:13 | |
| *** heyongli has joined #openstack-infra | 07:14 | |
| *** kjackal has joined #openstack-infra | 07:16 | |
| *** kjackal_ has joined #openstack-infra | 07:18 | |
| *** edmondsw has joined #openstack-infra | 07:20 | |
| *** kjackal has quit IRC | 07:21 | |
| *** kjackal has joined #openstack-infra | 07:22 | |
| *** heyongli has quit IRC | 07:24 | |
| *** kjackal_ has quit IRC | 07:24 | |
| *** heyongli has joined #openstack-infra | 07:24 | |
| *** edmondsw has quit IRC | 07:24 | |
| *** kjackal_ has joined #openstack-infra | 07:25 | |
| *** ykarel is now known as ykarel|lunch | 07:26 | |
| *** kjackal has quit IRC | 07:27 | |
| *** rpittau has quit IRC | 07:27 | |
| *** rcernin has quit IRC | 07:29 | |
| *** zhangfei has quit IRC | 07:30 | |
| *** alexchadin has joined #openstack-infra | 07:33 | |
| *** heyongli has quit IRC | 07:34 | |
| *** heyongli has joined #openstack-infra | 07:34 | |
| *** graphene has quit IRC | 07:35 | |
| *** tosky has joined #openstack-infra | 07:36 | |
| *** graphene has joined #openstack-infra | 07:37 | |
| *** quiquell|bbl is now known as quiquell | 07:39 | |
| *** rpittau has joined #openstack-infra | 07:39 | |
| *** zhangfei has joined #openstack-infra | 07:43 | |
| *** heyongli has quit IRC | 07:44 | |
| *** heyongli has joined #openstack-infra | 07:45 | |
| *** amoralej|off is now known as amoralej | 07:46 | |
| *** heyongli has quit IRC | 07:47 | |
| *** jpena|off is now known as jpena | 07:47 | |
| *** lpetrut_ has joined #openstack-infra | 07:54 | |
| *** jpich has joined #openstack-infra | 07:54 | |
| *** lpetrut has quit IRC | 07:54 | |
| *** yolanda_ has joined #openstack-infra | 07:54 | |
| *** yolanda has quit IRC | 07:56 | |
| *** kjackal has joined #openstack-infra | 07:57 | |
| *** florianf has joined #openstack-infra | 07:58 | |
| *** kjackal__ has joined #openstack-infra | 07:59 | |
| *** kjackal_ has quit IRC | 07:59 | |
| *** kjackal has quit IRC | 08:02 | |
| *** mgoddard has joined #openstack-infra | 08:07 | |
| *** nicolasbock has quit IRC | 08:15 | |
| *** nicolasbock has joined #openstack-infra | 08:15 | |
| *** ykarel|lunch is now known as ykarel | 08:16 | |
| *** graphene has quit IRC | 08:16 | |
| ianychoi | Hello infra-team! I have sent an e-mail to openstack-ko@lists.openstack.org mailing list but I could not check my sent e-mail on http://lists.openstack.org/pipermail/openstack-ko/ . Seems that mail server doesn't work? | 08:17 |
| *** graphene has joined #openstack-infra | 08:18 | |
| *** nicolasbock_ has joined #openstack-infra | 08:23 | |
| *** nicolasbock has quit IRC | 08:25 | |
| openstackgerrit | Adrian Czarnecki proposed openstack-infra/project-config master: Make monasca-api py35 job voting https://review.openstack.org/580581 | 08:28 |
| *** hph^ has joined #openstack-infra | 08:30 | |
| *** cshastri has quit IRC | 08:30 | |
| *** roman_g_ has joined #openstack-infra | 08:31 | |
| *** nicolasbock_ has quit IRC | 08:36 | |
| *** derekh has joined #openstack-infra | 08:39 | |
| *** nicolasbock_ has joined #openstack-infra | 08:43 | |
| frickler | ianychoi: I do seem to see two mails from you here http://lists.openstack.org/pipermail/openstack-ko/2018-July/thread.html , are these the ones you are referring to? | 08:44 |
| frickler | seems like it may have taken like 20 minutes until the archive got updated | 08:46 |
| *** armaan has quit IRC | 08:49 | |
| *** armaan has joined #openstack-infra | 08:50 | |
| *** graphene has quit IRC | 08:50 | |
| *** graphene has joined #openstack-infra | 08:51 | |
| *** cshastri has joined #openstack-infra | 08:52 | |
| *** dtantsur|afk is now known as dtantsur | 08:57 | |
| *** s-shiono has quit IRC | 08:58 | |
| *** armaan has quit IRC | 08:58 | |
| *** armaan has joined #openstack-infra | 08:59 | |
| *** armaan has quit IRC | 09:04 | |
| *** mihalis68 has quit IRC | 09:05 | |
| *** mihalis68 has joined #openstack-infra | 09:05 | |
| *** edmondsw has joined #openstack-infra | 09:08 | |
| *** sambetts|afk is now known as sambetts | 09:10 | |
| *** edmondsw has quit IRC | 09:12 | |
| *** pbourke has quit IRC | 09:15 | |
| *** jamesmcarthur has joined #openstack-infra | 09:16 | |
| *** pbourke has joined #openstack-infra | 09:17 | |
| *** Goneri has joined #openstack-infra | 09:17 | |
| *** jamesmcarthur has quit IRC | 09:20 | |
| *** hashar has joined #openstack-infra | 09:29 | |
| *** panda|off is now known as panda | 09:40 | |
| *** pguimaraes has joined #openstack-infra | 09:45 | |
| *** dtantsur is now known as dtantsur|brb | 09:55 | |
| *** yamamoto has quit IRC | 09:55 | |
| *** pcichy has quit IRC | 09:57 | |
| *** pcichy has joined #openstack-infra | 09:57 | |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Switch to stestr https://review.openstack.org/580413 | 10:10 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: trivial: Remove 'tools/releasenotes_tox.sh' https://review.openstack.org/580414 | 10:10 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: trivial: Fix file permissions https://review.openstack.org/580415 | 10:10 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: builddoc: Remove support for Sphinx < 1.6 https://review.openstack.org/580416 | 10:10 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: packaging: Remove support for pyN requirement files https://review.openstack.org/580417 | 10:10 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: doc: Fix formatting of packagers guide https://review.openstack.org/580418 | 10:10 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: doc: Add documentation for missing '[pbr]' options https://review.openstack.org/580419 | 10:10 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Add Sphinx extension https://review.openstack.org/580420 | 10:10 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Deprecate 'build_sphinx' integration https://review.openstack.org/580421 | 10:10 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Deprecate 'test' integration https://review.openstack.org/580422 | 10:10 |
| *** yamamoto has joined #openstack-infra | 10:15 | |
| *** annp has quit IRC | 10:18 | |
| *** stakeda has quit IRC | 10:19 | |
| *** alexchadin has quit IRC | 10:24 | |
| *** tommylikehu has quit IRC | 10:26 | |
| *** tommylikehu has joined #openstack-infra | 10:26 | |
| *** dhill_ has quit IRC | 10:28 | |
| *** srwilkers has quit IRC | 10:34 | |
| *** srwilkers has joined #openstack-infra | 10:34 | |
| *** rpioso|afk has quit IRC | 10:45 | |
| *** rpioso|afk has joined #openstack-infra | 10:45 | |
| *** verdurin has quit IRC | 10:47 | |
| *** yamamoto has quit IRC | 10:49 | |
| *** verdurin has joined #openstack-infra | 10:50 | |
| *** edmondsw has joined #openstack-infra | 10:56 | |
| *** kjackal__ has quit IRC | 10:56 | |
| *** andreas_s has quit IRC | 10:58 | |
| *** andreas_s has joined #openstack-infra | 10:58 | |
| *** alexchadin has joined #openstack-infra | 10:59 | |
| *** edmondsw has quit IRC | 11:00 | |
| panda | can someone confirm if zuul uses fact caching between playbook calls on the same job. I remember somebody mentioned also something called zuul-save ? | 11:02 |
| *** andreas_s has quit IRC | 11:03 | |
| *** alexchadin has quit IRC | 11:04 | |
| *** kjackal has joined #openstack-infra | 11:11 | |
| *** yolanda_ is now known as yolanda | 11:12 | |
| *** armaan has joined #openstack-infra | 11:19 | |
| *** vivsoni_ has quit IRC | 11:32 | |
| *** ldnunes has joined #openstack-infra | 11:37 | |
| *** quiquell is now known as quiquell|lunch | 11:43 | |
| *** edmondsw has joined #openstack-infra | 11:44 | |
| *** armaan has quit IRC | 11:47 | |
| *** jpena is now known as jpena|lunch | 11:47 | |
| *** armaan has joined #openstack-infra | 11:47 | |
| *** yamamoto has joined #openstack-infra | 11:50 | |
| *** janki has quit IRC | 11:51 | |
| *** armaan has quit IRC | 11:51 | |
| *** claudiub has joined #openstack-infra | 11:53 | |
| *** panda is now known as panda|lunch | 11:53 | |
| *** yamamoto has quit IRC | 11:56 | |
| *** pcichy has quit IRC | 11:58 | |
| *** pcichy has joined #openstack-infra | 11:59 | |
| *** rosmaita has joined #openstack-infra | 12:00 | |
| *** alexchadin has joined #openstack-infra | 12:00 | |
| *** armaan has joined #openstack-infra | 12:07 | |
| *** quiquell|lunch is now known as quiquell | 12:08 | |
| *** yamamoto has joined #openstack-infra | 12:10 | |
| *** claudiub has quit IRC | 12:10 | |
| *** kgiusti has joined #openstack-infra | 12:12 | |
| *** jokke_ has quit IRC | 12:14 | |
| *** jokke_ has joined #openstack-infra | 12:14 | |
| *** yamamoto has quit IRC | 12:19 | |
| *** panda|lunch is now known as panda | 12:19 | |
| *** rlandy has joined #openstack-infra | 12:37 | |
| *** udesale has quit IRC | 12:37 | |
| *** udesale has joined #openstack-infra | 12:38 | |
| mordred | panda: yes, zuul uses fact caching. we actually run the setup module on each host before the job to prime the cache, then run the playbooks with gathering = smart turned on | 12:44 |
| *** mschuppert has joined #openstack-infra | 12:45 | |
| mordred | panda: that doesn't mean set_fact will persist across playbooks though - if you want to pass a variable from one playbook to the other, you want the zuul_return module | 12:45 |
| mordred | https://zuul-ci.org/docs/zuul/user/jobs.html#return-values | 12:46 |
| AJaeger | mordred: did you see fungi's comments on https://review.openstack.org/580521 ? Want to edit - or shall we merge as is? | 12:49 |
| AJaeger | dmsimard: could you review https://review.openstack.org/577675 , please? That's ara related... | 12:49 |
| mordred | AJaeger: I did- I think we can merge it as is - the order does not carry meaning | 12:50 |
| AJaeger | ok, will +2A then... | 12:51 |
| *** pcichy has quit IRC | 12:51 | |
| fungi | yeah, i didn't want to block on that, was simply curious | 12:52 |
| *** eernst has joined #openstack-infra | 12:53 | |
| *** yolanda_ has joined #openstack-infra | 12:54 | |
| *** eharney has joined #openstack-infra | 12:54 | |
| *** alexchad_ has joined #openstack-infra | 12:54 | |
| mschuppert | hi, I have an issue with https://review.openstack.org/#/c/579813/ which does not enter gate jobs. bandini mentioned you may could tell me why this is the case. we tried rechecks and also removed +W and set it again. | 12:55 |
| mschuppert | pabelanger: ^ | 12:55 |
| *** alexchadin has quit IRC | 12:56 | |
| pabelanger | mschuppert: your patch, 579813 depends-on another that hasn't merged yet. So you need to first approve that | 12:56 |
| AJaeger | mschuppert: does it have a depends-on? | 12:56 |
| AJaeger | mschuppert: click on the depends-on link to see what's not merged... | 12:56 |
| *** yolanda has quit IRC | 12:57 | |
| *** yamamoto has joined #openstack-infra | 12:58 | |
| *** janki has joined #openstack-infra | 12:58 | |
| *** jpena|lunch is now known as jpena | 12:58 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Add job to build container images using pbrx https://review.openstack.org/580160 | 12:58 |
| mschuppert | argh ok, should have waited to cherry pick | 12:59 |
| mschuppert | thx | 12:59 |
| AJaeger | mschuppert: or use Depends-On: https://review.o.o/ID - or remove it completely | 12:59 |
| *** rpioso|afk is now known as rpioso | 12:59 | |
| mschuppert | ack thx AJaeger pabelanger | 13:00 |
| *** amoralej is now known as amoralej|lunch | 13:02 | |
| *** yamamoto_ has joined #openstack-infra | 13:05 | |
| ianychoi | frickler, oh yes i should have waited more - thanks a lot :) | 13:05 |
| *** yamamoto_ has quit IRC | 13:07 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Install build bindep profiles alongside doc and test https://review.openstack.org/580521 | 13:08 |
| *** yamamoto has quit IRC | 13:08 | |
| AJaeger | stephenfin: regarding https://review.openstack.org/559401 : I renamed it ;) | 13:09 |
| stephenfin | AJaeger: Did you? | 13:09 |
| *** felipemonteiro_ has joined #openstack-infra | 13:09 | |
| stephenfin | I'm still seeing os-vif-tempest-dsvm-ovs | 13:09 |
| *** stephenfin is now known as finucannot | 13:10 | |
| AJaeger | stephenfin: I did - but somehow the upload didn't work. | 13:10 |
| AJaeger | finucannot: so, user error on my side - good that you asked ;) | 13:10 |
| AJaeger | finucannot: check again, please ;) | 13:10 |
| *** felipemonteiro__ has joined #openstack-infra | 13:10 | |
| *** cshastri has quit IRC | 13:10 | |
| finucannot | AJaeger: I see it now. Cheers! :) | 13:11 |
| *** hemna_ has joined #openstack-infra | 13:12 | |
| mordred | infra-root: tobiash pointed out that the version of bubblewrap in the PPA we use to install it is old (related to the pbrx/containers patch) I uploaded 0.2.1 to the ppa, but uploaded it for bionic so it wouldn't just upgrade itself on our executors | 13:12 |
| *** alexchad_ has quit IRC | 13:13 | |
| fungi | neat | 13:14 |
| *** felipemonteiro_ has quit IRC | 13:14 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Fix race at shutdown https://review.openstack.org/580564 | 13:15 |
| *** mriedem has joined #openstack-infra | 13:18 | |
| *** armaan has quit IRC | 13:18 | |
| *** armaan has joined #openstack-infra | 13:19 | |
| *** armaan has quit IRC | 13:23 | |
| panda | mordred: ah, that's what I was looking for, thanks! | 13:23 |
| *** cshastri has joined #openstack-infra | 13:24 | |
| *** armaan has joined #openstack-infra | 13:26 | |
| *** pawelzny has quit IRC | 13:27 | |
| *** yamamoto has joined #openstack-infra | 13:29 | |
| pabelanger | clarkb: I'm starting to think there is more to the issue with reverse proxy cache to docker, we are still getting some misses: http://paste.openstack.org/show/725252/ | 13:29 |
| pabelanger | but we have more then enough space in cache now | 13:29 |
| *** dtantsur|brb is now known as dtantsur | 13:29 | |
| pabelanger | I wonder if something with expire headers has changed, and invalidating the cache | 13:29 |
| *** sthussey has joined #openstack-infra | 13:35 | |
| *** armaan has quit IRC | 13:36 | |
| *** armaan has joined #openstack-infra | 13:37 | |
| *** Goneri has quit IRC | 13:39 | |
| *** armaan has quit IRC | 13:40 | |
| *** armaan has joined #openstack-infra | 13:40 | |
| *** annp has joined #openstack-infra | 13:40 | |
| *** psachin` has quit IRC | 13:42 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Add job to build container images using pbrx https://review.openstack.org/580160 | 13:42 |
| *** alexchadin has joined #openstack-infra | 13:45 | |
| *** armaan has quit IRC | 13:45 | |
| *** annp has quit IRC | 13:45 | |
| *** ykarel is now known as ykarel|away | 13:51 | |
| *** agopi has quit IRC | 13:56 | |
| *** eernst has quit IRC | 13:58 | |
| ttx | hmm, is the MQTT server at firehost.o.o down? | 13:59 |
| melwitt | thank you ianw! | 13:59 |
| *** amoralej|lunch is now known as amoralej | 14:04 | |
| *** eernst has joined #openstack-infra | 14:05 | |
| dhellmann | fungi : ok, so it sounds like maybe turning metadata warnings into errors is a bad idea? | 14:06 |
| fungi | ttx: firehose? i'm rebooting my workstation but can double-check in a sec | 14:07 |
| fungi | dhellmann: yes, the metadata warnings are a sign that cpython stdlib distutils is not kept up to date with the current state of the python packaging ecosystem | 14:08 |
| fungi | at least some of the metadata warnings, anyway | 14:08 |
| *** hongbin has joined #openstack-infra | 14:08 | |
| *** yamahata has joined #openstack-infra | 14:09 | |
| *** cshastri has quit IRC | 14:09 | |
| dhellmann | ok, so it's probably safe to ignore those and just go along with the setuptools "check" command | 14:10 |
| *** yamahata has quit IRC | 14:11 | |
| *** alexchadin has quit IRC | 14:11 | |
| *** yamahata has joined #openstack-infra | 14:11 | |
| clarkb | pabelanger: we invalidate cached data after 24 hours | 14:12 |
| clarkb | pabelanger: could it just be that? | 14:12 |
| pabelanger | clarkb: oh, do we? | 14:12 |
| pabelanger | maybe that is it | 14:12 |
| clarkb | pabelanger: yes, apache has that as a default and it seemed long enough to not change it | 14:12 |
| clarkb | however it shouldn't delete that data unless we are at the limit | 14:13 |
| fungi | ttx: yep, looks like it died during log rotation again (06:25:01 was its last log entry) | 14:13 |
| clarkb | instead it should check if it is still valid and refresh the counter if so | 14:13 |
| pabelanger | clarkb: in the case of container, do we actually want to do that? I would think we'd let them log for every, and let htcacheclean delete them eventually as oldest | 14:13 |
| fungi | #status log manually restarted mosquitto, lpmqtt and germqtt services on firehose01.openstack.org (mosquitto died again during log rotation due to its signal handling bug, and the other two services subsequently died from connection failures because the broker was down) | 14:14 |
| openstackstatus | fungi: finished logging | 14:14 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Switch to stestr https://review.openstack.org/580413 | 14:15 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: trivial: Remove 'tools/releasenotes_tox.sh' https://review.openstack.org/580414 | 14:15 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: trivial: Fix file permissions https://review.openstack.org/580415 | 14:15 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: builddoc: Remove support for Sphinx < 1.6 https://review.openstack.org/580416 | 14:15 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: packaging: Remove support for pyN requirement files https://review.openstack.org/580417 | 14:15 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: doc: Fix formatting of packagers guide https://review.openstack.org/580418 | 14:15 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: doc: Add documentation for missing '[pbr]' options https://review.openstack.org/580419 | 14:15 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Add Sphinx extension https://review.openstack.org/580420 | 14:15 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Deprecate 'build_sphinx' integration https://review.openstack.org/580421 | 14:15 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Deprecate 'test' integration https://review.openstack.org/580422 | 14:15 |
| *** ramishra has quit IRC | 14:16 | |
| clarkb | pabelanger: we could fiddle with that, the hit rate on rax ord for docker mirror is ~96.5% | 14:17 |
| clarkb | pabelanger: that seems really good already | 14:17 |
| fungi | especially if that's % requests and not % bytes, so gets skewed by things like indices | 14:18 |
| pabelanger | yah, I don't mind fiddling a bit | 14:19 |
| pabelanger | seems the 3.5% is still affecting tripleo | 14:19 |
| pabelanger | but increased cache size is working | 14:20 |
| *** dpawlik has quit IRC | 14:20 | |
| clarkb | fungi: yes it is total number of requests then percentage of misses vs not misses. | 14:21 |
| *** bnemec is now known as beekneemech | 14:22 | |
| *** edmondsw has quit IRC | 14:23 | |
| *** edmondsw has joined #openstack-infra | 14:24 | |
| clarkb | fungi: a good number of the supporting requests are filtered out due to redirects, I think that number is pretty close to reality | 14:26 |
| *** edmondsw has quit IRC | 14:27 | |
| *** jamesmcarthur has joined #openstack-infra | 14:28 | |
| clarkb | pabelanger: looking at 8ee19319fadd298795f0a1f9b0906ec5d367014ba1a57d0ad542f011560a6e66 on rax ord mirror. There are 11 requests for it in the current log file. two are misses. The first is a miss (expected). Then 5 hours later another miss (perhaps cleaned up due to disk usage?) then everything else is a hit. | 14:30 |
| pabelanger | clarkb: yah, I am thinking https://httpd.apache.org/docs/2.4/mod/mod_cache.html#cachedefaultexpire might be coming into play? | 14:30 |
| pabelanger | I wouldn't expect htcacheclean to clean it up, due to disk size | 14:31 |
| pabelanger | but, think it is getting forced deleted, before apache is saying it is too old | 14:31 |
| clarkb | ya thats the one day expiry I'm thinking of. As for htcacheclean we don't necessarily know how much disk was used exactly at that time (but could look at cacti to get a rough idea) | 14:32 |
| *** edmondsw has joined #openstack-infra | 14:32 | |
| clarkb | it is posible that the limit was used and this was deleted due to being least recently used and invalid | 14:32 |
| pabelanger | clarkb: do we explicitly set it, default is 1 hour | 14:32 |
| *** dhajare has quit IRC | 14:32 | |
| clarkb | (actually doesn't even need to be invalid to be deleted, just least recently used) | 14:32 |
| clarkb | I thought we set it, but I don't see it, we do set CacheStoreExpired On | 14:33 |
| *** Bhujay has quit IRC | 14:33 | |
| *** agopi has joined #openstack-infra | 14:34 | |
| *** ykarel|away has quit IRC | 14:34 | |
| pabelanger | CacheIgnoreNoLastMod seems interesting too | 14:34 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool master: Use openstacksdk instead of os-client-config https://review.openstack.org/566158 | 14:34 |
| ttx | fungi: thx | 14:34 |
| pabelanger | seem like that would be used along with CacheDefaultExpire | 14:34 |
| pabelanger | clarkb: https://httpd.apache.org/docs/2.4/mod/mod_cache.html#cachemaxexpire is 1 day | 14:37 |
| clarkb | ah it is the max that is one day | 14:37 |
| pabelanger | so that seems to say, regardless of all settings, we'll invalidate after a day | 14:37 |
| clarkb | right, but we only delete if we need the space | 14:38 |
| clarkb | which is true for valid and invalid data. The difference is that invalid data is checked before servign it as valid again | 14:38 |
| *** felipemonteiro__ has quit IRC | 14:38 | |
| *** eernst has quit IRC | 14:39 | |
| *** lpetrut_ has quit IRC | 14:40 | |
| pabelanger | so, maybe we bump https://httpd.apache.org/docs/2.4/mod/mod_cache.html#cachedefaultexpire to 12 hours (or day) for 8081 / 8082 and see if that helps cache miss rate. that covers expiry date nor last-modified date are provided | 14:41 |
| pabelanger | I can actually confirm by getting a pcap from the mirror | 14:41 |
| clarkb | ++ and keep an eye on disk usage at the same time | 14:41 |
| pabelanger | yah | 14:41 |
| clarkb | proably worht a comment that docker is different than else too | 14:43 |
| clarkb | so that we don't get confused about why the cache settings are so different | 14:43 |
| *** alexchadin has joined #openstack-infra | 14:44 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/zuul master: Change "core developer" reference https://review.openstack.org/579241 | 14:45 |
| *** quiquell is now known as quiquell|off | 14:47 | |
| *** hongbin has quit IRC | 14:49 | |
| *** hongbin has joined #openstack-infra | 14:49 | |
| *** rpittau has quit IRC | 14:50 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Set CacheDefaultExpire for 8001/8002 on mirrors https://review.openstack.org/580676 | 14:50 |
| pabelanger | clarkb: fungi: ^updates default for docker reverse proxy | 14:50 |
| pabelanger | cache | 14:50 |
| pabelanger | and I have time today to also monitor | 14:51 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: Revert "proposal: OSA: Do not sync tests/tests-repo-clone.sh anymore" https://review.openstack.org/580682 | 14:58 |
| *** cjloader has joined #openstack-infra | 15:00 | |
| *** yolanda__ has joined #openstack-infra | 15:00 | |
| *** cjloader has quit IRC | 15:00 | |
| *** cjloader has joined #openstack-infra | 15:00 | |
| *** yolanda_ has quit IRC | 15:03 | |
| *** kjackal has quit IRC | 15:03 | |
| *** kjackal has joined #openstack-infra | 15:04 | |
| *** eharney has quit IRC | 15:04 | |
| openstackgerrit | Dean Troyer proposed openstack-infra/project-config master: Put StarlingX projects into a common gate queue https://review.openstack.org/578532 | 15:11 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove release-tools configuration https://review.openstack.org/579194 | 15:11 |
| *** seongsoocho has joined #openstack-infra | 15:13 | |
| *** ykarel|away has joined #openstack-infra | 15:14 | |
| *** iyamahat has joined #openstack-infra | 15:15 | |
| *** ykarel|away is now known as ykarel | 15:17 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck master: Update query for nova bug 1779711 https://review.openstack.org/580687 | 15:17 |
| openstack | bug 1779711 in OpenStack Compute (nova) "test_pre_live_migration_volume_backed* intermittently fails serialized json compare" [Critical,Fix released] https://launchpad.net/bugs/1779711 - Assigned to Matt Riedemann (mriedem) | 15:17 |
| *** bobh has joined #openstack-infra | 15:19 | |
| *** eharney has joined #openstack-infra | 15:19 | |
| *** openstackgerrit has quit IRC | 15:19 | |
| clarkb | mnaser: looks like ipv6 dns pings and resolves again in vexxhost. Should we reenable vexxhost max servers or are you wanting to see things settle down on route advertisements first? | 15:27 |
| *** hashar is now known as hasharAway | 15:29 | |
| *** openstackgerrit has joined #openstack-infra | 15:30 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: proposal/OSA: Sync the contents of the sync folder https://review.openstack.org/580696 | 15:30 |
| *** alexchadin has quit IRC | 15:31 | |
| pabelanger | clarkb: do you mind a review on https://review.openstack.org/580676/ for caching we discussed | 15:32 |
| clarkb | pabelanger: yup, sorry just catching up on yesterday and email. Will look now | 15:32 |
| pabelanger | clarkb: np, thanks | 15:33 |
| *** bobh has quit IRC | 15:33 | |
| *** iranzo has quit IRC | 15:33 | |
| *** dhajare has joined #openstack-infra | 15:35 | |
| *** anteaya has quit IRC | 15:38 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Report config errors when removing cross-repo jobs https://review.openstack.org/579997 | 15:41 |
| *** yamamoto_ has joined #openstack-infra | 15:41 | |
| *** hemna_ has quit IRC | 15:42 | |
| *** tianhui_ has joined #openstack-infra | 15:44 | |
| *** yamamoto has quit IRC | 15:44 | |
| *** mriedem is now known as mriedem_away | 15:45 | |
| *** tianhui has quit IRC | 15:46 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: proposal/OSA: Sync the contents of the sync folder https://review.openstack.org/580696 | 15:46 |
| openstackgerrit | Merged openstack-infra/elastic-recheck master: Update query for nova bug 1779711 https://review.openstack.org/580687 | 15:48 |
| openstack | bug 1779711 in OpenStack Compute (nova) "test_pre_live_migration_volume_backed* intermittently fails serialized json compare" [Critical,Fix released] https://launchpad.net/bugs/1779711 - Assigned to Matt Riedemann (mriedem) | 15:48 |
| *** pguimaraes has quit IRC | 15:50 | |
| *** hemna_ has joined #openstack-infra | 15:51 | |
| openstackgerrit | Merged openstack-infra/system-config master: Set CacheDefaultExpire for 8001/8002 on mirrors https://review.openstack.org/580676 | 15:53 |
| *** trown is now known as trown|lunch | 15:55 | |
| *** zhangfei has quit IRC | 15:55 | |
| pabelanger | clarkb: what are your thoughts on exposing the output of https://review.openstack.org/575881/ some how for non-root to see. Maybe a crontab every x minutes to apache public_html folder | 15:57 |
| *** neiloy has joined #openstack-infra | 15:57 | |
| pabelanger | clarkb: or if we get fancy cacit.o.o | 15:57 |
| pabelanger | I actually wonder if something like awstats could present the data too | 15:58 |
| clarkb | pabelanger: ya that was why I pushed that script up. I just haven't had time to work on publishing the info it produces. Crontab that writes a file that we serve would be great. | 16:00 |
| openstackgerrit | Fatema Khalid Sherif proposed openstack-infra/storyboard master: Changing 'Merged' to 'Resolved'. https://review.openstack.org/580708 | 16:00 |
| *** lucasagomes is now known as lucas-afk | 16:01 | |
| *** hemna_ has quit IRC | 16:01 | |
| *** Swami has joined #openstack-infra | 16:02 | |
| openstackgerrit | Fatema Khalid Sherif proposed openstack-infra/storyboard master: Changing 'Merged' to 'Resolved'. https://review.openstack.org/580708 | 16:03 |
| *** ykarel has quit IRC | 16:07 | |
| *** yamahata has quit IRC | 16:12 | |
| *** iyamahat has quit IRC | 16:13 | |
| *** ykarel has joined #openstack-infra | 16:13 | |
| openstackgerrit | Fatema Khalid Sherif proposed openstack-infra/storyboard master: Changing 'Merged' to 'Resolved'. https://review.openstack.org/556648 | 16:13 |
| mnaser | clarkb: it's still pending with our provider so i'd prefer to wait a bit longer to not cause noise | 16:13 |
| *** sambetts is now known as sambetts|afk | 16:14 | |
| clarkb | mnaser: wfm | 16:15 |
| *** bobh has joined #openstack-infra | 16:15 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Report config errors when removing cross-repo jobs https://review.openstack.org/579997 | 16:20 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Add job to build container images using pbrx https://review.openstack.org/580160 | 16:21 |
| *** bobh has quit IRC | 16:30 | |
| *** bobh has joined #openstack-infra | 16:32 | |
| *** iyamahat has joined #openstack-infra | 16:34 | |
| *** jchhatbar has joined #openstack-infra | 16:35 | |
| *** cjloader has quit IRC | 16:35 | |
| *** panda is now known as panda|off | 16:36 | |
| *** dtantsur is now known as dtantsur|afk | 16:37 | |
| *** janki has quit IRC | 16:38 | |
| *** yamamoto has joined #openstack-infra | 16:43 | |
| openstackgerrit | Arx Cruz proposed openstack/diskimage-builder master: Update developing_elements https://review.openstack.org/580719 | 16:45 |
| *** yolanda_ has joined #openstack-infra | 16:46 | |
| *** yamamoto_ has quit IRC | 16:47 | |
| *** pcichy has joined #openstack-infra | 16:48 | |
| *** yolanda__ has quit IRC | 16:49 | |
| *** ykarel_ has joined #openstack-infra | 16:49 | |
| *** jpich has quit IRC | 16:50 | |
| *** Swami has quit IRC | 16:51 | |
| *** tianhui has joined #openstack-infra | 16:52 | |
| *** ykarel has quit IRC | 16:53 | |
| *** tianhui_ has quit IRC | 16:53 | |
| *** yamahata has joined #openstack-infra | 16:54 | |
| *** bobh has quit IRC | 16:59 | |
| *** derekh has quit IRC | 17:02 | |
| *** mgoddard has quit IRC | 17:03 | |
| *** amoralej is now known as amoralej|off | 17:04 | |
| *** diablo_rojo has joined #openstack-infra | 17:04 | |
| *** ykarel_ is now known as ykarel|away | 17:06 | |
| *** Swami has joined #openstack-infra | 17:07 | |
| *** smcginnis is now known as smcginnis_afk | 17:08 | |
| *** udesale has quit IRC | 17:08 | |
| *** jchhatbar has quit IRC | 17:10 | |
| *** mriedem_away is now known as mriedem | 17:10 | |
| *** zul has quit IRC | 17:14 | |
| *** zul has joined #openstack-infra | 17:15 | |
| *** florianf has quit IRC | 17:22 | |
| *** yamamoto has quit IRC | 17:24 | |
| *** yamamoto has joined #openstack-infra | 17:26 | |
| *** jpena is now known as jpena|off | 17:26 | |
| *** yolanda__ has joined #openstack-infra | 17:29 | |
| pabelanger | clarkb: fungi: maybe on monday we can look to land https://review.openstack.org/497948/ should help jobs keep running each time we make vhost changes to mirrors vs failing because we stop / start apache | 17:30 |
| *** yamamoto has quit IRC | 17:30 | |
| *** hasharAway has quit IRC | 17:32 | |
| clarkb | pabelanger: I'm fine with that, but fungi and I are likely afk all of next week | 17:32 |
| clarkb | we have foundation tsaff meetings we are traveling for | 17:32 |
| *** yolanda_ has quit IRC | 17:32 | |
| pabelanger | ah, okay. I'll work with ianw then :) | 17:33 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Report config errors when removing cross-repo jobs https://review.openstack.org/579997 | 17:33 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Cleanup test_over_quota https://review.openstack.org/580728 | 17:35 |
| *** yamamoto has joined #openstack-infra | 17:37 | |
| *** yamamoto has quit IRC | 17:37 | |
| *** ykarel|away has quit IRC | 17:39 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Fix relaunch attempts when hitting quota errors https://review.openstack.org/536930 | 17:41 |
| *** trown|lunch is now known as trown | 17:41 | |
| pabelanger | clarkb: fungi: I was thinking more about OVH errors when we get close to max capacity. Was maybe thinking of removing max-server from a region and see what nodepool does, give we now use quota from openstack API, i wonder if that show we actually have less quota capacity. | 17:43 |
| *** jamesmcarthur has quit IRC | 17:44 | |
| clarkb | pabelanger: reading the emails re OVH I think the lowered amount was because johnsom and dpawlik were debugging nested virt | 17:45 |
| clarkb | you should probably follow up with them | 17:45 |
| clarkb | as for removing max servers we'd need to double chekc the quotas in each region before doing that (I know we can't do that in vexxhost for example as we have unlimited instance quota) | 17:45 |
| johnsom | We finished that testing. The new kernel fixed the bug. I can't talk to the pool size however. | 17:46 |
| clarkb | johnsom: oh neat. Re pool size one hypervisor was removed from the aggregate pool (I assume the one being tested on) | 17:46 |
| clarkb | johnsom: any idea if that is or will be rolled out more broadly? | 17:46 |
| pabelanger | clarkb: good point, let me see if I can see quota in nodepool logs | 17:46 |
| johnsom | clarkb It was actually the kernel in the nodepool image | 17:47 |
| pabelanger | 2018-07-06 17:20:51,811 DEBUG nodepool.driver.openstack.OpenStackProvider: Provider quota for ovh-bhs1: {'compute': {'cores': 2400, 'instances': 600, 'ram': 4915200}} | 17:47 |
| clarkb | johnsom: also have any more data on "new kernel" was it a specific patch or just updating to a more modern kernel? | 17:47 |
| johnsom | clarkb We have lifted the KVM restriction for both OVH and limestone | 17:47 |
| pabelanger | so, ever though 600 instances, i think nodepool will stop once we hit ram / cores | 17:47 |
| clarkb | pabelanger: ya but our max servers is closer to 159 iirc | 17:48 |
| clarkb | pabelanger: so we can't do it there either | 17:48 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Install config pointing docker at the dockerhub mirror https://review.openstack.org/580730 | 17:48 |
| mordred | clarkb: how's that look? ^^ | 17:49 |
| *** Swami has quit IRC | 17:49 | |
| pabelanger | clarkb: ah, I see. I guess we'd need to have OVH setup up the correct quota limits | 17:49 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Add job to build container images using pbrx https://review.openstack.org/580160 | 17:50 |
| clarkb | mordred: close, I think you have to drop the http:// from the docker_mirror var and tell it to use http via a different config setting | 17:50 |
| clarkb | mordred: they don't allow you to specify protocol in the url (technically it isn't a url I guess) and assume https unless overridden elsewhere | 17:50 |
| mordred | clarkb: I have "http://localhost:5000" on my laptop | 17:51 |
| clarkb | pabelanger: ya some clouds set us right at the limit, others have been more generous with the expectations we are good users and can manage it via our config | 17:51 |
| clarkb | mordred: oh interesting, I think it was pabelanger that had the issue I described above | 17:51 |
| johnsom | clarkb It was the 4.4.0-128.154 kernel. There were three KVM fixes in that release. We did not narrow down to which one fixed it. http://changelogs.ubuntu.com/changelogs/pool/main/l/linux-lts-xenial/linux-lts-xenial_4.4.0-130.156~14.04.1/changelog scroll down to "linux (4.4.0-128.154) xenial; urgency=medium" | 17:52 |
| mordred | clarkb: joy. well - I'm using the docker from the docker apt repo not from the distro if it makes any difference | 17:52 |
| clarkb | mordred: possible they fixed that issue in newer docker I guess | 17:52 |
| mordred | it looks like we're hosting a debian package archive mirror of docker packages too - deb-docker ? | 17:53 |
| clarkb | johnsom: thanks | 17:53 |
| clarkb | mordred: it would appear so, just for xenial | 17:53 |
| pabelanger | clarkb: mordred: yah, and also depending on docker version you either need 8001 or 8002 of our reverse proxy cache | 17:54 |
| clarkb | (fwiw I think we should get away from trying to properly mirror every random projects deb packages (or rpms) as it requires a decnt amount of mirror side upkeep, and instead prefer caching like we have done with mariadb packages) | 17:54 |
| *** zul has quit IRC | 18:00 | |
| *** zul has joined #openstack-infra | 18:00 | |
| *** dhajare has quit IRC | 18:03 | |
| *** e0ne has joined #openstack-infra | 18:04 | |
| *** yolanda_ has joined #openstack-infra | 18:07 | |
| fungi | pabelanger: clarkb: i have a feeling our quotas in ovh didn't decrease when one of the compute nodes was taken out of the aggregate? | 18:09 |
| fungi | so... would have been at least no better | 18:09 |
| clarkb | fungi: our quotas are already way above what we can run apparently | 18:09 |
| clarkb | ya exactly | 18:09 |
| *** yolanda__ has quit IRC | 18:10 | |
| pabelanger | agree | 18:11 |
| fungi | the dynamic quota feature of nodepool is awesome, but it's no magic bullet | 18:12 |
| *** anteaya has joined #openstack-infra | 18:15 | |
| anteaya | just as a note, I do like winterscale as a viable option for rebranding | 18:16 |
| *** ccamacho has quit IRC | 18:17 | |
| anteaya | I'm finding it hard to see it referenced as winterstack | 18:17 |
| *** roman_g_ has quit IRC | 18:18 | |
| *** robled has quit IRC | 18:23 | |
| *** robled has joined #openstack-infra | 18:24 | |
| *** robled has joined #openstack-infra | 18:24 | |
| *** e0ne has quit IRC | 18:24 | |
| corvus | by reinforcing the openstack connection, winterstack sort of embodies the very problem we're trying to solve, no? | 18:26 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/python-storyboardclient master: uncap pbr https://review.openstack.org/580735 | 18:27 |
| clarkb | corvus: yes, also I'm not sure everyone is a game of thrones fan and will appreciate winter is coming :) | 18:28 |
| * fungi hasn't read even one of those books | 18:29 | |
| corvus | (note anteaya's point was winterstack != winterscale) | 18:30 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: remove branch aware project settings for whereto https://review.openstack.org/580737 | 18:33 |
| clarkb | oh I keep mixing them up | 18:34 |
| clarkb | clearly I fail | 18:34 |
| clarkb | spend enough years typing stack and I guess scale comes out as stack | 18:34 |
| clarkb | (that was wholly unintentional muscle memory typing) | 18:35 |
| clarkb | ya I got the etherpad url right and the email subject wrong :/ | 18:36 |
| clarkb | heh the whole email was wrong, but the etherpad was right. | 18:36 |
| *** yamamoto has joined #openstack-infra | 18:38 | |
| *** graphene has quit IRC | 18:40 | |
| *** cargonza_ has joined #openstack-infra | 18:41 | |
| *** graphene has joined #openstack-infra | 18:41 | |
| anteaya | thanks for hearing me | 18:42 |
| *** mgoddard has joined #openstack-infra | 18:43 | |
| *** yamamoto has quit IRC | 18:48 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: switch whereto to use publish-to-pypi-python3 https://review.openstack.org/580740 | 18:48 |
| *** mgoddard has quit IRC | 18:48 | |
| *** dhajare has joined #openstack-infra | 18:58 | |
| *** mschuppert has quit IRC | 19:04 | |
| *** mihalis68 has quit IRC | 19:15 | |
| *** graphene has quit IRC | 19:22 | |
| *** graphene has joined #openstack-infra | 19:24 | |
| *** dhajare has quit IRC | 19:30 | |
| *** gyee has joined #openstack-infra | 19:32 | |
| *** eharney has quit IRC | 19:34 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: remove restrictions on repos allowed to use publish-openstack-tox-docs https://review.openstack.org/580484 | 19:36 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: switch incorrect python3 docs job to correct one https://review.openstack.org/580486 | 19:36 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: remove publish-openstack-sphinx-docs-python3 job https://review.openstack.org/580489 | 19:36 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: remove branch aware project settings for whereto https://review.openstack.org/580737 | 19:36 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: switch whereto to use publish-to-pypi-python3 https://review.openstack.org/580740 | 19:36 |
| *** cargonza_ has quit IRC | 19:39 | |
| *** cargonza_ has joined #openstack-infra | 19:39 | |
| *** dbecker has quit IRC | 19:50 | |
| *** graphene has quit IRC | 19:55 | |
| *** dbecker has joined #openstack-infra | 19:56 | |
| *** yolanda__ has joined #openstack-infra | 19:56 | |
| *** graphene has joined #openstack-infra | 19:57 | |
| *** yolanda_ has quit IRC | 19:59 | |
| *** chuck_ has joined #openstack-infra | 20:00 | |
| *** zul has quit IRC | 20:00 | |
| *** zul has joined #openstack-infra | 20:01 | |
| *** edmondsw_ has joined #openstack-infra | 20:09 | |
| *** edmondsw has quit IRC | 20:11 | |
| *** roman_g has joined #openstack-infra | 20:21 | |
| *** yolanda_ has joined #openstack-infra | 20:22 | |
| *** yolanda__ has quit IRC | 20:26 | |
| *** jmorgan1 has quit IRC | 20:26 | |
| *** pcichy has quit IRC | 20:26 | |
| *** yolanda__ has joined #openstack-infra | 20:31 | |
| *** yolanda_ has quit IRC | 20:34 | |
| *** Goneri has joined #openstack-infra | 20:35 | |
| *** jmorgan1 has joined #openstack-infra | 20:36 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: DNM: Break Zuul's config https://review.openstack.org/580759 | 20:45 |
| *** graphene has quit IRC | 20:47 | |
| *** graphene has joined #openstack-infra | 20:49 | |
| *** dbecker has quit IRC | 20:49 | |
| *** dpawlik has joined #openstack-infra | 20:58 | |
| dhellmann | why do we have a bunch of projects running openstack-tox-cover in the post pipeline? | 21:01 |
| *** dbecker has joined #openstack-infra | 21:01 | |
| *** dpawlik has quit IRC | 21:02 | |
| fungi | as opposed to... periodic? | 21:02 |
| fungi | i think the idea was to collect coverage data for each commit as it merged | 21:02 |
| dhellmann | ah | 21:03 |
| dhellmann | is the data persisted somehow? | 21:03 |
| clarkb | dhellmann: just in the logs server. At one time there was some work to aggregate it and show trends over time but that fizzled out | 21:04 |
| fungi | not past the log retention, which back when that was started was probably at least a full dev cycle but is no longer anywhere near that long | 21:04 |
| dhellmann | ok | 21:04 |
| *** larainema has quit IRC | 21:04 | |
| dhellmann | I hadn't seen that job before, so the fact that it was in post caught my eye | 21:04 |
| fungi | i think there's a qa spec for something to trend code coverage longer? | 21:04 |
| dhellmann | on a different note, there's not going to be a lot left in project-config/zuul.d/projects.yaml after we move project job settings in-tree | 21:07 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Report config errors when removing cross-repo jobs https://review.openstack.org/579997 | 21:08 |
| dhellmann | just the release jobs for most projects | 21:08 |
| *** kgiusti has left #openstack-infra | 21:09 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: WIP: unsuccessful attempt to reproduce zuul erratic behavior https://review.openstack.org/580765 | 21:09 |
| fungi | dhellmann: that sounds like... success? | 21:09 |
| dhellmann | I think so, yes :-) | 21:09 |
| dhellmann | there will be a very few with other master-only jobs | 21:09 |
| *** diablo_rojo has quit IRC | 21:14 | |
| *** kjackal has quit IRC | 21:15 | |
| *** nicolasbock_ has quit IRC | 21:15 | |
| *** trown is now known as trown|outtypewww | 21:15 | |
| *** eharney has joined #openstack-infra | 21:16 | |
| *** graphene has quit IRC | 21:19 | |
| *** graphene has joined #openstack-infra | 21:21 | |
| *** diablo_rojo has joined #openstack-infra | 21:23 | |
| *** jesslampe has joined #openstack-infra | 21:33 | |
| *** jesslampe has quit IRC | 21:33 | |
| *** jesslampe has joined #openstack-infra | 21:34 | |
| *** rosmaita has quit IRC | 21:40 | |
| *** agopi has quit IRC | 21:41 | |
| *** pfallenop has joined #openstack-infra | 21:51 | |
| *** edmondsw_ has quit IRC | 21:53 | |
| *** yolanda_ has joined #openstack-infra | 21:53 | |
| openstackgerrit | Merged openstack-infra/python-storyboardclient master: uncap pbr https://review.openstack.org/580735 | 21:55 |
| *** yolanda__ has quit IRC | 21:56 | |
| *** pfallenop has quit IRC | 22:10 | |
| *** pfallenop has joined #openstack-infra | 22:10 | |
| *** mriedem has quit IRC | 22:12 | |
| *** jesslampe has quit IRC | 22:12 | |
| *** ldnunes has quit IRC | 22:22 | |
| *** hongbin has quit IRC | 22:25 | |
| *** neiloy has quit IRC | 22:32 | |
| openstackgerrit | Jill Rouleau proposed openstack-infra/project-config master: Adding Ansible roles for TripleO https://review.openstack.org/579950 | 22:33 |
| *** Goneri has quit IRC | 22:33 | |
| *** dbecker has quit IRC | 22:35 | |
| *** dbecker has joined #openstack-infra | 22:41 | |
| *** edmondsw has joined #openstack-infra | 22:49 | |
| *** edmondsw has quit IRC | 22:54 | |
| *** yolanda__ has joined #openstack-infra | 23:04 | |
| *** eharney has quit IRC | 23:04 | |
| *** dhajare has joined #openstack-infra | 23:05 | |
| *** yolanda_ has quit IRC | 23:06 | |
| *** yolanda has joined #openstack-infra | 23:07 | |
| *** yolanda__ has quit IRC | 23:09 | |
| clarkb | mnaser: mwhahaha http://logs.openstack.org/59/580059/1/gate/puppet-openstack-unit-4.8-centos-7/1d5030c/job-output.txt.gz#_2018-07-06_21_31_18_817965 that seems to be affecting tripleo gate | 23:11 |
| clarkb | did the puppet package get renamed or moved? | 23:11 |
| *** graphene has quit IRC | 23:13 | |
| mwhahaha | That's probably a question for #rdo. Not sure | 23:13 |
| mwhahaha | weshay: -^ | 23:13 |
| mwhahaha | We use whatever mirrors that we're loaded in the images, did those change? | 23:14 |
| mwhahaha | EmilienM: where did we get puppet for on the base images? | 23:14 |
| *** graphene has joined #openstack-infra | 23:14 | |
| clarkb | we haven't changed our mirrors, but we do mirror what upstream publsih so they may have changed upstream | 23:15 |
| clarkb | might be more accurate to say "we haven't changed the mirror configuration and hosting, but the contents are synced from upstream and may change as a result" | 23:15 |
| *** rlandy has quit IRC | 23:16 | |
| mwhahaha | so i have no idea what the default yum repos are in the mirrors | 23:20 |
| mwhahaha | cause they aren't captured in that job | 23:20 |
| EmilienM | afik we get the rpm from rdo | 23:21 |
| EmilienM | but I haven't followed the recent changes if any | 23:21 |
| EmilienM | or maybe puppetlabs? | 23:22 |
| EmilienM | let me check | 23:22 |
| *** dbecker has quit IRC | 23:22 | |
| mwhahaha | EmilienM: no the bindep one we pull from the default repos | 23:23 |
| mwhahaha | so if we aren't installing the rdo repos in the images anymore, that would do it | 23:23 |
| mwhahaha | like i said it's hard to tell from those jobs because we don't capture /etc | 23:23 |
| *** rpioso is now known as rpioso|afk | 23:23 | |
| mwhahaha | we don't even use the local one because we install a specific version later i think | 23:23 |
| EmilienM | yeah but I remember they deploy rdo / ocata repo in the image | 23:23 |
| EmilienM | or maybe not anymore | 23:23 |
| * mwhahaha shrugs and has to run | 23:24 | |
| clarkb | epel is disabled but present (you can opt into enabling it per yum call | 23:25 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: WIP: Add a role to return file comments https://review.openstack.org/579033 | 23:25 |
| clarkb | I want ot say we stopped installing rdo for ovs a long time ago but I am double checking | 23:25 |
| *** dhajare has quit IRC | 23:27 | |
| *** cshastri has joined #openstack-infra | 23:28 | |
| *** auristor has quit IRC | 23:30 | |
| clarkb | https://review.openstack.org/#/c/519535/ was removed november 23, 2017 | 23:30 |
| *** dbecker has joined #openstack-infra | 23:33 | |
| clarkb | puppet is not a valid package at http://mirror.centos.org/centos/7/os/x86_64/Packages/ so it would have to be in epel but that is disabled I think | 23:35 |
| *** rcernin has joined #openstack-infra | 23:36 | |
| *** masuberu has joined #openstack-infra | 23:38 | |
| clarkb | EmilienM: mwhahaha mordred I0689acb53789d3650926a3e11aec4570df5d950c is what broke it | 23:38 |
| clarkb | http://git.openstack.org/cgit/openstack/puppet-tripleo/tree/bindep.txt#n12 the build tag collided and now we try to install puppet | 23:38 |
| clarkb | and there is no puppet package in the centos base repo | 23:38 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: configure-mirrors: add set_epel_repository option https://review.openstack.org/580781 | 23:39 |
| clarkb | I'm not sure what the bset way forward on that is, if mordred is around his input would be appreciated. We can revert the zuul-jobs change or update the puppet-tripleo bindep tag | 23:39 |
| *** masber has quit IRC | 23:41 | |
| *** yolanda_ has joined #openstack-infra | 23:43 | |
| fungi | clarkb: oh! so there was a repo already using a bindep profile called "build"? | 23:44 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: configure-mirrors: skip system mirrors if zuul can't sudo https://review.openstack.org/580782 | 23:45 |
| pabelanger | yes, puppet modules IIRC | 23:45 |
| pabelanger | clarkb: sadly we still get ovs from rdo, see: https://review.openstack.org/580518/ | 23:45 |
| pabelanger | I'd love to drop that dependency | 23:45 |
| *** yolanda has quit IRC | 23:46 | |
| fungi | clarkb: mordred: perhaps we should revert that series and/or pick a better name (after scanning our repos to find out if anyone's using it for a profile already)? | 23:46 |
| *** auristor has joined #openstack-infra | 23:47 | |
| clarkb | pabelanger: but that isnt baked into the image anymore | 23:47 |
| clarkb | it is only used when necessary | 23:47 |
| clarkb | fungi ya that might be best way forward | 23:48 |
| clarkb | I've got babysitter showing up in 10 minutes so if someone else can drive the bindep cleanup that would be great | 23:49 |
| pabelanger | clarkb: right, we use ubuntu lts for doing puppet builds, not centos | 23:49 |
| pabelanger | that's why it has been working | 23:50 |
| pabelanger | but agree, we should maybe revert | 23:50 |
| pabelanger | but just heading out the door now | 23:50 |
| fungi | i can get to it in a few | 23:50 |
| clarkb | pabelanger: that isnt used for puppet though, it is orthogonal | 23:51 |
| clarkb | it was only ever used for ovs to get multinode networking | 23:51 |
| clarkb | it breaks now because we try to install puppet due to the bindep profile named 'build' | 23:52 |
| clarkb | and until we figure out how to stop using ovs or to get ovs into rhel/centos that will continue | 23:53 |
| clarkb | or just dont do multinode testing on centos | 23:53 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!