| *** gouthamr has joined #openstack-infra | 00:11 | |
| *** sflanigan_afk has joined #openstack-infra | 00:12 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/shade master: Use unicode match for name_or_id https://review.openstack.org/440924 | 00:12 |
|---|---|---|
| *** wolverineav has joined #openstack-infra | 00:12 | |
| *** camunoz has joined #openstack-infra | 00:16 | |
| *** wolverineav has quit IRC | 00:17 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/devstack-gate master: WIP: test running dsvm with searchlight https://review.openstack.org/441696 | 00:19 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Merge remote-tracking branch 'origin/feature/v2' into merge-branch https://review.openstack.org/441723 | 00:25 |
| *** amotoki has joined #openstack-infra | 00:27 | |
| *** ssbarnea has quit IRC | 00:27 | |
| *** esikachev has joined #openstack-infra | 00:31 | |
| *** wolverineav has joined #openstack-infra | 00:33 | |
| *** aeng has quit IRC | 00:34 | |
| *** esikachev has quit IRC | 00:36 | |
| *** tonytan_brb has joined #openstack-infra | 00:36 | |
| *** wolverineav has quit IRC | 00:37 | |
| *** tonytan4ever has quit IRC | 00:39 | |
| *** zz_dimtruck is now known as dimtruck | 00:45 | |
| *** aeng has joined #openstack-infra | 00:46 | |
| *** esikachev has joined #openstack-infra | 00:50 | |
| *** salv-orlando has joined #openstack-infra | 00:53 | |
| *** wolverineav has joined #openstack-infra | 00:53 | |
| *** gildub has joined #openstack-infra | 00:54 | |
| *** salv-orlando has quit IRC | 00:54 | |
| *** salv-orlando has joined #openstack-infra | 00:54 | |
| *** esikachev has quit IRC | 00:54 | |
| *** salv-orl_ has quit IRC | 00:55 | |
| *** markvoelker has joined #openstack-infra | 00:56 | |
| *** wolverineav has quit IRC | 00:58 | |
| *** gildub has quit IRC | 00:59 | |
| *** dave-mccowan has joined #openstack-infra | 01:00 | |
| *** wolverineav has joined #openstack-infra | 01:04 | |
| *** liusheng has quit IRC | 01:04 | |
| *** dimtruck is now known as zz_dimtruck | 01:04 | |
| *** zz_dimtruck is now known as dimtruck | 01:04 | |
| *** wolverineav has quit IRC | 01:08 | |
| *** aviau has quit IRC | 01:08 | |
| *** aviau has joined #openstack-infra | 01:08 | |
| *** yamamoto_ has joined #openstack-infra | 01:10 | |
| *** zhurong has joined #openstack-infra | 01:13 | |
| *** esikachev has joined #openstack-infra | 01:13 | |
| *** dimtruck is now known as zz_dimtruck | 01:13 | |
| *** liujiong has joined #openstack-infra | 01:14 | |
| *** erlon has quit IRC | 01:15 | |
| *** esikachev has quit IRC | 01:20 | |
| *** zz_dimtruck is now known as dimtruck | 01:21 | |
| *** yamamoto_ has quit IRC | 01:21 | |
| *** wolverineav has joined #openstack-infra | 01:24 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/project-config master: Don't run check-requirements on old branches fro networking-bgppvn https://review.openstack.org/441725 | 01:25 |
| *** yamamoto_ has joined #openstack-infra | 01:25 | |
| *** wolverineav has quit IRC | 01:28 | |
| *** yamamoto_ has quit IRC | 01:29 | |
| *** yamamoto_ has joined #openstack-infra | 01:29 | |
| *** dhinesh has quit IRC | 01:29 | |
| *** aeng has quit IRC | 01:32 | |
| *** wolverineav has joined #openstack-infra | 01:32 | |
| *** wolverineav has quit IRC | 01:36 | |
| *** yamamoto_ has quit IRC | 01:39 | |
| *** dave-mccowan has quit IRC | 01:40 | |
| *** wolverineav has joined #openstack-infra | 01:42 | |
| *** aeng has joined #openstack-infra | 01:46 | |
| *** wolverineav has quit IRC | 01:47 | |
| *** apetrich has quit IRC | 01:52 | |
| *** wolverineav has joined #openstack-infra | 01:53 | |
| *** chlong__ has joined #openstack-infra | 01:55 | |
| *** wolverineav has quit IRC | 01:57 | |
| openstackgerrit | Chaoyi Huang proposed openstack-infra/irc-meetings master: Update meeting time, chair and description for Tricircle meetings https://review.openstack.org/441727 | 01:57 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: layout/tripleo: make scenarios upgrades voting on stable/ocata https://review.openstack.org/440723 | 02:05 |
| *** gongysh has joined #openstack-infra | 02:05 | |
| *** Goneri has joined #openstack-infra | 02:05 | |
| *** esikachev has joined #openstack-infra | 02:10 | |
| *** wolverineav has joined #openstack-infra | 02:12 | |
| *** Goneri has quit IRC | 02:14 | |
| *** zhurong has quit IRC | 02:15 | |
| *** esikachev has quit IRC | 02:16 | |
| *** wolverineav has quit IRC | 02:17 | |
| *** zhurong has joined #openstack-infra | 02:19 | |
| *** liusheng has joined #openstack-infra | 02:19 | |
| *** gildub has joined #openstack-infra | 02:19 | |
| *** wolverineav has joined #openstack-infra | 02:23 | |
| *** wolverineav has quit IRC | 02:27 | |
| *** dave-mccowan has joined #openstack-infra | 02:29 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/441731 | 02:31 |
| *** winggundamth has joined #openstack-infra | 02:34 | |
| *** yamamoto_ has joined #openstack-infra | 02:36 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/441731 | 02:38 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/441731 | 02:42 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: A couple small test improvements https://review.openstack.org/437592 | 02:47 |
| *** yujunz has joined #openstack-infra | 02:49 | |
| *** wolverineav has joined #openstack-infra | 02:53 | |
| *** esikachev has joined #openstack-infra | 02:53 | |
| *** apetrich has joined #openstack-infra | 02:53 | |
| *** esikachev has quit IRC | 02:57 | |
| *** wolverineav has quit IRC | 02:57 | |
| *** esikachev has joined #openstack-infra | 02:58 | |
| *** warby has joined #openstack-infra | 03:03 | |
| *** yatinkarel has joined #openstack-infra | 03:04 | |
| *** esikachev has quit IRC | 03:05 | |
| *** ihrachys has joined #openstack-infra | 03:06 | |
| *** thorst has quit IRC | 03:08 | |
| *** esikachev has joined #openstack-infra | 03:12 | |
| *** wolverineav has joined #openstack-infra | 03:13 | |
| *** esikachev has quit IRC | 03:17 | |
| *** wolverineav has quit IRC | 03:18 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Update meeting time, chair and description for Tricircle meetings https://review.openstack.org/441727 | 03:18 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: dib: run feature/v2 on trusty too https://review.openstack.org/441735 | 03:18 |
| *** wolverineav has joined #openstack-infra | 03:23 | |
| *** esikachev has joined #openstack-infra | 03:25 | |
| *** dhinesh has joined #openstack-infra | 03:26 | |
| *** wolverineav has quit IRC | 03:27 | |
| *** esikachev has quit IRC | 03:30 | |
| *** knangia has quit IRC | 03:31 | |
| openstackgerrit | Merged openstack-infra/project-config master: Skip non-doc checks for deployment guide in Kolla https://review.openstack.org/441245 | 03:31 |
| *** jiaohaolin has joined #openstack-infra | 03:32 | |
| openstackgerrit | Joseph Robinson proposed openstack-infra/project-config master: [deploy-guide] Add Kolla Deploy Guide https://review.openstack.org/441737 | 03:34 |
| *** wolverineav has joined #openstack-infra | 03:34 | |
| *** tlian has joined #openstack-infra | 03:34 | |
| jiaohaolin | hey guys Which version of pep8 dose openstack use to check code? | 03:36 |
| jiaohaolin | I use pep8==1.7.0 to check code ,but the code can not pass the jenkin-pep8 test. | 03:37 |
| *** esikachev has joined #openstack-infra | 03:37 | |
| *** wolverineav has quit IRC | 03:38 | |
| clarkb | jiaohaolin: you can check the pip freeze output in the job log | 03:39 |
| clarkb | should tell you exact versions for everything. Use tox -r -e pep8 to reproduce locally | 03:39 |
| jiaohaolin | clarkb: ??? | 03:42 |
| *** esikachev has quit IRC | 03:42 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add manila-tempest-minimal-dsvm-lvm-centos-7 job https://review.openstack.org/439623 | 03:47 |
| *** esikachev has joined #openstack-infra | 03:50 | |
| *** sree has joined #openstack-infra | 03:51 | |
| *** wolverineav has joined #openstack-infra | 03:54 | |
| *** esikachev has quit IRC | 03:54 | |
| *** apetrich has quit IRC | 03:54 | |
| openstackgerrit | Merged openstack-infra/project-config master: [Manila] Add proper skip filters for special manila tempest jobs https://review.openstack.org/440748 | 03:55 |
| openstackgerrit | Merged openstack-infra/project-config master: layout/tripleo: Run multinode-scenario002 on ec2 changes https://review.openstack.org/441115 | 03:55 |
| frickler | Delay in Elastic Search: Indexing behind by 33 hours | 03:56 |
| openstackgerrit | Merged openstack-infra/project-config master: [Fuxi] Add python-manilaclient in py35 job https://review.openstack.org/441635 | 03:56 |
| jamielennox | hey, reminder for when anyone is around, can we please release a JJB 1.6.2 from the current head of the stable/1.6 branch | 03:58 |
| *** wolverineav has quit IRC | 03:58 | |
| *** dave-mccowan has quit IRC | 04:03 | |
| *** esikachev has joined #openstack-infra | 04:03 | |
| *** esikachev has quit IRC | 04:07 | |
| *** spotz_zzz is now known as spotz | 04:13 | |
| openstackgerrit | Merged openstack-infra/project-config master: Enable nova-lxd project in octavia https://review.openstack.org/440751 | 04:13 |
| *** wolverineav has joined #openstack-infra | 04:13 | |
| *** esikachev has joined #openstack-infra | 04:16 | |
| openstackgerrit | Merged openstack-infra/project-config master: move networking-odl vpnservice as non-voting gate jobs https://review.openstack.org/440167 | 04:16 |
| *** wolverineav has quit IRC | 04:18 | |
| *** tlian has quit IRC | 04:20 | |
| *** adriant has quit IRC | 04:20 | |
| *** esikachev has quit IRC | 04:20 | |
| openstackgerrit | Merged openstack-infra/project-config master: Revert installation of barbican-tempect-plugin https://review.openstack.org/437125 | 04:22 |
| *** markvoelker has quit IRC | 04:23 | |
| *** esikachev has joined #openstack-infra | 04:28 | |
| *** thorst has joined #openstack-infra | 04:28 | |
| *** thorst has quit IRC | 04:28 | |
| *** esikachev has quit IRC | 04:32 | |
| *** wolverineav has joined #openstack-infra | 04:34 | |
| *** wolverineav has quit IRC | 04:38 | |
| *** esikachev has joined #openstack-infra | 04:40 | |
| *** yujunz has quit IRC | 04:41 | |
| *** wolverineav has joined #openstack-infra | 04:44 | |
| *** nadya has joined #openstack-infra | 04:44 | |
| *** esikachev has quit IRC | 04:45 | |
| *** wolverineav has quit IRC | 04:48 | |
| *** psachin has joined #openstack-infra | 04:49 | |
| *** nmathew has joined #openstack-infra | 04:50 | |
| *** esikachev has joined #openstack-infra | 04:51 | |
| *** pahuang has quit IRC | 04:51 | |
| *** nadya has quit IRC | 04:51 | |
| *** wolverineav has joined #openstack-infra | 04:54 | |
| *** esikachev has quit IRC | 04:55 | |
| *** pahuang has joined #openstack-infra | 04:58 | |
| *** wolverineav has quit IRC | 04:59 | |
| *** claudiub has joined #openstack-infra | 04:59 | |
| *** esikachev has joined #openstack-infra | 05:04 | |
| *** csomerville has joined #openstack-infra | 05:05 | |
| openstackgerrit | Masayuki Igawa proposed openstack/gertty master: Make size column configurable graph https://review.openstack.org/380950 | 05:07 |
| *** esikachev has quit IRC | 05:08 | |
| *** cody-somerville has quit IRC | 05:09 | |
| *** esikachev has joined #openstack-infra | 05:13 | |
| *** wolverineav has joined #openstack-infra | 05:15 | |
| *** esikachev has quit IRC | 05:18 | |
| *** wolverineav has quit IRC | 05:19 | |
| *** askb has joined #openstack-infra | 05:20 | |
| *** markvoelker has joined #openstack-infra | 05:24 | |
| *** markvoelker has quit IRC | 05:29 | |
| *** thorst has joined #openstack-infra | 05:29 | |
| *** thorst has quit IRC | 05:34 | |
| *** timothyb89 has quit IRC | 05:35 | |
| *** wolverineav has joined #openstack-infra | 05:35 | |
| *** timothyb89 has joined #openstack-infra | 05:35 | |
| *** wolverineav has quit IRC | 05:39 | |
| *** amotoki_ has joined #openstack-infra | 05:42 | |
| *** psachin has quit IRC | 05:42 | |
| *** vikrant has joined #openstack-infra | 05:44 | |
| *** wolverineav has joined #openstack-infra | 05:45 | |
| *** amotoki has quit IRC | 05:46 | |
| *** wolverineav has quit IRC | 05:49 | |
| *** saibarspeis has joined #openstack-infra | 05:50 | |
| *** tonytan_brb has quit IRC | 05:51 | |
| *** hichihara has joined #openstack-infra | 05:51 | |
| *** wolverineav has joined #openstack-infra | 05:55 | |
| *** wolverineav has quit IRC | 05:59 | |
| *** gouthamr has quit IRC | 06:02 | |
| *** wolverineav has joined #openstack-infra | 06:05 | |
| *** eroux has quit IRC | 06:05 | |
| *** rcernin has joined #openstack-infra | 06:08 | |
| *** wolverineav has quit IRC | 06:09 | |
| *** apetrich has joined #openstack-infra | 06:13 | |
| *** abregman has joined #openstack-infra | 06:15 | |
| *** wolverineav has joined #openstack-infra | 06:15 | |
| *** warby has quit IRC | 06:16 | |
| *** wolverineav has quit IRC | 06:20 | |
| *** yujunz has joined #openstack-infra | 06:21 | |
| *** dhajare has joined #openstack-infra | 06:22 | |
| *** pgadiya has joined #openstack-infra | 06:22 | |
| *** wolverineav has joined #openstack-infra | 06:25 | |
| *** alexchadin has joined #openstack-infra | 06:26 | |
| *** wolverineav has quit IRC | 06:29 | |
| *** kornica is now known as kornicameiter | 06:30 | |
| *** kornicameiter is now known as kornicameister | 06:30 | |
| *** thorst has joined #openstack-infra | 06:30 | |
| *** thorst has quit IRC | 06:34 | |
| *** wolverineav has joined #openstack-infra | 06:35 | |
| *** wolverineav has quit IRC | 06:40 | |
| *** bgaifullin has joined #openstack-infra | 06:40 | |
| *** yujunz has quit IRC | 06:41 | |
| *** markvoelker has joined #openstack-infra | 06:44 | |
| *** wolverineav has joined #openstack-infra | 06:45 | |
| *** wolverineav has quit IRC | 06:49 | |
| *** dimtruck is now known as zz_dimtruck | 06:49 | |
| *** zz_dimtruck is now known as dimtruck | 06:49 | |
| *** bhavik1 has joined #openstack-infra | 06:50 | |
| *** knangia has joined #openstack-infra | 06:50 | |
| *** salv-orl_ has joined #openstack-infra | 06:53 | |
| *** yujunz has joined #openstack-infra | 06:54 | |
| *** camunoz has quit IRC | 06:54 | |
| *** salv-orlando has quit IRC | 06:56 | |
| *** wolverineav has joined #openstack-infra | 06:56 | |
| *** yujunz has quit IRC | 06:57 | |
| *** pcaruana has joined #openstack-infra | 06:58 | |
| *** yujunz has joined #openstack-infra | 06:58 | |
| *** dimtruck is now known as zz_dimtruck | 06:59 | |
| *** liusheng has quit IRC | 07:00 | |
| *** wolverineav has quit IRC | 07:00 | |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Correct the quota/availability algorithm https://review.openstack.org/440780 | 07:04 |
| *** florianf has joined #openstack-infra | 07:05 | |
| *** pcaruana has quit IRC | 07:05 | |
| *** wolverineav has joined #openstack-infra | 07:05 | |
| *** pcaruana has joined #openstack-infra | 07:06 | |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Only use ready nodes from the same provider. https://review.openstack.org/441270 | 07:06 |
| *** liusheng has joined #openstack-infra | 07:06 | |
| *** gildub has quit IRC | 07:06 | |
| *** AJaeger has quit IRC | 07:07 | |
| *** wolverineav has quit IRC | 07:10 | |
| *** tesseract has joined #openstack-infra | 07:13 | |
| *** saibarspeis has quit IRC | 07:15 | |
| *** wolverineav has joined #openstack-infra | 07:15 | |
| *** wolverineav has quit IRC | 07:20 | |
| *** andreas_s has joined #openstack-infra | 07:24 | |
| *** ihrachys has quit IRC | 07:25 | |
| *** wolverineav has joined #openstack-infra | 07:26 | |
| *** ihrachys has joined #openstack-infra | 07:26 | |
| *** eroux has joined #openstack-infra | 07:27 | |
| *** yatinkarel has quit IRC | 07:28 | |
| *** jaosorior has joined #openstack-infra | 07:30 | |
| *** ihrachys has quit IRC | 07:30 | |
| *** wolverineav has quit IRC | 07:30 | |
| *** nadya has joined #openstack-infra | 07:34 | |
| *** AJaeger has joined #openstack-infra | 07:35 | |
| AJaeger | infra-root, docs.openstack.org is dead slow - could somebody investigate, please? | 07:35 |
| *** ihrachys has joined #openstack-infra | 07:36 | |
| *** wolverineav has joined #openstack-infra | 07:36 | |
| *** chlong__ has quit IRC | 07:36 | |
| *** ramineni has left #openstack-infra | 07:37 | |
| *** esikachev has joined #openstack-infra | 07:39 | |
| *** ralonsoh has joined #openstack-infra | 07:40 | |
| *** eranrom has quit IRC | 07:40 | |
| *** wolverineav has quit IRC | 07:40 | |
| *** ihrachys has quit IRC | 07:40 | |
| *** eranrom_ has joined #openstack-infra | 07:40 | |
| *** markus_z has joined #openstack-infra | 07:44 | |
| *** jiaohaolin has quit IRC | 07:45 | |
| *** jiaohaolin has joined #openstack-infra | 07:47 | |
| *** dhinesh has quit IRC | 07:50 | |
| *** dimak has joined #openstack-infra | 07:53 | |
| *** ihrachys has joined #openstack-infra | 07:56 | |
| *** alexchadin has quit IRC | 07:59 | |
| *** alexchadin has joined #openstack-infra | 08:00 | |
| *** ihrachys has quit IRC | 08:00 | |
| *** wolverineav has joined #openstack-infra | 08:06 | |
| *** lewo has quit IRC | 08:06 | |
| *** danielitit_ has joined #openstack-infra | 08:06 | |
| *** lewo has joined #openstack-infra | 08:06 | |
| *** jbadiapa has joined #openstack-infra | 08:09 | |
| *** wolverineav has quit IRC | 08:10 | |
| *** jiaohaolin has left #openstack-infra | 08:10 | |
| *** gibi has joined #openstack-infra | 08:15 | |
| *** ihrachys has joined #openstack-infra | 08:16 | |
| *** yujunz has quit IRC | 08:19 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job with MySQL https://review.openstack.org/425295 | 08:19 |
| *** yuval has joined #openstack-infra | 08:20 | |
| *** ihrachys has quit IRC | 08:20 | |
| *** larainema has quit IRC | 08:22 | |
| *** yujunz has joined #openstack-infra | 08:23 | |
| *** yujunz has quit IRC | 08:24 | |
| *** ihrachys has joined #openstack-infra | 08:26 | |
| *** hichihara has quit IRC | 08:27 | |
| *** yujunz has joined #openstack-infra | 08:29 | |
| *** ihrachys has quit IRC | 08:31 | |
| *** thorst has joined #openstack-infra | 08:32 | |
| *** bauwser is now known as bauzas | 08:34 | |
| *** ramineni has joined #openstack-infra | 08:35 | |
| *** nmathew- has joined #openstack-infra | 08:35 | |
| *** thorst has quit IRC | 08:36 | |
| *** nmathew has quit IRC | 08:38 | |
| ramineni | AJaeger: hi | 08:44 |
| *** ccamacho has joined #openstack-infra | 08:47 | |
| *** rwsu has quit IRC | 08:47 | |
| *** liusheng has quit IRC | 08:48 | |
| *** liusheng has joined #openstack-infra | 08:49 | |
| openstackgerrit | Claudiu Belu proposed openstack-infra/project-config master: Adds python-hnvclient repository https://review.openstack.org/441810 | 08:50 |
| *** jpich has joined #openstack-infra | 08:50 | |
| *** markvoelker_ has joined #openstack-infra | 08:51 | |
| *** eranrom_ is now known as eranrom | 08:52 | |
| *** dingyichen has quit IRC | 08:53 | |
| openstackgerrit | Peter Razumovsky proposed openstack-infra/project-config master: Add new repo fuel-ccp-elasticsearch https://review.openstack.org/439567 | 08:54 |
| *** markvoelker has quit IRC | 08:54 | |
| *** zzzeek has quit IRC | 09:00 | |
| *** zzzeek has joined #openstack-infra | 09:00 | |
| *** yamamoto_ has quit IRC | 09:00 | |
| *** shardy has joined #openstack-infra | 09:00 | |
| *** rwsu has joined #openstack-infra | 09:01 | |
| *** pgadiya has quit IRC | 09:01 | |
| *** rossella_s has joined #openstack-infra | 09:01 | |
| *** amoralej|off is now known as amoralej | 09:04 | |
| *** isaacb has joined #openstack-infra | 09:04 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Add OSOps Team meeting https://review.openstack.org/439124 | 09:07 |
| *** sshnaidm|off is now known as sshnaidm | 09:13 | |
| *** e0ne has joined #openstack-infra | 09:13 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/infra-manual master: No longer ask to add openstack-release https://review.openstack.org/441823 | 09:14 |
| *** pgadiya has joined #openstack-infra | 09:14 | |
| *** d0ugal has quit IRC | 09:14 | |
| *** nmathew- has quit IRC | 09:15 | |
| *** neiljerram has joined #openstack-infra | 09:22 | |
| *** d0ugal has joined #openstack-infra | 09:26 | |
| *** d0ugal has quit IRC | 09:26 | |
| *** d0ugal has joined #openstack-infra | 09:26 | |
| *** yujunz has quit IRC | 09:30 | |
| *** thorst has joined #openstack-infra | 09:33 | |
| *** markus_z has quit IRC | 09:35 | |
| *** thorst has quit IRC | 09:37 | |
| openstackgerrit | Neil Jerram proposed openstack-infra/irc-meetings master: Remove networking-calico meeting https://review.openstack.org/441847 | 09:38 |
| *** esikachev has quit IRC | 09:38 | |
| *** wolverineav has joined #openstack-infra | 09:39 | |
| *** esikachev has joined #openstack-infra | 09:41 | |
| *** derekh has joined #openstack-infra | 09:42 | |
| *** abregman is now known as abregman|mtg | 09:42 | |
| *** abregman|mtg has quit IRC | 09:42 | |
| *** lucas-afk is now known as lucasagomes | 09:43 | |
| *** wolverineav has quit IRC | 09:44 | |
| *** abregman has joined #openstack-infra | 09:44 | |
| *** ssbarnea has joined #openstack-infra | 09:47 | |
| *** wolverineav has joined #openstack-infra | 09:49 | |
| *** sree has quit IRC | 09:52 | |
| openstackgerrit | Merged openstack-infra/project-config master: Retire networking-ofagent https://review.openstack.org/441483 | 09:52 |
| *** markus_z has joined #openstack-infra | 09:52 | |
| *** tosky has joined #openstack-infra | 09:52 | |
| *** sree has joined #openstack-infra | 09:53 | |
| *** wolverineav has quit IRC | 09:54 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add Tricircle multi-region job https://review.openstack.org/414909 | 09:56 |
| andreaf | hello infra folks - according to http://status.openstack.org/elastic-recheck/ elastic search indexing is 39h behind - anyone who could look into it? | 09:56 |
| openstackgerrit | Merged openstack-infra/project-config master: karbor: enable swift multi-workers https://review.openstack.org/439262 | 09:57 |
| openstackgerrit | Merged openstack-infra/project-config master: add tripleo non-voting job into neutron & neutronclient gates https://review.openstack.org/433737 | 09:57 |
| *** tushar has joined #openstack-infra | 09:57 | |
| openstackgerrit | Merged openstack-infra/project-config master: Octavia / Barbican cross project testing https://review.openstack.org/436997 | 09:58 |
| *** electrofelix has joined #openstack-infra | 09:58 | |
| tushar | Hi | 09:58 |
| openstackgerrit | Merged openstack-infra/project-config master: Update patrole tempest devstack gate to use pre_test_hook. https://review.openstack.org/441191 | 09:59 |
| tushar | In cinder CI after moving from Trusty to xenial ..tempest testcases are failing | 09:59 |
| openstackgerrit | Merged openstack-infra/project-config master: Add ubuntu-mariadb to configure_mirror.sh https://review.openstack.org/440769 | 10:00 |
| openstackgerrit | Merged openstack-infra/project-config master: Turn on voting for Nova tox-functional-py35 job https://review.openstack.org/440826 | 10:00 |
| openstackgerrit | Merged openstack-infra/project-config master: Gate job for senlinclient functional test https://review.openstack.org/436338 | 10:00 |
| *** yujunz has joined #openstack-infra | 10:00 | |
| *** nadya has quit IRC | 10:00 | |
| *** nadya has joined #openstack-infra | 10:00 | |
| *** yujunz has quit IRC | 10:00 | |
| tushar | Anyone else facing same issue in Cinder CI? | 10:01 |
| *** nadya has quit IRC | 10:01 | |
| openstackgerrit | Merged openstack-infra/project-config master: gnocchi: test upgrade from 3.1 on master https://review.openstack.org/439656 | 10:01 |
| openstackgerrit | Merged openstack-infra/project-config master: Run Heat AMQP job in hybrid mode https://review.openstack.org/440674 | 10:03 |
| tushar | isaacb : Hii | 10:03 |
| isaacb | tushar: Hi | 10:04 |
| openstackgerrit | Merged openstack-infra/project-config master: Add ovsdbapp project https://review.openstack.org/438080 | 10:04 |
| tushar | isaacb : you were facing some isuue in CI while running on Xenial. For Cinder iSCSI | 10:05 |
| isaacb | tushar: yes | 10:06 |
| tushar | isaacb : Is there any change required in CI configuration ? | 10:06 |
| *** s-shiono has quit IRC | 10:06 | |
| *** mdbooth_ is now known as mdbooth | 10:08 | |
| isaacb | tushar: No. but there was a change in the configuration to include localrc in local.conf (But it's not connected to Ubuntu xenial) | 10:08 |
| *** john-davidge has joined #openstack-infra | 10:09 | |
| *** wolverineav has joined #openstack-infra | 10:09 | |
| openstackgerrit | liusheng proposed openstack-infra/project-config master: Add OpenStackClient plugin jobs for python-pankoclient https://review.openstack.org/441861 | 10:09 |
| tushar | isaacb : Yes I already did that changes to include localrc in local.conf.. After this FC is running properly but there is failure in ISCSI | 10:10 |
| isaacb | tushar: I had problem with iSCSI also. Did you change the initiator name? | 10:11 |
| *** alexchadin has quit IRC | 10:11 | |
| openstackgerrit | Claudiu Belu proposed openstack-infra/project-config master: Adds python-hnvclient repository https://review.openstack.org/441810 | 10:13 |
| tushar | isaacb : What problem you had with iSCSI? I havnt change the initiator name | 10:13 |
| *** wolverineav has quit IRC | 10:14 | |
| isaacb | tushar: I'm using DIB to create the images for the VMs. In order to the initiator to be unique for each VM, you need to change it after the VM is created. | 10:15 |
| *** user` has joined #openstack-infra | 10:15 | |
| *** user` is now known as chem | 10:16 | |
| isaacb | tushar: after you change it, you need to restart open-iscsi and iscsid | 10:16 |
| *** chem has quit IRC | 10:16 | |
| *** chem has joined #openstack-infra | 10:16 | |
| *** liujiong has quit IRC | 10:17 | |
| tushar | isaacb : where you are changing the initiator name? | 10:18 |
| isaacb | tushar: In the jenkins job | 10:19 |
| tushar | isaacb : ok | 10:22 |
| *** sdague has joined #openstack-infra | 10:25 | |
| *** Haaibo has joined #openstack-infra | 10:25 | |
| *** Gk-1wm-su has joined #openstack-infra | 10:26 | |
| *** Gk-1wm-su has left #openstack-infra | 10:26 | |
| *** Gk-1wm-su has joined #openstack-infra | 10:28 | |
| *** abregman has quit IRC | 10:29 | |
| *** bhavik1 has quit IRC | 10:29 | |
| *** wolverineav has joined #openstack-infra | 10:29 | |
| *** openstackgerrit has quit IRC | 10:33 | |
| *** thorst has joined #openstack-infra | 10:34 | |
| *** yujunz has joined #openstack-infra | 10:34 | |
| *** wolverineav has quit IRC | 10:34 | |
| *** Gk-1wm-su has quit IRC | 10:35 | |
| *** yujunz-zte has joined #openstack-infra | 10:35 | |
| *** yujunz has quit IRC | 10:36 | |
| *** ssbarnea has quit IRC | 10:36 | |
| *** ssbarnea has joined #openstack-infra | 10:37 | |
| *** thorst has quit IRC | 10:38 | |
| *** amotoki_ has quit IRC | 10:40 | |
| *** wolverineav has joined #openstack-infra | 10:40 | |
| *** knangia has quit IRC | 10:41 | |
| *** nadya has joined #openstack-infra | 10:42 | |
| *** abregman has joined #openstack-infra | 10:42 | |
| *** wolverineav has quit IRC | 10:44 | |
| *** dtantsur|afk is now known as dtantsur | 10:46 | |
| *** alexchadin has joined #openstack-infra | 10:48 | |
| *** wolverineav has joined #openstack-infra | 10:57 | |
| *** sambetts|afk is now known as sambetts | 10:58 | |
| *** esikachev has quit IRC | 11:00 | |
| *** wolverineav has quit IRC | 11:01 | |
| *** markus_z has quit IRC | 11:03 | |
| *** nicolasbock has joined #openstack-infra | 11:05 | |
| *** flepied has quit IRC | 11:08 | |
| *** sdague has quit IRC | 11:13 | |
| *** sdague_ has joined #openstack-infra | 11:14 | |
| *** sdague has joined #openstack-infra | 11:14 | |
| *** sdague has quit IRC | 11:16 | |
| *** sdague_ is now known as sdague | 11:16 | |
| *** wolverineav has joined #openstack-infra | 11:17 | |
| *** sree has quit IRC | 11:21 | |
| *** gongysh has quit IRC | 11:21 | |
| *** sree has joined #openstack-infra | 11:21 | |
| *** wolverineav has quit IRC | 11:22 | |
| *** sree has quit IRC | 11:26 | |
| *** shardy has quit IRC | 11:26 | |
| *** shardy has joined #openstack-infra | 11:26 | |
| *** openstackgerrit has joined #openstack-infra | 11:28 | |
| openstackgerrit | Alexander Evseev proposed openstack-infra/jenkins-job-builder master: Add the Slave Prerequisites properties plugin https://review.openstack.org/441893 | 11:28 |
| *** alexchadin has quit IRC | 11:28 | |
| *** isaacb has quit IRC | 11:29 | |
| *** furlongm has quit IRC | 11:32 | |
| *** furlongm has joined #openstack-infra | 11:32 | |
| tosky | hi infra team, I have a (nice) speedup for some of the sahara tests: https://review.openstack.org/#/c/439752/ | 11:33 |
| openstackgerrit | Alexander Evseev proposed openstack-infra/jenkins-job-builder master: Add the Slave Prerequisites properties plugin https://review.openstack.org/441893 | 11:35 |
| *** yujunz has joined #openstack-infra | 11:35 | |
| *** yujunz-zte has quit IRC | 11:36 | |
| *** wolverineav has joined #openstack-infra | 11:37 | |
| openstackgerrit | Merged openstack-infra/project-config master: Move undercloud-containers to check https://review.openstack.org/441597 | 11:37 |
| *** rossella_s has quit IRC | 11:37 | |
| odyssey4me | AJaeger I see a failure in parsing the jobs http://logs.openstack.org/17/419517/19/check/gate-project-config-jenkins-project/dcc536a/console.html#_2017-03-04_10_32_09_049065 - this is from https://review.openstack.org/419517 - the output isn't making it entirely clear to me where the issue lies, I'd appreciate some help figuring it out | 11:39 |
| odyssey4me | oh, I think I have it - jobs should be a list | 11:40 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: Add OSA periodic upgrade job https://review.openstack.org/419517 | 11:41 |
| *** wolverineav has quit IRC | 11:41 | |
| *** wolverineav has joined #openstack-infra | 11:42 | |
| *** alexchadin has joined #openstack-infra | 11:44 | |
| *** wolverin_ has joined #openstack-infra | 11:45 | |
| AJaeger | odyssey4me: commented. | 11:46 |
| *** wolverineav has quit IRC | 11:46 | |
| openstackgerrit | Merged openstack-infra/project-config master: layout/tripleo: run upgrade jobs only when needed https://review.openstack.org/441691 | 11:46 |
| odyssey4me | AJaeger OK, does that mean I do away with the job-group then? | 11:47 |
| vsaienk01 | sdague: fungi dansmith: please add to your review queue 2 line patch that exports tempest variables in grenade before running smoke tests https://review.openstack.org/#/c/438955/ | 11:48 |
| sdague | vsaienk01: where are those getting set? | 11:49 |
| vsaienk01 | they set in grenade localrc http://logs.openstack.org/57/436957/14/experimental/gate-grenade-dsvm-ironic-multinode-multitenant-ubuntu-xenial-nv/ff9774a/logs/grenade_localrc.txt.gz and are sourced | 11:50 |
| vsaienk01 | sdague: ^ they are sourced from grenade_localrc but not exported, so not visible in tempest | 11:50 |
| *** esikachev has joined #openstack-infra | 11:51 | |
| sdague | vsaienk01: ok, I guess I am curious why they are not set here - https://github.com/openstack/ironic/blob/d601a11e91e2010cf10f6438147b6a015984d5f2/devstack/upgrade/settings#L10 | 11:51 |
| sdague | because you could export there | 11:51 |
| *** ggherdov-___ is now known as ggherdov- | 11:52 | |
| vsaienk01 | sdague: yes we can export them in ironic, but why not export the in general, not only ironic might use them | 11:52 |
| *** larainema has joined #openstack-infra | 11:53 | |
| odyssey4me | AJaeger a more thorough question in the review as a comment to your comment | 11:53 |
| AJaeger | odyssey4me: oh, overlooked the job-group. Me checks again... | 11:53 |
| sdague | vsaienk01: because we're actually trying to get away from projects setting things in grenade localrc, which is custom logic in devstack-gate, instead of using grenade settings, which lets plugins do things on their own | 11:53 |
| vsaienk01 | sdague: ok, understood, will rework to apply on Ironic side, thanks! | 11:54 |
| *** tushar has quit IRC | 11:55 | |
| sdague | vsaienk01: I think we should either do that, or put the export directly in d-g | 11:55 |
| sdague | https://github.com/openstack-infra/devstack-gate/blob/89a0b50c8584103af7406ae413f62e0e7afbb432/devstack-vm-gate.sh#L627 | 11:55 |
| sdague | but doing custom per var export in line in grenade seems like the wrong option | 11:56 |
| AJaeger | sdague: could you comment on https://review.openstack.org/438347 , please? | 11:57 |
| openstackgerrit | Claudiu Belu proposed openstack-infra/project-config master: Adds python-hnvclient repository https://review.openstack.org/441810 | 11:58 |
| *** zhurong has quit IRC | 11:58 | |
| vsaienk01 | sdague: so what you suggest update d-g? Looks like more general way | 11:58 |
| sdague | vsaienk01: yeh, I think that either the grenade localrc should be exporting it, or it happens in a plugin | 12:00 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: Add OSA periodic upgrade job https://review.openstack.org/419517 | 12:00 |
| *** amotoki has joined #openstack-infra | 12:01 | |
| odyssey4me | AJaeger adjusted, with a comment to highlight the parameter that I was implementing in the job group | 12:02 |
| *** nadya has quit IRC | 12:02 | |
| vsaienk01 | sdague: ok, I will prepare patch to d-g than, thanks! | 12:02 |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config master: [Manila] Fix regex for skipping Manila CI job https://review.openstack.org/441905 | 12:03 |
| vsaienk01 | sdague: looks I was wrong about concurrency exporting TEMPEST_CONCURRENCY will not work as we need to add --concurrency $TEMPEST_CONCURRENCY argument when running tempest, so I will rework patch to grenade to | 12:04 |
| sdague | vsaienk01: grenade seems to do that already | 12:04 |
| sdague | is that not what you are seeing? | 12:04 |
| vsaienk01 | sdague: right https://github.com/openstack-dev/grenade/blob/master/grenade.sh#L270 | 12:05 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: Add OSA periodic upgrade job https://review.openstack.org/419517 | 12:05 |
| *** nadya has joined #openstack-infra | 12:06 | |
| vkmc | hi all! is there some gate other than neutron exercising devstack deployed with ipv6? | 12:06 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate master: Use export OS_TEST_TIMEOUT in grenade_localrc https://review.openstack.org/441908 | 12:06 |
| vkmc | for what I can see... it's the only one... and I'm wondering why | 12:06 |
| *** martinkopec has joined #openstack-infra | 12:07 | |
| *** isaacb has joined #openstack-infra | 12:08 | |
| *** dave-mccowan has joined #openstack-infra | 12:09 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config master: [Manila] Fix regex for skipping Manila CI job https://review.openstack.org/441905 | 12:10 |
| *** aysyd has joined #openstack-infra | 12:12 | |
| andreaf | vkmc: I'm not sure this is what you're looking for, but we run IPv6 api/scenario tests in the integrated gate job: http://logs.openstack.org/68/439168/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/1d8ec25/console.html#_2017-03-01_16_36_35_625842 | 12:13 |
| vkmc | andreaf, looking into it, thanks for the pointer | 12:13 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: layout/tripleo: make scenarios upgrades voting on stable/ocata https://review.openstack.org/440723 | 12:15 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: layout/tripleo: make scenarios upgrades voting on stable/ocata https://review.openstack.org/440723 | 12:16 |
| *** alexchadin has quit IRC | 12:17 | |
| *** rfolco has joined #openstack-infra | 12:17 | |
| *** alexchadin has joined #openstack-infra | 12:21 | |
| *** shardy is now known as shardy_lunch | 12:21 | |
| *** markus_z has joined #openstack-infra | 12:25 | |
| *** _Cyclone_ has joined #openstack-infra | 12:27 | |
| andreaf | fungi: around? last data in elastic search is 2017-03-05T19:22:22.600Z | 12:28 |
| openstackgerrit | Flavio Percoco proposed openstack-infra/tripleo-ci master: Collect more info about docker https://review.openstack.org/441050 | 12:35 |
| *** yujunz has quit IRC | 12:36 | |
| *** gordc has joined #openstack-infra | 12:38 | |
| *** askb has quit IRC | 12:40 | |
| *** _Cyclone_ has quit IRC | 12:41 | |
| *** lucasagomes is now known as lucas-hungry | 12:41 | |
| sdague | AJaeger: https://review.openstack.org/#/c/439500 ... does this mean all the _LE things go away? | 12:43 |
| *** thorst has joined #openstack-infra | 12:44 | |
| *** yujunz has joined #openstack-infra | 12:46 | |
| *** amoralej is now known as amoralej|lunch | 12:46 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: jjb/tripleo: merge some jobs with same properties https://review.openstack.org/441927 | 12:47 |
| *** ociuhandu has joined #openstack-infra | 12:48 | |
| AJaeger | sdague: best discuss with ianychoi . Currently the translation team decided to not translate these at all. | 12:48 |
| *** savihou has joined #openstack-infra | 12:48 | |
| *** ihrachys has joined #openstack-infra | 12:49 | |
| *** jamielennox is now known as jamielennox|away | 12:50 | |
| *** tosky has quit IRC | 12:50 | |
| *** dprince has joined #openstack-infra | 12:50 | |
| sdague | AJaeger: ... hmm, is there something on the list about it? Because we've got all these hacking rules that require those, and if that's not true any more, I'd definitely like to revert it | 12:51 |
| sdague | because it's hugely annoying and ugly | 12:51 |
| sdague | but only exists because the translation team needed them | 12:51 |
| *** tosky has joined #openstack-infra | 12:52 | |
| *** rfolco has quit IRC | 12:52 | |
| *** salv-orlando has joined #openstack-infra | 12:53 | |
| sdague | AJaeger: https://github.com/openstack/nova/blob/e88dd0034b1b135d680dae3494597e295add9cfe/nova/hacking/checks.py#L314-L333 | 12:53 |
| *** rfolco has joined #openstack-infra | 12:54 | |
| *** ihrachys has quit IRC | 12:54 | |
| *** pradk has joined #openstack-infra | 12:55 | |
| *** pgadiya has quit IRC | 12:55 | |
| *** salv-orl_ has quit IRC | 12:56 | |
| *** shardy_lunch is now known as shardy | 12:56 | |
| *** abregman has quit IRC | 12:59 | |
| *** ihrachys has joined #openstack-infra | 13:00 | |
| *** abregman has joined #openstack-infra | 13:00 | |
| *** yujunz-zte has joined #openstack-infra | 13:02 | |
| *** yujunz has quit IRC | 13:03 | |
| sdague | AJaeger: ok, I'll take it to the list | 13:03 |
| sdague | AJaeger: I'm fine with whatever the i18n team decided here, I just don't really understand the implications | 13:03 |
| *** abregman is now known as abregman|mtg | 13:03 | |
| sdague | AJaeger: was hoping you'd have quick answers | 13:04 |
| *** rhallisey has joined #openstack-infra | 13:04 | |
| *** ihrachys has quit IRC | 13:04 | |
| openstackgerrit | wes hayutin proposed openstack-infra/project-config master: Move containers-oooq to the check pipeline https://review.openstack.org/437945 | 13:04 |
| *** yujunz-zte is now known as yujunz[away] | 13:05 | |
| *** rhallisey has quit IRC | 13:05 | |
| *** rhallisey has joined #openstack-infra | 13:05 | |
| *** isaacb has quit IRC | 13:08 | |
| *** ihrachys has joined #openstack-infra | 13:10 | |
| *** yujunz[away] is now known as yujunz-zte | 13:12 | |
| *** jkilpatr has joined #openstack-infra | 13:12 | |
| *** ihrachys has quit IRC | 13:14 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Group nodes by availability zone https://review.openstack.org/441470 | 13:17 |
| odyssey4me | AJaeger If you have a chance, can you re-look at https://review.openstack.org/419517 please? | 13:17 |
| *** ihrachys has joined #openstack-infra | 13:20 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Group nodes by availability zone https://review.openstack.org/441470 | 13:21 |
| *** vsaienk01 has quit IRC | 13:23 | |
| *** yujunz-zte is now known as yujunz[away] | 13:23 | |
| *** yujunz[away] is now known as yujunz-zte | 13:24 | |
| *** ihrachys has quit IRC | 13:25 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Group nodes by availability zone https://review.openstack.org/441470 | 13:28 |
| *** nadya has quit IRC | 13:29 | |
| *** rlandy has joined #openstack-infra | 13:30 | |
| AJaeger | sdague: best ask on openstack-i18n, the discussion was months ago... | 13:30 |
| *** _Cyclone_ has joined #openstack-infra | 13:30 | |
| *** ihrachys has joined #openstack-infra | 13:30 | |
| AJaeger | sdague: sorry, not right now. | 13:30 |
| AJaeger | odyssey4me: later... | 13:30 |
| *** abregman|mtg has quit IRC | 13:31 | |
| *** sshnaidm has quit IRC | 13:32 | |
| *** mdrabe has joined #openstack-infra | 13:33 | |
| openstackgerrit | Alexander Evseev proposed openstack-infra/zuul master: Use ssh-agent instead of ugly ssh-wrapper scripts https://review.openstack.org/331148 | 13:33 |
| *** ihrachys has quit IRC | 13:35 | |
| *** flepied has joined #openstack-infra | 13:35 | |
| *** ccamacho is now known as ccamacho|lunch | 13:35 | |
| *** sshnaidm has joined #openstack-infra | 13:38 | |
| *** Guest36874 is now known as zeus | 13:38 | |
| *** jkilpatr has quit IRC | 13:39 | |
| *** zeus has quit IRC | 13:39 | |
| *** zeus has joined #openstack-infra | 13:39 | |
| *** hashar has joined #openstack-infra | 13:39 | |
| EmilienM | happy Monday infra, if someone can review https://review.openstack.org/#/c/440723/ please :-) | 13:43 |
| *** abregman|mtg has joined #openstack-infra | 13:44 | |
| dmsimard | Hello cores, still need a final +2 on https://review.openstack.org/#/c/441144/ to fix an issue with logs.o.o, thanks ! | 13:46 |
| *** baoli has joined #openstack-infra | 13:47 | |
| *** baoli has quit IRC | 13:48 | |
| *** baoli has joined #openstack-infra | 13:49 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: upgrades: Only use release depenent environment for newton https://review.openstack.org/441946 | 13:49 |
| *** bauzas has left #openstack-infra | 13:50 | |
| *** amoralej|lunch is now known as amoralej | 13:50 | |
| *** baoli has quit IRC | 13:50 | |
| *** baoli_ has joined #openstack-infra | 13:50 | |
| *** ihrachys has joined #openstack-infra | 13:50 | |
| *** lucas-hungry is now known as lucasagomes | 13:51 | |
| *** baoli_ has quit IRC | 13:51 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: upgrades: Only use release depenent environment for newton https://review.openstack.org/441946 | 13:52 |
| *** ldnunes has joined #openstack-infra | 13:52 | |
| *** kgiusti has joined #openstack-infra | 13:53 | |
| fungi | andreaf: yeah, that doesn't look so good. i'll dust off my elasticsearch troubleshooting docs and see if i can find what's going wrong | 13:54 |
| *** bauzas has joined #openstack-infra | 13:54 | |
| andreaf | fungi: cool, thanks | 13:54 |
| fungi | AJaeger: docs.o.o presumably recovered on its own? seems fairly snappy to me for the moment | 13:54 |
| fungi | i'll take a look at our cacti graphs | 13:54 |
| *** ihrachys has quit IRC | 13:55 | |
| dmsimard | rcarrillocruz: thank you kind sir | 13:55 |
| rcarrillocruz | np | 13:55 |
| openstackgerrit | Merged openstack-infra/puppet-openstackci master: Allow logs.o.o to server gzipped svg files https://review.openstack.org/441144 | 13:58 |
| *** baoli has joined #openstack-infra | 13:59 | |
| fungi | AJaeger: your comment about docs site slowness was at 07:35z, and i see in cacti that the files01.o.o server which hosts it had elevated system cpu utilization and load average 06:35-09:40z... timing suggests something kicked off by cron, maybe mlocate db updates? | 14:00 |
| *** hongbin has joined #openstack-infra | 14:00 | |
| frickler | fungi: that's what I guessed last week, too. but why would that not happen on sat+sun? | 14:01 |
| fungi | great question | 14:01 |
| *** eroux has quit IRC | 14:02 | |
| *** saibarspeis has joined #openstack-infra | 14:02 | |
| fungi | i'm having a look through the cronjobs on that system now | 14:02 |
| frickler | there was similar slowness last week at about the same time of day until someone restarted apache2 on fri | 14:02 |
| *** arxcruz has quit IRC | 14:02 | |
| *** arxcruz has joined #openstack-infra | 14:02 | |
| fungi | oh, ianw had noted an apache2 mpm worker bug on trusty which may need a workaround on that server | 14:03 |
| frickler | fungi: also only responses on port 443 seemed slow, the redirect on port 80 was fast | 14:03 |
| AJaeger | fungi, thanks for checking. There were several comments in the last two weeks about slowness during my morning - and ianw restarted at least twice and wanted to discuss this at the last team meeting | 14:03 |
| fungi | though that seems probably unrelated to what i'm seeing in cacti in that case | 14:03 |
| AJaeger | frickler: we should serve docs.o.o only on 443 via https | 14:03 |
| *** abregman|mtg has quit IRC | 14:04 | |
| AJaeger | fungi: indeed, it's fine now | 14:04 |
| frickler | AJaeger: there is a redirect still running on http://docs.o.o to https | 14:04 |
| frickler | and doing "curl -I http://docs.o.o" was still fast when "curl -I https://docs.o.o" took up to 20s | 14:05 |
| *** amotoki has quit IRC | 14:06 | |
| *** amotoki has joined #openstack-infra | 14:06 | |
| frickler | so that should at least rule out any networking issues | 14:07 |
| *** Hal has joined #openstack-infra | 14:07 | |
| fungi | yeah, does make disk contention a more likely culprit there | 14:07 |
| *** xyang1 has joined #openstack-infra | 14:09 | |
| AJaeger | fungi: so, do we have cron jobs running? | 14:09 |
| *** mriedem has quit IRC | 14:09 | |
| cmurphy | fungi: if you look at the cacti graphs it seems to happen monday through thursday at about 6:45UTC so I would guess a cron is unlikely | 14:10 |
| cmurphy | established TCP connections graph is also interesting http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=10232&rra_id=all | 14:10 |
| AJaeger | fungi, we have our periodic jobs in zuul defined - could one of them be the culprit? | 14:10 |
| fungi | cmurphy: yeah, i suspect the higher tcp connection count is a symptom of the slowness rather than a cause | 14:10 |
| fungi | if a webserver starts being slow to return data, your established connections will pile up on it | 14:11 |
| *** gongysh has joined #openstack-infra | 14:11 | |
| AJaeger | What about our wheel building jobs? Are they pushing to files0.1? | 14:12 |
| fungi | AJaeger: i hope periodic jobs aren't putting significant load on files01 (and no, those push into afs themselves) | 14:12 |
| mordred | cmurphy: your nick ... it's different | 14:13 |
| cmurphy | mordred: but still tab-completeable | 14:13 |
| fungi | less crinkly though | 14:13 |
| cmurphy | indeed | 14:13 |
| mordred | cmurphy: yay tabs! | 14:14 |
| *** amotoki has quit IRC | 14:15 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: jjb/tripleo: merge some jobs with same properties https://review.openstack.org/441927 | 14:15 |
| fungi | the mlocate db update is set to run on files01 daily around 06:25z (depending on how long the other cronjobs in front of it take to complete) | 14:15 |
| fungi | but if we're not seeing it friday through sunday then it's unlikely to be related, i agree | 14:16 |
| *** matt-borland has joined #openstack-infra | 14:16 | |
| AJaeger | do you know when it run today? | 14:16 |
| fungi | i'm checking logs to pin it down | 14:16 |
| *** isaacb has joined #openstack-infra | 14:17 | |
| *** esikachev has quit IRC | 14:17 | |
| fungi | no luck, cron.daily as a batch gets logged when it starts at 06:25 but the individual scripts aren't | 14:18 |
| *** esikachev has joined #openstack-infra | 14:18 | |
| *** flepied has quit IRC | 14:19 | |
| *** abregman|mtg has joined #openstack-infra | 14:19 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 14:22 |
| AJaeger | does it log when all of them are finished? Or do we need to log start/finish explicitely? | 14:22 |
| *** ihrachys has joined #openstack-infra | 14:22 | |
| *** esikachev has quit IRC | 14:23 | |
| *** gouthamr has joined #openstack-infra | 14:24 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:24 | |
| *** bgaifullin has quit IRC | 14:25 | |
| *** jcoufal has joined #openstack-infra | 14:25 | |
| AJaeger | fungi, could you put https://review.openstack.org/#/c/439767/ on your low-prio review queue for later, please? ianw wanted your review on it ("Add #openstack-deployment channel to logging") | 14:25 |
| *** makowals has quit IRC | 14:28 | |
| *** makowals has joined #openstack-infra | 14:30 | |
| openstackgerrit | Alfredo Moralejo proposed openstack-infra/tripleo-ci master: Add new variable REVIEW_RELEASE and use it in delorean build https://review.openstack.org/441960 | 14:30 |
| *** hongbin has quit IRC | 14:33 | |
| *** esikachev has joined #openstack-infra | 14:34 | |
| *** Goneri has joined #openstack-infra | 14:34 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: jjb/tripleo: merge some jobs with same properties https://review.openstack.org/441927 | 14:34 |
| openstackgerrit | Merged openstack-infra/release-tools master: remove list-repos command https://review.openstack.org/431169 | 14:38 |
| *** vikrant has quit IRC | 14:38 | |
| openstackgerrit | Merged openstack-infra/release-tools master: move propose-final-releases command to releases repo https://review.openstack.org/431170 | 14:38 |
| *** esikachev has quit IRC | 14:38 | |
| openstackgerrit | Merged openstack-infra/release-tools master: move list_unreleased_changes.sh to the releases repo https://review.openstack.org/431171 | 14:38 |
| *** sree has joined #openstack-infra | 14:38 | |
| openstackgerrit | Merged openstack-infra/release-tools master: move list_library_unreleased_changes.sh to releases repo https://review.openstack.org/431172 | 14:39 |
| openstackgerrit | Merged openstack-infra/release-tools master: remove list_oslo_unreleased_changes.sh https://review.openstack.org/431173 | 14:39 |
| *** esikachev has joined #openstack-infra | 14:39 | |
| *** yuval has quit IRC | 14:40 | |
| *** amotoki has joined #openstack-infra | 14:41 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/subunit2sql master: Use enginefacade instead of session in olo.db https://review.openstack.org/441966 | 14:42 |
| *** vsaienk0 has joined #openstack-infra | 14:43 | |
| *** eharney has joined #openstack-infra | 14:44 | |
| *** yujunz-zte has quit IRC | 14:46 | |
| vsaienk0 | sdague: fungi: sorry for bothering, we hit the bug https://bugs.launchpad.net/devstack/+bug/1669509 when trying to setup ironic multinode. during dumping database job failed with error that plugin is enabled twice, when in local.conf there is only one line with enable_plugin .... I've added a debug and found that DEVSTACK_PLUGINS is set while _DEVSTACK_STACKRC is not, I'm confused how it is possible, could you please help with the issue, thanks | 14:47 |
| openstack | Launchpad bug 1669509 in devstack "ironic grenade multinode try to enable_plugins second time during dumping databases" [Undecided,In progress] - Assigned to Vasyl Saienko (vsaienko) | 14:47 |
| vkmc | pabelanger, hey there! continuing debugging the package-installs problem... this is the build log http://paste.ubuntu.com/24125072/ for the elements I'm working on here https://review.openstack.org/#/c/411500/ | 14:48 |
| vkmc | pabelanger, you mentioned something about the version | 14:48 |
| *** esikachev has quit IRC | 14:49 | |
| *** goneri_ has joined #openstack-infra | 14:51 | |
| *** makowals has quit IRC | 14:52 | |
| openstackgerrit | Merged openstack-infra/shade master: Remove service names in OpenStackCloud docs https://review.openstack.org/439709 | 14:52 |
| *** xyang1 has quit IRC | 14:52 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: jjb/tripleo: merge some jobs with same properties https://review.openstack.org/441927 | 14:53 |
| *** esikachev has joined #openstack-infra | 14:54 | |
| *** xyang1 has joined #openstack-infra | 14:54 | |
| cloudnull | mornings | 14:54 |
| ianychoi | AJaeger, hello! I have discussed log level translations with sdague. After the discussion, I have found that: 1) I18n contributor guide does not tell that I18n does not focus on log level translation and 2) oslo.i18n documentation describes _LW and _LE for log level translation support ( https://docs.openstack.org/developer/oslo.i18n/guidelines.html#log-translation ). For the 2nd point, discussing with oslo.i18n team would be good? | 14:54 |
| ianychoi | Note that for the 1st point, I would like to specify in I18n contributor guide and share through openstack-dev mailing list. | 14:55 |
| *** makowals has joined #openstack-infra | 14:56 | |
| openstackgerrit | Merged openstack-infra/project-config master: layout/tripleo: make scenarios upgrades voting on stable/ocata https://review.openstack.org/440723 | 14:56 |
| openstackgerrit | Merged openstack-infra/shade master: Fix OpenStack and ID misspellings https://review.openstack.org/439744 | 14:57 |
| openstackgerrit | Merged openstack-infra/shade master: Rename ClusterTemplate in OpenStackCloud docs https://review.openstack.org/439779 | 14:57 |
| *** chlong__ has joined #openstack-infra | 14:57 | |
| *** esikachev has quit IRC | 14:58 | |
| *** esikachev has joined #openstack-infra | 14:59 | |
| *** mtanino has joined #openstack-infra | 15:00 | |
| *** danielitit_ has quit IRC | 15:01 | |
| openstackgerrit | Jeremy Liu proposed openstack-infra/project-config master: Add releasenote job for cloudkitty and cloudkitty-dashboard https://review.openstack.org/441971 | 15:01 |
| *** jaypipes_ has joined #openstack-infra | 15:01 | |
| *** alexchadin has quit IRC | 15:01 | |
| *** lewo has quit IRC | 15:02 | |
| *** lewo has joined #openstack-infra | 15:03 | |
| *** esikachev has quit IRC | 15:03 | |
| ianychoi | cloudnull, good morning, if you have time, could you partcipate in reviewing https://review.openstack.org/#/c/440825/ for a revised translation checksite spec using OpenStackAnsible? | 15:05 |
| *** esikachev has joined #openstack-infra | 15:05 | |
| *** mriedem has joined #openstack-infra | 15:05 | |
| ianychoi | Oh andy is in #openstack-ansible channel. I will start to talk now | 15:06 |
| *** saibarspeis has quit IRC | 15:07 | |
| cloudnull | ohai ianychoi | 15:11 |
| cloudnull | added the spec to my review queue | 15:11 |
| *** zz_dimtruck is now known as dimtruck | 15:14 | |
| *** makowals has quit IRC | 15:14 | |
| AJaeger | ianychoi: 1 is not a problem since the log fiels are not in zanata - 2 is the think to discuss, best talk with oslo.i18n. Reach out to dhellmann on this. | 15:15 |
| *** baoli has quit IRC | 15:15 | |
| *** alexchadin has joined #openstack-infra | 15:16 | |
| jeblair | AJaeger, fungi, cmurphy: mtime on mlocate.db is 06:45. i expect that's when updatedb finished. | 15:17 |
| ianychoi | AJaeger, I see I will discuss with dhellmann soon :) | 15:17 |
| ianychoi | Thanks! | 15:17 |
| *** makowals has joined #openstack-infra | 15:18 | |
| fungi | jeblair: thanks, i didn't think to check that. so yeah seems unlikely to be what's eating the system | 15:19 |
| *** scottynomad has quit IRC | 15:19 | |
| *** david-lyle has quit IRC | 15:20 | |
| *** ccamacho|lunch is now known as ccamacho | 15:21 | |
| *** gongysh has quit IRC | 15:24 | |
| *** tonytan4ever has joined #openstack-infra | 15:24 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: layout/tripleo: run upgrade jobs on puppet-tripleo https://review.openstack.org/441992 | 15:24 |
| *** erlon has joined #openstack-infra | 15:26 | |
| *** slaweq has quit IRC | 15:29 | |
| *** dhajare has quit IRC | 15:31 | |
| openstackgerrit | Ildiko Vancsa proposed openstack-infra/project-config master: Adding #openstack-university to Accesbot https://review.openstack.org/441996 | 15:32 |
| *** hamzy_ is now known as hamzy | 15:33 | |
| *** amotoki has quit IRC | 15:33 | |
| *** alexchadin has quit IRC | 15:34 | |
| *** tdasilva has joined #openstack-infra | 15:34 | |
| *** jamesden_ has joined #openstack-infra | 15:34 | |
| openstackgerrit | Jeremy Liu proposed openstack-infra/project-config master: Add releasenote job for cloudkitty and cloudkitty-dashboard https://review.openstack.org/441971 | 15:34 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 15:35 |
| *** sree has quit IRC | 15:40 | |
| *** makowals_ has joined #openstack-infra | 15:42 | |
| *** makowals has quit IRC | 15:43 | |
| *** e0ne has quit IRC | 15:44 | |
| *** dizquierdo has joined #openstack-infra | 15:47 | |
| *** mhickey has joined #openstack-infra | 15:50 | |
| openstackgerrit | Andy McCrae proposed openstack-infra/project-config master: Add os_molteniron to OpenStack-Ansible https://review.openstack.org/442002 | 15:50 |
| *** markus_z has quit IRC | 15:51 | |
| *** annegentle has joined #openstack-infra | 15:52 | |
| openstackgerrit | Ildiko Vancsa proposed openstack-infra/system-config master: Add #openstack-university to meetbot channels https://review.openstack.org/442004 | 15:55 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 15:56 |
| *** xarses_ has joined #openstack-infra | 15:57 | |
| *** nadya has joined #openstack-infra | 15:58 | |
| *** annegentle has quit IRC | 15:59 | |
| *** savihou has quit IRC | 16:00 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql master: Fix stop date option for run_failure_rate graph https://review.openstack.org/442007 | 16:00 |
| *** esikachev has quit IRC | 16:00 | |
| *** esikachev has joined #openstack-infra | 16:01 | |
| *** Jeffrey4l has quit IRC | 16:02 | |
| *** yamahata has joined #openstack-infra | 16:02 | |
| *** hongbin has joined #openstack-infra | 16:03 | |
| *** esikachev has quit IRC | 16:06 | |
| openstackgerrit | Alfredo Moralejo proposed openstack-infra/tripleo-ci master: Add new variable REVIEW_RELEASE and use it in delorean build https://review.openstack.org/441960 | 16:06 |
| *** annegentle has joined #openstack-infra | 16:07 | |
| *** warby has joined #openstack-infra | 16:08 | |
| *** rcernin has quit IRC | 16:08 | |
| *** esikachev has joined #openstack-infra | 16:09 | |
| *** jamesden_ has quit IRC | 16:09 | |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Use devstack's zookeeper support https://review.openstack.org/441209 | 16:10 |
| pabelanger | vkmc: sure, I'll look shortly | 16:11 |
| *** pt_15 has joined #openstack-infra | 16:12 | |
| *** yujunz has joined #openstack-infra | 16:13 | |
| *** e0ne has joined #openstack-infra | 16:13 | |
| fungi | pabelanger: any chance you were planning to be around for the infra meeting tomorrow and would be willing to chair it? i just realized i'm going to be running between airplanes at that time and so can't do it | 16:14 |
| *** esikachev has quit IRC | 16:14 | |
| fungi | agenda looks pretty light (empty actually) so far | 16:15 |
| *** Jeffrey4l has joined #openstack-infra | 16:15 | |
| *** baoli has joined #openstack-infra | 16:16 | |
| *** bhavik1 has joined #openstack-infra | 16:16 | |
| *** david-lyle has joined #openstack-infra | 16:17 | |
| pabelanger | fungi: yes, should be attending. I don't mind giving it a try | 16:19 |
| openstackgerrit | Thiago da Silva proposed openstack-infra/project-config master: Apply branch excludes to either ubuntu or centos https://review.openstack.org/442017 | 16:19 |
| fungi | pabelanger: thanks! pretty easy... i just cut and paste from the agenda for the most part | 16:19 |
| *** EricGonczer_ has joined #openstack-infra | 16:19 | |
| pabelanger | fungi: sure, I'll do some prep work this afternoon | 16:20 |
| *** baoli has quit IRC | 16:20 | |
| *** david-lyle has quit IRC | 16:22 | |
| *** nadya has quit IRC | 16:24 | |
| rcarrillocruz | cmurphy: heya, https://github.com/ansible/ansible/pull/22321 | 16:24 |
| rcarrillocruz | seems the os_group PR merged recently for the domain_id thing causes issues with the default | 16:25 |
| rcarrillocruz | can you please check it out that fix still works for you? | 16:25 |
| cmurphy | rcarrillocruz: sure | 16:28 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config master: gnocchi: fix upgrade jobs version https://review.openstack.org/442023 | 16:30 |
| *** purp_too is now known as purp | 16:30 | |
| *** nadya has joined #openstack-infra | 16:31 | |
| *** esikachev has joined #openstack-infra | 16:31 | |
| fungi | pabelanger: zuul status currently shows that neutron change running some jobs in the check pipeline | 16:32 |
| Shrews | cmurphy: rcarrillocruz: left a comment on that PR | 16:33 |
| fungi | pabelanger: did it have a funny git parent before your rebase? | 16:33 |
| *** amotoki has joined #openstack-infra | 16:34 | |
| pabelanger | fungi: ya, I just sent an email, but the issue was https://review.openstack.org/#/c/439565/ | 16:34 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 16:34 |
| rcarrillocruz | The deeper the fix the better, so hold on | 16:34 |
| fungi | pabelanger: oh, fun times | 16:34 |
| pabelanger | fungi: it had a depends-on cycle | 16:34 |
| *** nadya has quit IRC | 16:34 | |
| fungi | cute | 16:35 |
| pabelanger | fungi: maybe we should add some sort of check to git-review that doesn't allow that? | 16:35 |
| * clarkb not really here, but logstash/elsaticsearch problem appears to be at least partially related to logstash daemons in an unhappy place | 16:35 | |
| pabelanger | or something other gate job | 16:35 |
| clarkb | (I just restarted the one on worker01 and it refused to die cleanly) | 16:35 |
| *** esikachev has quit IRC | 16:35 | |
| pabelanger | clarkb: I can look into it again | 16:35 |
| fungi | clarkb: i just restarted all the workers because i noticed that recent changes hadn't restarted them all (looked like they'd only restarted worker A) | 16:35 |
| *** esikachev has joined #openstack-infra | 16:36 | |
| clarkb | fungi: ok, I think its the logstash daemon unhappy though | 16:36 |
| fungi | oh | 16:36 |
| fungi | i hadn't checked there yet | 16:36 |
| rcarrillocruz | That works, let fix on shade | 16:36 |
| clarkb | they stop pushing events into elasticsearch and when you try to stop them properly they refuse to die | 16:36 |
| fungi | the es cluster itself is green and all 80 workers were running, but some with start times from more than a month ago and others with start times from a change which merged last night | 16:36 |
| pabelanger | I think it is logstash daemon too | 16:37 |
| clarkb | pabelanger: yes that | 16:37 |
| fungi | i have a feeling we have puppet only restarting one worker process on each server | 16:37 |
| fungi | but unrelated to this issue i guess | 16:37 |
| clarkb | I think the input processing in logstash may be crashing | 16:38 |
| *** ativelkov has quit IRC | 16:38 | |
| pabelanger | {:timestamp=>"2017-03-05T19:09:27.063000+0000", :message=>"Pipeline main started"} | 16:38 |
| pabelanger | is last message from logstash-worker10.o.o | 16:38 |
| clarkb | or something like that, when straced in the past there is a ton of gettimeofday implying its doing something, but no writes | 16:38 |
| * clarkb just started stracing 02 and same thing | 16:39 | |
| clarkb | gettimeofday, futex, thats it | 16:39 |
| fungi | there were a couple of changes merged yesterday which could impact log processing, but they landed a couple hours after the data in logstash dries up so unless it was in the middle of a significant backlog it's likely unrelated? | 16:39 |
| *** amotoki has quit IRC | 16:39 | |
| *** esikachev has quit IRC | 16:40 | |
| clarkb | fungi: ya based on the size of indexes I think whatever happened started on friday | 16:40 |
| fungi | oh, and just took a couple days to completely lock up? | 16:40 |
| clarkb | the index for the third is large but not as big as expected then the remaining days are basically non existant iwth jiust a few docs each | 16:40 |
| *** ativelkov has joined #openstack-infra | 16:40 | |
| fungi | s/lock/dry/ | 16:40 |
| clarkb | ya or perhaps its not a complete deadlock but sufficiently so that we don't process fast enough to do anything appreciable | 16:41 |
| cmurphy | rcarrillocruz: not sure the fix needs to be in shade, maybe just don't pass filters here: https://github.com/ansible/ansible/pull/22321/files#diff-9d6e652297aedc35f22a98c78ae82379L149 | 16:41 |
| *** e0ne has quit IRC | 16:41 | |
| *** salv-orlando has quit IRC | 16:41 | |
| clarkb | fungi: we should be doing about 10k events per second under load. 10k events over 3 days is going t olook like complete deadlock | 16:41 |
| clarkb | but may actually "technically" still be doing something | 16:42 |
| clarkb | well thats interesting, 01 seemed to have locked up again :/ | 16:42 |
| *** ricardoas1 has joined #openstack-infra | 16:43 | |
| *** ricardoas1 has quit IRC | 16:43 | |
| openstackgerrit | Cullen Taylor proposed openstack-infra/zuul feature/zuulv3: Re-enable test_tags https://review.openstack.org/439858 | 16:44 |
| *** ricardoas has joined #openstack-infra | 16:44 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Fix comment about AZ selection https://review.openstack.org/442029 | 16:44 |
| *** e0ne has joined #openstack-infra | 16:45 | |
| openstackgerrit | Merged openstack-infra/release-tools master: move list_stable_unreleased_changes.sh to releases repo https://review.openstack.org/431174 | 16:45 |
| openstackgerrit | Merged openstack-infra/release-tools master: remove branching scripts https://review.openstack.org/431175 | 16:45 |
| clarkb | sudo strace -fp 29967 2>&1 | grep -v '\(clock\|time\|futex\)' to see a bit more of the interesting calls | 16:45 |
| isaacb | rcarrillocruz: Hi. Can you please add https://review.openstack.org/#/c/263021/ to your review queue | 16:46 |
| vkmc | pabelanger, sure thing, thx | 16:46 |
| clarkb | its possible that elasticsearch is not actually happy like it claims to be | 16:46 |
| openstackgerrit | Merged openstack-infra/release-tools master: remove ptl command https://review.openstack.org/431176 | 16:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/441731 | 16:46 |
| openstackgerrit | Merged openstack-infra/release-tools master: remove highest_semver.py https://review.openstack.org/431177 | 16:46 |
| clarkb | and is refusing to index the events from logstash which in turn makes logstash unhappy and so forth up the pipeline | 16:46 |
| openstackgerrit | Merged openstack-infra/release-tools master: remove latest-deliverable-versions command https://review.openstack.org/431178 | 16:46 |
| clarkb | I can try restarting the master (04) as that seems to dislodge other problems in ES | 16:46 |
| clarkb | if there is no opposition to that I can do that now. Will set indexes to not allocation, restart 04, enable allocation which will start the cluster recovery | 16:47 |
| *** esikachev has joined #openstack-infra | 16:48 | |
| clarkb | its hard to know because ES claims to be happy. But maybe that shouldn't be trustyed | 16:49 |
| fungi | sounds like a worthwhile experiment to me, but i agree i assumed the issue was outside es because cluster health reported nothing out of the ordinary | 16:50 |
| clarkb | fungi: ya me too :) | 16:50 |
| *** e0ne has quit IRC | 16:50 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/elastic-recheck master: Removed queries for bugs 1349617 and 1668958 https://review.openstack.org/442033 | 16:51 |
| openstack | bug 1668958 in neutron "metadata service occasionally not returning keys" [Critical,Fix released] https://launchpad.net/bugs/1668958 - Assigned to Kevin Benton (kevinbenton) | 16:51 |
| openstack | bug 1668958 in neutron "duplicate for #1349617 metadata service occasionally not returning keys" [Critical,Fix released] https://launchpad.net/bugs/1668958 - Assigned to Kevin Benton (kevinbenton) | 16:51 |
| jeblair | infra-root: i'm porting over a discussion started in #zuul | 16:51 |
| clarkb | well that is curious, 04 is offline (coming back now) and indexing has resumed | 16:51 |
| jeblair | looks like zookeeper is down on nodepool.o.o | 16:51 |
| clarkb | fungi: so I think that means that maybe we can't trust its self reported status :) | 16:51 |
| fungi | jeblair: oh, ouch | 16:51 |
| jeblair | nodepool.o.o ran out of space and zookeeper shut down | 16:52 |
| clarkb | index recovery is in process | 16:52 |
| Shrews | jeblair: it's back | 16:52 |
| pabelanger | I had 2 qcow2 images in my home folder on nodepool.o.o, I have deleted them | 16:52 |
| clarkb | jeblair: disk space? | 16:52 |
| jeblair | clarkb: yes | 16:52 |
| pabelanger | that gives us 20% back | 16:52 |
| jeblair | Shrews: did someone restart it? | 16:52 |
| pabelanger | we also have a 8GB qcow2 in /var/log/nodepool/images | 16:52 |
| pabelanger | I didn't restart | 16:53 |
| Shrews | jeblair: not that I'm aware of. just pabelanger's cleanup | 16:53 |
| pabelanger | just deleted space | 16:53 |
| Shrews | nodepool-launcher still throwing errors | 16:53 |
| *** yujunz has quit IRC | 16:53 | |
| jeblair | maybe systemd or upstart or whatever restarted it | 16:53 |
| fungi | i just deleted /var/log/nodepool/image/1254.qcow2 which had been there since october | 16:53 |
| fungi | 8.5gb | 16:53 |
| pabelanger | Mar 6 16:51:09 nodepool kernel: [4762211.537934] init: zookeeper main process ended, respawning | 16:53 |
| jeblair | Mar 6 16:51:09 nodepool kernel: [4762211.537934] init: zookeeper main process ended, respawning | 16:53 |
| jeblair | :) | 16:53 |
| pabelanger | thanks systemd | 16:54 |
| pabelanger | /var/lib/zookeeper/version-2 looks to be 3.7G | 16:55 |
| *** abregman|mtg has quit IRC | 16:55 | |
| Shrews | jeblair: pabelanger: i think i know why nodepool-launcher hasn't recovered. bug in the connection listener | 16:56 |
| jeblair | Shrews: yeah, it seems like the launcher and zuul may have a flaw with their error processing... the builders look like they handled it more gracefully, but they still say "suspended. waiting" | 16:56 |
| jeblair | Shrews: ah cool. | 16:56 |
| Shrews | jeblair: zk.state never gets reset when it reconnects | 16:56 |
| *** jamesden_ has joined #openstack-infra | 16:56 | |
| clarkb | fungi: cluster is green again and indexing events so I guess that cluster got "stuck" and that dominoed upstream | 16:57 |
| jeblair | Shrews: ah | 16:57 |
| Shrews | jeblair: oh, wait. hrm, that comes from the event. not sure now | 16:57 |
| clarkb | fungi: unfortunately cluster reported it was happy so we overlooked it, I guess we need to ignore what it says and operate on behavior now | 16:57 |
| fungi | thanks clarkb! andreaf ^ we're getting events in ls again | 16:57 |
| *** martinkopec has quit IRC | 16:57 | |
| Shrews | jeblair: oh! nl01 just recovered | 16:58 |
| pabelanger | okay, so looking at https://zookeeper.apache.org/doc/r3.4.2/zookeeperAdmin.html it seems we might need to enable autopurge on zookeeper: A ZooKeeper server will not remove old snapshots and log files when using the default configuration. | 16:58 |
| *** hashar is now known as hasharErrand | 16:58 | |
| jeblair | Shrews: nice! | 16:58 |
| *** sshnaidm is now known as sshnaidm|afk | 16:58 | |
| jeblair | Shrews: so it looks like it may have something like a 5min poll interval | 16:59 |
| pabelanger | autopurge.snapRetainCount and autopurge.purgeInterval look to be the settings. I'll read up more on what google thinks are sane defaults | 16:59 |
| pabelanger | Shrews: Yay | 16:59 |
| jeblair | pabelanger: thanks. SpamapS may be able to help if you have questions. | 16:59 |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Remove unused ping and http check functions https://review.openstack.org/437174 | 16:59 |
| Shrews | jeblair: pabelanger: i need a check in the cleanup thread that looks for suspended zookeeper state, like the other threads. then we wouldn't see those exceptions | 16:59 |
| pabelanger | jeblair: great idea | 16:59 |
| jlvillal | sdague, Any idea why we would be seeing a last line like: http://logs.openstack.org/85/437385/1/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-coreos-src-ubuntu-xenial/d291396/logs/local.conf.txt.gz | 17:00 |
| jlvillal | sdague, This is our stable/newton job for Ironic | 17:00 |
| sdague | jlvillal: because it's a very old test run? | 17:00 |
| jlvillal | sdague, Asking because a week or so ago I remember changes to local_conf creation | 17:00 |
| rcarrillocruz | cmurphy , Shrews , if-else'd the domain_id param | 17:01 |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Add testr slowest to the end of the test run https://review.openstack.org/438624 | 17:01 |
| sdague | jlvillal: rebase, re-run tests | 17:01 |
| sdague | there was a bug in there | 17:01 |
| jlvillal | sdague, Oh yeah! Our not in our whiteboard said broken as of 1-Mar... | 17:01 |
| *** jamesden_ has quit IRC | 17:01 | |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Run test-matrix.py under python3 if present https://review.openstack.org/417982 | 17:01 |
| *** jamesden_ has joined #openstack-infra | 17:01 | |
| sdague | dstools has since been fixed | 17:01 |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Add Designate help / log links to gate https://review.openstack.org/317044 | 17:01 |
| jlvillal | sdague, Thanks! | 17:02 |
| jeblair | Shrews, pabelanger: zuulv3 seems to have recovered as well | 17:02 |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/irc-meetings master: Adjust oslo meeting time and chair https://review.openstack.org/441535 | 17:02 |
| pabelanger | jeblair: Shrews: I'm guessing, if we had n+1 zookeepers, we might not of had that issue? Assuming on zk instances had HDD space | 17:03 |
| jeblair | pabelanger: i expect so, since zk (correctly) shut down in that instance. | 17:03 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Suspend NodeCleanupWorker on ZK suspension https://review.openstack.org/442042 | 17:04 |
| Shrews | jeblair: pabelanger: ^^^^ | 17:04 |
| *** knangia has joined #openstack-infra | 17:04 | |
| cmurphy | rcarrillocruz: left a comment | 17:04 |
| *** csomerville has quit IRC | 17:04 | |
| rcarrillocruz | oops, thx | 17:04 |
| *** mgagne_ has quit IRC | 17:05 | |
| *** mgagne_ has joined #openstack-infra | 17:05 | |
| *** csomerville has joined #openstack-infra | 17:05 | |
| *** jaypipes_ is now known as jaypipes | 17:05 | |
| Shrews | jeblair: pabelanger: i'm glad to see this occur, actually. i don't think we tested this event well | 17:05 |
| pabelanger | Ya | 17:05 |
| pabelanger | the fact things started working again, once we recovered HDD was great | 17:06 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config master: Move containers-oooq to the check pipeline https://review.openstack.org/437945 | 17:06 |
| *** nadya has joined #openstack-infra | 17:06 | |
| jeblair | Shrews: ++. aside from the logging, i think all the components performed admirably. :) | 17:06 |
| Shrews | pabelanger: did you check the builders? | 17:06 |
| pabelanger | Shrews: I see 2 DIBs being built | 17:06 |
| Shrews | \o/ | 17:06 |
| pabelanger | we might have been down over the weekend :) | 17:07 |
| pabelanger | uploads were restarted too | 17:07 |
| *** andreas_s has quit IRC | 17:08 | |
| *** dosaboy_ is now known as dosaboy | 17:09 | |
| *** tesseract has quit IRC | 17:10 | |
| *** cody-somerville has joined #openstack-infra | 17:10 | |
| *** cody-somerville has quit IRC | 17:10 | |
| *** cody-somerville has joined #openstack-infra | 17:10 | |
| *** csomerville has quit IRC | 17:13 | |
| *** nadya has quit IRC | 17:15 | |
| *** vhosakot has joined #openstack-infra | 17:15 | |
| *** jamesdenton has quit IRC | 17:15 | |
| Shrews | speaking of image uploads, jeblair: if you get some time today: https://review.openstack.org/434934 | 17:18 |
| *** david-lyle has joined #openstack-infra | 17:18 | |
| jeblair | Shrews: oh, thanks, i hadn't seen that | 17:18 |
| fungi | pabelanger: for definitions of "down" which don't include failing to run jobs | 17:18 |
| jeblair | completely un-noticed by users is the best kind of down | 17:18 |
| fungi | pabelanger: because the ci system (and outwardly, nodepool itself) just kept chugging along | 17:18 |
| pabelanger | ++ | 17:19 |
| fungi | i'm quite impressed | 17:19 |
| pabelanger | same :) | 17:19 |
| *** BobBall has joined #openstack-infra | 17:20 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 17:21 |
| openstackgerrit | Merged openstack-infra/nodepool master: Clarification about the rate parameter https://review.openstack.org/436993 | 17:23 |
| *** david-lyle has quit IRC | 17:24 | |
| annegentle | is there a timed window for the heavy spam filters on the wiki? I ask because on the women of openstack list someone had trouble with two different pages that filtered for "gmail" -- thoughts? | 17:26 |
| *** eroux has joined #openstack-infra | 17:27 | |
| *** rcernin has joined #openstack-infra | 17:27 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Adding skip_file to artcl_collect_list https://review.openstack.org/440432 | 17:28 |
| *** dizquierdo has quit IRC | 17:28 | |
| openstackgerrit | Andy McCrae proposed openstack-infra/project-config master: Add os_molteniron to OpenStack-Ansible https://review.openstack.org/442002 | 17:29 |
| *** david-lyle has joined #openstack-infra | 17:30 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Fix potential race in image upload cleanup https://review.openstack.org/434934 | 17:30 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: layout/tripleo: fix logic for scenarios & voting https://review.openstack.org/442090 | 17:31 |
| *** jpich has quit IRC | 17:33 | |
| *** vhosakot has quit IRC | 17:35 | |
| AJaeger | fungi, jeblair: Do you have any other idea about the slow docs.o.o? Any kind of monitoring we can run for tomorrow? | 17:36 |
| *** nadya has joined #openstack-infra | 17:37 | |
| fungi | annegentle: the pattern matches are static | 17:37 |
| openstackgerrit | Merged openstack-infra/project-config master: Revert "Revert "Migrate -platform- devstack jobs to -neutron-full-"" https://review.openstack.org/439771 | 17:37 |
| annegentle | fungi ok, and staying that way I am guessing? | 17:37 |
| annegentle | fungi basically trying to let the contributor know this behavior is from now on | 17:37 |
| fungi | annegentle: we did remove one from the list we're maintaining because a member company name was explicitly disallowed by it and we needed to track them in the ccla signatories page (which ideally should move out of the wiki fairly soonish) | 17:38 |
| *** mhickey has quit IRC | 17:38 | |
| fungi | but we also use a couple lists provided by mediawiki and wikipedia we don't directly control, so i'll have to see where it's hitting | 17:38 |
| annegentle | fungi ok | 17:39 |
| annegentle | fungi women-of-openstack ML if you want to see the thread | 17:39 |
| fungi | someone also found that urls to youtu.be were in one of the disallowed lists not under our direct control, but that alternative youtube.com urls worked fine | 17:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/441731 | 17:40 |
| fungi | annegentle: yeah, i just confirmed "gmail" is in a regular expression we're maintaining (at least) so i can try unblocking it there and we'll see how far it gets us | 17:40 |
| annegentle | fungi ok, hopefully helpful! | 17:41 |
| clarkb | fungi: I think gmail is in there becuase they were posting gmail addrs to contact for quickbooks support | 17:41 |
| fungi | annegentle: confirmed, removing it from the regex seems to have worked. hopefully that doesn't increase the amount of spam pages getting through | 17:42 |
| annegentle | fungi my workaround was to edit to "gee mail" | 17:42 |
| annegentle | :) | 17:43 |
| fungi | clarkb: yeah, likely | 17:43 |
| *** andreww has joined #openstack-infra | 17:43 | |
| *** armax has joined #openstack-infra | 17:45 | |
| *** xarses_ has quit IRC | 17:46 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 17:47 |
| *** eroux has quit IRC | 17:50 | |
| *** isaacb has quit IRC | 17:52 | |
| *** annegentle has quit IRC | 17:52 | |
| *** mhickey has joined #openstack-infra | 17:53 | |
| *** rkukura has joined #openstack-infra | 17:54 | |
| *** Hal has quit IRC | 17:55 | |
| *** ralonsoh has quit IRC | 17:55 | |
| *** Apoorva has joined #openstack-infra | 17:56 | |
| *** beekneemech is now known as bnemec | 17:56 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config master: [Manila] Fix regex for skipping Manila CI job https://review.openstack.org/441905 | 17:57 |
| *** mhickey has quit IRC | 17:57 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Nic config for containerized undercloud https://review.openstack.org/442098 | 17:57 |
| *** jaosorior has quit IRC | 17:58 | |
| EmilienM | if someone has time for a second review on https://review.openstack.org/#/c/442090/ - thanks | 17:59 |
| *** EricGonczer_ has quit IRC | 18:00 | |
| jeblair | AJaeger, fungi: i confess i'm not up to date on the apache issues. my understanding is that ianw identified a likely culprit and made a fix, so i have not been paying close attention. if there's still a problem, then perhaps we need to open a wider investigative effort and communicate that along with who is driving it. | 18:00 |
| *** ccamacho has left #openstack-infra | 18:00 | |
| *** ociuhandu has quit IRC | 18:01 | |
| fungi | i think ianw's fix was applied to static.o.o and he theorized that we ought to also consider doing it to files01? i'm pulling up that discussion now to confirm | 18:02 |
| *** hasharErrand has quit IRC | 18:02 | |
| sdague | is something weird with rax-ord? | 18:02 |
| sdague | http://logs.openstack.org/08/441908/1/gate/gate-tempest-dsvm-neutron-full-ubuntu-xenial/58520c4/console.html - devstack took 50 minutes to complete on this run, the thing was killed for overrun | 18:03 |
| sdague | and I feel like I've hit a few of these recently | 18:03 |
| *** mhickey has joined #openstack-infra | 18:04 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 18:05 |
| fungi | jeblair: AJaeger: confirmed, as of last week's meeting https://review.openstack.org/426639 to work around the error on static was proposed, merged 04:01z thursday. probably no similar patch has been proposed for files01 yet | 18:05 |
| openstackgerrit | Thiago da Silva proposed openstack-infra/project-config master: Apply branch excludes to either ubuntu or centos https://review.openstack.org/442017 | 18:06 |
| *** sambetts is now known as sambetts|afk | 18:07 | |
| fungi | ianw: this is from static's current error.log: [Mon Mar 06 17:07:05.642726 2017] [mpm_worker:error] [pid 29561:tid 140043516348288] AH00288: scoreboard is full, not at MaxRequestWorkers | 18:07 |
| *** chlong__ has quit IRC | 18:08 | |
| fungi | not sure if that means we still have a problem (it's mpm_worker now rather than mpm_event) | 18:09 |
| *** shardy has quit IRC | 18:11 | |
| *** neiljerram has quit IRC | 18:12 | |
| AJaeger | fungi, and is this really the same problem as on files01? I wonder why we hit limits at this point of time - and only this time. | 18:12 |
| fungi | AJaeger: right, i have no idea whether it's in any way related to the performance issues observed | 18:12 |
| *** winggundamth_ has joined #openstack-infra | 18:15 | |
| *** bhavik1 has quit IRC | 18:17 | |
| *** winggundamth has quit IRC | 18:18 | |
| AJaeger | ianw: could you check tomorrow performance of docs.o.o and see what the problem is, please? | 18:20 |
| *** lucasagomes is now known as lucas-afk | 18:20 | |
| *** shardy has joined #openstack-infra | 18:24 | |
| *** hashar has joined #openstack-infra | 18:25 | |
| *** dhinesh has joined #openstack-infra | 18:26 | |
| EmilienM | AJaeger: sorry for direct ping, if you still have little time for today, can you maybe look this one, https://review.openstack.org/#/c/442090/ so our master gate is not stuck on undesired voting jobs. Thanks a lot | 18:27 |
| *** e0ne has joined #openstack-infra | 18:29 | |
| *** tosky has quit IRC | 18:31 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 18:31 |
| *** baoli has joined #openstack-infra | 18:34 | |
| *** nadya has quit IRC | 18:34 | |
| *** dtantsur is now known as dtantsur|afk | 18:34 | |
| *** eroux has joined #openstack-infra | 18:35 | |
| *** jamesden_ has quit IRC | 18:35 | |
| *** amotoki has joined #openstack-infra | 18:36 | |
| AJaeger | EmilienM: checking... | 18:38 |
| *** jcoufal has quit IRC | 18:40 | |
| AJaeger | EmilienM: I see a mismatch between comment and regex -> -1 | 18:41 |
| *** amotoki has quit IRC | 18:41 | |
| EmilienM | AJaeger: ok, let me update the comment. | 18:41 |
| *** spotz is now known as spotz_zzz | 18:42 | |
| *** rkukura has quit IRC | 18:43 | |
| *** ijw has joined #openstack-infra | 18:43 | |
| *** spotz_zzz is now known as spotz | 18:43 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Remove spurious with from comment https://review.openstack.org/442107 | 18:43 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: layout/tripleo: fix logic for scenarios & voting https://review.openstack.org/442090 | 18:44 |
| *** bgaifullin has joined #openstack-infra | 18:44 | |
| EmilienM | AJaeger: the first regex should match something iiuc, I'm confused | 18:44 |
| EmilienM | AJaeger: you meant this one? ^gate-tripleo-ci-centos-7(-scenario00(1|2|3))?-multinode-upgrades$ | 18:44 |
| *** winggundamth_ has quit IRC | 18:45 | |
| *** jcoufal has joined #openstack-infra | 18:46 | |
| *** vsaienko has joined #openstack-infra | 18:46 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Don't use delorean-ci repo for upgrade deployment https://review.openstack.org/441166 | 18:47 |
| AJaeger | EmilienM: I commented. I mean that the current jobs in zuul/layout.yaml do not match any jobs in addition to what they matched. Or differently gate-tripleo-ci-centos-7-multinode-upgrades is matches by new regex but not used | 18:47 |
| *** vsaienko has left #openstack-infra | 18:47 | |
| AJaeger | EmilienM: so, your stating, "we only want gate-tripleo-ci-centos-7-multinode-upgrades" confuses me since you don't run this job at all... | 18:48 |
| *** ccamacho has joined #openstack-infra | 18:48 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Report layout config errors for config repos https://review.openstack.org/440760 | 18:49 |
| *** Guest64317 has joined #openstack-infra | 18:50 | |
| sdague | fungi et al - http://logs.openstack.org/87/439187/3/gate/gate-nova-python27-ubuntu-xenial/fdd5548/console.html#_2017-03-06_18_12_59_241504 | 18:51 |
| sdague | all tests passed, job completed. Then 40 minutes later "job time out, failure" | 18:51 |
| *** esikachev has quit IRC | 18:51 | |
| EmilienM | AJaeger: we should run gate-tripleo-ci-centos-7-multinode-upgrades in stable/ocata only | 18:51 |
| EmilienM | AJaeger: let me check again | 18:51 |
| sdague | 2017-03-06 17:32:11.008991 | [Zuul] Task exit code: 0 | 18:51 |
| sdague | 2017-03-06 18:12:59.241504 | [Zuul] Job timed out, result: FAILURE | 18:51 |
| *** esikachev has joined #openstack-infra | 18:52 | |
| EmilienM | AJaeger: see https://review.openstack.org/#/c/442090/2/zuul/layout.yaml | 18:53 |
| AJaeger | EmilienM: 'grep gate-tripleo-ci-centos-7-multinode-upgrades zuul/layout.yaml' only returns two -nv jobs | 18:53 |
| *** bgaifullin has quit IRC | 18:53 | |
| * AJaeger pulls the change | 18:54 | |
| *** rkukura has joined #openstack-infra | 18:54 | |
| *** bgaifullin has joined #openstack-infra | 18:54 | |
| AJaeger | EmilienM: sorry, my local repo wasn't updated ;( | 18:54 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Catch gear.InterruptedError https://review.openstack.org/440789 | 18:55 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Switch to yaml.safe_load https://review.openstack.org/441285 | 18:55 |
| EmilienM | AJaeger: no worries, and sorry for all these things. I know our layout is very complex but we also try to increase tests coverage | 18:55 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Report YAML parse errors https://review.openstack.org/441286 | 18:56 |
| *** Guest64317 has quit IRC | 18:56 | |
| *** esikachev has quit IRC | 18:57 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Port SQLAlchemy reporter to v3 driver structure https://review.openstack.org/442114 | 18:57 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Test upgrades ocata->master https://review.openstack.org/440596 | 18:57 |
| *** chem has quit IRC | 18:57 | |
| *** _ody has left #openstack-infra | 18:58 | |
| *** baoli has quit IRC | 18:58 | |
| *** esikachev has joined #openstack-infra | 19:00 | |
| *** _ody has joined #openstack-infra | 19:00 | |
| *** _ody has left #openstack-infra | 19:00 | |
| *** ociuhandu has joined #openstack-infra | 19:02 | |
| *** dprince has quit IRC | 19:02 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Remove spurious with from comment https://review.openstack.org/442107 | 19:03 |
| *** pcaruana has quit IRC | 19:04 | |
| *** esikachev has quit IRC | 19:05 | |
| fungi | sdague: also the ansible task log at http://logs.openstack.org/87/439187/3/gate/gate-nova-python27-ubuntu-xenial/fdd5548/_zuul_ansible/ansible_log.txt is kinda strange. there's a task starting at 17:21:56,975 and then silence until 18:12:57,443 when it moves on to the publishers play | 19:05 |
| *** esikachev has joined #openstack-infra | 19:07 | |
| *** bgaifullin has quit IRC | 19:07 | |
| fungi | looks like it was the task executing `/usr/local/jenkins/slave_scripts/run-tox.sh py27` but there's no reflection of the task exiting at 17:32:11 | 19:07 |
| *** electrofelix has quit IRC | 19:08 | |
| *** MasterOfBugs has joined #openstack-infra | 19:09 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Port SQLAlchemy reporter to v3 driver structure https://review.openstack.org/442114 | 19:09 |
| *** baoli has joined #openstack-infra | 19:09 | |
| *** shardy has quit IRC | 19:11 | |
| sdague | fungi: yeh, definitely confusing to me | 19:12 |
| *** esikachev has quit IRC | 19:12 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/devstack-gate master: Revert "Add testr slowest to the end of the test run" https://review.openstack.org/442123 | 19:12 |
| ihrachys | sdague: ianw ^ | 19:13 |
| fungi | ihrachys: yeah, i also noticed that the subsequent run for nova.tests.unit.test_profiler is clobbering the testr results | 19:13 |
| fungi | http://logs.openstack.org/87/439187/3/gate/gate-nova-python27-ubuntu-xenial/fdd5548/testr_results.html.gz | 19:14 |
| *** rkukura has quit IRC | 19:14 | |
| sdague | ihrachys: revert approved | 19:14 |
| sdague | mtreinish: ^^^^ | 19:14 |
| fungi | er, sdague: ^ (sorry ihrachys!) | 19:15 |
| mtreinish | sdague: well if you gave me 5 secs I was going to push a patch that was going to fix it | 19:15 |
| *** bgaifullin has joined #openstack-infra | 19:15 | |
| *** esikachev has joined #openstack-infra | 19:15 | |
| *** pcaruana has joined #openstack-infra | 19:15 | |
| mtreinish | we shouldnt need to call the testr in the venv since it's system installed | 19:16 |
| *** ewindisch has quit IRC | 19:16 | |
| mtreinish | which is likely why the venv doesn't have it, since all plugin uses system site packages | 19:16 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move alembic into sql driver https://review.openstack.org/442124 | 19:18 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/devstack-gate master: Use testr from system python https://review.openstack.org/442125 | 19:18 |
| mtreinish | sdague: ^^^ that's the fix | 19:18 |
| ihrachys | mtreinish: sdague: I don't insist on a particular fix as long as the gate is ok | 19:20 |
| *** esikachev has quit IRC | 19:21 | |
| ihrachys | just triggered a revert to get attention ;) | 19:21 |
| *** yee379 has quit IRC | 19:21 | |
| mtreinish | ihrachys: well I'd rather leave the slowest data, because several people asked where it went at the ptg | 19:21 |
| *** yee379 has joined #openstack-infra | 19:21 | |
| mtreinish | even though I don't find it particularly useful :) | 19:21 |
| *** eroux has quit IRC | 19:21 | |
| ihrachys | mtreinish: sure np. negotiate if it's possible to remove +w with sdague | 19:21 |
| mtreinish | ihrachys: heh, well I was going to -2 to block the merge, but I don't have that acl on d-g | 19:22 |
| *** salv-orlando has joined #openstack-infra | 19:24 | |
| sdague | mtreinish: just stack in on the revert, because I'd rather see the fix demonstrated with a bunch of different configs with depends on | 19:24 |
| sdague | so we don't end up here again | 19:25 |
| jeblair | do we need to add a (non-voting) job to devstack-gate? | 19:25 |
| mtreinish | sdague: it's pretty obvious just look at https://github.com/openstack-infra/devstack-gate/blob/master/functions.sh#L557 we call testr from the default PATH there | 19:25 |
| mtreinish | things would always fail if it didn't work | 19:25 |
| mtreinish | I just am always thrown by the weirdness caused by system site packages | 19:25 |
| *** eroux has joined #openstack-infra | 19:26 | |
| *** esikachev has joined #openstack-infra | 19:26 | |
| sdague | mtreinish: I'm not sure why it hurts anything to do the revert, then do the fix, then ensure the fix works with some of the edge cases | 19:26 |
| vkmc | pabelanger, sorry for pinging again, any chance you could take a look to the dib issue? | 19:27 |
| *** dprince has joined #openstack-infra | 19:28 | |
| *** nadya has joined #openstack-infra | 19:28 | |
| vkmc | pabelanger, I noticed that DIB 1.26 is being installed... is there some bug that was fixed between 1.26 and 1.28 for that element in particular? | 19:28 |
| pabelanger | vkmc: I had started, but switched to something else. Looking again now | 19:29 |
| *** baoli has quit IRC | 19:29 | |
| vkmc | pabelanger++ | 19:29 |
| mtreinish | because it adds an extra step which likely means a long time before it lands again | 19:29 |
| *** chlong has joined #openstack-infra | 19:31 | |
| sdague | mtreinish: why, the first patch merged in a week (which is pretty short for d-g) I'm sure we can merge the fixed one this week | 19:32 |
| *** vhosakot has joined #openstack-infra | 19:34 | |
| openstackgerrit | Alfredo Moralejo proposed openstack-infra/tripleo-ci master: Add new variable REVIEW_RELEASE and use it in delorean build https://review.openstack.org/441960 | 19:35 |
| pabelanger | vkmc: left a comment on 411500 to try | 19:35 |
| vkmc | pabelanger, thanks a lot | 19:36 |
| EmilienM | pabelanger: if you have some time, https://review.openstack.org/#/c/442090/ - would help us to unblock master ci jobs. Thanks! | 19:36 |
| pabelanger | EmilienM: sure, 1 sec | 19:36 |
| EmilienM | thanks | 19:37 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add missing pauses in reconfiguration tests https://review.openstack.org/442136 | 19:37 |
| *** bgaifullin has quit IRC | 19:37 | |
| pabelanger | +3 | 19:37 |
| EmilienM | thx | 19:37 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Make decision wheter to build images in CI or not https://review.openstack.org/442139 | 19:41 |
| *** esikachev has quit IRC | 19:43 | |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Group nodes by availability zone https://review.openstack.org/441470 | 19:44 |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Fix comment about AZ selection https://review.openstack.org/442029 | 19:45 |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Suspend NodeCleanupWorker on ZK suspension https://review.openstack.org/442042 | 19:45 |
| *** markvoelker_ has quit IRC | 19:47 | |
| openstackgerrit | Merged openstack-infra/project-config master: layout/tripleo: fix logic for scenarios & voting https://review.openstack.org/442090 | 19:48 |
| *** vhosakot has quit IRC | 19:48 | |
| *** ociuhandu has quit IRC | 19:48 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: New ovb playbook and settings https://review.openstack.org/431567 | 19:50 |
| *** Rockyg has joined #openstack-infra | 19:50 | |
| *** baoli has joined #openstack-infra | 19:50 | |
| *** baoli has quit IRC | 19:50 | |
| *** pvaneck has joined #openstack-infra | 19:50 | |
| *** esikachev has joined #openstack-infra | 19:52 | |
| pabelanger | vkmc: left a follow up too, if the first doesn't work | 19:52 |
| *** gouthamr has quit IRC | 19:54 | |
| *** EricGonczer_ has joined #openstack-infra | 19:54 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql master: Add run_time_meta arge to specify values to use in graph https://review.openstack.org/231763 | 19:54 |
| openstackgerrit | Flavio Percoco proposed openstack-infra/tripleo-ci master: Collect more info about docker https://review.openstack.org/441050 | 19:54 |
| *** claudiub|2 has joined #openstack-infra | 19:55 | |
| *** esikachev has quit IRC | 19:56 | |
| openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config master: [magnum] Replace old jobs with the experimental https://review.openstack.org/442142 | 19:57 |
| *** goneri_ has quit IRC | 19:58 | |
| *** esikachev has joined #openstack-infra | 19:58 | |
| *** Goneri has quit IRC | 19:58 | |
| *** claudiub has quit IRC | 19:58 | |
| *** Goneri has joined #openstack-infra | 19:58 | |
| *** salv-orlando has quit IRC | 19:58 | |
| *** annegentle has joined #openstack-infra | 19:59 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add missing pauses in reconfiguration tests https://review.openstack.org/442136 | 20:01 |
| *** ijw_ has joined #openstack-infra | 20:06 | |
| *** ijw has quit IRC | 20:09 | |
| *** ijw has joined #openstack-infra | 20:11 | |
| *** rkukura has joined #openstack-infra | 20:12 | |
| *** gouthamr has joined #openstack-infra | 20:13 | |
| *** e0ne has quit IRC | 20:14 | |
| *** ijw_ has quit IRC | 20:14 | |
| AJaeger | review.o.o where are you? ;( | 20:15 |
| AJaeger | ah, now returned - that was a long delay | 20:15 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Make wait_for path smart https://review.openstack.org/441247 | 20:16 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql master: Add run_time_meta arge to specify values to use in graph https://review.openstack.org/231763 | 20:18 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql master: Add run_failure_rate argument to specify values to use in graph https://review.openstack.org/442147 | 20:18 |
| *** nadya has quit IRC | 20:18 | |
| vkmc | pabelanger, testing it... changing the package-installs to install.d didn't work, now I'm checking out pkg-map | 20:19 |
| vkmc | :) | 20:19 |
| vkmc | thanks | 20:19 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Remove extra sample ATCs file https://review.openstack.org/442148 | 20:21 |
| *** rkukura has quit IRC | 20:22 | |
| *** markvoelker has joined #openstack-infra | 20:24 | |
| *** rkukura has joined #openstack-infra | 20:27 | |
| *** ociuhandu has joined #openstack-infra | 20:27 | |
| *** mhickey has quit IRC | 20:28 | |
| *** yujunz has joined #openstack-infra | 20:29 | |
| andreaf | fungi: cool, thanks | 20:32 |
| *** vsaienko has joined #openstack-infra | 20:36 | |
| vsaienko | AJaeger registered project on pypi https://review.openstack.org/#/c/438907 | 20:36 |
| *** amotoki has joined #openstack-infra | 20:37 | |
| *** tonytan4ever has quit IRC | 20:37 | |
| *** tonytan4ever has joined #openstack-infra | 20:38 | |
| *** ijw_ has joined #openstack-infra | 20:38 | |
| AJaeger | vsaienko: great - let's move forward | 20:38 |
| *** esikachev has quit IRC | 20:39 | |
| *** amoralej is now known as amoralej|off | 20:39 | |
| vsaienko | AJaeger thanks! | 20:40 |
| *** ijw has quit IRC | 20:41 | |
| *** amotoki has quit IRC | 20:42 | |
| *** tonytan4ever has quit IRC | 20:42 | |
| *** pradk has quit IRC | 20:47 | |
| *** chlong has quit IRC | 20:48 | |
| *** esikachev has joined #openstack-infra | 20:48 | |
| *** yujunz has quit IRC | 20:49 | |
| *** askb has joined #openstack-infra | 20:49 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: upgrades: Only use release depenent environment for newton https://review.openstack.org/441946 | 20:51 |
| *** vhosakot has joined #openstack-infra | 20:52 | |
| *** yamahata has quit IRC | 20:52 | |
| *** salv-orlando has joined #openstack-infra | 20:53 | |
| *** esikachev has quit IRC | 20:53 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config master: Add neutron-dsvm-api job into devstack-gate gate https://review.openstack.org/442156 | 20:56 |
| openstackgerrit | John L. Villalovos proposed openstack-infra/devstack-gate master: WIP/DNM: Testing grenade with Ironic multi-node job https://review.openstack.org/431777 | 20:57 |
| ihrachys | sdague: mtreinish: tell me what you think about gating d-g against neutron-api job ^ | 20:57 |
| *** jcoufal_ has joined #openstack-infra | 20:58 | |
| *** hichihara has joined #openstack-infra | 20:58 | |
| sdague | ihrachys: so the 3 neutron jobs all in the gate are going to fail right? Should I just rebase those out so they don't slow down the d-g fix | 20:58 |
| ihrachys | sdague: yeah I guess | 20:58 |
| sdague | ihrachys: we definitely don't want it voting | 20:58 |
| openstackgerrit | Derek Schultz proposed openstack-infra/project-config master: Adds openstack-functions channel for project Picasso https://review.openstack.org/442157 | 20:58 |
| ihrachys | kevinbenton: ^ I guess you should adopt the armax's practice of bumping patches off gate to speed up fix merges | 20:59 |
| ihrachys | sdague: definitely? | 20:59 |
| ihrachys | what's the drawback? | 20:59 |
| *** ociuhandu has quit IRC | 21:00 | |
| sdague | ihrachys: every project putting every functional job of theirs into the voting list | 21:00 |
| *** savihou has joined #openstack-infra | 21:00 | |
| *** jamielennox|away is now known as jamielennox | 21:00 | |
| sdague | and nothing every landing | 21:00 |
| *** jcoufal has quit IRC | 21:00 | |
| sdague | non voting might be fine | 21:00 |
| sdague | but we even try to limit those | 21:00 |
| ihrachys | sdague: isn't it stability of a job that is of concern and not the number of jobs per se? | 21:01 |
| *** flwang has joined #openstack-infra | 21:01 | |
| flwang | AJaeger: ping | 21:01 |
| pabelanger | is anybody looking into the gate failures? Seems to be related to: sudo: .tox/all-plugin/bin/testr: command not found | 21:01 |
| flwang | AJaeger: about the distil-ui | 21:01 |
| pabelanger | http://logs.openstack.org/54/436754/1/gate/gate-neutron-dsvm-api-ubuntu-xenial/f8ef90e/console.html#_2017-03-06_20_56_31_353584 | 21:01 |
| ihrachys | sdague: well it's second time we are broken, we want to do something to avoid the third time | 21:01 |
| AJaeger | flwang: yes? | 21:01 |
| *** raildo has quit IRC | 21:01 | |
| ihrachys | pabelanger: yes fix in gate | 21:01 |
| *** rfolco has quit IRC | 21:01 | |
| ihrachys | pabelanger: https://review.openstack.org/#/c/442123/ | 21:01 |
| flwang | AJaeger: i prefer to start with an empty repo so that i can manage it better, is that ok? | 21:02 |
| pabelanger | ihrachys: thanks, I see it now | 21:02 |
| pabelanger | do we want to promote it? | 21:02 |
| ihrachys | would be nice | 21:02 |
| pabelanger | k | 21:02 |
| AJaeger | flwang: as long as you don't pushs lots of changes to keep history of your existing content: Sure | 21:02 |
| flwang | AJaeger: yep, should be fine. with that way, do i still need another patch set? | 21:03 |
| EmilienM | is it me or gerrit is super slow? | 21:03 |
| AJaeger | flwang: just mention it as review comment... | 21:03 |
| sdague | EmilienM: it is super slow | 21:03 |
| flwang | AJaeger: ok, cool, thank you | 21:03 |
| AJaeger | EmilienM: for me as well | 21:04 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Use PYTHONIOENCODING=utf-8 for invites invocation https://review.openstack.org/442158 | 21:04 |
| AJaeger | infra-root, time for weekly gerrit restart? | 21:04 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Eat the extra leading newline in invites https://review.openstack.org/442159 | 21:04 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Add human name to sample of invites from address https://review.openstack.org/442160 | 21:04 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql master: Add run_failure_rate argument to specify values to use in graph https://review.openstack.org/442147 | 21:04 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql master: Add run_time_meta arge to specify values to use in graph https://review.openstack.org/231763 | 21:04 |
| *** lucas-afk has quit IRC | 21:04 | |
| *** rfolco has joined #openstack-infra | 21:04 | |
| *** rfolco has quit IRC | 21:04 | |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config master: [Zun] Add kuryr-libnetwork to zunclient job https://review.openstack.org/442161 | 21:05 |
| pabelanger | 442123 has been promoted | 21:05 |
| *** rook has quit IRC | 21:05 | |
| dims_ | gerrit slow for anyone else? | 21:05 |
| *** wfoster has quit IRC | 21:05 | |
| *** florianf has quit IRC | 21:05 | |
| pabelanger | indeed, looks like GC is spiked | 21:06 |
| sdague | ihrachys: there is an infinite universe out there, the point isn't to try to figure out how to prevent anything from breaking anything else, because that wedges, we've seen that. As long as we have fast fix paths we can manage edge conditions. | 21:06 |
| *** yamahata has joined #openstack-infra | 21:06 | |
| *** rook has joined #openstack-infra | 21:06 | |
| ihrachys | sdague: ok then nv and we'll see if it stops from 3rd case? | 21:06 |
| pabelanger | fungi: clarkb: jeblair: ^any objections to restarting gerrit? | 21:06 |
| *** xarses_ has joined #openstack-infra | 21:06 | |
| *** rook is now known as Guest94833 | 21:06 | |
| *** lucasagomes has joined #openstack-infra | 21:07 | |
| *** wfoster has joined #openstack-infra | 21:07 | |
| ihrachys | sdague: I think it makes sense to have it as nv at least especially now when there is ongoing rework of how configs are loaded and such | 21:07 |
| sdague | ihrachys: nv seems fine to me | 21:07 |
| ihrachys | ok lemme adopt | 21:09 |
| *** Apoorva has quit IRC | 21:09 | |
| *** Apoorva has joined #openstack-infra | 21:09 | |
| *** andreww has quit IRC | 21:10 | |
| *** dschultz has joined #openstack-infra | 21:10 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 21:10 |
| *** rhallisey has quit IRC | 21:10 | |
| pabelanger | infra-root: it looks like compute035.vanilla.ic.openstack.org might be having HDD issues. It appears the filesystem is currently read-only: -bash: cannot create temp file for here-document: Read-only file system | 21:11 |
| pabelanger | I am going to see how to remove the node from service for now | 21:11 |
| fungi | pabelanger: gerrit restart seems pragmatic assuming the git gc graph looks like our usual death spiral | 21:12 |
| pabelanger | fungi: indeed it does | 21:12 |
| fungi | er, java gc graph i mean | 21:12 |
| pabelanger | 1 sec and I'll start the process | 21:12 |
| *** esikachev has joined #openstack-infra | 21:13 | |
| pabelanger | #status notice restarting gerrit to address performance problems | 21:13 |
| fungi | openstackstatus: seems slow too | 21:13 |
| *** pcaruana has quit IRC | 21:13 | |
| fungi | i'll take a quick look at its log | 21:14 |
| *** pabelanger has quit IRC | 21:14 | |
| *** pabelanger has joined #openstack-infra | 21:14 | |
| pabelanger | #status notice restarting gerrit to address performance problems | 21:14 |
| openstackstatus | pabelanger: sending notice | 21:14 |
| fungi | oh, you weren't auth'd ;) | 21:14 |
| pabelanger | there we go, needed to auth first | 21:14 |
| pabelanger | :) | 21:14 |
| * fungi forgets it's possible to not set nickserv to kick anyone who uses your nick without identifying (including yourself) | 21:15 | |
| -openstackstatus- NOTICE: restarting gerrit to address performance problems | 21:15 | |
| pabelanger | gerrit restarted | 21:16 |
| *** esikachev has quit IRC | 21:17 | |
| *** dprince has quit IRC | 21:17 | |
| openstackstatus | pabelanger: finished sending notice | 21:17 |
| *** yamahata has quit IRC | 21:19 | |
| openstackgerrit | Derek Schultz proposed openstack-infra/project-config master: Adds openstack-functions channel for project Picasso https://review.openstack.org/442157 | 21:19 |
| *** eroux has quit IRC | 21:23 | |
| flwang | may I please get an approval for this https://review.openstack.org/#/c/440846/ ? Thanks in advance | 21:24 |
| pabelanger | okay, I've disabled nova-compute on compute035.vanilla.ic.openstack.org for now. Waiting to confirm that the controller will no longer use it | 21:26 |
| *** kgiusti has quit IRC | 21:27 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: jjb/tripleo: merge some jobs with same properties https://review.openstack.org/441927 | 21:27 |
| felipemonteiro_ | Where is tempest.conf located in devstack-gate? /etc/tempest/tempest.conf? or /opt/stack/new/tempest/tempest.conf? | 21:27 |
| *** Guest94833 is now known as rook-new | 21:32 | |
| *** vsaienko has quit IRC | 21:32 | |
| *** baoli has joined #openstack-infra | 21:33 | |
| pabelanger | #status log nova-computer for compute035.vanilla.ic.o.o has been disabled on controller.vanilla.ic.o.o. compute035.vanilla.ic.o.o appears to be having HDD issue, currently in ready-only mode. | 21:33 |
| openstackstatus | pabelanger: finished logging | 21:33 |
| *** Jeffrey4l has quit IRC | 21:35 | |
| *** Jeffrey4l has joined #openstack-infra | 21:35 | |
| *** ldnunes has quit IRC | 21:37 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/subunit2sql master: Add option to sort and limit for run_failure_rate https://review.openstack.org/442175 | 21:37 |
| *** aysyd has quit IRC | 21:37 | |
| *** szaher_ has joined #openstack-infra | 21:37 | |
| szaher_ | Hello guys, I'm getting this error in the dvsm gate job http://logs.openstack.org/04/441104/10/check/gate-osbackup-freezer-dsvm-ubuntu-xenial/5cfb3b7/console.html | 21:38 |
| szaher_ | sudo: .tox/all-plugin/bin/testr: command not found | 21:38 |
| szaher_ | any idea how can I fix this error ? | 21:39 |
| *** savihou has quit IRC | 21:39 | |
| *** vsaienko has joined #openstack-infra | 21:39 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/devstack-gate master: WIP/DNM: Testing grenade with Ironic multi-node job https://review.openstack.org/431777 | 21:41 |
| *** jkilpatr has joined #openstack-infra | 21:42 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add generic tox job https://review.openstack.org/442180 | 21:43 |
| *** szaher_ has quit IRC | 21:44 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Provide file locations of config syntax errors https://review.openstack.org/441606 | 21:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove unused mergeChangeQueue method https://review.openstack.org/435950 | 21:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use hostname in Nodepool requests https://review.openstack.org/435949 | 21:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Clarify Job/Build/BuildSet docstrings https://review.openstack.org/435948 | 21:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add a test for a broken config on startup https://review.openstack.org/441499 | 21:46 |
| *** jkilpatr has quit IRC | 21:48 | |
| *** yamahata has joined #openstack-infra | 21:48 | |
| *** ociuhandu has joined #openstack-infra | 21:49 | |
| *** tonytan4ever has joined #openstack-infra | 21:50 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add generic tox job https://review.openstack.org/438281 | 21:52 |
| *** jkilpatr has joined #openstack-infra | 21:52 | |
| *** vsaienko has quit IRC | 21:53 | |
| *** ociuhandu has quit IRC | 21:54 | |
| *** ijw_ has quit IRC | 21:55 | |
| jhesketh | Morning | 21:58 |
| *** jkilpatr has quit IRC | 21:58 | |
| *** hichihara has quit IRC | 21:59 | |
| *** vsaienko has joined #openstack-infra | 21:59 | |
| EmilienM | pabelanger, yolanda, AJaeger: I checked tripleo Ci and all upgrade jobs are good now, thanks again for your help today. | 22:00 |
| *** Goneri has quit IRC | 22:00 | |
| *** jamesdenton has joined #openstack-infra | 22:01 | |
| *** jkilpatr_ has joined #openstack-infra | 22:01 | |
| jeblair | zuul meeting now in #openstack-meeting-alt | 22:01 |
| *** mtanino_ has joined #openstack-infra | 22:02 | |
| *** vhosakot has quit IRC | 22:04 | |
| *** mtanino has quit IRC | 22:04 | |
| *** thorst has quit IRC | 22:04 | |
| *** gouthamr has quit IRC | 22:05 | |
| *** thorst has joined #openstack-infra | 22:05 | |
| *** thorst has quit IRC | 22:09 | |
| *** esikachev has joined #openstack-infra | 22:10 | |
| *** rook-new is now known as rook | 22:12 | |
| *** jcoufal_ has quit IRC | 22:14 | |
| *** esikachev has quit IRC | 22:14 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config master: Add neutron-dsvm-api job into devstack-gate check queue https://review.openstack.org/442156 | 22:15 |
| *** jamesden_ has joined #openstack-infra | 22:16 | |
| *** dave-mccowan has quit IRC | 22:17 | |
| *** jamesdenton has quit IRC | 22:18 | |
| *** vsaienko has quit IRC | 22:18 | |
| *** ZZelle has joined #openstack-infra | 22:19 | |
| *** matt-borland has quit IRC | 22:19 | |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Revert "Add testr slowest to the end of the test run" https://review.openstack.org/442123 | 22:21 |
| *** john-davidge has quit IRC | 22:22 | |
| *** adriant has joined #openstack-infra | 22:22 | |
| *** vsaienko has joined #openstack-infra | 22:22 | |
| *** baoli has quit IRC | 22:23 | |
| *** ijw has joined #openstack-infra | 22:24 | |
| *** jkilpatr_ has quit IRC | 22:24 | |
| *** gouthamr has joined #openstack-infra | 22:25 | |
| *** esikachev has joined #openstack-infra | 22:27 | |
| *** jkilpatr_ has joined #openstack-infra | 22:28 | |
| *** ihrachys has quit IRC | 22:29 | |
| *** ijw has quit IRC | 22:29 | |
| *** dimtruck is now known as zz_dimtruck | 22:29 | |
| *** vsaienko has quit IRC | 22:31 | |
| *** esikachev has quit IRC | 22:33 | |
| *** jkilpatr_ has quit IRC | 22:34 | |
| *** ijw has joined #openstack-infra | 22:35 | |
| *** vsaienko has joined #openstack-infra | 22:37 | |
| *** jkilpatr_ has joined #openstack-infra | 22:37 | |
| *** amotoki has joined #openstack-infra | 22:38 | |
| *** ijw has quit IRC | 22:38 | |
| *** ijw has joined #openstack-infra | 22:38 | |
| *** amotoki has quit IRC | 22:42 | |
| *** vhosakot has joined #openstack-infra | 22:43 | |
| *** dasanind has joined #openstack-infra | 22:46 | |
| *** tonytan4ever has quit IRC | 22:49 | |
| *** gongysh has joined #openstack-infra | 22:50 | |
| *** ccamacho has left #openstack-infra | 22:53 | |
| *** vsaienko has quit IRC | 22:54 | |
| *** EricGonczer_ has quit IRC | 22:55 | |
| *** zz_dimtruck is now known as dimtruck | 22:57 | |
| *** vsaienko has joined #openstack-infra | 22:57 | |
| *** tlian has joined #openstack-infra | 22:58 | |
| fungi | gonna go grab some dinner now that the zuul meeting's over, but should be back shortly | 23:00 |
| *** claudiub has joined #openstack-infra | 23:01 | |
| jamielennox | fungi, clarkb, zaro: hey, can we proceed with that JJB 1.6.2 tag today? | 23:04 |
| *** claudiub|2 has quit IRC | 23:04 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: jjb/tripleo: merge some jobs with same properties https://review.openstack.org/441927 | 23:04 |
| *** derekh has quit IRC | 23:04 | |
| jamielennox | the uncap was merged to the stable branch | 23:04 |
| *** jkilpatr_ has quit IRC | 23:04 | |
| *** jamesden_ has quit IRC | 23:05 | |
| *** jkilpatr_ has joined #openstack-infra | 23:06 | |
| *** pramodrj07 has joined #openstack-infra | 23:07 | |
| *** jamesdenton has joined #openstack-infra | 23:08 | |
| *** jamesdenton has quit IRC | 23:09 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add generic tox job https://review.openstack.org/442180 | 23:11 |
| *** vsaienko has quit IRC | 23:13 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/441731 | 23:13 |
| *** esikachev has joined #openstack-infra | 23:13 | |
| *** hashar has quit IRC | 23:15 | |
| openstackgerrit | Felipe Monteiro proposed openstack-infra/project-config master: Add post test hook to patrole. https://review.openstack.org/442203 | 23:17 |
| *** esikachev has quit IRC | 23:18 | |
| *** jkilpatr_ has quit IRC | 23:18 | |
| *** rcernin has quit IRC | 23:19 | |
| *** jkilpatr_ has joined #openstack-infra | 23:20 | |
| otherwiseguy | Who do I contact about getting myself added to ovsdbapp-core? The project creators docs just say "ask the infra team". | 23:21 |
| pabelanger | otherwiseguy: which review? | 23:22 |
| pabelanger | otherwiseguy: 438080 I take it was the initial request? | 23:23 |
| otherwiseguy | https://review.openstack.org/#/c/438080/ yeah. | 23:23 |
| pabelanger | otherwiseguy: done! | 23:23 |
| otherwiseguy | also: hi pabelanger! :) | 23:23 |
| pabelanger | o/ | 23:24 |
| otherwiseguy | well that was easy. :D | 23:24 |
| pabelanger | indeed | 23:24 |
| *** esikachev has joined #openstack-infra | 23:24 | |
| *** xyang1 has quit IRC | 23:26 | |
| otherwiseguy | thanks pabelanger! | 23:27 |
| *** s-shiono has joined #openstack-infra | 23:32 | |
| *** esikachev has quit IRC | 23:34 | |
| *** gordc has quit IRC | 23:35 | |
| *** annegentle has quit IRC | 23:35 | |
| *** vhosakot has quit IRC | 23:42 | |
| *** gyee has joined #openstack-infra | 23:46 | |
| *** salv-orlando has quit IRC | 23:46 | |
| *** ssbarnea has quit IRC | 23:46 | |
| *** wolverineav has joined #openstack-infra | 23:47 | |
| *** wolverin_ has quit IRC | 23:48 | |
| *** jaypipes has quit IRC | 23:49 | |
| *** asselin has joined #openstack-infra | 23:54 | |
| *** jkilpatr_ has quit IRC | 23:54 | |
| *** gildub has joined #openstack-infra | 23:55 | |
| *** gongysh has quit IRC | 23:57 | |
| *** jkilpatr_ has joined #openstack-infra | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!