| *** dingyichen has joined #openstack-infra | 00:01 | |
| mwhahaha | so gerrit is just hanging for me when I try to push a change, anyone else? | 00:02 |
|---|---|---|
| mwhahaha | if i ctrl+c and retry it's rejecting it but i'm not seeing the new patch set | 00:03 |
| clarkb | mwhahaha: its that 0000UTC db backup time again | 00:03 |
| clarkb | should be fine in a minute or two | 00:03 |
| mwhahaha | sneaky | 00:03 |
| mwhahaha | ok | 00:03 |
| *** sflanigan has quit IRC | 00:05 | |
| *** dingyichen has quit IRC | 00:05 | |
| *** dchen has joined #openstack-infra | 00:05 | |
| *** sflanigan has joined #openstack-infra | 00:05 | |
| *** sflanigan has joined #openstack-infra | 00:05 | |
| *** dchen has quit IRC | 00:05 | |
| *** wolverineav has joined #openstack-infra | 00:05 | |
| *** dingyichen has joined #openstack-infra | 00:06 | |
| *** jamesdenton has joined #openstack-infra | 00:06 | |
| *** pahuang has quit IRC | 00:07 | |
| Swanson | I want to back out a commit that is up in gerrit and push up a new one based on the previous commit. How? | 00:07 |
| clarkb | Swanson: gerrit won't let you push the same patch twice, easiest way is to git review -d the patchset you wnt, git commit --amend to change the commit message slightly then git review to push ti back up again | 00:08 |
| *** wolverineav has quit IRC | 00:10 | |
| *** hongbin has quit IRC | 00:10 | |
| *** jamesdenton has quit IRC | 00:11 | |
| *** wowbagger42 has quit IRC | 00:11 | |
| *** thorst_ has joined #openstack-infra | 00:12 | |
| *** sdake has joined #openstack-infra | 00:13 | |
| openstackgerrit | Jerry Zhao proposed openstack-infra/project-config: create project for fuel plugin of fortinet related plugins https://review.openstack.org/326091 | 00:14 |
| *** ijw has joined #openstack-infra | 00:14 | |
| openstackgerrit | Manjeet Singh Bhatia proposed openstack-infra/project-config: Making a networking-odl job multinode https://review.openstack.org/395259 | 00:15 |
| *** tphummel has quit IRC | 00:15 | |
| *** EricGonczer_ has quit IRC | 00:16 | |
| *** rbrndt_ has quit IRC | 00:16 | |
| *** EricGonczer_ has joined #openstack-infra | 00:18 | |
| *** ijw has quit IRC | 00:19 | |
| *** Dong_Zhi has joined #openstack-infra | 00:19 | |
| *** david-lyle has quit IRC | 00:20 | |
| *** oomichi has quit IRC | 00:22 | |
| *** Julien-zte has joined #openstack-infra | 00:24 | |
| *** pahuang has joined #openstack-infra | 00:24 | |
| *** Dong_Zhi has quit IRC | 00:24 | |
| *** Dong_Zhi has joined #openstack-infra | 00:25 | |
| *** wolverineav has joined #openstack-infra | 00:25 | |
| *** john-davidge has joined #openstack-infra | 00:26 | |
| *** Julien-zte has quit IRC | 00:26 | |
| *** Julien-zte has joined #openstack-infra | 00:27 | |
| *** gmann has joined #openstack-infra | 00:30 | |
| *** wolverineav has quit IRC | 00:30 | |
| *** john-davidge has quit IRC | 00:30 | |
| *** annegentle has quit IRC | 00:30 | |
| *** spzala has joined #openstack-infra | 00:31 | |
| *** Dong_Zhi has quit IRC | 00:32 | |
| *** jamesdenton has joined #openstack-infra | 00:34 | |
| *** wolverineav has joined #openstack-infra | 00:35 | |
| *** spzala has quit IRC | 00:37 | |
| *** gmann has quit IRC | 00:39 | |
| *** wolverineav has quit IRC | 00:40 | |
| *** oomichi has joined #openstack-infra | 00:43 | |
| *** sbalukoff has left #openstack-infra | 00:45 | |
| *** gmann has joined #openstack-infra | 00:46 | |
| *** Julien-zte has quit IRC | 00:49 | |
| *** amotoki has quit IRC | 00:49 | |
| *** chlong has joined #openstack-infra | 00:49 | |
| *** thcipriani is now known as thcipriani|afk | 00:50 | |
| *** Julien-zte has joined #openstack-infra | 00:50 | |
| *** spzala has joined #openstack-infra | 00:52 | |
| *** jamesdenton has quit IRC | 00:55 | |
| *** ijw has joined #openstack-infra | 00:55 | |
| *** spzala has quit IRC | 00:56 | |
| *** tuanluong has joined #openstack-infra | 00:57 | |
| *** spzala has joined #openstack-infra | 00:59 | |
| *** Julien-zte has quit IRC | 01:01 | |
| *** Julien-zte has joined #openstack-infra | 01:02 | |
| *** gmann_ has joined #openstack-infra | 01:02 | |
| *** Julien-zte has quit IRC | 01:03 | |
| *** gmann has quit IRC | 01:03 | |
| *** Julien-zte has joined #openstack-infra | 01:04 | |
| *** wolverineav has joined #openstack-infra | 01:04 | |
| *** Julien-zte has joined #openstack-infra | 01:05 | |
| *** Julien-zte has joined #openstack-infra | 01:05 | |
| *** dchen has joined #openstack-infra | 01:05 | |
| *** Swami_ has quit IRC | 01:06 | |
| *** Swami has quit IRC | 01:06 | |
| *** wolverineav has quit IRC | 01:09 | |
| *** dchen has quit IRC | 01:09 | |
| *** pvaneck has quit IRC | 01:11 | |
| *** Julien-zte has quit IRC | 01:12 | |
| *** Julien-zte has joined #openstack-infra | 01:13 | |
| openstackgerrit | Joseph Robinson proposed openstack-infra/irc-meetings: [User Guide] Updating Meeting Schedule https://review.openstack.org/395274 | 01:15 |
| *** gmann has joined #openstack-infra | 01:17 | |
| *** jamesdenton has joined #openstack-infra | 01:18 | |
| *** gmann_ has quit IRC | 01:19 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 01:19 |
| *** markvoelker has quit IRC | 01:22 | |
| *** Sukhdev has quit IRC | 01:23 | |
| *** wolverineav has joined #openstack-infra | 01:24 | |
| *** maeker has quit IRC | 01:28 | |
| *** wolverineav has quit IRC | 01:28 | |
| *** tphummel has joined #openstack-infra | 01:29 | |
| *** gmann_ has joined #openstack-infra | 01:30 | |
| *** zhurong has joined #openstack-infra | 01:31 | |
| *** gmann has quit IRC | 01:33 | |
| *** yanyanhu has joined #openstack-infra | 01:36 | |
| *** sdake has quit IRC | 01:37 | |
| *** Daisy has joined #openstack-infra | 01:39 | |
| *** Daisy has quit IRC | 01:39 | |
| *** Daisy has joined #openstack-infra | 01:39 | |
| *** EricGonczer_ has quit IRC | 01:40 | |
| *** Apoorva has quit IRC | 01:42 | |
| *** amotoki has joined #openstack-infra | 01:43 | |
| *** tphummel has quit IRC | 01:45 | |
| *** wolverineav has joined #openstack-infra | 01:45 | |
| *** jamesdenton has quit IRC | 01:46 | |
| *** armax has quit IRC | 01:47 | |
| openstackgerrit | Joseph Robinson proposed openstack-infra/irc-meetings: [User Guide] Updating Meeting Schedule https://review.openstack.org/395274 | 01:48 |
| *** jamesdenton has joined #openstack-infra | 01:48 | |
| *** amotoki has quit IRC | 01:48 | |
| *** wolverineav has quit IRC | 01:50 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Change Ops Guide specialty team meeting time https://review.openstack.org/394719 | 01:55 |
| *** wolverineav has joined #openstack-infra | 01:55 | |
| *** jamesdenton has quit IRC | 01:57 | |
| *** maeker has joined #openstack-infra | 01:59 | |
| *** wolverineav has quit IRC | 02:00 | |
| *** maeker has quit IRC | 02:03 | |
| *** ijw has quit IRC | 02:04 | |
| *** mmandel has joined #openstack-infra | 02:07 | |
| *** tiswanso has joined #openstack-infra | 02:08 | |
| openstackgerrit | Joseph Robinson proposed openstack-infra/irc-meetings: [User Guide] Updating Meeting Schedule https://review.openstack.org/395274 | 02:09 |
| *** mmandel has quit IRC | 02:11 | |
| *** pahuang has quit IRC | 02:12 | |
| *** esikachev has joined #openstack-infra | 02:13 | |
| *** tiswanso has quit IRC | 02:17 | |
| *** tiswanso has joined #openstack-infra | 02:17 | |
| *** esikachev has quit IRC | 02:18 | |
| *** sflanigan has quit IRC | 02:18 | |
| *** david-lyle has joined #openstack-infra | 02:20 | |
| *** david-lyle has quit IRC | 02:20 | |
| *** david-lyle has joined #openstack-infra | 02:22 | |
| *** Kiall has quit IRC | 02:22 | |
| *** markvoelker has joined #openstack-infra | 02:23 | |
| *** jcoufal has quit IRC | 02:23 | |
| *** ssbarnea has quit IRC | 02:23 | |
| *** ssbarnea has joined #openstack-infra | 02:24 | |
| *** shu-mutou-AWAY is now known as shu-mutou | 02:24 | |
| *** Kiall has joined #openstack-infra | 02:25 | |
| *** wolverineav has joined #openstack-infra | 02:25 | |
| *** pahuang has joined #openstack-infra | 02:26 | |
| *** markvoelker has quit IRC | 02:28 | |
| *** wolverineav has quit IRC | 02:29 | |
| *** EricGonczer_ has joined #openstack-infra | 02:31 | |
| *** binbincong has quit IRC | 02:31 | |
| *** sflanigan has joined #openstack-infra | 02:31 | |
| *** sflanigan has joined #openstack-infra | 02:31 | |
| *** Julien-zte has quit IRC | 02:36 | |
| *** Julien-zte has joined #openstack-infra | 02:37 | |
| *** thorst_ has quit IRC | 02:39 | |
| *** thorst_ has joined #openstack-infra | 02:40 | |
| *** mriedem has quit IRC | 02:42 | |
| *** rbuzatu has quit IRC | 02:44 | |
| *** wolverineav has joined #openstack-infra | 02:45 | |
| *** Julien-zte has quit IRC | 02:45 | |
| *** rbuzatu has joined #openstack-infra | 02:46 | |
| *** spzala has quit IRC | 02:46 | |
| *** spzala has joined #openstack-infra | 02:46 | |
| *** thorst_ has quit IRC | 02:48 | |
| *** wolverineav has quit IRC | 02:49 | |
| *** spzala has quit IRC | 02:51 | |
| *** Julien-zte has joined #openstack-infra | 02:52 | |
| *** john-davidge has joined #openstack-infra | 02:53 | |
| *** apetrich has quit IRC | 02:53 | |
| *** binbincong has joined #openstack-infra | 02:56 | |
| *** john-davidge has quit IRC | 02:57 | |
| *** mmandel has joined #openstack-infra | 02:58 | |
| *** rossella_s has joined #openstack-infra | 03:00 | |
| *** mmandel has quit IRC | 03:02 | |
| *** Julien-zte has quit IRC | 03:04 | |
| *** wolverineav has joined #openstack-infra | 03:04 | |
| *** Julien-zte has joined #openstack-infra | 03:05 | |
| *** apetrich has joined #openstack-infra | 03:07 | |
| *** wolverineav has quit IRC | 03:09 | |
| *** aneliubin has joined #openstack-infra | 03:12 | |
| *** aneliubin has quit IRC | 03:13 | |
| *** yaume has quit IRC | 03:19 | |
| *** rossella_s has quit IRC | 03:22 | |
| *** knangia has quit IRC | 03:22 | |
| *** Julien-zte has quit IRC | 03:23 | |
| *** Julien-zte has joined #openstack-infra | 03:23 | |
| *** wolverineav has joined #openstack-infra | 03:25 | |
| *** EricGonczer_ has quit IRC | 03:27 | |
| *** sflanigan has quit IRC | 03:29 | |
| *** wolverineav has quit IRC | 03:30 | |
| *** sflanigan has joined #openstack-infra | 03:31 | |
| *** adrian_otto has joined #openstack-infra | 03:32 | |
| *** EricGonczer_ has joined #openstack-infra | 03:32 | |
| *** Julien-zte has quit IRC | 03:33 | |
| openstackgerrit | Isaku Yamahata proposed openstack-infra/project-config: networking-odl: make rally job voting https://review.openstack.org/395298 | 03:33 |
| *** pahuang has quit IRC | 03:35 | |
| *** kvcobb has quit IRC | 03:35 | |
| *** EricGonczer_ has quit IRC | 03:35 | |
| *** Julien-zte has joined #openstack-infra | 03:35 | |
| *** dave-mccowan has quit IRC | 03:38 | |
| *** Daisy has quit IRC | 03:39 | |
| *** Julien-zte has quit IRC | 03:40 | |
| *** Daisy has joined #openstack-infra | 03:40 | |
| *** hongbin has joined #openstack-infra | 03:41 | |
| *** Daisy has quit IRC | 03:41 | |
| *** Daisy has joined #openstack-infra | 03:42 | |
| *** wolverineav has joined #openstack-infra | 03:45 | |
| *** asselin_ has joined #openstack-infra | 03:45 | |
| *** thorst_ has joined #openstack-infra | 03:46 | |
| *** adrian_otto has quit IRC | 03:46 | |
| *** asselin__ has joined #openstack-infra | 03:46 | |
| *** yamahata has joined #openstack-infra | 03:46 | |
| *** Daisy has quit IRC | 03:47 | |
| *** asselin has quit IRC | 03:47 | |
| *** Daisy has joined #openstack-infra | 03:48 | |
| *** wolverineav has quit IRC | 03:50 | |
| *** asselin_ has quit IRC | 03:50 | |
| *** aneliubin has joined #openstack-infra | 03:50 | |
| *** hongbin has quit IRC | 03:51 | |
| *** pahuang has joined #openstack-infra | 03:51 | |
| *** Daisy has quit IRC | 03:52 | |
| *** thorst_ has quit IRC | 03:54 | |
| *** Daisy has joined #openstack-infra | 03:54 | |
| *** mixos has quit IRC | 03:57 | |
| *** Daisy has quit IRC | 03:58 | |
| *** Daisy has joined #openstack-infra | 04:00 | |
| *** Daisy has quit IRC | 04:04 | |
| *** gmann_ has quit IRC | 04:04 | |
| *** wolverineav has joined #openstack-infra | 04:05 | |
| *** binbincong has quit IRC | 04:06 | |
| *** Daisy has joined #openstack-infra | 04:06 | |
| *** wolverineav has quit IRC | 04:10 | |
| *** Daisy has quit IRC | 04:10 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Change Ops Guide specialty team meeting time https://review.openstack.org/394719 | 04:12 |
| *** adriant has quit IRC | 04:12 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements https://review.openstack.org/389871 | 04:13 |
| openstackgerrit | Merged openstack-infra/irc-meetings: [User Guide] Updating Meeting Schedule https://review.openstack.org/395274 | 04:13 |
| *** esikachev has joined #openstack-infra | 04:13 | |
| *** masber has quit IRC | 04:14 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements https://review.openstack.org/395311 | 04:14 |
| *** wolverineav has joined #openstack-infra | 04:15 | |
| *** masber has joined #openstack-infra | 04:15 | |
| *** Daisy has joined #openstack-infra | 04:16 | |
| *** esikachev has quit IRC | 04:18 | |
| *** wolverineav has quit IRC | 04:19 | |
| *** Daisy has quit IRC | 04:21 | |
| *** Daisy has joined #openstack-infra | 04:22 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-testr: Updated from global requirements https://review.openstack.org/389926 | 04:22 |
| *** Sukhdev has joined #openstack-infra | 04:22 | |
| *** alex_xu has quit IRC | 04:23 | |
| *** tiswanso has quit IRC | 04:23 | |
| *** Dong_Zhi has joined #openstack-infra | 04:23 | |
| *** markvoelker has joined #openstack-infra | 04:24 | |
| *** Dong_Zhi_ has joined #openstack-infra | 04:24 | |
| *** Dong_Zhi has quit IRC | 04:25 | |
| *** Dong_Zhi__ has joined #openstack-infra | 04:25 | |
| *** binbincong has joined #openstack-infra | 04:26 | |
| openstackgerrit | Lin Yang proposed openstack-infra/project-config: Add mapping from rsc gerrit to launchpad https://review.openstack.org/395396 | 04:28 |
| *** markvoelker has quit IRC | 04:28 | |
| *** Dong_Zhi_ has quit IRC | 04:29 | |
| *** Daisy_ has joined #openstack-infra | 04:29 | |
| *** alex_xu has joined #openstack-infra | 04:29 | |
| *** Daisy_ has quit IRC | 04:30 | |
| *** nicolasbock has quit IRC | 04:30 | |
| *** Daisy_ has joined #openstack-infra | 04:31 | |
| *** Daisy has quit IRC | 04:32 | |
| *** gmann has joined #openstack-infra | 04:33 | |
| *** Dong_Zhi__ has quit IRC | 04:33 | |
| *** Daisy_ has quit IRC | 04:35 | |
| *** Julien-zte has joined #openstack-infra | 04:36 | |
| *** links has joined #openstack-infra | 04:38 | |
| openstackgerrit | Lin Yang proposed openstack-infra/project-config: Rename rsc to valence https://review.openstack.org/381332 | 04:39 |
| *** Rockyg has quit IRC | 04:41 | |
| *** Julien-zte has quit IRC | 04:41 | |
| *** Daisy has joined #openstack-infra | 04:43 | |
| *** wolverineav has joined #openstack-infra | 04:44 | |
| *** adrian_otto has joined #openstack-infra | 04:44 | |
| *** sandanar has joined #openstack-infra | 04:45 | |
| *** Daisy has quit IRC | 04:47 | |
| *** Daisy has joined #openstack-infra | 04:49 | |
| *** wolverineav has quit IRC | 04:49 | |
| *** binbincong has quit IRC | 04:52 | |
| *** sree has joined #openstack-infra | 04:52 | |
| *** thorst_ has joined #openstack-infra | 04:52 | |
| *** Daisy has quit IRC | 04:53 | |
| *** Daisy has joined #openstack-infra | 04:55 | |
| *** binbincong has joined #openstack-infra | 04:55 | |
| *** thorst_ has quit IRC | 04:59 | |
| *** Daisy has quit IRC | 05:00 | |
| *** Daisy has joined #openstack-infra | 05:01 | |
| *** mixos has joined #openstack-infra | 05:03 | |
| *** Daisy has quit IRC | 05:03 | |
| *** Daisy has joined #openstack-infra | 05:03 | |
| *** wolverineav has joined #openstack-infra | 05:04 | |
| *** gmann_ has joined #openstack-infra | 05:04 | |
| *** gmann has quit IRC | 05:06 | |
| *** adrian_otto has quit IRC | 05:06 | |
| *** adrian_otto has joined #openstack-infra | 05:07 | |
| *** wolverineav has quit IRC | 05:08 | |
| *** claudiub has joined #openstack-infra | 05:11 | |
| *** adrian_otto has quit IRC | 05:12 | |
| *** adrian_otto has joined #openstack-infra | 05:13 | |
| *** adrian_otto has quit IRC | 05:13 | |
| *** adrian_otto has joined #openstack-infra | 05:15 | |
| *** snarwade has joined #openstack-infra | 05:16 | |
| *** binbincong has quit IRC | 05:16 | |
| *** alex_xu has quit IRC | 05:17 | |
| *** alex_xu has joined #openstack-infra | 05:18 | |
| *** john-davidge has joined #openstack-infra | 05:20 | |
| *** david-lyle has quit IRC | 05:22 | |
| *** david-lyle has joined #openstack-infra | 05:23 | |
| *** wolverineav has joined #openstack-infra | 05:24 | |
| *** john-davidge has quit IRC | 05:25 | |
| *** Daisy has quit IRC | 05:25 | |
| *** Daisy has joined #openstack-infra | 05:26 | |
| *** chandankumar has joined #openstack-infra | 05:27 | |
| *** wolverineav has quit IRC | 05:28 | |
| *** adrian_otto has quit IRC | 05:29 | |
| *** Daisy_ has joined #openstack-infra | 05:31 | |
| *** kvcobb has joined #openstack-infra | 05:32 | |
| *** sflanigan has quit IRC | 05:33 | |
| *** adrian_otto has joined #openstack-infra | 05:33 | |
| *** binbincong has joined #openstack-infra | 05:33 | |
| *** wolverineav has joined #openstack-infra | 05:34 | |
| *** Daisy has quit IRC | 05:34 | |
| *** adrian_otto has quit IRC | 05:35 | |
| *** adrian_otto has joined #openstack-infra | 05:36 | |
| *** Julien-zte has joined #openstack-infra | 05:37 | |
| *** wolverineav has quit IRC | 05:38 | |
| *** Daisy_ has quit IRC | 05:39 | |
| *** Daisy has joined #openstack-infra | 05:40 | |
| *** Julien-zte has quit IRC | 05:41 | |
| *** wolverineav has joined #openstack-infra | 05:43 | |
| *** wolverineav has quit IRC | 05:48 | |
| *** binbincong has quit IRC | 05:55 | |
| *** thorst_ has joined #openstack-infra | 05:56 | |
| *** oanson has joined #openstack-infra | 05:59 | |
| *** gmann has joined #openstack-infra | 06:03 | |
| *** thorst_ has quit IRC | 06:04 | |
| *** rbuzatu has quit IRC | 06:04 | |
| *** gmann_ has quit IRC | 06:05 | |
| openstackgerrit | Yanyan Hu proposed openstack-infra/project-config: Fix senlin integration test https://review.openstack.org/395410 | 06:08 |
| *** wolverineav has joined #openstack-infra | 06:09 | |
| *** wolverineav has quit IRC | 06:09 | |
| *** links has quit IRC | 06:11 | |
| *** adrian_otto has quit IRC | 06:11 | |
| *** kjackal_ has joined #openstack-infra | 06:12 | |
| *** esikachev has joined #openstack-infra | 06:14 | |
| *** rbuzatu has joined #openstack-infra | 06:14 | |
| *** Daisy has quit IRC | 06:17 | |
| *** dingyichen has quit IRC | 06:17 | |
| *** kjackal_ has quit IRC | 06:18 | |
| *** rbuzatu has quit IRC | 06:18 | |
| *** esikachev has quit IRC | 06:18 | |
| *** rbuzatu has joined #openstack-infra | 06:19 | |
| *** rbuzatu has quit IRC | 06:23 | |
| *** markvoelker has joined #openstack-infra | 06:24 | |
| *** wolverineav has joined #openstack-infra | 06:29 | |
| *** markvoelker has quit IRC | 06:29 | |
| *** kjackal_ has joined #openstack-infra | 06:31 | |
| *** dingyichen has joined #openstack-infra | 06:31 | |
| *** wolverineav has quit IRC | 06:33 | |
| *** kaisers has joined #openstack-infra | 06:35 | |
| *** zhurong has quit IRC | 06:35 | |
| *** rbuzatu has joined #openstack-infra | 06:36 | |
| *** zhurong has joined #openstack-infra | 06:37 | |
| *** Julien-zte has joined #openstack-infra | 06:38 | |
| *** Kevin_Zheng has joined #openstack-infra | 06:39 | |
| *** links has joined #openstack-infra | 06:39 | |
| *** qwertyco has joined #openstack-infra | 06:40 | |
| *** hurgleburgler has quit IRC | 06:41 | |
| *** Julien-zte has quit IRC | 06:43 | |
| *** esikachev has joined #openstack-infra | 06:45 | |
| *** wolverineav has joined #openstack-infra | 06:49 | |
| *** esikachev has quit IRC | 06:50 | |
| *** wolverineav has quit IRC | 06:53 | |
| *** rcernin has joined #openstack-infra | 06:54 | |
| *** jtomasek has quit IRC | 06:55 | |
| *** wolverineav has joined #openstack-infra | 06:59 | |
| *** HeOS has joined #openstack-infra | 06:59 | |
| *** drifterza has joined #openstack-infra | 06:59 | |
| *** sflanigan has joined #openstack-infra | 07:00 | |
| *** thorst_ has joined #openstack-infra | 07:01 | |
| *** wolverineav has quit IRC | 07:03 | |
| *** ihrachys has joined #openstack-infra | 07:07 | |
| *** thorst_ has quit IRC | 07:09 | |
| *** Jeffrey4l has joined #openstack-infra | 07:09 | |
| *** tesseract has joined #openstack-infra | 07:11 | |
| *** tesseract is now known as Guest39033 | 07:11 | |
| *** mmandel has joined #openstack-infra | 07:14 | |
| *** kjackal_ has quit IRC | 07:14 | |
| *** kjackal_ has joined #openstack-infra | 07:15 | |
| *** tlian has quit IRC | 07:18 | |
| *** mmandel has quit IRC | 07:19 | |
| *** abregman has joined #openstack-infra | 07:19 | |
| *** saibarspeis has joined #openstack-infra | 07:23 | |
| *** wolverineav has joined #openstack-infra | 07:24 | |
| *** markvoelker has joined #openstack-infra | 07:25 | |
| openstackgerrit | chenhb proposed openstack-infra/project-config: [Rally]Add neutron extensions service test job https://review.openstack.org/395432 | 07:26 |
| *** Sukhdev has quit IRC | 07:28 | |
| *** wolverineav has quit IRC | 07:29 | |
| *** andreas_s has joined #openstack-infra | 07:29 | |
| *** markvoelker has quit IRC | 07:30 | |
| *** florianf has joined #openstack-infra | 07:32 | |
| openstackgerrit | Julia Varlamova proposed openstack-infra/devstack-gate: Add new roles to feature matrix https://review.openstack.org/394895 | 07:35 |
| *** isaacb has joined #openstack-infra | 07:36 | |
| *** Julien-zte has joined #openstack-infra | 07:39 | |
| *** tmorin has joined #openstack-infra | 07:41 | |
| *** Julien-zte has quit IRC | 07:43 | |
| *** esikachev has joined #openstack-infra | 07:45 | |
| *** matrohon has joined #openstack-infra | 07:53 | |
| *** wolverineav has joined #openstack-infra | 07:53 | |
| *** pilgrimstack1 has joined #openstack-infra | 07:57 | |
| *** wolverineav has quit IRC | 07:58 | |
| *** pilgrimstack has quit IRC | 07:59 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: networking-bagpipe jobs adjustments https://review.openstack.org/394339 | 08:00 |
| *** ihrachys has quit IRC | 08:06 | |
| *** dtardivel has joined #openstack-infra | 08:07 | |
| *** thorst_ has joined #openstack-infra | 08:08 | |
| *** caowei_ has joined #openstack-infra | 08:08 | |
| *** shardy has joined #openstack-infra | 08:09 | |
| *** ad_rien_ has joined #openstack-infra | 08:09 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: Add Grafana for networking-bagpipe https://review.openstack.org/385337 | 08:11 |
| yolanda | good morning | 08:12 |
| *** wolverineav has joined #openstack-infra | 08:12 | |
| *** ad_rien_1 has joined #openstack-infra | 08:13 | |
| *** thorst_ has quit IRC | 08:13 | |
| *** ad_rien_ has quit IRC | 08:13 | |
| *** wolverineav has quit IRC | 08:17 | |
| *** isaacb has quit IRC | 08:18 | |
| *** yuval has joined #openstack-infra | 08:21 | |
| *** ssbarnea has quit IRC | 08:22 | |
| *** acabot has joined #openstack-infra | 08:24 | |
| openstackgerrit | Merged openstack-infra/project-config: networking-bgpvpn jobs adjustments https://review.openstack.org/394352 | 08:24 |
| *** jaosorior has joined #openstack-infra | 08:25 | |
| openstackgerrit | Merged openstack-infra/project-config: Add Grafana config for networking-bgpvpn https://review.openstack.org/385335 | 08:25 |
| openstackgerrit | Merged openstack-infra/project-config: [magnum] Add specs repo https://review.openstack.org/391770 | 08:25 |
| openstackgerrit | Merged openstack-infra/project-config: Add coverage2sql project https://review.openstack.org/393634 | 08:25 |
| openstackgerrit | Merged openstack-infra/project-config: Create governance-website repository https://review.openstack.org/394412 | 08:26 |
| openstackgerrit | Merged openstack-infra/project-config: Add i18n-specs repo https://review.openstack.org/394680 | 08:26 |
| *** ralonsoh has joined #openstack-infra | 08:26 | |
| *** abregman has quit IRC | 08:26 | |
| openstackgerrit | Merged openstack-infra/project-config: Adds check-requirements job to compute-hyperv https://review.openstack.org/394982 | 08:28 |
| *** abregman has joined #openstack-infra | 08:28 | |
| openstackgerrit | Merged openstack-infra/project-config: Publish yaql docs on rtfd https://review.openstack.org/394546 | 08:29 |
| openstackgerrit | Merged openstack-infra/project-config: Fix typos in initialize-urandom.py & gerrit-git-prep.sh https://review.openstack.org/394734 | 08:29 |
| *** ggnel_t has quit IRC | 08:29 | |
| *** ssbarnea has joined #openstack-infra | 08:30 | |
| *** abregman is now known as abregman|mtg | 08:38 | |
| *** dingyichen has quit IRC | 08:39 | |
| *** Julien-zte has joined #openstack-infra | 08:39 | |
| *** bhavik1 has joined #openstack-infra | 08:42 | |
| *** ggnel_t has joined #openstack-infra | 08:43 | |
| *** Julien-zte has quit IRC | 08:44 | |
| *** martinkopec has joined #openstack-infra | 08:44 | |
| *** jpich has joined #openstack-infra | 08:46 | |
| *** Julien-zte has joined #openstack-infra | 08:47 | |
| *** caowei_ has quit IRC | 08:47 | |
| *** Julien-zte has quit IRC | 08:48 | |
| *** openstackgerrit has quit IRC | 08:48 | |
| *** openstackgerrit has joined #openstack-infra | 08:48 | |
| *** Julien-zte has joined #openstack-infra | 08:48 | |
| *** Julien-zte has quit IRC | 08:50 | |
| *** Julien-zte has joined #openstack-infra | 08:50 | |
| *** hashar has joined #openstack-infra | 08:52 | |
| openstackgerrit | watanabe isao proposed openstack-infra/devstack-gate: Add cleanup hook https://review.openstack.org/368554 | 08:53 |
| *** claudiub has quit IRC | 08:53 | |
| *** jordanP has joined #openstack-infra | 08:53 | |
| *** saibarspeis has quit IRC | 08:53 | |
| *** saibarspeis has joined #openstack-infra | 08:54 | |
| *** isaacb has joined #openstack-infra | 08:55 | |
| sree | Hi, how can I create a new gerrit group for my new OpenStack project? I need this group to be added as part of "gerrit/acls/openstack/<projectname>.config " | 08:56 |
| *** nmagnezi has joined #openstack-infra | 08:57 | |
| *** saibarspeis has quit IRC | 08:58 | |
| *** Dong_Zhi__ has joined #openstack-infra | 08:59 | |
| *** zzzeek has quit IRC | 09:00 | |
| *** zzzeek has joined #openstack-infra | 09:00 | |
| openstackgerrit | watanabe isao proposed openstack-infra/puppet-openstackci: Update example https://review.openstack.org/330326 | 09:01 |
| *** caowei_ has joined #openstack-infra | 09:02 | |
| *** yanyanhu has quit IRC | 09:03 | |
| *** claudiub has joined #openstack-infra | 09:04 | |
| *** yanyanhu has joined #openstack-infra | 09:04 | |
| *** kvcobb has quit IRC | 09:05 | |
| *** Dong_Zhi__ has quit IRC | 09:05 | |
| *** lucas-afk is now known as lucasagomes | 09:07 | |
| *** abregman|mtg has quit IRC | 09:07 | |
| *** chem has joined #openstack-infra | 09:09 | |
| *** slaweq has quit IRC | 09:09 | |
| *** abregman has joined #openstack-infra | 09:10 | |
| *** sdake has joined #openstack-infra | 09:11 | |
| *** ihrachys has joined #openstack-infra | 09:11 | |
| *** thorst_ has joined #openstack-infra | 09:11 | |
| *** shu-mutou is now known as shu-mutou-AWAY | 09:12 | |
| *** abregman is now known as abregman|mtg | 09:14 | |
| *** dtantsur|afk is now known as dtantsur | 09:15 | |
| *** camunoz has quit IRC | 09:17 | |
| *** kjackal_ has quit IRC | 09:18 | |
| *** thorst_ has quit IRC | 09:19 | |
| *** claudiub has quit IRC | 09:19 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 09:19 |
| *** gmann has quit IRC | 09:24 | |
| *** dimtruck is now known as zz_dimtruck | 09:25 | |
| *** mhickey has joined #openstack-infra | 09:25 | |
| *** markvoelker has joined #openstack-infra | 09:26 | |
| *** yamahata has quit IRC | 09:27 | |
| *** Rockyg has joined #openstack-infra | 09:28 | |
| *** nmagnezi has quit IRC | 09:30 | |
| *** markvoelker has quit IRC | 09:31 | |
| *** abregman|mtg is now known as abregman | 09:31 | |
| *** nmagnezi has joined #openstack-infra | 09:31 | |
| *** zhurong has quit IRC | 09:32 | |
| *** ihrachys has quit IRC | 09:34 | |
| *** zhurong has joined #openstack-infra | 09:35 | |
| *** caowei_ has quit IRC | 09:35 | |
| *** wolverineav has joined #openstack-infra | 09:38 | |
| *** sdake has quit IRC | 09:38 | |
| *** john-davidge has joined #openstack-infra | 09:39 | |
| *** tmorin has quit IRC | 09:39 | |
| *** derekh has joined #openstack-infra | 09:39 | |
| *** john-davidge has quit IRC | 09:40 | |
| *** john-davidge has joined #openstack-infra | 09:40 | |
| *** qwertyco has quit IRC | 09:42 | |
| openstackgerrit | Merged openstack-infra/zuul: Re-enable the duplicate_pipeline test https://review.openstack.org/384192 | 09:42 |
| *** wolverineav has quit IRC | 09:42 | |
| *** Julien-zte has quit IRC | 09:43 | |
| openstackgerrit | Ales Komarek proposed openstack-infra/project-config: Added push merge to openstack-salt repos https://review.openstack.org/395487 | 09:44 |
| *** electrofelix has joined #openstack-infra | 09:45 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Remove unused Log WG meeting https://review.openstack.org/394841 | 09:46 |
| *** zhurong has quit IRC | 10:01 | |
| openstackgerrit | chenhb proposed openstack-infra/project-config: [Rally]Add neutron extensions service test job https://review.openstack.org/395432 | 10:02 |
| *** kzaitsev_mb has joined #openstack-infra | 10:04 | |
| *** tuanluong has quit IRC | 10:09 | |
| *** yanyanhu has quit IRC | 10:11 | |
| *** Dong_Zhi__ has joined #openstack-infra | 10:14 | |
| *** thorst_ has joined #openstack-infra | 10:16 | |
| *** Dong_Zhi__ has quit IRC | 10:17 | |
| *** xnox has quit IRC | 10:18 | |
| *** sree has quit IRC | 10:19 | |
| *** wolverineav has joined #openstack-infra | 10:19 | |
| *** gouthamr has joined #openstack-infra | 10:19 | |
| *** sree has joined #openstack-infra | 10:19 | |
| *** ihrachys has joined #openstack-infra | 10:21 | |
| *** xnox has joined #openstack-infra | 10:21 | |
| *** jtomasek has joined #openstack-infra | 10:23 | |
| *** thorst_ has quit IRC | 10:23 | |
| *** ssbarnea has quit IRC | 10:25 | |
| *** csomerville has joined #openstack-infra | 10:26 | |
| *** cody-somerville has quit IRC | 10:26 | |
| *** tosky has joined #openstack-infra | 10:27 | |
| *** ssbarnea has joined #openstack-infra | 10:27 | |
| openstackgerrit | chenhb proposed openstack-infra/project-config: [Rally]Add neutron extensions service test job https://review.openstack.org/395432 | 10:27 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/irc-meetings: Remove unused Ops tags meeting https://review.openstack.org/395509 | 10:28 |
| *** askb has quit IRC | 10:31 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/irc-meetings: Remove unused Ceilometer meeting https://review.openstack.org/395513 | 10:33 |
| *** tojuvone has quit IRC | 10:34 | |
| *** tojuvone has joined #openstack-infra | 10:34 | |
| *** ggnel_t has quit IRC | 10:37 | |
| *** dtantsur is now known as dtantsur|brb | 10:41 | |
| *** gouthamr has quit IRC | 10:42 | |
| *** tammy5 has joined #openstack-infra | 10:45 | |
| *** gouthamr has joined #openstack-infra | 10:45 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/irc-meetings: Remove unused Ironic v2 API meeting https://review.openstack.org/395517 | 10:49 |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: networking-bagpipe jobs adjustments https://review.openstack.org/394339 | 10:54 |
| *** snarwade has quit IRC | 10:55 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: Add Grafana for networking-bagpipe https://review.openstack.org/385337 | 10:56 |
| *** amotoki has joined #openstack-infra | 10:58 | |
| *** mmandel has joined #openstack-infra | 11:00 | |
| *** rbuzatu_ has joined #openstack-infra | 11:00 | |
| *** mixos has quit IRC | 11:02 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Remove unused Ceilometer meeting https://review.openstack.org/395513 | 11:02 |
| *** rbuzatu has quit IRC | 11:03 | |
| *** mmandel has quit IRC | 11:04 | |
| *** rbuzatu_ has quit IRC | 11:05 | |
| *** rbuzatu has joined #openstack-infra | 11:05 | |
| *** rfolco has joined #openstack-infra | 11:05 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: Skip python3 jobs for past stable branches of n8g-bgpvpn and n8g-bagpipe https://review.openstack.org/395528 | 11:08 |
| *** rbuzatu_ has joined #openstack-infra | 11:08 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Stop using documentation network range https://review.openstack.org/395529 | 11:09 |
| *** rbuzatu has quit IRC | 11:09 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: Skip py35 jobs on past stable/x of n8g-bgpvpn and n8g-bagpipe https://review.openstack.org/395528 | 11:10 |
| *** psilvad has joined #openstack-infra | 11:18 | |
| *** thorst_ has joined #openstack-infra | 11:20 | |
| *** thorst_ has quit IRC | 11:27 | |
| *** caowei_ has joined #openstack-infra | 11:29 | |
| *** slaweq has joined #openstack-infra | 11:30 | |
| *** panda|ko is now known as panda|soso | 11:30 | |
| *** nicolasbock has joined #openstack-infra | 11:36 | |
| *** dtantsur|brb is now known as dtantsur | 11:37 | |
| *** snarwade has joined #openstack-infra | 11:41 | |
| *** amotoki has quit IRC | 11:43 | |
| *** ianychoi has quit IRC | 11:45 | |
| *** bhavik1 has quit IRC | 11:45 | |
| *** Dong_Zhi__ has joined #openstack-infra | 11:45 | |
| *** jkilpatr has quit IRC | 11:48 | |
| *** Dong_Zhi__ has quit IRC | 11:49 | |
| *** Julien-zte has joined #openstack-infra | 11:50 | |
| *** florianf has quit IRC | 11:54 | |
| *** florianf has joined #openstack-infra | 11:54 | |
| *** caowei_ has quit IRC | 11:54 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Stop using documentation network range https://review.openstack.org/395529 | 12:00 |
| tsufiev | fungi, o/ I'm accepting the shift from r1chardj0n3s on asking the questions about including older FF into infra images | 12:01 |
| tsufiev | fungi, are there any news about that? | 12:01 |
| openstackgerrit | Sreeram Vancheeswaran proposed openstack-infra/project-config: Request to add new project nova-dpm https://review.openstack.org/395560 | 12:04 |
| *** rodrigods has quit IRC | 12:04 | |
| *** rodrigods has joined #openstack-infra | 12:04 | |
| *** jkilpatr has joined #openstack-infra | 12:05 | |
| *** rbuzatu_ has quit IRC | 12:10 | |
| *** rbuzatu has joined #openstack-infra | 12:11 | |
| *** Naeil has joined #openstack-infra | 12:12 | |
| *** caowei has joined #openstack-infra | 12:12 | |
| *** maeker has joined #openstack-infra | 12:12 | |
| *** amotoki has joined #openstack-infra | 12:13 | |
| *** rbuzatu has quit IRC | 12:15 | |
| *** maeker has quit IRC | 12:16 | |
| *** ggnel_t has joined #openstack-infra | 12:16 | |
| openstackgerrit | Sreeram Vancheeswaran proposed openstack-infra/project-config: Request to add new project nova-dpm https://review.openstack.org/395560 | 12:17 |
| *** nicolasbock has quit IRC | 12:19 | |
| *** nicolasbock has joined #openstack-infra | 12:19 | |
| *** raildo has joined #openstack-infra | 12:20 | |
| *** rbuzatu has joined #openstack-infra | 12:20 | |
| *** nicolasbock has quit IRC | 12:21 | |
| *** maeker has joined #openstack-infra | 12:21 | |
| *** nicolasbock has joined #openstack-infra | 12:21 | |
| *** nicolasbock has quit IRC | 12:22 | |
| *** nicolasbock has joined #openstack-infra | 12:22 | |
| *** esikachev has quit IRC | 12:22 | |
| *** rtheis has joined #openstack-infra | 12:22 | |
| *** nicolasbock has quit IRC | 12:22 | |
| *** nicolasbock has joined #openstack-infra | 12:22 | |
| *** claudiub has joined #openstack-infra | 12:25 | |
| *** esikachev has joined #openstack-infra | 12:25 | |
| *** mkoderer has joined #openstack-infra | 12:26 | |
| *** amotoki has quit IRC | 12:28 | |
| *** Julien-zte has quit IRC | 12:29 | |
| *** Julien-zte has joined #openstack-infra | 12:30 | |
| *** caowei has quit IRC | 12:33 | |
| *** tammy5 has quit IRC | 12:33 | |
| *** EricGonczer_ has joined #openstack-infra | 12:34 | |
| *** Julien-zte has quit IRC | 12:34 | |
| *** amotoki has joined #openstack-infra | 12:46 | |
| openstackgerrit | James Page proposed openstack-infra/project-config: Add Ceph FS Charm https://review.openstack.org/390406 | 12:47 |
| *** lucasagomes is now known as lucas-hungry | 12:47 | |
| *** sdake has joined #openstack-infra | 12:48 | |
| *** thorst_ has joined #openstack-infra | 12:48 | |
| *** thorst_ has quit IRC | 12:48 | |
| *** thorst_ has joined #openstack-infra | 12:48 | |
| *** zhurong has joined #openstack-infra | 12:49 | |
| *** caowei_ has joined #openstack-infra | 12:51 | |
| openstackgerrit | James Page proposed openstack-infra/project-config: Drop group for charm-lxd https://review.openstack.org/395573 | 12:51 |
| *** maeker has quit IRC | 12:51 | |
| *** d0ugal has quit IRC | 12:51 | |
| *** gmann has joined #openstack-infra | 12:51 | |
| *** maeker has joined #openstack-infra | 12:52 | |
| *** pradk has joined #openstack-infra | 12:53 | |
| *** gmann_ has joined #openstack-infra | 12:53 | |
| *** baoli has joined #openstack-infra | 12:54 | |
| *** gmann has quit IRC | 12:56 | |
| *** baoli_ has joined #openstack-infra | 12:57 | |
| *** Julien-zte has joined #openstack-infra | 12:57 | |
| *** caowei_ has quit IRC | 12:57 | |
| *** nmagnezi has quit IRC | 12:58 | |
| *** EricGonczer_ has quit IRC | 12:59 | |
| *** baoli has quit IRC | 12:59 | |
| *** d0ugal has joined #openstack-infra | 12:59 | |
| *** zhurong has quit IRC | 13:01 | |
| *** zhurong has joined #openstack-infra | 13:06 | |
| *** drifterza has quit IRC | 13:06 | |
| *** gmann has joined #openstack-infra | 13:08 | |
| *** gmann_ has quit IRC | 13:11 | |
| *** gmann has quit IRC | 13:11 | |
| *** gmann has joined #openstack-infra | 13:11 | |
| *** maeker has quit IRC | 13:13 | |
| *** maeker has joined #openstack-infra | 13:14 | |
| *** edmondsw has joined #openstack-infra | 13:15 | |
| *** maeker has quit IRC | 13:16 | |
| *** Julien-z_ has joined #openstack-infra | 13:16 | |
| *** amotoki has quit IRC | 13:17 | |
| *** Julien-zte has quit IRC | 13:18 | |
| *** florianf has quit IRC | 13:19 | |
| *** krtaylor has joined #openstack-infra | 13:20 | |
| *** inc0 has joined #openstack-infra | 13:20 | |
| *** maeker has joined #openstack-infra | 13:21 | |
| *** caowei_ has joined #openstack-infra | 13:22 | |
| *** maeker has quit IRC | 13:22 | |
| *** Julien-z_ has quit IRC | 13:22 | |
| *** Julien-zte has joined #openstack-infra | 13:24 | |
| *** maeker has joined #openstack-infra | 13:24 | |
| *** hashar has quit IRC | 13:25 | |
| *** hashar has joined #openstack-infra | 13:25 | |
| *** jistr is now known as jistr|brb | 13:26 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Revert "Add Barbican key order to scenario002" https://review.openstack.org/395217 | 13:26 |
| *** maeker has quit IRC | 13:28 | |
| jlvillal | As a note, in Gerrit I am seeing "500 Internal server error" in the "Conflicts With (N/A)" box. https://review.openstack.org/#/c/374147/ | 13:29 |
| *** baoli_ has quit IRC | 13:29 | |
| *** maeker has joined #openstack-infra | 13:29 | |
| jlvillal | Not sure if that is a known issue. | 13:29 |
| *** EricGonczer_ has joined #openstack-infra | 13:31 | |
| *** jcoufal has joined #openstack-infra | 13:32 | |
| *** baoli has joined #openstack-infra | 13:32 | |
| clarkb | tsufiev: we dont include any firefox on our images now. Its allinstalled at job runtime | 13:32 |
| *** EricGonczer_ has quit IRC | 13:32 | |
| *** markus_z has joined #openstack-infra | 13:33 | |
| jlvillal | clarkb, You are awake too early for the west coast ;) | 13:33 |
| clarkb | jlvillal: I think that happens if conflicts are resolved.Gerrit still tries to remder the co flicts with box but queries return 500becaise thereare none | 13:33 |
| clarkb | jlvillal: you too | 13:33 |
| jlvillal | clarkb, Thanks | 13:33 |
| tsufiev | clarkb, the problem with modern firefox versions from xenial repos is that they don't work well with Selenium automation framework, which breaks horizon integration tests | 13:33 |
| jlvillal | clarkb, I got back from Barcelona on Saturday. Still adjusting :) | 13:33 |
| *** dave-mccowan has joined #openstack-infra | 13:34 | |
| tsufiev | so we downloaded previous version of FF manually, but recently the connection to mozilla ftp became flaky | 13:34 |
| clarkb | tsufiev: does chromium work? | 13:34 |
| *** jheroux has joined #openstack-infra | 13:34 | |
| tsufiev | clarkb, short answer: no | 13:35 |
| tsufiev | more long answer is that it requires a separate driver, so most likely we'll have to solve the same issues as with moving to modern FF version | 13:35 |
| *** tmorin has joined #openstack-infra | 13:35 | |
| tsufiev | before version 47 FF was a very special browser regarding to Selenium interaction | 13:36 |
| tmorin | fungi: you around ? | 13:36 |
| clarkb | tsufiev: ok, I just wanted to clarofy that we dont preinstall any browser to our images | 13:36 |
| tmorin | fungi: I'm still trying to figure out where this 10.0.0.0 spurious route issue is coming from (networking-bgpvpn job) | 13:36 |
| *** florianf has joined #openstack-infra | 13:37 | |
| *** sree has quit IRC | 13:37 | |
| tmorin | fungi: I'm running out of ideas on things to check and would need, if possible, the stack.sh.log of a test VM having lost connectivity because of the spurious route | 13:37 |
| tsufiev | clarkb, it would be great if we could install previous version of FF using standard repos, but AFAIK there is no such way | 13:37 |
| *** sree has joined #openstack-infra | 13:38 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: networking-bagpipe jobs adjustments https://review.openstack.org/394339 | 13:38 |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: Add Grafana for networking-bagpipe https://review.openstack.org/385337 | 13:39 |
| *** sree has quit IRC | 13:42 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Full quickstart gate run on OVB https://review.openstack.org/381094 | 13:43 |
| *** jistr|brb is now known as jistr | 13:46 | |
| *** Julien-zte has quit IRC | 13:49 | |
| fungi | tmorin: well, an up-side to this is that it's doing exactly the same thing on hosts where the job runs to completion and publishes logs, but since those hosts aren't dependent on being able to reach 10.0.0.1 for global routing you actually have logs to look att | 13:50 |
| *** hurgleburgler has joined #openstack-infra | 13:50 | |
| *** Julien-zte has joined #openstack-infra | 13:50 | |
| tmorin | fungi: well, yes, and I did look, but since I didn't find an answer there, I'm assuming the actual codepath in devstack neutron code or devstack plugin code, may be different... | 13:51 |
| *** lucas-hungry is now known as lucasagomes | 13:51 | |
| fungi | clarkb: do you happen to recall what the fix was for this in the neutron jobs recently? | 13:51 |
| *** esikachev has quit IRC | 13:52 | |
| fungi | just want to rule out that it's somehow not applied or regressed in the bgpvpn jobs | 13:52 |
| *** raildo has quit IRC | 13:54 | |
| *** drifterza has joined #openstack-infra | 13:54 | |
| fungi | http://codesearch.openstack.org/?q=10.0.0.0/16 turns up a lot of hits in devstack, networking-ovn, neutron and neutron-dynamic-routing but i'm not sure which (if any) are relevant to this case | 13:55 |
| *** ssbarnea has quit IRC | 13:56 | |
| *** kgiusti has joined #openstack-infra | 13:56 | |
| *** ssbarnea has joined #openstack-infra | 13:56 | |
| fungi | is it maybe broken for all l3 services still due to http://git.openstack.org/cgit/openstack-dev/devstack/tree/lib/neutron_plugins/services/l3#n89 ? | 13:56 |
| *** Goneri has joined #openstack-infra | 13:57 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul: Fix test_failed_change_in_middle to use tenants https://review.openstack.org/395607 | 13:57 |
| fungi | or was this the workaround for collisions there? http://git.openstack.org/cgit/openstack-dev/devstack/tree/lib/neutron_plugins/services/l3#n376 | 13:58 |
| tmorin | fungi: yes, it seems related to SUBNETPOOL_PREFIX_V4 used as the replace_range, but what I don't get is why other neutron jobs would be exempt from the issue | 13:59 |
| tmorin | fungi: how easy is it to find a neutron job run on this cloud provider ? | 14:00 |
| *** xyang1 has joined #openstack-infra | 14:00 | |
| *** tlian has joined #openstack-infra | 14:00 | |
| tmorin | (osic-cloud1) | 14:01 |
| fungi | very. almost all of them are running there | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable test_single_nonexistent_post_job test https://review.openstack.org/391692 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable 4 CRD unit tests https://review.openstack.org/393494 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable 3 disabled tests https://review.openstack.org/393452 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_file_head test https://review.openstack.org/393956 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable test_failed_change_in_middle test https://review.openstack.org/391687 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Move job running into own class https://review.openstack.org/385964 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_nonvoting_pipeline https://review.openstack.org/386769 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_merger_repack test https://review.openstack.org/393953 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_layered_templates test https://review.openstack.org/393445 | 14:01 |
| clarkb | fungi: devstack changed the ramge to be smaller than a /8 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_job_from_templates_launched job https://review.openstack.org/393412 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable test_two_failed_changes_at_head test https://review.openstack.org/393950 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_can_merge unit test https://review.openstack.org/392953 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_queue_precedence test https://review.openstack.org/394191 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable test_statsd test https://review.openstack.org/393479 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable test_new_patchset_check / test_abandoned_check https://review.openstack.org/393458 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_source_cache unit test https://review.openstack.org/393278 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_one_job_project unit test https://review.openstack.org/393304 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable 4 disable tests https://review.openstack.org/393461 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_needed_changes_enqueue testing https://review.openstack.org/393001 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Lower the log level in tests https://review.openstack.org/395611 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Remove discover from test-requirements https://review.openstack.org/395612 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Ansible launcher: fix afs publisher https://review.openstack.org/395613 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Rename zuul_runner to command https://review.openstack.org/395614 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Use command module instead of zuul_runner https://review.openstack.org/395615 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Put script string in directly instead of in files https://review.openstack.org/395616 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Stop running commands with async https://review.openstack.org/395617 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Split playbook into vars, pre-playbook and playbook https://review.openstack.org/395618 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable pipelining for ansible-playbook https://review.openstack.org/395619 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Strip leading / from afs targets https://review.openstack.org/395620 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Ansible launcher: Fix afs publisher root detection https://review.openstack.org/395621 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Add a note to README.rst about contributing to Zuul v3 https://review.openstack.org/395622 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Default test log level to DEBUG except for testr https://review.openstack.org/395623 | 14:01 |
| *** gordc has joined #openstack-infra | 14:01 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Revert "Put script string in directly instead of in files" https://review.openstack.org/395624 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Generate shell scripts as a sequence https://review.openstack.org/395625 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Ansible launcher: use sequence-uuid in shell scripts https://review.openstack.org/395626 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Ansible launcher: import get_exception in ansible command https://review.openstack.org/395627 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Ansible launcher: don't close stdout in command module https://review.openstack.org/395628 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Add back timeout_var logic https://review.openstack.org/395629 | 14:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Ansible launcher: remove keep_remote_files https://review.openstack.org/395630 | 14:01 |
| *** lennyb has quit IRC | 14:02 | |
| fungi | tmorin: here's one... http://logs.openstack.org/69/395569/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/3a401de/ | 14:03 |
| *** mriedem has joined #openstack-infra | 14:03 | |
| clarkb | fungi: keep.in mind 10/8 route issue was only a problem on mulyinode or if needing to talk yo internet via ipv4 | 14:03 |
| *** oanson has quit IRC | 14:03 | |
| clarkb | single node jobs were largely unaffected by the issue which is how iterged inthe first place | 14:04 |
| tmorin | fungi: interesting, no 10.0.0.0/16 at all in the devstack.log for this job | 14:04 |
| * tmorin goes looking at project-config for this job | 14:04 | |
| fungi | clarkb: yeah, so maybe bgpvpn-bagpipe is breaking because it wants to retrieve stuff from github or something? | 14:04 |
| *** spzala has joined #openstack-infra | 14:04 | |
| fungi | clarkb: though the weirdness is that it seems to be consistently timing out during "all-plugin installdeps: setuptools, -r/opt/stack/new/tempest/requirements.txt" | 14:06 |
| clarkb | or maybe it makes a vpn on 10/8 for which it cant route properly? certainly many ways this setup canbreak | 14:06 |
| *** fguillot has joined #openstack-infra | 14:07 | |
| fungi | and stracing pip there shows that it's communicating with our mirror in osic at that point | 14:07 |
| openstackgerrit | Arie Bregman proposed openstack-infra/shade: Add compute usage support https://review.openstack.org/393873 | 14:08 |
| *** yuval has quit IRC | 14:08 | |
| tmorin | fungi: it is indeed getting a git submodule from github | 14:09 |
| *** tiswanso has joined #openstack-infra | 14:09 | |
| tmorin | clarkb: no such VPN | 14:09 |
| tmorin | fungi: I still do not get why working neutron jobs do not have anything related to 10.0.0.0/16 in their lors, it means they do not go through these devstack parts or with a different SUBNETPOOL_PREFIX_V4 | 14:11 |
| *** mdrabe has joined #openstack-infra | 14:11 | |
| fungi | tmorin: http://fungi.yuggoth.org/tmp/logs.tar.gz is the job logs i bundled up off the node i held yesterday, so maybe those will help | 14:13 |
| *** gmann has quit IRC | 14:13 | |
| tmorin | fungi: it seems that the tar.gz only contains a symink | 14:14 |
| fungi | oh, that file is tiny | 14:14 |
| fungi | yep! | 14:14 |
| tmorin | ;) | 14:14 |
| fungi | my bad, i tarred up the logs symlink from the workspace | 14:14 |
| fungi | just a sec | 14:14 |
| *** matt-borland has joined #openstack-infra | 14:15 | |
| fungi | tmorin: try downloading again. looks like it contains actual files this time ;) | 14:16 |
| tmorin | fungi: the working neutron job, in the place of the problematic ip route replace, has 10.1.0.0/20 ( http://logs.openstack.org/69/395569/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/3a401de/logs/devstacklog.txt.gz#_2016-11-09_12_54_36_978 ) , but it's not coming from SUBNETPOOL_PREFIX_V4 | 14:16 |
| tmorin | fungi: downloading... | 14:16 |
| openstackgerrit | Merged openstack/os-client-config: Add fuga.io to vendors https://review.openstack.org/394044 | 14:18 |
| openstackgerrit | Julia Varlamova proposed openstack-infra/devstack-gate: Add new roles to feature matrix https://review.openstack.org/394895 | 14:18 |
| fungi | yeah, i'm not surprised. SUBNETPOOL_PREFIX_V4 was just a stab in the dark based on searching the source code | 14:18 |
| *** Julien-zte has quit IRC | 14:18 | |
| tmorin | fungi: it still is somehow related to the problem, because this is indeed where the problematic route is derived from | 14:19 |
| fungi | i need to disappear briefly, but shall return forthwith | 14:19 |
| *** lennyb has joined #openstack-infra | 14:19 | |
| *** maeker has quit IRC | 14:19 | |
| tmorin | fungi: ok :) | 14:20 |
| *** Julien-zte has joined #openstack-infra | 14:23 | |
| *** esikachev has joined #openstack-infra | 14:25 | |
| *** dprince has joined #openstack-infra | 14:29 | |
| *** jbernard has quit IRC | 14:30 | |
| *** jaosorior has quit IRC | 14:33 | |
| *** jaosorior has joined #openstack-infra | 14:33 | |
| tmorin | fungi: I can't usefully compare the net-bgpvpn jobs with the working neutron-job you provided, because that one is stable/newton and not having the SUBNET_POOL_PREFIX things | 14:34 |
| fungi | tmorin: oh, i can dig up a master one--sorry i didn't notice | 14:35 |
| tmorin | fungi: I'm looking at one, but unsure whether it is running on the cloud provider in question | 14:36 |
| tmorin | fungi: np | 14:36 |
| fungi | tmorin: http://logs.openstack.org/27/395427/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/4520c65/ is master | 14:38 |
| *** rtheis_ has joined #openstack-infra | 14:38 | |
| *** maeker has joined #openstack-infra | 14:38 | |
| tmorin | I've had a look at a different one http://logs.openstack.org/71/395071/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/4061480/logs/ --> it is having the same "ip route replace 10.0.0.0/16 ..." as the one causing us issues.... ( http://logs.openstack.org/71/395071/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/4061480/logs/devstacklog.txt.gz#_2016-11-08_19_56_30_291 ) | 14:39 |
| *** csomerville has quit IRC | 14:39 | |
| *** rtheis has quit IRC | 14:39 | |
| * tmorin now looking at 395427 ... | 14:39 | |
| *** maeker has quit IRC | 14:40 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Move job running into own class https://review.openstack.org/385964 | 14:40 |
| *** maeker_ has joined #openstack-infra | 14:40 | |
| *** baoli has quit IRC | 14:40 | |
| tmorin | fungi: 395427 also has the ip route replace with 10.0.0.0/16 ...( http://logs.openstack.org/27/395427/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/4520c65/logs/devstacklog.txt.gz#_2016-11-09_12_25_32_417 ) | 14:40 |
| *** baoli has joined #openstack-infra | 14:41 | |
| *** jamesdenton has joined #openstack-infra | 14:43 | |
| *** mixos has joined #openstack-infra | 14:43 | |
| fungi | tmorin: so the working log does "Running tempest full test suite" while the breaking one for networking-bgpvpn-bagpipe runs "...with plugins..." | 14:44 |
| tmorin | fungi: I would tend to think that this "ip route replace" in the run for 395427 that you linked, should have cause a loss of routing if run on a provider also using this address ... why no breakage ? | 14:44 |
| fungi | what custom plugins are used there? | 14:44 |
| tmorin | fungi: yes, the tempest plugin with the BGPVPN API tests | 14:44 |
| *** martinkopec has quit IRC | 14:45 | |
| fungi | do you have nonstandard requirements? maybe source installs from github? | 14:45 |
| tmorin | tmorin: nothing but basic calls to a neutron service plugin | 14:45 |
| tmorin | fungi: yes, we do get a submodule from github, as said above | 14:45 |
| fungi | oh | 14:45 |
| jschwarz | hey guys, I'm looking into building my own CirrOS image and I know a few other projects in the OpenStack tents are already doing that | 14:45 |
| jschwarz | but I don't know which/where | 14:46 |
| jschwarz | can anyone point me the right way? :) | 14:46 |
| tmorin | fungi: is talking to github something that we should expect to possibly not work ? | 14:46 |
| *** edtubill has joined #openstack-infra | 14:46 | |
| fungi | tmorin: well, github.com has no aaaa records in dns, and with 10.0.0.0/16 shadowing the 10.0.0.0/8 interface going to the 10.0.0.1 ipv4 gateway, it's possible the job is timing out trying to get requirements from github | 14:47 |
| fungi | so it could be that the way neutron/devstack "fixed" this was to just assume nothing actually needs ipv4 connectivity from the job node | 14:48 |
| fungi | which clarkb was alluding to earlier | 14:48 |
| fungi | if the source from github is being added to pip requirements, then that would explain why it's hung waiting for the requirements.txt install to complete | 14:48 |
| *** links has quit IRC | 14:49 | |
| tmorin | fungi: it's not fetched from github via *requirements.txt, but via git submodule sync | 14:49 |
| tmorin | fungi: but I got your point though... | 14:50 |
| fungi | yeah, it's highly likely that the straight neutron tempest full job doesn't need v4 connectivity to the internet and will work with just v6 | 14:50 |
| tmorin | tmorin: aren't there other projects fetching things oustide in IPv4 ? | 14:50 |
| *** edtubill has quit IRC | 14:51 | |
| fungi | possibly not running inside devstack with neutron? or perhaps they similarly just rerun their jobs until they succeed on a different provider | 14:51 |
| *** baoli has quit IRC | 14:51 | |
| *** mixos has quit IRC | 14:52 | |
| *** rtheis_ is now known as rtheis | 14:52 | |
| *** baoli has joined #openstack-infra | 14:53 | |
| tmorin | neutron/devstack/lib/ovs has a compile_ovs function compiling a fresh OVS right from github | 14:53 |
| tmorin | this seems to be use by networking-ovn | 14:53 |
| tmorin | I need to check their jobs... | 14:53 |
| fungi | i had some suggestions on how to solve this in bug 1629133 but they ultimately went with a simpler solution | 14:54 |
| openstack | bug 1629133 in Magnum "New neutron subnet pool support breaks multinode testing." [Undecided,In progress] https://launchpad.net/bugs/1629133 - Assigned to Spyros Trigazis (strigazi) | 14:54 |
| tmorin | fungi: to make sure this is indeed the issue we are hitting, perhaps you could do a "netstat -atpn" on a problematic networking-bgpvpn tempest run ? | 14:55 |
| pabelanger | rax-iad slow this morning | 14:55 |
| *** evgenyf has joined #openstack-infra | 14:56 | |
| fungi | tmorin: while the job is running or on the held node i have from yesterday? | 14:57 |
| *** sandanar has quit IRC | 14:58 | |
| tmorin | fungi: sorry for the newbie question: what is a held node ? | 14:58 |
| fungi | i held a node running one of these jobs yesterday, so that nodepool wouldn't delete it after the job completed | 14:58 |
| tmorin | fungi: if "held" means suspended in the problematic state, that would be informative, but if it is past the TCP timeout which is our hypothesis, then not | 14:58 |
| tmorin | a running one would be more informative | 14:59 |
| tmorin | e.g. 395479,2 | 14:59 |
| tmorin | about but 1629133: choosing a SUBNET_POOL_PREFIX_V4 *not* containing the gateway address for osic-cloud1 would I think have helped a lot avoiding this kind of issues (10.0.0.0/16 is small enough, *but* contains 10.0.0.1) | 15:00 |
| fungi | tmorin: not sure what you're looking for from it, but http://paste.openstack.org/show/588567/ | 15:00 |
| *** hongbin has joined #openstack-infra | 15:01 | |
| tmorin | fungi: not informative, it's got no active TCP connection to the outside except SSH from you and jenkins | 15:01 |
| fungi | yeah | 15:02 |
| fungi | that's the job currently running for 395467,1 | 15:02 |
| *** zhurong has quit IRC | 15:03 | |
| *** drifterza has quit IRC | 15:04 | |
| fungi | stracing the pip process, i see it trying to hit 8.8.8.8 and 8.8.4.4 for some reason too | 15:05 |
| fungi | oh, ouch. /etc/resolv.conf is using those instead of our local unbound daemon | 15:05 |
| tmorin | fungi: I'll push a change to networking-bgpvpn changing SUBNET_POOL_PREFIX_V4 to something not overlapping with 10.0.0.1 -- that may help us drill down the issue... | 15:05 |
| clarkb | fungi: yes I rhink known issur with glean | 15:06 |
| *** asettle has joined #openstack-infra | 15:06 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/system-config: Create /srv/static/tc for publication purposes https://review.openstack.org/395659 | 15:06 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/system-config: Use /srv/static/tc as governance.o.o docroot https://review.openstack.org/395660 | 15:06 |
| fungi | tmorin: good thinking | 15:06 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config: Switch TC docs publication to /srv/static/tc https://review.openstack.org/395661 | 15:06 |
| asettle | Hey guys, wondering if I could get your help with something. I can't seem to figure out why the layout job fails on this patch: https://review.openstack.org/#/c/391499/ | 15:06 |
| asettle | I'm new to contributing to infra, so, probably something I wouldn't even know to look for. | 15:07 |
| pabelanger | okay, need some help from git people smarter then me. If I want to replace 389470 (merge master to feature branch) a top of 385964. What are the steps not to have gerrit create a slew a reviews again? | 15:07 |
| pabelanger | I assume I follow: http://docs.openstack.org/infra/manual/drivers.html#merge-commits | 15:08 |
| pabelanger | but using the respective branches of each review | 15:08 |
| *** edtubill has joined #openstack-infra | 15:09 | |
| *** rbrndt_ has joined #openstack-infra | 15:09 | |
| pabelanger | even better, might just to be rebase 389470 a top of feature/zuulv3 again | 15:10 |
| jlvillal | Patch to nodepool: https://review.openstack.org/383496 This could allow us (Ironic) to do fewer hacks trying to figure out if id_rsa.pub / authorized_keys has an ending line-feed or not in our devstack scripts. Has one +2 already. | 15:12 |
| jlvillal | Super easy, I promise :) | 15:12 |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: Skip py35 jobs on past stable/x of n8g-bgpvpn and n8g-bagpipe https://review.openstack.org/395528 | 15:13 |
| *** adrian_otto has joined #openstack-infra | 15:13 | |
| *** caowei_ has quit IRC | 15:14 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Merge remote-tracking branch 'origin/master' into feature/zuulv3 https://review.openstack.org/389470 | 15:16 |
| pabelanger | okay, think I have it | 15:17 |
| *** dtantsur is now known as dtantsur|brb | 15:19 | |
| tmorin | fungi: just did a change with a tweaked SUBNETPOOL_PREFIX_V4... --> 395663,1 with a tempest job running | 15:23 |
| fungi | jschwarz: i think trove and ironic-python-agent are doing something along those lines (no idea if it's cirros based or something else) | 15:23 |
| jschwarz | fungi, thanks :) | 15:24 |
| fungi | asettle: that log says "FAILURE: Job gate-openstack-ansible-geploy-guide no | 15:24 |
| fungi | t defined" | 15:24 |
| *** rhallisey has joined #openstack-infra | 15:24 | |
| *** tosky has quit IRC | 15:24 | |
| *** psilvad has quit IRC | 15:25 | |
| asettle | fungi: dang. So, any ideas on what I need to do there? This is very new territory for me. | 15:26 |
| *** mriedem1 has joined #openstack-infra | 15:26 | |
| fungi | asettle: i've marked your misspelling with an inline comment | 15:26 |
| *** inc0 has quit IRC | 15:26 | |
| *** vsaienk0 has joined #openstack-infra | 15:26 | |
| *** rbuzatu has quit IRC | 15:27 | |
| asettle | fungi: haha omg a spelling mistake. how embarrassing ;) thank you fungi | 15:27 |
| fungi | yw | 15:27 |
| asettle | geploy-guide *headdesk* | 15:27 |
| *** mriedem has quit IRC | 15:27 | |
| asettle | It's when you stare at something for so long you can't recognise the problems anymore | 15:27 |
| fungi | that pretty well sums up a typical day for me | 15:27 |
| *** thcipriani|afk is now known as thcipriani | 15:27 | |
| openstackgerrit | Alexandra Settle proposed openstack-infra/project-config: Adds deploy guide gate jobs https://review.openstack.org/391499 | 15:27 |
| asettle | fungi: Thank youuu!!! :D | 15:27 |
| asettle | Hopefully this now actually passes... | 15:28 |
| vsaienk0 | devstack-gate core please review 1 line patch that drops hardcoding SERVICE_HOST=127.0.0.1 as we already have mechanism in devstack to calculate default https://review.openstack.org/#/c/368870/ . The patch passed nova/neutron CI | 15:28 |
| *** ianychoi has joined #openstack-infra | 15:28 | |
| *** baoli has quit IRC | 15:28 | |
| *** mriedem1 is now known as mriedem | 15:30 | |
| *** zz_dimtruck is now known as dimtruck | 15:33 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Stop using documentation network range https://review.openstack.org/395529 | 15:37 |
| Zara | hi, per discussion in #openstack-meeting right now-- would we be able to move the storyboard meeting to weekly 19:00UTC Weds in #openstack-meeting (from weekly 15:00UTC Weds in #openstack-meeting)? | 15:37 |
| fungi | Zara: if it's available, i don't see why not | 15:38 |
| *** gouthamr has quit IRC | 15:38 | |
| *** gouthamr has joined #openstack-infra | 15:39 | |
| Zara | it looked like it was from a ctrl+f on the meeting page, but there may be somewhere better I should check (I can't remember the home of the file for meeting times off the top of my head) | 15:39 |
| fungi | if you compose a change to the meetings, i believe there's a tox target you can use to check for conflicts (which also runs as a gate job) | 15:40 |
| *** john-davidge has quit IRC | 15:42 | |
| *** john-davidge has joined #openstack-infra | 15:43 | |
| Zara | oh, nice | 15:43 |
| *** Julien-zte has quit IRC | 15:45 | |
| odyssey4me | hi all - it seems that we have some rpm mirror slowness: http://logs.openstack.org/42/393442/11/check/gate-openstack-ansible-os_neutron-ansible-func-centos-7/52c3bae/console.html#_2016-11-09_15_37_27_335142 | 15:45 |
| *** Julien-zte has joined #openstack-infra | 15:46 | |
| tmorin | fungi: is the current tempest job for 395663,2 running on osic-cloud1 ? | 15:46 |
| *** tsg has joined #openstack-infra | 15:46 | |
| *** Julien-zte has quit IRC | 15:46 | |
| *** Julien-zte has joined #openstack-infra | 15:47 | |
| pabelanger | apologies for the incoming spam, 18 patchset rebase | 15:47 |
| *** jkilpatr_ has joined #openstack-infra | 15:47 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable test_single_nonexistent_post_job test https://review.openstack.org/391692 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable 4 CRD unit tests https://review.openstack.org/393494 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable 3 disabled tests https://review.openstack.org/393452 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_file_head test https://review.openstack.org/393956 | 15:47 |
| *** john-davidge has quit IRC | 15:47 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable test_failed_change_in_middle test https://review.openstack.org/391687 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_nonvoting_pipeline https://review.openstack.org/386769 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_merger_repack test https://review.openstack.org/393953 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_layered_templates test https://review.openstack.org/393445 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_job_from_templates_launched job https://review.openstack.org/393412 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable test_two_failed_changes_at_head test https://review.openstack.org/393950 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_can_merge unit test https://review.openstack.org/392953 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_queue_precedence test https://review.openstack.org/394191 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable test_statsd test https://review.openstack.org/393479 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable test_new_patchset_check / test_abandoned_check https://review.openstack.org/393458 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_source_cache unit test https://review.openstack.org/393278 | 15:47 |
| *** Julien-zte has quit IRC | 15:47 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_one_job_project unit test https://review.openstack.org/393304 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable 4 disable tests https://review.openstack.org/393461 | 15:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_needed_changes_enqueue testing https://review.openstack.org/393001 | 15:47 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/irc-meetings: Move StoryBoard meeting to 19:00UTC https://review.openstack.org/395678 | 15:47 |
| *** edtubill has quit IRC | 15:47 | |
| *** Julien-zte has joined #openstack-infra | 15:48 | |
| *** Julien-zte has quit IRC | 15:48 | |
| *** Julien-zte has joined #openstack-infra | 15:48 | |
| rcarrillocruz | pabelanger is on fire ! (heya!) | 15:48 |
| *** Julien-zte has quit IRC | 15:49 | |
| Zara | wow | 15:49 |
| *** edtubill has joined #openstack-infra | 15:49 | |
| *** Julien-zte has joined #openstack-infra | 15:49 | |
| *** jkilpatr has quit IRC | 15:49 | |
| pabelanger | Most of that is just enabling disabled tests | 15:49 |
| *** rajinir has joined #openstack-infra | 15:49 | |
| *** Julien-zte has quit IRC | 15:49 | |
| pabelanger | only a few lines of new codwe | 15:49 |
| pabelanger | but, would love some reviews to avoid rebase spam | 15:50 |
| *** Julien-zte has joined #openstack-infra | 15:50 | |
| *** sdake has quit IRC | 15:50 | |
| *** Julien-zte has quit IRC | 15:50 | |
| *** Julien-zte has joined #openstack-infra | 15:51 | |
| *** markus_z has quit IRC | 15:51 | |
| *** Julien-zte has quit IRC | 15:51 | |
| *** psilvad has joined #openstack-infra | 15:51 | |
| *** sdake has joined #openstack-infra | 15:52 | |
| *** abregman has quit IRC | 15:53 | |
| ianychoi | Good morning, clarkb! Can I talk briefly about Zanata upgrade? | 15:53 |
| jeblair | pabelanger: i should be more available today | 15:53 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config: rally: enable panko devstack plugin for Newton+ only https://review.openstack.org/395681 | 15:53 |
| *** Sukhdev has joined #openstack-infra | 15:54 | |
| cloudnull | mornings | 15:54 |
| *** isaacb has quit IRC | 15:55 | |
| *** abregman has joined #openstack-infra | 15:55 | |
| *** eharney has joined #openstack-infra | 15:55 | |
| *** rfolco_ has joined #openstack-infra | 15:56 | |
| *** dtantsur|brb is now known as dtantsur | 15:57 | |
| *** chandankumar has quit IRC | 15:58 | |
| *** rfolco has quit IRC | 15:58 | |
| *** watersoul_ has quit IRC | 16:00 | |
| *** jkilpatr_ has quit IRC | 16:01 | |
| *** mdrabe has quit IRC | 16:01 | |
| *** marst has joined #openstack-infra | 16:01 | |
| fungi | tmorin: no dice. according to this in ran in rax-ord: http://logs.openstack.org/63/395663/2/check/gate-tempest-dsvm-networking-bgpvpn-bagpipe/4db2d9a/console.html#_2016-11-09_15_38_07_583089 | 16:01 |
| fungi | tmorin: while it's still running, if you see the telnet:// link for the job in the zuul status page with an ipv6 address it's in osic-cloud1, otherwise it's elsewhere | 16:02 |
| fungi | at the moment that's the only provider where we only have ipv6 for global addressing | 16:02 |
| tmorin | fungi: ok, only osic-cloud1 is using v6, this I wasn't sure about | 16:03 |
| *** cody-somerville has joined #openstack-infra | 16:03 | |
| *** cody-somerville has joined #openstack-infra | 16:03 | |
| fungi | yeah, so probably want to recheck that change and roll the dice again | 16:03 |
| *** knangia has joined #openstack-infra | 16:04 | |
| tmorin | fungi: 395663,2 with the tweaked SUBNETPOOL_PREFIX_V4 currently has another running job on osic-cloud1 | 16:04 |
| tmorin | we'll see | 16:04 |
| *** e0ne has joined #openstack-infra | 16:05 | |
| *** hashar has quit IRC | 16:05 | |
| tmorin | fungi: in the meantime I've given some thought to the whole thing and remembered we have another job also doing github submodule sync, and I've just confirmed we have successful runs on osic-cloud1 (e.g. http://logs.openstack.org/64/394964/3/experimental/gate-tempest-dsvm-networking-bagpipe-full/0a71108/logs/devstacklog.txt.gz ) | 16:06 |
| tmorin | fungi: in the job above, we have the supposedly problematic 10.0.0.0/16 route ( http://logs.openstack.org/64/394964/3/experimental/gate-tempest-dsvm-networking-bagpipe-full/0a71108/logs/devstacklog.txt.gz#_2016-11-08_16_25_28_755 ) but this does not prevent the job from terminating | 16:06 |
| irtermite | fungi: you've set off my "osic" alert. It looks like there isn't anything you need from us, but just checking. | 16:06 |
| fungi | odyssey4me: pabelanger similarly noted slowness for jobs in rax-iad, perhaps based on the same evidence? | 16:07 |
| *** watersoul has joined #openstack-infra | 16:07 | |
| tmorin | itermite: thanks for checking :) I won't ask you to give an IPv4 address to all test VMs :) | 16:07 |
| openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config: [magnum] Add magnum-core instead magnum-specs-core https://review.openstack.org/395689 | 16:07 |
| irtermite | tmorin: good... 'cause I won't ;) | 16:08 |
| tmorin | fungi: so ^^ I suspect that our hypothesis about where the issue is coming from is not yet the right one... :-( | 16:08 |
| pabelanger | fungi: odyssey4me: Ya, I haven't debugged it any more, but apt-get / tox were taking a while to run | 16:08 |
| tmorin | irtermite: ;) kudos for pushing v6 adoption ! | 16:08 |
| irtermite | :) | 16:08 |
| irtermite | adoption by necessity? | 16:09 |
| odyssey4me | pabelanger I've seen some bindep failures when trying to apt-get update, but mostly I'm seeing very slow job execution | 16:09 |
| *** spzala has quit IRC | 16:09 | |
| fungi | tmorin: i concur, there could be entirely other issues behind this symptom | 16:09 |
| tmorin | irtermite: well, I can guess so, but some try less interesting workarounds to v4 scarcity | 16:10 |
| irtermite | tmorin: fungi: So, I take it part of the issue still resides in the lack of isp v6 support in some locations? (cc: cloudnull) | 16:10 |
| *** spzala has joined #openstack-infra | 16:10 | |
| fungi | irtermite: not sure, still researching | 16:10 |
| pabelanger | odyssey4me: Ya, sounds like what I was seeing too | 16:10 |
| fungi | it was a hunch | 16:10 |
| pabelanger | odyssey4me: Ya, sounds like what I was seeing too | 16:10 |
| pabelanger | doh | 16:10 |
| pabelanger | not my morning | 16:10 |
| tmorin | irtermite: not really, me having v6 access would help me look at the console and perhaps avoid bothering fungi with my gate issues :) | 16:10 |
| irtermite | tmorin: the "best" "workaround" to v4 scarcity and need to use v4 endpoint to v6 instances is a v4 jumpnode and then clever routing within | 16:11 |
| tmorin | irtermite: but the gate issue in itself does not seem v6 related | 16:11 |
| irtermite | tmorin: got ya... | 16:11 |
| fungi | tmorin: it's really not a more interesting workaround to ipv4 scarcity. the nodes are on a large rfc-1918 network behind a many-to-one overload nat/pat | 16:11 |
| fungi | they just happen to also have ipv6 global addresses which we can use to reach them directly | 16:11 |
| *** arxcruz is now known as arxcruz|brb | 16:12 | |
| irtermite | I see... so, you are attempting to get into the instance to see what happened, but can't due to it being v6 public and you not having v6. Then, I would suggest throwing an instance in the tenant that doesn't get wiped, that sits on both networks | 16:12 |
| tmorin | fungi: ah... I was imagining direct v6 ... | 16:12 |
| irtermite | we had set it up in a way that this is possible | 16:12 |
| fungi | tmorin: there is direct ipv6, and ipv4 through a nat | 16:12 |
| irtermite | that ^^' | 16:12 |
| irtermite | tmorin: https://github.com/osic/osic-clouds/wiki/3.1-DFW-Cloud-1 | 16:13 |
| fungi | so egress v4 works under normal circumstances except when there are local routing conflicts | 16:13 |
| *** adrian_otto has quit IRC | 16:13 | |
| fungi | ingress v4 isn't really possible given the number of nodes and unavailability of global v4 addresses | 16:13 |
| irtermite | right | 16:13 |
| fungi | so we use their global v6 addresses for ingress, to reach and manage them individually | 16:13 |
| *** rcernin has quit IRC | 16:13 | |
| *** jkilpatr_ has joined #openstack-infra | 16:14 | |
| irtermite | you just set up a single v4 ingress node, that also sits on the GATEWAY_NET_V6 network and use that to get to the v6 only instances | 16:14 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Fix race in TestDuplicatePipeline test https://review.openstack.org/395694 | 16:14 |
| *** spzala has quit IRC | 16:14 | |
| *** mdrabe has joined #openstack-infra | 16:15 | |
| *** rbuzatu has joined #openstack-infra | 16:15 | |
| openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config: [magnum-specs] Add magnum-core group https://review.openstack.org/395689 | 16:16 |
| fungi | irtermite: yeah, we've mostly avoided proxyies/bastions like that in the past since it would be a bit more effort to implement in our software | 16:17 |
| *** shamail has joined #openstack-infra | 16:18 | |
| *** ramishra has quit IRC | 16:18 | |
| *** ramishra has joined #openstack-infra | 16:19 | |
| openstackgerrit | Tomi Juvonen proposed openstack-infra/project-config: New fenix project https://review.openstack.org/394409 | 16:19 |
| *** shamail has quit IRC | 16:20 | |
| fungi | tmorin: it seems to have worked? http://logs.openstack.org/63/395663/2/check/gate-tempest-dsvm-networking-bgpvpn-bagpipe/7250524/ | 16:20 |
| tmorin | fungi: the last tempest run of the change with the tweaked SUBNETPOOL_PREFIX_V4 just finished successfully on osic-cloud1 | 16:20 |
| tmorin | fungi: yeah | 16:20 |
| fungi | so that supports that there's something going on that is stalling out on ipv4 egress due to that route conflict | 16:20 |
| irtermite | fungi: of course! this isn't intended to be a part of the automation. Just a gap to solve for what tmorin is outlining. It would be a static node that just sits there. Unless there is some automation that completely wipes the entire project no matter what is in there? | 16:21 |
| tmorin | fungi: well yes, although we haven't exactly clarified why some other jobs are not impacted ... | 16:21 |
| *** sree has joined #openstack-infra | 16:21 | |
| *** ggnel_t has quit IRC | 16:22 | |
| tsufiev | fungi, re: including the firefox 46 into the infra images... | 16:22 |
| fungi | tmorin: given the stalling seems to happen on requirements installation for tempest with plugins, it probably merits a closer look at what requirements are getting installed and how | 16:22 |
| tsufiev | or any other way to ensure that proper FF version gets into the horizon dsvm job | 16:22 |
| tmorin | fungi: yes, running tempest with plugins may indeed be where the difference happens | 16:23 |
| clarkb | ianychoi: today is not looking so great. maybe send mail to the infra list? | 16:23 |
| ianychoi | clarkb, okay I will do that thanks! | 16:24 |
| fungi | tsufiev: are we currently installing an older one because it's what devstack lists in its files set? | 16:24 |
| tmorin | fungi: even without understanding the issue in depth, I think it makes a lot of sense to suggest using for SUBNETPOOL_PREFIX_V4 a prefix not containing 10.0.0.1 | 16:24 |
| *** vaidy has quit IRC | 16:25 | |
| tsufiev | fungi, no, we're currently installing the older one manually in our job because it's the last version of firefox compatible with selenium2 | 16:25 |
| *** Guest39033 has quit IRC | 16:25 | |
| *** isviridov_away has quit IRC | 16:25 | |
| *** dtantsur is now known as dtantsur|afk | 16:25 | |
| tsufiev | installing = wget-ting it manually from mozilla-build ftp, and it's the problem | 16:25 |
| fungi | tmorin: yep, though i'd love to see devstack implement something where all rfc-1918 addressing used by devstack and related plugins get registered as offsets within a common netblock with a single knob to set the prefix for it. that would allow us to specify a safe range on a per-provider basis | 16:25 |
| tsufiev | I mean, the intermittent download errors | 16:26 |
| tmorin | fungi: +1 | 16:26 |
| fungi | tsufiev: oh, got it. the current solution to that is to have it included in te files list for devstack. longer term we want an arbitrary file mirror local to each provider where we can make things like that available | 16:26 |
| clarkb | but also we probably shohld test with a current firefox since that is what people use | 16:27 |
| *** raildo has joined #openstack-infra | 16:27 | |
| clarkb | I know I havent used an old release of firefox in years | 16:27 |
| tsufiev | clarkb, not possible :( | 16:27 |
| tsufiev | old = version 46 | 16:28 |
| tsufiev | and it's still pretty new comparing to what ubuntu maintainers might think | 16:28 |
| clarkb | tsufiev: yes I currently run some magical new version with e10s enabled | 16:28 |
| *** tosky has joined #openstack-infra | 16:28 | |
| clarkb | tsufiev: aiuiubuntu updates firefox sameday as frefox releases | 16:28 |
| clarkb | so thats not true | 16:28 |
| openstackgerrit | Merged openstack-infra/irc-meetings: Remove unused Ops tags meeting https://review.openstack.org/395509 | 16:29 |
| tsufiev | well, the exact issue with ff>46 is that old setup of selenium webdriver cannot talk to the ff the way it used to do it | 16:29 |
| clarkb | (because firefox only does old release suppory for a few weeks | 16:29 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/irc-meetings: Adds Massively Distributed Clouds meeting https://review.openstack.org/393899 | 16:29 |
| openstackgerrit | Merged openstack-infra/irc-meetings: Move StoryBoard meeting to 19:00UTC https://review.openstack.org/395678 | 16:29 |
| *** rbuzatu has quit IRC | 16:30 | |
| ihrachys | AJaeger_: would be nice to unbreak mitaka rally gates: https://review.openstack.org/#/c/395681/ | 16:30 |
| *** markvoelker has joined #openstack-infra | 16:31 | |
| tsufiev | clarkb, currently the choice for horizon community is either to test with older firefox, or not test at all | 16:31 |
| clarkb | tsufiev: why isntfix the tests anoption? | 16:31 |
| tsufiev | not enough volunteers/manpower | 16:31 |
| *** e0ne has quit IRC | 16:32 | |
| *** EricGonczer_ has joined #openstack-infra | 16:34 | |
| *** berendt has joined #openstack-infra | 16:35 | |
| openstackgerrit | Sreeram Vancheeswaran proposed openstack-infra/project-config: Request to add new project nova-dpm https://review.openstack.org/395560 | 16:35 |
| tsufiev | fungi, how can I include ff 46 into the filelist for devstack? | 16:35 |
| *** adrian_otto has joined #openstack-infra | 16:36 | |
| *** weshay is now known as weshay_brb | 16:36 | |
| clarkb | tsufiev: 45.4 is the current esr release my suggestion would be to use that version instead | 16:36 |
| *** sree has quit IRC | 16:36 | |
| tsufiev | clarkb, no objection to that | 16:36 |
| clarkb | you have to edit devstacks make a file list script intools/ iirc | 16:37 |
| openstackgerrit | Merged openstack-infra/project-config: Add tripleo-quickstart experimental job https://review.openstack.org/394394 | 16:37 |
| *** spzala has joined #openstack-infra | 16:38 | |
| *** mriedem1 has joined #openstack-infra | 16:38 | |
| *** mriedem1 has quit IRC | 16:38 | |
| *** abregman_ has joined #openstack-infra | 16:38 | |
| clarkb | 52 will be the next major esr bump | 16:38 |
| clarkb | but supposedly 45 should live a while | 16:38 |
| *** mriedem1 has joined #openstack-infra | 16:39 | |
| *** mriedem has quit IRC | 16:39 | |
| *** strigazi is now known as strigazi_AFK | 16:39 | |
| fungi | i take it the firefox package for xenial isn't suitable | 16:39 |
| openstackgerrit | Vinay Potluri proposed openstack-infra/project-config: Adding a new project syntribos-payloads https://review.openstack.org/390621 | 16:39 |
| *** EricGonczer_ has quit IRC | 16:39 | |
| tsufiev | fungi, yes, it's newer than 46 | 16:39 |
| clarkb | fungi: no ubuntu keeps it up to date with firefox releases | 16:39 |
| *** EricGonczer_ has joined #openstack-infra | 16:40 | |
| tsufiev | anything newer than 46 doesn't work for us | 16:40 |
| clarkb | (as a user O think that is a good thing) | 16:40 |
| fungi | ahh, yep, just confirmed it's too new | 16:40 |
| fungi | seems to have ff49 | 16:40 |
| clarkb | even trusty is likely ff49 | 16:40 |
| tsufiev | if they haven't broken compatibility with webdriver, that would be nice for us too :) | 16:40 |
| *** kzaitsev_mb has quit IRC | 16:41 | |
| clarkb | (so not a xenial issue) | 16:41 |
| *** abregman has quit IRC | 16:41 | |
| clarkb | yupconfirmed | 16:41 |
| tsufiev | clarkb, for the reference https://github.com/SeleniumHQ/selenium/issues/2110 | 16:42 |
| tsufiev | it's a well-known issue | 16:43 |
| *** evgenyf has quit IRC | 16:43 | |
| *** abregman_ is now known as abregman | 16:43 | |
| tsufiev | revert to ff 46 is the solution offered by selenium devs | 16:43 |
| *** mriedem1 is now known as mriedem | 16:43 | |
| robcresswell | lol, thanks selenium devs :/ | 16:43 |
| * tsufiev still looking for this file list | 16:44 | |
| tsufiev | is https://github.com/openstack-dev/devstack/tree/master/tools the place to start? | 16:44 |
| tsufiev | robcresswell, theoretically, we could switch to marionette - that would give all browsers the same opportunities | 16:45 |
| clarkb | tsufiev: yes there us a scriot in there that generates a list of files to cache | 16:45 |
| tsufiev | but I don't have enough time to investigate the transition process | 16:45 |
| tsufiev | :/ | 16:45 |
| *** weshay_brb is now known as weshay | 16:45 | |
| robcresswell | tsufiev: It appears nobody has time for Horizon :( | 16:47 |
| fungi | the same is true for most projects in openstack | 16:48 |
| rcarrillocruz | lol, you beat me to it fungi | 16:48 |
| robcresswell | True | 16:48 |
| JayF | I don't know if I've ever seen a software project, open source or otherwise, that didn't have at least 2x as many things to do as capacity to do the things. | 16:48 |
| *** ad_rien_1 has quit IRC | 16:49 | |
| ttx | it's part of being successful | 16:49 |
| tsufiev | robcresswell, you raised a hot topic ;) | 16:49 |
| * fungi considers a sarcastic #success Nobody has enough time for OpenStack! | 16:49 | |
| Zara | :D | 16:50 |
| rcarrillocruz | we automated everything, *done* | 16:50 |
| * tsufiev still hasn't success with finding the exact location to include older ff package into devstack | 16:50 | |
| clarkb | tsufiev: http://git.openstack.org/cgit/openstack-dev/devstack/tree/tools/image_list.sh that script I think | 16:51 |
| tmorin | AJaeger_: could you give your blessing to https://review.openstack.org/#/c/394339/ (now I think addressing your comments) ? | 16:51 |
| *** Swami has joined #openstack-infra | 16:52 | |
| *** lbeliveau_ has joined #openstack-infra | 16:52 | |
| *** bnemec has quit IRC | 16:52 | |
| *** lbeliveau has quit IRC | 16:52 | |
| *** yamahata has joined #openstack-infra | 16:53 | |
| pabelanger | tsufiev: which job are you looking at for firefox? | 16:53 |
| pabelanger | I think we also have some JJB macro that will install firefox too | 16:54 |
| tsufiev | clarkb, so I just need to add FF deb package url to ALL_IMAGES var there, right? | 16:54 |
| openstackgerrit | Merged openstack-infra/irc-meetings: Adds Massively Distributed Clouds meeting https://review.openstack.org/393899 | 16:54 |
| tsufiev | pabelanger, this one https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/horizon.yaml#L1-L36 | 16:54 |
| fungi | tsufiev: i think so, though it remains to be seen whether the devstack reviewers will agree to that as a solution | 16:55 |
| openstackgerrit | Matthew Booth proposed openstack-infra/project-config: Run devstack-plugin-nfs-nv in nova experimental https://review.openstack.org/395711 | 16:55 |
| pabelanger | tsufiev: k | 16:55 |
| *** raildo has quit IRC | 16:55 | |
| *** bnemec has joined #openstack-infra | 16:55 | |
| clarkb | pabelanger: the issue is mozilla file hosting is unreliable | 16:55 |
| clarkb | pabelanger: so looking at easy mode cache on images | 16:56 |
| *** gouthamr has quit IRC | 16:56 | |
| pabelanger | were are talking about firefox right? | 16:56 |
| tsufiev | yep | 16:56 |
| fungi | ultimately this is well suited to our arbitrary file mirroring plan | 16:56 |
| *** yamahata has quit IRC | 16:56 | |
| *** gouthamr has joined #openstack-infra | 16:56 | |
| fungi | but nobody's built that solution yet afaik | 16:56 |
| pabelanger | Ya, I didn't realise we did anything special to pin firefox | 16:56 |
| pabelanger | https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/horizon.yaml#L14 | 16:57 |
| pabelanger | just calls the firefox-install macro | 16:57 |
| pabelanger | Also, do we have a spec / blueprint about updating devstack to use bindep? | 16:58 |
| clarkb | pabelanger: I dont think infra does,would be a qa spec | 16:58 |
| *** yamahata has joined #openstack-infra | 16:58 | |
| pabelanger | let me pop over to their channel and check | 16:59 |
| fungi | pabelanger: none to my knowledge, though it also seems like a simple enough change you could just propose a patch and see where that takes you | 17:01 |
| openstackgerrit | Merged openstack-infra/nodepool: Move kazooclient in to a fixture https://review.openstack.org/387577 | 17:02 |
| *** Naeil has quit IRC | 17:02 | |
| fungi | i expected we'd wait a bit until bindep distro packages were more widely available | 17:02 |
| fungi | but installing from pypi could be an alternative to start relying on it sooner | 17:03 |
| clarkb | an easy first step is git clone $repo && if bindep.txt installpackages | 17:03 |
| pabelanger | fungi: Ya, that's what I am thinking too. Maybe first add an empty bindep.txt file and update the job to use install-distro-packages just to get the ball rolling. Then slowly start migrating things | 17:03 |
| openstackgerrit | Merged openstack-infra/zuul: Enable test_failed_change_in_middle test https://review.openstack.org/391687 | 17:03 |
| clarkb | pabelanger: I dont think you want a separate bindep for devstack | 17:03 |
| clarkb | instead it should use the existing data in projects | 17:03 |
| pabelanger | Right | 17:04 |
| clarkb | andthats a pretty small change to devstack I think | 17:04 |
| fungi | though that may also have to depend on getting bindep.txt files available in more projects too | 17:04 |
| pabelanger | ya | 17:05 |
| openstackgerrit | Merged openstack-infra/zuul: Re-enable test_nonvoting_pipeline https://review.openstack.org/386769 | 17:05 |
| fungi | an up side is that if we overload the existing devstack functions for collecting package names instead of extracting it out into the job config, we can just make it depend on various bindep.txt addition changes in other projects that share a check queue with devstack | 17:05 |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Add support for view-templates https://review.openstack.org/395716 | 17:05 |
| *** matt-borland has quit IRC | 17:06 | |
| *** matt-borland has joined #openstack-infra | 17:06 | |
| *** rbuzatu has joined #openstack-infra | 17:07 | |
| fungi | so replace devstack's current package list file parser routines with calls to run bindep over an accumulated set of bindep.txt files from the enabled projects, and then as you spot things missing for specific services just add a depends-on in that commit message to the per-project bindep.txt additions which solve them | 17:07 |
| openstackgerrit | Timur Sufiev proposed openstack-infra/project-config: Remove install-firefox macro from horizon dsvm job https://review.openstack.org/395717 | 17:07 |
| *** andreas_s has quit IRC | 17:07 | |
| tsufiev | clarkb, fungi: I think that's ^^ the step 1 | 17:07 |
| *** chlong has quit IRC | 17:08 | |
| *** gouthamr has quit IRC | 17:10 | |
| *** tmorin has quit IRC | 17:10 | |
| *** rbuzatu has quit IRC | 17:10 | |
| *** ricardoas has joined #openstack-infra | 17:10 | |
| *** gouthamr has joined #openstack-infra | 17:10 | |
| *** gouthamr has quit IRC | 17:11 | |
| *** gouthamr has joined #openstack-infra | 17:12 | |
| *** xavierr has joined #openstack-infra | 17:13 | |
| *** xavierr has left #openstack-infra | 17:13 | |
| *** gyee has joined #openstack-infra | 17:13 | |
| *** matrohon has quit IRC | 17:14 | |
| *** chlong has joined #openstack-infra | 17:17 | |
| tsufiev | fungi, clarkb: and here is the step 2: https://review.openstack.org/#/c/395720/ | 17:18 |
| *** fernnest has joined #openstack-infra | 17:20 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Remove v3 project template test https://review.openstack.org/395722 | 17:20 |
| zaro | fungi: do we still keep numbers for active contributors to openstack? you happen to have those or a way to generate it? | 17:22 |
| *** john-davidge has joined #openstack-infra | 17:23 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Delete test_single_nonexistent_post_job test https://review.openstack.org/391692 | 17:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable 4 CRD unit tests https://review.openstack.org/393494 | 17:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable 3 disabled tests https://review.openstack.org/393452 | 17:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_file_head test https://review.openstack.org/393956 | 17:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_merger_repack test https://review.openstack.org/393953 | 17:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_layered_templates test https://review.openstack.org/393445 | 17:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_job_from_templates_launched job https://review.openstack.org/393412 | 17:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable test_two_failed_changes_at_head test https://review.openstack.org/393950 | 17:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_can_merge unit test https://review.openstack.org/392953 | 17:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_queue_precedence test https://review.openstack.org/394191 | 17:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable test_statsd test https://review.openstack.org/393479 | 17:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable test_new_patchset_check / test_abandoned_check https://review.openstack.org/393458 | 17:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_source_cache unit test https://review.openstack.org/393278 | 17:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_one_job_project unit test https://review.openstack.org/393304 | 17:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable 4 disable tests https://review.openstack.org/393461 | 17:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_needed_changes_enqueue testing https://review.openstack.org/393001 | 17:24 |
| fungi | zaro: http://git.openstack.org/cgit/openstack-infra/system-config/tree/tools/owners.py | 17:24 |
| *** chandankumar has joined #openstack-infra | 17:25 | |
| *** asettle has quit IRC | 17:26 | |
| *** baoli has joined #openstack-infra | 17:28 | |
| openstackgerrit | Mike Dorman proposed openstack-infra/jenkins-job-builder: Add support for Saltstack plugin builder https://review.openstack.org/391567 | 17:28 |
| fungi | zaro: in unrelated news, once i accepted the api host key into ~gerrit2/.ssh/known_hosts manage-projects seems to be back on track on review-dev | 17:28 |
| *** denisra_ has joined #openstack-infra | 17:28 | |
| zaro | fungi: thanks. what would be your guess on how many accounts we have? 10K+? | 17:28 |
| zaro | *accounts/gerrit accounts | 17:29 |
| fungi | zaro: total accounts, not just accounts of people who own changes? | 17:29 |
| zaro | yes | 17:29 |
| clarkb | its more than 12k | 17:29 |
| clarkb | since account ids are sequential | 17:30 |
| zaro | that includes dups, correct? | 17:30 |
| *** spzala has quit IRC | 17:30 | |
| fungi | 18974 according to `select count(*) from accounts;` | 17:30 |
| fungi | so just shy of 19k accounts in the db | 17:31 |
| *** Sukhdev has quit IRC | 17:31 | |
| *** spzala has joined #openstack-infra | 17:31 | |
| fungi | duplicate accounts are a small enough portion of the overall count as to be statistically insignificant | 17:31 |
| zaro | cool. thanks | 17:31 |
| *** denisra has quit IRC | 17:32 | |
| *** jpich has quit IRC | 17:33 | |
| fungi | for comparison, `select count(*) from account_group_members where group_id=324;` shows we have 11694 members in the "CLA Accepted - ICLA" group (so that's the number of accounts that have agreed to the icla) | 17:34 |
| *** gouthamr has quit IRC | 17:35 | |
| *** spzala has quit IRC | 17:36 | |
| *** pilgrimstack1 has quit IRC | 17:37 | |
| zaro | fungi: you can submit reviews without accepting CLA, correct? | 17:37 |
| *** gouthamr has joined #openstack-infra | 17:37 | |
| pleia2 | right | 17:38 |
| fungi | zaro: you can leave review comments and votes without accepting a cla, you can also push proposed changes to _some_ projects without agreeing to a cla | 17:38 |
| fungi | we enforce a cla on a project-by-project basis in gerrit | 17:39 |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Add support for view-templates https://review.openstack.org/395716 | 17:39 |
| fungi | it's basically set in the individual project acls | 17:39 |
| *** baoli has quit IRC | 17:39 | |
| *** baoli has joined #openstack-infra | 17:39 | |
| fungi | though in general deliverable repos for official project teams in openstack have cla enforcement turned on | 17:39 |
| *** florianf has quit IRC | 17:40 | |
| *** Apoorva has joined #openstack-infra | 17:40 | |
| *** gouthamr has quit IRC | 17:41 | |
| *** esikachev has quit IRC | 17:42 | |
| *** abregman has quit IRC | 17:42 | |
| *** gouthamr has joined #openstack-infra | 17:42 | |
| *** cody-somerville has quit IRC | 17:44 | |
| *** EricGonczer_ has quit IRC | 17:47 | |
| *** cody-somerville has joined #openstack-infra | 17:47 | |
| *** ad_rien_ has joined #openstack-infra | 17:49 | |
| *** denisra_ has quit IRC | 17:49 | |
| *** gouthamr has quit IRC | 17:50 | |
| *** mhickey has quit IRC | 17:51 | |
| *** cody-somerville has quit IRC | 17:52 | |
| mordred | infra-root, Shrews: I'd like to cut a shade release | 17:52 |
| *** gouthamr has joined #openstack-infra | 17:52 | |
| fungi | early and often! | 17:52 |
| Shrews | mordred: NEVER! | 17:54 |
| jeblair | mordred: seems like a good day for it | 17:54 |
| pabelanger | mordred: +1 | 17:55 |
| mordred | I think this one should be 1.13.0 since there's new stuff in it | 17:55 |
| Shrews | mordred: definitely | 17:56 |
| *** derekh has quit IRC | 17:57 | |
| Shrews | qd | 17:58 |
| JayF | I'm seeing a strange problem on ironic-python-agent project; in this patch: https://review.openstack.org/#/c/374147 and others in IPA (but not on other projects that I've seen), the Conflicts With panel is returning "500 internal server error" | 17:58 |
| Shrews | oops | 17:58 |
| *** jtomasek has quit IRC | 17:58 | |
| nibalizer | mordred: better today than friday! | 17:58 |
| clarkb | JayF: it does that if there were once conflicts that have been resolved | 17:59 |
| clarkb | ui doesnt drop the panel and it 500s looling up the non existant conflicts | 17:59 |
| *** fernnest has quit IRC | 17:59 | |
| *** vaidy has joined #openstack-infra | 17:59 | |
| clarkb | at least thats what appears to hapoen whenI looked at it a little while back | 17:59 |
| JayF | Ah, okay, that makes sense. We probably had an IPA patch that was conflicting with near-everything | 17:59 |
| *** isviridov_away has joined #openstack-infra | 17:59 | |
| *** baoli has quit IRC | 18:00 | |
| *** baoli has joined #openstack-infra | 18:00 | |
| *** rbuzatu_ has joined #openstack-infra | 18:00 | |
| *** gouthamr has quit IRC | 18:00 | |
| mordred | infra-root, Shrews: ok. tag is pushed. let the carnage begin | 18:01 |
| *** psilvad has quit IRC | 18:02 | |
| *** ralonsoh has quit IRC | 18:02 | |
| *** jcoufal_ has joined #openstack-infra | 18:02 | |
| *** mkoderer has quit IRC | 18:03 | |
| jeblair | clarkb: looling definitely sounds like something gerrit would do | 18:03 |
| mordred | jeblair: ++ | 18:03 |
| clarkb | this is my "head hurts too much and on phone to type properly" typing | 18:04 |
| *** aneliubin has quit IRC | 18:04 | |
| *** jcoufal has quit IRC | 18:05 | |
| *** gouthamr has joined #openstack-infra | 18:06 | |
| *** lucasagomes is now known as lucas-afk | 18:07 | |
| *** nicolasbock has quit IRC | 18:09 | |
| *** eharney has quit IRC | 18:10 | |
| *** nicolasbock has joined #openstack-infra | 18:11 | |
| *** bnemec has quit IRC | 18:11 | |
| fungi | mrmartin: i've approved the askbot production upgrade change--sorry i didn't realize it was hanging out there still | 18:12 |
| fungi | mrmartin: i'll try to keep an eye on the service once it upgrades and make sure it's still behaving sanely | 18:12 |
| clarkb | fungi: does that not need a scheduled downtine? | 18:12 |
| *** bnemec has joined #openstack-infra | 18:13 | |
| fungi | clarkb: i don't see anything to that effect in the commit message nor review comments | 18:14 |
| clarkb | ok(iask because there is a migrate command imying it may need to do things while offline like gerrit does) | 18:14 |
| *** gouthamr has quit IRC | 18:15 | |
| *** tphummel has joined #openstack-infra | 18:16 | |
| fungi | am i missing a reference to a migration command in that change? | 18:16 |
| fungi | i keep rereading and not seeing one | 18:16 |
| clarkb | fungi: I am looking at askbot docs | 18:16 |
| fungi | oh | 18:16 |
| *** gouthamr has joined #openstack-infra | 18:16 | |
| clarkb | http://askbot.org/doc/upgrade.html | 18:17 |
| fungi | looking to see whether we call that in the puppet module | 18:17 |
| clarkb | my experience with askbot was to nevwr trust the docs thoughso these couldbe completely wrong too :) | 18:17 |
| *** sdake has quit IRC | 18:19 | |
| *** maeker_ has quit IRC | 18:19 | |
| *** jordanP has quit IRC | 18:19 | |
| fungi | clarkb: http://git.openstack.org/cgit/openstack-infra/puppet-askbot/tree/manifests/site/config.pp#n94 seems to be an exec for running that | 18:19 |
| *** maeker has joined #openstack-infra | 18:20 | |
| fungi | runs whenever the source code for askbot or the settings file changes | 18:20 |
| clarkb | cool so may be a short blip depending on how askbot handles db changing under it but otherwise should get through it | 18:20 |
| *** baoli has quit IRC | 18:21 | |
| *** ihrachys has quit IRC | 18:22 | |
| *** baoli has joined #openstack-infra | 18:22 | |
| *** gouthamr_ has joined #openstack-infra | 18:23 | |
| *** gouthamr has quit IRC | 18:23 | |
| *** rodrigods has quit IRC | 18:24 | |
| *** ad_rien_ has quit IRC | 18:26 | |
| *** psilvad has joined #openstack-infra | 18:26 | |
| *** jaosorior has quit IRC | 18:26 | |
| *** rodrigods has joined #openstack-infra | 18:27 | |
| *** asettle has joined #openstack-infra | 18:27 | |
| *** rbuzatu_ has quit IRC | 18:29 | |
| *** electrofelix has quit IRC | 18:29 | |
| openstackgerrit | Merged openstack-infra/system-config: Update ask.o.o to latest 0.7.x branch https://review.openstack.org/274032 | 18:30 |
| *** gouthamr_ is now known as gouthamr | 18:30 | |
| fungi | and there it is. now the waiting game | 18:30 |
| *** rbuzatu has joined #openstack-infra | 18:30 | |
| *** ad_rien_ has joined #openstack-infra | 18:30 | |
| *** asettle has quit IRC | 18:31 | |
| *** ad_rien_ has quit IRC | 18:33 | |
| *** tosky has quit IRC | 18:34 | |
| *** ad_rien_ has joined #openstack-infra | 18:35 | |
| *** rbuzatu has quit IRC | 18:36 | |
| openstackgerrit | Merged openstack-infra/zuul: Delete test_single_nonexistent_post_job test https://review.openstack.org/391692 | 18:36 |
| openstackgerrit | Merged openstack-infra/zuul: Re-enable test_can_merge unit test https://review.openstack.org/392953 | 18:36 |
| openstackgerrit | Merged openstack-infra/zuul: Re-enable test_needed_changes_enqueue testing https://review.openstack.org/393001 | 18:38 |
| openstackgerrit | Merged openstack-infra/zuul: Re-enable test_source_cache unit test https://review.openstack.org/393278 | 18:38 |
| openstackgerrit | Merged openstack-infra/zuul: Re-enable test_one_job_project unit test https://review.openstack.org/393304 | 18:39 |
| openstackgerrit | Merged openstack-infra/zuul: Re-enable test_job_from_templates_launched job https://review.openstack.org/393412 | 18:39 |
| *** xarses has joined #openstack-infra | 18:39 | |
| *** chandankumar_ has joined #openstack-infra | 18:39 | |
| *** baoli has quit IRC | 18:42 | |
| *** chandankumar has quit IRC | 18:43 | |
| *** baoli has joined #openstack-infra | 18:43 | |
| *** gouthamr has quit IRC | 18:44 | |
| *** xarses has quit IRC | 18:44 | |
| *** gouthamr has joined #openstack-infra | 18:45 | |
| *** baoli has quit IRC | 18:49 | |
| *** gouthamr has quit IRC | 18:49 | |
| *** jerryz has joined #openstack-infra | 18:49 | |
| *** gouthamr has joined #openstack-infra | 18:49 | |
| *** thcipriani is now known as thcipriani|afk | 18:50 | |
| *** rbuzatu has joined #openstack-infra | 18:50 | |
| *** baoli has joined #openstack-infra | 18:50 | |
| *** amotoki has joined #openstack-infra | 18:55 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Fix race in TestDuplicatePipeline test https://review.openstack.org/395694 | 18:56 |
| *** jamesdenton has quit IRC | 18:57 | |
| *** rodrigods has quit IRC | 18:58 | |
| *** rbrndt_ has quit IRC | 18:58 | |
| *** rcernin has joined #openstack-infra | 18:59 | |
| openstackgerrit | Merged openstack-infra/zuul: Add getProjectBranches to Source https://review.openstack.org/382076 | 18:59 |
| *** harlowja has quit IRC | 18:59 | |
| openstackgerrit | Merged openstack-infra/zuul: Implement branch-specific in-repo job config https://review.openstack.org/382077 | 18:59 |
| *** amotoki has quit IRC | 18:59 | |
| *** maeker has quit IRC | 19:00 | |
| *** baoli has quit IRC | 19:00 | |
| *** dprince has quit IRC | 19:00 | |
| *** Sukhdev has joined #openstack-infra | 19:00 | |
| fungi | the askbot upgrade seems to have happened but `manage.py migrate` is exiting 1 instead of 0 | 19:01 |
| fungi | AttributeError: 'Settings' object has no attribute 'ASKBOT_MULTILINGUAL' | 19:01 |
| fungi | mrmartin: ^ | 19:01 |
| fungi | the site seems to be up and running though | 19:01 |
| clarkb | fungi: I wonder if we need to add that value to our config file ? | 19:01 |
| *** baoli has joined #openstack-infra | 19:01 | |
| clarkb | iirc its django and django uses raw python configuration setup ^ implies that maybe its missing a value it expects to be there? | 19:02 |
| fungi | yeah, there's a settings.py file | 19:02 |
| fungi | :q | 19:02 |
| openstackgerrit | Merged openstack-infra/zuul: Fix race in TestDuplicatePipeline test https://review.openstack.org/395694 | 19:02 |
| fungi | hah, you're not my vi window | 19:02 |
| *** ijw has joined #openstack-infra | 19:02 | |
| clarkb | https://github.com/ASKBOT/askbot-devel/blob/master/askbot/doc/source/multilingual.rst#upgrading-from-older-versions | 19:02 |
| *** esikachev has joined #openstack-infra | 19:03 | |
| fungi | yep, urls.py does indeed do a "getattr(settings, 'ASKBOT_MULTILINGUAL', False)" | 19:04 |
| openstackgerrit | Ian Y. Choi proposed openstack-infra/yaml2ical: [WIP] Add support on monthly recurrences https://review.openstack.org/395762 | 19:06 |
| fungi | and yeah, later versions use ASKBOT_TRANSLATE_URL like https://github.com/ASKBOT/askbot-devel/blob/master/askbot/urls.py#L19 | 19:06 |
| openstackgerrit | Merged openstack-infra/zuul: Re-enable test_layered_templates test https://review.openstack.org/393445 | 19:07 |
| openstackgerrit | Merged openstack-infra/zuul: Re-enable 3 disabled tests https://review.openstack.org/393452 | 19:08 |
| *** eharney has joined #openstack-infra | 19:08 | |
| *** gouthamr has quit IRC | 19:09 | |
| fungi | er, i guess https://github.com/ASKBOT/askbot-devel/blob/master/askbot/setup_templates/urls.py is the relevant replacement | 19:11 |
| *** oanson has joined #openstack-infra | 19:11 | |
| *** ijw has quit IRC | 19:11 | |
| fungi | uhh, on the server /srv/dist/askbot/askbot/setup_templates/urls.py is still the old version | 19:13 |
| fungi | i wonder if /srv/dist/askbot is cruft | 19:13 |
| *** armax has joined #openstack-infra | 19:14 | |
| clarkb | re the networking-fortinet-release request, the change setting up those acls came from armax. Should I be adding armax to the group and let him delegate out to whomever is proper group membership? or just add jerryz because neutron has divested? | 19:14 |
| armax | clarkb: do you have a link? | 19:15 |
| *** gouthamr has joined #openstack-infra | 19:15 | |
| *** spzala has joined #openstack-infra | 19:15 | |
| clarkb | armax: https://review.openstack.org/#/c/303039/ jerry has asked that we add a couple people to networking-fortinet-release | 19:15 |
| clarkb | armax: happy to add them direclty if they look fine to you as the divestor | 19:16 |
| clarkb | (I don't know who the correct fortinet individuals are myself) | 19:16 |
| * armax looks | 19:16 | |
| *** coolsvap has quit IRC | 19:17 | |
| *** ad_rien_ has quit IRC | 19:17 | |
| armax | clarkb: sure, I think the fact that th fortinet-release team is empty is an oversight | 19:17 |
| armax | clarkb: please go ahead, but you can add me and I can add them, either way | 19:18 |
| clarkb | if you are ok with that membership I will just go ahead and do it, thanks | 19:18 |
| jerryz | thanks, clarb, armax | 19:19 |
| jerryz | clarkb | 19:19 |
| clarkb | jerryz: and its done now :) | 19:19 |
| armax | clarkb: thanks | 19:19 |
| *** ssbarnea has quit IRC | 19:20 | |
| fungi | i think the puppet git resource for askbot at http://git.openstack.org/cgit/openstack-infra/puppet-askbot/tree/manifests/init.pp#n114 isn't updating to the new specified $askbot_revision | 19:20 |
| *** amotoki has joined #openstack-infra | 19:21 | |
| clarkb | fungi: so we didn't actually upgrade? | 19:21 |
| fungi | i don't see any reference to git in the syslog | 19:21 |
| *** cody-somerville has joined #openstack-infra | 19:21 | |
| *** cody-somerville has joined #openstack-infra | 19:21 | |
| fungi | i think the upgrade happens from some other mechanism and we're using this dist tree to grab template files | 19:22 |
| *** ijw has joined #openstack-infra | 19:22 | |
| *** baoli has quit IRC | 19:22 | |
| fungi | no, it would need to be using this i think | 19:22 |
| *** john-davidge has quit IRC | 19:22 | |
| *** ad_rien_ has joined #openstack-infra | 19:22 | |
| *** john-davidge has joined #openstack-infra | 19:23 | |
| fungi | `/usr/askbot-env/bin/pip list` says we're running "askbot (0.7.53)" | 19:23 |
| fungi | which is what the change was trying to accomplish | 19:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: First hold jobs for test_duplicate_pipelines https://review.openstack.org/395772 | 19:24 |
| fungi | so somehow the virtualenv for it is running newer askbot than what's checked out into $dist_root | 19:25 |
| *** dave-mccowan has quit IRC | 19:25 | |
| *** amotoki has quit IRC | 19:25 | |
| *** dave-mccowan has joined #openstack-infra | 19:26 | |
| fungi | nevermind, `git describe` in /srv/dist/askbot says 0.7.49-1029-g06be25e so i think we're running the version that's checked out there, it's just not the version we told it to upgrade to | 19:26 |
| fungi | it's still the old version from before we merged 274032 | 19:27 |
| *** john-davidge has quit IRC | 19:28 | |
| *** rodrigods has joined #openstack-infra | 19:28 | |
| *** baoli_ has joined #openstack-infra | 19:28 | |
| *** baoli__ has joined #openstack-infra | 19:29 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: First hold jobs / orderedRelease for test_duplicate_pipelines https://review.openstack.org/395772 | 19:29 |
| *** ad_rien_ has quit IRC | 19:30 | |
| openstackgerrit | Merged openstack-infra/storyboard: use processutils from oslo.concurrency https://review.openstack.org/394570 | 19:30 |
| pabelanger | larger amount of launch failures in rax-ord for ubuntu-xenial today | 19:31 |
| pabelanger | wonder what is going on | 19:31 |
| *** adrian_otto has quit IRC | 19:31 | |
| *** ad_rien_ has joined #openstack-infra | 19:32 | |
| *** baoli_ has quit IRC | 19:32 | |
| fungi | yeah, old version was definitely 0.7.53 according to https://github.com/ASKBOT/askbot-devel/blob/06be25e/askbot/__init__.py#L10 | 19:33 |
| *** ad_rien_ has quit IRC | 19:35 | |
| *** dave-mccowan has quit IRC | 19:36 | |
| *** chandankumar_ has quit IRC | 19:38 | |
| openstackgerrit | Waldemar Znoinski proposed openstack-infra/project-config: add non-voting functional tests job for networking-odl https://review.openstack.org/394476 | 19:44 |
| *** cody-somerville has quit IRC | 19:45 | |
| *** clenimar has joined #openstack-infra | 19:46 | |
| fungi | reading through https://github.com/voxpupuli/puppet-git_resource/blob/master/lib/puppet/provider/git/default.rb i don't see anything that would cause it to ignore a mandate for a specific commit being present when already checked out to another commit | 19:46 |
| fungi | unless that's this check: https://github.com/voxpupuli/puppet-git_resource/blob/master/lib/puppet/provider/git/default.rb#L90 | 19:47 |
| fungi | i'm a little fuzzy on puppet resource api implementations | 19:48 |
| fungi | nibalizer: ^ do you know if changing the $commit set in a puppet git resource with ensure=>present will cause it to check out that new commit in an existing clone at that path? | 19:49 |
| *** ijw has quit IRC | 19:49 | |
| clarkb | I want to say with vcsrepo we have to do ensure=>latest to get it to update | 19:49 |
| clarkb | even if specifying an explicit commit | 19:49 |
| clarkb | or tag | 19:49 |
| fungi | it looks there like "latest" is only relevant for branches (it's a no-op on commit and tag) | 19:50 |
| *** rbrndt_ has joined #openstack-infra | 19:52 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: test_duplicate_pipelines messages are also unordered https://review.openstack.org/395772 | 19:52 |
| *** jkilpatr_ has quit IRC | 19:52 | |
| *** hashar has joined #openstack-infra | 19:52 | |
| *** clenimar has quit IRC | 19:52 | |
| *** jeckersb has joined #openstack-infra | 19:54 | |
| *** oanson has quit IRC | 19:55 | |
| *** rcernin has quit IRC | 19:55 | |
| *** EricGonczer_ has joined #openstack-infra | 19:58 | |
| openstackgerrit | Merged openstack-infra/zuul: test_duplicate_pipelines messages are also unordered https://review.openstack.org/395772 | 19:58 |
| *** cody-somerville has joined #openstack-infra | 20:02 | |
| *** Shuo has joined #openstack-infra | 20:03 | |
| *** jkilpatr has joined #openstack-infra | 20:04 | |
| *** jkilpatr has quit IRC | 20:05 | |
| openstackgerrit | Waldemar Znoinski proposed openstack-infra/project-config: add non-voting functional tests job for networking-odl https://review.openstack.org/394476 | 20:05 |
| Shuo | http://docs.openstack.org/infra/zuul/gating.html, anyone kindly helps me walk through the cross project gating example on the doc (I felt the doc might be wrong for the "master/Z1, stable/Z2, master/Z3" example, or maybe I missed anything there) | 20:06 |
| *** sdake has joined #openstack-infra | 20:08 | |
| *** armax has quit IRC | 20:08 | |
| openstackgerrit | Waldemar Znoinski proposed openstack-infra/project-config: add non-voting functional tests job for networking-odl https://review.openstack.org/394476 | 20:09 |
| clarkb | Shuo: do you have a specific question? Basically each change is stacked on top of the otehrs in git and that way you can test the speculative future in parallel before things actually merge | 20:10 |
| clarkb | Shuo: so change 1 goes in and it gets tested, Then change 2 arrives and zuul makes refs for change 2 on plugin stable branch and for change 1 on acme master branch | 20:10 |
| clarkb | and that continues with change 3, acme gets master + change 1, and plugin gets stable + change2 and master + change 3 | 20:12 |
| clarkb | this was you can test upgrades between branches in the speculative future as well | 20:12 |
| Shuo | clarkb: let me try to interpret that example, and you correct me in that context for any misunderstanding | 20:13 |
| *** ad_rien_ has joined #openstack-infra | 20:13 | |
| *** jkilpatr has joined #openstack-infra | 20:13 | |
| openstackgerrit | Merged openstack-infra/zuul: Enable test_new_patchset_check / test_abandoned_check https://review.openstack.org/393458 | 20:14 |
| *** ijw has joined #openstack-infra | 20:15 | |
| Shuo | clarkb: first, there are three commits going into two projects (independent repos), and repo 2 has two branches: "Change 1" goes into acme::master; "Change 2" goes into plugin::stable, "Change 3" goes into plugin::master | 20:17 |
| *** ijw has quit IRC | 20:17 | |
| clarkb | Shuo: correct | 20:17 |
| Shuo | clarkb: how many tests zuul inserts to the queue in total? (the table showed 6, but I am confused here) | 20:19 |
| clarkb | Shuo: those aren't tests inserted into the queue, they are speculative git refs built from the proposed state | 20:19 |
| clarkb | so each of those is a git ref that is identified by the Z1, Z2, Z3 zuul refs across branches | 20:20 |
| *** jkilpatr has quit IRC | 20:20 | |
| clarkb | the number of test jobs queued depends on the config for each of the projects and is independent of zuul creating those git refs | 20:20 |
| *** tlian has quit IRC | 20:20 | |
| *** ad_rien_ has quit IRC | 20:21 | |
| *** tlian has joined #openstack-infra | 20:21 | |
| *** aneliubin has joined #openstack-infra | 20:21 | |
| *** maeker has joined #openstack-infra | 20:22 | |
| openstackgerrit | Merged openstack-infra/zuul: Re-enable 4 disable tests https://review.openstack.org/393461 | 20:22 |
| *** maeker_ has joined #openstack-infra | 20:23 | |
| *** maeker has quit IRC | 20:23 | |
| openstackgerrit | Merged openstack-infra/zuul: Enable test_statsd test https://review.openstack.org/393479 | 20:23 |
| Shuo | clarkb: let me first understand why the use case scenario of Z2 (since it's on stable branch, not master branch). Is that a release branch fix? Say "O" release (which is a stable branch) needs some bug-fix. | 20:23 |
| openstackgerrit | Merged openstack-infra/zuul: Enable 4 CRD unit tests https://review.openstack.org/393494 | 20:23 |
| openstackgerrit | Merged openstack-infra/zuul: Enable test_two_failed_changes_at_head test https://review.openstack.org/393950 | 20:23 |
| openstackgerrit | Merged openstack-infra/zuul: Re-enable test_merger_repack test https://review.openstack.org/393953 | 20:24 |
| openstackgerrit | Merged openstack-infra/zuul: Re-enable test_file_head test https://review.openstack.org/393956 | 20:24 |
| clarkb | Shuo: openstack uses stable branches to backport critical bugfixes yes | 20:24 |
| openstackgerrit | Merged openstack-infra/zuul: Re-enable test_queue_precedence test https://review.openstack.org/394191 | 20:24 |
| jeckersb | question about co-dependent changes... https://review.openstack.org/#/c/395728/ and https://review.openstack.org/#/c/395778/ are each failing checks due to the other. how to move forward? | 20:24 |
| *** ijw has joined #openstack-infra | 20:25 | |
| Shuo | clarkb: and Z3 has nothing to do with Z2, right? (i.e, Z3 may be a different commit from a different committer). oops, you seemed just implied that Z3 and Z2 could be the same bug fix (Z2 is a backport of Z3) | 20:25 |
| clarkb | jeckersb: is https://review.openstack.org/#/c/395778/ going to fail? if not merge that one first then merge the other | 20:26 |
| clarkb | Shuo: correct in both cases | 20:26 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: WIP: Transition ZK API from dict to object model https://review.openstack.org/394592 | 20:27 |
| clarkb | Shuo: they can be related eg a backported bugfix or they may be entirely different | 20:27 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Add tenant support to zuul client https://review.openstack.org/393850 | 20:27 |
| jeckersb | clarkb: yeah the job is still running but it's failing... see http://logs.openstack.org/78/395778/1/check/gate-oslo.messaging-python27-ubuntu-xenial/2977c61/console.html | 20:27 |
| clarkb | jeckersb: in that case you can squash them together or disable the failing test(s), merge the fixes, enable the failing tests | 20:28 |
| jeckersb | clarkb: ok i'll do that then, thanks! | 20:28 |
| *** claudiub has quit IRC | 20:29 | |
| *** ijw has quit IRC | 20:30 | |
| *** hurgleburgler has quit IRC | 20:30 | |
| *** ijw has joined #openstack-infra | 20:31 | |
| fungi | Shuo: also stable branch and master branch changes can be interrelated in jobs that checkout multiple branches, for example those which perform upgrade tests between two stable branches or between a stable branch and the master branch | 20:33 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Remove includes and parameter functions https://review.openstack.org/394644 | 20:33 |
| fungi | so you might want to make sure that a fix merged to stable/newton of nova doesn't break the ability to upgrade to a state which incorporates a proposed change to the master branch of neutron | 20:34 |
| *** jkilpatr has joined #openstack-infra | 20:34 | |
| *** ijw has quit IRC | 20:36 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: WIP: Transition ZK API from dict to object model https://review.openstack.org/394592 | 20:37 |
| Shuo | clarkb: can you help me understand the 2nd row of the table "2acmemaster/Z2acme master + change 1"? it has the same description as row 1, but has different zuul reference from row 1, can you help me understand what it refers to? | 20:38 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: WIP: Transition ZK API from dict to object model https://review.openstack.org/394592 | 20:38 |
| *** gyee has quit IRC | 20:38 | |
| *** dave-mccowan has joined #openstack-infra | 20:38 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: WIP: Transition ZK API from dict to object model https://review.openstack.org/394592 | 20:39 |
| clarkb | Shuo: it is the same thing as the first row but with a name matching the zuul ref for the second change. That way the second change can find the ref made for it | 20:39 |
| clarkb | Shuo: but it is the same merge as in the first row, just aliased with a new name so change 2 can find it | 20:40 |
| Shuo | clarkb: sounds like column "Description" in that table is source of truth of the real merge action candidate (correct me if I am wrong here). If so, why there are three rows related to "acme master + change 1", but only 2 rows related to "plugin stable + change 2", and only 1 for the last commit? | 20:44 |
| openstackgerrit | Merged openstack-infra/project-config: Remove 99-install-zuul from nodepool-base element https://review.openstack.org/394761 | 20:45 |
| clarkb | Shuo: beacuse change 1 is present in testing of all three changes, change 2 is present in testing of change 2 and 3, and change 3 is only present when testing change 3 | 20:45 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/project-config: Restrict nova-net grenade jobs to <= Newton https://review.openstack.org/393400 | 20:45 |
| clarkb | Shuo: beacuse that is the order of the speculative future | 20:45 |
| Shuo | clarkb: my question is that why we needed more alias for "acme master + change 1" (my guess is that it will be used in more tests?) | 20:45 |
| clarkb | Shuo: because each change si given a string to find refs at (in the ZUUL_REF env var) that is unique to each change so you have to alias back to anything in the earlier speculative futuer history | 20:46 |
| *** baoli__ has quit IRC | 20:47 | |
| *** hamzy has quit IRC | 20:48 | |
| Shuo | clarkb: in this particular use case, how many permutations the zuul will insert into the speculative queue as test jobs? | 20:48 |
| *** baoli has joined #openstack-infra | 20:49 | |
| clarkb | Shuo: as jobs that is entirely up to how each of those projects has configured its jobs. That isn't specified in the example as the example only cares about what the git state looks like | 20:50 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/project-config: Restrict gate-tempest-dsvm-multinode-full-ubuntu-xenial to Newton https://review.openstack.org/395793 | 20:50 |
| clarkb | in the example 6 git refs will be created to test those three changes | 20:50 |
| clarkb | each change may run an arbitrary number of jobs | 20:50 |
| *** baoli_ has joined #openstack-infra | 20:50 | |
| Shuo | clarkb: yeah, I must have used a wrong term (my 'job' probably is different what you refer to as 'job') | 20:51 |
| *** baoli__ has joined #openstack-infra | 20:51 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Add pip install requests[security] package https://review.openstack.org/395794 | 20:51 |
| clarkb | Shuo: in Zuul lingo a "job" is the entity that runs tests. Each job may pass or fail | 20:52 |
| clarkb | Shuo: so you can have a unittest job, and a functional test job, and integration test jobs or however you want to organize it | 20:52 |
| clarkb | actually zuul may properly call those a "build" but I think we have used them interchangeably | 20:53 |
| *** evgenyf has joined #openstack-infra | 20:53 | |
| *** baoli has quit IRC | 20:54 | |
| Shuo | clarkb: what the column 'change' mean here? I see for the same des of "acme master + change 1", which is the source of truth of a commit, got 3 different "change" ID, which are 1, 2, 3 | 20:54 |
| clarkb | Shuo: changes are units of review in gerrit | 20:55 |
| clarkb | they also happen to a a git commit | 20:55 |
| *** baoli_ has quit IRC | 20:55 | |
| clarkb | s/to a a/to be a/ | 20:55 |
| *** psanchez has quit IRC | 20:56 | |
| *** slagle has quit IRC | 20:57 | |
| *** stevebaker has quit IRC | 20:57 | |
| *** cschwede has quit IRC | 20:57 | |
| *** adrian_otto has joined #openstack-infra | 20:58 | |
| *** kzaitsev_mb has joined #openstack-infra | 20:59 | |
| Shuo | clarkb: I am confused here. There are two tables, one is a 3 row table and the other is a 6 rows table. Both tables has 3 Change IDs. But there are 3 rows for Change3 in the 2nd table, does those three rows represent a single commit and review? | 20:59 |
| clarkb | Shuo: they represent 3 git commits identified by the zuul refs | 21:00 |
| clarkb | Shuo: first table is just the change setup and order | 21:00 |
| clarkb | Shuo: second table is what zuul refs are created by zuul to enable the testing of those changes | 21:00 |
| Shuo | clarkb: as a developer, my view of the world should be table 1, right? | 21:00 |
| Shuo | clarkb: table 2 is the zuul's view of the world, correct? | 21:01 |
| clarkb | Shuo: its both if you want to understand how things are being tested, but table one is the more visible thing you interact with often | 21:01 |
| clarkb | Shuo: yes | 21:01 |
| *** mhayden has quit IRC | 21:02 | |
| Shuo | clarkb: running to the meeting, will come back to this topic later. Many thanks | 21:02 |
| Shuo | fungi: thanks as well. | 21:02 |
| *** askb has joined #openstack-infra | 21:03 | |
| *** EricGonczer_ has quit IRC | 21:03 | |
| nibalizer | fungi: it should | 21:04 |
| *** baoli__ has quit IRC | 21:07 | |
| fungi | per #openstack-dev ask.o.o is now suddenly throwing internal server errors | 21:07 |
| *** rbuzatu has quit IRC | 21:07 | |
| *** baoli has joined #openstack-infra | 21:08 | |
| *** thcipriani|afk is now known as thcipriani | 21:08 | |
| *** fguillot has quit IRC | 21:09 | |
| *** aeng has joined #openstack-infra | 21:12 | |
| fungi | i'm pretty well in over my head on this askbot upgrade, so going to revert until mrmartin is around to help me figure out why it's going off the rails | 21:13 |
| *** rtheis has quit IRC | 21:14 | |
| dhellmann | clarkb, jeblair : I have a patch series with 15 members. At what point does a long series like that start to trigger the performance issues we've seen in zuul in the past? | 21:15 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Revert "Update ask.o.o to latest 0.7.x branch" https://review.openstack.org/395797 | 21:16 |
| jeblair | dhellmann: i want to say much longer than that? | 21:16 |
| clarkb | fungi: roger | 21:17 |
| dhellmann | jeblair : ok. I think this is probably the longest series I've personally done in quite a while, so I wanted to check first | 21:17 |
| clarkb | the one we ran into trouble on was like 200 long | 21:17 |
| clarkb | dhellmann: ^ | 21:17 |
| * dhellmann crosses his fingers and toes | 21:17 | |
| jeblair | dhellmann, clarkb: the recent indicence that comes to mind was more like 100+ i want to say? | 21:17 |
| clarkb | jeblair: ya it was ~200 iirc | 21:17 |
| *** adriant has joined #openstack-infra | 21:17 | |
| jeblair | or what clarkb said :) | 21:17 |
| jeblair | thank goodness i put that '+' on there | 21:17 |
| dhellmann | ok, if this series grows that long I'll never get ttx to review it | 21:17 |
| dhellmann | series submitted, let's see how things go | 21:18 |
| *** hurgleburgler has joined #openstack-infra | 21:19 | |
| jeblair | clarkb: a build is a single execution of a job. so 'gate-python27' is a job. when it ran on november 9 at 21:18 on change 3, that was a build. | 21:20 |
| clarkb | there we go | 21:20 |
| * jeblair notes to add to zuul glossary | 21:21 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: POC: Use tripleo-repos in tripleo.sh https://review.openstack.org/395813 | 21:23 |
| *** gouthamr has quit IRC | 21:24 | |
| *** Goneri has quit IRC | 21:26 | |
| tonyb | Can someone with IRC rights change the topic in #openstack-requirements? We moved the meeting time and woudl like to s/1200/1000/ | 21:27 |
| *** aneliubin has quit IRC | 21:27 | |
| *** yamahata has quit IRC | 21:27 | |
| *** asettle has joined #openstack-infra | 21:28 | |
| *** cschwede has joined #openstack-infra | 21:28 | |
| *** psanchez has joined #openstack-infra | 21:28 | |
| openstackgerrit | Merged openstack-infra/system-config: Revert "Update ask.o.o to latest 0.7.x branch" https://review.openstack.org/395797 | 21:29 |
| *** wolverineav has quit IRC | 21:30 | |
| *** slagle has joined #openstack-infra | 21:31 | |
| *** gouthamr has joined #openstack-infra | 21:31 | |
| *** wolverineav has joined #openstack-infra | 21:31 | |
| fungi | for some reason, when ansible-file writes to the syslog, it does so with really outdated timestamps | 21:33 |
| jhesketh | Morning | 21:33 |
| fungi | just saw a puppet run where ansible-file reported log entries from october 23 and november 5 and 6 | 21:33 |
| *** asettle has quit IRC | 21:33 | |
| *** Jeffrey4l has quit IRC | 21:34 | |
| *** jkilpatr has quit IRC | 21:34 | |
| *** stevebaker has joined #openstack-infra | 21:34 | |
| *** wolverineav has quit IRC | 21:36 | |
| *** edmondsw has quit IRC | 21:37 | |
| nibalizer | fungi: yea so if we have commit => 'abaaba' and ensure => present, with the git_resource, it will set it to that commit | 21:37 |
| nibalizer | event if it was previously checked out to a tag or whatever | 21:37 |
| nibalizer | there is also a bug on master that makes the module not work, so woo finding that | 21:38 |
| *** fguillot has joined #openstack-infra | 21:38 | |
| bkero | oh vcsrepo | 21:39 |
| *** wolverineav has joined #openstack-infra | 21:40 | |
| clarkb | I don't think this is vcsrepo | 21:40 |
| clarkb | its the other thing that was suppsoed to be better | 21:40 |
| clarkb | (but I guess isn't?) | 21:40 |
| openstackgerrit | Nate Johnston proposed openstack-infra/irc-meetings: Change time for the FWaaS team meeting. https://review.openstack.org/393793 | 21:41 |
| fungi | nibalizer: thanks for confirming, there might be some other reason the git resource commit change for ask.o.o to puppet-askbot never registered | 21:41 |
| clarkb | maybe it doesn't do a proper git update to ensure the ref is present? | 21:42 |
| *** kgiusti has left #openstack-infra | 21:43 | |
| nibalizer | what's the issue? | 21:44 |
| *** wolverineav has quit IRC | 21:44 | |
| smcginnis | Would really love some feedback to move this forward: https://review.openstack.org/#/c/393481/ :) | 21:44 |
| *** hamzy has joined #openstack-infra | 21:44 | |
| fungi | nibalizer: 274032 landed, but /srv/dist/askbot never updated to the specified commit, and remained at the old one | 21:45 |
| nibalizer | ok | 21:45 |
| fungi | could be a problem with default inheritance or something i guess | 21:46 |
| nibalizer | i wonder if latest=> true is the issue? | 21:47 |
| *** ijw has joined #openstack-infra | 21:48 | |
| fungi | oh, indeed it does have that hard-coded in the askbot base class | 21:48 |
| *** harlowja has joined #openstack-infra | 21:49 | |
| fungi | it's at best irrelevant if you're specifying a commit or tag, from what i saw in the provider implementation | 21:49 |
| *** thorst_ has quit IRC | 21:49 | |
| fungi | but maybe it's actively suppressing things | 21:49 |
| *** amotoki has joined #openstack-infra | 21:50 | |
| nibalizer | im noticing we pass _repo and _revision into askbot::install, then don't seem to do anything with them once they're in there | 21:51 |
| *** evgenyf has quit IRC | 21:51 | |
| fungi | i wonder if they're used in templates | 21:51 |
| *** jeckersb is now known as jeckersb_gone | 21:52 | |
| *** amotoki has quit IRC | 21:53 | |
| *** asilenkov has quit IRC | 21:56 | |
| *** ijw has quit IRC | 21:56 | |
| *** rossella_s has joined #openstack-infra | 21:58 | |
| *** jkilpatr has joined #openstack-infra | 21:58 | |
| *** sree has joined #openstack-infra | 22:00 | |
| *** asilenkov has joined #openstack-infra | 22:00 | |
| *** wolverineav has joined #openstack-infra | 22:00 | |
| *** kzaitsev_mb has quit IRC | 22:02 | |
| *** kzaitsev_mb has joined #openstack-infra | 22:02 | |
| *** ijw has joined #openstack-infra | 22:02 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: POC: Use tripleo-repos in tripleo.sh https://review.openstack.org/395813 | 22:02 |
| *** jcoufal_ has quit IRC | 22:02 | |
| *** gouthamr has quit IRC | 22:03 | |
| johnsom | Hi infra folks. Would anyone know of something that changed between the 1st and 4th of November that would cause nova to fail to boot vms inside scenario test gates? I can't reproduce it locally. | 22:03 |
| *** jheroux has quit IRC | 22:04 | |
| *** sree has quit IRC | 22:04 | |
| *** tpsilva has quit IRC | 22:04 | |
| *** tiswanso has quit IRC | 22:04 | |
| *** wolverineav has quit IRC | 22:05 | |
| *** fguillot has quit IRC | 22:07 | |
| *** ijw has quit IRC | 22:07 | |
| *** matt-borland has quit IRC | 22:07 | |
| *** baoli has quit IRC | 22:09 | |
| *** sdake has quit IRC | 22:09 | |
| *** rodrigods has quit IRC | 22:11 | |
| *** rodrigods has joined #openstack-infra | 22:11 | |
| asselin__ | any puppet-cores around with time to review patches in openstack-infra/puppet-bandersnatch ? | 22:12 |
| asselin__ | they're all pretty straight forward | 22:12 |
| *** wolverineav has joined #openstack-infra | 22:12 | |
| jlvillal | So what is the solution to this patch? https://review.openstack.org/#/c/374147/ Submitted, Merge Pending. | 22:13 |
| jlvillal | But I see over on the side "Cannot Merge" | 22:13 |
| jlvillal | jeblair, Have you seen something like that before? ^^^ | 22:13 |
| jlvillal | I would have thought it would have failed and said "merge conflict" or something. If that is the reason. | 22:14 |
| jlvillal | I was able to do a "git cherry-pick" without issues of that patch though. I'm confused. | 22:15 |
| *** hashar has quit IRC | 22:16 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Re-enable test_live_reconfiguration test https://review.openstack.org/393488 | 22:16 |
| mordred | jlvillal: gerrit uses jgit, which sometimes has a harder time merging things than cgit | 22:17 |
| *** wolverineav has quit IRC | 22:17 | |
| mordred | jlvillal: you may just need to rebase the patch so that gerrit doesn't have the confuses | 22:17 |
| *** panda|soso is now known as panda|zZ | 22:17 | |
| jlvillal | mordred, Okay. I will do a rebase. Thanks. | 22:18 |
| *** baoli has joined #openstack-infra | 22:18 | |
| *** gouthamr has joined #openstack-infra | 22:18 | |
| jlvillal | mordred, When I did click the "rebase" button I got this: Code Review - Error | 22:19 |
| jlvillal | Unable to create new object: /home/gerrit2/review_site/git/openstack/ironic-python-agent.git/objects/63/83732095bdb0fbf2a2690dbc5f08c5c2bb7362 | 22:19 |
| jlvillal | Not sure if that is a worrisome error or not. Or just means I should do the rebase locally. | 22:19 |
| *** mriedem has quit IRC | 22:19 | |
| jlvillal | I thought I would ask though. | 22:19 |
| mordred | uhm | 22:20 |
| jlvillal | My gut feeling is that it isn't good. | 22:20 |
| mordred | ok. we're not out of space on gerrit :) | 22:20 |
| jlvillal | But I'm willing to rebase locally and push it, if desired. | 22:21 |
| mordred | clarkb, fungi : /home/gerrit2/review_site/git/openstack/ironic-python-agent.git/objects/63 is ... | 22:21 |
| mordred | drwxr-xr-x 2 root root 4096 Aug 13 12:22 . | 22:21 |
| mordred | clarkb, fungi: which doesn't seem ... correct. any reason you can think of that we might have a subdir that has root ownership there? | 22:21 |
| clarkb | that means jgit cant resolve the conflict | 22:21 |
| clarkb | and is the source of the issue | 22:21 |
| clarkb | jlvillal: ^ | 22:21 |
| jlvillal | clarkb, Okay. So I should just rebase locally and push then. | 22:22 |
| jlvillal | mordred, clarkb Thanks. | 22:22 |
| mordred | clarkb: ok. cool | 22:22 |
| clarkb | mordred: though as for why root... | 22:22 |
| mordred | clarkb: but also - why are there things in /home/gerrit2/review_site/git/openstack/ironic-python-agent.git/objects owned by root? | 22:22 |
| clarkb | maybe thats anunderlying causr to the jgit problrm? | 22:22 |
| mordred | yah | 22:22 |
| *** wolverineav has joined #openstack-infra | 22:22 | |
| clarkb | I dunno why any would be owned by root | 22:22 |
| mordred | I mean - the directory is only writable by root | 22:22 |
| *** edtubill has quit IRC | 22:23 | |
| jlvillal | Seems wrong to me... | 22:23 |
| mordred | clarkb: there are some things owned by root in general | 22:23 |
| mordred | mordred@review:~$ find /home/gerrit2/review_site/git/openstack -user root -type d | wc -l | 22:24 |
| mordred | 2670 | 22:24 |
| mordred | mordred@review:~$ find /home/gerrit2/review_site/git/openstack -user gerrit2 -type d | wc -l | 22:24 |
| mordred | 90069 | 22:24 |
| *** baoli has quit IRC | 22:24 | |
| mordred | each of the dirs owned by root is a top-level hash dir | 22:24 |
| mordred | like /home/gerrit2/review_site/git/openstack/puppet-openstacklib.git/objects/6b | 22:24 |
| *** tammy5 has joined #openstack-infra | 22:24 | |
| clarkb | ah | 22:25 |
| clarkb | repack/gcthen maybe | 22:25 |
| mordred | jlvillal: have you pushed a new thing yet? | 22:25 |
| jlvillal | mordred, Yep | 22:25 |
| mordred | darn | 22:25 |
| fungi | that seems like maybe we're doing repack/gc as root when we should be doing it as gerrit2? | 22:25 |
| jlvillal | Sorry. I thought I had the go-ahead. | 22:25 |
| mordred | jlvillal: no - you're great | 22:25 |
| fungi | or maybe we did at one time and never cleaned up the mess | 22:25 |
| mordred | I was going to abuse your test case | 22:25 |
| jlvillal | heh | 22:25 |
| clarkb | fungi: ya | 22:26 |
| *** baoli has joined #openstack-infra | 22:26 | |
| mordred | how funny would it be if the occasional jgit can't merge errors are just this? | 22:26 |
| *** baoli has quit IRC | 22:26 | |
| jlvillal | Funny awkward = sure. funny funny, probably not so much ;) | 22:26 |
| mordred | "funny" | 22:26 |
| mordred | yah | 22:26 |
| mordred | I mean, definitely not ha-ha funny | 22:26 |
| *** wolverineav has quit IRC | 22:27 | |
| mordred | fungi, clarkb: any issue with chowning them? | 22:27 |
| mordred | or should I leave it for now for futher investigation? | 22:27 |
| fungi | less funny "ha-ha" and more funny "uh-oh" | 22:27 |
| mordred | I can think of no reasons for anything in /home/gerrit2/review_site/git to be owned by anyone other than gerrit2:gerrit2 | 22:27 |
| fungi | mordred: i would chown them to gerrit2:gerrit2 yes, and double-check root's crontab while in there | 22:28 |
| mordred | sudo chmod -R gerrit2:gerrit2 /home/gerrit2/review_site/git # double check me? | 22:28 |
| mordred | fungi: ^^ (check me?) | 22:29 |
| fungi | chown | 22:29 |
| fungi | not chmod | 22:29 |
| mordred | thank you | 22:29 |
| fungi | otherwise lgtm | 22:29 |
| *** tiswanso has joined #openstack-infra | 22:30 | |
| mordred | running | 22:30 |
| fungi | may take a while | 22:30 |
| *** tiswanso has quit IRC | 22:30 | |
| *** tiswanso has joined #openstack-infra | 22:30 | |
| mordred | fungi: I don't see any things in root's crontab for doing repacks | 22:30 |
| *** tiswanso has quit IRC | 22:30 | |
| fungi | okay, so probably historical cruft | 22:30 |
| mordred | fungi: yah - although from Aug 13 | 22:31 |
| *** tiswanso has joined #openstack-infra | 22:31 | |
| mordred | did we do a manual something back then or something? | 22:31 |
| * mordred can't remember august | 22:31 | |
| fungi | that could reflect the date something changed within it | 22:31 |
| mordred | but nothing could change in it - because it was owned by root | 22:32 |
| *** wolverineav has joined #openstack-infra | 22:32 | |
| mordred | the chown is done | 22:32 |
| mordred | jlvillal: thanks, btw | 22:32 |
| mordred | mordred@review:~$ find /home/gerrit2/review_site/git/openstack -user root -type d | wc -l | 22:33 |
| fungi | yeah, dunno if a change in a non-root-owned subdir of it could be reflected there, but i agree august seems pretty recent | 22:33 |
| mordred | 0 | 22:33 |
| mordred | woot | 22:33 |
| *** dtardivel has quit IRC | 22:34 | |
| *** berendt has quit IRC | 22:36 | |
| *** wolverineav has quit IRC | 22:36 | |
| *** gildub has joined #openstack-infra | 22:37 | |
| *** yamahata has joined #openstack-infra | 22:37 | |
| *** jeckersb_gone is now known as jeckersb | 22:38 | |
| clarkb | anyone worling on a fix for gcing? | 22:39 |
| *** thorst_ has joined #openstack-infra | 22:39 | |
| clarkb | assuming that runs as root | 22:39 |
| *** tammy5 has quit IRC | 22:39 | |
| jlvillal | mordred, Glad to help. Thanks for helping me :) | 22:40 |
| *** gyee has joined #openstack-infra | 22:41 | |
| mordred | clarkb: I did not find a gc root cron | 22:41 |
| *** edtubill has joined #openstack-infra | 22:41 | |
| *** wolverineav has joined #openstack-infra | 22:42 | |
| *** mdrabe has quit IRC | 22:42 | |
| *** wolverin_ has joined #openstack-infra | 22:42 | |
| *** spzala has quit IRC | 22:44 | |
| clarkb | ya looks like user is setto gerrit2in the cronsI find inpuppet | 22:44 |
| *** spzala has joined #openstack-infra | 22:45 | |
| *** mdrabe has joined #openstack-infra | 22:45 | |
| *** wolverineav has quit IRC | 22:46 | |
| mordred | yup. that's what I'm finding too | 22:46 |
| *** spzala_ has joined #openstack-infra | 22:47 | |
| *** wolverin_ has quit IRC | 22:47 | |
| *** chlong has quit IRC | 22:47 | |
| *** rhallisey has quit IRC | 22:48 | |
| *** spzala has quit IRC | 22:49 | |
| johnsom | FYI, found the issue with some gerrit digging, DIB changed over to xenial images by default. | 22:50 |
| *** esikachev has quit IRC | 22:50 | |
| *** spzala_ has quit IRC | 22:51 | |
| *** wolverineav has joined #openstack-infra | 22:52 | |
| *** ijw has joined #openstack-infra | 22:53 | |
| *** e0ne has joined #openstack-infra | 22:53 | |
| *** wolverineav has quit IRC | 22:57 | |
| *** adrian_otto has quit IRC | 22:57 | |
| *** ijw has quit IRC | 22:57 | |
| *** tiswanso has quit IRC | 22:57 | |
| *** Swami has quit IRC | 22:58 | |
| *** ijw has joined #openstack-infra | 22:59 | |
| *** edtubill has quit IRC | 23:00 | |
| openstackgerrit | Khai Do proposed openstack-infra/infra-specs: Gerrit upgrade https://review.openstack.org/388190 | 23:02 |
| openstackgerrit | Khai Do proposed openstack-infra/infra-specs: add gerrit-upgrade to priority efforts query https://review.openstack.org/388202 | 23:02 |
| *** wolverineav has joined #openstack-infra | 23:02 | |
| *** xyang1 has quit IRC | 23:03 | |
| *** ijw has quit IRC | 23:03 | |
| *** e0ne has quit IRC | 23:04 | |
| *** gyee has quit IRC | 23:04 | |
| *** wolverineav has quit IRC | 23:06 | |
| *** harlowja_ has joined #openstack-infra | 23:08 | |
| *** sdake has joined #openstack-infra | 23:09 | |
| *** harlowja has quit IRC | 23:12 | |
| *** wolverineav has joined #openstack-infra | 23:12 | |
| openstackgerrit | Khai Do proposed openstack-infra/project-config: rename 'tox' macro to 'run-tox' https://review.openstack.org/393927 | 23:12 |
| *** spzala has joined #openstack-infra | 23:16 | |
| *** wolverineav has quit IRC | 23:17 | |
| *** asettle has joined #openstack-infra | 23:17 | |
| clarkb | tsufiev: so reading that selenium bug they claim its fixed | 23:17 |
| clarkb | tsufiev: I am really confused, if selenium and firefox are both updated (not sure why they wouldn't be) then why are we broken? | 23:17 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Make a private method more privater https://review.openstack.org/395867 | 23:18 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Make search_projects a special case of list_projects https://review.openstack.org/395868 | 23:18 |
| *** mdrabe has quit IRC | 23:18 | |
| *** ijw has joined #openstack-infra | 23:20 | |
| *** spzala has quit IRC | 23:21 | |
| *** gordc has quit IRC | 23:22 | |
| *** wolverineav has joined #openstack-infra | 23:22 | |
| ianw | clarkb: nodepool is out of disk again. looking now | 23:22 |
| clarkb | ianw: looks like we have ~26 images when we should only have ~14? | 23:24 |
| clarkb | we are leaking them somehow | 23:24 |
| ianw | well we have 448 building images to start | 23:24 |
| clarkb | hrm so we aren't uploading within 24 hours and those are all piling up | 23:25 |
| ianw | i think we're not getting images uploaded before the next lot starts and that gums up the works | 23:25 |
| clarkb | which may be preventing the deletes from running? | 23:25 |
| *** maeker_ has quit IRC | 23:25 | |
| clarkb | ianw: a | 23:25 |
| clarkb | *ya | 23:25 |
| *** rossella_s has quit IRC | 23:25 | |
| *** maeker has joined #openstack-infra | 23:26 | |
| ianw | i can do the same as the other day, cancel all current builds and remove images not in the dib-image-list | 23:26 |
| *** wolverineav has quit IRC | 23:26 | |
| ianw | that will get us back to a blank slate at least | 23:26 |
| ianw | http://paste.openstack.org/show/588626/ <- du results, as expected nothing "odd" | 23:27 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Stop uploading images to demo european clouds https://review.openstack.org/394675 | 23:28 |
| openstackgerrit | Alexandra Settle proposed openstack-infra/project-config: Adds deploy guide gate jobs https://review.openstack.org/391499 | 23:28 |
| clarkb | ianw: ^ and maybe get that in to reduce jupload overhead | 23:28 |
| *** gmann has joined #openstack-infra | 23:28 | |
| ianw | clarkb: yep, ok ... i'll clear everything out, and then we can merge that and try again | 23:28 |
| clarkb | ianw: sounds good | 23:28 |
| *** asettle has quit IRC | 23:30 | |
| *** Jeffrey4l has joined #openstack-infra | 23:31 | |
| *** thorst_ has quit IRC | 23:32 | |
| *** wolverineav has joined #openstack-infra | 23:32 | |
| *** Jeffrey4l has quit IRC | 23:32 | |
| *** thorst_ has joined #openstack-infra | 23:32 | |
| *** Jeffrey4l has joined #openstack-infra | 23:32 | |
| *** Jeffrey4l has quit IRC | 23:33 | |
| *** Jeffrey4l has joined #openstack-infra | 23:34 | |
| *** gmann has quit IRC | 23:34 | |
| *** wolverineav has quit IRC | 23:36 | |
| *** armax has joined #openstack-infra | 23:37 | |
| *** thorst_ has quit IRC | 23:40 | |
| *** gmann has joined #openstack-infra | 23:41 | |
| *** wolverineav has joined #openstack-infra | 23:41 | |
| *** Swami has joined #openstack-infra | 23:44 | |
| openstackgerrit | Merged openstack-infra/project-config: Stop uploading images to demo european clouds https://review.openstack.org/394675 | 23:44 |
| ianw | clarkb: ok, even just the active images are 515G it seems, so we're pretty tight | 23:46 |
| *** Swami_ has joined #openstack-infra | 23:46 | |
| *** wolverineav has quit IRC | 23:46 | |
| ianw | that vhd conversion process is rather terrible, i think it balloons like 3 times the size during conversion | 23:46 |
| ianw | i remember thinking last christmas time "i should look into that" :( | 23:46 |
| ianw | if anyone's interested in some reviews of https://review.openstack.org/#/q/topic:image-log-split i'd be happy to deploy it so we're getting individual upload logs too | 23:48 |
| clarkb | vhd has raw, copy of raw,and vhd iirc | 23:48 |
| clarkb | so ya pretty ineffiicnet | 23:48 |
| *** dingyichen has joined #openstack-infra | 23:49 | |
| *** gmann has quit IRC | 23:49 | |
| *** camunoz has joined #openstack-infra | 23:51 | |
| *** wolverineav has joined #openstack-infra | 23:51 | |
| *** gmann has joined #openstack-infra | 23:52 | |
| ianw | ok, going to try a f24 build to see where that's at, then maybe can try a targeted upload | 23:53 |
| *** netsin has quit IRC | 23:53 | |
| *** masuberu has joined #openstack-infra | 23:54 | |
| *** wolverineav has quit IRC | 23:55 | |
| *** masber has quit IRC | 23:56 | |
| *** wolverineav has joined #openstack-infra | 23:56 | |
| *** maeker has quit IRC | 23:57 | |
| *** dfflanders has joined #openstack-infra | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!