| *** markvoelker has quit IRC | 00:00 | |
| *** zeih has quit IRC | 00:00 | |
| *** MarkAtwood has quit IRC | 00:01 | |
| *** weshay has quit IRC | 00:09 | |
| *** dizquierdo has quit IRC | 00:12 | |
| *** zeih has joined #openstack-infra | 00:14 | |
| *** kzaitsev_mb has quit IRC | 00:14 | |
| *** zeih has quit IRC | 00:19 | |
| *** zz_dimtruck is now known as dimtruck | 00:23 | |
| *** zeih has joined #openstack-infra | 00:23 | |
| *** gildub has joined #openstack-infra | 00:24 | |
| *** dims_ has joined #openstack-infra | 00:27 | |
| *** zeih has quit IRC | 00:27 | |
| *** dims has quit IRC | 00:28 | |
| *** dims has joined #openstack-infra | 00:33 | |
| *** harlowja_at_home has joined #openstack-infra | 00:33 | |
| *** dims_ has quit IRC | 00:33 | |
| *** dimtruck is now known as zz_dimtruck | 00:39 | |
| *** zeih has joined #openstack-infra | 00:41 | |
| *** zeih has quit IRC | 00:45 | |
| *** jpr has joined #openstack-infra | 00:50 | |
| *** zeih has joined #openstack-infra | 00:50 | |
| *** chlong has quit IRC | 00:51 | |
| *** takashi has joined #openstack-infra | 00:51 | |
| *** |-paul-| has quit IRC | 00:54 | |
| *** david-lyle has quit IRC | 00:54 | |
| *** zeih has quit IRC | 00:54 | |
| *** david-lyle has joined #openstack-infra | 00:54 | |
| *** Qiming has joined #openstack-infra | 00:58 | |
| *** GnomeKin1 has quit IRC | 01:06 | |
| *** chlong has joined #openstack-infra | 01:06 | |
| *** GnomeKin1 has joined #openstack-infra | 01:08 | |
| *** dalgaaf has quit IRC | 01:08 | |
| *** zeih has joined #openstack-infra | 01:09 | |
| *** MarkAtwood has joined #openstack-infra | 01:10 | |
| *** kzaitsev_mb has joined #openstack-infra | 01:11 | |
| *** zeih has quit IRC | 01:13 | |
| *** akshai has quit IRC | 01:14 | |
| ianw | greghaynes: oh, i thought https://review.openstack.org/#/c/290956/ went through. it's rather trivial | 01:21 |
|---|---|---|
| *** zeih has joined #openstack-infra | 01:27 | |
| *** Qiming has quit IRC | 01:30 | |
| *** zeih has quit IRC | 01:31 | |
| *** rhallisey has quit IRC | 01:34 | |
| *** _amrith_ is now known as amrith | 01:35 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-openafs: Use CI built RPMs for CentOS7 https://review.openstack.org/290266 | 01:36 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Revert "Add CentOS AFS build job to project-config experimental" https://review.openstack.org/291403 | 01:38 |
| *** sdake has joined #openstack-infra | 01:41 | |
| *** EricGonczer_ has quit IRC | 01:43 | |
| *** _nadya_ has joined #openstack-infra | 01:45 | |
| *** tphummel has quit IRC | 01:47 | |
| *** tsg has joined #openstack-infra | 01:49 | |
| *** _nadya_ has quit IRC | 01:50 | |
| *** Sukhdev has joined #openstack-infra | 01:51 | |
| *** bryan_att has quit IRC | 01:52 | |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Add CentOS AFS build job to project-config experimental" https://review.openstack.org/291403 | 01:53 |
| *** zeih has joined #openstack-infra | 01:53 | |
| *** Sukhdev has quit IRC | 01:53 | |
| *** Sukhdev has joined #openstack-infra | 01:54 | |
| *** markvoelker has joined #openstack-infra | 01:56 | |
| *** tzn has quit IRC | 01:57 | |
| *** zhenguo_ has joined #openstack-infra | 01:58 | |
| *** Daisy has joined #openstack-infra | 01:58 | |
| *** zeih has quit IRC | 01:59 | |
| *** Daisy has quit IRC | 01:59 | |
| *** kzaitsev_mb has quit IRC | 01:59 | |
| *** Daisy has joined #openstack-infra | 02:00 | |
| *** thorst has joined #openstack-infra | 02:00 | |
| *** markvoelker has quit IRC | 02:00 | |
| *** baoli has joined #openstack-infra | 02:00 | |
| *** nwkarsten has quit IRC | 02:01 | |
| *** nwkarsten has joined #openstack-infra | 02:01 | |
| *** hdd has quit IRC | 02:01 | |
| *** Daisy has quit IRC | 02:02 | |
| *** Daisy_ has joined #openstack-infra | 02:02 | |
| *** zeih has joined #openstack-infra | 02:03 | |
| *** thorst has quit IRC | 02:05 | |
| *** zz_dimtruck is now known as dimtruck | 02:05 | |
| *** nwkarsten has quit IRC | 02:05 | |
| *** Qiming has joined #openstack-infra | 02:07 | |
| *** zeih has quit IRC | 02:07 | |
| *** chlong has quit IRC | 02:07 | |
| *** dims has quit IRC | 02:07 | |
| openstackgerrit | Sam Yaple proposed openstack-infra/project-config: Do not run gate jobs when doing docs-only patch https://review.openstack.org/292187 | 02:07 |
| *** IlyaG has joined #openstack-infra | 02:07 | |
| *** MarkAtwood has quit IRC | 02:09 | |
| *** rkukura has quit IRC | 02:10 | |
| *** IlyaG has quit IRC | 02:12 | |
| *** camunoz has joined #openstack-infra | 02:13 | |
| *** jpr has quit IRC | 02:13 | |
| *** rguillebert has quit IRC | 02:17 | |
| *** ajmiller has quit IRC | 02:18 | |
| *** tsg has quit IRC | 02:18 | |
| *** chlong has joined #openstack-infra | 02:20 | |
| *** dims has joined #openstack-infra | 02:21 | |
| *** zeih has joined #openstack-infra | 02:21 | |
| *** amrith is now known as _amrith_ | 02:23 | |
| openstackgerrit | Sam Yaple proposed openstack-infra/project-config: Do not run gate jobs when doing docs-only patch https://review.openstack.org/292187 | 02:25 |
| *** zeih has quit IRC | 02:25 | |
| *** [1]Thelo has joined #openstack-infra | 02:32 | |
| *** Thelo has quit IRC | 02:34 | |
| *** [1]Thelo is now known as Thelo | 02:34 | |
| *** zeih has joined #openstack-infra | 02:39 | |
| *** sbalukoff has joined #openstack-infra | 02:40 | |
| *** akshai has joined #openstack-infra | 02:40 | |
| *** dims has quit IRC | 02:41 | |
| *** zeih has quit IRC | 02:44 | |
| *** sbalukoff has quit IRC | 02:52 | |
| *** yamamoto has quit IRC | 02:55 | |
| *** kzaitsev_mb has joined #openstack-infra | 02:55 | |
| *** rkukura has joined #openstack-infra | 02:57 | |
| *** zeih has joined #openstack-infra | 02:58 | |
| *** akshai_ has joined #openstack-infra | 02:59 | |
| *** kzaitsev_mb has quit IRC | 03:01 | |
| *** sdake has quit IRC | 03:01 | |
| *** zeih has quit IRC | 03:02 | |
| *** dimtruck is now known as zz_dimtruck | 03:02 | |
| *** akshai has quit IRC | 03:02 | |
| *** baoli has quit IRC | 03:03 | |
| *** baoli has joined #openstack-infra | 03:04 | |
| *** zz_dimtruck is now known as dimtruck | 03:12 | |
| *** zhurong_ has joined #openstack-infra | 03:14 | |
| *** zeih has joined #openstack-infra | 03:15 | |
| *** asettle has quit IRC | 03:20 | |
| *** zeih has quit IRC | 03:20 | |
| *** asettle has joined #openstack-infra | 03:20 | |
| *** chlong has quit IRC | 03:22 | |
| *** zeih has joined #openstack-infra | 03:25 | |
| openstackgerrit | Merged openstack/diskimage-builder: centos-minimal does not provide base https://review.openstack.org/290956 | 03:27 |
| *** zeih has quit IRC | 03:29 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add releasenotes https://review.openstack.org/292193 | 03:30 |
| ianw | greghaynes: if that looks good, i think we should add that before release | 03:30 |
| ianw | greghaynes: ^^ | 03:30 |
| *** Sukhdev has quit IRC | 03:32 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add releasenotes https://review.openstack.org/292193 | 03:34 |
| prometheanfire | ianw: have a sec? | 03:34 |
| prometheanfire | ianw: https://review.openstack.org/#/c/290894/ | 03:34 |
| SamYaple | prometheanfire: go to bed! you have work in the morning | 03:34 |
| *** akshai_ has quit IRC | 03:34 | |
| prometheanfire | sure I do | 03:34 |
| *** IlyaG has joined #openstack-infra | 03:38 | |
| *** chlong has joined #openstack-infra | 03:41 | |
| *** IlyaG has quit IRC | 03:43 | |
| *** zeih has joined #openstack-infra | 03:43 | |
| *** asettle has quit IRC | 03:44 | |
| *** dkehn has quit IRC | 03:45 | |
| *** _nadya_ has joined #openstack-infra | 03:46 | |
| *** nwkarsten has joined #openstack-infra | 03:47 | |
| *** zeih has quit IRC | 03:47 | |
| *** links has joined #openstack-infra | 03:50 | |
| *** _nadya_ has quit IRC | 03:50 | |
| *** dkehn has joined #openstack-infra | 03:51 | |
| *** hrubi has quit IRC | 03:51 | |
| *** dimtruck is now known as zz_dimtruck | 03:52 | |
| *** Sukhdev has joined #openstack-infra | 03:53 | |
| *** hrubi has joined #openstack-infra | 03:53 | |
| *** yamamoto has joined #openstack-infra | 03:56 | |
| *** markvoelker has joined #openstack-infra | 03:57 | |
| *** kzaitsev_mb has joined #openstack-infra | 03:57 | |
| *** ajmiller has joined #openstack-infra | 04:00 | |
| *** ekarlso- has quit IRC | 04:00 | |
| *** baoli has quit IRC | 04:01 | |
| *** zeih has joined #openstack-infra | 04:01 | |
| *** markvoelker has quit IRC | 04:01 | |
| *** kzaitsev_mb has quit IRC | 04:02 | |
| *** mtanino has quit IRC | 04:02 | |
| *** ajmiller_ has joined #openstack-infra | 04:02 | |
| *** harlowja_at_home has quit IRC | 04:04 | |
| *** zeih has quit IRC | 04:06 | |
| *** ajmiller has quit IRC | 04:06 | |
| *** andymaier has joined #openstack-infra | 04:07 | |
| *** Daisy_ has quit IRC | 04:08 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add releasenotes https://review.openstack.org/292193 | 04:08 |
| *** gildub has quit IRC | 04:08 | |
| *** Daisy has joined #openstack-infra | 04:09 | |
| *** ajmiller_ has quit IRC | 04:09 | |
| *** Daisy_ has joined #openstack-infra | 04:10 | |
| *** [HeOS] has joined #openstack-infra | 04:12 | |
| *** roxanagh_ has joined #openstack-infra | 04:13 | |
| *** ekarlso- has joined #openstack-infra | 04:13 | |
| *** Daisy has quit IRC | 04:13 | |
| *** Daisy_ has quit IRC | 04:15 | |
| *** HeOS has quit IRC | 04:15 | |
| *** zeih has joined #openstack-infra | 04:19 | |
| *** roxanagh_ has quit IRC | 04:20 | |
| *** andymaier has quit IRC | 04:23 | |
| *** zeih has quit IRC | 04:23 | |
| *** zz_dimtruck is now known as dimtruck | 04:27 | |
| *** thorst has joined #openstack-infra | 04:27 | |
| *** hdd has joined #openstack-infra | 04:28 | |
| *** abregman has quit IRC | 04:31 | |
| *** baoli has joined #openstack-infra | 04:32 | |
| *** treaki__ has joined #openstack-infra | 04:32 | |
| *** baoli has quit IRC | 04:33 | |
| *** thorst has quit IRC | 04:35 | |
| *** chlong has quit IRC | 04:35 | |
| *** treaki_ has quit IRC | 04:36 | |
| *** zeih has joined #openstack-infra | 04:38 | |
| *** armax has joined #openstack-infra | 04:38 | |
| *** zeih has quit IRC | 04:42 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add releasenotes https://review.openstack.org/292193 | 04:44 |
| *** chlong has joined #openstack-infra | 04:48 | |
| *** kushal has joined #openstack-infra | 04:55 | |
| *** zeih has joined #openstack-infra | 04:56 | |
| *** zeih has quit IRC | 05:00 | |
| *** [HeOS] has quit IRC | 05:00 | |
| *** [HeOS] has joined #openstack-infra | 05:01 | |
| *** otherwiseguy has quit IRC | 05:02 | |
| *** _nadya_ has joined #openstack-infra | 05:02 | |
| *** chlong has quit IRC | 05:03 | |
| *** Daisy has joined #openstack-infra | 05:05 | |
| *** boris-42 has joined #openstack-infra | 05:06 | |
| *** Daisy has quit IRC | 05:07 | |
| *** Daisy has joined #openstack-infra | 05:07 | |
| *** _nadya_ has quit IRC | 05:07 | |
| *** Daisy has quit IRC | 05:08 | |
| *** Daisy has joined #openstack-infra | 05:08 | |
| *** otherwiseguy has joined #openstack-infra | 05:12 | |
| *** zeih has joined #openstack-infra | 05:14 | |
| *** kushal has quit IRC | 05:16 | |
| *** chlong has joined #openstack-infra | 05:16 | |
| *** zeih has quit IRC | 05:18 | |
| *** chlong has quit IRC | 05:22 | |
| *** _amrith_ is now known as amrith | 05:29 | |
| *** zeih has joined #openstack-infra | 05:32 | |
| *** thorst has joined #openstack-infra | 05:33 | |
| *** chlong has joined #openstack-infra | 05:34 | |
| *** zeih has quit IRC | 05:36 | |
| *** kiran-r has joined #openstack-infra | 05:37 | |
| *** hdd has quit IRC | 05:38 | |
| *** hdd has joined #openstack-infra | 05:39 | |
| *** hdd has quit IRC | 05:39 | |
| *** amrith is now known as _amrith_ | 05:39 | |
| *** thorst has quit IRC | 05:41 | |
| *** fawadkhaliq has joined #openstack-infra | 05:46 | |
| *** zeih has joined #openstack-infra | 05:50 | |
| *** zeih has quit IRC | 05:54 | |
| *** markvoelker has joined #openstack-infra | 05:58 | |
| *** kzaitsev_mb has joined #openstack-infra | 05:58 | |
| openstackgerrit | Merged openstack-infra/project-config: Add centos-minimal build, experimental job https://review.openstack.org/290974 | 05:58 |
| *** zeih has joined #openstack-infra | 05:59 | |
| *** ihrachys has joined #openstack-infra | 06:02 | |
| *** markvoelker has quit IRC | 06:02 | |
| *** zeih has quit IRC | 06:04 | |
| *** kzaitsev_mb has quit IRC | 06:04 | |
| *** abregman has joined #openstack-infra | 06:05 | |
| *** nwkarsten has quit IRC | 06:06 | |
| *** nwkarsten has joined #openstack-infra | 06:06 | |
| *** nwkarsten has quit IRC | 06:10 | |
| *** zeih has joined #openstack-infra | 06:18 | |
| *** asettle has joined #openstack-infra | 06:18 | |
| *** dimtruck is now known as zz_dimtruck | 06:19 | |
| *** ihrachys_ has joined #openstack-infra | 06:19 | |
| *** sridhar_ram has joined #openstack-infra | 06:19 | |
| *** ihrachys has quit IRC | 06:21 | |
| *** zeih has quit IRC | 06:22 | |
| *** zz_dimtruck is now known as dimtruck | 06:23 | |
| openstackgerrit | Alex Xu proposed openstack-infra/irc-meetings: Update Nova API sub-team meeting time https://review.openstack.org/292222 | 06:25 |
| *** sridhar_ram has quit IRC | 06:31 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/288849 | 06:31 |
| *** MarkAtwood has joined #openstack-infra | 06:31 | |
| *** daemontool has quit IRC | 06:34 | |
| *** dimtruck is now known as zz_dimtruck | 06:36 | |
| *** zeih has joined #openstack-infra | 06:36 | |
| *** flepied1 has joined #openstack-infra | 06:39 | |
| *** pcaruana has quit IRC | 06:39 | |
| *** flepied has quit IRC | 06:40 | |
| *** zeih has quit IRC | 06:40 | |
| *** jtomasek has joined #openstack-infra | 06:41 | |
| *** flepied has joined #openstack-infra | 06:45 | |
| *** flepied1 has quit IRC | 06:45 | |
| *** ihrachys has joined #openstack-infra | 06:46 | |
| *** ihrachys_ has quit IRC | 06:47 | |
| *** chlong has quit IRC | 06:48 | |
| *** oanson has joined #openstack-infra | 06:50 | |
| *** ihrachys_ has joined #openstack-infra | 06:53 | |
| *** zeih has joined #openstack-infra | 06:54 | |
| *** ihrachys has quit IRC | 06:55 | |
| *** zeih has quit IRC | 06:58 | |
| openstackgerrit | abregman proposed openstack-infra/project-config: Add CentOS & Fedora dashboards to grafana https://review.openstack.org/292123 | 07:00 |
| *** kzaitsev_mb has joined #openstack-infra | 07:00 | |
| *** zhurong_ has quit IRC | 07:01 | |
| *** thorst has joined #openstack-infra | 07:02 | |
| *** hichihara has joined #openstack-infra | 07:03 | |
| *** ihrachys_ has quit IRC | 07:04 | |
| *** kzaitsev_mb has quit IRC | 07:05 | |
| *** andymccr_ has joined #openstack-infra | 07:05 | |
| *** timburke_ has joined #openstack-infra | 07:06 | |
| *** sdake has joined #openstack-infra | 07:06 | |
| *** AJaeger has quit IRC | 07:06 | |
| *** thorst has quit IRC | 07:07 | |
| *** aloga_ has joined #openstack-infra | 07:07 | |
| *** asettle has quit IRC | 07:07 | |
| *** fawadkhaliq has quit IRC | 07:08 | |
| *** sc`_ has joined #openstack-infra | 07:10 | |
| *** zeih has joined #openstack-infra | 07:12 | |
| *** hughhalf_ has joined #openstack-infra | 07:14 | |
| *** ruhe2 has joined #openstack-infra | 07:14 | |
| *** cschwede_ has joined #openstack-infra | 07:14 | |
| *** Daisy has quit IRC | 07:15 | |
| *** SotK has quit IRC | 07:15 | |
| *** icey_ has quit IRC | 07:15 | |
| *** cbader_2 has quit IRC | 07:15 | |
| *** isq_ has quit IRC | 07:15 | |
| *** persia has quit IRC | 07:15 | |
| *** eezhova has quit IRC | 07:15 | |
| *** masayukig has quit IRC | 07:15 | |
| *** acabot has quit IRC | 07:15 | |
| *** lezbar has quit IRC | 07:15 | |
| *** ruhe has quit IRC | 07:15 | |
| *** cschwede has quit IRC | 07:15 | |
| *** bswartz has quit IRC | 07:15 | |
| *** sgordon has quit IRC | 07:15 | |
| *** jpeeler has quit IRC | 07:15 | |
| *** dangers_away has quit IRC | 07:15 | |
| *** aloga has quit IRC | 07:15 | |
| *** sileht has quit IRC | 07:15 | |
| *** bigjools has quit IRC | 07:15 | |
| *** timburke has quit IRC | 07:15 | |
| *** pedroalvarez has quit IRC | 07:15 | |
| *** hughhalf has quit IRC | 07:15 | |
| *** sirushti has quit IRC | 07:15 | |
| *** dabukalam has quit IRC | 07:15 | |
| *** sc` has quit IRC | 07:15 | |
| *** olaph has quit IRC | 07:15 | |
| *** mkoderer has quit IRC | 07:15 | |
| *** andymccr has quit IRC | 07:15 | |
| *** dstanek has quit IRC | 07:15 | |
| *** ruhe2 is now known as ruhe | 07:15 | |
| *** icey has joined #openstack-infra | 07:15 | |
| *** sc`_ is now known as sc` | 07:15 | |
| *** cschwede_ is now known as cschwede | 07:15 | |
| *** [HeOS] is now known as HeOS | 07:15 | |
| *** cbader_2 has joined #openstack-infra | 07:15 | |
| *** jpeeler has joined #openstack-infra | 07:15 | |
| *** bigjools has joined #openstack-infra | 07:16 | |
| *** Daisy has joined #openstack-infra | 07:16 | |
| *** SotK has joined #openstack-infra | 07:16 | |
| *** isq_ has joined #openstack-infra | 07:16 | |
| *** eezhova has joined #openstack-infra | 07:16 | |
| *** masayukig has joined #openstack-infra | 07:16 | |
| *** acabot has joined #openstack-infra | 07:16 | |
| *** lezbar has joined #openstack-infra | 07:16 | |
| *** sgordon has joined #openstack-infra | 07:16 | |
| *** dangers_away has joined #openstack-infra | 07:16 | |
| *** pedroalvarez has joined #openstack-infra | 07:16 | |
| *** sirushti has joined #openstack-infra | 07:16 | |
| *** dabukalam has joined #openstack-infra | 07:16 | |
| *** olaph has joined #openstack-infra | 07:16 | |
| *** mkoderer has joined #openstack-infra | 07:16 | |
| *** jaosorior has joined #openstack-infra | 07:16 | |
| *** dstanek has joined #openstack-infra | 07:16 | |
| *** sileht has joined #openstack-infra | 07:16 | |
| *** binbincong has quit IRC | 07:16 | |
| *** zeih has quit IRC | 07:17 | |
| *** persia has joined #openstack-infra | 07:18 | |
| *** binbincong has joined #openstack-infra | 07:28 | |
| *** ihrachys has joined #openstack-infra | 07:30 | |
| *** zeih has joined #openstack-infra | 07:30 | |
| *** nmagnezi has joined #openstack-infra | 07:31 | |
| *** zeih has quit IRC | 07:35 | |
| openstackgerrit | Ghe Rivero proposed openstack-infra/shade: Add quotas support https://review.openstack.org/285110 | 07:35 |
| *** ianychoi has quit IRC | 07:37 | |
| *** zhurong_ has joined #openstack-infra | 07:38 | |
| *** andymccr_ is now known as andymccr | 07:39 | |
| *** scheuran has joined #openstack-infra | 07:40 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Add dib element to generate logical volumes https://review.openstack.org/252041 | 07:40 |
| openstackgerrit | LisaLi proposed openstack-infra/project-config: Enable import backup in tempest https://review.openstack.org/289128 | 07:48 |
| *** zeih has joined #openstack-infra | 07:49 | |
| openstackgerrit | LisaLi proposed openstack-infra/project-config: Enable import backup in tempest https://review.openstack.org/289128 | 07:49 |
| *** AJaeger has joined #openstack-infra | 07:52 | |
| *** tesseract has joined #openstack-infra | 07:52 | |
| *** tesseract is now known as Guest59187 | 07:52 | |
| *** zeih has quit IRC | 07:53 | |
| AJaeger | good morning, I cannot sign into review.openstack.org - but sending patches works. Do I have a local problem or is gerrit broken? | 07:54 |
| *** Sukhdev has quit IRC | 07:57 | |
| *** Sukhdev has joined #openstack-infra | 07:58 | |
| ianw | AJaeger: i just logged out & in again OK | 07:58 |
| rcarrillocruz | AJaeger: yep, i can logout login fine | 07:58 |
| *** markvoelker has joined #openstack-infra | 07:58 | |
| AJaeger | thanks for testing! | 07:59 |
| AJaeger | even stranger - only fails on my workstation, works on second machine ;( | 08:00 |
| *** _nadya_ has joined #openstack-infra | 08:01 | |
| *** kzaitsev_mb has joined #openstack-infra | 08:01 | |
| *** markvoelker has quit IRC | 08:03 | |
| *** kzaitsev_mb has quit IRC | 08:06 | |
| *** Hal has joined #openstack-infra | 08:07 | |
| *** Hal is now known as Guest95781 | 08:07 | |
| *** thorst has joined #openstack-infra | 08:07 | |
| *** thorst has quit IRC | 08:11 | |
| *** fhubik has joined #openstack-infra | 08:17 | |
| *** kzaitsev_mb has joined #openstack-infra | 08:20 | |
| *** mikelk has joined #openstack-infra | 08:25 | |
| *** rcernin has joined #openstack-infra | 08:25 | |
| *** arxcruz has joined #openstack-infra | 08:25 | |
| *** dtardivel has joined #openstack-infra | 08:27 | |
| *** nmagnezi has quit IRC | 08:28 | |
| *** matrohon has joined #openstack-infra | 08:29 | |
| *** nmagnezi has joined #openstack-infra | 08:29 | |
| *** vincentll has joined #openstack-infra | 08:30 | |
| *** jed56 has joined #openstack-infra | 08:30 | |
| *** lezbar has quit IRC | 08:37 | |
| *** Sukhdev has quit IRC | 08:40 | |
| *** sshnaidm has quit IRC | 08:41 | |
| *** lezbar has joined #openstack-infra | 08:42 | |
| *** pcaruana has joined #openstack-infra | 08:43 | |
| *** vgridnev has joined #openstack-infra | 08:43 | |
| *** aloga_ is now known as aloga | 08:43 | |
| *** dizquierdo has joined #openstack-infra | 08:44 | |
| *** MarkAtwo_ has joined #openstack-infra | 08:44 | |
| *** _degorenko|afk is now known as degorenko | 08:45 | |
| *** kiran-r has quit IRC | 08:46 | |
| *** Guest95781 has quit IRC | 08:46 | |
| *** kiran-r has joined #openstack-infra | 08:46 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Clear up "already provided" message https://review.openstack.org/290968 | 08:46 |
| *** MarkAtwood has quit IRC | 08:47 | |
| ianw | AJaeger: can you delete stuff on static? i'd like https://tarballs.openstack.org/package-afs-centos7/package-afs-centos7/ removed to avoid confusion (the extra subdir, the files should just be at the root) | 08:47 |
| *** dizquierdo has quit IRC | 08:51 | |
| *** _skolekonov is now known as skolekonov | 08:51 | |
| *** flepied has quit IRC | 08:52 | |
| *** dingyichen has quit IRC | 08:54 | |
| *** Digvijay has joined #openstack-infra | 08:54 | |
| Digvijay | ERROR zuul.GerritEventConnector: Received unrecognized event type 'ref-replicated' from Gerrit. Can not get account information. | 08:54 |
| Digvijay | Anyone know about this error | 08:54 |
| Digvijay | please help me | 08:55 |
| *** asettle has joined #openstack-infra | 08:55 | |
| Digvijay | ERROR zuul.GerritEventConnector: Received unrecognized event type 'ref-replicated' from Gerrit. Can not get account information. | 08:56 |
| Digvijay | Anyone know about this error | 08:56 |
| *** hichihara has quit IRC | 08:57 | |
| openstackgerrit | Merged openstack-infra/project-config: Add reno jobs to some Puppet OpenStack modules https://review.openstack.org/291805 | 08:57 |
| *** ociuhandu has quit IRC | 08:57 | |
| *** hashar has joined #openstack-infra | 09:02 | |
| *** jordanP has joined #openstack-infra | 09:02 | |
| *** kzaitsev_mb has quit IRC | 09:04 | |
| *** placko_ has joined #openstack-infra | 09:07 | |
| *** larsbutler has joined #openstack-infra | 09:08 | |
| *** asettle has quit IRC | 09:09 | |
| AJaeger | ianw: you need an infra-root to manipulate content on static | 09:09 |
| *** thorst has joined #openstack-infra | 09:09 | |
| *** asettle has joined #openstack-infra | 09:11 | |
| *** Daisy has quit IRC | 09:12 | |
| *** jlanoux has joined #openstack-infra | 09:14 | |
| *** asettle has quit IRC | 09:15 | |
| *** thorst has quit IRC | 09:17 | |
| *** lucas-afk is now known as lucasagomes | 09:19 | |
| openstackgerrit | Ilya Shakhat proposed openstack-infra/project-config: Add new project "performa" https://review.openstack.org/291657 | 09:19 |
| *** flepied has joined #openstack-infra | 09:24 | |
| *** jistr has joined #openstack-infra | 09:28 | |
| *** GnomeKin1 is now known as BobBall | 09:29 | |
| *** electrofelix has joined #openstack-infra | 09:31 | |
| *** zhurong_ has quit IRC | 09:31 | |
| *** pblaho has joined #openstack-infra | 09:33 | |
| *** derekh has joined #openstack-infra | 09:33 | |
| Digvijay | ERROR zuul.GerritEventConnector: Received unrecognized event type 'ref-replicated' from Gerrit. Can not get account information. | 09:34 |
| Digvijay | Anyone know about this error | 09:34 |
| *** ociuhandu has joined #openstack-infra | 09:36 | |
| *** armax has quit IRC | 09:37 | |
| *** jlanoux_ has joined #openstack-infra | 09:38 | |
| *** jlanoux has quit IRC | 09:41 | |
| *** Digvijay has quit IRC | 09:47 | |
| *** esikachev has joined #openstack-infra | 09:47 | |
| openstackgerrit | Alexey Ovchinnikov proposed openstack-infra/project-config: Add publishing capability to buildimage-lxd job https://review.openstack.org/290418 | 09:49 |
| *** sshnaidm has joined #openstack-infra | 09:49 | |
| openstackgerrit | Alexey Ovchinnikov proposed openstack-infra/project-config: Add publishing capability to buildimage-lxd job https://review.openstack.org/290418 | 09:50 |
| *** e0ne has joined #openstack-infra | 09:52 | |
| openstackgerrit | Alexey Ovchinnikov proposed openstack-infra/project-config: Add publishing capability to buildimage-lxd job https://review.openstack.org/290418 | 09:53 |
| *** tpsilva has joined #openstack-infra | 09:56 | |
| *** markvoelker has joined #openstack-infra | 09:59 | |
| *** dtantsur|afk is now known as dtantsur | 10:00 | |
| yolanda | good morning | 10:02 |
| *** markvoelker has quit IRC | 10:03 | |
| *** abregman is now known as abregman|afk | 10:05 | |
| *** hashar has quit IRC | 10:06 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:07 | |
| *** hashar has joined #openstack-infra | 10:09 | |
| *** dims has joined #openstack-infra | 10:09 | |
| *** MarkAtwo_ has quit IRC | 10:12 | |
| *** sdague has joined #openstack-infra | 10:13 | |
| *** jlanoux_ has quit IRC | 10:15 | |
| *** sambetts|afk is now known as sambetts | 10:21 | |
| *** dims has quit IRC | 10:21 | |
| *** rguillebert has joined #openstack-infra | 10:21 | |
| *** rossella_s has joined #openstack-infra | 10:23 | |
| *** Qiming has quit IRC | 10:26 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Add playbook to manage power state of ironic servers https://review.openstack.org/284981 | 10:28 |
| *** dims has joined #openstack-infra | 10:30 | |
| *** arxcruz has quit IRC | 10:32 | |
| *** flongo has joined #openstack-infra | 10:33 | |
| *** rossella_s has quit IRC | 10:37 | |
| *** thorst has joined #openstack-infra | 10:38 | |
| *** sdake has quit IRC | 10:38 | |
| *** abregman|afk is now known as abregman | 10:38 | |
| *** dims has quit IRC | 10:39 | |
| *** dims has joined #openstack-infra | 10:40 | |
| *** arxcruz has joined #openstack-infra | 10:40 | |
| *** baoli has joined #openstack-infra | 10:41 | |
| *** thorst has quit IRC | 10:43 | |
| *** armax has joined #openstack-infra | 10:44 | |
| *** e0ne has quit IRC | 10:45 | |
| *** kzaitsev_mb has quit IRC | 10:45 | |
| *** baoli has quit IRC | 10:46 | |
| *** dizquierdo has joined #openstack-infra | 10:55 | |
| *** tzn has joined #openstack-infra | 10:56 | |
| *** e0ne has joined #openstack-infra | 10:56 | |
| *** schipiga has joined #openstack-infra | 10:59 | |
| *** flongo has quit IRC | 11:00 | |
| openstackgerrit | Purandhar Sairam Mannidi proposed openstack/diskimage-builder: Add support for building images capable of UEFI https://review.openstack.org/287784 | 11:01 |
| schipiga | Hi guys. I would like to enable heat service in horizon tests. As I know, it isn't possible to inject local.conf file with "enable_service heat"-section. What is a proper way to make that? Is it touching devstack-gate http://docs.openstack.org/infra/system-config/devstack-gate.html ? I found a env var MY_ENABLED_SERVICES in https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate.sh#L213. Is it that I | 11:04 |
| *** claudiub has joined #openstack-infra | 11:04 | |
| *** kiran-r has quit IRC | 11:06 | |
| *** flongo has joined #openstack-infra | 11:07 | |
| *** MarkAtwood has joined #openstack-infra | 11:08 | |
| *** fawadkhaliq has joined #openstack-infra | 11:09 | |
| *** jcoufal has joined #openstack-infra | 11:12 | |
| *** MarkAtwood has quit IRC | 11:13 | |
| *** Qiming has joined #openstack-infra | 11:13 | |
| *** _amrith_ is now known as amrith | 11:15 | |
| *** kzaitsev_mb has joined #openstack-infra | 11:16 | |
| *** wei-wang has joined #openstack-infra | 11:18 | |
| *** ihrachys has quit IRC | 11:18 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Add new ironic virsh commands https://review.openstack.org/292304 | 11:19 |
| *** e0ne has quit IRC | 11:21 | |
| flongo | Hi all, I'm the project team lead of the iotronic project which has been recently merged to openstack-infra. I would need to be added to the iotronic-release and iotronic-core groups on gerrit to start with project management. Can anybody of the infra team help me? | 11:24 |
| *** e0ne has joined #openstack-infra | 11:26 | |
| flongo | this is the change that was merged to add the iotronic project: https://review.openstack.org/#/c/286113/ | 11:27 |
| yolanda | hi flongo, i can do it | 11:28 |
| *** claudiub has quit IRC | 11:28 | |
| *** claudiub has joined #openstack-infra | 11:29 | |
| flongo | thanks yolanda! | 11:29 |
| yolanda | done | 11:29 |
| flongo | great! | 11:29 |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: Edit task notes from board https://review.openstack.org/291755 | 11:30 |
| *** gordc has joined #openstack-infra | 11:35 | |
| *** rhallisey has joined #openstack-infra | 11:36 | |
| *** ldnunes has joined #openstack-infra | 11:37 | |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: Edit task notes from board https://review.openstack.org/291755 | 11:39 |
| openstackgerrit | Vincent proposed openstack-infra/project-config: add Synergy project https://review.openstack.org/283157 | 11:41 |
| *** thorst has joined #openstack-infra | 11:42 | |
| *** thorst_ has joined #openstack-infra | 11:43 | |
| *** dprince has joined #openstack-infra | 11:45 | |
| *** dprince has quit IRC | 11:45 | |
| *** dims_ has joined #openstack-infra | 11:45 | |
| *** dprince has joined #openstack-infra | 11:45 | |
| *** thorst has quit IRC | 11:47 | |
| *** dims has quit IRC | 11:47 | |
| *** erlon has joined #openstack-infra | 11:51 | |
| TheJulia | the new ubuntu-trusty images, what is the preferred way to access mysql for jobs running on them? | 11:55 |
| AJaeger | TheJulia: which job are we talking about? | 11:56 |
| AJaeger | TheJulia: there shouldn't be a change for you but if there is, we need details... | 11:57 |
| TheJulia | AJaeger: with the change to ubuntu-trusty to bare-trusty, openstack_citest mysql user appears to no longer work | 11:57 |
| AJaeger | TheJulia: do you have a log file to look at? | 11:58 |
| TheJulia | It just shows ansible failing to be able to open the DB :\ | 11:58 |
| AJaeger | TheJulia: Link? | 11:59 |
| TheJulia | http://logs.openstack.org/93/290193/1/gate/gate-bifrost-integration-coreosipa-cirros/69f24b2/console.html.gz | 11:59 |
| *** yamamoto has quit IRC | 12:00 | |
| *** markvoelker has joined #openstack-infra | 12:00 | |
| *** ihrachys has joined #openstack-infra | 12:01 | |
| *** chlong has joined #openstack-infra | 12:01 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add Designate Role to OpenStack-Ansible https://review.openstack.org/292326 | 12:02 |
| *** MarkAtwood has joined #openstack-infra | 12:02 | |
| *** ihrachys has quit IRC | 12:03 | |
| *** ihrachys has joined #openstack-infra | 12:03 | |
| *** markvoelker has quit IRC | 12:04 | |
| *** aysyd has joined #openstack-infra | 12:04 | |
| *** sshnaidm has quit IRC | 12:05 | |
| *** kgiusti has joined #openstack-infra | 12:07 | |
| *** MarkAtwood has quit IRC | 12:07 | |
| *** jaosorior has quit IRC | 12:08 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add Designate Role to OpenStack-Ansible https://review.openstack.org/292326 | 12:08 |
| *** weshay has joined #openstack-infra | 12:08 | |
| *** jaosorior has joined #openstack-infra | 12:08 | |
| *** esikachev has quit IRC | 12:08 | |
| *** aysyd has quit IRC | 12:09 | |
| AJaeger | TheJulia: let me check... | 12:09 |
| *** aysyd has joined #openstack-infra | 12:10 | |
| *** rfolco has joined #openstack-infra | 12:11 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add database support for gate-bifrost-integration-coreosipa-cirros https://review.openstack.org/292336 | 12:11 |
| AJaeger | TheJulia: Yes, that job runs without DB access, fixed by ^ | 12:11 |
| *** smarcet has joined #openstack-infra | 12:12 | |
| AJaeger | TheJulia: does gate-bifrost-integration-dibipa-debian-nv also need DB access? | 12:12 |
| smarcet | fungi: morning | 12:12 |
| TheJulia | Ahh... okay | 12:12 |
| smarcet | any change to access to openstackid production logs? | 12:12 |
| TheJulia | AJaeger: yeah, we don't need pgsql, i can edit it if you want | 12:12 |
| smarcet | i am getting a 404 with my user and cat get log | 12:12 |
| AJaeger | I still have the editor open ;) | 12:12 |
| TheJulia | AJaeger: then go right ahead :) | 12:13 |
| TheJulia | AJaeger: Thank you! | 12:13 |
| AJaeger | Also for gate-bifrost-integration-dibipa-debian-nv ? | 12:13 |
| TheJulia | yes | 12:13 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add database support for gate-bifrost-integration* https://review.openstack.org/292336 | 12:14 |
| AJaeger | done ^ | 12:14 |
| TheJulia | AJaeger: Thank you! | 12:14 |
| AJaeger | TheJulia: We need to rework database setup, so might handle this different in the future. For now, let's go with this one. | 12:14 |
| TheJulia | AJaeger: Yeah, I'm guessing the mysql-db prep step also invokes a creation of a user? | 12:15 |
| AJaeger | fungi, please read scrollback above for another database issue we hit - once you've had your coffee ;) | 12:15 |
| *** keedya has joined #openstack-infra | 12:15 | |
| TheJulia | AJaeger: I'll gladly be the outlier that breaks :) | 12:15 |
| AJaeger | TheJulia: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/macros.yaml#n643 | 12:15 |
| *** fabio_ has joined #openstack-infra | 12:16 | |
| TheJulia | Yeah, re-worked :) | 12:16 |
| TheJulia | or needs it I should say | 12:16 |
| *** keedya has quit IRC | 12:17 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul/layout: save TripleO CI resources https://review.openstack.org/292339 | 12:17 |
| AJaeger | yep, should be fine now - once the change merges, give it an hour to deploy and then recheck - I expect it will work then. If not, tell us again... | 12:17 |
| *** keedya has joined #openstack-infra | 12:17 | |
| TheJulia | AJaeger: Will do | 12:17 |
| AJaeger | yolanda: could you review https://review.openstack.org/292336 , please? | 12:18 |
| yolanda | sure | 12:18 |
| *** amrith is now known as _amrith_ | 12:19 | |
| *** flongo has quit IRC | 12:19 | |
| *** gnuoy_ has joined #openstack-infra | 12:20 | |
| AJaeger | thanks | 12:20 |
| *** sshnaidm has joined #openstack-infra | 12:20 | |
| *** baoli has joined #openstack-infra | 12:21 | |
| *** rossella_s has joined #openstack-infra | 12:22 | |
| AJaeger | TheJulia: Let me double check: Do you really need mysql for image building? gate-bifrost-integration-dibipa-debian-nv is image building and those normally don't need a database... | 12:22 |
| TheJulia | AJaeger: it builds an image then extercises the image | 12:23 |
| TheJulia | so, yes, it does need the databse | 12:23 |
| TheJulia | s/bse/base | 12:23 |
| *** wei-wang has quit IRC | 12:24 | |
| *** gnuoy_ has quit IRC | 12:25 | |
| *** wei-wang has joined #openstack-infra | 12:25 | |
| AJaeger | Ah, so for the exercise? Ok... | 12:25 |
| *** armax has quit IRC | 12:25 | |
| *** baoli has quit IRC | 12:26 | |
| *** wei-wang has quit IRC | 12:26 | |
| *** fabio_ has left #openstack-infra | 12:27 | |
| *** zhurong_ has joined #openstack-infra | 12:31 | |
| *** nikil89_ has joined #openstack-infra | 12:31 | |
| *** edmondsw has joined #openstack-infra | 12:31 | |
| openstackgerrit | Merged openstack-infra/storyboard: Replace deprecated LOG.warn with LOG.warning https://review.openstack.org/291649 | 12:32 |
| *** [1]Thelo has joined #openstack-infra | 12:32 | |
| *** flongo has joined #openstack-infra | 12:32 | |
| *** boris-42 has quit IRC | 12:34 | |
| *** sshnaidm has quit IRC | 12:34 | |
| *** Thelo has quit IRC | 12:34 | |
| *** [1]Thelo is now known as Thelo | 12:34 | |
| *** zhurong_ has quit IRC | 12:35 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add Designate Role to OpenStack-Ansible https://review.openstack.org/292326 | 12:37 |
| *** zhurong_ has joined #openstack-infra | 12:38 | |
| *** flongo has quit IRC | 12:38 | |
| *** cbader_2 has quit IRC | 12:41 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Rename the ceph to upgrades https://review.openstack.org/292359 | 12:41 |
| openstackgerrit | Ana Krivokapic proposed openstack-infra/project-config: New project for TripleO UI https://review.openstack.org/291227 | 12:42 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Rename the ceph to upgrades https://review.openstack.org/292359 | 12:42 |
| *** baoli has joined #openstack-infra | 12:42 | |
| *** zhurong_ has quit IRC | 12:42 | |
| *** baoli_ has joined #openstack-infra | 12:43 | |
| *** links has quit IRC | 12:46 | |
| *** baoli has quit IRC | 12:46 | |
| *** links has joined #openstack-infra | 12:46 | |
| *** yamamoto has joined #openstack-infra | 12:48 | |
| *** armax has joined #openstack-infra | 12:48 | |
| *** sshnaidm has joined #openstack-infra | 12:50 | |
| *** markvoelker has joined #openstack-infra | 12:51 | |
| *** mtanino has joined #openstack-infra | 12:52 | |
| *** automagically_ has joined #openstack-infra | 12:53 | |
| *** lucasagomes is now known as lucas-hungry | 12:54 | |
| *** automagically_ has left #openstack-infra | 12:55 | |
| *** nwkarsten has joined #openstack-infra | 12:56 | |
| *** eharney has quit IRC | 12:57 | |
| *** MarkAtwood has joined #openstack-infra | 12:57 | |
| *** cbader has joined #openstack-infra | 12:59 | |
| *** nmagnezi has quit IRC | 12:59 | |
| *** bswartz has joined #openstack-infra | 13:00 | |
| *** MarkAtwood has quit IRC | 13:01 | |
| scheuran | Hi AJaeger, would you mind having a quick look at this review? https://review.openstack.org/#/c/257501/ It's a simple infra doc patch... thanks | 13:04 |
| AJaeger | HI scheuran, for system-config I cannot really help - and that one is out of my expertise to even +1. Sorry... | 13:06 |
| *** vincentfrancoise has joined #openstack-infra | 13:06 | |
| scheuran | AJaeger, ok, no problem.. thanks | 13:07 |
| *** sshnaidm has quit IRC | 13:10 | |
| *** eharney has joined #openstack-infra | 13:11 | |
| *** esker has quit IRC | 13:13 | |
| *** esker has joined #openstack-infra | 13:14 | |
| *** nmagnezi has joined #openstack-infra | 13:15 | |
| *** ajmiller has joined #openstack-infra | 13:15 | |
| *** _amrith_ is now known as amrith | 13:16 | |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support GitHub PR webhooks https://review.openstack.org/163117 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Make the string representation of change transparent https://review.openstack.org/238948 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Lower the log level in tests https://review.openstack.org/263364 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Merge pull requests from github reporter https://review.openstack.org/243250 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Encapsulate determining the event purpose https://review.openstack.org/247487 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Fix job hierarchy bug. https://review.openstack.org/192457 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: support github pull reqeust labels https://review.openstack.org/247421 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Better merge message for GitHub pull reqeusts https://review.openstack.org/280667 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add 'push' and 'tag' github webhook events. https://review.openstack.org/191207 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add 'pr-comment' github webhook event https://review.openstack.org/239203 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support for dependent pipelines with github https://review.openstack.org/247500 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Configurable SSH access to GitHub https://review.openstack.org/239138 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow github trigger to match on branches/refs https://review.openstack.org/258448 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow using webapp from connections https://review.openstack.org/215642 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow list values in template parameters. https://review.openstack.org/191208 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add basic Github Zuul Reporter. https://review.openstack.org/191312 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support for github commit status https://review.openstack.org/239303 | 13:16 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: GitHub file matching support https://review.openstack.org/292376 | 13:16 |
| *** nwkarsten has quit IRC | 13:18 | |
| *** _ari_ has joined #openstack-infra | 13:19 | |
| vincentfrancoise | Hi infra team | 13:19 |
| *** nwkarsten has joined #openstack-infra | 13:19 | |
| vincentfrancoise | I am trying to write a multinode test for watcher, but it is currently failing | 13:20 |
| vincentfrancoise | Apparently, this due to some limitation on the devstack-gate (devstack-vm-gate.sh) with the DEVSTACK_LOCAL_CONFIG variable which is actually shared by both the primary node and the subnodes | 13:21 |
| vincentfrancoise | has anyone encountered this problem before? | 13:21 |
| *** nwkarsten has quit IRC | 13:23 | |
| *** BigWillie has joined #openstack-infra | 13:24 | |
| *** sshnaidm has joined #openstack-infra | 13:26 | |
| *** akshai has joined #openstack-infra | 13:27 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Fixed missing ref https://review.openstack.org/292383 | 13:28 |
| *** yolanda has quit IRC | 13:29 | |
| *** ajmiller_ has joined #openstack-infra | 13:29 | |
| *** yolanda has joined #openstack-infra | 13:31 | |
| *** krotscheck has joined #openstack-infra | 13:31 | |
| *** ajmiller has quit IRC | 13:32 | |
| openstackgerrit | Merged openstack-infra/project-config: Add database support for gate-bifrost-integration* https://review.openstack.org/292336 | 13:32 |
| *** tzn has quit IRC | 13:33 | |
| *** nwkarsten has joined #openstack-infra | 13:33 | |
| *** nwkarsten has quit IRC | 13:33 | |
| openstackgerrit | Merged openstack-infra/release-tools: make args to creating stable branch more explicit https://review.openstack.org/289385 | 13:34 |
| EmilienM | dhellmann: I'm wondering why http://docs.openstack.org/releasenotes/puppet-keystone/ is not updated with all notes, did I miss something? https://github.com/openstack/puppet-keystone/commit/515c3a484b12a8d6b7418c8ca69f3970b18bb2c0 | 13:34 |
| *** nwkarsten has joined #openstack-infra | 13:34 | |
| openstackgerrit | Merged openstack-infra/release-tools: add script to generate branching instructions https://review.openstack.org/289386 | 13:35 |
| *** gsagie has joined #openstack-infra | 13:36 | |
| AJaeger | EmilienM: can you build locally and get everything? | 13:37 |
| gsagie | Hello everyone, i am trying to find something that increase Neutron quota for some devstack/tempest gate tests we run, anyone has any example or can help whats the best way to do it? | 13:37 |
| EmilienM | AJaeger: i'm trying now | 13:37 |
| AJaeger | Last change "2016-03-09" | 13:38 |
| openstackgerrit | Merged openstack-infra/openstackid: Fixed missing ref https://review.openstack.org/292383 | 13:38 |
| EmilienM | AJaeger: if I build locally, I have all notes | 13:39 |
| AJaeger | EmilienM: same here ;( | 13:39 |
| AJaeger | EmilienM: so, let's check log files... | 13:40 |
| *** ajmiller_ has quit IRC | 13:40 | |
| EmilienM | AJaeger: look http://docs-draft.openstack.org/09/274409/5/gate/gate-puppet-keystone-releasenotes/27d5734//releasenotes/build/html/unreleased.html | 13:41 |
| EmilienM | from https://review.openstack.org/#/c/274409/ | 13:41 |
| EmilienM | it sounds like, the build works, but doc website did not get the update | 13:41 |
| AJaeger | ;( | 13:42 |
| *** gael__ has joined #openstack-infra | 13:44 | |
| *** EricGonczer_ has joined #openstack-infra | 13:45 | |
| AJaeger | I can't find post jobs for most recent commits. Could you just merge a simple change and then let'S check the post job, EmilienM ... | 13:46 |
| EmilienM | AJaeger: I guess I need to merge a patch with a note, right? | 13:47 |
| AJaeger | EmilienM: any patch will do - we always publish notes | 13:47 |
| openstackgerrit | Thomas Bechtold proposed openstack/requirements: Require iso8601>=0.1.11 https://review.openstack.org/292396 | 13:48 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support GitHub PR webhooks https://review.openstack.org/163117 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Make the string representation of change transparent https://review.openstack.org/238948 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Lower the log level in tests https://review.openstack.org/263364 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Merge pull requests from github reporter https://review.openstack.org/243250 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Encapsulate determining the event purpose https://review.openstack.org/247487 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Fix job hierarchy bug. https://review.openstack.org/192457 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: support github pull reqeust labels https://review.openstack.org/247421 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Better merge message for GitHub pull reqeusts https://review.openstack.org/280667 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add 'push' and 'tag' github webhook events. https://review.openstack.org/191207 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add 'pr-comment' github webhook event https://review.openstack.org/239203 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support for dependent pipelines with github https://review.openstack.org/247500 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Configurable SSH access to GitHub https://review.openstack.org/239138 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: GitHub file matching support https://review.openstack.org/292376 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow github trigger to match on branches/refs https://review.openstack.org/258448 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Log GitHub API rate limit https://review.openstack.org/292377 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow using webapp from connections https://review.openstack.org/215642 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow list values in template parameters. https://review.openstack.org/191208 | 13:49 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add basic Github Zuul Reporter. https://review.openstack.org/191312 | 13:49 |
| *** MarkAtwood has joined #openstack-infra | 13:51 | |
| EmilienM | AJaeger: doing it with https://review.openstack.org/292398 | 13:52 |
| *** flongo has joined #openstack-infra | 13:53 | |
| AJaeger | EmilienM: ok, let's see what happens - I'll check later today | 13:54 |
| EmilienM | AJaeger: how infra team manage the meeting time for tomorrow? | 13:54 |
| EmilienM | in Canada, we changed time this week end | 13:55 |
| *** MarkAtwood has quit IRC | 13:55 | |
| *** EricGonc_ has joined #openstack-infra | 13:56 | |
| mordred | EmilienM: meeting time is in UTC | 13:56 |
| EmilienM | mordred: ok thx | 13:56 |
| *** gael__ has left #openstack-infra | 13:56 | |
| openstackgerrit | greghaynes proposed openstack-infra/glean: WIP: Add interface bonding support https://review.openstack.org/292399 | 13:56 |
| mordred | EmilienM: thanks for reminding me to check my calendar and make sure it did the right thnig :) | 13:56 |
| EmilienM | every year, it's the same thing and people miss meetings | 13:57 |
| EmilienM | (me included) | 13:57 |
| AJaeger | EmilienM: All meetings are in UTC, so just don't change your time ;) | 13:57 |
| anteaya | I have utc on my phone and my weechat server | 13:57 |
| anteaya | which my stove clock could do 24 hour time, I'd put that on utc as well | 13:58 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Add dib element to generate logical volumes https://review.openstack.org/252041 | 13:59 |
| *** EricGonczer_ has quit IRC | 13:59 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:00 | |
| *** flongo has quit IRC | 14:00 | |
| *** amitgandhinz has joined #openstack-infra | 14:01 | |
| *** tzn has joined #openstack-infra | 14:01 | |
| EmilienM | AJaeger: should be in gate | 14:02 |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: WIP for boards and worklists page https://review.openstack.org/279753 | 14:02 |
| *** ig0r_ has joined #openstack-infra | 14:02 | |
| *** lucas-hungry is now known as lucasagomes | 14:03 | |
| *** mriedem has joined #openstack-infra | 14:04 | |
| *** boris-42 has joined #openstack-infra | 14:05 | |
| *** amrith is now known as _amrith_ | 14:06 | |
| *** _amrith_ is now known as amrith | 14:06 | |
| greghaynes | mordred: we have a really funny glean gate failure | 14:06 |
| *** tonytan4ever has joined #openstack-infra | 14:06 | |
| AJaeger | EmilienM: is in post now ;) | 14:06 |
| EmilienM | AJaeger: mhh, nothing in post queue appears | 14:07 |
| greghaynes | mordred: for some reason a stale glean.lock is getting left on our test nodes from boot. It is owned by root, and the tests fail because they cannot get this lock | 14:07 |
| EmilienM | AJaeger: I don't see it | 14:07 |
| AJaeger | EmilienM: I see it at the bottom | 14:07 |
| *** jlanoux has joined #openstack-infra | 14:07 | |
| EmilienM | AJaeger: I was using 292398 filter | 14:07 |
| EmilienM | AJaeger: let's see if it works | 14:07 |
| *** rbrndt has joined #openstack-infra | 14:08 | |
| AJaeger | looks good so far ;) | 14:08 |
| *** salv-orlando has joined #openstack-infra | 14:08 | |
| *** tongli has joined #openstack-infra | 14:10 | |
| *** daemontool has joined #openstack-infra | 14:10 | |
| *** EricGonc_ has quit IRC | 14:10 | |
| *** bauzas is now known as not_bauzas | 14:10 | |
| *** not_bauzas is now known as bauzas | 14:11 | |
| mordred | greghaynes: yes. yolanda is working on a fix for that | 14:11 |
| *** zz_dimtruck is now known as dimtruck | 14:12 | |
| yolanda | greghaynes that's consequence of ubuntu-trusty move | 14:12 |
| yolanda | so i started to take a look last week | 14:12 |
| *** asettle has joined #openstack-infra | 14:12 | |
| greghaynes | yolanda: ah. I think the first thing wrong is that the tests shouldnt use that global lock, but then yes theres a bug with leaving that file | 14:12 |
| *** Guest12587 is now known as mfisch | 14:13 | |
| yolanda | greghaynes yep, i just talked with mordred, a good solution seems to mock that call | 14:13 |
| *** mfisch is now known as Guest62254 | 14:13 | |
| *** thiagop has joined #openstack-infra | 14:13 | |
| greghaynes | awesome | 14:14 |
| mordred | greghaynes: as implemented right now, I do not believe we have a good way to remove the file | 14:14 |
| mordred | greghaynes: but once we're mocking it in tests, figuring that out woudl be nice | 14:15 |
| *** fawadkhaliq has quit IRC | 14:15 | |
| *** smarcet has quit IRC | 14:15 | |
| anteaya | infra-root: jenkins06 seems to be off doing its own thing: http://grafana.openstack.org/dashboard/db/nodepool | 14:15 |
| *** Guest62254 is now known as mfisch | 14:15 | |
| *** mfisch has quit IRC | 14:15 | |
| *** mfisch has joined #openstack-infra | 14:15 | |
| *** fawadkhaliq has joined #openstack-infra | 14:15 | |
| anteaya | and the rackspace error node launch attempts graph looks busier that is indicative of a health cloud interaction for us: http://grafana.openstack.org/dashboard/db/nodepool-rackspace | 14:16 |
| greghaynes | mordred: We record pid in that file, right? | 14:16 |
| *** david-lyle has quit IRC | 14:16 | |
| mordred | greghaynes: we create the file if it doesn't exist, then get a lock on it | 14:16 |
| greghaynes | mordred: If so its probably not an issue if we leave it - just notice that the pid is stale | 14:16 |
| anteaya | mordred: in the good news, the bluebox error node launch attempts looks good | 14:16 |
| mordred | anteaya: woot! | 14:16 |
| greghaynes | ah | 14:16 |
| mordred | jlk: ^^ well done | 14:16 |
| *** saw21 has joined #openstack-infra | 14:17 | |
| mordred | greghaynes: fh = open(self.filename, 'w') | 14:17 |
| mordred | fcntl.flock(fh, fcntl.LOCK_EX) | 14:17 |
| greghaynes | mordred: yea, so we might need to write out our pid in there | 14:18 |
| mordred | greghaynes: yah. I mean - we kinda want to use daemon.pidlockfile | 14:18 |
| *** vincentfrancoise has left #openstack-infra | 14:18 | |
| greghaynes | or that | 14:18 |
| mordred | except that glean shoudl not have depends | 14:18 |
| anteaya | mordred jlk yay! | 14:18 |
| greghaynes | heh | 14:18 |
| mordred | greghaynes: I honestly cannot believe that python core does not have usable pidfile locking | 14:19 |
| greghaynes | mordred: huh, daemontools depends on lockfile which is our deprecated thing | 14:19 |
| *** david-lyle has joined #openstack-infra | 14:19 | |
| *** asettle has quit IRC | 14:19 | |
| greghaynes | er, python-daemon | 14:20 |
| mattymo | can someone help me remove the wf-1 from this patch? https://review.openstack.org/#/c/284263/1 We changed stable/8.0 settings and now Bogdan Dobrelya can't remove that wf-1 vote | 14:20 |
| openstackgerrit | yolanda.robla proposed openstack-infra/jenkins-job-builder: Allow using lockfile per jenkins master https://review.openstack.org/292405 | 14:20 |
| * yolanda is going to look at glean fix now | 14:20 | |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 14:20 |
| *** notnownikki has joined #openstack-infra | 14:21 | |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: WIP for boards and worklists page https://review.openstack.org/279753 | 14:23 |
| mattymo | is fungi available yet? | 14:24 |
| *** ajmiller has joined #openstack-infra | 14:24 | |
| *** arxcruz has quit IRC | 14:24 | |
| EmilienM | I'm going to push release notes for Puppet modules this week and would like to save TripleO CI resources, if you have some time, please review https://review.openstack.org/#/c/292339/ | 14:24 |
| fungi | mattymo: busy morning, still catching up | 14:24 |
| *** yamamoto has quit IRC | 14:25 | |
| anteaya | morning fungi | 14:26 |
| fungi | ianw: you want the whole /srv/static/tarballs/package-afs-centos7/package-afs-centos7 directory deleted, including all its contents? | 14:27 |
| *** burgerk has joined #openstack-infra | 14:27 | |
| *** pcaruana has quit IRC | 14:28 | |
| *** rossella_ has joined #openstack-infra | 14:28 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/glean: Mock systemlock on glean tests https://review.openstack.org/291399 | 14:28 |
| yolanda | mordred, greghaynes ^ | 14:28 |
| *** abregman is now known as abregman|mtg | 14:28 | |
| *** aorourke-afk is now known as aorourke | 14:28 | |
| *** MarkAtwood has joined #openstack-infra | 14:28 | |
| *** ansiwen has quit IRC | 14:29 | |
| *** mriedem is now known as mriedem_meeting | 14:30 | |
| *** rossella_s has quit IRC | 14:30 | |
| AJaeger | mattymo: just push a new version of the change, it will remove the WF-1 | 14:30 |
| mordred | yolanda: looks great | 14:30 |
| *** roxanagh_ has joined #openstack-infra | 14:31 | |
| AJaeger | mattymo: you don't need any of us for that... | 14:31 |
| *** yamahata has quit IRC | 14:31 | |
| *** dtantsur is now known as dtantsur|brb | 14:32 | |
| *** ansiwen has joined #openstack-infra | 14:33 | |
| fungi | did anybody end up helping smarcet with openstackid.org log review? he's dropped off channel, need to know if i should hunt him down elsewhere in case we have a production issue with that | 14:33 |
| *** mtanino has quit IRC | 14:34 | |
| fungi | also looks like someone's taking care of jenkins06? it's in shutdown and running no jobs... no idea for how long. if nobody's working on it, i can clean it up and restart it now | 14:34 |
| anteaya | fungi: I am not helping smarcet | 14:35 |
| *** yamamoto has joined #openstack-infra | 14:35 | |
| *** yamamoto has quit IRC | 14:36 | |
| anteaya | fungi: I have no info on jenkins06 other than it needs some attention | 14:36 |
| anteaya | pabelanger: you noting over the weekend that the cpu for stackalytics.o.o is at capacity for the user: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=2905&rra_id=all | 14:36 |
| anteaya | pabelanger: do you have any thoughts on how we should proceed here? | 14:36 |
| anteaya | s/noting/noted | 14:37 |
| openstackgerrit | Andrey Pavlov proposed openstack-infra/project-config: ec2-api job: remove tempest from rally job https://review.openstack.org/292418 | 14:37 |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: 'All Boards and Worklists' Page https://review.openstack.org/279753 | 14:37 |
| mattymo | AJaeger, oh ok. Thanks :) | 14:37 |
| *** pfallenop has quit IRC | 14:37 | |
| fungi | mattymo: taken care of now | 14:37 |
| *** rlandy has joined #openstack-infra | 14:40 | |
| fungi | mattymo: but in the future, yes a trivial rebase will preserve code review votes while removing workflow votes. though it will also remove verified votes, which if it's time-sensitive can be an additional delay to keep in mind since it goes back through the check pipeline in zuul again | 14:40 |
| dhellmann | EmilienM, AJaeger : let me know if you need me to look at that release notes job -- I don't see logs from https://review.openstack.org/#/c/292398/ at http://logs.openstack.org/fd/fd328e0f0f262cb627ca7d2e058090d47d4edae9/ yet | 14:41 |
| EmilienM | dhellmann: job still in post queue - will keep you updated | 14:42 |
| *** akrivoka has joined #openstack-infra | 14:42 | |
| dhellmann | EmilienM : ah, there it is | 14:42 |
| *** gsagie has left #openstack-infra | 14:43 | |
| fungi | ianw: i have temporarily relocated /srv/static/tarballs/package-afs-centos7/package-afs-centos7 on static.o.o into my homedir, so can easily restore it if that wasn't what you wanted removed | 14:45 |
| *** dprince has quit IRC | 14:45 | |
| *** x00350071__ has quit IRC | 14:45 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Improved User Locking Procedure https://review.openstack.org/292425 | 14:47 |
| *** x00350071 has joined #openstack-infra | 14:48 | |
| *** nmagnezi has quit IRC | 14:48 | |
| *** esikachev has joined #openstack-infra | 14:48 | |
| *** mriedem_meeting is now known as mriedem | 14:49 | |
| anteaya | infra-root: can someone disable gerrit account 19917 please? This is a request of the operator: http://paste.openstack.org/show/490398/ | 14:49 |
| fungi | okay, jenkins06 is on its way back up now | 14:49 |
| fungi | anteaya: i've set that account inactive. there seem to be no established connections for it | 14:50 |
| *** fawadkhaliq has quit IRC | 14:51 | |
| *** fawadkhaliq has joined #openstack-infra | 14:51 | |
| *** yaume has joined #openstack-infra | 14:52 | |
| *** yamamoto has joined #openstack-infra | 14:52 | |
| anteaya | fungi: thank you | 14:53 |
| *** sshnaidm has quit IRC | 14:53 | |
| anteaya | and thanks for jenkins06 too | 14:53 |
| *** abregman|mtg is now known as abregman | 14:53 | |
| *** yaume has quit IRC | 14:55 | |
| *** yaume has joined #openstack-infra | 14:55 | |
| *** sfinucan has joined #openstack-infra | 14:59 | |
| openstackgerrit | Merged openstack-infra/openstackid: Improved User Locking Procedure https://review.openstack.org/292425 | 14:59 |
| *** Hal has joined #openstack-infra | 15:01 | |
| *** yaume_ has joined #openstack-infra | 15:01 | |
| *** Hal is now known as Guest10733 | 15:01 | |
| *** yaume has quit IRC | 15:01 | |
| *** yaume__ has joined #openstack-infra | 15:01 | |
| *** Qiming has quit IRC | 15:03 | |
| SamYaple | AJaeger: re https://review.openstack.org/#/c/292187/ | 15:03 |
| SamYaple | I get order is importnant , but i dont understand how that file is parse. put the skip-if at the top or bottom? | 15:04 |
| openstackgerrit | Sam Yaple proposed openstack-infra/project-config: Do not run gate jobs when doing docs-only patch https://review.openstack.org/292187 | 15:06 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Fix on Assets url default value https://review.openstack.org/292439 | 15:06 |
| SamYaple | im going to guess top. lets find out! | 15:06 |
| *** yaume_ has quit IRC | 15:06 | |
| SamYaple | mordred: whens the next shade tag? have an ansible PR i would love to get into 2.1 but i need a shade tag | 15:07 |
| AJaeger | EmilienM: http://docs.openstack.org/releasenotes/puppet-keystone/unreleased.html looks good to me now... | 15:08 |
| EmilienM | dhellmann, AJaeger: awesome. We'll never know what happenned | 15:08 |
| AJaeger | EmilienM: seems that post job wsa not run at all - and I don't know why. | 15:09 |
| EmilienM | this is not the first time I've seen it | 15:09 |
| *** IlyaG has joined #openstack-infra | 15:09 | |
| anteaya | a post job disappearing? | 15:09 |
| EmilienM | a releasenote post job not publishing doc | 15:11 |
| *** vgridnev has quit IRC | 15:11 | |
| EmilienM | but I might have dreamt | 15:11 |
| *** jpr has joined #openstack-infra | 15:12 | |
| AJaeger | anteaya: I haven't found logs for the post job of the last two changes | 15:12 |
| anteaya | oh my | 15:12 |
| fungi | EmilienM: AJaeger: anteaya: if we restart zuul for maintenance or something, we only reenqueue the previous check and gate pipeline states. other pipelines (post, experimental, et cetera) are lost if they were queued at the time we stopped zuul | 15:12 |
| anteaya | oh, so any logs for those jobs would be lost | 15:13 |
| AJaeger | fungi, yes, that would explain it. | 15:13 |
| fungi | if you know roughly what time it went into post, we could probably track down whether we were restarting zuul a little while after that | 15:13 |
| anteaya | AJaeger: ah okay, so also the job wouldn't have finished running | 15:13 |
| *** vgridnev has joined #openstack-infra | 15:13 | |
| *** IlyaG has quit IRC | 15:13 | |
| *** amotoki has quit IRC | 15:14 | |
| *** hdd has joined #openstack-infra | 15:14 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: Use centos7-mitaka repo for trunk https://review.openstack.org/292448 | 15:14 |
| *** esker has quit IRC | 15:15 | |
| AJaeger | anteaya: it might not have started yet... | 15:15 |
| *** yaume__ has quit IRC | 15:15 | |
| *** tonytan4ever has quit IRC | 15:16 | |
| *** jpr has quit IRC | 15:16 | |
| *** mika has quit IRC | 15:16 | |
| *** mika has joined #openstack-infra | 15:16 | |
| *** mika has joined #openstack-infra | 15:16 | |
| *** ddieterly has joined #openstack-infra | 15:17 | |
| openstackgerrit | Merged openstack-infra/openstackid: Fix on Assets url default value https://review.openstack.org/292439 | 15:17 |
| yolanda | greghaynes, around to review glean fix? https://review.openstack.org/291399 | 15:18 |
| *** tzn has quit IRC | 15:18 | |
| *** EricGonczer_ has joined #openstack-infra | 15:18 | |
| *** tonytan4ever has joined #openstack-infra | 15:19 | |
| *** corvus is now known as jeblair | 15:21 | |
| *** daemontool has quit IRC | 15:22 | |
| *** daemontool has joined #openstack-infra | 15:23 | |
| *** links has quit IRC | 15:23 | |
| *** ig0r__ has joined #openstack-infra | 15:23 | |
| anteaya | AJaeger: if a job didn't start, how can you expect it to have logs, as you had said logs were missing | 15:24 |
| *** regXboi has joined #openstack-infra | 15:25 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Use centos7-mitaka repo for trunk https://review.openstack.org/292448 | 15:25 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Move tripleo.sh into tripleo-ci repo https://review.openstack.org/272210 | 15:25 |
| AJaeger | anteaya: I didn't know that it didn't start - so going backward: Tehre are no jobs, so most likely it was not started... | 15:26 |
| *** doug-fis_ has joined #openstack-infra | 15:26 | |
| *** EricGonczer_ has quit IRC | 15:26 | |
| *** ig0r_ has quit IRC | 15:26 | |
| *** Swami has joined #openstack-infra | 15:26 | |
| anteaya | AJaeger: ah okay thanks | 15:27 |
| anteaya | sorry I got confused | 15:27 |
| *** doug-fish has quit IRC | 15:27 | |
| AJaeger | no worries - we needed to figure out why this didn't work - and that it works now ;) | 15:28 |
| *** EricGonczer_ has joined #openstack-infra | 15:28 | |
| anteaya | yup | 15:29 |
| *** tsg has joined #openstack-infra | 15:29 | |
| *** jpr has joined #openstack-infra | 15:30 | |
| *** mriedem is now known as mriedem_meeting | 15:30 | |
| *** yamamoto has quit IRC | 15:30 | |
| *** salv-orlando has quit IRC | 15:31 | |
| EmilienM | what are the plans to have Ubuntu 16.04 LTS nodes in nodepool? | 15:32 |
| anteaya | you ask a good question | 15:32 |
| anteaya | and I have an item on tomorrow's meeting agenda to discuss those and other questions about operating systems | 15:32 |
| anteaya | so we can create a plan | 15:32 |
| anteaya | as I don't believe we have one yet | 15:32 |
| *** salv-orlando has joined #openstack-infra | 15:33 | |
| *** armax has quit IRC | 15:33 | |
| anteaya | https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting | 15:33 |
| *** EricGonczer_ has quit IRC | 15:33 | |
| anteaya | EmilienM: feel free to add your questions or items of fact to the etherpad | 15:33 |
| anteaya | and hopefully you will be available for tomorrow's meeting item, if we have time to get to it | 15:34 |
| anteaya | not meaning to circumvent discussion now in channel if folks want to talk about it | 15:34 |
| anteaya | but also would be good to have thoughts on the etherpad so we can track any agreements if we create them | 15:34 |
| AJaeger | AFAIK WE first want to switch the devstack-trusty to ubuntu-trusty to have just one image - and first need to figure out some things with ubuntu-trusty... | 15:35 |
| *** armax has joined #openstack-infra | 15:35 | |
| *** vgridnev has quit IRC | 15:35 | |
| fungi | yep. also i don't expect us to be providing xenial images officially before xenial is officially released. that's still more than a month away | 15:37 |
| AJaeger | fungi, did you come up with some ideas for the "database setup" for ubuntu-trusty? | 15:38 |
| *** harlowja_at_home has joined #openstack-infra | 15:38 | |
| * AJaeger also checked how to migrate from devstack-trusty to ubuntu-trusty but didn't come up with a good idea, so won't volunteer to do the first steps... | 15:39 | |
| *** kencjohnston has joined #openstack-infra | 15:40 | |
| mordred | fungi: agree. however, anteaya, EmilienM, the next step in our ability to provide them when they exist will be making sure that we can build an ubuntu-xenial image with diskimage-builder | 15:40 |
| mordred | it should be possible for people who are interested in having access ot xenial sooner rather than later to do the leg work to make sure such a thing builds and work | 15:40 |
| *** davideagnello has quit IRC | 15:41 | |
| EmilienM | I don't expect xenial available today, but I'm already doing planning for our next cycle, Xenial now uses systemd and it will require some work to continue CI on it | 15:41 |
| mordred | yah | 15:41 |
| anteaya | mordred: are you in the mood to add that thought to the etherpad? https://etherpad.openstack.org/p/infra-operating-system-upgrades | 15:41 |
| EmilienM | in puppet modules, we'll have to send lot of patches | 15:41 |
| EmilienM | nothing crazy though | 15:42 |
| fungi | AJaeger: ideas as far as how to migrate unit tests off of setting up mysql/postgres if they don't use them? the best i can come up with is to send a big announcement with a list of the jobs we know need databases preconfigured for their tests, and set a deadline where we're going to stop setting it up for all other jobs and wait for projects to give us additions for that list | 15:42 |
| *** vgridnev has joined #openstack-infra | 15:42 | |
| fungi | AJaeger: a codesearch for openstack_citest might turn up a few more, though also i think some projects are using a test framework from oslo.db that might also indirectly add database dependencies | 15:43 |
| AJaeger | fungi, so have python27-db and coverage-db jobs? | 15:43 |
| fungi | AJaeger: yeah | 15:44 |
| fungi | so maybe discussing with dims or other oslo.db drivers might provide some insight | 15:44 |
| openstackgerrit | Zara proposed openstack-infra/storyboard: Add task notes to task email https://review.openstack.org/292462 | 15:44 |
| mordred | anteaya: I have added nodes | 15:45 |
| mordred | anteaya: I have added notes | 15:45 |
| anteaya | mordred: thank you for your added notes | 15:46 |
| anteaya | I apprciate it | 15:46 |
| *** bpokorny has joined #openstack-infra | 15:46 | |
| *** nikil89_ has quit IRC | 15:46 | |
| *** thorst_ is now known as thorst_afk | 15:46 | |
| *** davideagnello has joined #openstack-infra | 15:47 | |
| *** fhubik has quit IRC | 15:47 | |
| dims_ | AJaeger : fungi : we should talk to rpodolyaka and zzzeek | 15:48 |
| fungi | dims_: thanks for the pointers | 15:48 |
| *** vgridnev has quit IRC | 15:48 | |
| *** tzn has joined #openstack-infra | 15:49 | |
| *** zul has joined #openstack-infra | 15:50 | |
| *** vgridnev has joined #openstack-infra | 15:50 | |
| *** Sukhdev has joined #openstack-infra | 15:50 | |
| *** tonytan4ever has quit IRC | 15:50 | |
| *** tonytan4ever has joined #openstack-infra | 15:51 | |
| *** tzn has quit IRC | 15:51 | |
| *** tzn has joined #openstack-infra | 15:51 | |
| AJaeger | dims_: on #openstack-oslo? | 15:52 |
| dims_ | AJaeger : yep | 15:52 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: WIP: Add python-db jobs https://review.openstack.org/292472 | 15:54 |
| *** apoorvad has joined #openstack-infra | 15:54 | |
| AJaeger | fungi, proof of concept for discussion ^ | 15:54 |
| *** tonytan_brb has joined #openstack-infra | 15:54 | |
| fungi | AJaeger: thanks! i'll take a look when my current meeting wraps up | 15:54 |
| clarkb | AJaeger: for the devstack-trusty to ubuntu-trusty migration there there are experimental jobs on devstack-gate to test it running on ubuntu-trusty. First step is run those, if they work/pass then stadt switching jobs over | 15:54 |
| *** tonytan4ever has quit IRC | 15:55 | |
| *** vgridnev has quit IRC | 15:55 | |
| *** ddieterly is now known as ddieterly[away] | 15:55 | |
| *** tonytan_brb has quit IRC | 15:55 | |
| AJaeger | dims, will followup later - need to leave now for roughly two hours | 15:55 |
| AJaeger | clarkb: thanks, found '{pipeline}-tempest-dsvm-full{job-suffix}' now | 15:56 |
| *** vgridnev has joined #openstack-infra | 15:56 | |
| AJaeger | with suffix dibtest | 15:56 |
| anteaya | clarkb: hello | 15:56 |
| anteaya | clarkb: anything I can help with for kibana 4? | 15:56 |
| clarkb | anteaya: someone needs to figure out how to make it less configurable | 15:57 |
| fungi | clarkb: AJaeger: yeah, i have a feeling the devstack-trusty to ubuntu-trusty migration will be pretty seamless. worst case we'll find we've silently grown dependent on one of cloud-init's python deps being preinstalled on the system | 15:57 |
| *** tonytan4ever has joined #openstack-infra | 15:57 | |
| clarkb | anteaya: I havent started that | 15:57 |
| *** sshnaidm has joined #openstack-infra | 15:58 | |
| anteaya | clarkb: what would I need to set up to see if I could figure that out? | 15:58 |
| *** jecarey has joined #openstack-infra | 15:58 | |
| clarkb | anteaya: an elasticsearch and kibana | 15:58 |
| anteaya | thanks | 15:58 |
| *** ddieterly[away] is now known as ddieterly | 15:58 | |
| *** placko_ has quit IRC | 15:58 | |
| *** vgridnev has quit IRC | 15:59 | |
| AJaeger | fungi, clarkb : I noticed that devstack nodes have a special configure script in nodepool - so wonder whether we need to replicate that one... | 15:59 |
| AJaeger | But time to leave for now... | 16:00 |
| fungi | AJaeger: thanks, will take a look | 16:00 |
| *** amitgandhinz has quit IRC | 16:01 | |
| *** daemontool has quit IRC | 16:01 | |
| *** amitgandhinz has joined #openstack-infra | 16:02 | |
| fungi | AJaeger: if you're talking about the prepare_node_devstack.sh script, that's only for the snapshot-based builds on rackspace. everywhere else it's handled by the node-devstack dib element, and we include that element when creating ubuntu-trusty images too | 16:02 |
| openstackgerrit | Brad Behle proposed openstack-infra/project-config: Create new networking-ovn-native-l3-nv check job https://review.openstack.org/289547 | 16:06 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Reset the ovs nightly https://review.openstack.org/292480 | 16:07 |
| *** ramishra has quit IRC | 16:08 | |
| *** fernnest has joined #openstack-infra | 16:09 | |
| *** pcaruana has joined #openstack-infra | 16:09 | |
| *** ramishra has joined #openstack-infra | 16:10 | |
| *** arxcruz has joined #openstack-infra | 16:10 | |
| *** jaypipes has joined #openstack-infra | 16:10 | |
| *** fawadkhaliq has quit IRC | 16:11 | |
| asselin | lennyb, fyi, I saw your comment in the 3rd party ci meeting. If you have a firewall, it's not sufficient that you use the DNS name for review.openstack.org. AFAIK firewalls are IP based, so if the ip changes, the firewall will block the new ip on that port. | 16:13 |
| fungi | in actuality, there are firewalls which have features around filtering by hostname (some resolve them at ruleset compilation, some poll semi-continuously). however it's not a popular solution among savvy firewall administrators as it reduces the security of your filter to the security of your dns resolution | 16:15 |
| *** thiagop has quit IRC | 16:17 | |
| *** gyee has joined #openstack-infra | 16:17 | |
| fungi | that said, destination-specific egress filters are an insane idea. the assumption that addresses of services you don't control won't change is specious, and as a firewall admin you set yourself up for a lot of extra work (and your users for a lot of added pain) for no appreciable decrease in risk | 16:18 |
| *** hashar has quit IRC | 16:19 | |
| asselin | completely agree on the added pain portion for users | 16:20 |
| *** mriedem_meeting is now known as mriedem | 16:21 | |
| *** tqtran has joined #openstack-infra | 16:25 | |
| *** dtantsur|brb is now known as dtantsur | 16:25 | |
| * mordred agrees with fungi | 16:25 | |
| mordred | egress filters are honestly crazypants | 16:26 |
| HeOS | Hello! I have one question to you: what do you think about a script/job on a Jenkins to abandon old requests with CR-2 (with W-1, for example) on review.openstack.org ? | 16:26 |
| anteaya | HeOS: we have that | 16:27 |
| anteaya | we disabled it | 16:27 |
| *** scheuran has quit IRC | 16:27 | |
| anteaya | about 18 months ago? | 16:27 |
| HeOS | anteaya, what the reason? | 16:27 |
| anteaya | HeOS: glance has a bot that takes care of that for them as they wanted it | 16:27 |
| anteaya | HeOS: well the way I remember the conversation going, we had more patches coming in that we could review | 16:27 |
| anteaya | so abandoning them wasn't a net beneifit to our overall workflow | 16:28 |
| anteaya | so we stopped | 16:28 |
| HeOS | anteaya, yes, we had the same for fuel-related projects some month ago, and I want to restore it. | 16:28 |
| fungi | HeOS: why would the age of a review be criteria for abandoning someone else's work? i can understand using it as criteria for prioritizing what you review, but gerrit and other gerrit clients have flexible enough querying and filtering options to make it easy to ignore things older than you care about | 16:28 |
| *** thiagop has joined #openstack-infra | 16:28 | |
| *** fawadkhaliq has joined #openstack-infra | 16:29 | |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 16:29 |
| *** kencjohnston has quit IRC | 16:30 | |
| *** yamamoto has joined #openstack-infra | 16:31 | |
| fungi | HeOS: some projects (for example, glance) have their own automation for abandoning reviews based on their team's set criteria. from a global perspective, review prioritization policy isn't something infra feels comfortable forcing on projects. rather they should be free to decide this (and hopefully come to a conclusion that even project-wide review policy is not something they ought to mandate, and | 16:31 |
| fungi | let individual reviewers prioritize what they review) | 16:31 |
| *** sdake has joined #openstack-infra | 16:31 | |
| *** abregman has quit IRC | 16:31 | |
| *** _nadya_ has quit IRC | 16:31 | |
| *** Guest59187 has quit IRC | 16:31 | |
| HeOS | fungi, those requests look like 'forgotten', for example. | 16:31 |
| fungi | HeOS: sure. are _all_ of them "forgotten"? and unimportant? | 16:32 |
| * mordred has patches outstanding almost a year old | 16:32 | |
| fungi | back when we had a global auto-abandon, i spent far too much time un-abandoning good patches of my own or from other contributors | 16:32 |
| HeOS | fungi, our management think so. | 16:32 |
| fungi | HeOS: it would be awesome to instead support free thought and the possibility that people may have their own ideas rather than being managed by someone else | 16:33 |
| fungi | and also to use the tools we make available which allow you to completely ignore old patches if you don't want to review them | 16:34 |
| fungi | but we do also empower core reviewers with default acls to abandon the changes of other contributors to their projects when necessary | 16:34 |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Add playbook to manage power state of ironic servers https://review.openstack.org/284981 | 16:35 |
| *** bryan_att has joined #openstack-infra | 16:35 | |
| *** MarkAtwood has quit IRC | 16:38 | |
| *** matrohon has quit IRC | 16:39 | |
| HeOS | fungi, if anyone has 'important' request, he can restore it. | 16:39 |
| *** NobodyCam has joined #openstack-infra | 16:39 | |
| HeOS | If you have no time to continue work, you have no headache about the request in such case. :) | 16:40 |
| *** doug-fis_ has quit IRC | 16:41 | |
| HeOS | So, as I understand, Openstack Infra team have no objections, right? I mean, if we want to do it, we can run a script to clear "old" requests. | 16:41 |
| *** kzaitsev_mb has quit IRC | 16:41 | |
| *** doug-fish has joined #openstack-infra | 16:41 | |
| *** yamamoto has quit IRC | 16:41 | |
| *** mikelk has quit IRC | 16:42 | |
| electrofelix | clarkb: heard that you've been encountering some JJB cache corruption with multiple workers | 16:43 |
| clarkb | electrofelix: fungi was the person running the commands but yes it didn't seem to actually apply the jobs | 16:43 |
| *** pfallenop has joined #openstack-infra | 16:44 | |
| electrofelix | so it skipped updating the jobs as opposed to the cache was corrupted? | 16:44 |
| clarkb | well we think maybe both | 16:44 |
| electrofelix | the sentence 'cache corruption' can mean so many things ... | 16:44 |
| clarkb | because it updated the cache to indicate the jobs were update? | 16:44 |
| clarkb | you'd need to double check with fungi but aiui the cache was "corrupted" because it was updated to indicate jobs had been updated when they had not been | 16:45 |
| clarkb | the other issue was the jobs just weren't updated | 16:45 |
| anteaya | HeOS: glance does so with a bot, which has its own gerrit group | 16:45 |
| *** tphummel has joined #openstack-infra | 16:45 | |
| *** vincentll has quit IRC | 16:45 | |
| *** armax has quit IRC | 16:46 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 16:46 | |
| *** doug-fish has quit IRC | 16:47 | |
| electrofelix | clarkb fungi: and they were when you did them without using workers? | 16:48 |
| HeOS | anteaya, :) | 16:49 |
| HeOS | anteaya, I want to use the same way to start it. | 16:49 |
| fungi | clarkb: electrofelix: observed behavior was that with --workers 2 on most masters it claimed all jobs were updated, but a lot of them hadn't been | 16:49 |
| fungi | i wasn't the one to rerun without --workers afterward, but it sounded like no cache removal was needed to get the remaining jobs updated | 16:49 |
| electrofelix | Any debug logs kept from this? Would be good to capture them and pop them into a bugzilla before we start adding debug statements to inspect closer | 16:51 |
| yolanda | i launched jjb on all jenkins after that, and no ignore cache or flush cache needed. And a bunch of new jobs were created/deleted on all jenkins masters | 16:51 |
| fungi | electrofelix: i don't know... does jenkins-jobs update create debug logging by default? | 16:51 |
| anteaya | HeOS: then you need to create a change to your acl to create a new gerrit group for the bot, follow glance's example | 16:52 |
| electrofelix | nope, you have to enable the debug log level | 16:52 |
| HeOS | anteaya, thanks. :) | 16:52 |
| anteaya | welcome | 16:52 |
| HeOS | anteaya, I'm going to do it. | 16:52 |
| fungi | electrofelix: right, then no debug log from that. we don't have it on in our default runs | 16:52 |
| anteaya | HeOS: you don't have to keep telling me | 16:53 |
| anteaya | I'm not invested in you doing it or not | 16:53 |
| anteaya | just how you implement it, if you do | 16:53 |
| HeOS | anteaya, I understand it. | 16:53 |
| electrofelix | fungi: I'm trying to think of a way it could occur, and I'm a little stumped | 16:54 |
| fungi | electrofelix: i also don't know whether it's a condition we can recreate easily. if it was dependent on the number of jobs updated (in this case the change was updating around 65% of our ~8k jobs) | 16:54 |
| fungi | that could be a tough one to retrigger | 16:54 |
| *** rcernin has quit IRC | 16:56 | |
| fungi | electrofelix: anyway, i'm mostly just keeping an eye out for it happening again, and will manually inspect the state of the cache and try some additional reruns to see what happens | 16:56 |
| electrofelix | Was there a particular change in the configs that triggered this? no reason we can't try it again on a separate instance | 16:56 |
| *** chlong has quit IRC | 16:56 | |
| electrofelix | even locally if there is something systematic it should be possible to trigger by starting at the same config state, uploading, updating to the new config state and retrying the update | 16:57 |
| electrofelix | so if you have the config change I can poke around with a local test instance in the next day or two | 16:57 |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: WIP Improve 'Tasks Assigned to Me' https://review.openstack.org/292509 | 16:57 |
| yolanda | electrofelix, we've been having these problems on massive job reconfigs, due to the move of jobs to ubuntu-trusty | 16:58 |
| yolanda | so jjb seems to be pretty unstable on long runs | 16:59 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Fix Summit Event description serialization https://review.openstack.org/292510 | 16:59 |
| fungi | well, much of the instability is that jenkins-jobs update is running for far longer than the timeout imposed by the calling process, so it's being terminated partway through | 16:59 |
| yolanda | one problem we had is puppet running jjb on top of another process already running, so that's reason for the lockfile change. But workers is another isolated problem | 16:59 |
| *** woodster_ has joined #openstack-infra | 17:00 | |
| electrofelix | do you have the config change that this occurred on so I can take a look during the week? | 17:00 |
| fungi | electrofelix: was tracking it down... there have been so many | 17:00 |
| fungi | electrofelix: the one where i observed it because i was manually running jenkins-jobs update to avoid the timeout was https://review.openstack.org/291493 | 17:01 |
| yolanda | electrofelix, i don't have it. I'd say trying some massive reconfig of jobs, create a change that updates more than 500 jobs for example | 17:01 |
| *** doug-fish has joined #openstack-infra | 17:01 | |
| *** ddieterly is now known as ddieterly[away] | 17:01 | |
| fungi | that one-liner patch applied to over 5k jobs | 17:02 |
| fungi | since there were so many, i thought trying out jjb multithreading might be useful. and it reported that it updated them all, and a spot check showed that it did indeed update at least some of them, but we found plenty of examples the next day which weren't updated | 17:03 |
| electrofelix | fungi: thanks I'll experiment with it, especially since it was working fairly well in tests done here and at redhat | 17:04 |
| *** sputnik13 has joined #openstack-infra | 17:04 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Use shade for all OpenStack interactions https://review.openstack.org/226751 | 17:04 |
| *** esikachev has quit IRC | 17:05 | |
| electrofelix | yolanda: figured it might be worth starting with a known point of failure just in case there is something else going on | 17:06 |
| electrofelix | besides the parallel code acting up | 17:06 |
| *** IlyaG has joined #openstack-infra | 17:06 | |
| *** esikachev has joined #openstack-infra | 17:06 | |
| yolanda | electrofelix makes sense | 17:06 |
| *** vgridnev has joined #openstack-infra | 17:06 | |
| fungi | electrofelix: yeah, it's such a trivial config change that it seems unlikely there's anything about the change itself contributing to the issue, but jjb has grown increasingly complex so i guess i don't know that for certain | 17:07 |
| *** yamahata has joined #openstack-infra | 17:07 | |
| *** dims has joined #openstack-infra | 17:08 | |
| openstackgerrit | Sergey Lukjanov proposed openstack-infra/project-config: Enable Ceilo plugin for Sahara dsvm jobs https://review.openstack.org/217751 | 17:08 |
| electrofelix | I presume there were no tracebacks dumped to the console during the run? | 17:08 |
| fungi | none | 17:09 |
| fungi | at least none that i saw | 17:09 |
| fungi | generally when it does that it reraises or echoes them again at the end of the run | 17:09 |
| *** dims_ has quit IRC | 17:09 | |
| fungi | or presents some sort of error at least | 17:09 |
| electrofelix | yes it should | 17:10 |
| fungi | also it seemed to pretty consistently have not updated at least certain jobs across every one of our 8 jenkins masters | 17:10 |
| electrofelix | now that's interesting | 17:10 |
| electrofelix | which jobs were they? | 17:10 |
| electrofelix | if you have one name I'll know where to look in particular | 17:11 |
| fungi | i don't recall. there wasn't anything particularly distinguishing about them, they were instantiated from the same templates and job groups as others which did update | 17:11 |
| *** nwkarsten has quit IRC | 17:11 | |
| fungi | suggested this was more from partitioning and less something about a particular job's configuration | 17:11 |
| *** nwkarsten has joined #openstack-infra | 17:12 | |
| electrofelix | you mean one worker worked while the other failed to update properly? | 17:12 |
| *** shivharis has joined #openstack-infra | 17:12 | |
| *** pfallenop has quit IRC | 17:12 | |
| fungi | it seemed as if a random half (based on anecdotal observation) of the jobs didn't get their configs applied, but it was the same set across all masters as far as we saw | 17:13 |
| *** pfallenop has joined #openstack-infra | 17:13 | |
| *** pfallenop has joined #openstack-infra | 17:13 | |
| electrofelix | interesting, jobs are sorted by name so that would help the consistency | 17:13 |
| fungi | so presumably chosen based on a deterministic hash order or something | 17:13 |
| fungi | oh, or alphanumeric sort | 17:13 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Use shade for all OpenStack interactions https://review.openstack.org/226751 | 17:14 |
| fungi | we didn't carefully survey which jobs were impacted and which weren't, we just saw that some were broken across the board and initiated another update without --workers | 17:14 |
| shivharis | fungi: hi | 17:14 |
| *** dizquierdo has quit IRC | 17:14 | |
| fungi | so i don't know if it was, for example, all jobs in the second half of the alphabet or something | 17:15 |
| *** arxcruz has quit IRC | 17:15 | |
| fungi | given that most of the jobs in question started with gate-{name}- so it would have been impacting projects in one half of the alphabet or the other if that were the case | 17:15 |
| *** sdake_ has joined #openstack-infra | 17:15 | |
| fungi | shivharis: hi, nice weather we're having | 17:15 |
| shivharis | fungi: I seem to have lost +2 access to vendor repo networking-brocade - how do i get this back? | 17:16 |
| *** nwkarsten has quit IRC | 17:16 | |
| fungi | shivharis: i'll look | 17:16 |
| electrofelix | fungi: starting to suspect a python threading queue size limit | 17:16 |
| *** sc68cal has joined #openstack-infra | 17:17 | |
| *** e0ne has quit IRC | 17:17 | |
| shivharis | fungi: thanks | 17:17 |
| fungi | electrofelix: that sounds plausible, and would explain why we might not see it without threading | 17:17 |
| *** esikachev has quit IRC | 17:17 | |
| electrofelix | yes, since it defaults to calling the original function directly for n_workers = 1 | 17:17 |
| *** eil397 has joined #openstack-infra | 17:17 | |
| *** sdake has quit IRC | 17:17 | |
| *** IlyaG has quit IRC | 17:17 | |
| fungi | shivharis: i see you listed at https://review.openstack.org/#/admin/groups/566,members but perhaps you have multiple accounts? | 17:18 |
| fungi | shivharis: what account id do you see when you go to https://review.openstack.org/#/settings/ | 17:18 |
| shivharis | sharis@brocade.com | 17:18 |
| shivharis | maybe i should login as shivharis@hotmail.com (maybe) | 17:19 |
| fungi | shivharis: that looks like a very strange number. is that really what you see listed as the account id on the page i asked about? | 17:19 |
| shivharis | i'll try that | 17:19 |
| fungi | shivharis: yes, logging into login.launchpad.net with different e-mail addresses creates different gerrit accounts | 17:19 |
| *** kzaitsev_mb has joined #openstack-infra | 17:19 | |
| *** esikachev has joined #openstack-infra | 17:20 | |
| *** thorst_afk is now known as thorst_ | 17:20 | |
| *** eharney has quit IRC | 17:20 | |
| shivharis | the page you pointed to shows: shivharis@hotmail.com | 17:20 |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Start adding test for bifrost dhcp https://review.openstack.org/292521 | 17:20 |
| yolanda | TheJulia ^ | 17:20 |
| fungi | shivharis: i seriously doubt that is what it says next to account id, since the account id field is constrained in the database to strictly type int data | 17:21 |
| TheJulia | yolanda: :) | 17:21 |
| fungi | shivharis: more likely you're telling me what you see in the email address field | 17:21 |
| fungi | shivharis: which was not what i asked | 17:21 |
| shivharis | fungi: sorry i goofed, 5217 | 17:22 |
| yolanda | TheJulia, i got plenty of timeouts when running on my vms,but i hope we get better results on upstream | 17:22 |
| anteaya | timothyb89: is https://review.openstack.org/#/c/287373/ ready for infra to vote on its inclusion? or are you still gathering reviews for the form of the spec? | 17:23 |
| TheJulia | yolanda: :( I guess we shall see :) | 17:23 |
| *** ddieterly[away] is now known as ddieterly | 17:24 | |
| yolanda | i hope the performance is better | 17:24 |
| *** MarkAtwood has joined #openstack-infra | 17:24 | |
| *** esikachev has quit IRC | 17:24 | |
| fungi | shivharis: confirmed, there is no 5217 in the networking-brocade-core group members table. i see a 5217 which seems to also belong to "Shiv Haris" but with the hotmail.com address | 17:24 |
| fungi | shivharis: er, paste error there, sorry | 17:24 |
| timothyb89 | anteaya: still gathering reviews I think, there's still some details we'd like input on | 17:24 |
| *** jordanP has quit IRC | 17:25 | |
| electrofelix | yolanda fungi: just two more data point needed, are the jobs updated by talking directly to each jenkins master? and is the update done locally such as talking to localhost:8080 or remotely to the masters? | 17:25 |
| *** ildikov_ has quit IRC | 17:25 | |
| anteaya | timothyb89: okay thanks, was just wondering if your agenda item was ready for specs approval and based on your answer it sounds like not yet | 17:25 |
| *** eharney has joined #openstack-infra | 17:25 | |
| *** vgridnev has quit IRC | 17:25 | |
| *** tzn has quit IRC | 17:25 | |
| timothyb89 | anteaya: sure, thanks for checking :) | 17:26 |
| yolanda | fungi, the runs are based on ansible, it connects by ssh to each jenkins master, and triggers jjb runs on each one | 17:27 |
| yolanda | i mean, electrofelix | 17:27 |
| electrofelix | and the update is done via http://localhost:8080 or something similar? | 17:28 |
| fungi | electrofelix: locally (localhost:8080) | 17:28 |
| yolanda | electrofelix, look at run_jjb.yaml in system-config/playbooks/ | 17:28 |
| fungi | electrofelix: jenkins-jobs update is being run on the jenkins master, not on a remote host | 17:28 |
| yolanda | no, not localhost | 17:28 |
| *** jistr has quit IRC | 17:28 | |
| electrofelix | ah, thanks, just want to make sure when I'm testing this, it's similar | 17:28 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Reset the ovs nightly https://review.openstack.org/292480 | 17:28 |
| yolanda | fungi, that's on puppet. But you did the workers with jjb runs? | 17:28 |
| yolanda | on ansible? | 17:28 |
| anteaya | timothyb89: :) | 17:28 |
| *** MarkAtwood has quit IRC | 17:29 | |
| fungi | yolanda: i started a gnu screen session on the jenkins masters and ran jenkins-jobs update in it, i haven't tried out the ansible playbook yet. however the ansible playbook also runs jjb directly (locally) on each jenkins master, not over the network | 17:29 |
| wznoinsk | heuston: hi | 17:29 |
| yolanda | fungi yep, just connects by ssh and triggers the job there | 17:29 |
| wznoinsk | infra: hi | 17:30 |
| wznoinsk | http://www.isitdownrightnow.com/ask.openstack.org.html | 17:30 |
| *** tzn has joined #openstack-infra | 17:30 | |
| yolanda | anyway, electrofelix, jenkins_jobs.ini is not set to localhost, but to the jenkins master url. And it's resolving to external ips | 17:30 |
| fungi | yolanda: what he's asking is whether the jenkins-job process is running on the jenkins master, and connecting to the api over the loopback interface, or whether the jenkins-jobs process is running on another machine and connecting to the jenkins api over the network | 17:30 |
| *** sfinucan has quit IRC | 17:30 | |
| *** tzn has quit IRC | 17:30 | |
| wznoinsk | ^fungi | 17:30 |
| *** tzn has joined #openstack-infra | 17:30 | |
| yolanda | ah understood. It's run on the same machine | 17:31 |
| fungi | wznoinsk: yep, it's timing out for me too | 17:31 |
| wznoinsk | ok, ball on your side then | 17:31 |
| electrofelix | yolanda fungi: thanks, it'll probably be tomorrow or Wednesday when I dig into this properly, but definitely want to make sure the worker behaviour is fixed asap | 17:32 |
| fungi | wznoinsk: as much as it can be anyway. it's a pretty opaque php webapp. i'll see if i can stumble across the problem | 17:32 |
| yolanda | electrofelix, thx | 17:32 |
| shivharis | fungi: I am clueless as to how to proceed, user account 5217 with login as shivharis@hotmail.com does not give me permission to review | 17:33 |
| *** nwkarsten has joined #openstack-infra | 17:33 | |
| fungi | shivharis: so i'm not finding a duplicate account for you in gerrit. the sharis@brocade.com address and associated openid url seem to be attached to your 5217 account which has shivharis@hotmail.com as the preferred address. what review are you seeing the problem on? | 17:34 |
| fungi | shivharis: i feel like we've already merged your duplicate accounts a year or two ago | 17:34 |
| *** jlanoux has quit IRC | 17:34 | |
| fungi | shivharis: so there's probably something else going on | 17:34 |
| yolanda | fungi, electrofelix, for the cache corruption when puppet runs on top of a running jjb, i've been working on adding lockfiles to jjb: https://review.openstack.org/292405 | 17:34 |
| shivharis | fungi: https://review.openstack.org/#/c/280976/ | 17:35 |
| fungi | shivharis: an example review url where you're unable to code review +2 would help in narrowing this down | 17:35 |
| fungi | shivharis: thanks, checking it out | 17:35 |
| *** SumitNaiksatam has joined #openstack-infra | 17:35 | |
| fungi | shivharis: are you able to vote +1 on it at least? | 17:35 |
| shivharis | fungi: no | 17:36 |
| fungi | or are you not able to vote at all? if the latter, make sure you're looking at the latest patchset (up in the pale blue bar at the top-right) | 17:36 |
| shivharis | cannot vote at all | 17:36 |
| fungi | it'll say "Patch Sets (10/10)" if you're looking at the current patchset | 17:36 |
| fungi | if you have a lower left-hand number than 10, it's an old patchset. you can't vote on old patchsets | 17:36 |
| *** jaosorior has quit IRC | 17:37 | |
| shivharis | it says Patch Sets (10/10) | 17:38 |
| electrofelix | fungi yolanda: suspect the issue with the workers is something along the lines of http://bugs.python.org/issue8237 or some unclear limit that is resulting in this fun behaviour, which may not have been seen by me in testing since I tended to use 50-100 workers which would empty the queue much faster ;-) | 17:38 |
| electrofelix | so I definitely need to test it with just 2 workers | 17:38 |
| fungi | shivharis: and when you hit the "reply" button you don't see "Code-Review -1 0 +1" options? | 17:38 |
| *** maishsk has joined #openstack-infra | 17:39 | |
| shivharis | fungi: i feel dumb, i was looking for the +2 like in the UI before. My bad. Sincerely apologize. I see +2 | 17:40 |
| shivharis | fungi: thanks | 17:41 |
| *** _nadya_ has joined #openstack-infra | 17:41 | |
| fungi | shivharis: you're welcome. the gerrit new change screen has taken a lot of people by surprise | 17:41 |
| *** gnuoy_ has joined #openstack-infra | 17:41 | |
| EmilienM | fungi: so https://review.openstack.org/#/c/288244/ got merged (UID/GID stuff) but I the file in the image is still not good. Is it expected? | 17:41 |
| *** gnuoy_ has quit IRC | 17:42 | |
| *** vgridnev has joined #openstack-infra | 17:42 | |
| EmilienM | I still see UID steal from rabbitmq http://logs.openstack.org/61/292461/1/check/gate-puppet-cinder-puppet-beaker-rspec-dsvm-centos7/4d23df2/logs/syslog.txt.gz#_Mar_14_15_52_38 | 17:42 |
| EmilienM | when i revert my workaround | 17:42 |
| fungi | EmilienM: thanks, i'll see if the image where that ran didn't get uploaded for some reason | 17:42 |
| EmilienM | where do you check if Puppet was run on the image? | 17:43 |
| fungi | EmilienM: nodepool image builder logs at http://nodepool.openstack.org/ | 17:43 |
| EmilienM | oh... right | 17:44 |
| EmilienM | I can look myself then | 17:44 |
| *** vgridnev has quit IRC | 17:45 | |
| fungi | EmilienM: okay, so this ran on a devstack-centos7 worker in internap-nyj01 at 15:45 utc today. best case it was using an image from yesterday, and the change merged in time to end up on the image builds from friday | 17:45 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: WIP: Add python-db jobs - for nova initially https://review.openstack.org/292472 | 17:46 |
| *** Ryan_Lane has left #openstack-infra | 17:46 | |
| *** ddieterly is now known as ddieterly[away] | 17:46 | |
| fungi | EmilienM: i think image uploads there are failing. most recent devstack-centos7 image uploaded to internap-nyj01 is almost 10 days old. checking whether it's similarly outdated elsewhere | 17:46 |
| *** sridhar_ram has joined #openstack-infra | 17:47 | |
| AJaeger | fungi, yes I meant the prepare_node_devstack script - glad to learn that we have it... | 17:47 |
| EmilienM | ok so my UID/GID error is valid then | 17:47 |
| fungi | we definitely have devstack-centos7 dib builds as recent as a day ago | 17:47 |
| EmilienM | but upload failed | 17:47 |
| EmilienM | where are upload logs? in n.o.o ? | 17:48 |
| fungi | yeah, we don't have those exposed yet. traditionally we feared openstack client libraries did a poor job of sanitizing credentials in debug level logs and tracebacks | 17:48 |
| fungi | there are patches landing or landed to switch over to shade 100% in nodepool, after which i think we're probably considering publishing the remaining log files | 17:49 |
| fungi | anyway, uploads to internap-nyj01 look pretty inconsistent across the board, not just for devstack-centos7 | 17:49 |
| *** _nadya_ has quit IRC | 17:49 | |
| mgagne | fungi: please tell me more | 17:49 |
| fungi | and we definitely have devstack-centos7 images successfully uploading in other providers daily it seems | 17:50 |
| fungi | mgagne: yep, looking for any correlations and then i'll hunt down what we logged | 17:50 |
| *** shivharis has quit IRC | 17:51 | |
| *** bdemers has quit IRC | 17:51 | |
| *** bdemers has joined #openstack-infra | 17:53 | |
| *** jecarey has quit IRC | 17:53 | |
| *** esikachev has joined #openstack-infra | 17:54 | |
| *** vgridnev has joined #openstack-infra | 17:54 | |
| *** salv-orl_ has joined #openstack-infra | 17:54 | |
| *** sbalukoff has joined #openstack-infra | 17:54 | |
| *** kzaitsev1mb has joined #openstack-infra | 17:54 | |
| *** vgridnev has quit IRC | 17:55 | |
| mgagne | fungi: is devstack-centos7 image 10 days old right now? could you try to reupload it right now? | 17:55 |
| *** kzaitsev1mb is now known as kzaitsev_mb_ | 17:56 | |
| fungi | mgagne: yeah, we have two which successfully uploaded 10 and 11 days ago. it tries to upload a new one each day. i'm trying now to decipher the uploader logging to see what happened with the one it should have tried to upload yesterday | 17:56 |
| *** kzaitsev_mb has quit IRC | 17:56 | |
| mgagne | any image ID? | 17:56 |
| mgagne | recent one | 17:56 |
| *** tpsilva has quit IRC | 17:57 | |
| *** salv-orlando has quit IRC | 17:57 | |
| fungi | that's what i'm hoping to find in the logs | 17:57 |
| *** pvaneck has joined #openstack-infra | 17:57 | |
| fungi | mgagne: 2016-03-13 18:16:03,067 DEBUG nodepool.ProviderManager: Status of image in internap-nyj01 23130318-4e27-4978-a433-a4959571fad4: ACTIVE | 17:57 |
| fungi | i think that's the one. still reading logs to find out how the story ends | 17:58 |
| fungi | nope, tat's devstack-trusty | 17:58 |
| mgagne | yea, it's active :D | 17:59 |
| *** salv-orl_ has quit IRC | 17:59 | |
| fungi | right, that one updated fine, but isn't the one i'm looking for | 17:59 |
| mgagne | 8b823e1b-de54-4b89-879a-18ccbb38779a ? | 17:59 |
| *** derekh has quit IRC | 17:59 | |
| *** dtantsur is now known as dtantsur|afk | 17:59 | |
| jokke_ | anyone willing to have a look what's going on here https://review.openstack.org/#/c/290746/ | 17:59 |
| fungi | mgagne: yes! i have a traceback for that one in the UploadWorker | 18:00 |
| jokke_ | Looks like it has been in "Submitted, Merge Pending" for quite a while | 18:00 |
| fungi | mgagne: unfortunately it's a bit vague on our end... OpenStackCloudException: Image creation failed: 500 Internal Server Error: Failed to upload image 8b823e1b-de54-4b89-879a-18ccbb38779a (HTTP 500) | 18:00 |
| *** Sukhdev has quit IRC | 18:00 | |
| mgagne | fungi: ok, I'll dig on our side. we need to figure out that one, it just bothers me to no end | 18:01 |
| fungi | mgagne: i'm trying to confirm this was the missing devstack-centos7 image now | 18:01 |
| mgagne | I glance image-list your account and it looks to be the latest centos7 | 18:01 |
| mgagne | Registry client request PUT /images/8b823e1b-de54-4b89-879a-18ccbb38779a raised NotAuthenticated :-/ | 18:01 |
| mgagne | in our logs | 18:01 |
| *** schipiga has quit IRC | 18:02 | |
| fungi | mgagne: yeah, there aren't enough breadcrumbs in this log for me to sort out which thread is which | 18:02 |
| *** esikachev has quit IRC | 18:02 | |
| Shrews | fungi: which version of shade is that exception from? | 18:02 |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 18:02 |
| fungi | because that traceback is immediately after a log entry about uploading an ubuntu-trusty image to internap-nyj01, not devstack-centos7 | 18:03 |
| *** _nadya_ has joined #openstack-infra | 18:03 | |
| fungi | Shrews: i see shade==1.5.1 # git sha 543954d installed now, but not sure what was installed the last time the image builder was restarted. checking for a start date on it now | 18:03 |
| Shrews | fungi: ok. just validating that it is 1.5.1 | 18:04 |
| *** _nadya_ has quit IRC | 18:04 | |
| Shrews | fungi: which is the latest | 18:04 |
| fungi | Shrews: restarted march 8 at 04:06 utc, but now i recall mordred saying he had hand-patched the change which was eventually released as 1.5.1 into the server before restarting | 18:04 |
| *** ybathia has joined #openstack-infra | 18:04 | |
| anteaya | I don't understand why I am getting this view: https://review.openstack.org/gitweb?p=openstack/glance_store.git;a=commitdiff;h=93fd6238f18511c231603ddaa1747b4ea381a9a6 when I click on related changes in this patch that jokke_ is asking about: https://review.openstack.org/#/c/290746 | 18:05 |
| fungi | Shrews: so what's imported into the running builder should be _equivalent_ to 1.5.1 | 18:05 |
| anteaya | this was the view I was hoping for: https://review.openstack.org/#/c/291495/ | 18:06 |
| Shrews | fungi: ack. i'm no help then. but speaking of shade, we need heat enabled in our devstack jobs, if you find time later: https://review.openstack.org/291371 | 18:06 |
| anteaya | sorry I guess it was the stable/mitaka one I needed: https://review.openstack.org/#/c/291682/ | 18:07 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: WIP: Add python-db jobs - for nova initially https://review.openstack.org/292472 | 18:07 |
| mgagne | fungi: what bothers me is that trusty works fine but not centos7 | 18:07 |
| fungi | mgagne: i wonder if it's image size related | 18:08 |
| anteaya | jokke_: oh look gerrit has left a note identifying the issue: The following dependency errors were found: | 18:08 |
| anteaya | Depends on patch set 1 of I62cc0374, however the current patch set is 3. | 18:08 |
| mgagne | fungi: is one significantly a different size from the other? | 18:08 |
| *** Sukhdev has joined #openstack-infra | 18:09 | |
| anteaya | jokke_: try rebased on master now taht I62cc0374 has merged | 18:09 |
| fungi | i'm working up a comparison now | 18:09 |
| anteaya | s/rebased/rebasing | 18:09 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Use shade for all OpenStack interactions https://review.openstack.org/226751 | 18:10 |
| *** ihrachys has quit IRC | 18:10 | |
| *** e0ne has joined #openstack-infra | 18:11 | |
| *** _nadya_ has joined #openstack-infra | 18:11 | |
| *** Sukhdev has quit IRC | 18:11 | |
| *** ildikov_ has joined #openstack-infra | 18:12 | |
| *** flepied1 has joined #openstack-infra | 18:12 | |
| *** Roamer` has quit IRC | 18:13 | |
| *** nwkarsten has quit IRC | 18:13 | |
| AJaeger | fungi, I updated 292472 - and used nova as guinea-pig. Patch is still named WIP but could merge if that's the right approach. Take your time with reviewing, I just wanted to give a full example - so, no urgency... | 18:13 |
| *** vdrok has quit IRC | 18:13 | |
| *** Roamer` has joined #openstack-infra | 18:13 | |
| *** flepied has quit IRC | 18:14 | |
| fungi | mgagne: do you happen to know whether we're uploading raw or qcow2 to internap? looks like probably raw? | 18:14 |
| *** abregman has joined #openstack-infra | 18:14 | |
| *** harlowja_at_home has quit IRC | 18:14 | |
| fungi | AJaeger: yep--thanks for putting that together! it's on my radar if things calm down a little more today | 18:14 |
| *** doug-fish has quit IRC | 18:15 | |
| mordred | fungi: should be qcow2 according to os-client-config | 18:15 |
| *** rossella_ has quit IRC | 18:15 | |
| fungi | aha, that's where i was supposed to be looking. thanks mordred | 18:15 |
| mgagne | fungi: checking | 18:15 |
| mordred | fungi: os_client_config/vendors/internap.json | 18:15 |
| mordred | fungi: if it doesn't list an image type, then that cloud supports uploading qcow2 | 18:15 |
| mgagne | qcow2 | 18:15 |
| fungi | so 5.3G for /opt/nodepool_dib/176398.qcow2 | 18:16 |
| mgagne | fungi: I think the upload takes too much time and the token expires. glance-api then cannot auth against registry and fails | 18:16 |
| fungi | which was that failed devstack-centos7 upload | 18:16 |
| mgagne | will continue to investigate that hypoethesis | 18:17 |
| mgagne | hypothesis* | 18:17 |
| mgagne | there is only 30m between image creation and failure. token is 1h IIRC | 18:17 |
| *** MarkAtwood has joined #openstack-infra | 18:18 | |
| *** x00350071 has quit IRC | 18:18 | |
| *** x00350071 has joined #openstack-infra | 18:19 | |
| *** amitgandhinz has quit IRC | 18:19 | |
| *** MarkAtwo_ has joined #openstack-infra | 18:20 | |
| *** angdraug has joined #openstack-infra | 18:20 | |
| *** MarkAtwood has quit IRC | 18:20 | |
| jokke_ | anteaya: ok, cheers | 18:20 |
| *** degorenko is now known as _degorenko|afk | 18:21 | |
| *** flepied1 has quit IRC | 18:21 | |
| *** flepied has joined #openstack-infra | 18:22 | |
| *** IlyaG has joined #openstack-infra | 18:22 | |
| anteaya | jokke_: if that doesn't fix it, come back | 18:22 |
| *** nwkarsten has joined #openstack-infra | 18:23 | |
| *** nwkarsten has quit IRC | 18:23 | |
| *** nwkarsten has joined #openstack-infra | 18:24 | |
| *** lucasagomes is now known as lucas-dinner | 18:25 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: WIP: Add python-db jobs - for nova initially https://review.openstack.org/292472 | 18:26 |
| *** flepied has quit IRC | 18:26 | |
| mgagne | fungi: have to go in meeting, still investigating. would there be a way to share the image file you are trying to upload? we could try to upload it ourselves in a test account and see if we can make it crash | 18:26 |
| *** kzaitsev_mb_ has quit IRC | 18:26 | |
| *** notnownikki has quit IRC | 18:26 | |
| fungi | mgagne: yeah, i could probably put it in the webroot on nodepool.o.o temporarily | 18:27 |
| mgagne | fungi: is the binary file uploaded or is it using copy from URL? | 18:27 |
| *** doug-fish has joined #openstack-infra | 18:27 | |
| fungi | mgagne: direct upload, looks like | 18:27 |
| clarkb | yes should be direct upload | 18:27 |
| *** vdrok has joined #openstack-infra | 18:28 | |
| *** xyang1 has joined #openstack-infra | 18:28 | |
| clarkb | I am working on trying to script up a way to make the multinode tests more easily reproduceable and I keep running into the "This would be so much easier if I could assume individuals have a cloud" | 18:29 |
| clarkb | to the point now where I think I am going to make that a requirement. We are building clouds that doesn't seem like a crazy request | 18:29 |
| greghaynes | ++ | 18:29 |
| fungi | mgagne: temporarily available at http://nodepool.openstack.org/176398.qcow2 and the md5sum of that is supposed to be ca741913b2d3956c9a2087e2e0f862d1 | 18:29 |
| mgagne | downlading now | 18:30 |
| *** angdraug has quit IRC | 18:30 | |
| fungi | clarkb: fwiw, the devstack-gate reproduction instructions mostly assume you have access to a public cloud provider | 18:30 |
| fungi | so it's not a stretch | 18:30 |
| anteaya | I agree it is a reasonable assumption | 18:31 |
| clarkb | fungi: ya I just assumed to start that booting two VM like thing with known networking would be straightforward, it turns out this is not the case if you don't have an openstack | 18:31 |
| *** tzn has quit IRC | 18:31 | |
| mgagne | fungi: going in meeting now, still downloading | 18:31 |
| fungi | mgagne: i expect it to take some time, but thanks for testing | 18:31 |
| *** tzn has joined #openstack-infra | 18:32 | |
| anteaya | clarkb: yeah I think our multinode test is a niche enough case that assuming an openstack cloud for usage is reasonable | 18:32 |
| anteaya | that might not even narrow the field enough though | 18:33 |
| clarkb | anteaya: well, the idea is to make it not niche and use it by default. Last summit sdague said before we could do that we would need a way for people to reproduce tests locally | 18:33 |
| *** electrofelix has quit IRC | 18:33 | |
| fungi | for some strained definitions of "locally" hopefully ;) | 18:33 |
| anteaya | okay | 18:33 |
| clarkb | the tests don't currently pass often enough to make that possible today either, but I want to make sure that the reproduction steps aren't a hold up for this goal | 18:33 |
| anteaya | but locally meaning laptop or workstation? | 18:33 |
| anteaya | or locally meaning any cloud you can get access to? | 18:33 |
| clarkb | anteaya: no I take the more nebulous "not in openstack infra's system and in something I control" definition | 18:34 |
| anteaya | okay | 18:34 |
| fungi | i'm hoping "locally" means some laptop or workstation with network access to a working openstack deployment | 18:34 |
| clarkb | basically anything a dev has control over | 18:34 |
| anteaya | for that definition I still think an openstack deployment is reasonable | 18:34 |
| anteaya | sdague: ^^ this is your requirement, I'm told | 18:34 |
| pc_m | Hi Folks! Any recommendations if a repo wants to use UPPER_CONSTRAINTS file for tox.ini, but has some additional packages to specify? | 18:35 |
| pc_m | Can there be multiple -c options on pip install? | 18:35 |
| fungi | pc_m: you can specify additional requirements and the constraints file will still apply to the ones it lists just fine | 18:35 |
| pc_m | fungi: cool. How does it pick those up, from the requirements.txt file we have? | 18:36 |
| fungi | pc_m: just update your requirements list to use === lines for the things you carry that aren't covered by global constraints | 18:36 |
| *** tzn has quit IRC | 18:36 | |
| AJaeger | pc_m: Are you not using global requirements? | 18:36 |
| clarkb | the top two e-r bugs are actually multinode test fails on live migration | 18:36 |
| pc_m | AJaeger: yes currently. | 18:36 |
| *** piet has joined #openstack-infra | 18:36 | |
| pc_m | fungi: So if the same requirement is in requirements and constraints, who takes precedence? | 18:37 |
| openstackgerrit | Merged openstack-infra/glean: Mock systemlock on glean tests https://review.openstack.org/291399 | 18:37 |
| AJaeger | Let's fix that then ;) Perhaps too late for Mitaka ;( | 18:37 |
| fungi | pc_m: the constraints list is not a requirements list | 18:37 |
| clarkb | all a constraints file does is say "if I have to install a package listed here I will install only the version listed here" | 18:38 |
| pc_m | fungi: Hmmm. I thought it was an either-or, | 18:38 |
| fungi | pc_m: you tell pip to install your list of requirements, and for package names which are present in the constraints list constrain them to those listed versions instead of perhaps broader versions listed in your requirements. if there's something in your requirements list not in the constraints list pip just treats it as a normal (non-constrained) requirement | 18:38 |
| pc_m | fungi: Ah. OK. Gotcha. | 18:39 |
| fungi | pc_m: conversely, a majority of the things in the constrains list are probably not going to get installed for your project | 18:39 |
| *** eglute_s is now known as eglute | 18:39 | |
| clarkb | I take that back the second and third bugs are live migration related. The new top bug is related to RDO/EPEL mirror issues | 18:40 |
| fungi | it's just a global point of agreement on specific versions of packages common across many openstack projects to help ensure they're tested with some common set of versions of things when coinstalled | 18:40 |
| *** yamahata has quit IRC | 18:40 | |
| pc_m | fungi: thanks makes sense now. | 18:40 |
| clarkb | fungi: and to ensure that if you run a test twice you use the same set of deps | 18:41 |
| *** yamahata has joined #openstack-infra | 18:41 | |
| clarkb | to make openstack deployment and testing reproduceable | 18:41 |
| *** Guest10733 has quit IRC | 18:41 | |
| fungi | clarkb: ahh, yep, and also other beneficial side effects like being able to do some testing on new versions of things before they impact a bunch of projects | 18:41 |
| *** amitgandhinz has joined #openstack-infra | 18:42 | |
| clarkb | mordred: Shrews if I os_server auto_ip a server in ansible how do I get the ip address for that server? | 18:43 |
| *** ddieterly[away] is now known as ddieterly | 18:43 | |
| pc_m | cool. Trying to update a vendor repo to use constraints as one way to help with reducing breakages. | 18:44 |
| mordred | clarkb: server['interface_ip'] or server['public_ipv4'] | 18:44 |
| clarkb | mordred: where server is registered by the os_server task? | 18:45 |
| *** gyee has quit IRC | 18:46 | |
| *** ybathia has quit IRC | 18:47 | |
| clarkb | mordred: for reproducing multinode test runs I think my plan is to have devs edit an inventory file that specifies the image name, keyname, etc. Then os_server some servers, copy in some "nodepool" info then run the reproduce script that devstack-gate writes out in its logs | 18:48 |
| mordred | clarkb: yah | 18:48 |
| clarkb | then you run ansible-playbook -i inventoryfile make-multinode.yaml | 18:49 |
| clarkb | mordred: btw the os_server docs say that both python>=2.6 and python>=2.7 are required | 18:51 |
| mordred | clarkb: oh. I read that 4 times before I saw "reproducing" | 18:51 |
| mordred | clarkb: they are not. :) | 18:51 |
| mordred | clarkb: that sounds like a great plan | 18:51 |
| *** flepied has joined #openstack-infra | 18:51 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Update Zuul Layout for Puppet OpenStack https://review.openstack.org/292555 | 18:52 |
| clarkb | mordred: semi related to that, do you know if we can make our images read only public in the clouds we use? | 18:53 |
| clarkb | I want to say that that isn't something that most clouds allow because it would pollute their currated list of images | 18:53 |
| clarkb | (I think the image uuid is recorded in jobs too so people could really reproduce if those were available) | 18:53 |
| *** ayoung has quit IRC | 18:54 | |
| mordred | clarkb: I do not believe that we can | 18:54 |
| mordred | clarkb: in any of our clouds | 18:54 |
| samueldmq | hi, I have a question/suggestion regarding our review system | 18:56 |
| clarkb | samueldmq: usually best to just ask | 18:57 |
| samueldmq | would it be possible/interesting to have Workflow-1 kept between patchsets? that means it would need to be added-removed manually | 18:57 |
| AJaeger | project-config cores, https://review.openstack.org/#/c/277892 sets up some skip-ifs for magnum - and those are added for each job. I haven't found a better way in my testing - but I'm not happy with this setup. Does anybody have good suggestions for the change? | 18:57 |
| *** akshai has quit IRC | 18:57 | |
| samueldmq | clarkb: ^ | 18:57 |
| clarkb | samueldmq: I think the reason we didn't do it that way was to allow whomever updated the WIP patch to be ready for review a way to unset the state | 18:58 |
| AJaeger | samueldmq: the good think is that they are reset, only -2 stays - that way somebody else can take over... | 18:58 |
| clarkb | samueldmq: that way if a WIP patch sits for months anyone can ick it up, make it reviewable and push it | 18:58 |
| clarkb | AJaeger: yup | 18:58 |
| AJaeger | ;) | 18:58 |
| *** akshai has joined #openstack-infra | 18:59 | |
| samueldmq | clarkb: AJaeger on the other hand we have patch with different patchsets that needed to be set as w-1 | 19:00 |
| samueldmq | and that needs to be set every time a new patchset is sent out | 19:00 |
| samueldmq | I guess anyone is able to mark a patch/remove it from W-1 | 19:01 |
| clarkb | anyone is able to change their own vote | 19:01 |
| *** HeOS has quit IRC | 19:01 | |
| clarkb | removing someone elses is only possibly by gerrit admins | 19:01 |
| fungi | or by uploading a new change | 19:01 |
| fungi | that's the reason we ended up with the current behavior | 19:02 |
| fungi | purely so that people who want to take over a wip change can "un-wip" it | 19:02 |
| AJaeger | samueldmq: what some people do: Put WIP in the title, in case they forgot to WIP the version and they know it will need a few iterations... | 19:02 |
| fungi | if we ever get to the point that we're back to using a change state instead of a vote label for work in progress, that can become more flexible | 19:03 |
| *** akrivoka has quit IRC | 19:03 | |
| samueldmq | fungi: ++ | 19:03 |
| *** angdraug has joined #openstack-infra | 19:03 | |
| jeblair | even when we had that, we had new patchsets reset the state | 19:03 |
| fungi | like granting core reviewers (or maybe anyone) the ability to set and un-set work in progress on a change, similar to how abandon/restore works now | 19:03 |
| samueldmq | fungi: yes, and a new patch could be submitted to take over | 19:03 |
| jeblair | (though, theoretically with a plugin git-review could push to a special ref to maintain the wip state) | 19:04 |
| fungi | but yeah, as jeblair points out we used to reset wip on a new patchset even when we were maintaining a form to make that a change state | 19:04 |
| *** zul has quit IRC | 19:04 | |
| samueldmq | git review --wip ? | 19:04 |
| jeblair | but in general, there is not a correct answer here; it's hard for computers to know when a patch is ready :) | 19:04 |
| samueldmq | jeblair: ++ | 19:05 |
| samueldmq | I've seen more cases where we want to keep W-1 | 19:05 |
| jeblair | the best we can do is aim for more flexibility | 19:05 |
| samueldmq | than cases where someone else wants to take it over, and remove from W-1 | 19:05 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Update Zuul Layout for Puppet OpenStack https://review.openstack.org/292555 | 19:05 |
| fungi | i believe there is a git-review change to make it possible to set arbitrary votes. the trick is making it sensible across different gerrits and somehow conveying what's appropriate for that in some metadata (e.g. .gitreview files) | 19:05 |
| samueldmq | but maybe that's just what I've been observating | 19:05 |
| jeblair | fungi: yeah, a plugin would be a much better foundation to build a git-review change like that; as just votes it has to be completely generic | 19:06 |
| *** HeOS has joined #openstack-infra | 19:06 | |
| jeblair | samueldmq: a useful observation nonetheless | 19:06 |
| fungi | right, and adding plugin detection api calls to git-review so that support can be transparently discoverable | 19:07 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Fix Summit Event description serialization https://review.openstack.org/292510 | 19:07 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add new ironic virsh commands https://review.openstack.org/292304 | 19:08 |
| samueldmq | fungi: if we could, in the current API, allow everyone to set/unset a patch as W-1 | 19:12 |
| samueldmq | fungi: we could just keep the state though patchsets, and let someone remove it manually; but that isn't possible, right? | 19:12 |
| samueldmq | jeblair: yes, I don't know how these changes work here, and what kind of data is necessary for changing a default like that | 19:12 |
| *** _nadya_ has quit IRC | 19:13 | |
| clarkb | samueldmq: yes there is no "remove other persons vote" permision in gerrit | 19:13 |
| *** jaosorior has joined #openstack-infra | 19:13 | |
| samueldmq | jeblair: so for now just sharing what I observed so far | 19:13 |
| samueldmq | clarkb: and that can be restricted to a 'type of vote' (Workflow) ? | 19:13 |
| clarkb | samueldmq: you can't do it at all | 19:13 |
| clarkb | it is something you get as the much large admin group membership but thats the only way iirc | 19:14 |
| samueldmq | clarkb: okay, so the quickest way to change it now was to stop supporting the idea of 'someone else's taking it over' and start supporting the idea of 'a WIP patch may take several patchsets to get ready (and be unset as w-1)' | 19:15 |
| samueldmq | and I guess that can be easily carried to larger discussions, where people have different observations of it | 19:16 |
| AJaeger | samueldmq: what do you think of just naming it WIP? Wouldn't that solve your issue? | 19:16 |
| samueldmq | AJaeger: that will be clearly understood as a work-in-progress | 19:16 |
| samueldmq | AJaeger: expect for some people filtering on status: for their custom dashboards | 19:16 |
| *** doug-fish has quit IRC | 19:17 | |
| samueldmq | AJaeger: I meant "label:Workflow-1" | 19:17 |
| *** doug-fish has joined #openstack-infra | 19:17 | |
| AJaeger | samueldmq: best if those people set W-1 as well - but if they forgot it... | 19:17 |
| openstackgerrit | Merged openstack-infra/openstackid-resources: Fix Summit Event description serialization https://review.openstack.org/292510 | 19:17 |
| samueldmq | AJaeger: for each patchset ? :( | 19:18 |
| samueldmq | AJaeger: that would work too | 19:18 |
| AJaeger | samueldmq: For me as core reviewer, I love that WIP is not sticky! | 19:18 |
| *** _nadya_ has joined #openstack-infra | 19:18 | |
| AJaeger | I can review a change and block the single revision from merging with giving a W-1. | 19:18 |
| samueldmq | anyways, that's not a big deal, and I am sure you guys have tons of things with higher priority than this | 19:18 |
| samueldmq | just would like to share ideas :) | 19:18 |
| anteaya | samueldmq: thanks for sharing your ideas | 19:18 |
| anteaya | and you know I'm not a guy, so I'll offer the word suggestions of: team, people, group, or folks | 19:19 |
| anteaya | as those are more inclusive to women | 19:19 |
| anteaya | :) | 19:19 |
| samueldmq | AJaeger: sure, glad that works well for you | 19:19 |
| *** esker has joined #openstack-infra | 19:20 | |
| samueldmq | okay, rephrasing | 19:20 |
| *** _nadya_ has quit IRC | 19:20 | |
| samueldmq | anyways, that's not a big deal, and I am sure you folks have tons of things with higher priority than this | 19:20 |
| samueldmq | anteaya: ^ :) | 19:20 |
| *** doug-fis_ has joined #openstack-infra | 19:20 | |
| *** ayoung has joined #openstack-infra | 19:21 | |
| samueldmq | clarkb: AJaeger: fungi: jeblair: anteaya: I appreciate your time, good discussion, thanks | 19:21 |
| anteaya | samueldmq: thank you :) | 19:21 |
| fungi | thanks samueldmq! | 19:21 |
| *** doug-fish has quit IRC | 19:21 | |
| anteaya | samueldmq: always nice to spend time with you, you are such a lovely listener | 19:21 |
| *** claudiub|2 has joined #openstack-infra | 19:22 | |
| samueldmq | anteaya: thanks, gotta listen in order to learn | 19:22 |
| anteaya | very true | 19:23 |
| *** IlyaG has quit IRC | 19:23 | |
| *** doug-fis_ has quit IRC | 19:25 | |
| *** acoles has joined #openstack-infra | 19:25 | |
| *** claudiub has quit IRC | 19:25 | |
| acoles | hi, can anyone here help me understand why these backport patches are not proceeding to the gate queue, they have +2A? https://review.openstack.org/#/c/284644 and https://review.openstack.org/#/c/289890 | 19:25 |
| clarkb | acoles: the workflow +1 needs to be reapplied to the parent | 19:26 |
| clarkb | acoles: the order of votes there was such that zuul ignored the first approval because it didn't have a code review +2 | 19:27 |
| acoles | clarkb: oic. thank you! | 19:27 |
| fungi | yeah, workflow +1 is ignored if there's no code-review +2, and then adding a code-review +2 later doesn't trigger reevaluation of whether it should get enqueued | 19:27 |
| ianw | fungi: thanks; no that was the directory to move. just avoids confusion of why there's two copies of code | 19:28 |
| fungi | ianw: cool, so i can delete it from my homedir now? | 19:28 |
| acoles | notmyname: see above ^^ and please re-apply your workflow +1 | 19:28 |
| ianw | fungi: yep | 19:28 |
| fungi | thanks! | 19:28 |
| ianw | fungi / clarkb: i think we're at the point we need a node to build | 19:29 |
| ianw | sorry, wrt centos wheel mirror | 19:29 |
| ianw | oh, probably final reviews on https://review.openstack.org/290266 (puppet-openafs to use new mirror) and maybe https://review.openstack.org/290146 (system-config add node type to puppet comments) | 19:31 |
| notmyname | acoles: fungi: so if I go to reapply a vote, it doesn't work because my vote isn't changing. so gerrit will force me to change my vote then do the +2/+A again, right? | 19:31 |
| clarkb | notmyname: you vote +0 workflow, then +1 workflow | 19:31 |
| fungi | notmyname: you can just review to unset your workflow +1 (set it back to workflow 0) and then review again to set it back to +2 | 19:32 |
| fungi | er, +1 | 19:32 |
| notmyname | right. that's my point. must unset first | 19:32 |
| *** davideagnello has quit IRC | 19:32 | |
| *** Sukhdev has joined #openstack-infra | 19:32 | |
| fungi | yep, though if someone else were taking care of it and didn't have a workflow +1 there, they could just add a second one | 19:32 |
| AJaeger | clarkb, fungi: I just run "check experimental" on a nova change and the three dibtest changes on ubuntu-trusty passed. So, that means we look already good for devstack-trusty -> ubuntu-trusty... | 19:32 |
| clarkb | AJaeger: great | 19:32 |
| fungi | AJaeger: awesome, so we haven't regressed there | 19:33 |
| AJaeger | yeah... | 19:33 |
| fungi | AJaeger: granted, the images should be basically identical to the devstack-trusty images we're building, with the exception that we're using ubuntu-minimal/simple-init instead of the ubuntu cloud base image and cloud-init | 19:33 |
| *** saw21 has quit IRC | 19:34 | |
| clarkb | we can probably just go ahead and start changing a few of those jobs at a time | 19:34 |
| *** sdake has joined #openstack-infra | 19:35 | |
| AJaeger | clarkb: do you want to send a patch? | 19:35 |
| *** ddieterly is now known as ddieterly[away] | 19:35 | |
| *** akshai has quit IRC | 19:35 | |
| clarkb | I can, probaby start with the not main set of devstack gate jobs | 19:36 |
| *** hashar has joined #openstack-infra | 19:36 | |
| *** sdake_ has quit IRC | 19:36 | |
| AJaeger | or with diskimage-builder ;) | 19:37 |
| ianw | clarkb: so we seem to have lost "image.log" on http://nodepool.openstack.org/ ... the catch-all log | 19:37 |
| ianw | i'm assuming this was not intended | 19:37 |
| *** MarkAtwo_ has quit IRC | 19:37 | |
| *** acoles has left #openstack-infra | 19:37 | |
| *** yamahata has quit IRC | 19:38 | |
| AJaeger | should we ask for new changes to use ubuntu-trusty? | 19:38 |
| *** rockyg has joined #openstack-infra | 19:38 | |
| AJaeger | I can -1 new devstack-trusty lines if I stumple over them... | 19:38 |
| fungi | i wonder if there's a clean way to test that jjb configs only declare node names we have defined as labels in nodepool | 19:39 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Update to oslo.messaging 4.5.1 https://review.openstack.org/292567 | 19:39 |
| clarkb | ianw: maybe we don't have any more builds that fall into that? | 19:40 |
| fungi | that would catch not only cargo-cult reintroduction of old types we stop providing, but also unintentional typographical errors in the node name | 19:40 |
| *** akshai has joined #openstack-infra | 19:40 | |
| *** kencjohnston has joined #openstack-infra | 19:40 | |
| clarkb | ianw: the nodepool-builder is building to that dir still | 19:40 |
| clarkb | er logging to that dir | 19:40 |
| ianw | clarkb: well yesterday i added centos-minimal builds | 19:40 |
| ianw | gate-tempest-dsvm-platform-centos7-minimal: NOT_REGISTERED | 19:41 |
| clarkb | oh I know | 19:42 |
| clarkb | it is because the builder doesn't reload its config | 19:42 |
| clarkb | so there is no build job registered for centos-minimal so any builds fail without logs | 19:42 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Update Zuul Layout for Puppet OpenStack https://review.openstack.org/292555 | 19:43 |
| *** sdake_ has joined #openstack-infra | 19:43 | |
| *** ddieterly[away] is now known as ddieterly | 19:43 | |
| *** sdake has quit IRC | 19:45 | |
| *** jcoufal has quit IRC | 19:47 | |
| ianw | clarkb: hmm, ok. istr a conversation about reloading builder config and i thought we (i.e. greghaynes) had worked on that. anyway, it sounds like when someone has time if we could restart things, that would be good | 19:47 |
| openstackgerrit | Merged openstack-infra/release-tools: add version numbers to tracking dashboard https://review.openstack.org/291741 | 19:50 |
| clarkb | AJaeger: fungi I am just going to do one small chnge to get some data on ubunt-trusty then a second hcange to switch everything | 19:51 |
| clarkb | that way we don't have to hand hold jjb too much | 19:52 |
| fungi | ianw: yeah, at the moment we have to wait for there to be no builds/uploads in flight, which takes a while as some of our uploads are very, very slow | 19:52 |
| *** nwkarsten has quit IRC | 19:52 | |
| *** fawadkhaliq has quit IRC | 19:52 | |
| EmilienM | fungi: I missed the things about our image upload discussion, please let me know when image is uploaded, I'll test again | 19:53 |
| *** ayoung has quit IRC | 19:53 | |
| *** sambetts is now known as sambetts|afk | 19:53 | |
| fungi | EmilienM: will do. at the moment i think it's breaking for you in internap because we haven't had a successful devstack-centos7 image uploaded there for over a week, but mgagne us researching the upload failure from his end now | 19:53 |
| fungi | er, is researching | 19:54 |
| openstackgerrit | Madhusudhan Kandadai proposed openstack-infra/project-config: Add octavia experimental tempest job https://review.openstack.org/284875 | 19:54 |
| EmilienM | ok cool | 19:54 |
| mgagne | fungi: is there a way for you to trigger an upload? | 19:54 |
| EmilienM | AJaeger: I don't see in https://review.openstack.org/#/c/292339/1/zuul/layout.yaml how to merge both | 19:54 |
| fungi | mgagne: there will be one happening soonish, i think, if it hasn't already. i'll check the logs | 19:54 |
| *** mtanino has joined #openstack-infra | 19:56 | |
| * AJaeger implements a check for valid nodes in jenkins... | 19:56 | |
| fungi | mgagne: nope, we now have a new error today where we failed to build the devstack-centos7 image, so no upload | 19:56 |
| AJaeger | EmilienM: I was thinking along the lines of ^gate-(puppet-.*-dsvm-|tripleo-ci-f22).*$ | 19:57 |
| EmilienM | AJaeger: oh that would work indeed | 19:57 |
| *** dtardivel has quit IRC | 19:58 | |
| ianw | fungi / mgagne: yeah, my monitoring showed that, looks like an unfortunate timeout on rdoproject.org getting the rdo release rpm | 19:58 |
| fungi | ianw: is this a known issue? 2016-03-14 15:44:38,706 INFO nodepool.image.build.devstack-centos7: Cannot open: https://rdoproject.org/repos/rdo-release.rpm. Skipping. | 19:58 |
| fungi | ianw: heh, yep | 19:58 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul/layout: save TripleO CI resources https://review.openstack.org/292339 | 19:58 |
| *** kzaitsev_mb_ has joined #openstack-infra | 19:58 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Start devstack-trusty to ubuntu-trusty switch https://review.openstack.org/292572 | 19:59 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Switch rest of devstack-trusty to ubuntu-trusty https://review.openstack.org/292573 | 19:59 |
| clarkb | AJaeger: fungi something like ^ | 19:59 |
| ianw | i don't think there's much we can do about that, apart from better local mirroring for such repos which is coming | 20:00 |
| *** claudiub|2 has quit IRC | 20:01 | |
| clarkb | we somewhat intentionally don't use the mirrors for our dib builds | 20:01 |
| *** sdake_ has quit IRC | 20:01 | |
| clarkb | but that can always change I guess | 20:01 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Test Jenkins node declarations for known nodes https://review.openstack.org/292574 | 20:02 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: TESTING node test - do not merge https://review.openstack.org/292575 | 20:02 |
| AJaeger | clarkb, fungi: tests for invalid nodes ^ | 20:02 |
| AJaeger | unfortunately it fails ;( | 20:03 |
| fungi | or perhaps firtunately? | 20:03 |
| fungi | fortunately | 20:03 |
| fungi | assuming it fails by finding more cleanup | 20:03 |
| *** HeOS has quit IRC | 20:03 | |
| *** ig0r_ has joined #openstack-infra | 20:03 | |
| *** placko_ has joined #openstack-infra | 20:04 | |
| clarkb | btw we have to use the rdo repo beacuse many packages that openstack depends on apparently go in rdo too | 20:04 |
| clarkb | ovs being a big example | 20:04 |
| fungi | ianw: i think clarkb also mentioned the current top elastic recheck bug is for epel download errors? | 20:04 |
| clarkb | fungi: oui oui | 20:04 |
| clarkb | looks relatively recent too | 20:04 |
| ianw | clarkb: i think ovs is basically *the* example | 20:04 |
| fungi | so could be entirely related | 20:04 |
| *** HeOS has joined #openstack-infra | 20:05 | |
| ianw | AJaeger: last night i added centos-7 nodes too, just one experimental devstack job atm | 20:05 |
| fungi | ianw: the _current_ example, but once you let that horse out of the barn it's hard to get it back | 20:05 |
| clarkb | yup RDO/EPEL mirror issues bug picked up a bunch of hits just today | 20:06 |
| AJaeger | ianw, the test does not work - it can ony handle direct declarations but no variable substitution ;( | 20:07 |
| clarkb | however our categorization rate is low | 20:07 |
| AJaeger | so, not worth it ;( | 20:07 |
| *** ig0r__ has quit IRC | 20:07 | |
| * AJaeger abandons... | 20:07 | |
| *** salv-orlando has joined #openstack-infra | 20:08 | |
| *** jaosorior has quit IRC | 20:08 | |
| *** dimtruck is now known as zz_dimtruck | 20:08 | |
| ianw | in terms of devstack, i thought i added code to skip installing that stuff if it was already installed. maybe it's up there with my memory of builder reconfiguration (i.e., an aspirational memory :) | 20:08 |
| *** jaosorior has joined #openstack-infra | 20:08 | |
| *** tonytan4ever has quit IRC | 20:09 | |
| ianw | oh, but i guess it's not just the release rpm if the whole mirror is down, dur | 20:09 |
| openstackgerrit | Madhusudhan Kandadai proposed openstack-infra/project-config: Add octavia experimental tempest job https://review.openstack.org/284875 | 20:10 |
| *** amrith is now known as _amrith_ | 20:10 | |
| ianw | and yeah, that's right ... we do skip rdo repo install, but we always reinstall the epel repo rpm, because we've had cases where the epel version updated inbetween image builds, so we were on an old epel release which broke | 20:11 |
| ianw | all coming back to me... | 20:11 |
| fungi | oh wow, we're over the 1k repos mark in gerrit now! | 20:12 |
| fungi | 1010 current count | 20:12 |
| *** zz_dimtruck is now known as dimtruck | 20:12 | |
| mordred | fungi: wow | 20:12 |
| mordred | fungi: that is not a small number of repos | 20:12 |
| fungi | indeed it is not | 20:12 |
| *** ybathia has joined #openstack-infra | 20:13 | |
| *** kgiusti has quit IRC | 20:13 | |
| EmilienM | not sure that's expected but our bot could not find a Launchpad URL | 20:14 |
| EmilienM | openstack | EmilienM: Error: Could not gather data from Launchpad for bug #1557154 (https://launchpad.net/bugs/1557154). The error has been logged | 20:14 |
| openstack | EmilienM: Error: Could not gather data from Launchpad for bug #1557154 (https://launchpad.net/bugs/1557154). The error has been logged | 20:14 |
| EmilienM | trying again on this channel: https://bugs.launchpad.net/aodh/+bug/1557154 | 20:14 |
| *** ociuhandu has quit IRC | 20:15 | |
| *** mrunge has quit IRC | 20:15 | |
| clarkb | mordred: if I want to delegate_to localhost and not setup ssh keys for ssh to localhost do I need an explicit connection: local? | 20:15 |
| *** MarkAtwood has joined #openstack-infra | 20:16 | |
| openstackgerrit | Steve Baker proposed openstack-infra/shade: Add environment_files to stack_create https://review.openstack.org/277559 | 20:16 |
| openstackgerrit | Steve Baker proposed openstack-infra/shade: Make get_stack fetch a single full stack https://review.openstack.org/292590 | 20:16 |
| openstackgerrit | Steve Baker proposed openstack-infra/shade: Use event_utils.poll_for_events for stack polling https://review.openstack.org/292591 | 20:16 |
| openstackgerrit | Steve Baker proposed openstack-infra/shade: Wrap stack operations in a heat_exceptions https://review.openstack.org/292592 | 20:16 |
| openstackgerrit | Steve Baker proposed openstack-infra/shade: Implement update_stack https://review.openstack.org/292593 | 20:16 |
| *** AJaeger has quit IRC | 20:17 | |
| *** AJaeger has joined #openstack-infra | 20:17 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Filter nonexistent groups in who-approves.py https://review.openstack.org/292594 | 20:17 |
| *** nwkarsten has joined #openstack-infra | 20:18 | |
| *** claudiub has joined #openstack-infra | 20:18 | |
| *** nwkarsten has quit IRC | 20:19 | |
| openstackgerrit | Merged openstack-infra/glean: Fix hostname entries in glean https://review.openstack.org/285433 | 20:19 |
| *** mrunge has joined #openstack-infra | 20:19 | |
| *** nwkarsten has joined #openstack-infra | 20:19 | |
| yolanda | woot! mordred, greghaynes ... glean tests fixed | 20:20 |
| *** davideagnello has joined #openstack-infra | 20:20 | |
| Shrews | clarkb: any chance you can get this shade project-config change approved for us? https://review.openstack.org/291371 | 20:20 |
| *** MarkAtwood has quit IRC | 20:20 | |
| *** jaosorior has quit IRC | 20:21 | |
| anteaya | yolanda: congratulations! | 20:22 |
| mordred | yolanda: woot1 | 20:22 |
| clarkb | Shrews I thibk the prefered method is to tell devstack gate to enable heat that way if heat adds or removes services that is handled for you | 20:22 |
| mordred | clarkb: yes on the connection: local | 20:22 |
| yolanda | glean hostname fix landed finally | 20:22 |
| Shrews | clarkb: oh? i was trying to follow other projects, but I can investigate the other way | 20:23 |
| anteaya | clarkb: oh I approved, should I remove my +A? | 20:23 |
| clarkb | Shrews: ya devstack-gate's feature.yaml keeps track of which microservices each service needs to run across each release | 20:24 |
| clarkb | so if you say DEVSTACK_GATE_HEAT=1 then all of that is handled for you | 20:24 |
| clarkb | I believe that is the var | 20:24 |
| anteaya | I've workflow -1'd | 20:24 |
| *** eharney has quit IRC | 20:24 | |
| Shrews | clarkb: ok. lemme check real quick | 20:25 |
| *** eharney has joined #openstack-infra | 20:25 | |
| *** ayoung has joined #openstack-infra | 20:26 | |
| mordred | a bird just flew into our house | 20:27 |
| anteaya | mordred: how do you feel about that? | 20:27 |
| mordred | well, I mean, it's not like we don't have room for it | 20:27 |
| anteaya | true | 20:28 |
| anteaya | what kind of bird | 20:28 |
| mordred | blue | 20:28 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/project-config: Enable heat service in shade jobs https://review.openstack.org/291371 | 20:28 |
| anteaya | good colour | 20:28 |
| mordred | I think bluejay | 20:28 |
| anteaya | oh | 20:28 |
| anteaya | they can wreak things | 20:28 |
| anteaya | does it have a clear path to outside? | 20:28 |
| Shrews | clarkb: yep, thanks ^^^^ cc: anteaya, mordred | 20:28 |
| SpamapS | is there anything blocking jenkins-job-builder from releasing? | 20:28 |
| anteaya | Shrews: sorry I jumped the gun there | 20:28 |
| SpamapS | There's some stuff in master right now that I'd like to consume. | 20:29 |
| fungi | EmilienM: is it doing that for all bugs, or just that bug? | 20:29 |
| SpamapS | namely, Slack notifications | 20:29 |
| Shrews | anteaya: no worries! i learned something new | 20:29 |
| anteaya | mordred: bluejays and whiskey jacks are the crow family | 20:29 |
| SpamapS | happy to install from git, but figured I'd ask | 20:29 |
| EmilienM | test https://bugs.launchpad.net/cloud-archive/+bug/1530869 | 20:29 |
| openstack | Launchpad bug 1530869 in Ubuntu Cloud Archive "ironic-conductor does not load fake driver" [Undecided,New] | 20:29 |
| EmilienM | fungi: just aodh | 20:29 |
| anteaya | Shrews: me too, I mean I'm sure I should have known that, but I didn't have that memory and those words | 20:29 |
| EmilienM | or just this bug | 20:29 |
| *** MarkAtwood has joined #openstack-infra | 20:29 | |
| anteaya | Shrews: that looks more along the lines of what clarkb was wanting to see | 20:30 |
| clarkb | SpamapS: from git is what we do | 20:30 |
| SpamapS | clarkb: say no more. ;) | 20:30 |
| fungi | EmilienM: i'm going to guess it may be a launchpad issue if it's just that one bug | 20:30 |
| clarkb | SpamapS: zaro is the person to ask about getring a release | 20:30 |
| Shrews | anteaya: yes. it's used by the actual heat jobs, too | 20:30 |
| SpamapS | meh.. git'ing | 20:31 |
| EmilienM | fungi: no worries, just in case | 20:31 |
| anteaya | Shrews: even better | 20:31 |
| mordred | anteaya: it is now out of the house | 20:31 |
| anteaya | how did it get in? | 20:31 |
| mordred | anteaya: it flew into a bedroom, so we were able to close the door behind it and then open the window | 20:31 |
| anteaya | wonderful | 20:32 |
| mordred | anteaya: it flew in through the doors that were open to the backyard because it's lovely outside today | 20:32 |
| *** jaosorior has joined #openstack-infra | 20:32 | |
| anteaya | if bluejay they learn fast, it might be back | 20:32 |
| anteaya | oh lovely day sounds lovely | 20:32 |
| *** jaosorior has quit IRC | 20:34 | |
| *** edmondsw has quit IRC | 20:35 | |
| mordred | anteaya: ++ | 20:35 |
| *** dims_ has joined #openstack-infra | 20:36 | |
| openstackgerrit | Merged openstack-infra/shade: Bug fix: Do not fail on routers with no ext gw https://review.openstack.org/289538 | 20:37 |
| *** dims has quit IRC | 20:38 | |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 20:40 |
| *** IlyaG has joined #openstack-infra | 20:42 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable heat service in shade jobs https://review.openstack.org/291371 | 20:43 |
| *** vgridnev has joined #openstack-infra | 20:44 | |
| *** vgridnev has quit IRC | 20:44 | |
| *** ddieterly is now known as ddieterly[away] | 20:44 | |
| *** maishsk_ has joined #openstack-infra | 20:46 | |
| *** asettle has joined #openstack-infra | 20:46 | |
| *** maishsk has quit IRC | 20:46 | |
| *** maishsk_ is now known as maishsk | 20:46 | |
| *** BigWillie has quit IRC | 20:46 | |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-specs: Add Nodepool Zookeeper spec https://review.openstack.org/278777 | 20:48 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul/layout: save TripleO CI resources https://review.openstack.org/292339 | 20:48 |
| jeblair | greghaynes: since we're 99.99% in agreement on the nodepool-zk spec, do you think you'll have some time we can chat and see if we can get that last 0.01%? | 20:50 |
| openstackgerrit | Brant Knudson proposed openstack-infra/release-tools: Add update_reviews tool https://review.openstack.org/290853 | 20:53 |
| *** brad_behle has joined #openstack-infra | 20:53 | |
| *** bapalm has quit IRC | 20:55 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Update Email Configuration file https://review.openstack.org/292605 | 20:56 |
| *** Sukhdev has quit IRC | 20:57 | |
| *** bapalm has joined #openstack-infra | 20:58 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Make all configuration in-repo configuration https://review.openstack.org/268386 | 20:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Remove status_url option https://review.openstack.org/291960 | 20:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Sever the forward reference from connections to their users https://review.openstack.org/291855 | 20:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Remove scheduler parameter from connection registry https://review.openstack.org/291961 | 20:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Move gerrit logic from source to connection https://review.openstack.org/291854 | 20:59 |
| *** e0ne has quit IRC | 21:00 | |
| jeblair | jhesketh: i'm wrapping my head around connections and caching; see https://review.openstack.org/291961 and parents for some simplifications that i think will make it easier to adjust. let me know what you think of the general direction | 21:01 |
| *** rhallisey has quit IRC | 21:02 | |
| *** kencjohnston has quit IRC | 21:04 | |
| *** kzaitsev_mb_ has quit IRC | 21:05 | |
| *** zeih_ has joined #openstack-infra | 21:05 | |
| *** ddieterly[away] is now known as ddieterly | 21:06 | |
| *** kzaitsev_mb_ has joined #openstack-infra | 21:09 | |
| * AJaeger waves good-bye... | 21:10 | |
| *** jpr has quit IRC | 21:13 | |
| anteaya | good night AJaeger | 21:14 |
| anteaya | have a good evening | 21:14 |
| *** matrohon has joined #openstack-infra | 21:14 | |
| *** ldnunes has quit IRC | 21:15 | |
| *** chlong has joined #openstack-infra | 21:15 | |
| *** burgerk has quit IRC | 21:15 | |
| *** weshay has quit IRC | 21:15 | |
| *** fawadkhaliq has joined #openstack-infra | 21:17 | |
| *** _ari_ has quit IRC | 21:17 | |
| *** kzaitsev_mb_ has quit IRC | 21:17 | |
| *** kzaitsev_mb_ has joined #openstack-infra | 21:18 | |
| clarkb | arg, you know what would be awesome? if cloud images all agreed to use a single user | 21:18 |
| jeblair | clarkb: maybe even the single user that's guaranteed to be on all systems... | 21:19 |
| *** sdague has quit IRC | 21:19 | |
| *** yolanda has quit IRC | 21:20 | |
| *** TheJulia has quit IRC | 21:20 | |
| *** yolanda has joined #openstack-infra | 21:20 | |
| openstackgerrit | Merged openstack-infra/shade: Test v3 params on v2.0 endpoint; Add v3 unit https://review.openstack.org/289083 | 21:21 |
| openstackgerrit | Merged openstack-infra/shade: Update create_endpoint() https://review.openstack.org/289051 | 21:21 |
| *** nwkarsten has quit IRC | 21:21 | |
| clarkb | jeblair: that would be ideal :) | 21:23 |
| *** ociuhandu has joined #openstack-infra | 21:25 | |
| *** dimtruck is now known as zz_dimtruck | 21:27 | |
| mordred | clarkb: you know what's awesome about the images _we_ make? | 21:27 |
| *** thorst_ has quit IRC | 21:28 | |
| *** zz_dimtruck is now known as dimtruck | 21:29 | |
| matbu | mordred: Shrews hey :) any chances to get this review merged https://review.openstack.org/254337 ? | 21:30 |
| *** nwkarsten has joined #openstack-infra | 21:30 | |
| *** nwkarsten has quit IRC | 21:31 | |
| *** thorst_ has joined #openstack-infra | 21:31 | |
| *** timburke_ is now known as timburke | 21:31 | |
| *** nwkarsten has joined #openstack-infra | 21:31 | |
| mordred | matbu: lgtm. we also landed turning heat on in our dsvm jobs | 21:32 |
| mordred | matbu: so for the other outstanding heat patches I think we can get folks to add some functional tests | 21:32 |
| mordred | but this one is a decently unittestable metadata munging thing | 21:33 |
| matbu | mordred: k thanks | 21:33 |
| jeblair | mordred: speaking of metadata, in nodepool-shade ps57 you str() things we're passing into instance metadata.... | 21:34 |
| *** thorst_ has quit IRC | 21:35 | |
| brad_behle | AJaeger: Thanks for the reviews of https://review.openstack.org/#/c/289547 To resolve your latest comment, is it as simple as just replacing devstack-trusty with ubuntu-trusty? Or are there other changes I need to make as well? | 21:35 |
| jeblair | mordred: what's the deal with that? :) | 21:35 |
| stevebaker | mordred: I've just proposed a shade heat series, expect some more too | 21:36 |
| *** yamahata has joined #openstack-infra | 21:37 | |
| jeblair | mordred: cause when i look in nova show, it appears we are storing ints in the metadata | 21:37 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/project-config: Add periodic-kilo/liberty jobs to openstack/designate https://review.openstack.org/292617 | 21:37 |
| *** baoli_ has quit IRC | 21:37 | |
| *** dizquierdo has joined #openstack-infra | 21:37 | |
| mordred | jeblair: I str() them because if I don't a thing complained about something - lemme find the error | 21:38 |
| openstackgerrit | Eric Harney proposed openstack-infra/project-config: Add NFS devstack plugin https://review.openstack.org/289589 | 21:38 |
| ianw | brad_behle: yes | 21:38 |
| mordred | jeblair: OpenStackCloudException: Error in creating instance (Inner Exception: Invalid input for field/attribute nodepool_snapshot_image_id. Value: 1. 1 is not of type 'string' (HTTP 400) (Request-ID: req-8b3dc924-e233-4bdd-aff6-da3d4eba43d4)) | 21:38 |
| mordred | jeblair: http://logs.openstack.org/51/226751/55/check/gate-dsvm-nodepool-src-shade/793c7dc/logs/screen-nodepool.txt.gz#_2016-03-11_18_45_03_299 | 21:39 |
| brad_behle | ianw: So yes I need to make other changes? | 21:39 |
| *** aysyd has quit IRC | 21:39 | |
| jeblair | mordred: where do i see the traceback for the inner exception? | 21:40 |
| *** regXboi has quit IRC | 21:40 | |
| mordred | jeblair: nowhere in that log output that I can see | 21:41 |
| jeblair | mordred: okay. how do we get that? | 21:42 |
| jeblair | (somehow i feel like we have done this before) | 21:42 |
| mordred | jeblair: it does seem to be an exception from nova sever, btw | 21:43 |
| mordred | jeblair: so I'm pretty sure that the traceback of the innner_exception is just going ot show that novaclient received an error from the server and reported it | 21:43 |
| jeblair | mordred: i'm willing to take your word for that, but i also feel like you probably have better things to do than be the exception oracle :) | 21:43 |
| mordred | :) | 21:44 |
| jeblair | which is why i'd love to have these actually be logged | 21:44 |
| mordred | jeblair: so - the shade exception base class has a log_error method | 21:45 |
| mordred | jeblair: which will do: if self.inner_exception and self.inner_exception[1]: | 21:45 |
| mordred | logger.error(self.orig_message, exc_info=self.inner_exception) | 21:45 |
| *** abregman has quit IRC | 21:46 | |
| *** nwkarsten has quit IRC | 21:46 | |
| mordred | jeblair: should be easy enough to add calling that to nodepool | 21:46 |
| jeblair | mordred: well wait | 21:46 |
| ianw | brad_behle: sorry ... "yes" to your question , just s/devstack-trusty/ubuntu-trusty/ :) | 21:46 |
| jeblair | mordred: i wrote this *ages* ago: https://review.openstack.org/225361 | 21:46 |
| jeblair | mordred: but then we decided shade should just log it | 21:46 |
| jeblair | mordred: so the question is, why isn't that line you pointed at right there actually producing something in our log output? | 21:47 |
| brad_behle | ianw: Thanks! Next time I won't ask two contradiction questions :-) | 21:47 |
| mordred | we did? I'm pretty sure we do not in fact want to log inner exceptions every time one exists | 21:47 |
| mordred | becuase openstack produces them at a ludicrous rate | 21:47 |
| mriedem | is this a known break? http://logs.openstack.org/17/292617/1/check/gate-project-config-layout/65d6a32/console.html#_2016-03-14_21_42_21_744 | 21:47 |
| mordred | for normal operations | 21:47 |
| mordred | making any log that normally produces them next to useless | 21:47 |
| jeblair | mordred: i thought we set it up in shade so that only unexpected ones get logged | 21:47 |
| mordred | jeblair: hrm. it's possible we should have written down what we talked about last time in english somewhere | 21:49 |
| mordred | jeblair: this feels like one of those moments where we're about to relearn whatever we learned last time | 21:49 |
| mordred | jeblair: https://review.openstack.org/#/c/249868/ is where we stopped logging them | 21:50 |
| *** piet has quit IRC | 21:50 | |
| jeblair | mordred: yeah and https://review.openstack.org/225361 is from the same date | 21:51 |
| jeblair | mordred: so that's the missing piece | 21:51 |
| *** amitgandhinz has quit IRC | 21:52 | |
| jeblair | mordred: i think we need to land that and incorporate something similar in the shade nodepool patch | 21:52 |
| jhesketh | Morning | 21:52 |
| mordred | jeblair: yah. I think you wrote that, then we did the other thing, then we never updated your patch to use the log_error method | 21:52 |
| mordred | or - maybe just your patch as written | 21:52 |
| *** NobodyCam has quit IRC | 21:52 | |
| anteaya | morning jhesketh | 21:52 |
| *** NobodyCam has joined #openstack-infra | 21:53 | |
| *** dims_ has quit IRC | 21:53 | |
| jeblair | mordred: which way do you think would be better? | 21:54 |
| jeblair | mordred: call log_error? | 21:54 |
| mordred | jeblair: I'm trying to think if there is a reason to _not_ call log_error ... | 21:54 |
| *** bookwar has left #openstack-infra | 21:54 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Log shade inner exceptions https://review.openstack.org/225361 | 21:54 |
| mordred | jeblair: but if we call log_error, the log mesage will be with the shade logger | 21:54 |
| mordred | if we don't, it'll use the nodepool logger | 21:54 |
| jeblair | mordred: it'll be at error level, which will make it past our current logging config | 21:55 |
| clarkb | mordred: ya our images don't have this problem, unfortunately I am trying to wrap my head around how to make this not terrible when shipping a genericish "give me a multinode test env" playbook | 21:55 |
| *** bookwar has joined #openstack-infra | 21:55 | |
| *** xyang1 has quit IRC | 21:55 | |
| clarkb | I can assume ubuntu and use 'ubuntu' | 21:55 |
| jeblair | mordred: i'll do log_error for now | 21:55 |
| mordred | jeblair: cool | 21:55 |
| clarkb | but thats terrible | 21:55 |
| clarkb | I am beginning to appreciate why tools like vagrant are popular | 21:55 |
| mordred | clarkb: yup | 21:55 |
| mordred | clarkb: it's because most cloud vendors go out of their way to make life hard for their users | 21:56 |
| clarkb | yup | 21:56 |
| mordred | usually in the name of "branding" | 21:56 |
| Clint | it's the only way to get the customers to appreciate you | 21:56 |
| mordred | Clint: oh. is that what this feeling is? | 21:56 |
| clarkb | I hate to make this tool using vagrant because I dislike vagrant, but it may juts be the best option | 21:56 |
| clarkb | "give me two VMs that I can know the Ips to and actually log into consistently" | 21:57 |
| clarkb | should not be a hard problem | 21:57 |
| mordred | jeblair: also - perhaps instead of wrapping client.create_image with the thing - is there a better general purpose exception handler place we can put it? | 21:57 |
| *** mriedem is now known as mriedem_away | 21:57 | |
| anteaya | clarkb: :( | 21:58 |
| jeblair | mordred: i don't think so | 21:58 |
| mordred | jeblair: k. so we need to put it in various places | 21:58 |
| anteaya | david-lyle not running for ptl is gathering quite a crowd on the mailing list | 21:58 |
| jeblair | mordred: yes (in the upcoming shade-nodepool patch) | 21:58 |
| mordred | jeblair: yah. | 21:58 |
| anteaya | david-lyle: you should consider not running for other things | 21:58 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Log shade inner exceptions https://review.openstack.org/225361 | 21:58 |
| anteaya | david-lyle: you seem to be a crowd favourite | 21:59 |
| mordred | jeblair: woot | 21:59 |
| mordred | Shrews: ^^ | 21:59 |
| jeblair | mordred: okay, that's one thing off the stack... now to the real thing -- what's the deal with metadata? | 22:00 |
| jeblair | mordred: cause in *practice* it's JSON | 22:00 |
| mordred | jeblair: the nova api now does jsonschema-based validation | 22:00 |
| jeblair | mordred: did they intend to make it string-only? | 22:00 |
| mordred | yes. I believe so | 22:00 |
| jeblair | do they know that's a field regression? | 22:01 |
| mordred | yes - I believe the behavior is opt-in with microversions | 22:01 |
| jeblair | mordred: why is this affecting the shade patch only? | 22:01 |
| mordred | and that we're getting the nova client in such a way in shade as to target a later microversion than the previous code was | 22:01 |
| mordred | jeblair: I will investigate that next | 22:02 |
| mordred | jeblair: as it is an important question to make sure we understand the answer to | 22:02 |
| jeblair | ya... | 22:02 |
| clarkb | I am just going to have to sit on this reproduce multinode testing change, not sure how to tackle it in a way that makes sense | 22:02 |
| mordred | jeblair: the field was always _Supposed_ to just be string, they just didn't validate in the old code | 22:03 |
| mordred | jeblair: so honestly we should probalby do the str() wrapping in shade - since it's always the correct thing to do at that point regardless of microversion | 22:03 |
| jeblair | mordred: i'm not at the place you are yet :) | 22:03 |
| openstackgerrit | Sam Yaple proposed openstack-infra/shade: [WIP] Add update_endpoint() https://review.openstack.org/289052 | 22:03 |
| mordred | jeblair: :) | 22:04 |
| openstackgerrit | Brad Behle proposed openstack-infra/project-config: Create new networking-ovn-native-l3-nv check job https://review.openstack.org/289547 | 22:04 |
| mordred | jeblair: so - two forks of thought here - one is to verify my hypothesis about hwy shade is triggering the newer API behavior but the shade-created raw nova client in nodepool is not | 22:04 |
| mordred | jeblair: the other is that shade is supposed to make api differences between clouds go away, so if it can munge the input data such that it works across all known cloud versions, it should | 22:05 |
| anteaya | clarkb: ack | 22:05 |
| mordred | jeblair: I'm about to get on an aeroplane which should give me a great place to track down the first side of that and get you some more information on it | 22:06 |
| anteaya | mordred: happy trails | 22:07 |
| anteaya | or skies | 22:07 |
| jeblair | mordred: cool; i'm still evaluating the problem statement | 22:07 |
| *** hashar has quit IRC | 22:08 | |
| jeblair | mordred: aha! | 22:08 |
| jeblair | mordred: the error is introduced by the nodepool-shade patch | 22:09 |
| jeblair | mordred: and i don't think it has anything to do with nova... | 22:09 |
| jeblair | mordred: currently, we json encode the nodepool metadatata into a nodepool field in the nova metadata | 22:09 |
| jeblair | mordred: (so, over the wire, it's double json encoded). this means nova sees a str value for the nodepool key | 22:10 |
| jeblair | mordred: the nodepool-shade patch removes the extra json encoding | 22:10 |
| jeblair | mordred: i think that's erroneous -- there's no reason to change that | 22:10 |
| *** hdd has quit IRC | 22:12 | |
| craige | o/ | 22:12 |
| openstackgerrit | Mark Vanderwiel proposed openstack-infra/project-config: Increase heat timeout with addition of new lbaasv2 scenario tests https://review.openstack.org/287836 | 22:13 |
| mordred | jeblair: gotcha | 22:13 |
| *** ddieterly is now known as ddieterly[away] | 22:14 | |
| *** fawadkhaliq has quit IRC | 22:15 | |
| *** fawadkhaliq has joined #openstack-infra | 22:16 | |
| jeblair | notes left on 226751 | 22:16 |
| *** krtaylor has quit IRC | 22:17 | |
| *** gmurphy has joined #openstack-infra | 22:18 | |
| openstackgerrit | Nikhil Komawar proposed openstack-infra/irc-meetings: As per the discussion, extend time to 60 mins https://review.openstack.org/292625 | 22:19 |
| *** ianychoi has joined #openstack-infra | 22:20 | |
| *** shivharis has joined #openstack-infra | 22:20 | |
| openstackgerrit | Nikhil Komawar proposed openstack-infra/irc-meetings: As per discussion, extend Quota WG time to 60 mins https://review.openstack.org/292625 | 22:21 |
| gmurphy | hey all. trying to get bandit working the gate for the octavia project. the tool i'm using is failing due to the git head being in a detached state. is that typical for how a gate job runs (detached head state)? | 22:21 |
| gmurphy | http://logs.openstack.org/08/290408/5/check/gate-octavia-tox-bandit/88be8ef/console.html is example of the failure | 22:22 |
| clarkb | gmurphy: yes I believe all but the periodic jobs run that way | 22:22 |
| gmurphy | ok. so the bandit project runs the tool in their own gate and it works - http://logs.openstack.org/51/286751/8/gate/gate-bandit-pep8/f4645c8/console.html | 22:22 |
| gmurphy | which is strange.. | 22:23 |
| clarkb | maybe they fixed that bug and haven't released it? | 22:23 |
| gmurphy | (not sure if that log gives much context) | 22:23 |
| gmurphy | hmm maybe. | 22:23 |
| clarkb | you would have to ask bandit about it | 22:23 |
| *** fawadkhaliq has quit IRC | 22:23 | |
| *** IlyaG has quit IRC | 22:23 | |
| gmurphy | ok. thanks. | 22:23 |
| shivharis | clarkb: hi | 22:24 |
| *** fawadkhaliq has joined #openstack-infra | 22:24 | |
| clarkb | shivharis: hello | 22:24 |
| *** SumitNaiksatam has quit IRC | 22:24 | |
| openstackgerrit | Steve Baker proposed openstack-infra/shade: delete_stack add wait argument https://review.openstack.org/292626 | 22:24 |
| shivharis | clarkb: do i need special access/priv to create a stable branches in vendor repos? | 22:24 |
| *** thiagop has quit IRC | 22:25 | |
| clarkb | shivharis: I don't know what a vendor repo is, but if you are talking about repos in our gerrit then yes you need the create privelege | 22:25 |
| shivharis | github.com/openstack/networking-brocade | 22:25 |
| shivharis | clarkb: ^^ | 22:25 |
| *** yamahata has quit IRC | 22:26 | |
| shivharis | clarkb: ^ | 22:26 |
| clarkb | shivharis: that is on our gerrit server so yes, you need the create priv on the branch prefix you wish to create under | 22:26 |
| *** bpokorny_ has joined #openstack-infra | 22:26 | |
| clarkb | if you grep for create in the acl file dir you should find plenty of examples | 22:26 |
| *** dims has joined #openstack-infra | 22:26 | |
| *** claudiub has quit IRC | 22:26 | |
| *** rfolco has quit IRC | 22:27 | |
| *** mrunge has quit IRC | 22:27 | |
| shivharis | clarkb: sorry, forgot where to find the acl file | 22:27 |
| *** mrunge has joined #openstack-infra | 22:27 | |
| *** gyee has joined #openstack-infra | 22:27 | |
| clarkb | shivharis: openstack-infra/project-config/gerrit/acls | 22:27 |
| shivharis | clarkb: thanks .. looking | 22:28 |
| *** bpokorny has quit IRC | 22:29 | |
| *** cody-somerville has joined #openstack-infra | 22:29 | |
| *** cody-somerville has quit IRC | 22:29 | |
| *** cody-somerville has joined #openstack-infra | 22:29 | |
| *** dimtruck is now known as zz_dimtruck | 22:30 | |
| *** maishsk has quit IRC | 22:33 | |
| *** [1]Thelo has joined #openstack-infra | 22:33 | |
| *** e0ne has joined #openstack-infra | 22:34 | |
| *** IlyaG has joined #openstack-infra | 22:34 | |
| *** IlyaG has quit IRC | 22:34 | |
| *** krtaylor has joined #openstack-infra | 22:35 | |
| *** Thelo has quit IRC | 22:36 | |
| *** [1]Thelo is now known as Thelo | 22:36 | |
| *** ddieterly[away] is now known as ddieterly | 22:37 | |
| *** matrohon has quit IRC | 22:37 | |
| shivharis | clarkb: should I send a patch-set to add the create privilege | 22:39 |
| *** markvoelker has quit IRC | 22:39 | |
| clarkb | if you need it | 22:40 |
| shivharis | yes, so the same process, file a bug and do a patch-set? | 22:40 |
| clarkb | you don't need a bug, you can just push the change | 22:41 |
| shivharis | ok, no review etc? | 22:41 |
| jeblair | clarkb, mordred, Shrews: https://review.openstack.org/225361 passes tests and is ready to merge | 22:41 |
| *** SumitNaiksatam has joined #openstack-infra | 22:42 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add wait_for_server API call. https://review.openstack.org/292631 | 22:42 |
| Shrews | mordred: ^^^^ I haven't actually tested it yet | 22:42 |
| Shrews | jeblair: have i mentioned how much i hate the shade inner exception thing? | 22:43 |
| shivharis | clarkb: i dont have permissions for openstack-infra | 22:44 |
| clarkb | shivharis: everyone does, you push it just like any other change | 22:45 |
| jeblair | Shrews: i'm not sure who likes it, actually :). | 22:45 |
| clarkb | jeblair: log_errer is not a typo? | 22:46 |
| jeblair | i mean, i wrote quite a bit of it, but only after "don't mask exceptions" went out the window | 22:46 |
| jeblair | clarkb: it probably is.. | 22:46 |
| clarkb | Shrews: caught it too | 22:46 |
| jeblair | clarkb: (and i have no idea how to force this code in a test) | 22:46 |
| Shrews | clarkb: i posted review first, so i win | 22:47 |
| clarkb | jeblair: you could monkeypatch the openstackclient fake with a raise exception that hsa log_error in it? | 22:47 |
| jeblair | 1 review point to shrewsendorfle | 22:47 |
| *** krtaylor has quit IRC | 22:47 | |
| clarkb | then ensure the log contains that log error string | 22:47 |
| *** e0ne has quit IRC | 22:49 | |
| * Shrews does dinner things | 22:49 | |
| * anteaya imagines Shrews with silver and china and lace napkins | 22:50 | |
| *** dims has quit IRC | 22:50 | |
| *** ddieterly has quit IRC | 22:50 | |
| nibalizer | oh wow was today shade-nodepool day? | 22:52 |
| jeblair | nibalizer: no, just working on the patch | 22:52 |
| *** TheJulia has joined #openstack-infra | 22:52 | |
| nibalizer | ah ok | 22:53 |
| openstackgerrit | Shiv Haris proposed openstack-infra/project-config: Adding branch creation priv to group networking-brocade-core https://review.openstack.org/292635 | 22:53 |
| jeblair | clarkb: do we have anything that checks log output in a unit test? | 22:54 |
| *** ybathia has quit IRC | 22:55 | |
| clarkb | jeblair: I don't think we do, but we do record the log input to a stringio type object | 22:55 |
| clarkb | jeblair: it is part of the logging fixture | 22:55 |
| jeblair | clarkb: k, i'll look there | 22:55 |
| shivharis | clarkb: thought bug was a requirement. pushed out the change for review. thanks for you help. | 22:56 |
| *** yamamoto_ has joined #openstack-infra | 22:56 | |
| *** yamahata has joined #openstack-infra | 22:57 | |
| *** cody-somerville has quit IRC | 22:57 | |
| *** hughhalf_ is now known as hughhalf | 22:57 | |
| *** rhallisey has joined #openstack-infra | 22:59 | |
| *** krtaylor has joined #openstack-infra | 23:00 | |
| *** yamamoto_ has quit IRC | 23:00 | |
| *** pradk has quit IRC | 23:02 | |
| *** rbrndt has quit IRC | 23:04 | |
| *** ybathia has joined #openstack-infra | 23:05 | |
| *** dingyichen has joined #openstack-infra | 23:05 | |
| *** rockyg has quit IRC | 23:07 | |
| *** placko_ has quit IRC | 23:07 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Log shade inner exceptions https://review.openstack.org/225361 | 23:07 |
| jeblair | clarkb, Shrews: ^ | 23:07 |
| *** kzaitsev_mb_ has quit IRC | 23:08 | |
| *** smcginnis is now known as smcginnis_away | 23:08 | |
| *** harlowja_at_home has joined #openstack-infra | 23:10 | |
| *** gordc has quit IRC | 23:11 | |
| *** tphummel has quit IRC | 23:16 | |
| *** tphummel has joined #openstack-infra | 23:18 | |
| *** armax has joined #openstack-infra | 23:21 | |
| *** ybathia has quit IRC | 23:21 | |
| *** dims has joined #openstack-infra | 23:21 | |
| *** gongysh has joined #openstack-infra | 23:21 | |
| *** akshai has quit IRC | 23:26 | |
| *** dims has quit IRC | 23:27 | |
| *** Sukhdev has joined #openstack-infra | 23:28 | |
| *** Sukhdev has quit IRC | 23:31 | |
| *** thorst_ has joined #openstack-infra | 23:32 | |
| *** jpr has joined #openstack-infra | 23:33 | |
| *** jpr1 has joined #openstack-infra | 23:35 | |
| SpamapS | oh wonderful | 23:35 |
| SpamapS | 5 months later.. I'm a dstat maintainer | 23:35 |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 23:37 |
| *** jpr has quit IRC | 23:37 | |
| clarkb | pabelanger: you about? wondering if grafana has an ability to cache the data returned by backend data sources so that you can tell it to not requery each time it needs to draw a graph | 23:37 |
| *** Sukhdev has joined #openstack-infra | 23:38 | |
| clarkb | pabelanger: this could be useful as a way to make the elastic-recheck graphs richer using the elasticsearch backend, but we only really want those queries to update hourly or so | 23:38 |
| *** gyee has quit IRC | 23:39 | |
| *** dizquierdo has quit IRC | 23:40 | |
| *** Sukhdev has quit IRC | 23:40 | |
| clarkb | pabelanger: the grafana renders are generally richer than what we currently have which is nice, not sure how we would auto update the queries either, but one thing at a time | 23:40 |
| *** Sukhdev has joined #openstack-infra | 23:41 | |
| *** zz_dimtruck is now known as dimtruck | 23:41 | |
| *** sdake has joined #openstack-infra | 23:43 | |
| clarkb | fungi: btw I think the reason jenkins06 was offline may have been due to the weekly restart script if it wasn't able to converge on jenkins06 | 23:44 |
| clarkb | since it will poll forever until all the offline nodes delete | 23:44 |
| *** Sukhdev has quit IRC | 23:44 | |
| *** Sukhdev_ has joined #openstack-infra | 23:44 | |
| anteaya | clarkb: I haven't seen him all day | 23:45 |
| anteaya | him being pabelanger | 23:45 |
| *** sputnik13 has quit IRC | 23:46 | |
| fungi | clarkb: yep, that's sort of what i suspected, just wanted to make sure i wasn't stepping on anyone's toes if that hadn't been the cause | 23:46 |
| *** dizquierdo has joined #openstack-infra | 23:48 | |
| *** Hal has joined #openstack-infra | 23:49 | |
| *** Sukhdev_ has quit IRC | 23:49 | |
| *** Hal is now known as Guest53749 | 23:49 | |
| *** brad_behle has quit IRC | 23:49 | |
| *** davideagnello has quit IRC | 23:49 | |
| *** Sukhdev has joined #openstack-infra | 23:49 | |
| clarkb | EmilienM: re https://review.openstack.org/#/c/288244/ is there also an effort to fix the packaging | 23:50 |
| *** ZZelle has joined #openstack-infra | 23:50 | |
| *** x00350071 has quit IRC | 23:51 | |
| *** sputnik13 has joined #openstack-infra | 23:51 | |
| *** x00350071 has joined #openstack-infra | 23:52 | |
| *** sdake has quit IRC | 23:52 | |
| EmilienM | clarkb: i've been told there is nothing to fix | 23:52 |
| clarkb | EmilienM: you should use dynamic groups in the keystone package | 23:52 |
| EmilienM | rabbitmq uses dynamic UID/GID assignment | 23:52 |
| clarkb | just like the rabbit package | 23:52 |
| clarkb | then none of this is an issue | 23:52 |
| EmilienM | I'm not aware of any effort on that | 23:52 |
| EmilienM | ianw: are you? ^ | 23:52 |
| *** yamahata has quit IRC | 23:53 | |
| clarkb | the real bug here is that your pcakages are mixing gid assignments | 23:53 |
| clarkb | the packages should not do that | 23:53 |
| *** sputnik13 has quit IRC | 23:53 | |
| jhesketh | fungi: ping | 23:54 |
| *** salv-orl_ has joined #openstack-infra | 23:54 | |
| fungi | clarkb: er, the issue seemed to be that between centos 6 and 7 the registry of static uid/gid assignments had grown past 100 and so fedora/rh extended their SYS_*_MIN in the default shipped config to prevent autogenerated system accounts from conflicting with their preallocated accounts | 23:54 |
| *** IlyaG has joined #openstack-infra | 23:55 | |
| *** _amrith_ is now known as amrith | 23:55 | |
| clarkb | fungi: but this wouldn't be an issue if both used dynamic gids | 23:55 |
| clarkb | I am actually somewhat surprised that keystone would need a static gid | 23:55 |
| *** SumitNaiksatam has quit IRC | 23:55 | |
| *** eil397 has quit IRC | 23:56 | |
| fungi | clarkb: right, but one of the accounts are apparently part of the base set of accounts in fedora/rhel/centos now | 23:56 |
| fungi | even if you never install packages for it | 23:56 |
| ianw | EmilienM: i have not looked into further than that review | 23:56 |
| EmilienM | fungi: clarkb is asking if Red Hat plans to stop doing static UID/GID for OpenStack packaging, like it's documented here: https://git.fedorahosted.org/cgit/setup.git/tree/uidgid | 23:57 |
| *** shivharis has quit IRC | 23:57 | |
| *** salv-orlando has quit IRC | 23:57 | |
| *** yamamoto_ has joined #openstack-infra | 23:57 | |
| fungi | and apparently useradd isn't smart enough to skip those preallocated accounts when picking the next available account? that is the part that's unclear to me | 23:57 |
| *** ajmiller has quit IRC | 23:57 | |
| *** davideagnello has joined #openstack-infra | 23:57 | |
| *** zeih_ has quit IRC | 23:58 | |
| *** davideagnello has quit IRC | 23:58 | |
| fungi | looks like most of the openstack services are now present in their preallocation list | 23:58 |
| clarkb | yes I am not sure why any openstack service would need a static gid | 23:58 |
| *** davideagnello has joined #openstack-infra | 23:59 | |
| fungi | i love that uid 164 is "quantum" | 23:59 |
| jhesketh | fungi: with the spec to add elections.openstack.org (https://review.openstack.org/#/c/287577/6), is that ready to go to voting tomorrow? There was some questioning about grafting it onto the governance site but all the review feedback has been +1. Do we take that as meaning we should keep it on a separate domain or can the location be chosen as an implementation detail etc | 23:59 |
| jhesketh | (or should we iterate on the spec now, but noting that'll lose a lot of votes) | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!