| clarkb | I too am about to afk | 00:00 |
|---|---|---|
| clarkb | can help deploy in the morning | 00:00 |
| *** xarses has quit IRC | 00:01 | |
| pabelanger | WFM | 00:02 |
| *** jerryz has joined #openstack-infra | 00:03 | |
| pabelanger | greghaynes: ianw: works, no checksum files by default both --checksum and export DIB_CHECKSUM=1 work to generate them | 00:04 |
| greghaynes | pabelanger: w00t ty | 00:04 |
| pabelanger | clarkb: we can start with 382690 for dib checksums, then update the dib_cmd later if it works well. I still need to make nodepool read the files and pass the info to shade, will hack on that in the morning | 00:05 |
| clarkb | thinking about it more I like the env var since its easy to turn on and off via nodepool | 00:05 |
| *** shu-mutou-AWAY is now known as shu-mutou | 00:05 | |
| pabelanger | ya | 00:06 |
| *** tqtran has quit IRC | 00:07 | |
| ianw | greghaynes: not sure what i think about -> https://review.openstack.org/#/c/381576/4/elements/opensuse-minimal/environment.d/10-opensuse-distro-name.bash | 00:07 |
| pabelanger | okay, out for the night | 00:07 |
| *** jamesden_ has quit IRC | 00:07 | |
| ianw | i'm wondering if we've overloaded the variable too much | 00:08 |
| *** EricGonc_ has quit IRC | 00:09 | |
| *** paulobanon has quit IRC | 00:09 | |
| *** paulobanon has joined #openstack-infra | 00:11 | |
| *** ijw has joined #openstack-infra | 00:11 | |
| *** EricGonczer_ has joined #openstack-infra | 00:11 | |
| *** kaisers has joined #openstack-infra | 00:13 | |
| greghaynes | ianw: replied in -dib | 00:13 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: DNM: Upgrade puppetdb to 3.2.latest https://review.openstack.org/374234 | 00:13 |
| *** baoli has quit IRC | 00:15 | |
| *** ijw has quit IRC | 00:16 | |
| *** mixos has joined #openstack-infra | 00:16 | |
| *** kaisers has quit IRC | 00:17 | |
| *** pradk has joined #openstack-infra | 00:19 | |
| *** cardeois has joined #openstack-infra | 00:20 | |
| *** markvoelker has joined #openstack-infra | 00:22 | |
| *** ddieterly has joined #openstack-infra | 00:22 | |
| *** markvoelker has quit IRC | 00:27 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: DNM: Upgrade puppetdb to 3.2.latest https://review.openstack.org/374234 | 00:30 |
| *** Guest92 has quit IRC | 00:31 | |
| *** smarcet has quit IRC | 00:32 | |
| *** amitgandhinz has joined #openstack-infra | 00:41 | |
| *** thorst_ has joined #openstack-infra | 00:44 | |
| *** amitgandhinz has quit IRC | 00:45 | |
| *** rfolco has quit IRC | 00:48 | |
| *** baoli has joined #openstack-infra | 00:54 | |
| *** Guest92 has joined #openstack-infra | 00:54 | |
| *** zul has joined #openstack-infra | 00:55 | |
| *** Guest92 has quit IRC | 00:55 | |
| *** ddieterly has quit IRC | 00:57 | |
| *** Apoorva_ has joined #openstack-infra | 00:58 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: DNM: Upgrade puppetdb to 3.2.latest https://review.openstack.org/374234 | 00:59 |
| *** Apoorva has quit IRC | 01:01 | |
| *** Apoorva_ has quit IRC | 01:03 | |
| *** zul has quit IRC | 01:08 | |
| *** zul has joined #openstack-infra | 01:12 | |
| *** ijw has joined #openstack-infra | 01:13 | |
| *** Sukhdev has quit IRC | 01:15 | |
| *** watanabe_isao has joined #openstack-infra | 01:17 | |
| *** ijw has quit IRC | 01:18 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Increase disk_allocation_ratio to 4 https://review.openstack.org/379618 | 01:18 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add Mistral to the CI status https://review.openstack.org/379335 | 01:18 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add TripleO scenarios jobs in status dashboard https://review.openstack.org/367324 | 01:19 |
| *** rfolco has joined #openstack-infra | 01:21 | |
| *** morgan has quit IRC | 01:27 | |
| *** cardeois has quit IRC | 01:29 | |
| *** esikachev has joined #openstack-infra | 01:35 | |
| *** ddieterly has joined #openstack-infra | 01:35 | |
| *** esikachev has quit IRC | 01:39 | |
| *** amitgandhinz has joined #openstack-infra | 01:41 | |
| openstackgerrit | Merged openstack/diskimage-builder: Create (md5|sha256) checksum files for images https://review.openstack.org/380577 | 01:45 |
| *** amitgandhinz has quit IRC | 01:46 | |
| *** tuanluong has joined #openstack-infra | 01:55 | |
| *** hongbin has joined #openstack-infra | 01:59 | |
| *** BobBall has joined #openstack-infra | 02:01 | |
| *** BobBall is now known as Guest69093 | 02:01 | |
| *** kaisers has joined #openstack-infra | 02:02 | |
| *** ddieterly has quit IRC | 02:05 | |
| *** baoli has quit IRC | 02:05 | |
| *** kaisers has quit IRC | 02:06 | |
| *** Guest69093 has quit IRC | 02:06 | |
| *** gouthamr has quit IRC | 02:07 | |
| *** xarses has joined #openstack-infra | 02:09 | |
| *** amotoki has joined #openstack-infra | 02:12 | |
| *** ijw has joined #openstack-infra | 02:14 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: enable undercloud/ssl on multinode jobs https://review.openstack.org/382082 | 02:15 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 02:15 |
| *** mriedem has quit IRC | 02:18 | |
| *** EricGonczer_ has quit IRC | 02:19 | |
| *** ijw has quit IRC | 02:20 | |
| *** BobBall_ has joined #openstack-infra | 02:20 | |
| *** BobBall_ has quit IRC | 02:24 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: DO NOT MERGE testing switch to Ocata DLRN instance https://review.openstack.org/382521 | 02:25 |
| *** rfolco has quit IRC | 02:25 | |
| *** thorst_ has quit IRC | 02:25 | |
| *** BobBall_ has joined #openstack-infra | 02:26 | |
| *** thorst_ has joined #openstack-infra | 02:26 | |
| *** yuanying has quit IRC | 02:27 | |
| *** ramishra has quit IRC | 02:28 | |
| *** ramishra has joined #openstack-infra | 02:28 | |
| *** spzala has joined #openstack-infra | 02:31 | |
| *** BobBall_ has quit IRC | 02:31 | |
| *** BobBall_ has joined #openstack-infra | 02:32 | |
| *** jerryz has quit IRC | 02:34 | |
| *** cardeois has joined #openstack-infra | 02:35 | |
| *** cardeois has quit IRC | 02:35 | |
| *** thorst_ has quit IRC | 02:35 | |
| *** BobBall_ has quit IRC | 02:37 | |
| *** BobBall_ has joined #openstack-infra | 02:39 | |
| *** tiswanso has joined #openstack-infra | 02:40 | |
| *** amitgandhinz has joined #openstack-infra | 02:42 | |
| *** tongli has quit IRC | 02:43 | |
| *** thorst_ has joined #openstack-infra | 02:47 | |
| *** thorst_ has quit IRC | 02:47 | |
| *** amitgandhinz has quit IRC | 02:48 | |
| *** thorst_ has joined #openstack-infra | 02:48 | |
| *** BobBall_ has quit IRC | 02:51 | |
| *** BobBall has joined #openstack-infra | 02:52 | |
| *** BobBall is now known as Guest54540 | 02:52 | |
| *** thorst_ has quit IRC | 02:53 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: corrected minor mispelling https://review.openstack.org/381345 | 02:57 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update logparser plugin https://review.openstack.org/379194 | 03:01 |
| *** Guest54540 has quit IRC | 03:02 | |
| *** Shrews has quit IRC | 03:03 | |
| *** phschwartz has quit IRC | 03:03 | |
| *** BobBall_ has joined #openstack-infra | 03:03 | |
| *** mordred has quit IRC | 03:03 | |
| *** Shrews has joined #openstack-infra | 03:04 | |
| *** mordred has joined #openstack-infra | 03:06 | |
| *** phschwartz has joined #openstack-infra | 03:06 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Add support for the random string parameter https://review.openstack.org/351384 | 03:08 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update fingerprint plugin https://review.openstack.org/377181 | 03:09 |
| *** tuannguyen has quit IRC | 03:10 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update email-ext plugin https://review.openstack.org/377152 | 03:10 |
| *** tuannguyen has joined #openstack-infra | 03:11 | |
| *** watersoul has quit IRC | 03:12 | |
| *** BobBall_ has quit IRC | 03:12 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Fix documentation about "allow-empty-results" parameter for junit publisher https://review.openstack.org/375347 | 03:12 |
| *** yamahata has quit IRC | 03:12 | |
| *** sdake has joined #openstack-infra | 03:13 | |
| *** sdake has quit IRC | 03:13 | |
| *** sdake has joined #openstack-infra | 03:14 | |
| *** BobBall_ has joined #openstack-infra | 03:14 | |
| *** watersoul has joined #openstack-infra | 03:15 | |
| *** tuannguyen has quit IRC | 03:16 | |
| *** ijw has joined #openstack-infra | 03:16 | |
| *** vikrant has joined #openstack-infra | 03:20 | |
| *** ijw has quit IRC | 03:21 | |
| *** spzala has quit IRC | 03:28 | |
| *** tiswanso has quit IRC | 03:30 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add IPv6 network configuration for ipv6 job types https://review.openstack.org/363674 | 03:37 |
| *** BobBall_ has quit IRC | 03:38 | |
| *** sputnik13 has joined #openstack-infra | 03:39 | |
| *** EricGonczer_ has joined #openstack-infra | 03:40 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/release-tools: Tidy up ptl command if an invalid team is specified https://review.openstack.org/382709 | 03:40 |
| openstackgerrit | Tony Breeds proposed openstack-infra/release-tools: Make the PTL tool more human friendly https://review.openstack.org/382710 | 03:40 |
| *** armax has quit IRC | 03:41 | |
| *** EricGonczer_ has quit IRC | 03:41 | |
| *** annegentle has quit IRC | 03:42 | |
| *** amitgandhinz has joined #openstack-infra | 03:43 | |
| *** sdake_ has joined #openstack-infra | 03:45 | |
| *** sdake has quit IRC | 03:47 | |
| *** BobBall has joined #openstack-infra | 03:47 | |
| *** armax has joined #openstack-infra | 03:47 | |
| *** links has joined #openstack-infra | 03:47 | |
| *** BobBall is now known as Guest642 | 03:48 | |
| *** amitgandhinz has quit IRC | 03:48 | |
| *** kaisers has joined #openstack-infra | 03:50 | |
| *** thorst_ has joined #openstack-infra | 03:51 | |
| *** Guest642 has quit IRC | 03:53 | |
| *** BobBall_ has joined #openstack-infra | 03:55 | |
| *** kaisers has quit IRC | 03:55 | |
| *** thorst_ has quit IRC | 03:58 | |
| *** BobBall_ has quit IRC | 04:00 | |
| *** armax has quit IRC | 04:02 | |
| *** armax has joined #openstack-infra | 04:02 | |
| *** armax has quit IRC | 04:03 | |
| *** mtanino has quit IRC | 04:03 | |
| *** morgan has joined #openstack-infra | 04:07 | |
| *** yuanying has joined #openstack-infra | 04:13 | |
| *** hongbin has quit IRC | 04:15 | |
| *** ijw has joined #openstack-infra | 04:17 | |
| *** mixos has quit IRC | 04:18 | |
| *** smarcet has joined #openstack-infra | 04:21 | |
| *** ijw has quit IRC | 04:23 | |
| *** Sukhdev has joined #openstack-infra | 04:25 | |
| *** markvoelker has joined #openstack-infra | 04:25 | |
| *** jaosorior has joined #openstack-infra | 04:25 | |
| *** pgadiya has joined #openstack-infra | 04:28 | |
| *** smarcet has quit IRC | 04:28 | |
| *** markvoelker has quit IRC | 04:30 | |
| *** rajinir has quit IRC | 04:35 | |
| *** salv-orlando has joined #openstack-infra | 04:41 | |
| masayukig | pleia2 : thanks for the bugdaystats patch! yeah, the suggestion would be nice. What do you think oomichi ? | 04:42 |
| *** amitgandhinz has joined #openstack-infra | 04:44 | |
| *** yuanying has quit IRC | 04:45 | |
| *** salv-orlando has quit IRC | 04:46 | |
| *** zz_dimtruck is now known as dimtruck | 04:47 | |
| *** amitgandhinz has quit IRC | 04:49 | |
| *** psachin has joined #openstack-infra | 04:51 | |
| *** yamahata has joined #openstack-infra | 04:52 | |
| *** yuanying has joined #openstack-infra | 04:54 | |
| *** thorst_ has joined #openstack-infra | 04:55 | |
| *** narayrak has joined #openstack-infra | 04:56 | |
| *** narayrak has quit IRC | 04:59 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove enable from astara plugin https://review.openstack.org/382715 | 05:02 |
| *** thorst_ has quit IRC | 05:02 | |
| *** Rockyg has quit IRC | 05:03 | |
| *** smarcet has joined #openstack-infra | 05:03 | |
| *** makowals has quit IRC | 05:05 | |
| *** salv-orlando has joined #openstack-infra | 05:07 | |
| *** tphummel has joined #openstack-infra | 05:10 | |
| *** snarwade has joined #openstack-infra | 05:12 | |
| *** ijw has joined #openstack-infra | 05:19 | |
| *** david-lyle has joined #openstack-infra | 05:19 | |
| openstackgerrit | Masayuki Igawa proposed openstack-infra/puppet-bugdaystats: Enable daily_rotation option https://review.openstack.org/382718 | 05:19 |
| masayukig | jhesketh , pleia2 , oomichi : ^^^^^ We need this to enable the daily rotation option, IIUC. | 05:20 |
| *** ijw has quit IRC | 05:24 | |
| *** markvoelker has joined #openstack-infra | 05:26 | |
| *** markvoelker has quit IRC | 05:31 | |
| *** esikachev has joined #openstack-infra | 05:36 | |
| masayukig | so, could you have a look if you get a chance? | 05:38 |
| openstackgerrit | Tony Breeds proposed openstack-infra/project-config: Use --version-map when generating constraints updates https://review.openstack.org/382723 | 05:38 |
| *** kaisers has joined #openstack-infra | 05:39 | |
| *** smarcet has quit IRC | 05:40 | |
| *** esikachev has quit IRC | 05:40 | |
| *** oanson has joined #openstack-infra | 05:41 | |
| *** nadya has joined #openstack-infra | 05:42 | |
| *** dimtruck is now known as zz_dimtruck | 05:43 | |
| *** nadya has quit IRC | 05:43 | |
| *** amitgandhinz has joined #openstack-infra | 05:45 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Only ask for the overcloud-full image https://review.openstack.org/363592 | 05:47 |
| *** alex_xu has quit IRC | 05:48 | |
| *** kaisers has quit IRC | 05:48 | |
| *** vsaienko has joined #openstack-infra | 05:49 | |
| *** alex_xu has joined #openstack-infra | 05:51 | |
| *** Sukhdev has quit IRC | 05:51 | |
| *** esikachev has joined #openstack-infra | 05:51 | |
| *** amitgandhinz has quit IRC | 05:52 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Always configure ipv6 address with net-iso https://review.openstack.org/374922 | 05:53 |
| *** adriant has quit IRC | 05:54 | |
| *** kaisers has joined #openstack-infra | 05:55 | |
| *** jaosorior has quit IRC | 05:55 | |
| *** vsaienko has quit IRC | 05:56 | |
| *** esikachev has quit IRC | 05:56 | |
| *** jaosorior has joined #openstack-infra | 05:57 | |
| *** vsaienko has joined #openstack-infra | 05:57 | |
| *** thorst_ has joined #openstack-infra | 06:00 | |
| *** yuanying has quit IRC | 06:02 | |
| *** david-lyle_ has joined #openstack-infra | 06:04 | |
| *** david-lyle has quit IRC | 06:04 | |
| *** yuval has joined #openstack-infra | 06:04 | |
| openstackgerrit | Merged openstack-infra/puppet-bugdaystats: Enable daily_rotation option https://review.openstack.org/382718 | 06:05 |
| *** thorst_ has quit IRC | 06:07 | |
| *** sdake_ has quit IRC | 06:11 | |
| *** david-lyle_ has quit IRC | 06:12 | |
| *** bhavik1 has joined #openstack-infra | 06:14 | |
| *** rcernin has joined #openstack-infra | 06:15 | |
| *** larainema has quit IRC | 06:17 | |
| *** lin_yang has quit IRC | 06:18 | |
| *** martinkopec has joined #openstack-infra | 06:18 | |
| *** aeng has quit IRC | 06:19 | |
| *** makowals has joined #openstack-infra | 06:19 | |
| *** ijw has joined #openstack-infra | 06:20 | |
| *** tnovacik has joined #openstack-infra | 06:22 | |
| *** larainema has joined #openstack-infra | 06:22 | |
| *** lin_yang has joined #openstack-infra | 06:23 | |
| *** e0ne has joined #openstack-infra | 06:25 | |
| lennyb | anteaya, asselin__: np, I will chair. | 06:25 |
| *** ijw has quit IRC | 06:26 | |
| *** cody-somerville has quit IRC | 06:27 | |
| *** markvoelker has joined #openstack-infra | 06:27 | |
| *** cody-somerville has joined #openstack-infra | 06:28 | |
| *** salv-orlando has quit IRC | 06:29 | |
| *** tphummel has quit IRC | 06:30 | |
| *** vsaienko has quit IRC | 06:32 | |
| *** markvoelker has quit IRC | 06:32 | |
| *** andreas_s has joined #openstack-infra | 06:33 | |
| *** ccamacho has left #openstack-infra | 06:34 | |
| *** ccamacho has quit IRC | 06:34 | |
| *** salv-orlando has joined #openstack-infra | 06:36 | |
| *** nadya has joined #openstack-infra | 06:38 | |
| *** salv-orlando has quit IRC | 06:41 | |
| *** esikachev has joined #openstack-infra | 06:44 | |
| *** larainema has quit IRC | 06:45 | |
| *** lin_yang has quit IRC | 06:47 | |
| *** amitgandhinz has joined #openstack-infra | 06:48 | |
| *** esikachev has quit IRC | 06:49 | |
| *** nadya has quit IRC | 06:49 | |
| *** larainema has joined #openstack-infra | 06:51 | |
| *** lin_yang has joined #openstack-infra | 06:51 | |
| *** amitgandhinz has quit IRC | 06:53 | |
| yolanda | good morning | 06:53 |
| *** esikachev has joined #openstack-infra | 06:55 | |
| *** esikachev has quit IRC | 06:59 | |
| *** rossella_s has joined #openstack-infra | 07:01 | |
| *** thorst_ has joined #openstack-infra | 07:05 | |
| *** camunoz has quit IRC | 07:07 | |
| *** ihrachys has joined #openstack-infra | 07:08 | |
| *** amoralej|off is now known as amoralej | 07:10 | |
| *** esikachev has joined #openstack-infra | 07:10 | |
| *** tesseract- has joined #openstack-infra | 07:11 | |
| *** Naeil has joined #openstack-infra | 07:12 | |
| *** psachin has quit IRC | 07:12 | |
| *** thorst_ has quit IRC | 07:12 | |
| *** salv-orlando has joined #openstack-infra | 07:14 | |
| *** yuanying has joined #openstack-infra | 07:14 | |
| *** watersoul has quit IRC | 07:17 | |
| *** psachin has joined #openstack-infra | 07:17 | |
| *** ihrachys has quit IRC | 07:18 | |
| *** zeih has joined #openstack-infra | 07:18 | |
| *** esikachev has quit IRC | 07:19 | |
| *** zeih has quit IRC | 07:19 | |
| *** zeih has joined #openstack-infra | 07:19 | |
| *** pahuang has quit IRC | 07:19 | |
| *** watersoul has joined #openstack-infra | 07:21 | |
| *** ijw has joined #openstack-infra | 07:22 | |
| *** jpena|off is now known as jpena | 07:23 | |
| *** e0ne has quit IRC | 07:24 | |
| *** jlanoux has joined #openstack-infra | 07:24 | |
| *** jlanoux has quit IRC | 07:25 | |
| *** jlanoux has joined #openstack-infra | 07:26 | |
| *** pcaruana has joined #openstack-infra | 07:26 | |
| *** ijw has quit IRC | 07:28 | |
| *** markvoelker has joined #openstack-infra | 07:28 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 07:29 |
| *** ralonsoh has joined #openstack-infra | 07:32 | |
| *** markvoelker has quit IRC | 07:32 | |
| *** shardy_afk is now known as shardy | 07:34 | |
| *** abregman_ has joined #openstack-infra | 07:37 | |
| *** drifterza has joined #openstack-infra | 07:41 | |
| *** jpich has joined #openstack-infra | 07:44 | |
| *** nmagnezi has joined #openstack-infra | 07:46 | |
| *** esikachev has joined #openstack-infra | 07:46 | |
| *** dtardivel has joined #openstack-infra | 07:48 | |
| *** amitgandhinz has joined #openstack-infra | 07:49 | |
| *** amitgandhinz has quit IRC | 07:54 | |
| *** ihrachys has joined #openstack-infra | 07:56 | |
| *** salv-orl_ has joined #openstack-infra | 07:56 | |
| *** salv-orlando has quit IRC | 07:58 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add os_almanach to OpenStack-Ansible https://review.openstack.org/371590 | 07:59 |
| *** zzzeek has quit IRC | 08:00 | |
| *** jordanP has joined #openstack-infra | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:01 | |
| *** dragonmaster has joined #openstack-infra | 08:05 | |
| *** thorst_ has joined #openstack-infra | 08:10 | |
| *** ihrachys has quit IRC | 08:11 | |
| *** zhurong has joined #openstack-infra | 08:11 | |
| openstackgerrit | Merged openstack-infra/project-config: remove the legacy driver job for keystone https://review.openstack.org/382499 | 08:11 |
| *** sflanigan has quit IRC | 08:11 | |
| *** tuannguyen has joined #openstack-infra | 08:12 | |
| openstackgerrit | Masayuki Igawa proposed openstack-infra/devstack-gate: SUPER WIP: Use new tempest run workflow https://review.openstack.org/355666 | 08:13 |
| *** qwertyco_ has joined #openstack-infra | 08:16 | |
| openstackgerrit | Maciej Relewicz proposed openstack-infra/puppet-apps_site: Glare support for app-catalog https://review.openstack.org/359029 | 08:16 |
| *** hashar has joined #openstack-infra | 08:16 | |
| *** thorst_ has quit IRC | 08:17 | |
| *** tuannguyen has quit IRC | 08:17 | |
| *** jaosorior is now known as jaosorior_lunch | 08:17 | |
| *** jed561 has quit IRC | 08:19 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add os_almanach to OpenStack-Ansible https://review.openstack.org/371590 | 08:19 |
| openstackgerrit | Merged openstack-infra/project-config: gnocchi: do not run upgrade-from-2.2 on 3.0 branch https://review.openstack.org/382341 | 08:20 |
| *** qwertyco_ has quit IRC | 08:21 | |
| *** qwertyco has joined #openstack-infra | 08:21 | |
| *** abregman__ has joined #openstack-infra | 08:21 | |
| *** john-davidge has joined #openstack-infra | 08:22 | |
| *** ijw has joined #openstack-infra | 08:24 | |
| *** qwertyco is now known as qwertyco_ | 08:24 | |
| AJaeger | jeblair: I see some post failures due to AFS publishing, see http://logs.openstack.org/25/2527d0ac9f7a6c37e68c4fa604ac510b8ff0758d/post/openstack-manuals-tox-doc-publishdocs/2730f7a/_zuul_ansible/ansible_log.txt for log file. | 08:25 |
| *** abregman_ has quit IRC | 08:25 | |
| *** qwertyco_ has quit IRC | 08:26 | |
| openstackgerrit | Maciej Relewicz proposed openstack-infra/puppet-apps_site: Glare support for app-catalog https://review.openstack.org/359029 | 08:26 |
| *** qwertyco has joined #openstack-infra | 08:26 | |
| *** zeih has quit IRC | 08:26 | |
| *** john-dav_ has joined #openstack-infra | 08:28 | |
| *** john-davidge has quit IRC | 08:28 | |
| *** spzala has joined #openstack-infra | 08:28 | |
| *** ijw has quit IRC | 08:29 | |
| AJaeger | jeblair: later jobs worked, so do we have races here? We had several jobs in the post queue at the same time... | 08:32 |
| *** spzala has quit IRC | 08:33 | |
| *** nadya has joined #openstack-infra | 08:34 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: [WIP] Add IPv6 coverage using existing jobs https://review.openstack.org/382515 | 08:35 |
| *** e0ne has joined #openstack-infra | 08:37 | |
| *** derekh has joined #openstack-infra | 08:38 | |
| *** dingyichen has quit IRC | 08:38 | |
| *** ihrachys has joined #openstack-infra | 08:39 | |
| *** yaume has joined #openstack-infra | 08:40 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Add network config for puppet-infracloud on hiera https://review.openstack.org/371607 | 08:44 |
| *** dtantsur|afk is now known as dtantsur | 08:49 | |
| *** amitgandhinz has joined #openstack-infra | 08:50 | |
| *** john-dav_ has quit IRC | 08:51 | |
| *** amitgandhinz has quit IRC | 08:55 | |
| *** Naeil has quit IRC | 08:56 | |
| *** ociuhandu has joined #openstack-infra | 08:56 | |
| openstackgerrit | Merged openstack-infra/system-config: Add network config for puppet-infracloud on hiera https://review.openstack.org/371607 | 08:57 |
| *** qwertyco has quit IRC | 08:58 | |
| *** qwertyco has joined #openstack-infra | 08:58 | |
| *** qwertyco has quit IRC | 08:58 | |
| *** qwertyco has joined #openstack-infra | 08:59 | |
| *** Naeil has joined #openstack-infra | 09:00 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 09:03 |
| *** chem has joined #openstack-infra | 09:04 | |
| *** ralonsoh_ has joined #openstack-infra | 09:04 | |
| *** zeih has joined #openstack-infra | 09:04 | |
| *** ralonsoh has quit IRC | 09:05 | |
| *** john-davidge has joined #openstack-infra | 09:06 | |
| *** chem has quit IRC | 09:07 | |
| *** chem has joined #openstack-infra | 09:07 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 09:13 |
| *** qwertyco has quit IRC | 09:14 | |
| *** qwertyco has joined #openstack-infra | 09:14 | |
| *** thorst_ has joined #openstack-infra | 09:14 | |
| *** sambetts|afk is now known as sambetts | 09:17 | |
| openstackgerrit | Maciej Relewicz proposed openstack-infra/puppet-apps_site: Glare support for app-catalog https://review.openstack.org/359029 | 09:17 |
| *** ihrachys has quit IRC | 09:19 | |
| *** qwertyco has quit IRC | 09:21 | |
| *** qwertyco has joined #openstack-infra | 09:21 | |
| *** tosky has joined #openstack-infra | 09:21 | |
| *** pgadiya has quit IRC | 09:22 | |
| *** thorst_ has quit IRC | 09:22 | |
| *** ijw has joined #openstack-infra | 09:25 | |
| *** strigazi_AFK is now known as strigazi | 09:25 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:27 | |
| *** snarwade has quit IRC | 09:29 | |
| dulek | Anyone cares to take a look on https://review.openstack.org/#/c/379346/ ? :) | 09:30 |
| *** ociuhandu has quit IRC | 09:31 | |
| *** ijw has quit IRC | 09:31 | |
| *** pgadiya has joined #openstack-infra | 09:34 | |
| *** jaosorior_lunch has quit IRC | 09:36 | |
| *** berendt has joined #openstack-infra | 09:36 | |
| *** jaosorior_lunch has joined #openstack-infra | 09:36 | |
| *** qwertyco has quit IRC | 09:37 | |
| *** qwertyco has joined #openstack-infra | 09:37 | |
| *** kzaitsev_mb has quit IRC | 09:40 | |
| openstackgerrit | Maciej Relewicz proposed openstack-infra/puppet-apps_site: Glare support for app-catalog https://review.openstack.org/359029 | 09:42 |
| *** snarwade has joined #openstack-infra | 09:42 | |
| *** jaosorior_lunch is now known as jaosorior | 09:44 | |
| *** e0ne_ has joined #openstack-infra | 09:49 | |
| *** aarefiev has quit IRC | 09:50 | |
| *** e0ne has quit IRC | 09:50 | |
| *** thorst_ has joined #openstack-infra | 09:50 | |
| *** ralonsoh_ is now known as ralonsoh | 09:50 | |
| *** salv-orl_ has quit IRC | 09:51 | |
| *** aarefiev has joined #openstack-infra | 09:51 | |
| *** amitgandhinz has joined #openstack-infra | 09:51 | |
| *** gildub has quit IRC | 09:51 | |
| *** kaisers_ has joined #openstack-infra | 09:54 | |
| *** arxcruz is now known as acruz|lunch | 09:55 | |
| *** ssancheztrujillo has joined #openstack-infra | 09:55 | |
| *** kaisers_ has quit IRC | 09:55 | |
| *** amitgandhinz has quit IRC | 09:56 | |
| *** thorst_ has quit IRC | 09:58 | |
| *** kaisers has quit IRC | 09:58 | |
| *** kaisers has joined #openstack-infra | 09:58 | |
| *** Margarita_S has joined #openstack-infra | 09:59 | |
| *** john-davidge has quit IRC | 09:59 | |
| *** woodster_ has quit IRC | 10:00 | |
| *** kaisers has quit IRC | 10:00 | |
| *** ihrachys has joined #openstack-infra | 10:02 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/devstack-gate: Move network sanity check to Ansible https://review.openstack.org/382821 | 10:02 |
| rcarrillocruz | jeblair , clarkb : is there a gerrit topic for the 'ansiblefy devstack-gate functions' item that was agreed at the infra mid-cycle ^ ? | 10:03 |
| rcarrillocruz | (morniing!) | 10:03 |
| *** ociuhandu has joined #openstack-infra | 10:04 | |
| dtantsur | morning folks! could someone please help me figure out why nothing was ever posted to http://docs.openstack.org/developer/python-ironic-inspector-client? | 10:08 |
| *** kaisers has joined #openstack-infra | 10:10 | |
| AJaeger | dtantsur: default setup for python projects is publishing at release time. When was the last release ? | 10:11 |
| dtantsur | AJaeger, this answers my question, thanks :) | 10:11 |
| openstackgerrit | Saad Zaher proposed openstack-infra/project-config: Added requirements gate for python-freeclient https://review.openstack.org/382825 | 10:14 |
| *** kaisers has quit IRC | 10:14 | |
| *** tuannguyen has joined #openstack-infra | 10:14 | |
| openstackgerrit | Alexander Evseev proposed openstack-infra/project-config: Fix trusted host for NODEPOOL_PYPI_MIRROR https://review.openstack.org/336023 | 10:15 |
| *** snarwade has quit IRC | 10:15 | |
| *** ssancheztrujillo has quit IRC | 10:17 | |
| *** ccamacho has joined #openstack-infra | 10:17 | |
| *** snarwade has joined #openstack-infra | 10:18 | |
| *** tuannguyen has quit IRC | 10:19 | |
| openstackgerrit | Saad Zaher proposed openstack-infra/project-config: Added requirements gate for python-freeclient https://review.openstack.org/382827 | 10:19 |
| *** salv-orlando has joined #openstack-infra | 10:23 | |
| *** ijw has joined #openstack-infra | 10:26 | |
| *** kaisers has joined #openstack-infra | 10:27 | |
| *** ssancheztrujillo has joined #openstack-infra | 10:31 | |
| *** ijw has quit IRC | 10:32 | |
| *** bhavik1 has quit IRC | 10:38 | |
| *** kaisers has quit IRC | 10:39 | |
| *** kaisers has joined #openstack-infra | 10:40 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/382839 | 10:40 |
| *** sdague has joined #openstack-infra | 10:41 | |
| szaher | dirk: check this please https://review.openstack.org/#/c/380159/ | 10:46 |
| *** kzaitsev_mb has joined #openstack-infra | 10:46 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/devstack-gate: Move network sanity check to Ansible https://review.openstack.org/382821 | 10:47 |
| *** jkilpatr has quit IRC | 10:47 | |
| *** M-docaedo_vector has quit IRC | 10:50 | |
| *** amitgandhinz has joined #openstack-infra | 10:52 | |
| *** slaweq has quit IRC | 10:52 | |
| *** slaweq has joined #openstack-infra | 10:53 | |
| *** thorst_ has joined #openstack-infra | 10:54 | |
| *** acruz|lunch is now known as arxcruz | 10:56 | |
| *** kaisers has quit IRC | 10:56 | |
| *** amitgandhinz has quit IRC | 10:57 | |
| *** shardy is now known as shardy_lunch | 11:01 | |
| *** thorst_ has quit IRC | 11:02 | |
| *** M-docaedo_vector has joined #openstack-infra | 11:04 | |
| *** d0ugal has quit IRC | 11:05 | |
| AJaeger | dtantsur: release time = tag time, so 1.9.0 was taged last but afterwards https://review.openstack.org/368080 merged | 11:06 |
| AJaeger | dtantsur: I checked config now, everything looks fine on infra side - waiting for next release ;) | 11:06 |
| *** d0ugal has joined #openstack-infra | 11:06 | |
| *** d0ugal has quit IRC | 11:06 | |
| *** d0ugal has joined #openstack-infra | 11:06 | |
| dtantsur | cool, thanks1 | 11:06 |
| *** rtheis has joined #openstack-infra | 11:08 | |
| *** Margarita_S has quit IRC | 11:10 | |
| *** kun_huang has quit IRC | 11:10 | |
| *** OferBarber has joined #openstack-infra | 11:11 | |
| *** kun_huang has joined #openstack-infra | 11:11 | |
| *** vsaienko has joined #openstack-infra | 11:11 | |
| *** M-docaedo_vector has quit IRC | 11:11 | |
| *** jpena is now known as jpena|lunch | 11:14 | |
| *** rhallisey has joined #openstack-infra | 11:16 | |
| *** anthonyper has quit IRC | 11:17 | |
| *** M-docaedo_vector has joined #openstack-infra | 11:17 | |
| *** anthonyper has joined #openstack-infra | 11:17 | |
| *** ralonsoh has quit IRC | 11:17 | |
| *** ralonsoh has joined #openstack-infra | 11:18 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Manage /root.ssh directory from bifrost https://review.openstack.org/382856 | 11:20 |
| *** jkilpatr has joined #openstack-infra | 11:25 | |
| *** watanabe_isao has quit IRC | 11:26 | |
| *** ijw has joined #openstack-infra | 11:28 | |
| *** ldnunes has joined #openstack-infra | 11:30 | |
| *** shardy_lunch is now known as shardy | 11:31 | |
| *** baoli has joined #openstack-infra | 11:31 | |
| *** vsaienko has quit IRC | 11:31 | |
| *** vsaienko has joined #openstack-infra | 11:32 | |
| *** ashtokolov has quit IRC | 11:33 | |
| *** flaviof has quit IRC | 11:33 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Ensure that directories to create bridge are present https://review.openstack.org/382867 | 11:33 |
| *** spzala has joined #openstack-infra | 11:33 | |
| *** ashtokolov has joined #openstack-infra | 11:33 | |
| *** flaviof has joined #openstack-infra | 11:33 | |
| *** ijw has quit IRC | 11:34 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Manage /root.ssh directory from bifrost https://review.openstack.org/382856 | 11:37 |
| *** spzala has quit IRC | 11:37 | |
| jd__ | sileht: https://review.openstack.org/#/c/382247/ it seems upgrade tests are still run even if https://review.openstack.org/#/c/382341/ has been merged, what did I miss? | 11:38 |
| *** dprince has joined #openstack-infra | 11:39 | |
| *** vsaienko has quit IRC | 11:41 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 11:41 |
| sileht | jd__, weird | 11:41 |
| esikachev | hi! who can help me with zuul? i have a next error in job http://paste.openstack.org/show/584654/ | 11:41 |
| esikachev | variables from zuul not exist in jenkins job | 11:42 |
| esikachev | how i can fix it? | 11:43 |
| esikachev | Jenkins ver. 2.19.1 | 11:43 |
| *** claudiub has quit IRC | 11:45 | |
| *** thorst_ has joined #openstack-infra | 11:45 | |
| asselin__ | esikachev, third party ci? use https://review.openstack.org/#/c/367232/ + the depends-on patch which pins the version of jenkins to one that works | 11:47 |
| sileht | jd__, perhaps retry, a lag exists between the infra merged and when this is applied | 11:48 |
| *** tpsilva has joined #openstack-infra | 11:48 | |
| esikachev | asselin__: ok, got it. thanks | 11:48 |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Manage /root/.ssh prior to bifrost install https://review.openstack.org/382856 | 11:49 |
| mat128 | esikachev: please read this thread http://lists.openstack.org/pipermail/openstack-infra/2016-September/004709.html | 11:49 |
| mat128 | esikachev: long story short, you have to use the latest <2.0 version, and you have to use new/not yet landed puppet patches to be able to pin a jenkins version | 11:49 |
| *** vsaienko has joined #openstack-infra | 11:49 | |
| esikachev | mat128: thanks | 11:50 |
| * esikachev started redeploy | 11:50 | |
| vsaienk0 | infra folks I'm wondered if anyone saw such error: http://logs.openstack.org/73/368173/25/experimental/gate-tempest-dsvm-ironic-ipa-wholedisk-agent_ssh-tinyipa-multinode-nv/3473499/logs/syslog.txt.gz#_Oct__6_11_16_46 dnsmasq failed to read configuration files | 11:50 |
| migi | fungi: hi | 11:51 |
| vsaienk0 | the problem is reproduced on ironic-multinode job, and doesn't reproduced locally, other jobs are fine | 11:51 |
| *** hyakuhei- has quit IRC | 11:52 | |
| *** hyakuhei- has joined #openstack-infra | 11:52 | |
| *** hyakuhei- has quit IRC | 11:52 | |
| *** hyakuhei- has joined #openstack-infra | 11:52 | |
| *** hyakuhei- is now known as hyakuhei | 11:52 | |
| *** ociuhandu has quit IRC | 11:52 | |
| jd__ | AJaeger: clue ^^^ ? | 11:53 |
| *** amitgandhinz has joined #openstack-infra | 11:53 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Setup ssh-key on subnodes for Ironic https://review.openstack.org/364830 | 11:53 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Update ENABLED_SERVICE on subnode with ironic https://review.openstack.org/368611 | 11:53 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Update localrc for ironic-multinode case https://review.openstack.org/352790 | 11:53 |
| migi | fungi: I am wondering if it's possible to release in pip new version of jenkins-job-builder. I am missing the allow-empty-results in junit plugin to cover tests for horizon that does not create .testrepository | 11:54 |
| *** zeih has quit IRC | 11:55 | |
| *** rfolco has joined #openstack-infra | 11:55 | |
| *** EricGonczer_ has joined #openstack-infra | 11:56 | |
| *** uxdanielle has quit IRC | 11:56 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Add reno jobs for python-tripleoclient https://review.openstack.org/382041 | 11:57 |
| *** amitgandhinz has quit IRC | 11:58 | |
| *** Margarita_S has joined #openstack-infra | 11:58 | |
| *** vsaienko has quit IRC | 11:59 | |
| jordanP | guys, how.where can I report a bug in openstack-infra/shade ? | 11:59 |
| jordanP | I can"t fint the launchpad | 12:00 |
| *** vsaienko has joined #openstack-infra | 12:00 | |
| *** thorst__ has joined #openstack-infra | 12:00 | |
| openstackgerrit | Sergey Kraynev proposed openstack-infra/project-config: Add job for building drafts for ReNo https://review.openstack.org/382882 | 12:00 |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Ensure that directories to create bridge are present https://review.openstack.org/382867 | 12:00 |
| *** zeih has joined #openstack-infra | 12:02 | |
| *** gouthamr has joined #openstack-infra | 12:02 | |
| *** trown|outtypewww is now known as trown | 12:03 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 12:03 |
| *** thorst_ has quit IRC | 12:04 | |
| *** tuanluong has quit IRC | 12:04 | |
| *** thorst__ has quit IRC | 12:05 | |
| *** thorst_ has joined #openstack-infra | 12:06 | |
| *** zhurong has quit IRC | 12:07 | |
| *** lucas-afk is now known as lucasagomes | 12:07 | |
| *** thorst__ has joined #openstack-infra | 12:07 | |
| *** zhurong has joined #openstack-infra | 12:07 | |
| *** thorst_ has quit IRC | 12:11 | |
| *** jpena|lunch is now known as jpena | 12:11 | |
| *** alex_xu has quit IRC | 12:12 | |
| *** tuannguyen has joined #openstack-infra | 12:12 | |
| *** thorst__ has quit IRC | 12:12 | |
| *** thorst_ has joined #openstack-infra | 12:13 | |
| *** abregman__ is now known as abregman | 12:13 | |
| *** thorst__ has joined #openstack-infra | 12:14 | |
| *** alex_xu has joined #openstack-infra | 12:14 | |
| openstackgerrit | Sergey Kraynev proposed openstack-infra/project-config: Add job for building drafts for ReNo https://review.openstack.org/382882 | 12:15 |
| *** vsaienko has quit IRC | 12:17 | |
| *** thorst_ has quit IRC | 12:17 | |
| *** thorst__ has quit IRC | 12:19 | |
| *** Jeffrey4l_ has quit IRC | 12:20 | |
| *** Jeffrey4l_ has joined #openstack-infra | 12:21 | |
| Shrews | jordanP: you can submit something to storyboard.o.o | 12:22 |
| Shrews | jordanP: and bring attention to it in #openstack-shade | 12:23 |
| *** kaisers has joined #openstack-infra | 12:24 | |
| *** salv-orlando has quit IRC | 12:24 | |
| *** qwertyco has quit IRC | 12:24 | |
| *** qwertyco has joined #openstack-infra | 12:24 | |
| *** vsaienko has joined #openstack-infra | 12:25 | |
| *** edmondsw has joined #openstack-infra | 12:26 | |
| *** alex_xu has quit IRC | 12:27 | |
| *** esberglu has joined #openstack-infra | 12:29 | |
| *** alex_xu has joined #openstack-infra | 12:29 | |
| *** ijw has joined #openstack-infra | 12:29 | |
| *** markvoelker has joined #openstack-infra | 12:31 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/devstack-gate: Move network sanity check to Ansible https://review.openstack.org/382821 | 12:33 |
| *** aviau has quit IRC | 12:33 | |
| *** EricGonc_ has joined #openstack-infra | 12:33 | |
| *** kgiusti has joined #openstack-infra | 12:34 | |
| *** aviau has joined #openstack-infra | 12:34 | |
| *** EricGonczer_ has quit IRC | 12:35 | |
| *** ijw has quit IRC | 12:35 | |
| *** kzaitsev_mb has quit IRC | 12:35 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/devstack-gate: Move network sanity check to Ansible https://review.openstack.org/382821 | 12:35 |
| *** ddieterly has joined #openstack-infra | 12:37 | |
| *** shu-mutou is now known as shu-mutou-AWAY | 12:38 | |
| AJaeger | jd__: for such cases: check the logfile from the layout run and check the output: http://logs.openstack.org/41/382341/1/check/gate-project-config-layout/8147fd7/console.html#_2016-10-05_11_40_17_170302 | 12:38 |
| *** fguillot has joined #openstack-infra | 12:38 | |
| AJaeger | jd__: but I'm puzzled, the regex looks fine... | 12:39 |
| *** lin_yang has quit IRC | 12:39 | |
| jd__ | AJaeger: i'm partially reassured :) | 12:39 |
| *** jcoufal has joined #openstack-infra | 12:40 | |
| *** vsaienko has quit IRC | 12:41 | |
| *** ddieterly has quit IRC | 12:41 | |
| *** jaosorior has quit IRC | 12:41 | |
| AJaeger | jd__: hope somebody wiser and fitter than me can help | 12:41 |
| jd__ | AJaeger: no lag possible like sileht proposed? | 12:43 |
| *** kzaitsev_mb has joined #openstack-infra | 12:43 | |
| *** lin_yang has joined #openstack-infra | 12:45 | |
| AJaeger | jd__: ah. status.openstack.org/zuul has "ast reconfigured: Thu Oct 06 2016 13:40:17 GMT+0200" | 12:45 |
| AJaeger | So, now it should be active. | 12:45 |
| AJaeger | Recheck again ;) | 12:45 |
| jd__ | ah! | 12:45 |
| * jd__ rechecks | 12:46 | |
| *** vsaienko has joined #openstack-infra | 12:46 | |
| *** amitgandhinz has joined #openstack-infra | 12:46 | |
| AJaeger | I missed that your previous recheck was only an hour or so after the merge. That might have been close - check the "Last reconfigured" line to be sure next time ;) | 12:46 |
| *** links has quit IRC | 12:50 | |
| *** tiswanso has joined #openstack-infra | 12:50 | |
| *** tiswanso has quit IRC | 12:50 | |
| *** tiswanso has joined #openstack-infra | 12:51 | |
| *** kaisers has quit IRC | 12:51 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: [WIP] Add IPv6 coverage using existing jobs https://review.openstack.org/382515 | 12:54 |
| openstackgerrit | Maciej Relewicz proposed openstack-infra/puppet-apps_site: Glare support for app-catalog https://review.openstack.org/359029 | 12:55 |
| *** raildo has joined #openstack-infra | 12:56 | |
| *** ociuhandu has joined #openstack-infra | 12:56 | |
| *** john-davidge has joined #openstack-infra | 12:56 | |
| *** burgerk has joined #openstack-infra | 12:57 | |
| *** Goneri has joined #openstack-infra | 12:58 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 12:58 |
| *** spzala has joined #openstack-infra | 12:59 | |
| *** ociuhandu has quit IRC | 12:59 | |
| *** jtomasek_ has joined #openstack-infra | 13:00 | |
| *** dragonmaster has quit IRC | 13:00 | |
| *** jheroux has joined #openstack-infra | 13:02 | |
| *** thorst_ has joined #openstack-infra | 13:02 | |
| *** ociuhandu has joined #openstack-infra | 13:04 | |
| *** mdrabe has joined #openstack-infra | 13:04 | |
| *** inc0 has joined #openstack-infra | 13:04 | |
| *** zeih has quit IRC | 13:05 | |
| *** links has joined #openstack-infra | 13:05 | |
| *** vsaienko has quit IRC | 13:06 | |
| *** vsaienko has joined #openstack-infra | 13:09 | |
| *** aderyugin has quit IRC | 13:09 | |
| *** tongli has joined #openstack-infra | 13:11 | |
| *** smarcet has joined #openstack-infra | 13:11 | |
| *** lezbar__ has joined #openstack-infra | 13:11 | |
| *** lezbar has quit IRC | 13:12 | |
| dhellmann | we've started tagging the final newton releases, if anyone wants to follow along | 13:12 |
| *** aderyugin has joined #openstack-infra | 13:13 | |
| fungi | dhellmann: thanks for the heads up! | 13:13 |
| dhellmann | lots of jobs in the tag and release queues | 13:13 |
| *** tiswanso has quit IRC | 13:14 | |
| *** mriedem has joined #openstack-infra | 13:16 | |
| *** vsaienko has quit IRC | 13:18 | |
| *** snarwade has quit IRC | 13:19 | |
| *** vsaienko has joined #openstack-infra | 13:19 | |
| *** amitgandhinz has quit IRC | 13:19 | |
| *** amitgandhinz has joined #openstack-infra | 13:20 | |
| *** tiswanso has joined #openstack-infra | 13:20 | |
| *** sputnik13 has quit IRC | 13:26 | |
| *** vikrant has quit IRC | 13:26 | |
| *** jtomasek_ has quit IRC | 13:26 | |
| *** mkoderer has joined #openstack-infra | 13:27 | |
| *** azvyagintsev has joined #openstack-infra | 13:29 | |
| *** zul has quit IRC | 13:30 | |
| *** ijw has joined #openstack-infra | 13:31 | |
| *** baoli_ has joined #openstack-infra | 13:32 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Update localrc for ironic-multinode case https://review.openstack.org/352790 | 13:33 |
| *** zul has joined #openstack-infra | 13:33 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Update ENABLED_SERVICE on subnode with ironic https://review.openstack.org/368611 | 13:33 |
| *** baoli has quit IRC | 13:35 | |
| *** drifterza has quit IRC | 13:35 | |
| *** bnemec has joined #openstack-infra | 13:36 | |
| *** snarwade has joined #openstack-infra | 13:36 | |
| *** ijw has quit IRC | 13:37 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Remove propose-puppet-openstack-rdo-promote https://review.openstack.org/382955 | 13:37 |
| EmilienM | dmsimard: ^ | 13:37 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Update localrc for ironic-multinode case https://review.openstack.org/352790 | 13:37 |
| dmsimard | EmilienM: you're putting me under a bus here, let's wait and see if everything works before :P | 13:37 |
| EmilienM | dmsimard: I can WIP the patch if you want | 13:38 |
| dmsimard | yeah, sure | 13:38 |
| EmilienM | ok done | 13:38 |
| *** tiswanso has quit IRC | 13:39 | |
| *** rbrndt has joined #openstack-infra | 13:43 | |
| *** vsaienko has quit IRC | 13:44 | |
| *** burgerk has quit IRC | 13:45 | |
| *** vsaienko has joined #openstack-infra | 13:46 | |
| *** thorst__ has joined #openstack-infra | 13:46 | |
| *** nmagnezi has quit IRC | 13:47 | |
| *** eharney has joined #openstack-infra | 13:47 | |
| *** akshai has joined #openstack-infra | 13:49 | |
| *** claudiub has joined #openstack-infra | 13:49 | |
| *** thorst_ has quit IRC | 13:49 | |
| *** cardeois has joined #openstack-infra | 13:50 | |
| *** akshai_ has joined #openstack-infra | 13:50 | |
| *** smarcet has quit IRC | 13:52 | |
| *** xarses has quit IRC | 13:52 | |
| *** akshai has quit IRC | 13:54 | |
| *** jkilpatr has quit IRC | 13:54 | |
| *** vsaienko has quit IRC | 13:56 | |
| *** tiswanso has joined #openstack-infra | 13:56 | |
| *** mtanino has joined #openstack-infra | 13:56 | |
| *** azvyagintsev has left #openstack-infra | 13:57 | |
| anteaya | lennyb: thank you | 13:57 |
| openstackgerrit | Mike Fedosin proposed openstack-infra/system-config: Create apps-dev.openstack.org for testing community app-catalog https://review.openstack.org/382971 | 13:59 |
| *** thorst__ is now known as thorst_ | 13:59 | |
| *** tonytan4ever has joined #openstack-infra | 13:59 | |
| *** sdake has joined #openstack-infra | 13:59 | |
| *** ramishra_ has joined #openstack-infra | 14:01 | |
| *** gordc has joined #openstack-infra | 14:01 | |
| *** vsaienko has joined #openstack-infra | 14:02 | |
| *** nadya has quit IRC | 14:03 | |
| *** ramishra has quit IRC | 14:03 | |
| *** nadya has joined #openstack-infra | 14:04 | |
| *** tonytan4ever has quit IRC | 14:06 | |
| *** hongbin has joined #openstack-infra | 14:06 | |
| *** tonytan4ever has joined #openstack-infra | 14:06 | |
| *** ddieterly has joined #openstack-infra | 14:08 | |
| *** nadya has quit IRC | 14:08 | |
| *** jkilpatr has joined #openstack-infra | 14:10 | |
| *** vsaienko has quit IRC | 14:11 | |
| *** zhenguo has joined #openstack-infra | 14:11 | |
| *** smarcet has joined #openstack-infra | 14:13 | |
| *** burgerk has joined #openstack-infra | 14:13 | |
| *** kaisers has joined #openstack-infra | 14:14 | |
| *** sdake has quit IRC | 14:15 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - Test Undercloud upgrade mitaka -> newton https://review.openstack.org/381309 | 14:15 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Undercloud upgrade for mitaka and newton https://review.openstack.org/381286 | 14:15 |
| *** vsaienko has joined #openstack-infra | 14:15 | |
| *** sshnaidm has quit IRC | 14:17 | |
| *** xarses has joined #openstack-infra | 14:21 | |
| *** jamesdenton has joined #openstack-infra | 14:22 | |
| *** HeOS has quit IRC | 14:23 | |
| *** tuannguyen has quit IRC | 14:24 | |
| *** tuannguyen has joined #openstack-infra | 14:24 | |
| openstackgerrit | Marc Koderer proposed openstack-infra/project-config: Add experimental job for barbican-postgres https://review.openstack.org/382987 | 14:24 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: DO NOT MERGE fake periodic job to update cache to Ocata https://review.openstack.org/382521 | 14:25 |
| *** jlanoux has quit IRC | 14:25 | |
| *** sshnaidm has joined #openstack-infra | 14:25 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config: Revert "Set up stable/newton temporary ACLs" https://review.openstack.org/382988 | 14:25 |
| openstackgerrit | Paul Hummer proposed openstack-infra/project-config: Add branch creation acl for nova-lxd project. https://review.openstack.org/382989 | 14:26 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/devstack-gate: Move network sanity check to Ansible https://review.openstack.org/382821 | 14:27 |
| *** rossella_s has quit IRC | 14:27 | |
| *** rossella_s has joined #openstack-infra | 14:28 | |
| *** Vinsh has joined #openstack-infra | 14:28 | |
| EmilienM | hi, we're trying to merge https://review.openstack.org/#/c/378950/ but it seems like Gerrit doesn't want to. | 14:28 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add Calico non-voting functional test to OSA os_neutron https://review.openstack.org/382991 | 14:28 |
| EmilienM | rebasing it shows this error: Unable to create new object: /home/gerrit2/review_site/git/openstack/puppet-swift.git/objects/0d/abbc4750bf9fe84dcd3d4127907e253af2200b | 14:28 |
| *** gouthamr has quit IRC | 14:29 | |
| *** tuannguyen has quit IRC | 14:29 | |
| EmilienM | rebasing it manually worked, nevermind. | 14:29 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/devstack-gate: Move network sanity check to Ansible https://review.openstack.org/382821 | 14:29 |
| rcarrillocruz | yeah, the rebase feature of gerrit is quite limited | 14:30 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config: Remove temporary stable/newton ACLs https://review.openstack.org/382988 | 14:30 |
| *** gouthamr has joined #openstack-infra | 14:31 | |
| fungi | EmilienM: rcarrillocruz: more specifically, it's jgit that's limited. it only understands the most simple conflict resolution methods, so often you'll see merge failures or rebase button not working even though a local rebase doesn't report a conflict | 14:33 |
| *** ijw has joined #openstack-infra | 14:33 | |
| EmilienM | Vinsh: ^ fyi | 14:34 |
| *** vsaienko has quit IRC | 14:34 | |
| EmilienM | fungi: thx | 14:34 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Null value on avg_feedback_rate https://review.openstack.org/382996 | 14:34 |
| fungi | traditional cgit tries a variety of strategies to work around conflicts between commits, and is very advanced in that regard compared to jgit | 14:34 |
| *** vsaienko has joined #openstack-infra | 14:35 | |
| zigo | fungi: Could you run manage-projects, so I get the final release tags? | 14:35 |
| anteaya | fungi: how is the weather today? | 14:35 |
| pabelanger | clarkb: So, it took 6.1816667hrs to upload 1 of our raw images to BHS1. | 14:35 |
| pabelanger | clarkb: can only image when we do all 7 images. Running again, this time with iftop to track bandwidth | 14:36 |
| *** rhallisey has quit IRC | 14:36 | |
| *** ddieterly is now known as ddieterly[away] | 14:38 | |
| *** ijw has quit IRC | 14:38 | |
| AJaeger | fungi, pabelanger: Could either of you tell me quickly how many files are in http://files.openstack.org/developer-docs/ , please? Something like a "find /developer-docs -name "*.html" |wc -l" would be nice. | 14:39 |
| pabelanger | sure, 1 sec | 14:39 |
| fungi | zigo: it's running now | 14:39 |
| pabelanger | AJaeger: fungi 346 | 14:40 |
| AJaeger | thanks | 14:41 |
| fungi | anteaya: grey, cool and windy. we've got a weather system that's moved in over the past few days which is what's likely to deflect the hurricane away from us, so that's good news at least. but since weather is unpredictable and we're on our way to the airport tomorrow morning, still going to prepare the house as if it's heading right for us | 14:41 |
| *** qwertyco has quit IRC | 14:41 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources: Null value on avg_feedback_rate https://review.openstack.org/382996 | 14:41 |
| anteaya | glad you have a storm protecting you from the hurricane at least for today | 14:42 |
| *** annegentle has joined #openstack-infra | 14:42 | |
| anteaya | much remaining to do before you depart? | 14:42 |
| *** ddieterly[away] is now known as ddieterly | 14:42 | |
| *** OferBarber has quit IRC | 14:43 | |
| fungi | a fair amount, unfortunately, but i'm around online for most of the day in case anything important comes up in here | 14:43 |
| *** annegentle has quit IRC | 14:47 | |
| *** kaisers has quit IRC | 14:47 | |
| *** john-davidge has quit IRC | 14:49 | |
| anteaya | fortunately the release is finished, yay | 14:49 |
| anteaya | emotional support for completion of the remaining work | 14:49 |
| anteaya | if you would like it | 14:49 |
| pabelanger | clarkb: 5mins this morning using qcow2, testing raw again | 14:50 |
| clarkb | pabelanger: that is highly variable | 14:50 |
| pabelanger | yup | 14:50 |
| openstackgerrit | Kirill Zaitsev proposed openstack-infra/project-config: Add non-voting npm-test job to murano-dashboard https://review.openstack.org/383007 | 14:51 |
| *** jkilpatr has quit IRC | 14:52 | |
| *** zhurong has quit IRC | 14:52 | |
| *** annegentle has joined #openstack-infra | 14:53 | |
| *** lindsayk has quit IRC | 14:53 | |
| *** rockstar has quit IRC | 14:53 | |
| *** kong has quit IRC | 14:53 | |
| *** erlon has quit IRC | 14:54 | |
| *** ildikov has quit IRC | 14:54 | |
| *** ggherdov- has quit IRC | 14:54 | |
| *** armax has joined #openstack-infra | 14:54 | |
| *** asingh_ has quit IRC | 14:54 | |
| *** cody-somerville has quit IRC | 14:54 | |
| *** tchaypo has quit IRC | 14:54 | |
| *** MarkAtwood has quit IRC | 14:55 | |
| openstackgerrit | Kirill Zaitsev proposed openstack-infra/project-config: Add non-voting npm-test job to murano-dashboard https://review.openstack.org/383007 | 14:55 |
| *** DuncanT has quit IRC | 14:55 | |
| *** mkoderer has quit IRC | 14:55 | |
| *** asaprykin has quit IRC | 14:55 | |
| *** geekinutah has quit IRC | 14:55 | |
| *** jlanoux has joined #openstack-infra | 14:55 | |
| *** raddaoui has quit IRC | 14:55 | |
| *** csatari has quit IRC | 14:55 | |
| *** mattfarina has quit IRC | 14:55 | |
| *** ewindisch has quit IRC | 14:55 | |
| *** warpc has quit IRC | 14:55 | |
| *** iremizov has quit IRC | 14:55 | |
| *** mgkwill has quit IRC | 14:55 | |
| *** sweston has quit IRC | 14:55 | |
| *** zaro has quit IRC | 14:55 | |
| *** boris-42 has quit IRC | 14:55 | |
| *** mwhahaha has quit IRC | 14:55 | |
| *** dougwig has quit IRC | 14:55 | |
| *** cargonza has quit IRC | 14:55 | |
| *** ediardo has quit IRC | 14:55 | |
| *** andrewbogott has quit IRC | 14:55 | |
| *** electrical has quit IRC | 14:55 | |
| *** fkautz has quit IRC | 14:55 | |
| *** coolsvap has quit IRC | 14:55 | |
| *** patrickeast has quit IRC | 14:55 | |
| *** edwarnicke has quit IRC | 14:55 | |
| *** tomhambleton has quit IRC | 14:55 | |
| *** hrybacki has quit IRC | 14:55 | |
| *** _vsaienko has joined #openstack-infra | 14:56 | |
| *** vsaienko has quit IRC | 14:56 | |
| *** psilvad has joined #openstack-infra | 14:56 | |
| zigo | fungi: Thanks. | 14:58 |
| *** kaisers has joined #openstack-infra | 14:59 | |
| *** tuannguyen has joined #openstack-infra | 14:59 | |
| *** salv-orlando has joined #openstack-infra | 14:59 | |
| jeblair | AJaeger: i think your idea of a race sounds like the best fit for that error. especially since we are now doing deletes, we could actually have a job delete the in-progress temp files from another job. my idea to have a special post pipeline manager will correct this -- the question is, do we need that now, or can it wait for zuulv3? | 14:59 |
| jeblair | rcarrillocruz, clarkb: how about we use topic "zuulv3" for the devstack-gate roles? | 15:00 |
| rcarrillocruz | wfm | 15:00 |
| *** tuannguyen has quit IRC | 15:01 | |
| rcarrillocruz | not sure if you just wanted that for zuul-zuul | 15:01 |
| rcarrillocruz | i'll put that on my d-g changes then | 15:01 |
| rcarrillocruz | thx | 15:01 |
| clarkb | thats fine by me | 15:01 |
| *** tuannguyen has joined #openstack-infra | 15:01 | |
| openstackgerrit | Yuval Brik proposed openstack-infra/system-config: Rename Smaug to Karbor https://review.openstack.org/353309 | 15:01 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Rebuild DIB on missing image format https://review.openstack.org/383022 | 15:01 |
| *** ccamacho has quit IRC | 15:01 | |
| *** mwhahaha has joined #openstack-infra | 15:02 | |
| *** yuval has quit IRC | 15:03 | |
| *** r-mibu has quit IRC | 15:04 | |
| *** jkilpatr has joined #openstack-infra | 15:04 | |
| AJaeger | jeblair: for openstack-manuals, it's not a problem since we publish so often that it heals itself ;) | 15:04 |
| AJaeger | jeblair: and if the errors are only "cannot delete" then we're fine as well... | 15:05 |
| AJaeger | jeblair: it only becomes critical if we would have a release job publish something in a specific place and that doesn't show up... | 15:05 |
| *** oanson has quit IRC | 15:05 | |
| jeblair | AJaeger: i think the cannot delete errors are harmless, actually -- it was the "failed to set permissions" and "rename" errors that were the real ones. i believe they may have caused that file not to actually be published by that job (but likely only because it was just published by a different job) | 15:06 |
| AJaeger | jeblair: So, let's wait until we notice a real problem | 15:06 |
| *** tuannguyen has quit IRC | 15:06 | |
| jeblair | but yes, i *think* it's going to mostly work out oj | 15:07 |
| jeblair | ok | 15:07 |
| *** martinkopec has quit IRC | 15:07 | |
| rcarrillocruz | i suspect we may end up refactoring more stuff on the devstack-gate. For example, I've refactored the network_sanity_check function as a playbook, which include two task files for doing net checks, ping_check and http_check. However, network_sanity_check is a funciton called by setup_host, which is the entry point from ansible at devstack-gate-wrap ( we use an ansible shell task ). IMHO we should | 15:08 |
| rcarrillocruz | make the setup_host a playbook, and all the calls within task files | 15:08 |
| *** marst has quit IRC | 15:08 | |
| *** _vsaienko has quit IRC | 15:08 | |
| rcarrillocruz | the gather_facts we have ootb from ansible would gather multiple things we gather now in the setup_host body | 15:08 |
| *** r-mibu has joined #openstack-infra | 15:09 | |
| *** jlanoux_ has joined #openstack-infra | 15:09 | |
| *** annegentle has quit IRC | 15:09 | |
| *** jlanoux has quit IRC | 15:10 | |
| *** armax has quit IRC | 15:10 | |
| pabelanger | Ya, I've started work on the swap role, great that we have a branch now | 15:10 |
| *** rajinir has joined #openstack-infra | 15:10 | |
| rcarrillocruz | are we good on hosting this stuff on the d-g repo under playbooks/roles | 15:11 |
| *** armax has joined #openstack-infra | 15:11 | |
| rcarrillocruz | i haven't put stuff on roles, but i can just make the task files as roles if needed | 15:11 |
| pabelanger | that what I did for my local change | 15:11 |
| rcarrillocruz | ++ | 15:11 |
| *** _vsaienko has joined #openstack-infra | 15:11 | |
| rcarrillocruz | i'll push a patchset | 15:12 |
| pabelanger | playbook/roles/devstack-gate.swap | 15:12 |
| pabelanger | or something like that | 15:12 |
| clarkb | I dunno if we 50 roles though | 15:12 |
| clarkb | I think host setup role that includes swap etc makes more sense? | 15:12 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 15:12 |
| clarkb | then when people go to reconsume they dont ha e to determine which of yhe many roles they need, there is just one | 15:13 |
| *** electrical has joined #openstack-infra | 15:13 | |
| clarkb | I guess this is why include role is so shiny? | 15:14 |
| clarkb | but 2.2 isnt out yet... | 15:15 |
| *** lucasagomes is now known as lucas-hungry | 15:15 | |
| *** edwarnicke_ has joined #openstack-infra | 15:15 | |
| *** cody-somerville has joined #openstack-infra | 15:16 | |
| *** cody-somerville has joined #openstack-infra | 15:16 | |
| *** fkautz has joined #openstack-infra | 15:17 | |
| * clarkb wants 2.2 to cleanup all this inventory logic | 15:17 | |
| *** r-daneel has joined #openstack-infra | 15:17 | |
| *** ccamacho has joined #openstack-infra | 15:18 | |
| *** warpc has joined #openstack-infra | 15:18 | |
| *** dougwig has joined #openstack-infra | 15:19 | |
| *** marst has joined #openstack-infra | 15:19 | |
| *** ewindisch has joined #openstack-infra | 15:19 | |
| jeblair | clarkb: well, we only have 8 roles on our etherpad | 15:20 |
| *** sweston has joined #openstack-infra | 15:20 | |
| jeblair | and yeah, things will get better by zuulv3 :) | 15:20 |
| *** mkoderer has joined #openstack-infra | 15:21 | |
| clarkb | jeblair: ya but if every task rcarrillocruz has is converted to a role those add up quick | 15:21 |
| *** yaume has quit IRC | 15:21 | |
| *** rockstar has joined #openstack-infra | 15:21 | |
| *** vhosakot has joined #openstack-infra | 15:21 | |
| *** mwhahaha is now known as mwhahaha_ | 15:21 | |
| rcarrillocruz | yeah, i'm actually not making the checks as roles | 15:21 |
| rcarrillocruz | but task files | 15:21 |
| clarkb | anyways I imagine logical collections will shake out as we go | 15:21 |
| rcarrillocruz | so network sanity check | 15:21 |
| rcarrillocruz | is going to be role network_sanity_check | 15:21 |
| clarkb | rcarrillocruz: gotcha | 15:21 |
| rcarrillocruz | also because it's not possible to call a role from a role yet as clarkb pointed out | 15:21 |
| rcarrillocruz | so... | 15:21 |
| *** lindsayk has joined #openstack-infra | 15:22 | |
| rcarrillocruz | btw, are good to land https://review.openstack.org/#/c/378996/ | 15:23 |
| *** yaume has joined #openstack-infra | 15:23 | |
| rcarrillocruz | fungi, i addressed your comments | 15:23 |
| rcarrillocruz | the iptables stuff will come in a subsequent patch, i landed jesusaur change about putting the cacti ipv4/v6 addresses as defaults on the puppet class signature, instead in the class code | 15:23 |
| *** boris-42 has joined #openstack-infra | 15:24 | |
| *** mdrabe has quit IRC | 15:24 | |
| *** tchaypo has joined #openstack-infra | 15:25 | |
| *** hashar is now known as hasharAway | 15:26 | |
| *** abregman is now known as abregman|afk | 15:26 | |
| *** yaume has quit IRC | 15:27 | |
| *** mgkwill has joined #openstack-infra | 15:27 | |
| fungi | zigo: manage-projects reports issues with the deb-python-pyvmomi and deb-python-rfc3986 repos... i have a feeling they're incomplete/broken imports but i don't have time to look into them right now | 15:28 |
| zigo | fungi: What's the quick fix? | 15:28 |
| zigo | They used to be ok ... | 15:28 |
| *** azvyagintsev has joined #openstack-infra | 15:28 | |
| fungi | zigo: no idea. jeepyb reported "Failed to checkout config for project" on both of those | 15:29 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/devstack-gate: Move network sanity check to Ansible https://review.openstack.org/382821 | 15:29 |
| *** hrybacki has joined #openstack-infra | 15:29 | |
| zigo | fungi: Running git fsck --full in Alioth shows no issue, so the issue wasn't there. | 15:30 |
| zigo | fungi: Maybe in upstream repo? | 15:30 |
| fungi | zigo: raised FetchConfigException at line 181 of jeepyb/cmd/manage_projects.py | 15:30 |
| zigo | Oh... | 15:30 |
| zigo | fungi: Will it still continue to work for the other repos? | 15:30 |
| fungi | zigo: yeah, i think your other repos are fine | 15:30 |
| zigo | fungi: Ok, I'll look into it later then. | 15:30 |
| * zigo is busy upgrading to final releases. | 15:31 | |
| *** mdrabe has joined #openstack-infra | 15:31 | |
| zigo | Thanks again, btw. | 15:32 |
| *** tonytan_brb has joined #openstack-infra | 15:32 | |
| fungi | glad to help | 15:32 |
| fungi | hopefully we get the track-upstream updates separated from our ad hoc manage-projects runs soon | 15:32 |
| *** asaprykin has joined #openstack-infra | 15:33 | |
| *** geekinutah has joined #openstack-infra | 15:33 | |
| *** abregman|afk is now known as abregman | 15:33 | |
| *** mattfarina has joined #openstack-infra | 15:34 | |
| *** asingh_ has joined #openstack-infra | 15:34 | |
| *** kong has joined #openstack-infra | 15:34 | |
| zigo | fungi: Yeah. I'm also very much looking forward to have a real Debian mirror. 99% of non-deterministic build failures are due to failure to download form Debian repos ... | 15:34 |
| *** ijw has joined #openstack-infra | 15:34 | |
| zigo | And there's lots of them. | 15:34 |
| zigo | I switched from httpredir.debian.org to ftp.us.debian.org, but that's still not a 100% fix. | 15:34 |
| zigo | Just a little bit better. | 15:35 |
| *** tonytan4ever has quit IRC | 15:35 | |
| fungi | might be worth trying deb.d.o, but even that's no substitute for local mirrors, agreed | 15:35 |
| *** ggherdov- has joined #openstack-infra | 15:35 | |
| *** andrewbogott has joined #openstack-infra | 15:35 | |
| *** erlon has joined #openstack-infra | 15:36 | |
| *** MarkAtwood has joined #openstack-infra | 15:36 | |
| *** edwarnicke_ is now known as edwarnicke | 15:36 | |
| fungi | though deb.d.o uses the same cdn as pypi.p.o at least | 15:36 |
| *** DuncanT has joined #openstack-infra | 15:36 | |
| *** andrewbogott has quit IRC | 15:37 | |
| *** andrewbogott has joined #openstack-infra | 15:37 | |
| *** patrickeast has joined #openstack-infra | 15:37 | |
| *** adrian_otto has joined #openstack-infra | 15:37 | |
| *** ildikov has joined #openstack-infra | 15:38 | |
| *** nadya has joined #openstack-infra | 15:38 | |
| *** nadya has quit IRC | 15:38 | |
| *** andreas_s has quit IRC | 15:38 | |
| *** iremizov has joined #openstack-infra | 15:39 | |
| *** ijw has quit IRC | 15:40 | |
| openstackgerrit | Jordan Pittier proposed openstack/os-client-config: cloud_config:get_session_endpoint: catch Keystone EndpointNotFound https://review.openstack.org/383042 | 15:41 |
| *** cargonza has joined #openstack-infra | 15:41 | |
| pabelanger | clarkb: So, I think we could revert to qcow2 images for OVH, since we appear to be fighting some bandwidth issues | 15:41 |
| pabelanger | I'm still working on reproducing the image queued issue | 15:41 |
| *** raddaoui has joined #openstack-infra | 15:42 | |
| pabelanger | but, maybe we need to have shade be a little smarter, if upload has started, then queued is detected, that likely means we didn't completely upload the image for some reason | 15:42 |
| *** ediardo has joined #openstack-infra | 15:43 | |
| openstackgerrit | Jordan Pittier proposed openstack/os-client-config: cloud_config:get_session_endpoint: catch Keystone EndpointNotFound https://review.openstack.org/383042 | 15:43 |
| *** tuannguyen has joined #openstack-infra | 15:44 | |
| clarkb | pabelanger: and treat it as a failure? | 15:44 |
| *** zaro has joined #openstack-infra | 15:45 | |
| pabelanger | ya, I think so | 15:45 |
| *** csatari has joined #openstack-infra | 15:46 | |
| pabelanger | unless we actually finish ImageUpload, something happens on the far side, then it falls back to queued status | 15:46 |
| *** tomhambleton has joined #openstack-infra | 15:46 | |
| *** coolsvap has joined #openstack-infra | 15:47 | |
| pabelanger | http://git.openstack.org/cgit/openstack-infra/shade/tree/shade/openstackcloud.py#n2969 | 15:48 |
| clarkb | Is there a non failing queued state we need to be aware of too? | 15:48 |
| pabelanger | it does look like we change to see if the image status is not saving, queued. I wonder if that should just be saving and if queued, error? Since we would have finished an upload by then | 15:49 |
| pabelanger | clarkb: ya, that is what I need to figure out | 15:49 |
| *** mwhahaha has joined #openstack-infra | 15:49 | |
| pabelanger | http://docs.openstack.org/developer/glance/statuses.html | 15:49 |
| pabelanger | implies queued is only a failure for saving | 15:50 |
| pabelanger | and when you create image | 15:50 |
| clarkb | huh (odd name for a failure) | 15:50 |
| pabelanger | The image identifier has been reserved for an image in the Glance registry. No image data has been uploaded to Glance and the image size was not explicitly set to zero on creation. | 15:50 |
| anteaya | another project-config core reviewer available to review the revert for temporary stable/newton acls? https://review.openstack.org/#/c/382988 | 15:50 |
| clarkb | maybe flaper87 or nikhil can clarify for us | 15:50 |
| pabelanger | http://git.openstack.org/cgit/openstack-infra/shade/commit/?id=229f3daae0b9a8aba6e41eedf90eae20fcb8ecf5 looks to be the commit to add this logic | 15:52 |
| *** unrahul has quit IRC | 15:52 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/devstack-gate: Add role for fix_etc_hosts https://review.openstack.org/383052 | 15:52 |
| *** unrahul has joined #openstack-infra | 15:52 | |
| pabelanger | and might explain why we have issues with OVH BHS1 recently | 15:52 |
| *** nadya has joined #openstack-infra | 15:52 | |
| pabelanger | mordred: ^ might be interested in some help with above and issues we see in ovh-bhs1 with queued images | 15:53 |
| *** kaisers has quit IRC | 15:53 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: [WIP] Add IPv6 coverage using existing jobs https://review.openstack.org/382515 | 15:54 |
| *** berendt has quit IRC | 15:55 | |
| *** akshai_ has quit IRC | 15:55 | |
| *** esikachev has quit IRC | 15:56 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Perform a booting test for our images https://review.openstack.org/204639 | 15:56 |
| clarkb | pabelanger: interesting, I think those dates to roughly line up with when we had trouble there (though I would have to go look at git logs to be sure) | 15:57 |
| *** sputnik13 has joined #openstack-infra | 15:58 | |
| *** _vsaienko has quit IRC | 15:58 | |
| *** skamalakannan has joined #openstack-infra | 15:59 | |
| anteaya | thanks AJaeger | 16:00 |
| pabelanger | clarkb: Ya, that is what I am trying to track down too | 16:00 |
| *** EricGonc_ has quit IRC | 16:00 | |
| skamalakannan | anyone can help me on internet connectivity in openstack | 16:00 |
| *** rcernin has quit IRC | 16:01 | |
| *** mdrabe has quit IRC | 16:01 | |
| *** mdrabe has joined #openstack-infra | 16:01 | |
| *** vsaienko has joined #openstack-infra | 16:01 | |
| *** david-lyle has joined #openstack-infra | 16:01 | |
| *** jheroux has quit IRC | 16:02 | |
| anteaya | skamalakannan: what is the issue? | 16:03 |
| *** weshay is now known as weshay_bbiab | 16:03 | |
| anteaya | skamalakannan: we can't do anything about an internet service provider issue | 16:03 |
| openstackgerrit | Merged openstack-infra/project-config: Remove temporary stable/newton ACLs https://review.openstack.org/382988 | 16:04 |
| skamalakannan | anteaya, i am using my home internet. | 16:05 |
| anteaya | skamalakannan: what is your issue? | 16:05 |
| *** jheroux has joined #openstack-infra | 16:06 | |
| skamalakannan | i dont have a public IP. Is is possible to have internet acivitity in VM's | 16:06 |
| anteaya | skamalakannan: this channel is for questions from developers about developer issues | 16:07 |
| *** rhallisey has joined #openstack-infra | 16:07 | |
| anteaya | skamalakannan: are you running openstack in order to improve the code? | 16:07 |
| skamalakannan | I am able to spawn VM's using a external network. But there is not internet connectivity | 16:07 |
| skamalakannan | No. I am learner | 16:07 |
| skamalakannan | which group can help me put | 16:08 |
| skamalakannan | out* | 16:08 |
| anteaya | skamalakannan: if you are running openstack for your own use your best help is in the #openstack channel | 16:08 |
| skamalakannan | ok thanks | 16:08 |
| anteaya | welcome | 16:08 |
| *** esikachev has joined #openstack-infra | 16:08 | |
| pabelanger | clarkb: shade 1.12.0 first included the patch, but we cloud have been running it sooner, I think we had an untagged version of shade running a few times to test our the FIP patch back in Aug. | 16:09 |
| clarkb | pabelanger: good point, we defiitely have had that at different times | 16:09 |
| *** e0ne_ has quit IRC | 16:09 | |
| pabelanger | clarkb: but, end of Aug is when we started fixing our nodepool-builder issues with leaked images / uploads getting deleted. So, I think the timelines match up pretty close | 16:10 |
| *** csomerville has joined #openstack-infra | 16:10 | |
| pabelanger | sadly, we don't have nodepool logs from then | 16:10 |
| pabelanger | https://review.openstack.org/#/c/358843/ | 16:10 |
| pabelanger | Aug. 23 | 16:10 |
| vsaienk0 | clarkb: we've faced a problem with https://review.openstack.org/#/c/364830/ setup_ssh function change perms on directory to 700 and neutron dnsmasq stop working | 16:11 |
| *** cody-somerville has quit IRC | 16:11 | |
| *** akshai has joined #openstack-infra | 16:11 | |
| clarkb | vsaienk0: why does dnsmasq care about ssh keys? | 16:11 |
| vsaienk0 | clarkb: neutron uses /opt/stack/data/neutron subdirectory to store dnsmasq configs | 16:12 |
| *** lucas-hungry is now known as lucasagomes | 16:12 | |
| clarkb | vsaienk0: but the ssh keys are in an ssh keys dir | 16:13 |
| *** jordanP has quit IRC | 16:13 | |
| vsaienk0 | clarkb: we put keys to /opt/stack/data/ironic/ but setup_ssh keys change perms on /opt/stack/data to 700 | 16:13 |
| *** gyee has joined #openstack-infra | 16:13 | |
| clarkb | vsaienk0: I don't think it should recursively apply the permissions like that | 16:13 |
| *** jistr is now known as jistr|afk | 16:14 | |
| clarkb | pabelanger: rcarrillocruz ^ using file module with "path='/opt/stack/data/ironic/ssh_keys' mode=0700 state=directory" should only change the mode on the ssh_keys dir right? | 16:14 |
| *** vsaienko has quit IRC | 16:15 | |
| *** adrian_otto has quit IRC | 16:15 | |
| pabelanger | clarkb: Right, that is how I would expect it to work | 16:15 |
| pabelanger | recurse: no is the default | 16:15 |
| clarkb | vsaienk0: ya I don' | 16:16 |
| clarkb | t think that is the issue | 16:16 |
| vsaienk0 | clarkb: when we switched to setup_ssh keys we found that perms were changed | 16:16 |
| clarkb | vsaienk0: it should be testable locally if you install that version of ansible and run the ansible command | 16:16 |
| rcarrillocruz | ++ | 16:16 |
| vsaienk0 | clarkb: I can find a job logs | 16:16 |
| *** jcoufal has quit IRC | 16:16 | |
| *** strigazi is now known as strigazi_AFK | 16:17 | |
| vsaienk0 | clarkb: http://logs.openstack.org/73/368173/25/experimental/gate-tempest-dsvm-ironic-ipa-wholedisk-agent_ssh-tinyipa-multinode-nv/3473499/logs/devstacklog.txt.gz#_2016-10-06_11_19_41_482 | 16:18 |
| vsaienk0 | clarkb: parent directory of /opt/stack/data/neutron has perms 700 | 16:18 |
| *** vsaienko has joined #openstack-infra | 16:19 | |
| clarkb | vsaienk0: right I don't doubt that the perms are not what you expect. I just have a hard time believing that ansible command is at fault. Do you have logs from a job that ran recently (like today) without this change? | 16:19 |
| *** mrhillsman has joined #openstack-infra | 16:20 | |
| *** marst has quit IRC | 16:20 | |
| *** jcoufal has joined #openstack-infra | 16:20 | |
| vsaienk0 | clarkb: when I update perms to 755 after calling setup_ssh job passed http://logs.openstack.org/73/368173/26/experimental/gate-tempest-dsvm-ironic-ipa-wholedisk-agent_ssh-tinyipa-multinode-nv/0723776/console.html | 16:20 |
| pabelanger | I'm also failing to see the link, the log is showing 0700 on /opt/stack/data/neutron/ but the review is for /opt/stack/data/ironic/ssh_keys/ | 16:21 |
| vsaienk0 | clarkb: I did it here: https://review.openstack.org/#/c/368173/26/devstack/plugin.sh@72 | 16:21 |
| clarkb | vsaienk0: push a child change that does an ls listing before and after that function | 16:21 |
| clarkb | and/or try to reproduce locally using ansible | 16:22 |
| asselin__ | infra-root: can 3rd party ci folks get reviews on this and depending change to pin jenkins? https://review.openstack.org/#/c/367232/ | 16:22 |
| vsaienk0 | clarkb: Ok I will push a new change | 16:22 |
| *** marst has joined #openstack-infra | 16:22 | |
| pabelanger | asselin__: looking | 16:22 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: WIP testing setup_ssh https://review.openstack.org/383090 | 16:24 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Add reno jobs for python-tripleoclient https://review.openstack.org/382041 | 16:24 |
| pabelanger | asselin__: should the jenkins_version be present to maintain backwards compat? | 16:24 |
| *** mwhahaha_ has quit IRC | 16:24 | |
| asselin__ | pabelanger, in which patch? in puppet-jenkins yes, in puppet-openstackci, no | 16:25 |
| *** ccamacho1 has joined #openstack-infra | 16:25 | |
| vsaienk0 | clarkb: I hope it will break the job by exit https://review.openstack.org/#/c/383090/1/devstack-vm-gate.sh | 16:25 |
| asselin__ | the rationale is that 'present' doesn't work for puppet-openstackci | 16:25 |
| *** spzala has quit IRC | 16:25 | |
| asselin__ | hence the need for the pin | 16:25 |
| *** ccamacho has quit IRC | 16:26 | |
| *** jlanoux_ has quit IRC | 16:26 | |
| pabelanger | asselin__: okay, do you mind updating the commit message saying why you are pinning to 1.651? I haven't followed jenkins releases in a while | 16:26 |
| vsaienk0 | pabelanger, clarkb: thanks for help, I will get back when have results | 16:26 |
| *** annegentle has joined #openstack-infra | 16:27 | |
| pabelanger | asselin__: okay, I see some comments in the single_node_ci.pp now | 16:27 |
| *** vsaienko has quit IRC | 16:28 | |
| *** Swami has joined #openstack-infra | 16:28 | |
| pabelanger | asselin__: +3 | 16:28 |
| asselin__ | pabelanger, I don't mind to update the commit message. | 16:28 |
| fungi | asselin__: versions later than 1.651 don't work with the gearman plugin? | 16:28 |
| fungi | i thought jobs just needed configuration to whitelist zuul parameters | 16:29 |
| clarkb | fungi: yes that | 16:29 |
| clarkb | you either disable the checking entirely or whitelist the parameters explicitly iirc | 16:29 |
| clarkb | there is even old jjb configs to do the whitelisting that you can resurrect out of our git history if needed | 16:30 |
| pabelanger | I've removed +workflow, for more eyes on the review | 16:30 |
| fungi | seems questionable to default to a version which intentionally avoids security features implemented upstream. this is no better than having it install jenkins and break that feature, is it? | 16:30 |
| fungi | er, no better than having it install newer jenkins and disable that security feature i mean | 16:30 |
| *** vsaienko has joined #openstack-infra | 16:31 | |
| *** tesseract- has quit IRC | 16:31 | |
| clarkb | anyone else want to take the plunge on more tls in tests https://review.openstack.org/#/c/382618/ | 16:31 |
| clarkb | armax: btw re ^ the chagne to improve logging for the proxy has merged to devstack so we should in theory have much better data on those fails mriedem pointed out | 16:32 |
| asselin__ | any objections over this? https://review.openstack.org/#/c/366803/ | 16:32 |
| *** xyang1 has joined #openstack-infra | 16:32 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: WIP testing setup_ssh. https://review.openstack.org/383090 | 16:33 |
| clarkb | asselin__: I would recommend using the archive (I think that is its name) module to do the download and hash checking (I would add hash checking) | 16:33 |
| *** zhenguo has quit IRC | 16:33 | |
| clarkb | asselin__: but I think its fine to allow selectable jenkins versions as a general feature | 16:33 |
| zigo | fungi: You see, I'm done with the 24 patches for finalizing the release, and half of them have indice download failures ... :( | 16:33 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: warn when we can't find the version and skip reno https://review.openstack.org/383098 | 16:33 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: do not use locale version of admonition labels https://review.openstack.org/383099 | 16:33 |
| zigo | fungi: Got to nagivate between the dak runs. | 16:33 |
| fungi | asselin__: i worry that with 367232 we're openly encouraging downstream users to install older, known insecure versions of jenkins just to avoid them having to alter their job configuration to support security features introduced in newer jenkins releases | 16:34 |
| *** mat128 is now known as mat128|lunch | 16:34 | |
| asselin__ | fungi, I understand. Most 3rd party folks have other measures in place for security, so it's not an issue, but for the general case you can't assume that. | 16:36 |
| *** ijw has joined #openstack-infra | 16:36 | |
| fungi | asselin__: well, that worry is only partly for the sake of downstream consumers themselves, but also that i don't want to be contradicting upstream jenkins developers' position on what security functionality is needed in the application | 16:37 |
| pabelanger | Ya, that is a good point | 16:38 |
| asselin__ | fungi, ok, so there are 2 paths forward I see. 1. Enable jenkins version pin for those that want that. | 16:38 |
| fungi | we could end up with jenkins forums full of "don't use openstack's ci, they tell you to use old broken jenkins releases and you'll get hacked in no time" | 16:38 |
| asselin__ | 2. Enable jenkins arg selection for those that want to override https://review.openstack.org/#/c/262787/16 I believe ? | 16:38 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Update localrc for ironic-multinode case https://review.openstack.org/352790 | 16:38 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: WIP testing setup_ssh. https://review.openstack.org/383090 | 16:38 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Update ENABLED_SERVICE on subnode with ironic https://review.openstack.org/368611 | 16:38 |
| asselin__ | 3. is whitelist params in Jenkins? In not familiar with this one. | 16:39 |
| clarkb | asselin__: if you explicitly list a set of parameters on a job then plugins can modify their values | 16:40 |
| asselin__ | clarkb, fungi would you add your comments to the patches so they can get fixed? | 16:40 |
| fungi | asselin__: as much as i'd love to have an "easy button" for this, it's probably one where we need to expose the inconvenience downstream (more secure but possibly broken by default) and allow people who are using the module to make this decision rather than making this security decision for them | 16:40 |
| *** ijw has quit IRC | 16:40 | |
| asselin__ | fungi, ++ | 16:40 |
| fungi | asselin__: sure, i'm using this discussion to help me formalize my thoughts about it | 16:40 |
| fungi | it's definitely a complicated situation | 16:41 |
| asselin__ | clarkb, can you elaborate where you do that? in the JJB file? Zuul? Jenkins itself? | 16:41 |
| *** moravec1 has quit IRC | 16:42 | |
| clarkb | asselin__: in the jenkins job configuration, however you are managing that | 16:42 |
| clarkb | asselin__: it is per job, JJB can do it for you ( and we did ti for a long long time) | 16:42 |
| *** skamalakannan has quit IRC | 16:43 | |
| asselin__ | clarkb, really? link to patch? | 16:43 |
| clarkb | asselin__: you'd have to look in the git history for the jjb configs. zuul parameters was the macro iirc | 16:43 |
| *** tkelsey has joined #openstack-infra | 16:45 | |
| *** Drago has joined #openstack-infra | 16:46 | |
| openstackgerrit | Akihiro Motoki proposed openstack-infra/project-config: WIP: Translate releasenotes https://review.openstack.org/372167 | 16:46 |
| asselin__ | clarkb, in project-config/jenkins/jobs? | 16:48 |
| openstackgerrit | Erlon R. Cruz proposed openstack-infra/project-config: Adds new experimental Cinder migration job https://review.openstack.org/381737 | 16:48 |
| clarkb | asselin__: yes, though I think these configs predate project-config the history should've been preserved | 16:48 |
| clarkb | asselin__: it was required back when we triggered jobs via the http api instead of using gearman | 16:48 |
| asselin__ | clarkb, oh wow...very long time ago | 16:48 |
| fungi | doesn't seem like so long ago to me. how time flies | 16:49 |
| *** tphummel has joined #openstack-infra | 16:49 | |
| vsaienk0 | sc68cal: some time ago you reviewed a patch that drops hardcoding SERVICE_HOST to 127.0.0.1 https://review.openstack.org/#/c/368870 there were problems with intel NFV nova CI, but they fixed issue and give +1, also nova/neutron CI passes without problems. Could you please reconsider your vote on that change? | 16:50 |
| asselin__ | the 4th alternative is to just leave-it as-is and wiat for zuul v3....end of the month is it? | 16:50 |
| *** gyee has quit IRC | 16:51 | |
| anteaya | zuul v3 has no arrival time set | 16:53 |
| anteaya | not even an estimate | 16:53 |
| *** ddieterly is now known as ddieterly[away] | 16:54 | |
| anteaya | it'll be ready when jeblair says it's ready | 16:54 |
| *** tonytan_brb is now known as tonytan4ever | 16:54 | |
| *** Apoorva has joined #openstack-infra | 16:54 | |
| *** derekh has quit IRC | 16:56 | |
| *** jtomasek_ has joined #openstack-infra | 16:56 | |
| *** jistr|afk is now known as jistr | 16:57 | |
| *** vsaienko has quit IRC | 16:57 | |
| vsaienk0 | clarkb: previously there were not /opt/stack/data directory http://logs.openstack.org/73/368173/30/experimental/gate-tempest-dsvm-ironic-ipa-wholedisk-agent_ssh-tinyipa-multinode-nv/4ec9e01/console.html#_2016-10-06_16_55_43_115092 | 16:57 |
| *** ddieterly[away] is now known as ddieterly | 16:57 | |
| vsaienk0 | clarkb: and it was created with 700 http://logs.openstack.org/73/368173/30/experimental/gate-tempest-dsvm-ironic-ipa-wholedisk-agent_ssh-tinyipa-multinode-nv/4ec9e01/console.html#_2016-10-06_16_55_46_412585 | 16:58 |
| clarkb | vsaienk0: ok that explains it. Devstack is creating that dir when it runs normally but since we are making a subdir ansible does its best | 16:58 |
| clarkb | vsaienk0: In this case you can precreate the dir if you need to or use a different dir for your ssh keys (like the stack user's .ssh dir maybe) | 16:58 |
| *** vsaienko has joined #openstack-infra | 16:59 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Add pkg-map for gentoo to runtime-ssh-host-keys https://review.openstack.org/383126 | 16:59 |
| *** jcoufal_ has joined #openstack-infra | 16:59 | |
| *** amitgandhinz has quit IRC | 16:59 | |
| *** ralonsoh has quit IRC | 16:59 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: ignore unrecognized inline directives https://review.openstack.org/383129 | 17:00 |
| clarkb | pabelanger: jeblair are we ready to do the nodepool puppeting changes now? | 17:00 |
| *** Apoorva_ has joined #openstack-infra | 17:01 | |
| *** yamahata has quit IRC | 17:01 | |
| *** sdake has joined #openstack-infra | 17:01 | |
| vsaienk0 | clarkb: I'm wondered why ansible creates a parent directory with 700 also | 17:01 |
| *** yamahata has joined #openstack-infra | 17:01 | |
| *** jcoufal has quit IRC | 17:01 | |
| *** vhosakot_ has joined #openstack-infra | 17:02 | |
| clarkb | vsaienk0: because to create the child dir the parent dir must exist, and so it is doing its best with the information available to make this command succeed instead of failing | 17:02 |
| clarkb | vsaienk0: there is an argument that it should fail instead (and this is puppets behavior) | 17:02 |
| *** dtantsur is now known as dtantsur|afk | 17:02 | |
| *** jamielennox|away has quit IRC | 17:02 | |
| pabelanger | clarkb: Yup, have a open afternoon | 17:03 |
| *** david-lyle has quit IRC | 17:03 | |
| *** vhosakot has quit IRC | 17:03 | |
| vsaienk0 | clarkb: ok so what do you think if we put keys under /opt/stack/.ssh/ironic_keys and use that directory? | 17:03 |
| clarkb | pabelanger: cool I think we can just approve the changes, then once the init scripts are in place on the server shut down jeblairs screen with manual foregrounded processes and start the new daemons? | 17:04 |
| fungi | does ansible have a default umask we should be changing to something other than 077 for jobs? | 17:04 |
| clarkb | vsaienk0: I think that is a good idea since that is where I would expect the stack user's keys to live | 17:04 |
| openstackgerrit | Saad Zaher proposed openstack-infra/project-config: Added python-freezerclient py34,35, requirements gate jobs https://review.openstack.org/383152 | 17:04 |
| clarkb | fungi: I don't know but the file module docs probably tell us /me looks | 17:04 |
| *** Apoorva has quit IRC | 17:04 | |
| *** woodster_ has joined #openstack-infra | 17:05 | |
| clarkb | fungi: doesn't look like it | 17:05 |
| *** Apoorva_ has quit IRC | 17:05 | |
| fungi | still i agree this behavior is only confusing, not incorrect. we should be explicit about creating directories rather than implicit | 17:05 |
| pabelanger | clarkb: WFM | 17:06 |
| clarkb | pabelanger: I will aprove the stack now then | 17:07 |
| *** chem has quit IRC | 17:07 | |
| *** Naeil has quit IRC | 17:07 | |
| pabelanger | kk | 17:08 |
| *** Drago has left #openstack-infra | 17:09 | |
| *** csomerville has quit IRC | 17:10 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Update localrc for ironic-multinode case https://review.openstack.org/352790 | 17:10 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Setup ssh-key on subnodes for Ironic https://review.openstack.org/364830 | 17:10 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Update ENABLED_SERVICE on subnode with ironic https://review.openstack.org/368611 | 17:10 |
| *** nadya has quit IRC | 17:11 | |
| *** vsaienko has quit IRC | 17:11 | |
| *** sputnik13 has quit IRC | 17:12 | |
| *** Apoorva has joined #openstack-infra | 17:12 | |
| *** amitgandhinz has joined #openstack-infra | 17:13 | |
| vsaienk0 | clarkb: thanks for your help, I will ping you once more, when ironic patch passed grenade | 17:13 |
| vsaienk0 | *multinode | 17:13 |
| *** jpich has quit IRC | 17:14 | |
| clarkb | vsaienk0: ok, keep in mind that neutron + osic + multinode is still problematic (last I checked at least) so failures may not be related to this stack of changes | 17:14 |
| *** weshay_bbiab is now known as weshay | 17:15 | |
| jeblair | clarkb: nodepool puppet sounds good to me | 17:16 |
| openstackgerrit | Andreas Jaeger proposed openstack-dev/cookiecutter: Add locale_dir for translation of releasenotes https://review.openstack.org/383155 | 17:16 |
| *** jamielennox|away has joined #openstack-infra | 17:16 | |
| *** jamielennox|away is now known as jamielennox | 17:16 | |
| openstackgerrit | Merged openstack-infra/puppet-nodepool: Add nodepool-(builder|deleter) services https://review.openstack.org/382626 | 17:18 |
| *** tosky has quit IRC | 17:18 | |
| *** vsaienko has joined #openstack-infra | 17:18 | |
| clarkb | mtreinish: do we need to revert https://review.openstack.org/#/c/381960/ because that doesn't help in your venv? | 17:18 |
| harlowja | AJaeger do u know why certain jobs wouldn't be showing up on http://status.openstack.org/openstack-health/#/?groupKey=build_name&resolutionKey=hour&searchProject=-with-oslo | 17:18 |
| *** abregman has quit IRC | 17:18 | |
| *** ddieterly is now known as ddieterly[away] | 17:19 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackci: Add split daemon support for nodepool https://review.openstack.org/382664 | 17:19 |
| harlowja | like 'periodic-nova-py27-with-oslo-master' | 17:19 |
| mtreinish | clarkb: it doesn't break anything | 17:19 |
| mtreinish | and cython is still a build dep for right now | 17:19 |
| clarkb | mtreinish: ya its just not helping right? | 17:19 |
| AJaeger | harlowja: mtreinish is the expert | 17:19 |
| harlowja | kk | 17:19 |
| AJaeger | harlowja: you need to add the proper glue in general - | 17:19 |
| mtreinish | clarkb: well it will when I actually write the patch to stop using a venv | 17:19 |
| harlowja | 'general -' ? | 17:19 |
| mtreinish | clarkb: the only reason it works now is fungi manually installed everything | 17:20 |
| mtreinish | I just keep getting side tracked and haven't pushed out that patch yet | 17:20 |
| AJaeger | harlowja: a subunit log file is needed, if that does not exist, it does not show up. | 17:20 |
| clarkb | mtreinish: gotcha | 17:20 |
| harlowja | AJaeger intersting | 17:20 |
| AJaeger | harlowja: I don't konw whether your job generates the subunit file | 17:20 |
| *** tuannguyen has quit IRC | 17:20 | |
| *** tlian has joined #openstack-infra | 17:20 | |
| mtreinish | harlowja: right what AJaeger said is right. All the data is based on what's in the subunit2sql db | 17:20 |
| harlowja | gotcha, and these aren't getting far enough to make a subunit file | 17:21 |
| AJaeger | harlowja: that's the first thing to check - and if it does not, let's add it ;) | 17:21 |
| mtreinish | harlowja: that gets seeded based on subunit streams being written to disk in known location | 17:21 |
| harlowja | ya, at least the nova one is dying at http://logs.openstack.org/periodic/periodic-nova-py27-with-oslo-master/60c4ef2/console.html#_2016-10-06_06_05_13_408256 | 17:21 |
| mtreinish | harlowja: ah, ok yeah if it's failing before subunit gets written then it won't show up | 17:21 |
| AJaeger | harlowja: yes, nova aborts earlier I guess | 17:21 |
| harlowja | which is sorta odd, lol | 17:21 |
| AJaeger | harlowja: the nova one dies now due to the "py27: xxx" and "py34: yyy" lines | 17:21 |
| openstackgerrit | Merged openstack-infra/system-config: Add split daemon support for nodepool https://review.openstack.org/382665 | 17:22 |
| AJaeger | harlowja: (my guess) | 17:22 |
| AJaeger | harlowja: I fixed a first problem but seems my tests weren't complete ;( | 17:22 |
| fungi | mtreinish: clarkb: oh, right, i owe the pandas maintainers a pr to add cython to their setup_requires | 17:22 |
| harlowja | ya, this is getting into tox terroritory that i'm unfamilar with :-P | 17:22 |
| * harlowja didn't know u could do https://github.com/openstack/nova/blob/master/tox.ini#L23-L25 lol | 17:22 | |
| clarkb | heh I wonder why we need two different scripts for that | 17:23 |
| AJaeger | harlowja: I know about it - but didn't know it would break substitutions ;( | 17:23 |
| *** Rockyg has joined #openstack-infra | 17:23 | |
| mtreinish | clarkb: one uses ostestr with a blackfile list iirc | 17:23 |
| harlowja | is the 3 version more pretty :-P | 17:23 |
| harlowja | extra pretty | 17:23 |
| *** csomerville has joined #openstack-infra | 17:24 | |
| harlowja | lol | 17:24 |
| mtreinish | the other just uses testr | 17:24 |
| *** jpena is now known as jpena|off | 17:24 | |
| clarkb | mtreinish: because we can't actually pass all tests yet? | 17:24 |
| mtreinish | clarkb: right | 17:24 |
| AJaeger | harlowja: http://status.openstack.org/openstack-health/#/g/build_name/periodic-glance-py35-with-oslo-master also does not show up - so seems to die early | 17:24 |
| harlowja | yup | 17:24 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Allow more time before reloading Gerrit site header https://review.openstack.org/383157 | 17:24 |
| *** zz_dimtruck is now known as dimtruck | 17:24 | |
| *** bnemec has quit IRC | 17:25 | |
| harlowja | though that one does run tests | 17:25 |
| AJaeger | harlowja: sorry, don't have time to look further into this, hope somebody else can help you. | 17:25 |
| harlowja | AJaeger np :) | 17:25 |
| harlowja | sneaky testing | 17:25 |
| *** david-lyle has joined #openstack-infra | 17:25 | |
| mtreinish | harlowja: hmm, if it runs tests is it just failing to dump the subunit in the right place? | 17:25 |
| AJaeger | harlowja: for nova I see two optoins: Changing tox.ini - or changing the project-config script tospecial case nova's tox.ini | 17:25 |
| harlowja | mtreinish unsure, not quite sure about the new ansible stuff :-P | 17:26 |
| armax | clarkb: ack | 17:26 |
| tlian | Question on CI pipeline, Some commits are being merged by "Jenkins" even though the original author had already commited it. | 17:26 |
| tlian | In other word, the same changeset is being delivered twice. What is the purpose and intention of doing this? Can anyone explain please? | 17:26 |
| clarkb | tlian: those are merge commits because gerrit can't fast forward the change. | 17:27 |
| clarkb | tlian: so the original author retains ownership of their commit and jenkins the user submitting the change into gerrit gets ownership of any necessary merge commits | 17:27 |
| clarkb | tlian: its purely a bookkeeping mechanism in the git commit graph | 17:27 |
| *** tqtran has joined #openstack-infra | 17:27 | |
| harlowja | is anyone going to make better names for http://logs.openstack.org/periodic/periodic-glance-py35-with-oslo-master/b3e9cac/_zuul_ansible/scripts/ :-P | 17:27 |
| harlowja | i know these are probably autogenerated but damn, lol | 17:28 |
| tlian | @clarkb: Thanks! eh I guess I am not pruely clear on it. Why does it require to deliver it to the repo twice? Orig author delivering it once, and then Jenkins doing it the second time... seemed like some scheduled automated job is being doing that for some purpose? | 17:31 |
| clarkb | tlian: its a detail in how git works. Commits are identified by an immutable sha1 hash. Part of the info that is hashed is your parent commit hash. This means that if you parent changes you get a new commit (bceause you ahve a new hash). To avoid doing this when we merge code in the case where you would otherwise need to change the parent gerrit creates a merge commit which preservers the history of | 17:32 |
| clarkb | both sides of the merge. It happens to make this merge commit as the user submitting the change in gerrit, for us this user is called "jenkins" | 17:32 |
| *** annegentle has quit IRC | 17:34 | |
| openstackgerrit | Kirill Zaitsev proposed openstack-infra/project-config: Add non-voting npm-test job to murano-dashboard https://review.openstack.org/383007 | 17:35 |
| *** vsaienko has quit IRC | 17:35 | |
| tlian | @clarkb: thanks for the detail. | 17:35 |
| harlowja | mtreinish dims i'm guessing https://github.com/openstack-infra/project-config/blob/master/jenkins/scripts/run-tox-with-oslo-master.sh#L79-L81 isn't helping ; dims do u remember why u did that? | 17:35 |
| harlowja | my guess is https://github.com/openstack-infra/project-config/blob/master/jenkins/scripts/run-tox-with-oslo-master.sh#L83-L89 might be confusing the whole thing to :-/ | 17:36 |
| harlowja | ^ dynamically adds things to projects tox.ini files | 17:36 |
| *** annegentle has joined #openstack-infra | 17:36 | |
| *** Drago has joined #openstack-infra | 17:36 | |
| *** ijw has joined #openstack-infra | 17:36 | |
| *** sdague has quit IRC | 17:37 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-openstack_health: Stop using a venv for the api server https://review.openstack.org/383160 | 17:37 |
| mtreinish | clarkb, fungi: ^^^ I think I got that right, but I likely missed something | 17:37 |
| *** bnemec has joined #openstack-infra | 17:38 | |
| mtreinish | harlowja: ah, yeah that's probably because tox won't let you use posargs more than once (just my guess I haven't actually checked) | 17:39 |
| *** psachin has quit IRC | 17:39 | |
| anteaya | tlian: you don't need to use @ in irc | 17:39 |
| harlowja | mtreinish ya, let's see if dims cant remember why, seems odd | 17:39 |
| *** otavio has joined #openstack-infra | 17:39 | |
| anteaya | tlian: just using someone's nickname highlights your message for them | 17:39 |
| harlowja | that's probably wiping {posargs} from nova tox.ini, lol | 17:39 |
| mtreinish | harlowja: or some other limitation in the tox config | 17:39 |
| *** jerryz has joined #openstack-infra | 17:39 | |
| Drago | Hi all, I'm trying to reproduce gate-functional-dsvm-magnum-k8s. I'm following https://github.com/openstack-infra/devstack-gate and I'm not sure how to identify the environment variables and commands/scripts as used in that job. I don't see "magnum" anywhere in https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/devstack-gate.yaml | 17:39 |
| otavio | I am trying to sign the CLA on Gerrit but it is failing | 17:40 |
| mtreinish | harlowja: tox has kind of a fake inheritence model and there are a lot of quirks when trying to do what that script does | 17:40 |
| harlowja | yup | 17:40 |
| *** Margarita_S has quit IRC | 17:40 | |
| *** vsaienko has joined #openstack-infra | 17:40 | |
| anteaya | otavio: please ensure you have followed all the steps as outlined here: http://docs.openstack.org/infra/manual/developers.html#account-setup | 17:40 |
| anteaya | Drago: what patch? | 17:40 |
| tlian | anteaya: thnx. I will save a print next time :) | 17:41 |
| *** Vinsh has quit IRC | 17:41 | |
| Drago | anteaya: https://review.openstack.org/#/c/368981/ | 17:41 |
| *** trown is now known as trown|lunch | 17:41 | |
| clarkb | Drago: the easiest way to reproduce it will be using the reproduce.sh script produced by a job that ran in zuul. As for magnum's jobs they are likely defined in jenkins/jobs/magnum.yaml or some other file in that dir | 17:41 |
| anteaya | tlian: thanks :) | 17:41 |
| *** ijw has quit IRC | 17:41 | |
| anteaya | Drago: as clarkb says: http://logs.openstack.org/81/368981/11/check/gate-functional-dsvm-magnum-k8s/444be20/logs/reproduce.sh | 17:42 |
| Drago | clarkb: Oh, didn't see that, thanks! | 17:42 |
| clarkb | Drago: the header comment in that file should explain how to run it | 17:42 |
| Drago | anteaya, clarkb: Oh awesome, that makes it super simple | 17:42 |
| fungi | tonyb: tristanC: njohnston: my friend with the missing ballots finally received the first one from monday. it was queued between two mtas at cornell.edu for several days | 17:42 |
| fungi | presumably others are just now receiving theirs as well | 17:43 |
| anteaya | fungi: wow | 17:43 |
| openstackgerrit | Merged openstack-infra/puppet-infracloud: Ensure that directories to create bridge are present https://review.openstack.org/382867 | 17:45 |
| clarkb | fungi: where are we supposed to throw summit ideas on a wall? | 17:46 |
| clarkb | occurs to me that we should do a quick catch up on precise -> trusty and figure out how we can finish up the last few pieces | 17:46 |
| clarkb | (maybe even just work on it in a workroom) | 17:46 |
| fungi | clarkb: https://etherpad.openstack.org/p/infra-ocata-summit-planning | 17:46 |
| fungi | please add things there | 17:46 |
| fungi | i'm hoping to put together a strawman schedule tonight | 17:47 |
| *** bnemec has quit IRC | 17:47 | |
| amotoki | AJaeger: hi | 17:47 |
| *** vsaienko has quit IRC | 17:48 | |
| clarkb | pabelanger: don't see our new init scripts on nodepool.o.o yet | 17:48 |
| otavio | anteaya: Code Review - Error | 17:49 |
| otavio | Server Error | 17:49 |
| otavio | Cannot store contact information | 17:49 |
| clarkb | pabelanger: jeblair but that should happen soon I think | 17:49 |
| *** degorenko is now known as _degorenko|afk | 17:49 | |
| pabelanger | k | 17:49 |
| AJaeger | amotoki: hi! | 17:50 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Translate releasenotes https://review.openstack.org/372167 | 17:50 |
| AJaeger | amotoki: just pushed this ^ | 17:50 |
| amotoki | AJaeger: regarding release note translation, in general I agree that we should not have a code to add locale_dirs, but it raises me a question. | 17:50 |
| AJaeger | amotoki: great detective work! | 17:50 |
| amotoki | AJaeger: We now have many repositories and I wonder whether it is feasible to update all possible repositories to have locale_dirs defined in conf.py. | 17:50 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-openstack_health: Stop using a venv for the api server https://review.openstack.org/383160 | 17:51 |
| anteaya | otavio: read this please: https://ask.openstack.org/en/question/56720/cannot-store-contact-information-when-updating-info-in-openstack-gerrit/ | 17:51 |
| anteaya | otavio: I'm guessing your gerrit email and your foundation email don't match | 17:51 |
| anteaya | or you are not the right kind of foundation member | 17:52 |
| AJaeger | amotoki: yes, that's feasible IMHO. I would start with your suggestion to add locale_dir directly - and remove thta change once changes have merged. | 17:52 |
| amotoki | AJaeger: for example, if some language team wants to translate release notes of main services, we need to add locale_dirs to such projects. | 17:52 |
| AJaeger | amotoki: I can take care of pushing that change into conf.py - cross-project | 17:52 |
| amotoki | AJaeger: the number of repos with translations is small now, but in addition it seems better to cover core services as well. | 17:53 |
| clarkb | jeblair: do you think you will need a zuulv3 session/workroom? | 17:54 |
| AJaeger | amotoki: agreed, I would cover all of them | 17:54 |
| otavio | anteaya: the Foundation Member requirement could be more explicit ;-) anyway, it worked! Thanks! | 17:54 |
| *** david-lyle has quit IRC | 17:55 | |
| anteaya | otavio: you are welcome to offer a patcht to our docs if you wish | 17:55 |
| anteaya | otavio: glad you are on your way | 17:55 |
| amotoki | AJaeger: thanks. what we need to cover are projects using reno. not all projects :) | 17:55 |
| amotoki | AJaeger: FYI: patch for horizon https://review.openstack.org/383161 | 17:55 |
| openstackgerrit | Merged openstack-infra/system-config: Work around Gitweb encoding in who-approves script https://review.openstack.org/363119 | 17:56 |
| amotoki | AJaeger: we can reuse it. | 17:56 |
| AJaeger | amotoki: Yes... | 17:56 |
| *** tkelsey has quit IRC | 17:56 | |
| *** hferenc has quit IRC | 17:56 | |
| *** bnemec has joined #openstack-infra | 17:57 | |
| *** pvaneck has joined #openstack-infra | 17:57 | |
| mtreinish | fungi, clarkb, jeblair: if you get a sec can you take a look at: https://review.openstack.org/#/c/379849/1 | 17:57 |
| fungi | otavio: the foundation member requirement described at http://docs.openstack.org/infra/manual/developers.html#account-setup isn't explicit already? | 17:57 |
| mtreinish | lpmqtt is very bursty right now, and I think that should fix it | 17:57 |
| *** gyee has joined #openstack-infra | 17:57 | |
| fungi | otavio: or, if you were following some other instructions than those, please let us know where you found them so we can get them taken down or redirected | 17:58 |
| otavio | fungi: in the gerrit error message | 17:58 |
| fungi | otavio: unfortunately that error message is hard-coded in gerrit and we don't want to run a fork of it | 17:58 |
| otavio | fungi: anteaya has helped but if the error was more explit I could have figured it myself | 17:59 |
| otavio | fungi: indeed | 17:59 |
| fungi | so we've done our best to explain the required steps with documentation | 17:59 |
| otavio | fungi: sure; it was not a complain but a remark | 18:00 |
| fungi | otavio: appreciated! i'm always looking for ways to make the documentation clearer (until such time as we're finally able to get rid of this terrible icla linking process) | 18:00 |
| *** priteau has joined #openstack-infra | 18:01 | |
| *** tonytan4ever has quit IRC | 18:01 | |
| *** kzaitsev_mb has quit IRC | 18:01 | |
| *** tonytan4ever has joined #openstack-infra | 18:01 | |
| otavio | fungi: :-) | 18:02 |
| *** dimtruck is now known as zz_dimtruck | 18:02 | |
| *** otavio has left #openstack-infra | 18:02 | |
| JayF | Is there a way in activity.openstack.org to see the irc statistics for a contributor that's /not/ in the top 100 | 18:02 |
| fungi | oh, wow. we haven't taken activity.o.o down yet? | 18:02 |
| fungi | JayF: probably stackalytics needs to just grow irc log parsing | 18:03 |
| *** ihrachys has quit IRC | 18:03 | |
| *** bnemec has quit IRC | 18:03 | |
| JayF | fungi: Oh :( I like it, sad to hear it's scheduled for crushing | 18:03 |
| fungi | the foundation didn't retain the contract with bitgeria to maintain that service and the periodic analysis for it | 18:03 |
| openstackgerrit | Merged openstack-dev/cookiecutter: Add locale_dir for translation of releasenotes https://review.openstack.org/383155 | 18:03 |
| JayF | Ah. | 18:04 |
| fungi | er, s/retain/renew/ | 18:04 |
| JayF | I'm just trying to answer the question: how many lines of chat did user X say in openstack channels over Y time period | 18:04 |
| fungi | yep, i'll agree it's an interesting enough statistic | 18:04 |
| clarkb | JayF: if only grep worked over http | 18:04 |
| JayF | afaik activity.o.o was the only place to find that without doing a /lot/ of manual log parsing | 18:04 |
| JayF | ikr | 18:04 |
| *** csomerville has quit IRC | 18:04 | |
| JayF | grep on windows, where's my grep on chrome! | 18:04 |
| clarkb | JayF: grep clarkb -R http://eavesdrop.openstack.org | wc -l | 18:05 |
| * fungi mutters something about bash on windows | 18:05 | |
| AJaeger | amotoki: dhellmann has been busy reviewing my changes ;) | 18:05 |
| amotoki | AJaeger: :) | 18:06 |
| *** david-lyle has joined #openstack-infra | 18:06 | |
| *** bnemec has joined #openstack-infra | 18:08 | |
| *** sputnik13 has joined #openstack-infra | 18:08 | |
| *** annegentle has quit IRC | 18:08 | |
| *** vsaienko has joined #openstack-infra | 18:09 | |
| amotoki | AJaeger: I just saw your mail. are you scripting to prepare locale_dirs change? | 18:10 |
| AJaeger | amotoki: preparing that - shall I go for it? | 18:10 |
| amotoki | AJaeger: go ahead :) | 18:10 |
| *** sripriya has joined #openstack-infra | 18:11 | |
| amotoki | AJaeger: you can earn many commits | 18:11 |
| jeblair | AJaeger: btw, you asked for a find command to be run earlier -- if you install the openafs client on a machine, you can browse it yourself (it's world readable) | 18:11 |
| AJaeger | jeblair: will do that when I find some time - thanks | 18:11 |
| jeblair | AJaeger: when you find the time, here's the docs for debuntu: http://docs.openstack.org/infra/system-config/afs.html#client-configuration (suse should be very similar, and we can add a doc patch for that of course :) | 18:12 |
| fungi | clarkb could probably use that too ;) | 18:13 |
| clarkb | pabelanger: jeblair: ok I think we are ready to start up the new nodepool daemons | 18:13 |
| pabelanger | clarkb: okay | 18:13 |
| clarkb | jeblair: how do you want to stop the services? just kill them or do you want to join the screen and be more graceful? | 18:13 |
| jeblair | AJaeger: we also have the technical ability to set you and other docs team members up with write access in case something needs to be fixed (though, hopefully most of that will be taken care of by the rsync delete). that may merit a policy discussion. | 18:14 |
| AJaeger | jeblair: thanks. | 18:14 |
| *** shardy is now known as shardy_afk | 18:14 | |
| jeblair | clarkb: kill them all dead. | 18:14 |
| clarkb | fungi: oh yes I should figre out afs on tumbleweed | 18:14 |
| AJaeger | jeblair: let's start without write access ;) | 18:14 |
| jeblair | AJaeger: done! :) | 18:14 |
| *** vsaienko has quit IRC | 18:14 | |
| clarkb | pabelanger: jeblair ok there are two dib images still building should we wait for thsoe to finish first? | 18:15 |
| clarkb | otehrwise I am ready | 18:15 |
| pabelanger | I don't mind them being stopped | 18:15 |
| *** flepied1 has joined #openstack-infra | 18:15 | |
| AJaeger | team, I would appreciate a review of https://review.openstack.org/#/c/372167/ - to enable translation of releasenotes. | 18:15 |
| *** yamahata has quit IRC | 18:15 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Reduce image locking during scheduled build checks https://review.openstack.org/383187 | 18:16 |
| clarkb | alrighty I will go ahead and restart things now | 18:16 |
| *** EricGonczer_ has joined #openstack-infra | 18:16 | |
| clarkb | jeblair: I will let you close the screen when you are ready to as I am not sure if you have other things running in it and it seems less important | 18:16 |
| *** vsaienko has joined #openstack-infra | 18:17 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable TLS in more neutron integration jobs https://review.openstack.org/382618 | 18:17 |
| clarkb | hrm they all have parent pids of 1? are they not running in foreground? | 18:17 |
| *** bnemec has quit IRC | 18:17 | |
| jeblair | clarkb: yeah, they ended up in background | 18:17 |
| clarkb | ok killing them now and using our shiny new init scripts | 18:18 |
| jeblair | something mumble -d something | 18:18 |
| vsaienko | clarkb: multinode job just passed http://logs.openstack.org/73/368173/31/experimental/gate-tempest-dsvm-ironic-ipa-wholedisk-agent_ssh-tinyipa-multinode-nv/3d70383/ | 18:18 |
| *** flepied has quit IRC | 18:18 | |
| jeblair | two fighter jets just flew overhead (fleet week i guess?) | 18:18 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/subunit2sql: Enable release notes translation https://review.openstack.org/383190 | 18:19 |
| AJaeger | amotoki: ^ | 18:19 |
| *** ddieterly[away] has quit IRC | 18:19 | |
| clarkb | something looks unhappy | 18:19 |
| vsaienko | clarkb, pabelanger: could you please help to merge https://review.openstack.org/#/c/364830/ and other patches in the chain | 18:19 |
| *** EricGonczer_ has quit IRC | 18:19 | |
| clarkb | only one of the three started, now to figure out which it is and debug the otehrs | 18:19 |
| clarkb | looks like we didn't get default files for the new ones | 18:20 |
| clarkb | pabelanger: ^ | 18:20 |
| njohnston | fungi: Wow. That sucks. | 18:20 |
| clarkb | pabelanger: but the "plain" nodepoold default file did get updated properly | 18:20 |
| clarkb | (I should've checked this before starting | 18:20 |
| fungi | njohnston: bad timing i guess, but at least we can expect that everyone will probably get their ballots finally, they just may not have long to use them | 18:21 |
| clarkb | I think I may just add the files by hand really quick to get the services started? | 18:21 |
| pabelanger | clarkb: yes, it should | 18:21 |
| pabelanger | let me check | 18:21 |
| ianychoi | Hello, could somebody reviews https://review.openstack.org/#/c/367005/ and https://review.openstack.org/#/c/380964/ ? | 18:21 |
| openstackgerrit | Andreas Jaeger proposed openstack-dev/hacking: Enable release notes translation https://review.openstack.org/383193 | 18:21 |
| pabelanger | clarkb: Hmm, we are missing some /etc/default files | 18:22 |
| clarkb | pabelanger: yes thats what I said | 18:22 |
| clarkb | the logging files are fine | 18:22 |
| *** mkoderer has quit IRC | 18:22 | |
| pabelanger | let me see why | 18:22 |
| clarkb | I am going to manually add in the default files for now to get the services started | 18:22 |
| pabelanger | k | 18:22 |
| *** amoralej is now known as amoralej|off | 18:22 | |
| *** EricGonczer_ has joined #openstack-infra | 18:22 | |
| pabelanger | Don | 18:23 |
| pabelanger | we missed them | 18:23 |
| pabelanger | let me get a patch | 18:23 |
| *** smarcet has quit IRC | 18:23 | |
| jeblair | yeah, i don't see any relevant puppet errors | 18:23 |
| jeblair | so ++ manual then fix in a patch | 18:23 |
| *** smarcet has joined #openstack-infra | 18:24 | |
| *** spzala has joined #openstack-infra | 18:24 | |
| *** mixos has joined #openstack-infra | 18:24 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-nodepool: Add missing default files for launcher / deleter https://review.openstack.org/383204 | 18:25 |
| pabelanger | jeblair: clarkb: ^ | 18:25 |
| *** sdague has joined #openstack-infra | 18:25 | |
| *** ddieterly has joined #openstack-infra | 18:25 | |
| clarkb | ok they are still dying | 18:26 |
| * clarkb checks if its a pidfile conflict | 18:26 | |
| openstackgerrit | Andreas Jaeger proposed openstack/diskimage-builder: Enable release notes translation https://review.openstack.org/383210 | 18:26 |
| *** mat128|lunch is now known as mat128 | 18:27 | |
| *** esikachev has quit IRC | 18:27 | |
| clarkb | no pidfile dirs exist and the nodepool user should be able to write to them | 18:27 |
| *** bnemec has joined #openstack-infra | 18:27 | |
| *** rossella_s has quit IRC | 18:27 | |
| jeblair | clarkb: run one of them as the nodepool user with '-d' added ? | 18:27 |
| clarkb | ok | 18:27 |
| AJaeger | amotoki: I'll push for those releasenotes locale setting where we have translations - let's see what happens with the rest ;) | 18:28 |
| *** rossella_s has joined #openstack-infra | 18:28 | |
| *** zara_the_lemur__ has joined #openstack-infra | 18:28 | |
| clarkb | jeblair: that works, I started the launcher in the foregroudn and it is happily logging to the log dir | 18:29 |
| clarkb | so Ithink that means something wrong with init script or daemonization | 18:29 |
| jeblair | AJaeger: comments on 372167 | 18:30 |
| jeblair | clarkb: did you start the launcher with the same args as the init script would? | 18:31 |
| clarkb | jeblair: yes, I grabbed them using my ps -elf output for when the daemon tries to start | 18:31 |
| AJaeger | jeblair: I renamed the file but my mv command was wrong ;( | 18:31 |
| clarkb | jeblair: and appended -d | 18:31 |
| clarkb | permissions on /var/run/nodepool-deleter and /var/run/nodepool-launcher looks correct | 18:32 |
| clarkb | and there are no pid files in those dirs | 18:32 |
| jeblair | clarkb: i think it may be pidfiles... | 18:33 |
| AJaeger | jeblair: how can I include a file in JJB? Do you have an example? | 18:33 |
| clarkb | jeblair: ok I will keep looking at that angle | 18:33 |
| *** bnemec has quit IRC | 18:33 | |
| jeblair | clarkb: i think we need to add a '-p' argument | 18:34 |
| AJaeger | jeblair: thanks, found it in the docs... | 18:34 |
| *** bnemec has joined #openstack-infra | 18:34 | |
| AJaeger | jeblair: I'll give it a try... | 18:34 |
| jeblair | AJaeger: cool, i think a few minutes now will save days later :) | 18:34 |
| clarkb | jeblair: oh! nodepool does its own daemonization | 18:34 |
| jeblair | yep | 18:34 |
| clarkb | and by default its going to use a path that we don't use | 18:34 |
| clarkb | let me try that | 18:34 |
| jeblair | i'm not sure if the pid stuff in the init files is even used... | 18:34 |
| jeblair | it's used for stopping | 18:35 |
| jeblair | so the need to match. we should probably just add '-p $PIDFILE' to all invocations in the init script | 18:35 |
| jeblair | pabelanger: ^ | 18:35 |
| *** cody-somerville has joined #openstack-infra | 18:35 | |
| *** Sukhdev has joined #openstack-infra | 18:36 | |
| zara_the_lemur__ | (catching up on logs-- oh hey, activity.o.o has a storyboard section, neat. curious about the 'unknown' user, though) | 18:37 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Translate releasenotes https://review.openstack.org/372167 | 18:37 |
| AJaeger | jeblair: definitely - you're right, this might cause us some quick changes. Here's the fix ^ | 18:37 |
| AJaeger | jeblair: please review carefully the JJB change - this would be the first include useage ;) | 18:37 |
| *** ijw has joined #openstack-infra | 18:37 | |
| clarkb | jeblair: yup I think taht did it | 18:38 |
| clarkb | I edited the default files to add that in fwiw since those aren't properly managed by puppet yet which means puppet won't undo the changes on them until we get it fixed | 18:38 |
| clarkb | jeblair: pabelanger but I agree that adding it to the init script is a better way long term since it has that all variabled out | 18:38 |
| *** lseki has joined #openstack-infra | 18:38 | |
| *** trown|lunch is now known as trown | 18:39 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Reduce image locking during build checks https://review.openstack.org/383187 | 18:39 |
| *** bnemec has quit IRC | 18:41 | |
| clarkb | pabelanger: jeblair I can work on that patch if it helps | 18:41 |
| openstackgerrit | Andreas Jaeger proposed openstack/os-client-config: Enable release notes translation https://review.openstack.org/383310 | 18:41 |
| jeblair | clarkb: ++ | 18:41 |
| jeblair | AJaeger: we may want to move that to a subdirectory at some point for organizational purposes, but i think it's fine for now | 18:41 |
| jeblair | AJaeger: so assuming it passes the layout test, should be good :) | 18:42 |
| AJaeger | great ;) | 18:42 |
| *** nadya has joined #openstack-infra | 18:42 | |
| AJaeger | jeblair: that's a challnge - testing locally ... | 18:44 |
| *** vsaienko has quit IRC | 18:44 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-nodepool: Properly set pidfile for nodepoold https://review.openstack.org/383335 | 18:45 |
| clarkb | pabelanger: jeblair ^ | 18:45 |
| Drago | clarkb, anteaya: It ran, but apparently passed. I don't see anything similar to console.html in the logs. I assume it's just the console output, but mine is not similar to what I appears in the gate. I don't see anything like "magnum.tests.functional.k8s.test_k8s_python_client.TestKubernetesAPIs.test_pod_apis [1757.856705s] ... ok" | 18:45 |
| *** ijw has quit IRC | 18:45 | |
| Drago | I'm not sure it even ran the tests it was supposed to | 18:45 |
| clarkb | Drago: yes console.html is what is written to stdout | 18:45 |
| clarkb | Drago: how old is the reproduce.sh script? there were a few bugs in its generation that were fixed a week or two ago so older scripts may not work correctly | 18:46 |
| Drago | clarkb: Yesterday | 18:46 |
| clarkb | ok so thats likely not it | 18:46 |
| *** ociuhandu has quit IRC | 18:46 | |
| Drago | clarkb: Want me to give you a paste of the console output? | 18:46 |
| clarkb | Drago: sure, also a link to the script amy help others try to reproduce on their end | 18:47 |
| clarkb | (I can give that a go after lunch) | 18:47 |
| Drago | Okay | 18:47 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: always provide a download link in the announce emails https://review.openstack.org/383355 | 18:47 |
| *** krtaylor has joined #openstack-infra | 18:48 | |
| *** vsaienko has joined #openstack-infra | 18:49 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Refactor Gerrit parameters into separate file https://review.openstack.org/332591 | 18:49 |
| *** harlowja has quit IRC | 18:50 | |
| clarkb | jeblair: pabelanger and in this setup which daemon is responsible for transitioning from ready to used, then used to delete? Is it the deleter? | 18:50 |
| clarkb | (I think I may have to clean up some leaked nodes in a couple hours if so) | 18:50 |
| Drago | clarkb: http://paste.openstack.org/show/584722/ | 18:50 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Translate releasenotes https://review.openstack.org/372167 | 18:51 |
| Drago | clarkb: That includes the curl of reproduce.sh, but here it is again: http://logs.openstack.org/81/368981/11/check/gate-functional-dsvm-magnum-k8s/444be20/logs/reproduce.sh | 18:51 |
| AJaeger | jeblair: layout check didn't like indentation and include-raw, now using include-raw-escape | 18:51 |
| *** hwoarang has quit IRC | 18:51 | |
| *** hwoarang has joined #openstack-infra | 18:52 | |
| pabelanger | clarkb: I believe that is the deleter that handles that ready to used | 18:53 |
| *** vsaienko has quit IRC | 18:53 | |
| *** yamahata has joined #openstack-infra | 18:54 | |
| *** bnemec has joined #openstack-infra | 18:54 | |
| jeblair | clarkb: the deleter (it's the only one listening to zmq) | 18:54 |
| clarkb | Drago: if you compare the two logs the "magic" happens in the post_test_hook on the zuul run job and that seems to noop on your local run | 18:54 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Reduce image locking during build checks https://review.openstack.org/383187 | 18:54 |
| clarkb | Drago: so I would start by debugging that. Looks like it may not be defined proeprly in reproduce.sh (possibly a bug) | 18:54 |
| Drago | clarkb: Hmm! | 18:55 |
| clarkb | pabelanger: jeblair thanks. I think I will have some things to celan up then. Will get to them | 18:55 |
| Drago | clarkb: Thanks, I'll do that | 18:55 |
| *** slaweq_ has joined #openstack-infra | 18:55 | |
| *** jcoufal_ has quit IRC | 18:56 | |
| jeblair | clarkb: if we're not pressed for nodes, you could just leave it and it'll get cleaned up on its own after 8 hours | 18:56 |
| clarkb | #status log nodepool now running 3 separate daemons with configuration managed by puppet. If you can always make sure there is a deleter running before we have a launcher to avoid leaking nodes. | 18:56 |
| openstackstatus | clarkb: finished logging | 18:56 |
| mtreinish | AJaeger: on https://review.openstack.org/#/c/383400/ do we need to enable release note translations if there won't be any future releases? | 18:56 |
| clarkb | jeblair: ya we aren't super pressed. I will probably just take a quick look after lunch as they will be easier to identify as they age out | 18:56 |
| *** david-lyle has quit IRC | 18:57 | |
| clarkb | jeblair: I think the bigger impact is in demand calculations as nodepool thinks it has a bunch that are useable? | 18:57 |
| jeblair | somebody said lunch! :) | 18:57 |
| AJaeger | mtreinish: no, not at all. Feel free to -1 and I'll abandon. | 18:57 |
| *** hwoarang has quit IRC | 18:57 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 18:57 |
| *** slaweq has quit IRC | 18:57 | |
| jeblair | clarkb: oh, yeah, ready are probably more important. | 18:57 |
| AJaeger | mtreinish: shall I abandon? | 18:58 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 18:58 |
| mtreinish | AJaeger: ok cool, I just wanted to check the intent. Like only for future release notes, or are we gonna translate old notes | 18:58 |
| mtreinish | AJaeger: yeah, probably better to abandon that one, since tempest-lib won't have any future releases | 18:58 |
| *** hwoarang has joined #openstack-infra | 18:58 | |
| mtreinish | since it was all migrated back into tempest | 18:58 |
| AJaeger | mtreinish: I'm just writing an email - good question to answer in there. I'll abandon. Thanks | 18:59 |
| *** shamail has joined #openstack-infra | 18:59 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Rebuild DIB on missing image format https://review.openstack.org/383022 | 18:59 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Reduce image locking during build checks https://review.openstack.org/383187 | 18:59 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Add code to do the DIB build https://review.openstack.org/382570 | 18:59 |
| *** jtomasek_ has quit IRC | 19:00 | |
| *** slaweq has joined #openstack-infra | 19:00 | |
| *** slaweq_ has quit IRC | 19:00 | |
| *** jamielennox has quit IRC | 19:03 | |
| *** yamahata has quit IRC | 19:05 | |
| *** jamielennox|away has joined #openstack-infra | 19:05 | |
| *** jamielennox|away is now known as jamielennox | 19:06 | |
| *** vsaienko has joined #openstack-infra | 19:06 | |
| *** jcoufal has joined #openstack-infra | 19:06 | |
| *** ociuhandu has joined #openstack-infra | 19:06 | |
| AJaeger | jeblair: so, local layout test worked ;) | 19:07 |
| AJaeger | EmilienM: thanks for quick review! | 19:07 |
| *** tonytan4ever has quit IRC | 19:07 | |
| *** yamahata has joined #openstack-infra | 19:08 | |
| EmilienM | AJaeger: np | 19:09 |
| fungi | quite the glut of ready nodes in nodepool suddenly | 19:09 |
| AJaeger | fungi, I just pushed 200 changes in ;) | 19:10 |
| anteaya | the are getting assigned | 19:10 |
| *** bnemec has quit IRC | 19:10 | |
| clarkb | fungi: yes its realted to our switchover from nodepoold running in screen to running with proper init scripts | 19:10 |
| clarkb | I had a nodepool launcher running without a deleter so they didn't transition states properly (this is why I included the node in the status log to have deleter running first) | 19:10 |
| *** rtheis_ has joined #openstack-infra | 19:11 | |
| fungi | aha | 19:11 |
| fungi | makes sense | 19:11 |
| clarkb | basically deleter handles all state changes so should be running before you start booting things | 19:11 |
| *** bnemec has joined #openstack-infra | 19:11 | |
| *** adrian_otto has joined #openstack-infra | 19:11 | |
| clarkb | I am working on cleaning things up by checking if nodes are done running their jobs then setting them to delete | 19:11 |
| fungi | i've unfortunately not been following the nodepool scheduler split patches over the past few days | 19:11 |
| *** vsaienko has quit IRC | 19:12 | |
| clarkb | but there are like 300 and it requires talking to many hosts so probably most cleanup will happen when they all get old enough to not be running jobs any longer | 19:12 |
| *** rtheis has quit IRC | 19:12 | |
| *** salv-orlando has quit IRC | 19:13 | |
| *** maishsk has joined #openstack-infra | 19:13 | |
| *** annegentle has joined #openstack-infra | 19:13 | |
| * AJaeger waves good-night | 19:14 | |
| *** nadya has quit IRC | 19:15 | |
| *** adrian_otto has quit IRC | 19:15 | |
| fungi | night AJaeger! | 19:15 |
| *** sambetts is now known as sambetts|afk | 19:16 | |
| *** coolsvap has quit IRC | 19:16 | |
| anteaya | g'night AJaeger | 19:16 |
| *** adrian_otto has joined #openstack-infra | 19:18 | |
| pabelanger | Hmm, that's odd | 19:18 |
| pabelanger | Just got my email for TC voting, opened the URL | 19:19 |
| pabelanger | says I voted, which I did early this week | 19:19 |
| pabelanger | so, not sure why I got it a 2nd time | 19:19 |
| pabelanger | guess we sent out another round of emails | 19:20 |
| fungi | pabelanger: there was an mta in cornell.edu deferring a lot of civs e-mails. if you look at the received headers you should see a significant delay between two of them | 19:21 |
| fungi | the election officials sent a second copy of ballots on monday because a lot of people didn't receive the ones sent on sunday | 19:21 |
| fungi | it seems they just cleared it up within the last few hours and now all the deferred copies are starting to get delivered | 19:21 |
| pabelanger | fungi: Yup, it looks like that is correct. | 19:22 |
| pabelanger | cool, thanks | 19:22 |
| *** hwoarang has quit IRC | 19:25 | |
| *** hamzy has quit IRC | 19:26 | |
| *** ddieterly is now known as ddieterly[away] | 19:28 | |
| *** annegentle has quit IRC | 19:28 | |
| *** Goneri has quit IRC | 19:28 | |
| *** shamail has quit IRC | 19:29 | |
| pabelanger | clarkb: with any luck, our launch failure rate will drop again | 19:29 |
| pabelanger | hopefully only showing actual network issues | 19:30 |
| *** sileht has quit IRC | 19:31 | |
| *** sileht has joined #openstack-infra | 19:32 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: enable undercloud/ssl on multinode jobs https://review.openstack.org/382082 | 19:32 |
| *** ddieterly[away] is now known as ddieterly | 19:32 | |
| *** hwoarang has joined #openstack-infra | 19:32 | |
| *** maishsk has quit IRC | 19:33 | |
| *** cody-somerville has quit IRC | 19:35 | |
| openstackgerrit | Merged openstack-infra/release-tools: Tidy up ptl command if an invalid team is specified https://review.openstack.org/382709 | 19:36 |
| openstackgerrit | Merged openstack-infra/release-tools: Make the PTL tool more human friendly https://review.openstack.org/382710 | 19:36 |
| openstackgerrit | Merged openstack-infra/release-tools: support non-ASCII characters in PTL names https://review.openstack.org/382559 | 19:36 |
| *** cody-somerville has joined #openstack-infra | 19:36 | |
| *** cody-somerville has joined #openstack-infra | 19:36 | |
| *** hamzy has joined #openstack-infra | 19:37 | |
| *** ijw has joined #openstack-infra | 19:37 | |
| *** vsaienko has joined #openstack-infra | 19:44 | |
| *** inc0 has quit IRC | 19:45 | |
| *** tonytan4ever has joined #openstack-infra | 19:45 | |
| *** gyee has quit IRC | 19:47 | |
| *** vsaienko has quit IRC | 19:48 | |
| clarkb | I have the leaked nodes belonging to zl01-04 and 07 cleaned up | 19:49 |
| clarkb | should haev 05 and 06 done shortly then I will find lunch | 19:49 |
| *** nadya has joined #openstack-infra | 19:51 | |
| *** Sukhdev has quit IRC | 19:51 | |
| *** ijw has quit IRC | 19:52 | |
| *** zz_dimtruck is now known as dimtruck | 19:53 | |
| *** tnovacik has quit IRC | 19:54 | |
| *** sputnik13 has quit IRC | 19:56 | |
| *** mixos has quit IRC | 19:56 | |
| pabelanger | Like now http://grafana.openstack.org/dashboard/db/nodepool ready nodes look | 19:56 |
| pabelanger | pretty neat graph | 19:56 |
| clarkb | 05 and 06 assigned nodes are cleaned up now too | 19:57 |
| clarkb | I think we should be back to normalish now | 19:57 |
| *** Rockyg has quit IRC | 19:58 | |
| pabelanger | yay | 19:58 |
| clarkb | yup building has skyrocketted | 19:58 |
| clarkb | which is what I expected once I got this cleaned up as we would've fallen below min ready + demand in fake ready mode | 19:58 |
| pabelanger | clarkb: wonder if we should increase our window in the gate, since we have some capacity now | 19:59 |
| clarkb | I don't think so. It auto expands as things work | 19:59 |
| clarkb | things don't work and it contracts | 19:59 |
| pabelanger | True, I think 20 is the min | 19:59 |
| pabelanger | Oh | 20:00 |
| pabelanger | this is for tripleo stiff | 20:00 |
| clarkb | (granted its conservative like tcp but we have had ltos of problems when we let it get very large | 20:00 |
| pabelanger | stuff* | 20:00 |
| pabelanger | integrated is 4 currently | 20:00 |
| clarkb | ta | 20:00 |
| clarkb | *ya | 20:00 |
| *** jcoufal_ has joined #openstack-infra | 20:00 | |
| clarkb | FWIW I only cleaned up "ready" nodes, I think we have also leaked used nodes but since we have so much capacity those shouldn't affect our demand calcs terribly and they can expire after 8 hours like jeblair suggested | 20:01 |
| clarkb | or I can run my leak checks against used as well after lucnh | 20:01 |
| *** esikachev has joined #openstack-infra | 20:01 | |
| *** cody-somerville has quit IRC | 20:02 | |
| pabelanger | Ya, I see a few over 3+ hours | 20:02 |
| pabelanger | used that is | 20:02 |
| *** nadya has quit IRC | 20:02 | |
| *** dimtruck is now known as zz_dimtruck | 20:02 | |
| *** cody-somerville has joined #openstack-infra | 20:03 | |
| *** jcoufal has quit IRC | 20:03 | |
| pabelanger | never new we expired them after 8hour | 20:03 |
| *** jkilpatr has quit IRC | 20:05 | |
| *** jcoufal_ has quit IRC | 20:05 | |
| *** david-lyle has joined #openstack-infra | 20:06 | |
| *** mixos has joined #openstack-infra | 20:06 | |
| *** dtardivel has quit IRC | 20:07 | |
| *** mixos has quit IRC | 20:07 | |
| *** inc0_ has joined #openstack-infra | 20:07 | |
| jeblair | nodepool is self-healing | 20:08 |
| jeblair | if you are patient | 20:08 |
| *** inc0_ has quit IRC | 20:08 | |
| *** sdake has quit IRC | 20:09 | |
| *** mixos has joined #openstack-infra | 20:09 | |
| pabelanger | indeed, looks like NODE_CLEANUP is the setting | 20:11 |
| pabelanger | TIL | 20:11 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/383433 | 20:12 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Send ansible-puppet timing information to graphite https://review.openstack.org/285740 | 20:13 |
| pabelanger | neat, 3 DNS failures in bluebox-sjc1: Host git.openstack.org not found: 2(SERVFAIL) | 20:15 |
| pabelanger | been a while since I've see a DNS failure | 20:15 |
| *** aeng has joined #openstack-infra | 20:15 | |
| *** tonytan4ever has quit IRC | 20:16 | |
| Drago | clarkb: You're right, it's the gate_hook and post_test_hook that's missing :) | 20:16 |
| *** cody-somerville has quit IRC | 20:16 | |
| pabelanger | think we might have a race condition with pansible: http://logs.openstack.org/04/383204/1/check/gate-infra-puppet-apply-ubuntu-xenial/8d40b87/console.html#_2016-10-06_18_32_45_103263 | 20:16 |
| *** harlowja has joined #openstack-infra | 20:17 | |
| Drago | clarkb: I've added https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/magnum.yaml#L15-L59 into reproduce.sh manually and now it looks a lot more like the real gate's console | 20:17 |
| *** devananda|afk is now known as devananda | 20:18 | |
| *** cody-somerville has joined #openstack-infra | 20:18 | |
| *** cody-somerville has joined #openstack-infra | 20:18 | |
| *** e0ne has joined #openstack-infra | 20:20 | |
| *** fguillot has quit IRC | 20:21 | |
| *** kgiusti has left #openstack-infra | 20:22 | |
| *** e0ne has quit IRC | 20:22 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Increase build worker main loop delay https://review.openstack.org/383437 | 20:23 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Add a DIB configuration to fake.yaml https://review.openstack.org/383438 | 20:23 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Update 'nodepool dib-image-list' command to ZK https://review.openstack.org/383439 | 20:23 |
| *** ihrachys has joined #openstack-infra | 20:23 | |
| *** annegentle has joined #openstack-infra | 20:24 | |
| *** zz_dimtruck is now known as dimtruck | 20:24 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Do not merge https://review.openstack.org/383443 | 20:25 |
| *** salv-orlando has joined #openstack-infra | 20:27 | |
| *** mixos has quit IRC | 20:27 | |
| *** jkilpatr has joined #openstack-infra | 20:27 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Perform a booting test for our images https://review.openstack.org/204639 | 20:29 |
| *** vhosakot_ has quit IRC | 20:30 | |
| *** mixos has joined #openstack-infra | 20:30 | |
| *** vhosakot has joined #openstack-infra | 20:31 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Do not merge https://review.openstack.org/383443 | 20:31 |
| *** dimtruck is now known as zz_dimtruck | 20:34 | |
| *** rtheis_ has quit IRC | 20:38 | |
| openstackgerrit | Merged openstack-infra/zuul: Revert "Remove v2.5 ansiblelaunchserver" https://review.openstack.org/372536 | 20:39 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Do not merge https://review.openstack.org/383443 | 20:39 |
| openstackgerrit | Merged openstack-infra/zuul: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/372537 | 20:40 |
| openstackgerrit | Merged openstack-infra/zuul: Re-enable test_abandoned_gate https://review.openstack.org/382405 | 20:40 |
| *** abregman has joined #openstack-infra | 20:44 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Update 'nodepool dib-image-list' command to ZK https://review.openstack.org/383439 | 20:44 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Add a DIB configuration to fake.yaml https://review.openstack.org/383438 | 20:44 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Increase build worker main loop delay https://review.openstack.org/383437 | 20:44 |
| *** HeOS has joined #openstack-infra | 20:45 | |
| *** kzaitsev_mb has joined #openstack-infra | 20:45 | |
| *** AnarchyAo has joined #openstack-infra | 20:46 | |
| *** baoli_ has quit IRC | 20:46 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Fix developer guide TOC https://review.openstack.org/383454 | 20:48 |
| *** baoli has joined #openstack-infra | 20:48 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Do not merge https://review.openstack.org/383443 | 20:48 |
| *** lucasagomes is now known as lucas-afk | 20:53 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Stop forcing oslosphinx for docs https://review.openstack.org/383456 | 20:54 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Use globaltoc in docs for sidebar https://review.openstack.org/383457 | 20:55 |
| tonyb | fungi: Thanks. I'va also had similar reports ..... | 20:58 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Remove copyright from docs / toc https://review.openstack.org/383459 | 20:59 |
| *** vhosakot has quit IRC | 20:59 | |
| *** psilvad has quit IRC | 21:01 | |
| anteaya | tonyb: is there any way of knowing if all the ballots went out? did andrew myer ever send any logs or notifications? | 21:01 |
| *** raildo has quit IRC | 21:01 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Rename devloper documentation to developer guide https://review.openstack.org/383461 | 21:02 |
| tonyb | anteaya: I have a list of email address ther got fatal errors and I assume due to the way SMTP works the rest are "in transit" | 21:02 |
| *** pilgrimstack1 has joined #openstack-infra | 21:02 | |
| tonyb | anteaya: there is some evidence that resending get's through ... perhaps because it's a one off? | 21:02 |
| *** pilgrimstack has quit IRC | 21:04 | |
| *** Apoorva_ has joined #openstack-infra | 21:04 | |
| *** ijw has joined #openstack-infra | 21:04 | |
| * anteaya shrugs helpfully | 21:04 | |
| fungi | also they may have mail routing distributed across, e.g., three relays and only one might have been having issues, so it could depend on random chance | 21:04 |
| *** shardy_afk is now known as shardy | 21:05 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Fix formatting for supported distros in docs https://review.openstack.org/383464 | 21:06 |
| anteaya | tonyb: I'm going with the assumption that any email addresses on the fatal errors list got their ballots resent as soon as you got the list | 21:06 |
| fungi | the message to me from monday sat on alva01.serverfarm.cornell.edu for a few days. the one i received on sunday went through alva02.serverfarm.cornell.edu instead | 21:07 |
| tonyb | anteaya: no, fatal means invalid address so resending them isn't helpful | 21:07 |
| anteaya | tonyb: ah, okay thank you | 21:07 |
| tonyb | fungi: Yeah I have headers from 3 delayed messages and they all went via alva01 | 21:07 |
| *** Apoorva has quit IRC | 21:07 | |
| tonyb | anteaya: np | 21:07 |
| *** burgerk has quit IRC | 21:08 | |
| anteaya | both mine came through 02 | 21:09 |
| reed | quick question: does shade support trove? | 21:09 |
| anteaya | the second one I'm sure was delayed | 21:09 |
| *** eharney has quit IRC | 21:09 | |
| anteaya | I didn't see it until just now and I did search earlier today | 21:10 |
| *** ijw has quit IRC | 21:10 | |
| fungi | anteaya: yeah, i just confirmed my friend's ballots sat on alva02 (both of them) until today, so maybe it wasn't just a problem on 01 | 21:11 |
| *** trown is now known as trown|outtypewww | 21:11 | |
| anteaya | fungi: tonyb http://paste.openstack.org/show/584728/ | 21:11 |
| *** mixos has quit IRC | 21:12 | |
| anteaya | reed: I don't know | 21:12 |
| clarkb | I am going to go ahead and clear out some of the really old used instances since its pretty easy to do | 21:13 |
| *** annegentle has quit IRC | 21:13 | |
| anteaya | clarkb: thank you | 21:13 |
| *** baoli_ has joined #openstack-infra | 21:13 | |
| *** mixos has joined #openstack-infra | 21:14 | |
| *** asselin__ has quit IRC | 21:15 | |
| *** ldnunes has quit IRC | 21:15 | |
| *** tonytan4ever has joined #openstack-infra | 21:16 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: arch_wg: alt time for APAC friendly meetings https://review.openstack.org/379768 | 21:16 |
| *** esikachev has quit IRC | 21:17 | |
| *** baoli has quit IRC | 21:17 | |
| *** cody-somerville has quit IRC | 21:17 | |
| *** harlowja has quit IRC | 21:17 | |
| *** rfolco has quit IRC | 21:18 | |
| *** tiswanso has quit IRC | 21:18 | |
| *** tongli has quit IRC | 21:20 | |
| clarkb | looks like the big tripleo gate queue has starved centos-7 nodes elsewhere (point this out beacuse there was a belief that using centos7 meant you were immune to node starvation) | 21:20 |
| *** annegentle has joined #openstack-infra | 21:20 | |
| *** mixos has quit IRC | 21:20 | |
| greghaynes | because so few projects use centos 7? I know dib uses it and theres been abnormally large patch churn there today... | 21:21 |
| clarkb | greghaynes: yes that was the idea behind the puppet projects switch of a lot of jobs to centos7 | 21:21 |
| *** dprince has quit IRC | 21:21 | |
| *** tonytan4ever has quit IRC | 21:22 | |
| clarkb | but since nodepool is demand based and allocations proportionally... that means that we should see starvation across the node types rather than any one individual type | 21:22 |
| pabelanger | likely tripleo-centos-7 nodes that are needed | 21:22 |
| *** amitgandhinz has quit IRC | 21:22 | |
| *** shardy has quit IRC | 21:22 | |
| pabelanger | I see about 6 of them used for 4+hours | 21:23 |
| *** baoli_ has quit IRC | 21:23 | |
| clarkb | pabelanger: they will be in my delete list then | 21:23 |
| *** mixos has joined #openstack-infra | 21:23 | |
| clarkb | I am doing all nodes >3hours | 21:23 |
| clarkb | in used state | 21:24 |
| pabelanger | there is also launch failures with tripleo-test-cloud-rh1 in regards to FIPs not being found | 21:24 |
| pabelanger | I still need to debug why that is | 21:24 |
| pabelanger | not sure if a shade issue or cloud | 21:24 |
| clarkb | or floating IPs | 21:24 |
| pabelanger | I don't see any that are leaked | 21:24 |
| pabelanger | and told there should be enough | 21:24 |
| clarkb | is it a quota issue? | 21:25 |
| pabelanger | however, tripleo-test-cloud-rh1 is has some capacity issues. I know it doesn't help with heat trying to launch 5 ovh stacks at once | 21:25 |
| pabelanger | quota should be good, for 60 | 21:25 |
| pabelanger | LaunchNetworkException: Unable to find public IP of server | 21:26 |
| clarkb | pabelanger: is there a change to set ovh back to qcow2 yet? | 21:26 |
| pabelanger | clarkb: no, I can do that now | 21:26 |
| clarkb | kk | 21:26 |
| *** thorst_ has quit IRC | 21:27 | |
| *** cardeois has quit IRC | 21:27 | |
| *** thorst_ has joined #openstack-infra | 21:27 | |
| *** gouthamr has quit IRC | 21:27 | |
| *** ddieterly is now known as ddieterly[away] | 21:28 | |
| clarkb | pabelanger: that exception is something that shade emits when it doesn't know what the public IP of a server is and it doesn't know how to add one to it iirc | 21:28 |
| *** thorst__ has joined #openstack-infra | 21:29 | |
| pabelanger | k | 21:29 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Generate ssh-hostkeys on boot for ironic agent https://review.openstack.org/383481 | 21:30 |
| *** gouthamr has joined #openstack-infra | 21:31 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Switch ovh-gra1 back to qcow2 images https://review.openstack.org/383483 | 21:31 |
| *** annegentle has quit IRC | 21:31 | |
| pabelanger | clarkb: ^ only gra1 is in nodepool.yaml right now, ovh-bhs1 still removed (only way to stop uploads today) | 21:31 |
| *** ddieterly[away] is now known as ddieterly | 21:31 | |
| *** cody-somerville has joined #openstack-infra | 21:32 | |
| clarkb | pabelanger: do we want to wait on more input from ovh before deciding to enable bhs1 with qcow2? | 21:32 |
| *** ddieterly is now known as ddieterly[away] | 21:32 | |
| *** thorst_ has quit IRC | 21:32 | |
| pabelanger | clarkb: I think we need to revisit http://git.openstack.org/cgit/openstack-infra/shade/commit/?id=229f3daae0b9a8aba6e41eedf90eae20fcb8ecf5 | 21:32 |
| *** gouthamr has quit IRC | 21:32 | |
| pabelanger | for our upload issues | 21:32 |
| clarkb | oh right | 21:32 |
| clarkb | ok all used instances > 3 hours old are now set to delete | 21:33 |
| pabelanger | hopefully mordred can offer up some thoughts | 21:33 |
| pabelanger | k | 21:33 |
| pabelanger | aside from a revert | 21:33 |
| *** thorst__ has quit IRC | 21:34 | |
| *** david-lyle_ has joined #openstack-infra | 21:34 | |
| *** david-lyle has quit IRC | 21:34 | |
| *** kzaitsev_mb has quit IRC | 21:34 | |
| *** david-lyle has joined #openstack-infra | 21:35 | |
| *** adrian_otto has quit IRC | 21:35 | |
| *** gouthamr has joined #openstack-infra | 21:35 | |
| *** david-lyle has quit IRC | 21:35 | |
| *** david-lyle has joined #openstack-infra | 21:35 | |
| *** adriant has joined #openstack-infra | 21:35 | |
| *** annegentle has joined #openstack-infra | 21:36 | |
| *** gouthamr has quit IRC | 21:37 | |
| *** amitgandhinz has joined #openstack-infra | 21:37 | |
| *** esberglu has quit IRC | 21:37 | |
| *** mriedem has quit IRC | 21:38 | |
| *** pradk has quit IRC | 21:39 | |
| *** harlowja has joined #openstack-infra | 21:39 | |
| *** harlowja has quit IRC | 21:39 | |
| *** david-lyle_ has quit IRC | 21:39 | |
| *** harlowja has joined #openstack-infra | 21:39 | |
| *** kzaitsev_mb has joined #openstack-infra | 21:40 | |
| *** pahuang has joined #openstack-infra | 21:41 | |
| *** krtaylor has quit IRC | 21:42 | |
| *** smarcet has quit IRC | 21:43 | |
| *** smarcet has joined #openstack-infra | 21:44 | |
| *** kzaitsev_mb has quit IRC | 21:46 | |
| *** kzaitsev_mb has joined #openstack-infra | 21:47 | |
| *** EricGonczer_ has quit IRC | 21:47 | |
| *** rcernin has joined #openstack-infra | 21:47 | |
| *** bnemec has quit IRC | 21:47 | |
| clarkb | jeblair: http://logs.openstack.org/04/383204/1/check/gate-infra-puppet-apply-ubuntu-xenial/8d40b87/console.html#_2016-10-06_18_32_45_103263 is that parallel runs of pansible leaking across each other causing failures? | 21:48 |
| clarkb | I am going to rechcek to see if it is oncsistent but I think it may be racing somewhere | 21:48 |
| *** lseki has quit IRC | 21:48 | |
| *** smarcet has quit IRC | 21:48 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add bugs link to docs https://review.openstack.org/383488 | 21:49 |
| jeblair | clarkb: maybe so -- probably two runs are racing to do the initial link there. maybe we should run a very simple noop manifest first to establish that, then do the real runs | 21:49 |
| *** jheroux has quit IRC | 21:49 | |
| tonyb | anteaya: Hmm okay yours got stuck in alva02 so there goes that theory :( | 21:49 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add low-hanging-fruit bug tag to docs https://review.openstack.org/383489 | 21:51 |
| clarkb | jeblair: oh right ansible-puppet will ensure that dir exists but I guess mkdir on a dir that exists is typically a fail | 21:51 |
| clarkb | jeblair: so ya doing a simple noop pansible run to seed that is probably a good idea | 21:51 |
| *** marst has quit IRC | 21:54 | |
| *** rfolco has joined #openstack-infra | 21:54 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Update 'nodepool dib-image-list' command to ZK https://review.openstack.org/383439 | 21:55 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Add a DIB configuration to fake.yaml https://review.openstack.org/383438 | 21:55 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Update 'image-list' cli to ZK https://review.openstack.org/383491 | 21:55 |
| *** david-lyle has quit IRC | 21:56 | |
| *** caphrim0_ has joined #openstack-infra | 21:57 | |
| *** EricGonczer_ has joined #openstack-infra | 21:59 | |
| *** tlian has quit IRC | 21:59 | |
| *** rcernin has quit IRC | 21:59 | |
| *** rcernin has joined #openstack-infra | 21:59 | |
| jlvillal | clarkb: If I wanted to "fix" it so that the /etc/nodepool/id_rsa.pub file had a carriage return at the end. Where would I look to fix that? | 21:59 |
| clarkb | is anyone able to hit telnet://[2001:4800:1ae1:18:f816:3eff:fea7:6586]:19885 ? I wonder if the job is hosing the console log tailing somehow | 22:01 |
| clarkb | jeblair: ^ | 22:01 |
| *** EricGonczer_ has quit IRC | 22:01 | |
| clarkb | jlvillal: paramiko/nodepool | 22:01 |
| jlvillal | clarkb: Thanks. I'm assuming that is two projects. | 22:01 |
| clarkb | jlvillal: yes, nodepool generates the key using paramiko | 22:01 |
| clarkb | jlvillal: so you can probably solve it in either layer | 22:02 |
| jlvillal | clarkb: Awesome :) | 22:02 |
| clarkb | oh hrm that dvr job just restarted | 22:02 |
| clarkb | so I am guessing it crashed all the networking and zuul restarted it | 22:02 |
| clarkb | fun | 22:02 |
| *** AnarchyAo has quit IRC | 22:02 | |
| *** mdrabe has quit IRC | 22:04 | |
| clarkb | I have a telnet open now to watch where it fails | 22:04 |
| *** tpsilva has quit IRC | 22:04 | |
| *** spzala has quit IRC | 22:04 | |
| *** ccamacho1 has left #openstack-infra | 22:04 | |
| anteaya | tonyb: yeah :( | 22:05 |
| openstackgerrit | Merged openstack-infra/puppet-nodepool: Add missing default files for launcher / deleter https://review.openstack.org/383204 | 22:06 |
| *** ijw has joined #openstack-infra | 22:06 | |
| clarkb | jeblair: ^ recheck indeed does pass so ya a race | 22:06 |
| openstackgerrit | Merged openstack-infra/puppet-nodepool: Properly set pidfile for nodepoold https://review.openstack.org/383335 | 22:07 |
| clarkb | pabelanger: once ^ that gets onto the server I think I will restart services again just to make sure they still work while it is fresh in our heads | 22:07 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Integrate zuul-dev.o.o with review-dev.o.o https://review.openstack.org/383494 | 22:07 |
| *** akshai has quit IRC | 22:07 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/nodepool: Have a ending line-feed on the generated id_rsa.pub file https://review.openstack.org/383496 | 22:10 |
| jlvillal | clarkb: ^^^ And thanks. | 22:10 |
| *** ijw has quit IRC | 22:11 | |
| *** Apoorva_ has quit IRC | 22:12 | |
| *** sdake has joined #openstack-infra | 22:13 | |
| *** Apoorva has joined #openstack-infra | 22:13 | |
| *** mixos has quit IRC | 22:13 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/nodepool: Have an ending line-feed on the generated id_rsa.pub file https://review.openstack.org/383496 | 22:14 |
| *** jamesdenton has quit IRC | 22:14 | |
| *** tiswanso has joined #openstack-infra | 22:16 | |
| *** ociuhandu has quit IRC | 22:17 | |
| *** sdague has quit IRC | 22:18 | |
| *** amitgandhinz has quit IRC | 22:19 | |
| *** abregman has quit IRC | 22:19 | |
| *** gordc has quit IRC | 22:22 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Update 'nodepool dib-image-list' command to ZK https://review.openstack.org/383439 | 22:22 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Add a DIB configuration to fake.yaml https://review.openstack.org/383438 | 22:22 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Update 'image-list' cli to ZK https://review.openstack.org/383491 | 22:22 |
| *** Drago has left #openstack-infra | 22:24 | |
| *** zz_dimtruck is now known as dimtruck | 22:25 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Integrate zuul-dev.o.o with review-dev.o.o https://review.openstack.org/383494 | 22:26 |
| zaro | clarkb: wondering if i'm on the right track with setting up review-dev, zuul-dev, nodepool integration. also will need someone to provide a static nodepool slave. ^ | 22:26 |
| *** AnarchyAo has joined #openstack-infra | 22:28 | |
| clarkb | zaro: commented | 22:29 |
| clarkb | zaro: basically I think we want an all in one type setup on zuul-dev including nodepool and the zuul daemons | 22:30 |
| clarkb | zaro: openstackci module should make this easy maybe | 22:30 |
| *** krtaylor has joined #openstack-infra | 22:31 | |
| *** ddieterly[away] has quit IRC | 22:32 | |
| jeblair | clarkb, zaro: if we use zuulv2.5, we can make a static slave on localhost. that would be easy, but has security implications (your 'test' job content will run on the zuul-dev server). so if we don't like that, we may still want a single little static slave. | 22:32 |
| jeblair | (also, a static slave makes for better testing of zuul itself) | 22:33 |
| *** asselin_ has joined #openstack-infra | 22:33 | |
| *** ddieterly has joined #openstack-infra | 22:36 | |
| *** gildub has joined #openstack-infra | 22:36 | |
| zaro | fwiw, i'm not concerned about security but would preffer to make it more like prod. after all the goal here is to make sure things work after upgrading gerrit. | 22:36 |
| clarkb | ya I think it would be pretty easy to have a simple static instance that we run jobs on for tesing | 22:37 |
| *** rhallisey has quit IRC | 22:40 | |
| *** rhallisey has joined #openstack-infra | 22:40 | |
| *** rhallisey has quit IRC | 22:40 | |
| *** gildub_ has joined #openstack-infra | 22:40 | |
| *** rhallisey has joined #openstack-infra | 22:41 | |
| *** rhallisey has quit IRC | 22:41 | |
| zaro | clarkb: i assume you mean nodepool slave on zuul-dev? | 22:46 |
| clarkb | no, I think it would be its own intsance like jeblair says | 22:47 |
| jeblair | and if we only want a static slave, we can skip all the nodepool stuff | 22:48 |
| *** xarses has quit IRC | 22:48 | |
| *** annegentle has quit IRC | 22:49 | |
| *** cody-somerville has quit IRC | 22:50 | |
| *** ddieterly has quit IRC | 22:50 | |
| pabelanger | clarkb: WFM | 22:50 |
| *** ajo_ has quit IRC | 22:53 | |
| clarkb | mriedem armax http://logs.openstack.org/52/383452/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/d26eed3/logs/screen-n-api.txt.gz?level=WARNING failed on that connection issue with the extra logging from apache. and I still don't see anything | 22:53 |
| armax | um | 22:53 |
| clarkb | I think we will want to convince keystoneauth1 to actually log what it is doing | 22:53 |
| clarkb | or what it means by connection error and what the source was etc | 22:54 |
| clarkb | basically apache is saying nothing went wrong | 22:55 |
| clarkb | implying it never got the connection or keystoneauth1 is mistaken | 22:55 |
| zaro | clarkb: it's own instance coming from nodepool.o.o? if so, is 'zlstatic00.o.o' appropriate? | 22:57 |
| clarkb | no and no. Its own instance that we just boot and assign to its zuul launcher running on zuul-dev | 22:57 |
| zaro | clarkb: got it. thanks. | 22:58 |
| *** ajo has joined #openstack-infra | 22:58 | |
| *** salv-orlando has quit IRC | 23:01 | |
| *** gouthamr has joined #openstack-infra | 23:01 | |
| *** camunoz has joined #openstack-infra | 23:02 | |
| *** ihrachys has quit IRC | 23:03 | |
| *** apetrich has quit IRC | 23:03 | |
| *** apetrich has joined #openstack-infra | 23:04 | |
| *** tiswanso has quit IRC | 23:04 | |
| *** spzala has joined #openstack-infra | 23:05 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 23:06 |
| clarkb | puppet still hasn't run on nodepool yet to update the init scripts and default files. I might have to pick that up in the morning | 23:06 |
| *** claudiub has quit IRC | 23:07 | |
| *** ijw has joined #openstack-infra | 23:07 | |
| notmyname | where's the definition of the CI worker image? I found `prepare_node.sh` but I was hoping for something that more describes the actual node. drives, memory, etc | 23:08 |
| *** hongbin has quit IRC | 23:08 | |
| *** xarses has joined #openstack-infra | 23:08 | |
| *** AnarchyAo has quit IRC | 23:09 | |
| clarkb | notmyname: it depends on the cloud so there is no single definition. We try to avoid making a ton of promises about it as a result. What you can count on currently is 8GB of memory, ~80GB of disk some of it all in one device/partition sometimes split over a couple. A public IP address (either ipv4 or ipv6 or both). x86-64 instruction set. | 23:09 |
| clarkb | notmyname: this is roughly captured at http://docs.openstack.org/infra/system-config/contribute-cloud.html | 23:10 |
| notmyname | clarkb: ok. so prepare_node.sh is pretty much then entry point, then? (bigger context here is that I'm back to getting xfs on a CI node) | 23:10 |
| clarkb | notmyname: I don't think I would put xfs on the CI nodes during image build time. Instead I would do like devstack and create one on the fly at job runtime | 23:11 |
| *** spzala has quit IRC | 23:11 | |
| clarkb | notmyname: but to go the image build route thats all via openstack-infra/project-config/nodepool/elements now | 23:11 |
| clarkb | then we run disk image builder and feed in those elements | 23:12 |
| notmyname | ah? I was looking in project-config at macros.yaml (for builder definitions) and python-jobs.yaml (for job template definitions). I was looking in to adding a builder that makes an xfs partition to a job template | 23:12 |
| *** jcoufal has joined #openstack-infra | 23:13 | |
| clarkb | notmyname: there isn't one today in project-config because devstack does it for itself, but it should be doable via the job configs in project-config too | 23:13 |
| *** ijw has quit IRC | 23:14 | |
| notmyname | so which is the way to do it now? with builders and job templates? or nodepool/elements? | 23:14 |
| notmyname | and when you say "isn't one today", are you refering to and xfs partition? does devstack make one of those already? | 23:14 |
| clarkb | builders and templates if you want to do it at job runtime (my preference is this) or nodepool/elements if there is some reason to bake it into every image we build | 23:14 |
| notmyname | ok | 23:14 |
| clarkb | notmyname: correct there is no xfs partition handling in project-config today, because it lives in devstack | 23:15 |
| clarkb | notmyname: devstack creates an xfs filesystem for swift when swift is enabled | 23:15 |
| * notmyname wasn't aware that devstack does anything with xfs | 23:15 | |
| notmyname | hmm | 23:15 |
| notmyname | interesting | 23:15 |
| notmyname | but what I need to make work in gate-swift-python27-* | 23:16 |
| notmyname | s/in/is | 23:16 |
| clarkb | ya so you'll want to add that to your job via the job config | 23:16 |
| notmyname | which is why I was looking at the worker node definitions | 23:16 |
| clarkb | (its possible you could do it all via tox even but I think that requires sudo and we remove sudo perms by the time tox runs) | 23:16 |
| notmyname | right. that's what we looked in to forst | 23:17 |
| notmyname | *first | 23:17 |
| notmyname | otherwise we would do it in tox | 23:17 |
| clarkb | ya so you'll want to make a new job for swift that sets up xfs filesystem before removing sudo and running tox | 23:18 |
| *** xyang1 has quit IRC | 23:18 | |
| notmyname | ok, here's the last trick. I'd *really* like to avoid this turning into a TC governance thing. the right technical thing for the testing I need to do is to drop the existing py27 job template and use a py27+xfs job template. however, that being a slight difference, it risks being turned into another 100+ thread email | 23:18 |
| notmyname | which is why I was looking for "do it everywhere" sort of solutions | 23:19 |
| clarkb | uh | 23:19 |
| clarkb | I am not sure why that would be the case | 23:19 |
| clarkb | as long as your unittests can still run using `tox` (eg gracefually fallback if xfs isn't available) then it should be fine | 23:19 |
| clarkb | we already do similar for databases during unittesting | 23:19 |
| notmyname | because of the http://governance.openstack.org/reference/cti/python_cti.html and that `tox -epy27` ends up calling the gate-python27 job template (right?) | 23:19 |
| clarkb | no the other way around | 23:20 |
| clarkb | gate-python27 calls tox -epy27 | 23:20 |
| notmyname | hmm | 23:20 |
| pabelanger | Ya, don't use prepare_node.sh. In fact, I think we can likely remove that now | 23:20 |
| clarkb | but we already have a db and non db variant, they both still run tox -epy27 | 23:20 |
| clarkb | this is fine as long as your tests gracefully fallback if features are missing | 23:20 |
| notmyname | running without xfs would result in the tests being reduced to `return True`. (an exaggeration, but the point is that xfs would be required) | 23:21 |
| pabelanger | https://review.openstack.org/#/c/331494/ actually removes them | 23:22 |
| clarkb | notmyname: with the unittests that want to have a database they are skipped (and recorded as skips) when the database is not present | 23:22 |
| clarkb | notmyname: I think you can and should do similar for where xfs is needed | 23:22 |
| clarkb | notmyname: but that way people can continue to run things locally where xfs may not be present and its clearly recorded as such | 23:22 |
| clarkb | then with zuul you'll just always run with an xfs filesystem available and those tests won't be skipped | 23:23 |
| *** esberglu has joined #openstack-infra | 23:24 | |
| *** amotoki has quit IRC | 23:24 | |
| *** priteau has quit IRC | 23:26 | |
| *** mriedem has joined #openstack-infra | 23:26 | |
| *** dimtruck is now known as zz_dimtruck | 23:27 | |
| *** zz_dimtruck is now known as dimtruck | 23:27 | |
| clarkb | notmyname: but however you do it within the unittests you should be able to create an xfs filesystem in your job by making a new job for swift that roughly does install system deps, make xfs, remove sudo, run tox | 23:30 |
| notmyname | yeah, that's the path I was exploring | 23:31 |
| cloudnull | evenings | 23:31 |
| anteaya | evening cloudnull | 23:31 |
| anteaya | cloudnull: another fun day of meetings? | 23:31 |
| cloudnull | hows it anteaya? | 23:31 |
| anteaya | going well | 23:31 |
| cloudnull | anteaya: you know it :) | 23:31 |
| anteaya | ha ha ha | 23:32 |
| anteaya | I have a fire on, it was a beautiful day, coming into a long weekend | 23:32 |
| cloudnull | nice! | 23:32 |
| anteaya | the release happened mid-morning, all seems smooth | 23:32 |
| anteaya | thanks, yeah it has been a good day | 23:32 |
| cloudnull | yup release is out, now time to start breaking things :p | 23:33 |
| clarkb | ok nodepool.o.o finally updated those files but its late enough in the day that I don't think I am goign to restart all the services again. Will line that up for tomorrow | 23:33 |
| anteaya | cloudnull: yeah, it is okay now | 23:33 |
| anteaya | clarkb: thank you | 23:33 |
| *** esberglu has quit IRC | 23:35 | |
| anteaya | I think I am going to offline for the night | 23:35 |
| anteaya | g'night | 23:35 |
| *** rcernin has quit IRC | 23:36 | |
| *** dimtruck is now known as zz_dimtruck | 23:36 | |
| *** mixos has joined #openstack-infra | 23:36 | |
| jeblair | notmyname: can you see/hear/feel the blue angels from where you are? | 23:41 |
| *** mixos has quit IRC | 23:41 | |
| notmyname | jeblair: yes :-) | 23:45 |
| notmyname | see an hear. not feel | 23:45 |
| *** zara_the_lemur__ has quit IRC | 23:46 | |
| *** Swami has quit IRC | 23:50 | |
| jeblair | notmyname: i can just make them out as planes from here, though their contrails (er, chemtrails if anyone from berkeley is listening ;) are quite visible | 23:50 |
| *** amitgandhinz has joined #openstack-infra | 23:50 | |
| *** esberglu has joined #openstack-infra | 23:51 | |
| *** esberglu has quit IRC | 23:51 | |
| jeblair | actually they produce smoke... chemtrails might be the right word after all... | 23:51 |
| *** thorst_ has joined #openstack-infra | 23:52 | |
| *** rfolco has quit IRC | 23:53 | |
| *** dtantsur|afk has quit IRC | 23:53 | |
| *** jcoufal has quit IRC | 23:54 | |
| *** amitgandhinz has quit IRC | 23:55 | |
| *** pcaruana has quit IRC | 23:55 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Update 'image-list' cli to ZK https://review.openstack.org/383491 | 23:55 |
| *** pblaho has quit IRC | 23:55 | |
| *** jcoufal has joined #openstack-infra | 23:57 | |
| *** thorst_ has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!