| *** jamielennox|away is now known as jamielennox | 00:02 | |
| *** kzaitsev_mb has quit IRC | 00:03 | |
| *** markvoelker has quit IRC | 00:11 | |
| *** sflanigan has joined #openstack-infra | 00:17 | |
| *** thorst_afk has joined #openstack-infra | 00:19 | |
| *** mriedem has joined #openstack-infra | 00:22 | |
| *** mriedem has quit IRC | 00:22 | |
| *** thorst_afk has quit IRC | 00:24 | |
| *** hongbin_ has joined #openstack-infra | 00:28 | |
| *** hongbin has quit IRC | 00:28 | |
| *** EricGonczer_ has joined #openstack-infra | 00:35 | |
| *** esikachev has joined #openstack-infra | 00:39 | |
| *** jamesmca_ has joined #openstack-infra | 00:40 | |
| *** esikachev has quit IRC | 00:43 | |
| *** vhosakot has joined #openstack-infra | 00:44 | |
| *** jamesmca_ has quit IRC | 00:45 | |
| *** vhosakot has quit IRC | 00:47 | |
| *** esikachev has joined #openstack-infra | 00:48 | |
| *** esikachev has quit IRC | 00:52 | |
| *** links has joined #openstack-infra | 00:54 | |
| *** cuongnv has joined #openstack-infra | 00:56 | |
| *** adreznec has quit IRC | 00:59 | |
| *** adreznec has joined #openstack-infra | 01:01 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: sql-connection: make _setup_tables staticmethod https://review.openstack.org/466455 | 01:02 |
|---|---|---|
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: [RFC] Zuul Dashboard https://review.openstack.org/466561 | 01:02 |
| *** thorst_afk has joined #openstack-infra | 01:02 | |
| *** gildub has joined #openstack-infra | 01:03 | |
| *** hongbin_ has quit IRC | 01:03 | |
| *** thorst_afk has quit IRC | 01:04 | |
| *** esikachev has joined #openstack-infra | 01:05 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Switch debian to deb.debian.org https://review.openstack.org/466182 | 01:07 |
| *** inc0 has quit IRC | 01:07 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Add weights to digraph https://review.openstack.org/466473 | 01:07 |
| *** inc0 has joined #openstack-infra | 01:07 | |
| *** esikachev has quit IRC | 01:10 | |
| *** liujiong has joined #openstack-infra | 01:20 | |
| *** esikachev has joined #openstack-infra | 01:21 | |
| *** EricGonczer_ has quit IRC | 01:24 | |
| *** esikachev has quit IRC | 01:28 | |
| *** baoli has joined #openstack-infra | 01:30 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Re-enable F405 pep8 errors https://review.openstack.org/466285 | 01:36 |
| *** esikachev has joined #openstack-infra | 01:37 | |
| *** esikachev has quit IRC | 01:42 | |
| *** zul has quit IRC | 01:44 | |
| *** baoli has quit IRC | 01:46 | |
| *** Sukhdev has joined #openstack-infra | 01:47 | |
| *** armax has joined #openstack-infra | 01:47 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: Zuul Dashboard https://review.openstack.org/466561 | 01:48 |
| *** yolkfull has joined #openstack-infra | 01:52 | |
| *** armax has quit IRC | 01:54 | |
| *** esikachev has joined #openstack-infra | 01:57 | |
| *** thorst_afk has joined #openstack-infra | 01:58 | |
| *** thorst_afk has quit IRC | 01:58 | |
| *** jamielennox is now known as jamielennox|away | 02:00 | |
| *** esikachev has quit IRC | 02:01 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: RFC: Zuul Dashboard https://review.openstack.org/466561 | 02:01 |
| *** kzaitsev_mb has joined #openstack-infra | 02:02 | |
| *** funzo has joined #openstack-infra | 02:03 | |
| *** gildub has quit IRC | 02:04 | |
| *** gcb has joined #openstack-infra | 02:04 | |
| *** esikachev has joined #openstack-infra | 02:06 | |
| *** Kevin_Zheng has joined #openstack-infra | 02:07 | |
| *** funzo has quit IRC | 02:08 | |
| *** esikachev has quit IRC | 02:15 | |
| *** EricGonczer_ has joined #openstack-infra | 02:15 | |
| *** kzaitsev_mb has quit IRC | 02:17 | |
| *** winggundamth has joined #openstack-infra | 02:18 | |
| *** adam_g has quit IRC | 02:24 | |
| *** adam_g has joined #openstack-infra | 02:25 | |
| *** adam_g has quit IRC | 02:32 | |
| *** adam_g has joined #openstack-infra | 02:35 | |
| *** EricGonczer_ has quit IRC | 02:41 | |
| *** stakeda has joined #openstack-infra | 02:54 | |
| *** salv-orlando has joined #openstack-infra | 02:54 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Move exception to it's own file (again) https://review.openstack.org/466129 | 02:54 |
| *** thorst_afk has joined #openstack-infra | 02:57 | |
| *** thorst_afk has quit IRC | 02:57 | |
| *** baoli has joined #openstack-infra | 03:00 | |
| *** jhesketh_ is now known as jhesketh | 03:08 | |
| *** kzaitsev_mb has joined #openstack-infra | 03:14 | |
| *** kzaitsev_mb has quit IRC | 03:19 | |
| *** EricGonczer_ has joined #openstack-infra | 03:20 | |
| *** EricGonczer_ has quit IRC | 03:21 | |
| *** hongbin has joined #openstack-infra | 03:23 | |
| *** psachin has joined #openstack-infra | 03:23 | |
| *** adam_g has quit IRC | 03:24 | |
| *** adam_g has joined #openstack-infra | 03:24 | |
| *** thorst_afk has joined #openstack-infra | 03:28 | |
| *** gildub has joined #openstack-infra | 03:34 | |
| *** gildub has quit IRC | 03:43 | |
| *** vikrant has joined #openstack-infra | 03:46 | |
| *** lamt has joined #openstack-infra | 03:46 | |
| *** SumitNaiksatam has quit IRC | 03:46 | |
| *** thorst_afk has quit IRC | 03:46 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: launcher: ensure builder scripts are removed https://review.openstack.org/464519 | 03:46 |
| *** baoli has quit IRC | 03:48 | |
| *** jamielennox|away is now known as jamielennox | 03:53 | |
| *** xinliang has quit IRC | 03:54 | |
| *** xinliang has joined #openstack-infra | 03:55 | |
| *** xinliang has quit IRC | 03:55 | |
| *** xinliang has joined #openstack-infra | 03:55 | |
| *** salv-orlando has quit IRC | 03:58 | |
| *** aeng has quit IRC | 04:04 | |
| *** gildub has joined #openstack-infra | 04:10 | |
| *** yamamoto has quit IRC | 04:12 | |
| *** rwsu has joined #openstack-infra | 04:18 | |
| *** aeng has joined #openstack-infra | 04:20 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Split partition into it's own file https://review.openstack.org/465837 | 04:29 |
| openstackgerrit | Merged openstack/diskimage-builder master: Move parts of Partition creation into object https://review.openstack.org/465838 | 04:29 |
| *** adam_g has quit IRC | 04:30 | |
| *** adam_g has joined #openstack-infra | 04:32 | |
| *** esikachev has joined #openstack-infra | 04:32 | |
| *** rohan_ has joined #openstack-infra | 04:34 | |
| rohan_ | hi all | 04:34 |
| rohan_ | just wanted to know that during compute upgration which this should be get handeles | 04:34 |
| rohan_ | handled | 04:35 |
| *** andreas-f has joined #openstack-infra | 04:35 | |
| *** esikachev has quit IRC | 04:37 | |
| *** ramishra_ has joined #openstack-infra | 04:38 | |
| *** dingyichen has quit IRC | 04:38 | |
| *** ramishra has quit IRC | 04:38 | |
| *** dingyichen has joined #openstack-infra | 04:38 | |
| rohan_ | what can be the pre-checks for compute updrade ? | 04:38 |
| *** jamesmca_ has joined #openstack-infra | 04:41 | |
| *** jamesmca_ has quit IRC | 04:45 | |
| *** chandankumar has quit IRC | 04:46 | |
| *** jaosorior has joined #openstack-infra | 04:52 | |
| *** yamamoto has joined #openstack-infra | 04:56 | |
| *** sree has joined #openstack-infra | 04:56 | |
| *** isaacb has joined #openstack-infra | 04:59 | |
| *** chkumar246 has joined #openstack-infra | 05:00 | |
| *** chkumar246 is now known as chandankumar | 05:01 | |
| *** aeng has quit IRC | 05:02 | |
| *** dingyichen has quit IRC | 05:03 | |
| *** pgadiya has joined #openstack-infra | 05:03 | |
| *** pgadiya has quit IRC | 05:06 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Unit testing for graph generation https://review.openstack.org/466591 | 05:13 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Start at networkx for digraph implementation https://review.openstack.org/466592 | 05:13 |
| *** hongbin_ has joined #openstack-infra | 05:13 | |
| openstackgerrit | Noam Angel proposed openstack/diskimage-builder master: Revert "Set manifests to mode 600 and owner root" https://review.openstack.org/466593 | 05:13 |
| *** hongbin has quit IRC | 05:14 | |
| *** aeng has joined #openstack-infra | 05:15 | |
| *** kzaitsev_mb has joined #openstack-infra | 05:15 | |
| *** lamt has quit IRC | 05:16 | |
| *** hongbin_ has quit IRC | 05:17 | |
| *** salv-orlando has joined #openstack-infra | 05:17 | |
| *** dingyichen has joined #openstack-infra | 05:20 | |
| *** kzaitsev_mb has quit IRC | 05:20 | |
| *** cuongnv has quit IRC | 05:25 | |
| *** prateek has joined #openstack-infra | 05:27 | |
| *** winggundamth has quit IRC | 05:28 | |
| *** nmathew has joined #openstack-infra | 05:28 | |
| *** cuongnv has joined #openstack-infra | 05:38 | |
| *** jamesmca_ has joined #openstack-infra | 05:40 | |
| *** dingyichen has quit IRC | 05:41 | |
| *** isaacb has quit IRC | 05:41 | |
| *** thorst_afk has joined #openstack-infra | 05:43 | |
| *** jamesmca_ has quit IRC | 05:45 | |
| *** thorst_afk has quit IRC | 05:48 | |
| *** esikachev has joined #openstack-infra | 05:54 | |
| *** dingyichen has joined #openstack-infra | 05:54 | |
| *** funzo has joined #openstack-infra | 06:02 | |
| *** jascott1 has joined #openstack-infra | 06:02 | |
| *** salv-orlando has quit IRC | 06:04 | |
| *** rohan_ has quit IRC | 06:05 | |
| *** funzo has quit IRC | 06:06 | |
| *** ltomasbo|away is now known as ltomasbo | 06:06 | |
| *** lamt has joined #openstack-infra | 06:07 | |
| *** salv-orlando has joined #openstack-infra | 06:07 | |
| *** gyee has joined #openstack-infra | 06:08 | |
| *** esikachev has quit IRC | 06:08 | |
| *** Hal has quit IRC | 06:11 | |
| *** dhajare has joined #openstack-infra | 06:14 | |
| *** rcernin has joined #openstack-infra | 06:19 | |
| *** markus_z has joined #openstack-infra | 06:21 | |
| *** esikachev has joined #openstack-infra | 06:21 | |
| *** aeng has quit IRC | 06:22 | |
| *** gyee has quit IRC | 06:31 | |
| *** isaacb has joined #openstack-infra | 06:33 | |
| *** andreas_s has joined #openstack-infra | 06:41 | |
| *** cshen has quit IRC | 06:41 | |
| *** cshen has joined #openstack-infra | 06:41 | |
| *** adam_g has quit IRC | 06:42 | |
| *** adam_g has joined #openstack-infra | 06:43 | |
| *** thorst_afk has joined #openstack-infra | 06:44 | |
| *** ykarel has joined #openstack-infra | 06:45 | |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config master: Retire Gnocchi https://review.openstack.org/466320 | 06:47 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config master: Update Gnocchi devstack URL https://review.openstack.org/466321 | 06:47 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config master: Stop gating Gnocchi https://review.openstack.org/466318 | 06:47 |
| *** thorst_afk has quit IRC | 06:49 | |
| *** shardy has joined #openstack-infra | 06:55 | |
| *** DangerousDaren has joined #openstack-infra | 06:56 | |
| *** matrohon has joined #openstack-infra | 06:57 | |
| *** tie has joined #openstack-infra | 06:58 | |
| *** reduxio has joined #openstack-infra | 06:58 | |
| *** esikachev has quit IRC | 07:00 | |
| reduxio | Hello, I've tried upgrading my devstack and CI to latest version, and running into trouble. When nodepool tries to create a node it fails and in horizon I can see an error instance saying 'No valid host was found. There are not enough hosts available.'. Could not find the reason in the logs. the n-sch log shows 'Starting with 0 host(s)' but i'm not sure why. clarkb offered that i need to perform cell discovery, but I don' | 07:00 |
| reduxio | t think this is the issue as I have a single host (devstack) and it's connected to a cell. Also, manually firing up a VM through horizon works.. | 07:00 |
| *** kzaitsev_mb has joined #openstack-infra | 07:01 | |
| *** ccamacho has joined #openstack-infra | 07:01 | |
| *** salv-orlando has quit IRC | 07:01 | |
| *** camunoz has quit IRC | 07:01 | |
| *** salv-orlando has joined #openstack-infra | 07:03 | |
| *** andreas-f has quit IRC | 07:03 | |
| *** jascott1 has quit IRC | 07:03 | |
| *** florianf has joined #openstack-infra | 07:05 | |
| *** kzaitsev_mb has quit IRC | 07:07 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: launcher: add Jenkins credentials-binding support https://review.openstack.org/466611 | 07:07 |
| *** salv-orlando has quit IRC | 07:08 | |
| *** pcaruana has joined #openstack-infra | 07:11 | |
| *** pcaruana has quit IRC | 07:12 | |
| *** pcaruana has joined #openstack-infra | 07:13 | |
| *** rcernin has quit IRC | 07:14 | |
| *** rcernin has joined #openstack-infra | 07:14 | |
| *** asselin_ has quit IRC | 07:16 | |
| *** dizquierdo has joined #openstack-infra | 07:19 | |
| *** ggnel_t has joined #openstack-infra | 07:21 | |
| *** jpich has joined #openstack-infra | 07:23 | |
| *** tie has quit IRC | 07:25 | |
| *** e0ne has joined #openstack-infra | 07:28 | |
| *** bnemec has quit IRC | 07:29 | |
| *** flepied has quit IRC | 07:33 | |
| *** bnemec has joined #openstack-infra | 07:35 | |
| *** lamt has quit IRC | 07:35 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Start at networkx for digraph implementation https://review.openstack.org/466592 | 07:36 |
| *** david-lyle has quit IRC | 07:36 | |
| *** esikachev has joined #openstack-infra | 07:41 | |
| *** david-lyle has joined #openstack-infra | 07:42 | |
| *** thorst_afk has joined #openstack-infra | 07:45 | |
| *** jpena|off is now known as jpena | 07:46 | |
| *** david-lyle has quit IRC | 07:46 | |
| openstackgerrit | Noam Angel proposed openstack/diskimage-builder master: dhcp-all-interfaces.sh - Add support for InfiniBand interface DHCP https://review.openstack.org/465928 | 07:48 |
| *** thorst_afk has quit IRC | 07:50 | |
| *** Sukhdev has quit IRC | 07:50 | |
| *** wolverineav has joined #openstack-infra | 07:51 | |
| *** gouthamr has joined #openstack-infra | 07:51 | |
| *** Hal has joined #openstack-infra | 07:54 | |
| *** ralonsoh has joined #openstack-infra | 07:55 | |
| *** SumitNaiksatam has joined #openstack-infra | 07:59 | |
| *** rossella_s has joined #openstack-infra | 07:59 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:01 | |
| *** reduxio has quit IRC | 08:03 | |
| *** david-lyle has joined #openstack-infra | 08:03 | |
| *** flepied has joined #openstack-infra | 08:09 | |
| *** sflanigan has quit IRC | 08:10 | |
| *** reduxio has joined #openstack-infra | 08:12 | |
| reduxio | Hello, I've tried upgrading my devstack and CI to latest version, and running into trouble. When nodepool tries to create a node it fails and in horizon I can see an error instance saying 'No valid host was found. There are not enough hosts available.'. Could not find the reason in the logs. the n-sch log shows 'Starting with 0 host(s)' but i'm not sure why. clarkb offered that i need to perform cell discovery, I dont thi | 08:12 |
| *** e0ne has quit IRC | 08:12 | |
| reduxio | nk this is the issue as I have a single host (devstack) and it's connected to a cell. Also, manually firing up a VM through horizon works.. | 08:12 |
| *** e0ne has joined #openstack-infra | 08:14 | |
| *** flepied has quit IRC | 08:14 | |
| *** lucas-afk is now known as lucasagomes | 08:15 | |
| *** ralonsoh has quit IRC | 08:15 | |
| *** rossella_s has quit IRC | 08:15 | |
| *** gouthamr has quit IRC | 08:19 | |
| *** ralonsoh has joined #openstack-infra | 08:19 | |
| *** Hal has quit IRC | 08:21 | |
| *** rossella_s has joined #openstack-infra | 08:22 | |
| *** gildub has quit IRC | 08:23 | |
| *** alexchadin has joined #openstack-infra | 08:25 | |
| *** neiljerram has joined #openstack-infra | 08:28 | |
| *** dtantsur|afk is now known as dtantsur | 08:28 | |
| *** adriant has quit IRC | 08:28 | |
| *** derekh has joined #openstack-infra | 08:34 | |
| *** liujiong_lj has joined #openstack-infra | 08:41 | |
| *** liujiong has quit IRC | 08:41 | |
| *** pbourke has joined #openstack-infra | 08:43 | |
| *** dingyichen has quit IRC | 08:45 | |
| openstackgerrit | Chandan Kumar proposed openstack-infra/project-config master: Added blacklist option to remove stale tempest plugins https://review.openstack.org/466630 | 08:45 |
| *** thorst_afk has joined #openstack-infra | 08:46 | |
| *** feisky has joined #openstack-infra | 08:47 | |
| *** adam_g has quit IRC | 08:54 | |
| *** adam_g has joined #openstack-infra | 08:55 | |
| feisky | does someone know how to setup docs page for a new project? e.g. https://docs.openstack.org/developer/stackube | 09:05 |
| *** thorst_afk has quit IRC | 09:05 | |
| *** e0ne has quit IRC | 09:08 | |
| *** e0ne has joined #openstack-infra | 09:09 | |
| *** rossella_s has quit IRC | 09:09 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Rename Higgins to Zun https://review.openstack.org/466509 | 09:11 |
| *** Hal has joined #openstack-infra | 09:13 | |
| *** dtantsur is now known as dtantsur|lunch | 09:14 | |
| *** flepied has joined #openstack-infra | 09:14 | |
| *** electrofelix has joined #openstack-infra | 09:17 | |
| AJaeger | feisky: you can only publish official projects to docs.o.o - stackube is not listed in governance repo as official project in Big Tent | 09:18 |
| AJaeger | feisky: use rtfd hooks | 09:18 |
| *** dizquierdo has quit IRC | 09:21 | |
| *** sshnaidm|off is now known as sshnaidm | 09:26 | |
| feisky | AJaeger: thanks. | 09:27 |
| *** sree_ has joined #openstack-infra | 09:27 | |
| *** sree_ is now known as Guest2090 | 09:27 | |
| *** sree has quit IRC | 09:30 | |
| *** sree has joined #openstack-infra | 09:30 | |
| *** Guest2090 has quit IRC | 09:31 | |
| *** rossella_s has joined #openstack-infra | 09:33 | |
| *** gongysh has joined #openstack-infra | 09:35 | |
| *** tosky has joined #openstack-infra | 09:46 | |
| *** cuongnv has quit IRC | 09:49 | |
| *** sambetts_ is now known as sambetts | 09:51 | |
| *** reduxio has quit IRC | 09:54 | |
| *** adam_g has quit IRC | 09:54 | |
| *** adam_g has joined #openstack-infra | 09:55 | |
| *** thorst_afk has joined #openstack-infra | 10:02 | |
| *** funzo has joined #openstack-infra | 10:03 | |
| *** liujiong_lj has quit IRC | 10:05 | |
| *** stakeda has quit IRC | 10:06 | |
| openstackgerrit | afazekas proposed openstack/os-testr master: Fail when no test case selected https://review.openstack.org/466496 | 10:06 |
| *** thorst_afk has quit IRC | 10:07 | |
| *** Hal has quit IRC | 10:07 | |
| *** funzo has quit IRC | 10:07 | |
| *** adam_g has quit IRC | 10:09 | |
| *** rossella_s has quit IRC | 10:09 | |
| *** adam_g has joined #openstack-infra | 10:10 | |
| *** alexchad_ has joined #openstack-infra | 10:10 | |
| *** alexchadin has quit IRC | 10:10 | |
| *** e0ne has quit IRC | 10:13 | |
| *** tuanluong has joined #openstack-infra | 10:15 | |
| *** pblaho has joined #openstack-infra | 10:15 | |
| *** hashar has joined #openstack-infra | 10:16 | |
| *** reduxio has joined #openstack-infra | 10:18 | |
| *** adam_g has quit IRC | 10:19 | |
| *** rossella_s has joined #openstack-infra | 10:20 | |
| *** mpaolino has joined #openstack-infra | 10:21 | |
| *** dtantsur|lunch is now known as dtantsur | 10:23 | |
| *** adam_g has joined #openstack-infra | 10:23 | |
| *** reduxio has quit IRC | 10:28 | |
| *** sdague has joined #openstack-infra | 10:31 | |
| *** jkilpatr has quit IRC | 10:31 | |
| *** adam_g has quit IRC | 10:32 | |
| *** neiljerram has quit IRC | 10:33 | |
| *** aspiers has joined #openstack-infra | 10:34 | |
| *** neiljerram has joined #openstack-infra | 10:34 | |
| *** adam_g has joined #openstack-infra | 10:35 | |
| *** hrubi has quit IRC | 10:41 | |
| *** hashar has quit IRC | 10:44 | |
| *** adam_g has quit IRC | 10:48 | |
| *** adam_g has joined #openstack-infra | 10:49 | |
| *** bogdando has joined #openstack-infra | 10:52 | |
| bogdando | hello folks. I have a 'broken patch' that fails CI in a very strange way (a zuul cloner conflict) https://review.openstack.org/#/c/450792/ could you please help to resolve? | 10:52 |
| bogdando | or shall I just abandon and resubmit? | 10:53 |
| *** alexchad_ has quit IRC | 10:53 | |
| AJaeger | bogdando: where do you see "zuul cloner conflict"? | 10:53 |
| *** dizquierdo has joined #openstack-infra | 10:53 | |
| bogdando | AJaeger: http://logs.openstack.org/92/450792/24/experimental/gate-tripleo-quickstart-extras-base-centos-7-nv/4e9953c/console.html#_2017-05-22_10_39_55_083249 | 10:53 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Collapse shade legacy and neutron jobs https://review.openstack.org/466489 | 10:53 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Collapse shade ansible job definitions https://review.openstack.org/466488 | 10:53 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Collapse shade legacy and non-legacy jobs https://review.openstack.org/466490 | 10:53 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add python3 functional tests to shade https://review.openstack.org/466319 | 10:53 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Migrate shade tests to local_conf https://review.openstack.org/466487 | 10:53 |
| *** gongysh has quit IRC | 10:54 | |
| AJaeger | bogdando: argh ;( The set up for that job is broken in project-config | 10:54 |
| bogdando | AJaeger: oh my | 10:54 |
| mordred | AJaeger: I hopefully have that stack correct this time - thanks for the builder suggestion! | 10:54 |
| *** panda|off has joined #openstack-infra | 10:55 | |
| AJaeger | bogdando: can't help much further... | 10:56 |
| *** jkilpatr has joined #openstack-infra | 10:57 | |
| panda|off | AJaeger: so the clone map must specify a different dest for different projects ? | 10:57 |
| bogdando | AJaeger: thank you, that's enough for me | 10:57 |
| *** lucasagomes is now known as lucas-hungry | 10:57 | |
| *** bogdando has left #openstack-infra | 10:58 | |
| *** yolkfull has quit IRC | 10:58 | |
| *** numans has joined #openstack-infra | 10:59 | |
| AJaeger | panda|off: yes, it has to | 11:01 |
| *** sree has quit IRC | 11:01 | |
| *** sree has joined #openstack-infra | 11:02 | |
| panda|off | AJaeger: I think with that clonemap zuul should create two different directories, if I read the documentation correctly. Maybe I'm focusing on the wrong spot. | 11:03 |
| *** tuanluong has quit IRC | 11:04 | |
| *** hrubi has joined #openstack-infra | 11:05 | |
| panda|off | hmm , that should be the right builder "tripleo-quickstart-and-extras-checkout" in tripleo.yaml | 11:05 |
| panda|off | "By default, Zuul cloner will clone the project under basepath which would create sub directories whenever a project name contains slashes" | 11:06 |
| *** sree has quit IRC | 11:06 | |
| *** panda|off is now known as panda | 11:07 | |
| *** sree has joined #openstack-infra | 11:08 | |
| *** rossella_s has quit IRC | 11:09 | |
| *** ccamacho is now known as ccamacho|lunch | 11:10 | |
| AJaeger | panda: you add a clone-map, so it's not "by default" anymore | 11:12 |
| *** sree has quit IRC | 11:13 | |
| AJaeger | panda: check other clonemap usage in jenkins/jobs | 11:13 |
| AJaeger | panda: sorry, no time for further help now... | 11:13 |
| panda | AJaeger: oh, I get it now, thanks for the time. | 11:13 |
| *** thiagolib_ has joined #openstack-infra | 11:14 | |
| *** hrubi has quit IRC | 11:15 | |
| *** thorst_afk has joined #openstack-infra | 11:18 | |
| *** gcb has quit IRC | 11:19 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/project-config master: tripleo: fix clone destinations for quickstart projects https://review.openstack.org/466686 | 11:20 |
| AJaeger | mordred: LGTM now | 11:21 |
| AJaeger | panda: please double check that the pathes are now correct for all jobs. | 11:23 |
| *** rossella_s has joined #openstack-infra | 11:23 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/devstack-gate master: Delete HPCloud instructions https://review.openstack.org/466689 | 11:24 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/devstack-gate master: Update README for DIB-based images https://review.openstack.org/466690 | 11:24 |
| *** lennyb_ has quit IRC | 11:24 | |
| *** lennyb has quit IRC | 11:24 | |
| *** lennyb has joined #openstack-infra | 11:25 | |
| *** shardy has quit IRC | 11:27 | |
| *** lennyb has quit IRC | 11:27 | |
| *** lennyb has joined #openstack-infra | 11:28 | |
| *** lennyb_ has joined #openstack-infra | 11:29 | |
| *** lennyb has quit IRC | 11:29 | |
| *** lennyb_ has quit IRC | 11:29 | |
| *** lennyb has joined #openstack-infra | 11:30 | |
| *** dave-mccowan has joined #openstack-infra | 11:30 | |
| openstackgerrit | Lingxian Kong proposed openstack-infra/project-config master: Create python-qinlingclient project config https://review.openstack.org/466557 | 11:31 |
| *** nmathew has quit IRC | 11:34 | |
| *** zul has joined #openstack-infra | 11:36 | |
| *** danpawlik has joined #openstack-infra | 11:39 | |
| *** askb has quit IRC | 11:44 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Start at networkx for digraph implementation https://review.openstack.org/466592 | 11:49 |
| openstackgerrit | dongwenjuan proposed openstack-infra/puppet-diskimage_builder master: change 'vhd-util' package name to 'blktap-utils' https://review.openstack.org/466701 | 11:50 |
| mordred | cmurphy: oh my. you have just nerd-sniped me intoa dark hole | 11:51 |
| cmurphy | mordred: fabulous | 11:52 |
| openstackgerrit | Monty Taylor proposed openstack-infra/devstack-gate master: Stop suggesting people use the nova command line client https://review.openstack.org/466702 | 11:55 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Allow loading logging config from yaml https://review.openstack.org/445656 | 11:56 |
| cmurphy | mordred: aha, i was looking for --poll in the osc help and gave up | 11:56 |
| *** rhallisey has joined #openstack-infra | 11:58 | |
| *** ldnunes has joined #openstack-infra | 11:58 | |
| mordred | cmurphy: :) | 12:02 |
| Shrews | mordred: left a comment on 466702 | 12:03 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/project-config master: tripleo: remove experimental quickstart jobs https://review.openstack.org/466686 | 12:03 |
| *** dprince has joined #openstack-infra | 12:04 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack-infra/tripleo-ci master: DO NOT MERGE testing 450792 https://review.openstack.org/466322 | 12:05 |
| openstackgerrit | dongwenjuan proposed openstack-infra/nodepool master: 'print' is a function in python3 https://review.openstack.org/466706 | 12:06 |
| *** lucas-hungry is now known as lucasagomes | 12:07 | |
| mordred | Shrews: thanks! | 12:10 |
| openstackgerrit | Monty Taylor proposed openstack-infra/devstack-gate master: Stop suggesting people use the nova command line client https://review.openstack.org/466702 | 12:10 |
| *** pradk has joined #openstack-infra | 12:15 | |
| *** rossella_ has joined #openstack-infra | 12:15 | |
| *** rossella_s has quit IRC | 12:15 | |
| odyssey4me | we're getting quite a few apt-get update fails across multiple jobs - any known issues about? | 12:16 |
| *** rfolco has joined #openstack-infra | 12:16 | |
| *** jaypipes has joined #openstack-infra | 12:18 | |
| *** Hal has joined #openstack-infra | 12:20 | |
| *** rossella_ has quit IRC | 12:23 | |
| *** ccamacho|lunch is now known as ccamacho | 12:24 | |
| *** chlong has joined #openstack-infra | 12:29 | |
| *** rossella_ has joined #openstack-infra | 12:33 | |
| *** jpena is now known as jpena|lunch | 12:34 | |
| *** mdrabe has joined #openstack-infra | 12:35 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Read all Gerrit events from poll interruption https://review.openstack.org/466453 | 12:36 |
| *** rlandy has joined #openstack-infra | 12:36 | |
| Shrews | infra-root: fyi, looks like nodepool is having issues communicating with chocolate this morning | 12:40 |
| *** yamahata has quit IRC | 12:40 | |
| *** funzo has joined #openstack-infra | 12:42 | |
| mordred | Shrews: uhoh | 12:48 |
| mordred | Shrews: I can't ping that host at all | 12:49 |
| mordred | Shrews: I also cannot ping the chocolate controller from baremetal00 - or any of the other chocolate hosts | 12:52 |
| *** chlong has quit IRC | 12:55 | |
| *** kgiusti has joined #openstack-infra | 12:57 | |
| *** adarazs is now known as adarazs_brb | 12:59 | |
| Shrews | mordred: yep. vanilla seems fine. not sure how to debug further | 13:01 |
| *** ihrachys has joined #openstack-infra | 13:01 | |
| *** esberglu has joined #openstack-infra | 13:01 | |
| *** jheroux has joined #openstack-infra | 13:01 | |
| *** salv-orlando has joined #openstack-infra | 13:01 | |
| *** esberglu has quit IRC | 13:03 | |
| *** lamt has joined #openstack-infra | 13:04 | |
| *** esberglu has joined #openstack-infra | 13:05 | |
| *** zul has quit IRC | 13:05 | |
| *** esberglu_ has joined #openstack-infra | 13:06 | |
| *** salv-orlando has quit IRC | 13:07 | |
| *** salv-orlando has joined #openstack-infra | 13:07 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: quickstart transition: add promotion logic https://review.openstack.org/445467 | 13:08 |
| *** zul has joined #openstack-infra | 13:08 | |
| *** esberglu has quit IRC | 13:09 | |
| *** jamesmca_ has joined #openstack-infra | 13:10 | |
| *** rcarrillocruz has quit IRC | 13:11 | |
| *** kashyap has left #openstack-infra | 13:11 | |
| *** mriedem has joined #openstack-infra | 13:14 | |
| openstackgerrit | Alex Schultz proposed openstack-infra/project-config master: Revert "Revert "Revert "puppet: disable voting on ubuntu/integration jobs""" https://review.openstack.org/466726 | 13:16 |
| *** vikrant has quit IRC | 13:17 | |
| *** salv-orlando has quit IRC | 13:21 | |
| cmurphy | I was added as a reviewer on https://review.openstack.org/#/c/466701/ and I'm realizing I don't have the background on why we're installing vhd-util from a ppa rather than standard ubuntu repos, mordred or pabelanger can you explain? | 13:22 |
| *** thiagolib_ has quit IRC | 13:22 | |
| *** markvoelker has joined #openstack-infra | 13:22 | |
| *** gardlt has joined #openstack-infra | 13:23 | |
| *** trown is now known as trown|brb | 13:23 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: quickstart transition: add promotion logic https://review.openstack.org/445467 | 13:27 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: Ensure build.start_time is defined onBuildCompleted https://review.openstack.org/466732 | 13:27 |
| *** xyang1 has joined #openstack-infra | 13:27 | |
| *** gcb has joined #openstack-infra | 13:28 | |
| *** jpena|lunch is now known as jpena | 13:31 | |
| mordred | cmurphy: because it doesn't exist in standard ubuntu repos :( | 13:33 |
| mordred | cmurphy: the tl;dr is - qemu-img can't create vhd files that xenserver can boot | 13:33 |
| *** adarazs_brb is now known as adarazs | 13:33 | |
| mordred | cmurphy: so we have a patched version of vhd-util extracted from the xen source that we build in a PPA | 13:33 |
| *** prateek has quit IRC | 13:34 | |
| mordred | cmurphy: I'm not sure if we've tested vhd-util from blktap-utils ... I'd love it if that works | 13:34 |
| *** baoli has joined #openstack-infra | 13:34 | |
| mordred | cmurphy: we also have a patch prepared that needs to be tested for qemu-img itself that may also fix the issue | 13:35 |
| *** jamesmca_ has quit IRC | 13:35 | |
| *** markvoelker has quit IRC | 13:35 | |
| *** reduxio has joined #openstack-infra | 13:35 | |
| reduxio | Hello, I've upgraded my CI environment and devstack that support it, and now I fail to create new nodes. I think that provisioning fails since the local nova free disk space is insufficient, although the allocation is supposed to come from external san storage. I have a feeling it is somehow related to the new Nova cell feature. Any ideas? | 13:35 |
| cmurphy | mordred: that's what i was wondering, it seems like it's been provided by the blktap-utils package for a while | 13:35 |
| *** markvoelker has joined #openstack-infra | 13:35 | |
| mordred | cmurphy: yah - so ... I _think_ the one in blktap-utils is also not going to work | 13:36 |
| mordred | because to work withxenserver it needs the patch we apply in our vhd-util package | 13:36 |
| mordred | (the patch is a terrible patch, which is why it's not applied in the ubuntu repos - but it's better than the alternative for us so far, which would be running our own xenserver installation just to be able to make images) | 13:36 |
| *** trown|brb is now known as trown | 13:37 | |
| mordred | I've got a todo list item open to figure out if the qemu-img patch will work. if it does, we'll submit it upstream and then try to convince jamespage to apply it to the ubuntu packages | 13:37 |
| mordred | maybe I should add all that to the review | 13:37 |
| cmurphy | mordred: thanks :) | 13:38 |
| mordred | OH! the problem here is probably that the person is running on xenial or zesty ... and we don't have a package built for vhd-util for those distros yet | 13:38 |
| cmurphy | mordred: right | 13:39 |
| mordred | the problem THERE is that xenial has a newer GCC which produces more warnings | 13:39 |
| *** esikachev has quit IRC | 13:39 | |
| mordred | so rebuilding fails | 13:39 |
| *** esikache1 has joined #openstack-infra | 13:39 | |
| mordred | and I haven't fixed that yet :) | 13:39 |
| cmurphy | mordred: it looks like you uploaded a xenial version in april https://launchpad.net/~openstack-ci-core/+archive/ubuntu/vhd-util | 13:39 |
| cmurphy | mordred: i think they're looking for zesty based on the man page link | 13:40 |
| *** dimtruck is now known as zz_dimtruck | 13:40 | |
| *** zz_dimtruck is now known as dimtruck | 13:40 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Add Dockerfile https://review.openstack.org/465912 | 13:40 |
| *** esikache1 has quit IRC | 13:43 | |
| *** felipemonteiro has joined #openstack-infra | 13:49 | |
| *** dimtruck is now known as zz_dimtruck | 13:49 | |
| *** felipemonteiro_ has joined #openstack-infra | 13:51 | |
| *** rossella__ has joined #openstack-infra | 13:54 | |
| mordred | cmurphy: yes - I did - but it failed to build due to the new gcc stuff | 13:54 |
| mordred | cmurphy: I just put a novel into the review | 13:54 |
| *** felipemonteiro has quit IRC | 13:54 | |
| *** rossella_ has quit IRC | 13:55 | |
| cmurphy | mordred: thank you | 13:55 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: remove karbor team direct tagging ACLs https://review.openstack.org/466736 | 13:56 |
| *** links has quit IRC | 13:57 | |
| *** jamesmca_ has joined #openstack-infra | 13:57 | |
| mordred | cmurphy: I'm going to make a storyboard story and put the different tasks in it | 13:58 |
| *** mmedvede has quit IRC | 13:58 | |
| mordred | eww. now the real question - on what repo do I make it ... I'm going to just do nodepool for now | 13:58 |
| *** mmedvede has joined #openstack-infra | 14:01 | |
| *** hashar has joined #openstack-infra | 14:01 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/infra-manual master: clarify the expected policy for managing releases https://review.openstack.org/466739 | 14:01 |
| *** sree has joined #openstack-infra | 14:02 | |
| *** salv-orlando has joined #openstack-infra | 14:03 | |
| *** rossella__ has quit IRC | 14:03 | |
| *** rossella__ has joined #openstack-infra | 14:04 | |
| *** sree has quit IRC | 14:06 | |
| *** salv-orlando has quit IRC | 14:08 | |
| *** rbrndt has joined #openstack-infra | 14:08 | |
| *** rossella__ has quit IRC | 14:09 | |
| *** zz_dimtruck is now known as dimtruck | 14:09 | |
| *** eharney has joined #openstack-infra | 14:14 | |
| *** reduxio has quit IRC | 14:16 | |
| *** e0ne has joined #openstack-infra | 14:16 | |
| *** rossella__ has joined #openstack-infra | 14:17 | |
| _ari_ | hashar: any chance you could review https://review.openstack.org/#/c/463905/ | 14:18 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/infra-manual master: clarify the expected policy for managing releases https://review.openstack.org/466739 | 14:20 |
| hashar | _ari_: in between flights sorry ;( | 14:25 |
| *** hashar has quit IRC | 14:25 | |
| _ari_ | electrofelix: any chance you can review https://review.openstack.org/#/c/463905/ | 14:28 |
| *** hongbin has joined #openstack-infra | 14:28 | |
| *** markvoelker_ has joined #openstack-infra | 14:29 | |
| *** EricGonczer_ has joined #openstack-infra | 14:32 | |
| *** markvoelker has quit IRC | 14:33 | |
| dhellmann | we had a release failure for puppet-nova earlier today with the error "puppet: command not found" http://logs.openstack.org/89/89c58e7958b448364cb0290c1879116f49749a68/release/puppet-nova-tarball/fe9daf7/console.html | 14:33 |
| dhellmann | is that likely to be a bindep issue of some sort? | 14:33 |
| dhellmann | it was from the newton branch, if that makes any difference in the node type used | 14:34 |
| *** david-lyle has quit IRC | 14:34 | |
| *** panda is now known as panda|brb | 14:34 | |
| *** david-lyle has joined #openstack-infra | 14:35 | |
| AJaeger | dhellmann: we have no more puppet by default on our images. So, this needs to be added back somehow. | 14:35 |
| AJaeger | pabelanger: any ideas? ^ | 14:35 |
| *** esikache1 has joined #openstack-infra | 14:36 | |
| dhellmann | maybe whatever owns run-tarball.sh should do that installation, since it seems to be the thing invoking puppet? | 14:36 |
| dhellmann | is that the job definition in project-config? or would it be a node type definition in system-config? | 14:37 |
| *** psachin has quit IRC | 14:38 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Use all available citycloud quota in happy regions https://review.openstack.org/466548 | 14:39 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Reduce citycloud-la1 to max servers 0 https://review.openstack.org/466752 | 14:39 |
| clarkb | infra-root ^ should be ready to go | 14:39 |
| *** armax has joined #openstack-infra | 14:41 | |
| *** EricGonczer_ has quit IRC | 14:44 | |
| *** mat128 has joined #openstack-infra | 14:44 | |
| electrofelix | _ari_: have you considered placing a common function into helpers that both jms_messaging_builder and jms_messaging_notifer call? | 14:46 |
| electrofelix | zxiiro: added a question about naming to https://review.openstack.org/463905 that I think is more requiring answer from us than from _ari_ | 14:46 |
| *** panda|brb is now known as panda | 14:47 | |
| zxiiro | electrofelix: looking. | 14:48 |
| zxiiro | electrofelix: That reminds me. Any progress on JJB 2.0? I have quite a few people asking for it's release now. | 14:48 |
| zxiiro | This was kind of what I was worried about last year. JJB 2.0 work would put us in a limbo where we don't release in a very long time. | 14:49 |
| pabelanger | AJaeger: dhellmann yes, we need to sync bindep for puppet modules. Let me work on the proposal job today | 14:50 |
| pabelanger | otherwise it is a manual process | 14:50 |
| pabelanger | https://review.openstack.org/#/c/461970/ | 14:51 |
| *** yamahata has joined #openstack-infra | 14:51 | |
| *** mat128 has quit IRC | 14:51 | |
| *** david-lyle has quit IRC | 14:52 | |
| electrofelix | zxiiro: I was just thinking about what was needed there over the weekend ... | 14:52 |
| *** salv-orlando has joined #openstack-infra | 14:52 | |
| panda | pabelanger: https://review.openstack.org/466686 I see you created those jobs and those configuration. I don't think any on these is running correctly since Id12af31285e57bb6520453de84d874c7fd47943a | 14:52 |
| electrofelix | zxiiro: going to send that mail to the jenkins-devs I've promised for a while, and potentially we may want to consider altering the behaviour of any of the version specific code to default to assuming latest if it cannot get the version information and allow configuration to pin to earlier if it's available | 14:53 |
| pabelanger | panda: that is fine, I never found the time to work on quickstart | 14:54 |
| panda | pabelanger: ok thanks. | 14:55 |
| pabelanger | clarkb: fungi +3 | 14:55 |
| zxiiro | electrofelix: ok sounds good to me. Thanks | 14:55 |
| fungi | pabelanger: i think putting puppet package names in bindep.txt might be tricky for them since they run different tests with different puppet releases from different places. it may make more sense to have them stop using the same tarball job as python projects so that they can more easily encode puppet-specific logic | 14:55 |
| dhellmann | pabelanger : thanks, I just posted to -dev about this to try to pull some of the puppet folks in to helping, too | 14:55 |
| _ari_ | electrofelix: Are you saying they all should be jms_messaging instead of different names in each one for builder, publisher, and trigger | 14:55 |
| portdirect | sorry to pester - but if anyone if free to look at these reviews it would be awesome: https://review.openstack.org/#/c/466077, https://review.openstack.org/#/c/466287 | 14:56 |
| *** salv-orlando has quit IRC | 14:57 | |
| portdirect | would really like to get some proper testing in place on our repo :) | 14:57 |
| electrofelix | _ari_: that's what I'm wondering, since I think that has been used elsewhere in the code, but before suggesting you make any changes I wanted to see if it made sense to the other cores | 14:57 |
| *** d0ugal has quit IRC | 14:57 | |
| *** geekg_000 has joined #openstack-infra | 14:57 | |
| *** DangerousDaren has quit IRC | 14:58 | |
| _ari_ | electrofelix: ok I am going to make the other helper function changes you and zxiiro suggested and then perhaps this can be merged or do I need to wait from an answer on the other topic before that | 14:58 |
| electrofelix | I think if you hold on a little while zxiiro and myself should be able to hammer out an answer so you only need worry about making one more update before we merge ;) | 14:59 |
| clarkb | fungi: AJaeger portdirect re https://review.openstack.org/#/c/466287/2 we have in the past asked people to start with 2 node jobs first | 14:59 |
| pabelanger | fungi: They shouldn't need a specific version of puppet to build, by default they pinned to the version we included in images. Which makes me thing bindep should be fine in this case | 14:59 |
| clarkb | sort out networking issues etc | 14:59 |
| clarkb | then go up to 3 nodes if it helps them test something specific | 14:59 |
| _ari_ | electrofelix: sounds good thanks! | 14:59 |
| *** asselin has joined #openstack-infra | 14:59 | |
| *** andreas_s has quit IRC | 14:59 | |
| *** dizquierdo has quit IRC | 14:59 | |
| fungi | clarkb: as i read the change, the quorum determination requires three separate nodes (whether this is true i don't know, i took it as gospel) | 15:00 |
| clarkb | fungi: it will do a quorum of 1 | 15:00 |
| portdirect | clarkb: the issue for us is that we cannot viably use a two node gate for testing - as we need to have three nodes to build a quorum for ceph and miariadb | 15:01 |
| clarkb | whcih I think is a better place to start to sort out why multinode is so much weirder | 15:01 |
| clarkb | portdirect: 1 is a valid quorum to use as a stepping stone to sorting out general multinode issues | 15:01 |
| clarkb | portdirect: then once that is done, bump up to 3 | 15:01 |
| portdirect | we currently use the approach you are suggesting on a single node | 15:01 |
| clarkb | portdirect: yes, but single node doesn't expose any of the general multinode issues like networking and authentication among nodes etc | 15:02 |
| openstackgerrit | Merged openstack-infra/project-config master: Add new multinode gates to Kolla https://review.openstack.org/466415 | 15:02 |
| clarkb | basically there are a whole new suite of problems you will run into with mutlinode that are eaiser to sort out if you don't also conflate them with making a proper ceph cluster and mariadb cluster go | 15:02 |
| clarkb | solve them separately | 15:02 |
| AJaeger | clarkb, portdirect : I removed my vote for now. | 15:03 |
| portdirect | clarkb: we are running three node testing internally, but I'll update to make it two node if that is the preferred initial approach | 15:04 |
| portdirect | I take it that once we have that up and running it should be no problem to increase the node count? | 15:04 |
| fungi | pabelanger: right, they do their own uninstalling and reinstalling of puppet in other jobs, but they reuse a common tarballs job which isn't puppet specific and lacks that logic. they were obviously just using whatever version we preinstalled in their tarball jobs previously, but the point i was trying to make is that just sticking that in their bindep.txt file may seem misleading to them... they | 15:04 |
| fungi | probably need to take similar steps in their tarball jobs as they do in their other puppet-requiring jobs | 15:04 |
| clarkb | portdirect: yes, that would be my preference as we've seen just about everyone struggle with just 2 nodes keeping the clustering stuff simple | 15:04 |
| clarkb | portdirect: yup once 2 node is happy, no problem bumping it to 3 | 15:05 |
| portdirect | sweet - thanks clarkb :D | 15:05 |
| portdirect | and AJaeger/fungi too :) | 15:05 |
| *** dhajare has quit IRC | 15:05 | |
| *** d0ugal has joined #openstack-infra | 15:06 | |
| pabelanger | fungi: yes that works also, just means updating JJB with their puppet macro | 15:07 |
| pabelanger | but still feel bindep.txt works just fine in this case | 15:07 |
| pabelanger | since they are not testing puppet versions, just wanting a version of puppet to do puppet build | 15:07 |
| *** andreas_s has joined #openstack-infra | 15:08 | |
| fungi | might be that we should also ave a build/release-specific bindep profile name we can look for to make that clearer (like we do "test" for other sorts of jobs) | 15:09 |
| *** armax has quit IRC | 15:10 | |
| openstackgerrit | Merged openstack-infra/project-config master: Reduce citycloud-la1 to max servers 0 https://review.openstack.org/466752 | 15:10 |
| fungi | pabelanger: but really we need their input to figure out what makes the most sense for them, so maybe the ml thread will help us iron that out | 15:10 |
| *** Julien-zte has joined #openstack-infra | 15:10 | |
| openstackgerrit | Merged openstack-infra/project-config master: Use all available citycloud quota in happy regions https://review.openstack.org/466548 | 15:10 |
| openstackgerrit | Merged openstack-infra/project-config master: Add Fedora gate for OpenStack-Helm project https://review.openstack.org/466077 | 15:10 |
| *** rossella__ has quit IRC | 15:13 | |
| *** rderose has joined #openstack-infra | 15:22 | |
| *** jpich has quit IRC | 15:22 | |
| *** yamahata has quit IRC | 15:22 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Python3: Use exec for self._activate_virtualenv() https://review.openstack.org/466070 | 15:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Wrap map() in list() for python3 https://review.openstack.org/466069 | 15:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Python3: RuntimeError: dictionary changed size during iteration https://review.openstack.org/466049 | 15:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Python3: encode / decode data as utf8 https://review.openstack.org/466065 | 15:24 |
| *** vhosakot has joined #openstack-infra | 15:24 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: Create workspace variable for tox based roles https://review.openstack.org/466376 | 15:26 |
| clarkb | pabelanger: re the code around https://review.openstack.org/#/c/466070/3/nodepool/builder.py I want to say that is no longer necessary in dib 2.0 (but should be tested) | 15:27 |
| clarkb | pabelanger: possibly we can just bump the min requirement and delete all that code? | 15:27 |
| pabelanger | clarkb: yes, I would like to also. Will confirm with ianw ^ | 15:28 |
| *** ccamacho is now known as ccamacho|brb | 15:29 | |
| pabelanger | fungi: clarkb: also, what do we want to do about infracloud chocolate, networking looks to be down. Do either of you have a contact for network operations for HPE? | 15:30 |
| clarkb | I don't | 15:30 |
| fungi | pabelanger: nope. i assume asselin is gone now and he was our last openstack contributor contact on the inside | 15:30 |
| clarkb | wendar might though? | 15:31 |
| pabelanger | have we made progress about moving the hardware out of HPE too? | 15:31 |
| clarkb | pabelanger: how down is it? do we have access to the hosts via ssh? | 15:31 |
| pabelanger | clarkb: oh, maybe it is just the controller that is dead | 15:32 |
| fungi | i have an e-mail address for a "kevin coker" on the effort to assess relocating the gear out of hpe | 15:32 |
| pabelanger | I just got access to a compute node in chocolate | 15:32 |
| fungi | but i think he's a data center manager or something | 15:32 |
| pabelanger | let me see if I can reboot the controller | 15:32 |
| *** sree has joined #openstack-infra | 15:33 | |
| *** dizquierdo has joined #openstack-infra | 15:33 | |
| *** markvoelker_ has quit IRC | 15:35 | |
| *** cody-somerville has joined #openstack-infra | 15:35 | |
| *** nicolasbock has joined #openstack-infra | 15:36 | |
| *** csomerville has joined #openstack-infra | 15:36 | |
| *** salv-orlando has joined #openstack-infra | 15:36 | |
| clarkb | let me know if I can help as I recently had to poke around in that env when updating baremetal00s kernel | 15:36 |
| clarkb | but first breakfast | 15:36 |
| *** nicolasbock has quit IRC | 15:36 | |
| *** nicolasbock has joined #openstack-infra | 15:37 | |
| purp | fungi pabelanger: Yes, Kevin Coker leads a DC ops team. | 15:38 |
| *** dizquierdo has quit IRC | 15:38 | |
| *** sree has quit IRC | 15:38 | |
| *** dangers_away is now known as dangers | 15:38 | |
| purp | He’s also a good contact if there are problems with the gear still at HPE until it’s no longer at HPE. | 15:38 |
| fungi | purp: thanks for confirming! | 15:38 |
| pabelanger | clarkb: where is the lilo password stored these days? | 15:38 |
| *** sree has joined #openstack-infra | 15:39 | |
| *** chlong has joined #openstack-infra | 15:39 | |
| pabelanger | I am able to atleast ssh to lilo for the controller, so that is good news | 15:39 |
| purp | fungi: happy to help when I (infrequently ;) can. If we need someone to escalate this, ping and we’ll help out. | 15:39 |
| *** rossella__ has joined #openstack-infra | 15:39 | |
| *** cody-somerville has quit IRC | 15:39 | |
| fungi | purp: will do. hopefully pabelanger is able to resurrect the controller via ilo | 15:40 |
| pabelanger | clarkb: okay, found it | 15:42 |
| *** gyee has joined #openstack-infra | 15:42 | |
| *** SumitNaiksatam has quit IRC | 15:42 | |
| pabelanger | also, ilo :) | 15:43 |
| *** flepied has quit IRC | 15:43 | |
| *** sree has quit IRC | 15:43 | |
| pabelanger | compute000.chocolate.ic.openstack.org is still online | 15:44 |
| *** martinkopec has joined #openstack-infra | 15:45 | |
| *** martinkopec has quit IRC | 15:45 | |
| clarkb | pabelanger: so its up but no network access to service? | 15:48 |
| pabelanger | ya, dropping to single user mode now | 15:50 |
| *** andreas_s has quit IRC | 15:50 | |
| pabelanger | see what logs say | 15:50 |
| *** tushar__ has joined #openstack-infra | 15:50 | |
| tushar__ | Hi All | 15:51 |
| *** tphummel has joined #openstack-infra | 15:51 | |
| mordred | pabelanger, fungi, cmurphy: https://storyboard.openstack.org/#!/story/2001033 <-- I have made a story about VHD support with all of the information I know | 15:51 |
| tushar__ | I am facing issue in our CI environment, while creating the DIB image | 15:52 |
| mordred | I think too much of that task is currently sitting in "at some point either mordred or pabelanger will get around to testing a random patch ot a thing" | 15:52 |
| mordred | greghaynes: fwiw - there are a couple of tasks in that which will wind up driving patches in dib - but for now it's just all there so it's easy to track - I don't think any of the dib patches themselves will be terrible hard/contentious | 15:53 |
| tushar__ | you can find the error logs at - https://pastebin.com/1wmKycW2 | 15:54 |
| pabelanger | clarkb: were you able to log into the shell via textcons? | 15:54 |
| clarkb | pabelanger: one of the two options worked, I forget which one. But I didn't have a login so it only worked for catching grub and telling it to boot old kernel | 15:54 |
| pabelanger | Hmm, glean had an exception | 15:55 |
| pabelanger | I think we use it to create the bridges right? | 15:55 |
| clarkb | I don't think glean knows how to set up bridges | 15:55 |
| *** ykarel has quit IRC | 15:55 | |
| pabelanger | clarkb: I can get a linux prompt, but unsure which credentials to use | 15:55 |
| clarkb | I want to say its some other init script that comes through after glean and addes the extra bridge stuff | 15:56 |
| clarkb | pabelanger: ya that was my problem | 15:56 |
| pabelanger | cmurphy: ^ do you happen to know | 15:56 |
| clarkb | tushar__: looks like it is trying to make an https conncetion to /simple/bindep? | 15:57 |
| clarkb | tushar__: double check your pip config? | 15:57 |
| tushar__ | actually there is no pip.conf in my system | 15:58 |
| tushar__ | clarkb : should I create one ? | 15:58 |
| pabelanger | DIB_DEV_USER_USERNAME: "baremetal" | 15:59 |
| pabelanger | I see that in puppet-infracloud | 15:59 |
| *** pcaruana has quit IRC | 15:59 | |
| clarkb | tushar__: no the defaults should work, maybe that is pip's way of saying it tried to talk to pypi.python.org? | 16:00 |
| *** e0ne has quit IRC | 16:00 | |
| clarkb | tushar__: what I would try to do is manually reproduce those steps, make a virtualenv, then pip install bindep to it and see what happens | 16:00 |
| clarkb | pabelanger: oh neat, I don't know where the password is | 16:01 |
| clarkb | pabelanger: maybe its the ilo password? | 16:01 |
| fungi | pabelanger: checked our encrypted passwords list? | 16:01 |
| tushar__ | clarkb : okay | 16:01 |
| pabelanger | fungi: clarkb: looks like we need to set dib_dev_user_password | 16:02 |
| pabelanger | in puppet, but I do not see that | 16:02 |
| *** david-lyle has joined #openstack-infra | 16:03 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: merger/executor: configure source connections only. https://review.openstack.org/466506 | 16:04 |
| cmurphy | the devuser element copies an ssh key by default, so we might not have set a password | 16:04 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Create priority order for configuration files https://review.openstack.org/465632 | 16:05 |
| *** matrohon has quit IRC | 16:06 | |
| *** SumitNaiksatam has joined #openstack-infra | 16:07 | |
| pabelanger | controller00.vanilla.ic.openstack.org does have a password hash | 16:08 |
| pabelanger | maybe leftover from debugging? | 16:08 |
| *** hongbin has quit IRC | 16:08 | |
| *** rderose has quit IRC | 16:10 | |
| pabelanger | clarkb: okay, will process with single user mode. Any pointers on getting to grub with ilo | 16:11 |
| *** dizquierdo has joined #openstack-infra | 16:12 | |
| electrofelix | zxiiro: did you look at the question I raised about naming of jms_messaging_notify/jms_messaging_builder/jms_messaging? | 16:12 |
| openstackgerrit | Eric Harney proposed openstack-infra/project-config master: Cinder: move bdd test to experimental https://review.openstack.org/466804 | 16:12 |
| clarkb | pabelanger: ya, I hit the reboot command via ilo, then opened up the console thing using the example command in help docs for ilo, then waited | 16:13 |
| clarkb | pabelanger: unfortunately its like watching paint dry and you only get like 10 seconds in that 10 minute reboot to catch it | 16:13 |
| *** florianf has quit IRC | 16:14 | |
| pabelanger | clarkb: our docs or some others? | 16:14 |
| zxiiro | electrofelix: just looked. I think it should consistently have the same name everywhere. | 16:14 |
| clarkb | pabelanger: the ilo docs itself | 16:14 |
| clarkb | eg help foo | 16:14 |
| pabelanger | k | 16:14 |
| zxiiro | electrofelix: my understadning is that refers to the plugin name | 16:14 |
| clarkb | it gives an example command for getting a console where you specify width and refresh rate and stuff | 16:14 |
| *** mikal has quit IRC | 16:14 | |
| *** rcernin has quit IRC | 16:14 | |
| *** mikal has joined #openstack-infra | 16:16 | |
| *** Apoorva has joined #openstack-infra | 16:19 | |
| electrofelix | zxiiro: ok, that was my thought too, but I wasn't sure we had actually done that everywhere | 16:22 |
| clarkb | jeblair: Shrews pabelanger looking at http://grafana.openstack.org/dashboard/db/nodepool-city-cloud sto2 is used significantly more than kna1 and lon1 (la1 is "off" so can be ignored) any idea why that is? | 16:23 |
| clarkb | jeblair: Shrews pabelanger all three have the same max-servers value (50) and should be applied to all of the same nodepool labels | 16:23 |
| *** SumitNaiksatam has quit IRC | 16:24 | |
| pabelanger | this would be much easier if we enable serial console for infracloud :) | 16:25 |
| *** mpaolino has quit IRC | 16:25 | |
| dims | clarkb : can you please create a directory and drop some files on tarballs.o.o? http://paste.openstack.org/show/610251/ | 16:28 |
| *** hrubi has joined #openstack-infra | 16:29 | |
| *** neiljerram has quit IRC | 16:30 | |
| *** rcernin has joined #openstack-infra | 16:31 | |
| pabelanger | oh, serial port does work | 16:31 |
| pabelanger | yay | 16:31 |
| *** ltomasbo is now known as ltomasbo|away | 16:32 | |
| clarkb | pabelanger: nice, I think baremetal00 is on the oldest image so possibly doesn't have bug fixes like that | 16:34 |
| clarkb | dims: why do we need both versions? | 16:34 |
| clarkb | dims: also are we goibgn to be verify thing the signature with the asc file? if so cool | 16:35 |
| *** lucasagomes is now known as lucas-afk | 16:35 | |
| clarkb | infra-root I'm going to do what dims asks unless there is reason not to. etcd is apache2 licensed so we should be fine to redistribute it this way | 16:35 |
| dims | clarkb : 3.1.7 for now, 3.1.8 once i test it properly. we can live with just 3.1.7 if that's the only one we want to pick | 16:35 |
| fungi | dims: what's the plan for automating that? we've generally avoided hand-installing files onto tarballs.o.o for anything other than a very temporary workaround | 16:36 |
| dims | clarkb : yes, i do verify using asc | 16:36 |
| dims | fungi : i'll get things working and then add a periodic job to upload newer releases | 16:36 |
| dims | yep temporary workaround | 16:36 |
| fungi | perfect--thanks! | 16:36 |
| fungi | sounds fine to me for now | 16:37 |
| dims | thanks fungi clarkb ! | 16:37 |
| *** trown is now known as trown|lunch | 16:37 | |
| jeblair | clarkb: how important is it that we answer that question about the nodepool allocator? :) | 16:38 |
| pabelanger | clarkb: okay, going to need a little help. I cannot figure out how to get to grub :( | 16:38 |
| clarkb | jeblair: its not super important, its just unexpected behavior | 16:39 |
| *** neiljerram has joined #openstack-infra | 16:39 | |
| pabelanger | I do see: text is deprecated. Use set gfxpayload=vga=normal before linux command instead. | 16:39 |
| clarkb | pabelanger: when you reboot, the console should show you grub for a short perido of time in the ~10 minutes of boot | 16:39 |
| jeblair | clarkb: i don't see anything obvious; i get the feeling that it might take the better part of a day to dig into the allocator algorithm and figure it out. | 16:39 |
| clarkb | pabelanger: you then have to hit a key to stop grubs timeout which then lets you select different kernel or whatever | 16:39 |
| *** flepied has joined #openstack-infra | 16:40 | |
| *** salv-orlando has quit IRC | 16:40 | |
| clarkb | dims: one last question should we host at tarballs/etcd instead of tarballs/etcd3? | 16:40 |
| clarkb | dims: version specific dir seems funny | 16:40 |
| dims | clarkb : yep, sounds good | 16:40 |
| clarkb | dims: ok alldone | 16:43 |
| pabelanger | clarkb: okay, holding shift for 10mins seems to be the trick | 16:43 |
| dims | clarkb : w00t! | 16:44 |
| clarkb | jeblair: I'm wondering if this is a list ordering thing in the config. sto2 is last provider in the list maybe that means it wins more | 16:44 |
| *** markus_z has quit IRC | 16:45 | |
| *** jaosorior is now known as jaosorior_away | 16:45 | |
| *** Julien-zte has quit IRC | 16:45 | |
| *** armax has joined #openstack-infra | 16:46 | |
| *** pbourke has quit IRC | 16:46 | |
| pabelanger | clarkb: jeblair: I have notice that rax-iad often wins for rackspace things also | 16:46 |
| *** calebb has quit IRC | 16:46 | |
| *** geekg_000 has quit IRC | 16:47 | |
| *** jpena is now known as jpena|off | 16:47 | |
| *** geekg_000 has joined #openstack-infra | 16:48 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Temporarily(?) add some debug statements around git repo creation https://review.openstack.org/466810 | 16:49 |
| jeblair | clarkb: possibly, some of the provider algorithm is based on "go through each provider and increase the probability we will use the next". though i think dictionary keys may be involved... | 16:52 |
| pabelanger | Starting create bridge for infra cloud [fail] | 16:52 |
| clarkb | an unrelated fun issue appears to be that we can't always talk to subnodes over private addrs | 16:52 |
| clarkb | some private addrs work and others don't :/ | 16:53 |
| clarkb | possibly because neutron api and dhcp don't agree on what the assigned ip addr should be | 16:54 |
| clarkb | interesting | 16:54 |
| mordred | clarkb: that sounds like a thing we should maybe be able to annotate - sort of like "has_network: False" on rackspace and the external_network tags on internap | 16:54 |
| mordred | clarkb: Imean -it sounds like a thing that should work - but if it doesn't and doesn't work reasonably consistently on a cloud, we should be able to note it somewhere and knkow to avoid | 16:55 |
| clarkb | mordred: ? | 16:55 |
| clarkb | oh | 16:55 |
| jeblair | clarkb: i don't fully understand what you mean -- can you add more context? | 16:56 |
| mordred | clarkb: is it just some addresses? or is it "on this cloud we have private addresses but we can't actually use them" | 16:56 |
| clarkb | jeblair: nodepool says the subnode private ip addresses are 10.0.1.117 and 10.0.1.118 | 16:57 |
| clarkb | jeblair: if you ssh to the subnode public ip addresses the actual private ip addresses are 10.0.1.118 and 10.0.1.119 | 16:57 |
| *** ralonsoh has quit IRC | 16:57 | |
| clarkb | mordred: I don't know yet, I'm just starting to debug why some of the jobs fail and others don't | 16:58 |
| mordred | kk | 16:58 |
| mordred | that seems fantastic | 16:58 |
| clarkb | also we don't have a command to list subnodes? | 16:58 |
| mordred | clarkb: can you check - out of curiosity - if the ip has been updated in openstack from what's in nodepool? | 16:58 |
| jeblair | wow... clarkb what cloud(s)? | 16:58 |
| mordred | clarkb: I'm curious if we're storing the info from boot time, then it updates in a way we could learn which is reflected in dhcp - but our cached version is out of date | 16:59 |
| *** chlong has quit IRC | 16:59 | |
| mordred | clarkb: if you can't easily check I can also investigate | 16:59 |
| *** derekh has quit IRC | 16:59 | |
| clarkb | jeblair: citycloud | 16:59 |
| jeblair | clarkb: doesn't look like it. mysql may be easiest. | 16:59 |
| *** dprince has quit IRC | 17:00 | |
| *** salv-orlando has joined #openstack-infra | 17:01 | |
| asselin | fungi, clarkb jeblair mordred pabelanger mtreinish sdague yolanda hey, just wanted to let you know that I've decided to move on to a new project outside of openstack. I've really enjoyed working with all of you, and greatly appreciated your support in getting 3rd party ci 'commonized'. It's been really awesome past few years, and I wish you all the best going forward! | 17:01 |
| mordred | asselin: sad to see you go - but all the best!!! it's been really fantastic working with you | 17:02 |
| asselin | thanks mordred :) | 17:02 |
| clarkb | mordred: | addresses | openstackzuul-network1=10.0.1.117, 10.0.1.119, 188.240.223.249 <- is what the api says | 17:02 |
| jeblair | asselin: likewise! though i'm sorry to see you go, i wish you well in what you do next. :) | 17:03 |
| yolanda | hi asselin , has been very nice to work with you. I wish you all the luck and success in your new projects | 17:03 |
| fungi | asselin: you did awesome work! hope you get to continue doing awesome work whatever you're doing next | 17:03 |
| *** Hal has quit IRC | 17:03 | |
| mordred | clarkb: that seems like one of them got updated and one didn't | 17:04 |
| *** dhinesh has joined #openstack-infra | 17:04 | |
| _ari_ | zxiiro: electrofelix I am going to convert the names for trigger, builders, and publishers and all examples to same name for JMS messaging and will submit a new review | 17:04 |
| *** hongbin has joined #openstack-infra | 17:04 | |
| asselin | jeblair, yolanda fungi thank you. I still have some open patches. If there's any rework you'd like to see, i'd be happy to take a look...otherwise I'll let other folks take them over, or can abandon (no hard feelings) | 17:05 |
| clarkb | mordred: also not enough info in the nodepool logs to determine if it got back both ip addrs or only the one | 17:05 |
| *** salv-orlando has quit IRC | 17:05 | |
| zxiiro | _ari_: ok. FYI I do get an email on every single patch submittion and comment. | 17:05 |
| jeblair | mordred, clarkb: why are there 2 private ip addresses? (one for internal networking, one as a backend for nat?) | 17:05 |
| clarkb | jeblair: there should only be one | 17:06 |
| _ari_ | zxiiro: ok sorry for the noise then | 17:06 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/devstack-gate master: Specify etcd download location for all CI jobs https://review.openstack.org/466817 | 17:06 |
| clarkb | I've held a 3-node group in sto2 will send emailto citycloud to see if thats something they are aware of | 17:07 |
| tushar__ | clarkb :I tried manually.... normal pip install is working fine but sudo -H pip install is failing . - https://pastebin.com/kDTBUQej | 17:07 |
| pabelanger | asselin: good luck in the future | 17:07 |
| clarkb | tushar__: are you behind a proxy | 17:07 |
| clarkb | tushar__: sudo will remove your proxy vars | 17:07 |
| tushar__ | YES | 17:07 |
| clarkb | tushar__: as will dib | 17:07 |
| asselin | thanks pabelanger | 17:07 |
| fungi | clarkb: wondering if nova is reporting multiple private addresses but only one is actually bound to the instance or something weird like that | 17:08 |
| tushar__ | clarkb where should I add the proxy..to fix this | 17:08 |
| clarkb | fungi: yes only one is configured by dhcp | 17:08 |
| electrofelix | _ari_: thanks, will watch and review ASAP, probably tomorrow as it's pretty late where i am now | 17:08 |
| tushar__ | so that it will work for sudo as well | 17:08 |
| zxiiro | _ari_: No worries, I'm not always review it right away since JJB is volunteer time for me (day job comes first). But I do eventually review every patch that comes into my inbox. If you don't here from me in a week then definitely ping me. | 17:08 |
| clarkb | tushar__: you can usually set it in your global login prefs | 17:08 |
| _ari_ | electrofelix: ok thanks I also made that helper function for the builders and publishers | 17:09 |
| fungi | clarkb: and so we're picking one at random from the metadata, which 50% of the time gives us an invalid address? | 17:09 |
| clarkb | fungi: ya I think so. | 17:09 |
| clarkb | fungi: except the other node only has one private addr so less than 50% in total | 17:09 |
| _ari_ | zxiiro: good to know and always much appreciated to you and electrofelix for donating your time and reviewing! | 17:09 |
| fungi | clarkb: aha, so some report only one private address and some multiple, even within the same region? | 17:10 |
| mordred | clarkb: we also don't have a great answer for clouds with more than one instance of a given type of address ... this may be a good example to study | 17:10 |
| clarkb | fungi: yes | 17:10 |
| clarkb | fungi: same l2 and l3 even | 17:10 |
| mordred | clarkb: so don't delete those before I can poke at them a bit too | 17:10 |
| fungi | wacky | 17:10 |
| clarkb | mordred: ya I intend on leaving them around so citycloud can pkke at them. Will ask them to not delete too | 17:10 |
| clarkb | mordred: d46ce7f4-8691-43f3-8bf3-cdd0b77ddb8a is the funny one | 17:11 |
| fungi | my money's on it being a misconfiguration in the provider | 17:11 |
| mtreinish | asselin: :( sorry to see you go. Good luck on the new project! | 17:11 |
| tushar__ | clarkb : I already set the proxy in /etc/environment | 17:11 |
| clarkb | tushar__: you likely need sudo --login then | 17:11 |
| clarkb | I bet asselin knows the anser to these proxy problems :P but sounds like asselin gets to do other shiny things now :) | 17:12 |
| clarkb | asselin: have fun | 17:12 |
| dims | clarkb : can you please create a couple of directories? v3.1.7 and v3.1.8 and drop the files there? will simplify things as both github downloads and storage.googleapis.com follow that pattern | 17:12 |
| clarkb | dims: oh yup, sorry thats in your paste too | 17:12 |
| dims | thanks clarkb :) | 17:12 |
| asselin | mtreinish, thanks | 17:12 |
| *** hongbin has quit IRC | 17:13 | |
| asselin | clarkb, what proxy issue? I'm still around for a bit to help out :) | 17:13 |
| *** marst_ has joined #openstack-infra | 17:13 | |
| clarkb | asselin: basically tushar is dibing and it fails because sudo related things clear out the env vars that set http proxy | 17:13 |
| *** esikache1 has quit IRC | 17:13 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-roles master: Add openstack-info role https://review.openstack.org/466330 | 17:13 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-roles master: Initial commit for docs https://review.openstack.org/466347 | 17:14 |
| clarkb | dims: is that better? | 17:14 |
| asselin | tushar__, try sudo -H -E .... | 17:14 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-roles master: Add upload-sphinx-draft role https://review.openstack.org/466352 | 17:14 |
| fungi | i thought there were specific proxy provisions in dib, but i may be misremembering (and i don't recall secifics) | 17:14 |
| fungi | specifics | 17:14 |
| *** dprince has joined #openstack-infra | 17:14 | |
| tushar__ | asselin : while DIB image creation I am facing issue - error log https://pastebin.com/1wmKycW2 | 17:14 |
| dims | perfect clarkb!, i've filed https://review.openstack.org/#/c/466817/ to inject the location to the jobs | 17:14 |
| dims | fungi : ^ | 17:14 |
| *** chlong has joined #openstack-infra | 17:15 | |
| dims | thanks jeblair | 17:15 |
| openstackgerrit | Ari proposed openstack-infra/jenkins-job-builder master: Add support for jms_messaging builder and publisher https://review.openstack.org/463905 | 17:15 |
| clarkb | fungi: mordred: re ip weirdness I wonder if 117 is offered first but is NACKed for some reason then 119 is offered and that works | 17:15 |
| *** chlong has quit IRC | 17:15 | |
| clarkb | fungi: mordred and neutron doesn't have any way to clean up the nack | 17:15 |
| fungi | clarkb: that would be really weird... it's just looking at the dnsmasq backend data right? | 17:16 |
| clarkb | fungi: no, neutron configures the mac addr -> ip mapping in dnsmasq then assumes it works I think | 17:16 |
| clarkb | kevinbenton: ^ you likely know better than I | 17:16 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-roles master: Switch to envlist list for roles https://review.openstack.org/466374 | 17:16 |
| fungi | aha | 17:16 |
| fungi | for some reason i thought it was the other way around | 17:17 |
| tushar__ | asselin : sudo -H -E worked for me manually ... but DIB image creation is a automated process and there it is scripted as - sudo -H /usr/bindep-env/bin/pip install bindep | 17:17 |
| fungi | still, if neutron is explicitly setting reservations for those macs, then i don't see how it would hand out anything different | 17:17 |
| *** jamesmca_ has quit IRC | 17:18 | |
| clarkb | fungi: its why there is talk about switching dhcp servers because dnsmasq requires a full restart everytime that is edited which is slow ehn you want to boot 100 instances at once | 17:18 |
| clarkb | fungi: thats a good point | 17:18 |
| *** jmccrory_away is now known as jmccrory | 17:18 | |
| asselin | tushar__, yeah..you'll need to update that script. This is in your project-config right, or is the script pulled down from somewhere? | 17:18 |
| *** jamesmca_ has joined #openstack-infra | 17:18 | |
| fungi | ideally dnsmasq would be configured with no dynamic pool at all under those conditions | 17:18 |
| clarkb | anyways going to send an email to citycloud with the info on that host and ask them if they know what is up. In the meantime I suppose we should remove citycloud from the multinode labsl | 17:19 |
| *** esikache1 has joined #openstack-infra | 17:19 | |
| fungi | that sounds like a safe move, agreed | 17:19 |
| asselin | tushar__, /tmp/in_target.d/install.d/40-install-bindep is the file that needs to be updated | 17:20 |
| asselin | tushar__, the other option is to add the proxy information in /etc/environment | 17:20 |
| fungi | https://docs.openstack.org/developer/diskimage-builder/developer/developing_elements.html makes some indication that dib has special handling for proxy configs (keyword search "proxy" there) | 17:21 |
| mordred | clarkb: oh - interesting | 17:21 |
| asselin | tushar__, there might also be some sudoers file configuration you can use to ensure the proxy env vars are kept, but I'm blanking out on those details ATM. | 17:21 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Remove citycloud from multinode labels https://review.openstack.org/466824 | 17:21 |
| clarkb | infra-root ^ can get quick review on that to avoid failing jobs | 17:22 |
| mordred | clarkb: nevermind. not interesting | 17:22 |
| fungi | like under cleanup.d it says, "temporary settings to use the image build environment HTTP proxy" | 17:22 |
| mordred | clarkb: but - fwiw: http://paste.openstack.org/show/610256/ | 17:22 |
| mordred | kevinbenton: ^^ | 17:22 |
| mordred | that's the server record and also the neutron view of the ports | 17:22 |
| mordred | the two different fixed ips have two different mac addrs | 17:23 |
| clarkb | mordred: link/ether fa:16:3e:e4:52:48 <- is the mac addr according to linux | 17:24 |
| clarkb | whcih matches up with the working ip | 17:24 |
| mordred | clarkb: so at some point something thought there was a different vif | 17:24 |
| mordred | and made an ip for it | 17:24 |
| mordred | well - two things here ... | 17:25 |
| *** vhosakot_ has joined #openstack-infra | 17:25 | |
| clarkb | two devices have the same id seems wrong from a pure data standpoint | 17:25 |
| tushar__ | clarkb : Its not in project config...from somwhere else it is pulling the script | 17:25 |
| mordred | we can be better about reporting the correct "private_ipv4" in shade just from this ... | 17:25 |
| tushar__ | clarkb : already added proxy in /etc/environment | 17:25 |
| mordred | clarkb: if we have 2 private addresses AND we have a floating ip, the private address associated with the floating ip is more likely the default one we want | 17:26 |
| clarkb | mordred: good idea | 17:26 |
| mordred | clarkb: I think that's a simple logic change to make - and it's certainly no _worse_ than right now | 17:26 |
| clarkb | mordred: ya it iwll be deterministic at least | 17:26 |
| clarkb | tushar__: yes you'll need to edit whatever script it is to add in support for env vars | 17:26 |
| *** vhosakot has quit IRC | 17:27 | |
| asselin | tushar__, https://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/infra-package-needs/install.d/40-install-bindep#n26 | 17:28 |
| *** mat128 has joined #openstack-infra | 17:29 | |
| tushar__ | asselin : yeah...thank you | 17:29 |
| tushar__ | will change this and try | 17:30 |
| *** esikache1 has quit IRC | 17:30 | |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-specs master: Add nodepool drivers spec https://review.openstack.org/461509 | 17:30 |
| openstackgerrit | Ari proposed openstack-infra/jenkins-job-builder master: Add support for jms_messaging builder and publisher https://review.openstack.org/463905 | 17:30 |
| *** tosky has quit IRC | 17:31 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove citycloud from multinode labels https://review.openstack.org/466824 | 17:37 |
| *** e0ne has joined #openstack-infra | 17:37 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: test tempest patch https://review.openstack.org/466830 | 17:41 |
| *** asselin has quit IRC | 17:42 | |
| *** Sukhdev has joined #openstack-infra | 17:43 | |
| *** yamahata has joined #openstack-infra | 17:49 | |
| *** geekg_000 has quit IRC | 17:52 | |
| pabelanger | clarkb: I am stepping away from chocolate controller for a bit | 17:54 |
| *** chlong has joined #openstack-infra | 17:55 | |
| *** rbrndt has quit IRC | 17:56 | |
| *** dhajare has joined #openstack-infra | 17:56 | |
| *** dizquierdo has quit IRC | 17:56 | |
| *** sambetts is now known as sambetts|afk | 17:59 | |
| *** jamesmca_ has quit IRC | 18:00 | |
| *** Sukhdev has quit IRC | 18:01 | |
| *** e0ne has quit IRC | 18:06 | |
| *** asselin has joined #openstack-infra | 18:06 | |
| *** geekg_000 has joined #openstack-infra | 18:08 | |
| *** esikache1 has joined #openstack-infra | 18:09 | |
| *** r-daneel has joined #openstack-infra | 18:09 | |
| *** ijw has quit IRC | 18:09 | |
| *** rcarrillocruz has joined #openstack-infra | 18:11 | |
| *** e0ne has joined #openstack-infra | 18:18 | |
| *** jamesmca_ has joined #openstack-infra | 18:19 | |
| *** trown|lunch is now known as trown | 18:21 | |
| *** jamesmca_ has quit IRC | 18:23 | |
| *** jamesmca_ has joined #openstack-infra | 18:24 | |
| *** gouthamr has joined #openstack-infra | 18:24 | |
| mtreinish | clarkb: if you wanted to take a look at the subunit worker today I've got a block of free time right now | 18:29 |
| *** tphummel has quit IRC | 18:29 | |
| clarkb | mtreinish: sorry I got distracted by the citycloud networking thing. Currently digging through shade. | 18:29 |
| clarkb | mordred: btw key_name = 'private' is completely indecipherable in shade :P | 18:30 |
| clarkb | mordred: doesn't look like that comes from the cloud? | 18:30 |
| *** dhajare has quit IRC | 18:30 | |
| mtreinish | clarkb: ok, no worries | 18:30 |
| mordred | clarkb: line? | 18:30 |
| clarkb | mordred: meta.py:104 | 18:31 |
| clarkb | mordred: I almost wonder if thats a bug and the block above it is making it not be a problem | 18:31 |
| mordred | clarkb: that's a fallback position if nothing else works | 18:31 |
| mordred | clarkb: it should have a comment above it "hardcoded fallback for rackspace" | 18:31 |
| clarkb | mordred: no thats below 104 | 18:32 |
| clarkb | and does have that comment | 18:32 |
| *** dtantsur is now known as dtantsur|afk | 18:33 | |
| mordred | oh - sorry - yah - sorry - it's for anywhere else that has neutron but neutron bonged somewhere so it's a "look fora fixed network named private if you couldn't find anything else" | 18:33 |
| mordred | clarkb: I do not know of any clouds currently that would get to that point and then match that | 18:33 |
| clarkb | gotcha | 18:33 |
| mordred | clarkb: the code there is just looking at the nova addresses dict for one in a dict named "private" with "OS-EXT-IPS:type" == 'fixed' | 18:34 |
| mordred | clarkb: and yes- serious bonghits there | 18:34 |
| clarkb | mordred: the big problem with your idea of using the fip to determine private ip is that the current code very much assumes that each interface listing provides sufficient info on its own to determine what it is | 18:35 |
| mordred | clarkb: the reason we're getting the wrong private ip on citycloud is that in the case of more than one matching, we currently use the first | 18:35 |
| clarkb | yup | 18:35 |
| mordred | clarkb: yes - I agree - it will take another pass through the addresses from a different angle if we find ourselves in tha tposition | 18:35 |
| clarkb | I'm working on a draft patch that is somewhat hacky to work around that assumption | 18:35 |
| mordred | or it may take refactoring the thing | 18:35 |
| mordred | ah | 18:35 |
| mordred | cool | 18:35 |
| clarkb | and we can decide how to take it from there | 18:36 |
| mordred | try not to get cut to shreds in the middle of that :) | 18:36 |
| mordred | clarkb: fwiw, I have a WIP docs patch for nova that describes the format of that addresses dict - should you find that helpful | 18:36 |
| Shrews | wait... we STILL don't have the whole private/public IP thing down? | 18:37 |
| * Shrews wants to kick something right in the something | 18:37 | |
| *** harlowja has joined #openstack-infra | 18:37 | |
| clarkb | mordred: your paste from earlier is super helpful | 18:37 |
| mordred | clarkb: http://docs-draft.openstack.org/55/464255/7/check/gate-nova-api-ref-src/88a33cc//api-ref/build/html/?expanded=show-server-details-detail | 18:37 |
| mordred | clarkb: cool | 18:37 |
| *** jamesmca_ has quit IRC | 18:37 | |
| mordred | Shrews: well - it'sthe last remaining hole we knew about - "what do we do if there are more than one of these" | 18:38 |
| mordred | clarkb: hopefully you'll enjoy the text: "The mac address associated with the address. If “OS-EXT-IPS:type” is “fixed” then the mac address is the mac of the interface on the server the address is attached to. If “OS-EXT-IPS:type” is “floating” then it is the mac for the interface on the server that the fixed IP the floating IP is attached to is associated with." | 18:38 |
| *** masuberu has quit IRC | 18:39 | |
| *** dave-mccowan has quit IRC | 18:41 | |
| *** esberglu_ has quit IRC | 18:42 | |
| *** electrofelix has quit IRC | 18:43 | |
| *** harlowja has quit IRC | 18:43 | |
| *** esberglu has joined #openstack-infra | 18:44 | |
| *** yamahata has quit IRC | 18:45 | |
| *** dprince has quit IRC | 18:47 | |
| *** Memphis has joined #openstack-infra | 18:50 | |
| clarkb | mordred: also not sure how much a fan I am of having the port 22 connection check in there (I mean I get why we do it, but ugh why can't we just trust apis) | 18:50 |
| *** geekg_000_ has joined #openstack-infra | 18:51 | |
| *** Memphis has quit IRC | 18:51 | |
| *** jamesmca_ has joined #openstack-infra | 18:52 | |
| *** geekg_000 has quit IRC | 18:53 | |
| *** tphummel has joined #openstack-infra | 18:54 | |
| *** gouthamr has quit IRC | 18:54 | |
| *** e0ne has quit IRC | 18:55 | |
| *** mat128 has quit IRC | 18:56 | |
| *** kzaitsev_mb has joined #openstack-infra | 18:57 | |
| *** dprince has joined #openstack-infra | 18:57 | |
| *** mat128 has joined #openstack-infra | 18:59 | |
| mordred | clarkb: ikr? | 19:01 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Add openstack-info to base job https://review.openstack.org/466332 | 19:03 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Initial commit for docs https://review.openstack.org/466341 | 19:03 |
| *** feisky has quit IRC | 19:07 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Use envlist for tox based roles https://review.openstack.org/466360 | 19:08 |
| openstackgerrit | Clark Boylan proposed openstack-infra/shade master: Find private ip addr based on fip attachment https://review.openstack.org/466877 | 19:12 |
| clarkb | mordred: ^ that feels super hacky but I think it may mostly work? | 19:12 |
| *** nicolasbock has quit IRC | 19:13 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Remove uncalled test code https://review.openstack.org/464276 | 19:16 |
| clarkb | I've also just sent mail to citycloud about this hopefully they have ideas | 19:18 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Fix inventory vars containing spaces https://review.openstack.org/465072 | 19:18 |
| *** salv-orlando has joined #openstack-infra | 19:18 | |
| mordred | clarkb: that actually looks pretty good | 19:19 |
| *** mat128 has quit IRC | 19:20 | |
| clarkb | mordred: oh derp I forgot to pass the fip_mac in | 19:20 |
| * clarkb fixes | 19:20 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/shade master: Find private ip addr based on fip attachment https://review.openstack.org/466877 | 19:22 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/project-config master: tripleo: remove experimental quickstart jobs https://review.openstack.org/466686 | 19:24 |
| *** esikache1 has quit IRC | 19:27 | |
| *** salv-orlando has quit IRC | 19:28 | |
| *** esikache1 has joined #openstack-infra | 19:28 | |
| clarkb | mtreinish: ok you still around? I have the citycloud weirdness mostly behind me now | 19:29 |
| clarkb | mtreinish: what I am thinking is turn off the service on existing server, boot new server, update dns/firewalls, make sure service runs then delete old server | 19:29 |
| mtreinish | clarkb: sounds like a good plan | 19:30 |
| clarkb | mtreinish: any concerns with going down to a single worker temporarily? | 19:30 |
| mtreinish | clarkb: nope, I didn't even think subunit-worker01 was running | 19:30 |
| mtreinish | I thought we shut it down as part of the mqtt tests and never started it back up | 19:30 |
| mtreinish | as part of the big ssl failure debug | 19:31 |
| clarkb | mtreinish: oh maybe I'm operating on old info then | 19:31 |
| fungi | clarkb: heh, there's somebody in #-nova right now asking why ipv6 addresses aren't included in the configdrive metadata. weren't you harping on that recently? | 19:31 |
| clarkb | 2017-05-22 19:31:12,672 Converting Subunit V2 stream: <_io.BytesIO object at 0x45f02f0> to SQL <- seems it doing something | 19:32 |
| mtreinish | I could easily just be remembering incorrectly | 19:32 |
| clarkb | fungi: yes! | 19:32 |
| clarkb | fungi: there is a thread and a bug and patches | 19:32 |
| mtreinish | heh, ok then yeah I'm just making stuff up | 19:32 |
| clarkb | mtreinish: though maybe that leads to a different question. Can we get away with a single worker and just turn this one off? | 19:32 |
| mtreinish | clarkb: but anyway there shouldn't be any harm in stopping it | 19:32 |
| mtreinish | yeah, a single worker should be able to handle the load | 19:32 |
| mtreinish | at least in the short term | 19:32 |
| clarkb | mtreinish: ok maybe we start there. Let me turn the service off today, then in a day or two we make sure it doesn't harm anything then delete the server | 19:33 |
| clarkb | then if we need more compute we spin up a new server in the future? | 19:33 |
| mtreinish | sure, wfm | 19:33 |
| *** SumitNaiksatam has joined #openstack-infra | 19:33 | |
| clarkb | ok service is stopped, let us know if you see 02 having a hard time | 19:34 |
| mtreinish | I like having 2 for poorman's HA and a little load balancing. But it's not like things are super bogged down doing the sql adds | 19:34 |
| mtreinish | it's not like we need immediate db updates either | 19:35 |
| clarkb | fungi: do I need to go help -nova? | 19:35 |
| fungi | clarkb: currently trying to run down urls to references | 19:36 |
| clarkb | fungi: let me see what I can find | 19:36 |
| clarkb | fungi: https://bugs.launchpad.net/nova/+bug/1676363 | 19:37 |
| openstack | Launchpad bug 1676363 in OpenStack Compute (nova) "The network metadata should be more useful" [Medium,In progress] - Assigned to Dan Peschman (dpeschman) | 19:37 |
| fungi | clarkb: this thread? http://lists.openstack.org/pipermail/openstack-dev/2017-March/114563.html | 19:37 |
| pabelanger | clarkb: okay, I am finally on controller00.chocolate, I was on a compute host last time | 19:38 |
| clarkb | fungi: oui | 19:38 |
| clarkb | pabelanger: ssh'd in or just on ilo? | 19:39 |
| pabelanger | clarkb: ilo | 19:39 |
| fungi | clarkb: thanks, passed those along | 19:40 |
| *** dhajare has joined #openstack-infra | 19:46 | |
| *** wolverineav has quit IRC | 19:51 | |
| *** wolverineav has joined #openstack-infra | 19:51 | |
| *** skelso has joined #openstack-infra | 19:55 | |
| *** salv-orlando has joined #openstack-infra | 19:56 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config master: Use StoryBoard for Craton repositories https://review.openstack.org/466886 | 19:57 |
| openstackgerrit | Clark Boylan proposed openstack-infra/shade master: Find private ip addr based on fip attachment https://review.openstack.org/466877 | 20:00 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config master: Use StoryBoard for CloudKitty repositories https://review.openstack.org/466887 | 20:01 |
| *** kgiusti has quit IRC | 20:03 | |
| *** beisner_ has joined #openstack-infra | 20:03 | |
| *** nicolasbock has joined #openstack-infra | 20:06 | |
| *** chlong has quit IRC | 20:07 | |
| pabelanger | clarkb: best I can see, our link changed or was removed | 20:08 |
| pabelanger | it was eth0, but that is down now | 20:08 |
| pabelanger | but, eth3 is up | 20:08 |
| pabelanger | so, going to try and use it | 20:08 |
| clarkb | ok | 20:09 |
| *** jamesmca_ has quit IRC | 20:10 | |
| *** armax has quit IRC | 20:13 | |
| pabelanger | okay controller is back online, Iam able to SSH into it | 20:14 |
| fungi | project-config-core reviewers: if you're available, expedite requested on 466886 and 466887 above. i'm about to begin processing the sb imports for those craton and cloudkitty repos | 20:14 |
| clarkb | pabelanger: so it was just the device moved? they can do that if you don't otherwise have udev rules making them consistent | 20:14 |
| *** dimtruck is now known as zz_dimtruck | 20:14 | |
| pabelanger | clarkb: that is what I am looking for now | 20:15 |
| openstackgerrit | Clark Boylan proposed openstack-infra/shade master: Find private ip addr based on fip attachment https://review.openstack.org/466877 | 20:15 |
| clarkb | mordred: ^ that should actually pass unitests now | 20:15 |
| pabelanger | clarkb: 70-persistent-net.rules exists, so going to say no | 20:17 |
| clarkb | pabelanger: huh that implies someone moved a cable? | 20:18 |
| pabelanger | clarkb: or we had 2 interfaces all a long and the port on eth0 died? | 20:18 |
| pabelanger | but ya, something cable | 20:18 |
| pabelanger | we'd need somebody to audit it for use | 20:19 |
| pabelanger | us* | 20:19 |
| pabelanger | also, veth2 is only created after puppet is run. which means, each time we reboot servers it is missing until first puppet run | 20:20 |
| pabelanger | this makes linuxbridge agent unhappy | 20:20 |
| *** ijw has joined #openstack-infra | 20:21 | |
| fungi | oh, ouch | 20:22 |
| fungi | we're creating veth interfaces ephemerally via configuration management? how does that even work? | 20:22 |
| pabelanger | ya, some crazy puppet code :) | 20:22 |
| fungi | i just assumed puppet was creating /etc/network/interfaces.d/* files for them so they'd persist on reboot | 20:23 |
| pabelanger | no, glean does that | 20:23 |
| pabelanger | but glean doesn't support bridges | 20:23 |
| pabelanger | so, we did this dance of glean for interfaces, then puppet for veth2 | 20:23 |
| clarkb | this is the crazy stuff we had to do beacuse of networking restrictiosn in that env | 20:23 |
| fungi | yikes | 20:23 |
| clarkb | we dangle a veth off the physical port so that neutron is ignorant of the multiple vlans in play iirc | 20:24 |
| pabelanger | ya, this was something neutron didn't want to fix right? | 20:24 |
| fungi | clearly it was grotesque enough i did my best to wipe it from memory | 20:25 |
| clarkb | ya its a weird intersection of networking realities in that env and how neutron wants to see the world | 20:25 |
| clarkb | and we don't really have control to change the networking or update neutron because its such a corner case so we have this shim in the middle | 20:25 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Temporarily(?) add some debug statements around git repo creation https://review.openstack.org/466810 | 20:26 |
| pabelanger | okay, nodepool is happy again | 20:27 |
| openstackgerrit | Clark Boylan proposed openstack-infra/shade master: Find private ip addr based on fip attachment https://review.openstack.org/466877 | 20:29 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Use envlist for tox based roles https://review.openstack.org/466360 | 20:30 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-roles master: Default run-tox envlist to venv https://review.openstack.org/466375 | 20:30 |
| clarkb | fix unittests, break pep8, lets see if fixing pep8 breaks unittests >_> | 20:30 |
| *** chlong has joined #openstack-infra | 20:31 | |
| *** jamesmca_ has joined #openstack-infra | 20:31 | |
| *** dprince has quit IRC | 20:32 | |
| *** mriedem is now known as mriedem_afk | 20:36 | |
| clarkb | woo finally, now just to see what integration tests do | 20:38 |
| *** jamesmca_ has quit IRC | 20:38 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Temporarily(?) add some debug statements around git repo creation https://review.openstack.org/466810 | 20:39 |
| *** salv-orlando has quit IRC | 20:39 | |
| *** jamesmca_ has joined #openstack-infra | 20:40 | |
| *** salv-orlando has joined #openstack-infra | 20:40 | |
| *** jamesmca_ has quit IRC | 20:40 | |
| *** jamesmca_ has joined #openstack-infra | 20:40 | |
| *** chlong has quit IRC | 20:41 | |
| *** jamesmca_ has quit IRC | 20:41 | |
| *** jamesmca_ has joined #openstack-infra | 20:41 | |
| *** jamesmca_ has quit IRC | 20:42 | |
| mtreinish | clarkb, fungi: would it be possible to get the access log for health.o.o? I was thinking of writing (or borrowing an existing one I find via google) a script to do some cache warming to make openstack-health load a bit faster (and keep things up to date) and I'd like to know what the most common hit paths are | 20:42 |
| *** jamesmca_ has joined #openstack-infra | 20:43 | |
| *** salv-orlando has quit IRC | 20:44 | |
| *** jamesmca_ has quit IRC | 20:47 | |
| clarkb | mtreinish: we can probably do that. May need to scrub ip addrs first | 20:48 |
| fungi | seems fine to me too, yeah | 20:49 |
| clarkb | fungi: do we need to cut out the ips you think? | 20:49 |
| fungi | probably a good idea, but can literally use `cut` for that | 20:50 |
| clarkb | yup :) | 20:50 |
| clarkb | also I have really bad packet loss right now, /me may disappear as that gets debugged | 20:51 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove tox -epy27 envlist https://review.openstack.org/466894 | 20:51 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Run ansible-lint under pep8 envlist https://review.openstack.org/466895 | 20:51 |
| *** ijw_ has joined #openstack-infra | 20:51 | |
| *** jamesmca_ has joined #openstack-infra | 20:51 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Quote message when reporting to Gerrit https://review.openstack.org/466345 | 20:52 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Temporarily(?) add some debug statements around git repo creation https://review.openstack.org/466810 | 20:52 |
| fungi | `sudo cut -d' ' -f2- /var/log/apache2/openstack-health-api-access.log > access.log` ought to do it. we could take it further and just cut it down to get request paths and sort -u those or sort|uniq -c to get a count | 20:52 |
| *** askb has joined #openstack-infra | 20:53 | |
| clarkb | ok I think my wireless bridge died, nothing rebooting consumer ap hardware can't fix and I'm back | 20:54 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: Remove tox -epy27 envlist https://review.openstack.org/466897 | 20:54 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: Run ansible-lint under pep8 envlist https://review.openstack.org/466898 | 20:54 |
| mtreinish | fungi: heh, the script kinda writes it self from there. Just pipe that into head -n 50 and use that as a for loop for wget or curling the path is all we need :) | 20:54 |
| clarkb | fungi: size of requests is likely useful if caching things is important | 20:55 |
| *** ijw has quit IRC | 20:55 | |
| *** gouthamr has joined #openstack-infra | 20:55 | |
| clarkb | though that assumes larger request means more cost which may not be true | 20:55 |
| mtreinish | clarkb: it might be true, but not always since there is the query complexity too. For most cases the size of the data set is the limiting performance factor (there are 1 or 2 exceptions I can think of off the top of my head though) | 20:56 |
| *** dhajare has quit IRC | 20:56 | |
| clarkb | fungi: you going to grab that for mtreinish/ | 20:57 |
| mtreinish | but the caching all happens async in a separate worker thread so we just need to poke the endpoint and it should just do it's thing | 20:57 |
| *** thorst_afk has quit IRC | 20:58 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove tox -epy27 envlist https://review.openstack.org/466894 | 20:58 |
| *** thorst_afk has joined #openstack-infra | 20:59 | |
| *** felipemonteiro_ has quit IRC | 20:59 | |
| *** rockyg has joined #openstack-infra | 20:59 | |
| openstackgerrit | mark mcclain proposed openstack-infra/project-config master: Disable the requirements job for networking-arista stable/mitaka-hpb https://review.openstack.org/466901 | 21:00 |
| fungi | looking into it now | 21:02 |
| openstackgerrit | mark mcclain proposed openstack-infra/project-config master: Disable the requirements job for networking-arista stable/mitaka-hpb https://review.openstack.org/466901 | 21:02 |
| *** thorst_afk has quit IRC | 21:03 | |
| * clarkb finds food before today's meeting | 21:03 | |
| *** dave-mccowan has joined #openstack-infra | 21:05 | |
| *** armax has joined #openstack-infra | 21:07 | |
| *** gluytium has quit IRC | 21:10 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Conditional nodepool logic https://review.openstack.org/463392 | 21:10 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Support passing in $EXTRA_VARS https://review.openstack.org/463393 | 21:10 |
| *** gouthamr has quit IRC | 21:13 | |
| *** gluytium has joined #openstack-infra | 21:14 | |
| *** ldnunes has quit IRC | 21:15 | |
| *** esikache1 has quit IRC | 21:17 | |
| *** gouthamr has joined #openstack-infra | 21:17 | |
| fungi | mtreinish: current one-liner script looks like: sudo bash -c '( cat /var/log/apache2/openstack-health-api-access.log{,.1};zcat /var/log/apache2/openstack-health-api-access.log*.gz )'|grep ' "GET .*" 200 '|sed 's/.* "GET \([^ ]*\) HTTP[^"]*" 200 \([0-9]*\) .*/\2 \1/'|sort|uniq -c|sort -rn|head -n100>top-100.log | 21:18 |
| fungi | mtreinish: suffers from the fact that requests of the same path vary in size | 21:18 |
| *** esikache1 has joined #openstack-infra | 21:19 | |
| fungi | mtreinish: should i uniq on the path and then lookup the largest size for each of the top requested paths instead? | 21:19 |
| *** rhallisey has quit IRC | 21:22 | |
| fungi | project-config-core reviewers: if you're available, expedite requested on 466886 and 466887 above. i'm about to begin processing the sb imports for those craton and cloudkitty repos | 21:23 |
| *** ijw_ has quit IRC | 21:23 | |
| fungi | (once those changes merge and manage-projects creates the projects in sb for us) | 21:24 |
| *** esikache1 has quit IRC | 21:24 | |
| *** esberglu has quit IRC | 21:24 | |
| *** jamesmca_ has quit IRC | 21:25 | |
| mtreinish | fungi: I think that's probably fine. I don't think we need to do it based on size, just based on hits should be enough | 21:25 |
| *** jamesmca_ has joined #openstack-infra | 21:25 | |
| fungi | well, i almost have the latter now | 21:25 |
| *** kaisers1 has quit IRC | 21:25 | |
| fungi | also there seem to be quite a few zero-byte responses with 200 return codes | 21:26 |
| fungi | should i omit those from the totals? | 21:26 |
| mtreinish | fungi: maybe separate it out? I'm curious what they are | 21:27 |
| *** jamesmca_ has quit IRC | 21:28 | |
| *** jamesmca_ has joined #openstack-infra | 21:28 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: WIP: Remove install-distro-packages.sh dependency for run-bindep https://review.openstack.org/466913 | 21:28 |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Specify etcd download location for all CI jobs https://review.openstack.org/466817 | 21:29 |
| *** jheroux has quit IRC | 21:30 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: WIP: Remove install-distro-packages.sh dependency for run-bindep https://review.openstack.org/466913 | 21:30 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: WIP: Remove install-distro-packages.sh dependency for run-bindep https://review.openstack.org/466913 | 21:31 |
| *** jamesmca_ has quit IRC | 21:33 | |
| openstackgerrit | Merged openstack-dev/pbr master: Updated from global requirements https://review.openstack.org/465224 | 21:34 |
| *** jamesmca_ has joined #openstack-infra | 21:34 | |
| fungi | mtreinish: i'll do a separate search through the logs for the empty responses | 21:34 |
| *** jamesmca_ has quit IRC | 21:35 | |
| mtreinish | ok | 21:35 |
| fungi | because i agree, that seems like an error of some sort | 21:36 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: WIP: Remove install-distro-packages.sh dependency for run-bindep https://review.openstack.org/466913 | 21:36 |
| *** thorst_afk has joined #openstack-infra | 21:36 | |
| *** jamesmca_ has joined #openstack-infra | 21:37 | |
| *** jamesmca_ has quit IRC | 21:37 | |
| clarkb | mordred: https://review.openstack.org/#/c/466877/ dpesm | 21:38 |
| clarkb | gah | 21:38 |
| clarkb | mordred: ^ that change doesn't regress the test suite at least | 21:39 |
| *** esberglu has joined #openstack-infra | 21:39 | |
| clarkb | mordred: though I'm guessing we don't already test the case of multiple private IPs? | 21:39 |
| *** jamesmca_ has joined #openstack-infra | 21:39 | |
| clarkb | I should probably sort out a unit test at least | 21:39 |
| *** jamesmca_ has quit IRC | 21:39 | |
| *** eharney has quit IRC | 21:40 | |
| *** kaisers has joined #openstack-infra | 21:40 | |
| *** thorst_afk has quit IRC | 21:40 | |
| *** jamesmca_ has joined #openstack-infra | 21:40 | |
| *** gouthamr has quit IRC | 21:41 | |
| dirk | Does anyone remember the current state of nodepool builders? Are they on xenial already? pabelanger ? | 21:41 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Gather facts for run-bindep role https://review.openstack.org/466918 | 21:41 |
| clarkb | dirk: I don't think that work has happened yet, due to the vhd utils thing being not packaged for xenial yet | 21:42 |
| clarkb | dirk: but once that is done then we can move forward | 21:42 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: WIP: Remove install-distro-packages.sh dependency for run-bindep https://review.openstack.org/466913 | 21:42 |
| dirk | clarkb: thanks for the reply. Is there a way to help? I don know what the vhd utils thing is about | 21:43 |
| pabelanger | dirk: clarkb: right, still waiting on vhdutils | 21:43 |
| dirk | pabelanger: what needs to be done? Bug#? Code pointer? | 21:43 |
| pabelanger | dirk: https://launchpadlibrarian.net/317579563/buildlog_ubuntu-xenial-amd64.vhd-util_4.4.0-0ubuntu14xenial0_BUILDING.txt.gz | 21:44 |
| pabelanger | we need to fix cc warnings | 21:44 |
| pabelanger | or disable them in packaging | 21:44 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: WIP: Remove install-distro-packages.sh dependency for run-bindep https://review.openstack.org/466913 | 21:45 |
| dirk | Ok, that sounds easy enough | 21:46 |
| dirk | And we maintain that package ourselves? | 21:46 |
| pabelanger | yes | 21:46 |
| *** ijw has joined #openstack-infra | 21:46 | |
| pabelanger | we are working on adding qemu-utils support | 21:46 |
| cmurphy | dirk: the package gets published to this ppa https://launchpad.net/~openstack-ci-core/+archive/ubuntu/vhd-util | 21:47 |
| *** camunoz has joined #openstack-infra | 21:48 | |
| dirk | pabelanger: how far complete is that transition to qemu-utils? I don't want to fix this problem and then don't get thw fix merged because the path to obsolescence is almost completed ;-) | 21:48 |
| *** skelso has quit IRC | 21:49 | |
| dirk | cmurphy: thanks! Where is the source of the package? | 21:50 |
| mordred | clarkb: no - I'm guessing we don't - we should add a test for it - I can update your patch if you don't want to dig in to that too deeply | 21:50 |
| *** esikache1 has joined #openstack-infra | 21:51 | |
| pabelanger | dirk: we'll want to get vhdutils fix first, because I am not sure we'll be able to backport our qemu-img release | 21:51 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: WIP: Remove install-distro-packages.sh dependency for run-bindep https://review.openstack.org/466913 | 21:52 |
| cmurphy | dirk: I believe it's https://github.com/emonty/vhd-util | 21:52 |
| cmurphy | which i just learned today | 21:52 |
| clarkb | mordred: I'm working on it, there are existing tests for meta.py that are easy to modify | 21:53 |
| * cmurphy just now making these connections | 21:53 | |
| *** bobh has joined #openstack-infra | 21:53 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: WIP: Remove install-distro-packages.sh dependency for run-bindep https://review.openstack.org/466913 | 21:53 |
| ianw | pabelanger / clarkb : yeah, we should be ok -> https://git.openstack.org/cgit/openstack/diskimage-builder/tree/diskimage_builder/disk_image_create.py#n42 | 21:53 |
| dirk | cmurphy: ah, so you're already working on this? | 21:54 |
| pabelanger | ianw: thanks | 21:54 |
| cmurphy | dirk: no, i just learned about this while trying to help answer questions on https://review.openstack.org/#/c/466701/ | 21:54 |
| *** esikache1 has quit IRC | 21:56 | |
| fungi | project-config-core reviewers: shortly i'm going to self-approve 466886 and 466887 so as not to further delay the sb imports for craton and cloudkitty repos given that i told them i could do it at 20:00 | 21:56 |
| mordred | clarkb: sweet | 21:57 |
| dirk | cmurphy: ah.. /me goes reading the epic | 21:58 |
| pabelanger | dirk: cmurphy: mordred: I think we just need to add CFLAGS += -Wno-error=maybe-uninitialized to our rules file to continue to ignore them | 21:59 |
| pabelanger | I just haven't tested | 21:59 |
| dirk | pabelanger: Yeah, was just looking if i could find a better patch to win my 5 minutes of fame today ;-) | 22:00 |
| *** tdasilva has quit IRC | 22:01 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: WIP: Remove install-distro-packages.sh dependency for run-bindep https://review.openstack.org/466913 | 22:02 |
| mordred | dirk: fwiw, the qemu-util patch is in https://github.com/emonty/do-not-use-patched-qemu | 22:02 |
| mordred | also, I wrote this: https://storyboard.openstack.org/#!/story/2001033 if folkes haven't seen it yet | 22:02 |
| jeblair | zuul meeting now in #openstack-meeting-alt | 22:03 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: WIP: Remove install-distro-packages.sh dependency for run-bindep https://review.openstack.org/466913 | 22:05 |
| *** aeng has joined #openstack-infra | 22:05 | |
| *** jamesmca_ has quit IRC | 22:07 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/shade master: Find private ip addr based on fip attachment https://review.openstack.org/466877 | 22:08 |
| *** jkilpatr has quit IRC | 22:08 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: Remove install-distro-packages.sh dependency for run-bindep https://review.openstack.org/466913 | 22:08 |
| *** jamesmca_ has joined #openstack-infra | 22:09 | |
| *** zz_dimtruck is now known as dimtruck | 22:09 | |
| *** kzaitsev_mb has quit IRC | 22:09 | |
| *** ijw has quit IRC | 22:10 | |
| *** Julien-zte has joined #openstack-infra | 22:10 | |
| *** rfolco has quit IRC | 22:13 | |
| *** baoli has quit IRC | 22:13 | |
| *** xyang1 has quit IRC | 22:13 | |
| *** claudiub has quit IRC | 22:14 | |
| *** adriant has joined #openstack-infra | 22:19 | |
| openstackgerrit | Merged openstack-infra/project-config master: Use StoryBoard for Craton repositories https://review.openstack.org/466886 | 22:20 |
| openstackgerrit | Merged openstack-infra/project-config master: Use StoryBoard for CloudKitty repositories https://review.openstack.org/466887 | 22:20 |
| *** ijw has joined #openstack-infra | 22:20 | |
| *** dangers is now known as dangers_away | 22:22 | |
| *** ijw has quit IRC | 22:23 | |
| dirk | mordred: so the compile fix seems to be http://xenbits.xen.org/gitweb/?p=xen.git;a=commitdiff;h=5e39eb05aa2a6d9bfa6c3b3e299b071422498625 -- whats the best way to get that into that source repo? send a pull request? can you do a new upload then? | 22:23 |
| mordred | dirk: I think I can just cram it in - thanks for finding the patch! | 22:25 |
| dirk | mordred: ok, that'd be great. I'm currently struggling to figure out how to build the PPA locally with that patch applied to see whether that's complete | 22:26 |
| mordred | dirk: it's ... there's a git-buildpackage command ... one sec | 22:27 |
| *** jkilpatr has joined #openstack-infra | 22:27 | |
| * dirk installs git-buildpackage meanwhile | 22:27 | |
| *** jamesmca_ has quit IRC | 22:27 | |
| openstackgerrit | Rosario Di Somma proposed openstack-infra/shade master: WIP: Add pagination for the list_volumes call https://review.openstack.org/466927 | 22:27 |
| *** ijw has joined #openstack-infra | 22:28 | |
| *** hongbin has joined #openstack-infra | 22:33 | |
| *** ijw has quit IRC | 22:34 | |
| *** ijw has joined #openstack-infra | 22:35 | |
| *** Apoorva_ has joined #openstack-infra | 22:36 | |
| *** Apoorva has quit IRC | 22:40 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Ensure bindep is installed into virtualenv https://review.openstack.org/466931 | 22:40 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add bubblewrap to bindep / test-setup.sh https://review.openstack.org/461849 | 22:42 |
| *** ijw has quit IRC | 22:42 | |
| *** bobh has quit IRC | 22:42 | |
| dirk | mordred: ok, so gbp buildpackage succeeds on --git-dist=xenial with that patch from above | 22:43 |
| *** esikache1 has joined #openstack-infra | 22:43 | |
| mordred | dirk: EXCELLENT. I shall apply it, then build a new source package and upload. THANK YOU (a couple of those return 0; calls were kind of what I thought it should be - but also I don't know the code well enough to make sure there wasn't a bug doing thatsomewhere) | 22:44 |
| *** rossella__ has quit IRC | 22:46 | |
| dirk | mordred: thanks in advance.. glad to be of help (just updated the storyboard task, hope I didn't screw it up too badly) | 22:46 |
| *** ijw has joined #openstack-infra | 22:46 | |
| dirk | whats the next thing blocking us from a xenial nodepool builder then? | 22:47 |
| *** Apoorva_ has quit IRC | 22:47 | |
| *** r-daneel has quit IRC | 22:47 | |
| clarkb | dirk: building it, possibly systemd fixes once we boot something | 22:47 |
| *** dimtruck is now known as zz_dimtruck | 22:47 | |
| *** Apoorva has joined #openstack-infra | 22:47 | |
| clarkb | dirk: logging is already python logging'd to disk so should avoid any journald stuff. But init scripts may need updating? | 22:48 |
| clarkb | otherwise I expect it to mostly just work | 22:48 |
| dirk | clarkb: well, I guess I can't help with that or is there a way to build the machine for testing without being infra-root? | 22:48 |
| *** esikache1 has quit IRC | 22:48 | |
| *** zz_dimtruck is now known as dimtruck | 22:48 | |
| clarkb | dirk: you could always run the puppet manifest locally on a xenial instance to see if it works | 22:49 |
| clarkb | the contents of system-config/manifests/site.pp under the nb\d+ node def | 22:49 |
| clarkb | just be warned ti wll install our users onto that instance | 22:49 |
| dirk | I would expect it to fail because of some $credentials or $secrets missing | 22:50 |
| clarkb | ya you'll have to provide those hiera keys or replace them with direct values | 22:50 |
| *** ijw has quit IRC | 22:51 | |
| *** esikache1 has joined #openstack-infra | 22:52 | |
| *** esikache1 has quit IRC | 22:56 | |
| *** thorst_afk has joined #openstack-infra | 23:00 | |
| clarkb | mordred: https://review.openstack.org/#/c/466877/ is all green now and has a test. Review much appreciated. Would be great if we could get a workaround for the citycloud oddity soon | 23:01 |
| mordred | Shrews: you wanna look at that too? ^^ I'm also happy to just land it (I already have the context paged in) | 23:02 |
| *** ijw has joined #openstack-infra | 23:02 | |
| Shrews | lemme peek real quick | 23:02 |
| *** hongbin has quit IRC | 23:03 | |
| *** sdague has quit IRC | 23:03 | |
| *** hongbin has joined #openstack-infra | 23:04 | |
| *** thorst_afk has quit IRC | 23:04 | |
| *** thorst_afk has joined #openstack-infra | 23:05 | |
| *** neiljerram has quit IRC | 23:05 | |
| *** lamt has quit IRC | 23:06 | |
| Shrews | mordred: clarkb: +3 | 23:06 |
| clarkb | danke | 23:06 |
| mordred | clarkb: let's make a release when you wake up in the morning | 23:07 |
| clarkb | mordred: sounds good | 23:07 |
| mordred | clarkb: there are a pile of changes in shade right now that I'm confident in - but I'd like to watch nodepool just to be sure | 23:07 |
| *** rockyg has quit IRC | 23:07 | |
| clarkb | smcginnis: I don't see the cinder related lvm failures on e-r anymore. DId we change anything other than the timeout around that? | 23:07 |
| *** thorst_afk has quit IRC | 23:09 | |
| mordred | clarkb: speaking of - this shade release removes neutronclient and cinderclient and just uses REST - this is the reason I want to watch :) | 23:09 |
| mordred | since, you know, we use neutronclient in nodepool | 23:09 |
| smcginnis | clarkb: Nope | 23:10 |
| clarkb | smcginnis: interesting, maybe it was a bug in the distro and they fixed it for us | 23:10 |
| clarkb | mordred: that is a big change | 23:10 |
| smcginnis | clarkb: I had even seen some failures after extending the timeout, but it appears to have gotten better. | 23:10 |
| smcginnis | clarkb: That's my assumption. | 23:10 |
| *** dhinesh has quit IRC | 23:10 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate master: Preinstall pbr with pip https://review.openstack.org/466935 | 23:11 |
| clarkb | mordred: ^ is another one we have talked about in the past that I just never pushed code for. Its mostly a stab in the dark but hoping it makes things stop failing like http://logs.openstack.org/27/466927/1/check/gate-shade-dsvm-ansible/296035a/console.html#_2017-05-22_22_34_30_903450 | 23:11 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: Remove install-distro-packages.sh dependency for run-bindep https://review.openstack.org/466913 | 23:12 |
| mordred | clarkb: that just installed it just in the ansible venv though | 23:14 |
| mordred | clarkb: oh - I see | 23:14 |
| *** ijw has quit IRC | 23:14 | |
| mordred | clarkb: yah- wfm | 23:14 |
| clarkb | pabelanger: re ^ if thats in the openstack role why wouldn't we continue to support the fallback file? | 23:15 |
| clarkb | mordred: ya its when we install ansible to the venv everything downloaded by pip works just fine, then the first easy_install thing breaks | 23:15 |
| clarkb | mordred: its not very frequent at all and the best thing I can come up with is easy_isntall less reliable at figuring out the afs mirrors | 23:15 |
| *** jamesdenton has joined #openstack-infra | 23:16 | |
| mordred | clarkb: that's so ossum | 23:18 |
| *** jamesden_ has joined #openstack-infra | 23:20 | |
| mordred | clarkb: would you mind +A'ing https://review.openstack.org/#/c/466487 and https://review.openstack.org/#/c/466319 ? adding python3 functional tests for shade and using local.conf | 23:21 |
| *** jamesdenton has quit IRC | 23:21 | |
| clarkb | ya just let me finish up this review | 23:21 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Add SSH Agent Primitives and usage https://review.openstack.org/462712 | 23:28 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Add support for bwrap https://review.openstack.org/453851 | 23:28 |
| clarkb | mordred: doesn't look like anything consumes SHADE_TOX_PYTHON yet? | 23:30 |
| *** jamesden_ has quit IRC | 23:30 | |
| clarkb | oh wait its a tox.ini hack | 23:31 |
| clarkb | mordred: out of curiousity why not tox -epy35 directly? seems like tox is at least trying to address that problme for you | 23:33 |
| *** ijw has joined #openstack-infra | 23:33 | |
| *** ijw has joined #openstack-infra | 23:34 | |
| *** geekg_000_ has quit IRC | 23:34 | |
| *** rwsu has quit IRC | 23:34 | |
| clarkb | its not a big deal I approved both changes, just curious why plumbing through a var for tox env was not chosen | 23:36 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Start at networkx for digraph implementation https://review.openstack.org/466592 | 23:37 |
| *** Julien-zte has quit IRC | 23:37 | |
| *** tphummel has quit IRC | 23:39 | |
| *** felipemonteiro has joined #openstack-infra | 23:39 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add python3 functional tests to shade https://review.openstack.org/466319 | 23:40 |
| *** nicolasbock has quit IRC | 23:40 | |
| *** rwsu has joined #openstack-infra | 23:41 | |
| *** salv-orlando has joined #openstack-infra | 23:41 | |
| openstackgerrit | Merged openstack-infra/shade master: Find private ip addr based on fip attachment https://review.openstack.org/466877 | 23:41 |
| *** wolverineav has quit IRC | 23:41 | |
| mordred | clarkb: because tox -epy35 runs the unit tests under python3.5 | 23:41 |
| *** wolverineav has joined #openstack-infra | 23:42 | |
| mordred | clarkb: SHADE_TOX_PYTHON=python3 tox -functional runs the functional tests under 3 | 23:42 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add javascript license information https://review.openstack.org/466521 | 23:42 |
| mordred | clarkb: so it was either that or just add a functional35 tox job ... which just seemed meh | 23:42 |
| clarkb | mordred: ah | 23:42 |
| mordred | clarkb: it's the very weird dance shade needs to do here- of letting devstack install with its versions of libs then run functional tests from a venv against that cloud with potentially different versions of libs - because yay! | 23:43 |
| clarkb | ya | 23:43 |
| openstackgerrit | Merged openstack-infra/project-config master: Migrate shade tests to local_conf https://review.openstack.org/466487 | 23:44 |
| *** stakeda has joined #openstack-infra | 23:44 | |
| *** wolverineav has quit IRC | 23:46 | |
| *** esikache1 has joined #openstack-infra | 23:53 | |
| *** tdasilva has joined #openstack-infra | 23:54 | |
| *** Apoorva_ has joined #openstack-infra | 23:54 | |
| clarkb | ok office is only a few degrees cooler than the surface of the sun. time for me to escape the heat | 23:54 |
| clarkb | mordred: I'll try to get an early start tomorrow so we can get that shade release out and restart the encessary nodepool services | 23:55 |
| *** esikache1 has quit IRC | 23:57 | |
| *** Apoorva has quit IRC | 23:57 | |
| *** Apoorva_ has quit IRC | 23:58 | |
| *** dingyichen has joined #openstack-infra | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!