| *** ddieterly has joined #openstack-infra | 00:00 | |
| *** PollyZ has quit IRC | 00:06 | |
| *** oanson has joined #openstack-infra | 00:08 | |
| *** sdake has joined #openstack-infra | 00:09 | |
| *** itisha has quit IRC | 00:10 | |
| *** sdake_ has quit IRC | 00:11 | |
| *** ddieterly has quit IRC | 00:13 | |
| *** sflanigan has joined #openstack-infra | 00:15 | |
| *** sflanigan has joined #openstack-infra | 00:15 | |
| *** pt_15 has quit IRC | 00:16 | |
| ianw | what did i miss? | 00:17 |
|---|---|---|
| *** adrian_otto has joined #openstack-infra | 00:18 | |
| *** adrian_otto has quit IRC | 00:21 | |
| *** oanson has quit IRC | 00:23 | |
| *** rdx_matt has joined #openstack-infra | 00:23 | |
| *** oanson has joined #openstack-infra | 00:25 | |
| *** mriedem has quit IRC | 00:25 | |
| *** sdake_ has joined #openstack-infra | 00:26 | |
| *** sdake has quit IRC | 00:29 | |
| *** oanson has quit IRC | 00:29 | |
| *** thorst has joined #openstack-infra | 00:33 | |
| *** zeih has joined #openstack-infra | 00:33 | |
| *** thorst has quit IRC | 00:35 | |
| *** coolsvap has joined #openstack-infra | 00:35 | |
| *** thorst has joined #openstack-infra | 00:36 | |
| *** zul has quit IRC | 00:38 | |
| *** zeih has quit IRC | 00:38 | |
| *** esberglu has joined #openstack-infra | 00:41 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Use ovs-interface-undefault instead of ovs-native job https://review.openstack.org/338944 | 00:43 |
| *** thorst has quit IRC | 00:44 | |
| *** gongysh has joined #openstack-infra | 00:48 | |
| *** rdx_matt has quit IRC | 00:58 | |
| *** Julien-zte has joined #openstack-infra | 00:59 | |
| *** zhurong has joined #openstack-infra | 01:01 | |
| *** asselin__ has joined #openstack-infra | 01:02 | |
| *** asselin_ has quit IRC | 01:05 | |
| *** lvdongbing has joined #openstack-infra | 01:09 | |
| *** zhurong has quit IRC | 01:14 | |
| *** lvdongbing has quit IRC | 01:15 | |
| *** roxanaghe has joined #openstack-infra | 01:17 | |
| *** zhurong has joined #openstack-infra | 01:17 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 01:18 |
| *** esberglu has quit IRC | 01:21 | |
| *** roxanaghe has quit IRC | 01:22 | |
| *** thorst has joined #openstack-infra | 01:27 | |
| *** thorst has quit IRC | 01:27 | |
| *** Julien-zte has quit IRC | 01:28 | |
| *** Julien-zte has joined #openstack-infra | 01:31 | |
| *** cody-somerville has joined #openstack-infra | 01:33 | |
| *** zeih has joined #openstack-infra | 01:34 | |
| *** Daisy has joined #openstack-infra | 01:36 | |
| *** zeih has quit IRC | 01:38 | |
| *** ddieterly has joined #openstack-infra | 01:41 | |
| *** heyongli has joined #openstack-infra | 01:42 | |
| *** tqtran has joined #openstack-infra | 01:42 | |
| *** heyongli has quit IRC | 01:44 | |
| *** heyongli has joined #openstack-infra | 01:44 | |
| mordred | ianw: well, we rewrote everything in perl for one | 01:45 |
| *** tqtran has quit IRC | 01:46 | |
| *** Daisy has quit IRC | 01:46 | |
| *** Daisy has joined #openstack-infra | 01:47 | |
| *** Daisy has quit IRC | 01:51 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Use ovs-interface-undefault instead of ovs-native job https://review.openstack.org/338944 | 01:53 |
| *** rdx_matt has joined #openstack-infra | 01:54 | |
| *** heyongli has quit IRC | 01:54 | |
| *** heyongli has joined #openstack-infra | 01:55 | |
| *** ddieterly has quit IRC | 01:56 | |
| *** akshai has quit IRC | 01:56 | |
| *** clenimar_ has quit IRC | 01:56 | |
| sdake_ | hey folks | 01:56 |
| sdake_ | quick q | 01:56 |
| sdake_ | http://logs.openstack.org/76/339776/2/check/gate-kolla-dsvm-build-ubuntu-source/ba07478/console.html.gz#_2016-07-09_04_33_53_110704 | 01:56 |
| *** clenimar_ has joined #openstack-infra | 01:56 | |
| sdake_ | my understanding is a directory called /etc/apt/sources.list.available.d should be in the image | 01:57 |
| sdake_ | yet it is not | 01:57 |
| clarkb | sdake_: likely we havent managed to update the image in that region yet | 01:59 |
| *** oanson has joined #openstack-infra | 02:00 | |
| sdake_ | oh image needs updates? | 02:00 |
| sdake_ | i am planning to add another 3-5 mirrors | 02:00 |
| sdake_ | what is the typical lag between commit and image updates? | 02:00 |
| *** rkukura has quit IRC | 02:01 | |
| sdake_ | clarkb the reason I ask is I want to make sure I"m doing it correctly :) | 02:02 |
| *** PollyZ has joined #openstack-infra | 02:04 | |
| *** heyongli has quit IRC | 02:05 | |
| *** heyongli has joined #openstack-infra | 02:05 | |
| *** akshai has joined #openstack-infra | 02:06 | |
| *** Daisy has joined #openstack-infra | 02:06 | |
| *** akshai_ has joined #openstack-infra | 02:07 | |
| *** yanyanhu has joined #openstack-infra | 02:09 | |
| *** akshai has quit IRC | 02:10 | |
| *** esberglu has joined #openstack-infra | 02:10 | |
| *** EricGonczer_ has quit IRC | 02:12 | |
| *** heyongli has quit IRC | 02:15 | |
| *** heyongli has joined #openstack-infra | 02:15 | |
| *** sputnik13 has joined #openstack-infra | 02:16 | |
| *** sputnik13 has quit IRC | 02:16 | |
| *** PollyZ has quit IRC | 02:16 | |
| *** cody-somerville has quit IRC | 02:21 | |
| *** Daisy has quit IRC | 02:22 | |
| *** Daisy has joined #openstack-infra | 02:23 | |
| *** heyongli has quit IRC | 02:25 | |
| *** heyongli has joined #openstack-infra | 02:26 | |
| *** baoli has joined #openstack-infra | 02:26 | |
| *** ddieterly has joined #openstack-infra | 02:26 | |
| *** ramishra has joined #openstack-infra | 02:27 | |
| clarkb | we build images once a day | 02:27 |
| *** Daisy has quit IRC | 02:28 | |
| clarkb | but sometimes the builds or uploads fail | 02:28 |
| *** Daisy has joined #openstack-infra | 02:28 | |
| *** rdx_matt has quit IRC | 02:29 | |
| sdake_ | clarkb cool thanks | 02:31 |
| *** ddieterly has quit IRC | 02:31 | |
| *** Daisy has quit IRC | 02:33 | |
| *** zeih has joined #openstack-infra | 02:35 | |
| *** heyongli has quit IRC | 02:35 | |
| *** sdake_ is now known as sdake | 02:35 | |
| *** heyongli has joined #openstack-infra | 02:36 | |
| *** zeih has quit IRC | 02:39 | |
| *** Daisy has joined #openstack-infra | 02:40 | |
| *** ramishra has quit IRC | 02:42 | |
| *** ramishra has joined #openstack-infra | 02:43 | |
| *** Daisy has quit IRC | 02:43 | |
| *** Daisy has joined #openstack-infra | 02:43 | |
| *** kushal has joined #openstack-infra | 02:45 | |
| *** heyongli has quit IRC | 02:46 | |
| *** heyongli has joined #openstack-infra | 02:46 | |
| *** sflanigan is now known as sflanigan_afk | 02:55 | |
| *** heyongli has quit IRC | 02:56 | |
| *** heyongli has joined #openstack-infra | 02:56 | |
| *** esberglu has quit IRC | 03:01 | |
| *** psilvad has quit IRC | 03:01 | |
| *** ramishra has quit IRC | 03:02 | |
| *** ramishra has joined #openstack-infra | 03:03 | |
| *** coolsvap has quit IRC | 03:04 | |
| *** heyongli has quit IRC | 03:06 | |
| *** heyongli has joined #openstack-infra | 03:06 | |
| *** clenimar_ has quit IRC | 03:08 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add helper functions to db api for filtering runs on status https://review.openstack.org/328574 | 03:09 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add DB API method to get run wall times by run_metadata https://review.openstack.org/328478 | 03:09 |
| *** bmjen has quit IRC | 03:10 | |
| *** ramishra has quit IRC | 03:10 | |
| *** roxanaghe has joined #openstack-infra | 03:10 | |
| *** hurgleburgler has quit IRC | 03:11 | |
| *** ramishra has joined #openstack-infra | 03:12 | |
| *** hurgleburgler has joined #openstack-infra | 03:13 | |
| *** PollyZ has joined #openstack-infra | 03:13 | |
| *** bmjen has joined #openstack-infra | 03:14 | |
| *** sflanigan_afk is now known as sflanigan | 03:14 | |
| *** heyongli has quit IRC | 03:16 | |
| *** heyongli has joined #openstack-infra | 03:17 | |
| *** coolsvap has joined #openstack-infra | 03:17 | |
| *** treaki__ has joined #openstack-infra | 03:19 | |
| *** julim has quit IRC | 03:22 | |
| *** treaki_ has quit IRC | 03:23 | |
| *** yamamot__ has joined #openstack-infra | 03:24 | |
| *** baoli has quit IRC | 03:25 | |
| *** rdx_matt has joined #openstack-infra | 03:25 | |
| *** PollyZ has quit IRC | 03:25 | |
| *** heyongli has quit IRC | 03:27 | |
| *** heyongli has joined #openstack-infra | 03:27 | |
| *** Daisy has quit IRC | 03:28 | |
| *** ramishra has quit IRC | 03:28 | |
| *** Daisy has joined #openstack-infra | 03:28 | |
| *** ramishra has joined #openstack-infra | 03:33 | |
| *** Daisy has quit IRC | 03:33 | |
| *** kushal has quit IRC | 03:34 | |
| *** Daisy has joined #openstack-infra | 03:34 | |
| *** zeih has joined #openstack-infra | 03:35 | |
| *** heyongli has quit IRC | 03:37 | |
| *** baoli has joined #openstack-infra | 03:37 | |
| *** bmjen has quit IRC | 03:37 | |
| *** hurgleburgler has quit IRC | 03:37 | |
| *** heyongli has joined #openstack-infra | 03:37 | |
| *** bmjen_ is now known as bmjen | 03:37 | |
| *** kushal has joined #openstack-infra | 03:38 | |
| *** bhavik has joined #openstack-infra | 03:38 | |
| *** ramishra has quit IRC | 03:38 | |
| *** Daisy has quit IRC | 03:39 | |
| *** zeih has quit IRC | 03:40 | |
| *** ramishra has joined #openstack-infra | 03:40 | |
| *** Daisy has joined #openstack-infra | 03:45 | |
| *** heyongli has quit IRC | 03:47 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Use ovs-interface-undefault instead of ovs-native job https://review.openstack.org/338944 | 03:47 |
| *** heyongli has joined #openstack-infra | 03:47 | |
| *** Daisy has quit IRC | 03:50 | |
| *** Daisy has joined #openstack-infra | 03:52 | |
| *** Sukhdev has joined #openstack-infra | 03:53 | |
| *** kushal has quit IRC | 03:55 | |
| *** Julien-zte has quit IRC | 03:56 | |
| *** Daisy has quit IRC | 03:56 | |
| *** Nikolay_St has joined #openstack-infra | 03:56 | |
| *** Daisy has joined #openstack-infra | 03:57 | |
| *** heyongli has quit IRC | 03:57 | |
| *** heyongli has joined #openstack-infra | 03:58 | |
| *** psilvad has joined #openstack-infra | 03:59 | |
| *** bhavik has quit IRC | 03:59 | |
| *** rdx_matt has quit IRC | 04:00 | |
| *** kushal has joined #openstack-infra | 04:02 | |
| *** Daisy has quit IRC | 04:02 | |
| *** heyongli has quit IRC | 04:08 | |
| *** heyongli has joined #openstack-infra | 04:08 | |
| *** hurgleburgler has joined #openstack-infra | 04:08 | |
| *** Daisy has joined #openstack-infra | 04:09 | |
| *** dims has quit IRC | 04:11 | |
| *** amotoki has joined #openstack-infra | 04:13 | |
| *** Daisy has quit IRC | 04:13 | |
| *** zul has joined #openstack-infra | 04:15 | |
| *** Daisy has joined #openstack-infra | 04:15 | |
| *** PollyZ has joined #openstack-infra | 04:17 | |
| *** heyongli has quit IRC | 04:18 | |
| *** heyongli has joined #openstack-infra | 04:18 | |
| *** Daisy has quit IRC | 04:20 | |
| *** jmccrory is now known as jmccrory_away_th | 04:20 | |
| *** jmccrory_away_th is now known as jmccrory_away | 04:20 | |
| *** Daisy has joined #openstack-infra | 04:21 | |
| *** Julien-zte has joined #openstack-infra | 04:21 | |
| *** roxanaghe has quit IRC | 04:22 | |
| *** roxanaghe has joined #openstack-infra | 04:25 | |
| *** Daisy has quit IRC | 04:26 | |
| *** Daisy has joined #openstack-infra | 04:27 | |
| *** heyongli has quit IRC | 04:28 | |
| *** heyongli has joined #openstack-infra | 04:28 | |
| *** akshai_ has quit IRC | 04:30 | |
| *** akshai has joined #openstack-infra | 04:30 | |
| *** Daisy has quit IRC | 04:31 | |
| *** zeih has joined #openstack-infra | 04:36 | |
| *** gongysh has quit IRC | 04:37 | |
| *** Daisy has joined #openstack-infra | 04:38 | |
| *** TaylorH has joined #openstack-infra | 04:38 | |
| *** heyongli has quit IRC | 04:38 | |
| *** heyongli has joined #openstack-infra | 04:39 | |
| *** akshai has quit IRC | 04:39 | |
| *** zeih has quit IRC | 04:40 | |
| *** Nikolay_St has quit IRC | 04:42 | |
| *** TaylorHuang has quit IRC | 04:42 | |
| *** psachin has joined #openstack-infra | 04:43 | |
| *** sdake has quit IRC | 04:43 | |
| *** Daisy has quit IRC | 04:44 | |
| *** bhavik has joined #openstack-infra | 04:48 | |
| *** heyongli has quit IRC | 04:49 | |
| *** heyongli has joined #openstack-infra | 04:49 | |
| *** yamamot__ has quit IRC | 04:51 | |
| *** Daisy has joined #openstack-infra | 04:51 | |
| *** baoli has quit IRC | 04:52 | |
| *** Daisy has quit IRC | 04:54 | |
| *** Daisy has joined #openstack-infra | 04:54 | |
| *** rdx_matt has joined #openstack-infra | 04:55 | |
| *** heyongli has quit IRC | 04:59 | |
| *** heyongli has joined #openstack-infra | 04:59 | |
| *** mtanino has joined #openstack-infra | 05:01 | |
| *** Daisy has quit IRC | 05:07 | |
| *** Daisy has joined #openstack-infra | 05:07 | |
| *** hurgleburgler has quit IRC | 05:08 | |
| *** Daisy_ has joined #openstack-infra | 05:08 | |
| *** heyongli has quit IRC | 05:09 | |
| *** heyongli has joined #openstack-infra | 05:09 | |
| *** Daisy has quit IRC | 05:12 | |
| *** baoli has joined #openstack-infra | 05:13 | |
| *** mtanino has quit IRC | 05:14 | |
| *** karthikp_ has joined #openstack-infra | 05:17 | |
| *** pcaruana has quit IRC | 05:17 | |
| *** baoli has quit IRC | 05:17 | |
| *** gongysh has joined #openstack-infra | 05:18 | |
| *** heyongli has quit IRC | 05:19 | |
| *** gouthamr has joined #openstack-infra | 05:20 | |
| *** heyongli has joined #openstack-infra | 05:20 | |
| *** Daisy_ has quit IRC | 05:21 | |
| *** Daisy has joined #openstack-infra | 05:21 | |
| *** nadya has joined #openstack-infra | 05:22 | |
| *** sandanar has joined #openstack-infra | 05:22 | |
| *** gouthamr_ has joined #openstack-infra | 05:23 | |
| *** sandanar has quit IRC | 05:24 | |
| *** dims has joined #openstack-infra | 05:26 | |
| *** Daisy has quit IRC | 05:26 | |
| *** gouthamr has quit IRC | 05:27 | |
| *** karthik__ has joined #openstack-infra | 05:27 | |
| *** karthikp_ has quit IRC | 05:27 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Add neutron-dynamic-routing to PROJECT list https://review.openstack.org/340222 | 05:28 |
| *** Daisy has joined #openstack-infra | 05:30 | |
| *** heyongli has quit IRC | 05:30 | |
| *** rdx_matt has quit IRC | 05:30 | |
| *** sdake has joined #openstack-infra | 05:31 | |
| *** savihou has joined #openstack-infra | 05:33 | |
| *** sdake has quit IRC | 05:33 | |
| *** jamielennox is now known as jamielennox|away | 05:34 | |
| *** heyongli has joined #openstack-infra | 05:35 | |
| *** zeih has joined #openstack-infra | 05:37 | |
| *** roxanaghe has quit IRC | 05:37 | |
| *** heyongli has quit IRC | 05:40 | |
| *** karthik__ has quit IRC | 05:40 | |
| *** yamamot__ has joined #openstack-infra | 05:40 | |
| *** heyongli has joined #openstack-infra | 05:40 | |
| *** karthikp_ has joined #openstack-infra | 05:40 | |
| *** rkukura has joined #openstack-infra | 05:41 | |
| *** Sukhdev has quit IRC | 05:42 | |
| *** zeih has quit IRC | 05:42 | |
| *** baoli has joined #openstack-infra | 05:44 | |
| *** tqtran has joined #openstack-infra | 05:44 | |
| *** tqtran has quit IRC | 05:48 | |
| *** baoli has quit IRC | 05:48 | |
| *** jamielennox|away is now known as jamielennox | 05:50 | |
| *** heyongli has quit IRC | 05:50 | |
| *** nadya has quit IRC | 05:52 | |
| *** heyongli has joined #openstack-infra | 05:53 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Use ovs-interface-undefault instead of ovs-native job https://review.openstack.org/338944 | 05:57 |
| *** karthikp_ has quit IRC | 05:57 | |
| *** karthikp_ has joined #openstack-infra | 05:57 | |
| *** heyongli has quit IRC | 06:00 | |
| *** sandanar has joined #openstack-infra | 06:00 | |
| *** sandanar_ has joined #openstack-infra | 06:00 | |
| *** heyongli has joined #openstack-infra | 06:01 | |
| *** pgadiya has joined #openstack-infra | 06:02 | |
| *** karthikp_ has quit IRC | 06:02 | |
| *** baoli has joined #openstack-infra | 06:05 | |
| *** vipul_ has joined #openstack-infra | 06:09 | |
| *** baoli has quit IRC | 06:09 | |
| *** heyongli has quit IRC | 06:11 | |
| *** heyongli has joined #openstack-infra | 06:11 | |
| *** javeriak has joined #openstack-infra | 06:12 | |
| *** Daisy_ has joined #openstack-infra | 06:16 | |
| *** slaweq has joined #openstack-infra | 06:17 | |
| *** Daisy has quit IRC | 06:18 | |
| *** ramishra has quit IRC | 06:18 | |
| *** ramishra has joined #openstack-infra | 06:20 | |
| *** heyongli has quit IRC | 06:21 | |
| *** heyongli has joined #openstack-infra | 06:21 | |
| *** rcernin has joined #openstack-infra | 06:22 | |
| *** rdx_matt has joined #openstack-infra | 06:23 | |
| *** Daisy_ has quit IRC | 06:24 | |
| *** Daisy has joined #openstack-infra | 06:25 | |
| *** nadya has joined #openstack-infra | 06:25 | |
| *** dkaiharodsev has joined #openstack-infra | 06:25 | |
| *** andreas_s has joined #openstack-infra | 06:27 | |
| *** Daisy has quit IRC | 06:29 | |
| *** gouthamr_ has quit IRC | 06:30 | |
| *** dkaiharodsev has quit IRC | 06:30 | |
| *** Daisy has joined #openstack-infra | 06:30 | |
| *** heyongli has quit IRC | 06:31 | |
| *** heyongli has joined #openstack-infra | 06:31 | |
| *** Daisy has quit IRC | 06:35 | |
| *** gouthamr has joined #openstack-infra | 06:36 | |
| *** Daisy has joined #openstack-infra | 06:36 | |
| *** gongysh has quit IRC | 06:37 | |
| *** gouthamr_ has joined #openstack-infra | 06:38 | |
| *** zeih has joined #openstack-infra | 06:38 | |
| *** rossella_s has quit IRC | 06:40 | |
| *** rossella_s has joined #openstack-infra | 06:40 | |
| *** gouthamr has quit IRC | 06:41 | |
| *** Daisy has quit IRC | 06:41 | |
| *** heyongli has quit IRC | 06:41 | |
| *** heyongli has joined #openstack-infra | 06:42 | |
| *** zeih has quit IRC | 06:43 | |
| yolanda | good morning | 06:46 |
| *** Daisy has joined #openstack-infra | 06:47 | |
| *** Nikolay_St has joined #openstack-infra | 06:47 | |
| *** Ravikiran_K has joined #openstack-infra | 06:50 | |
| *** PollyZ has quit IRC | 06:50 | |
| *** pcaruana has joined #openstack-infra | 06:51 | |
| *** heyongli has quit IRC | 06:52 | |
| *** heyongli has joined #openstack-infra | 06:52 | |
| *** isaacb has joined #openstack-infra | 06:53 | |
| *** Daisy_ has joined #openstack-infra | 06:56 | |
| *** Nikolay_St has quit IRC | 06:57 | |
| *** Daisy has quit IRC | 06:59 | |
| *** baoli has joined #openstack-infra | 07:02 | |
| *** heyongli has quit IRC | 07:02 | |
| *** heyongli has joined #openstack-infra | 07:02 | |
| *** migi_not_here is now known as migi | 07:03 | |
| *** ccamacho has joined #openstack-infra | 07:03 | |
| *** nadya has quit IRC | 07:04 | |
| *** coolsvap has quit IRC | 07:05 | |
| *** dkaiharodsev has joined #openstack-infra | 07:05 | |
| *** coolsvap has joined #openstack-infra | 07:06 | |
| *** baoli has quit IRC | 07:07 | |
| *** tesseract- has joined #openstack-infra | 07:08 | |
| *** dkaiharodsev has quit IRC | 07:10 | |
| *** heyongli has quit IRC | 07:12 | |
| *** heyongli has joined #openstack-infra | 07:13 | |
| *** arxcruz has joined #openstack-infra | 07:15 | |
| *** mikelk has joined #openstack-infra | 07:16 | |
| *** gongysh has joined #openstack-infra | 07:17 | |
| *** garyk has quit IRC | 07:19 | |
| *** garyk has joined #openstack-infra | 07:21 | |
| *** vincentll has joined #openstack-infra | 07:21 | |
| *** Hal has joined #openstack-infra | 07:22 | |
| *** Hal is now known as Guest81377 | 07:22 | |
| *** heyongli has quit IRC | 07:22 | |
| *** heyongli has joined #openstack-infra | 07:23 | |
| *** rcarrillocruz has joined #openstack-infra | 07:24 | |
| *** dkaiharodsev has joined #openstack-infra | 07:25 | |
| *** e0ne has joined #openstack-infra | 07:28 | |
| *** dkaiharodsev has quit IRC | 07:30 | |
| *** dtardivel has joined #openstack-infra | 07:30 | |
| *** jlanoux has joined #openstack-infra | 07:31 | |
| *** Daisy_ has quit IRC | 07:32 | |
| *** Daisy has joined #openstack-infra | 07:32 | |
| *** heyongli has quit IRC | 07:33 | |
| *** heyongli has joined #openstack-infra | 07:33 | |
| *** Guest81377 has quit IRC | 07:34 | |
| *** kaisers1 has left #openstack-infra | 07:36 | |
| *** Daisy has quit IRC | 07:37 | |
| *** Daisy has joined #openstack-infra | 07:38 | |
| *** jpich has joined #openstack-infra | 07:39 | |
| *** zeih has joined #openstack-infra | 07:39 | |
| *** ifarkas has joined #openstack-infra | 07:40 | |
| *** Daisy has quit IRC | 07:43 | |
| *** heyongli has quit IRC | 07:43 | |
| *** hferenc has joined #openstack-infra | 07:44 | |
| *** zeih has quit IRC | 07:44 | |
| *** nmagnezi has joined #openstack-infra | 07:44 | |
| *** dkaiharodsev has joined #openstack-infra | 07:45 | |
| *** heyongli has joined #openstack-infra | 07:45 | |
| *** dkaiharodsev has quit IRC | 07:46 | |
| *** kaisers has quit IRC | 07:46 | |
| *** dkaiharodsev has joined #openstack-infra | 07:46 | |
| *** tqtran has joined #openstack-infra | 07:46 | |
| *** dkaiharodsev has quit IRC | 07:46 | |
| *** dkaiharodsev has joined #openstack-infra | 07:47 | |
| *** dkaiharodsev has quit IRC | 07:48 | |
| *** dkaiharodsev has joined #openstack-infra | 07:48 | |
| *** pilgrimstack has joined #openstack-infra | 07:48 | |
| *** coolsvap has quit IRC | 07:49 | |
| *** Daisy has joined #openstack-infra | 07:49 | |
| *** kaisers has joined #openstack-infra | 07:49 | |
| *** tqtran has quit IRC | 07:50 | |
| *** jtomasek has quit IRC | 07:52 | |
| *** dkaiharodsev has quit IRC | 07:53 | |
| *** heyongli has quit IRC | 07:53 | |
| *** heyongli has joined #openstack-infra | 07:53 | |
| *** Daisy has quit IRC | 07:54 | |
| hferenc | hello all! | 07:56 |
| *** lucas|afk is now known as lucasagomes | 07:58 | |
| lucasagomes | morning all | 07:58 |
| hferenc | could somebody from Tempest please look at this https://review.openstack.org/#/c/329832/4/jenkins/jobs/tempest-jobs.yaml@36 | 07:59 |
| *** zzzeek has quit IRC | 08:00 | |
| *** coolsvap has joined #openstack-infra | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| *** bhavik has quit IRC | 08:00 | |
| *** Daisy has joined #openstack-infra | 08:01 | |
| *** heyongli has quit IRC | 08:03 | |
| *** binbincong has joined #openstack-infra | 08:04 | |
| *** ramishra has quit IRC | 08:06 | |
| *** Daisy has quit IRC | 08:06 | |
| *** heyongli has joined #openstack-infra | 08:06 | |
| *** jistr has quit IRC | 08:06 | |
| *** Daisy has joined #openstack-infra | 08:06 | |
| *** jistr has joined #openstack-infra | 08:07 | |
| *** ramishra has joined #openstack-infra | 08:08 | |
| *** gouthamr_ has quit IRC | 08:09 | |
| *** jistr has quit IRC | 08:11 | |
| *** jistr has joined #openstack-infra | 08:11 | |
| *** heyongli has quit IRC | 08:14 | |
| *** heyongli has joined #openstack-infra | 08:14 | |
| *** derekh has joined #openstack-infra | 08:14 | |
| *** shardy has joined #openstack-infra | 08:14 | |
| *** sshnaidm|afk is now known as sshnaidm | 08:16 | |
| openstackgerrit | Tim Irnich proposed openstack-infra/project-config: Adding project for Gluon fuel plugin. https://review.openstack.org/339488 | 08:16 |
| *** shashank_hegde has quit IRC | 08:16 | |
| *** Daisy_ has joined #openstack-infra | 08:17 | |
| *** asettle has joined #openstack-infra | 08:17 | |
| *** Daisy_ has quit IRC | 08:17 | |
| *** eezhova has joined #openstack-infra | 08:19 | |
| *** dizquierdo has joined #openstack-infra | 08:19 | |
| *** Daisy has quit IRC | 08:19 | |
| openstackgerrit | Tim Irnich proposed openstack-infra/project-config: Adding project for Gluon fuel plugin. https://review.openstack.org/339488 | 08:20 |
| *** sorantis has joined #openstack-infra | 08:20 | |
| *** Hal has joined #openstack-infra | 08:20 | |
| *** Hal is now known as Guest55540 | 08:21 | |
| *** electrofelix has joined #openstack-infra | 08:21 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Change username from stack to $USER in tempest https://review.openstack.org/339118 | 08:22 |
| *** heyongli has quit IRC | 08:24 | |
| *** heyongli has joined #openstack-infra | 08:24 | |
| *** Daisy has joined #openstack-infra | 08:24 | |
| lennyb | andreaf, gmann: thanks for the comments. Could you pls, review again #link https://review.openstack.org/#/c/335447/ | 08:26 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE TESTING https://review.openstack.org/316436 | 08:26 |
| *** asettle has quit IRC | 08:27 | |
| *** asettle has joined #openstack-infra | 08:28 | |
| *** dizquierdo has quit IRC | 08:28 | |
| *** Daisy has quit IRC | 08:29 | |
| *** Daisy has joined #openstack-infra | 08:29 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE TESTING https://review.openstack.org/316436 | 08:29 |
| *** heyongli has quit IRC | 08:34 | |
| *** heyongli has joined #openstack-infra | 08:34 | |
| *** mgould|afk is now known as mgould | 08:37 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackci: Pin nodepool to latest tag 0.3.0 for 3rd party CI https://review.openstack.org/293112 | 08:38 |
| *** Daisy has quit IRC | 08:38 | |
| *** Daisy has joined #openstack-infra | 08:39 | |
| *** pblaho has joined #openstack-infra | 08:39 | |
| *** Daisy_ has joined #openstack-infra | 08:39 | |
| *** zeih has joined #openstack-infra | 08:40 | |
| *** dingyichen has quit IRC | 08:42 | |
| *** javeriak has quit IRC | 08:42 | |
| *** Daisy has quit IRC | 08:43 | |
| *** heyongli has quit IRC | 08:44 | |
| *** zeih has quit IRC | 08:45 | |
| *** heyongli has joined #openstack-infra | 08:45 | |
| *** tosky has joined #openstack-infra | 08:47 | |
| openstackgerrit | Merged openstack-infra/project-config: move gate-{name}-puppet-lint on ubuntu-xenial https://review.openstack.org/339662 | 08:48 |
| *** AJaeger_ has joined #openstack-infra | 08:49 | |
| *** bhavik has joined #openstack-infra | 08:50 | |
| *** Daisy has joined #openstack-infra | 08:51 | |
| *** Daisy_ has quit IRC | 08:51 | |
| *** AJaeger has quit IRC | 08:52 | |
| *** chem``` has joined #openstack-infra | 08:53 | |
| *** e0ne has quit IRC | 08:54 | |
| *** chem``` is now known as chem | 08:54 | |
| *** heyongli has quit IRC | 08:55 | |
| *** heyongli has joined #openstack-infra | 08:55 | |
| *** Daisy_ has joined #openstack-infra | 08:56 | |
| *** dtantsur|afk is now known as dtantsur | 08:56 | |
| *** chem`` has quit IRC | 08:57 | |
| *** nadya has joined #openstack-infra | 08:57 | |
| *** Daisy has quit IRC | 08:58 | |
| *** bauwser is now known as bauzas | 09:00 | |
| *** Daisy_ has quit IRC | 09:00 | |
| *** Daisy has joined #openstack-infra | 09:01 | |
| *** Daisy_ has joined #openstack-infra | 09:03 | |
| *** heyongli has quit IRC | 09:05 | |
| *** heyongli has joined #openstack-infra | 09:05 | |
| *** Daisy has quit IRC | 09:06 | |
| *** javeriak has joined #openstack-infra | 09:08 | |
| *** Daisy_ has quit IRC | 09:08 | |
| *** Daisy has joined #openstack-infra | 09:09 | |
| *** Daisy has quit IRC | 09:13 | |
| *** jed56 has joined #openstack-infra | 09:14 | |
| *** Daisy has joined #openstack-infra | 09:14 | |
| *** heyongli has quit IRC | 09:15 | |
| *** heyongli has joined #openstack-infra | 09:15 | |
| *** bhavik has quit IRC | 09:18 | |
| *** sileht has quit IRC | 09:18 | |
| *** sileht has joined #openstack-infra | 09:19 | |
| *** heyongli has quit IRC | 09:25 | |
| *** heyongli has joined #openstack-infra | 09:26 | |
| *** e0ne has joined #openstack-infra | 09:26 | |
| *** hashar has joined #openstack-infra | 09:29 | |
| *** Julien-zte has quit IRC | 09:29 | |
| AJaeger_ | hferenc: for tempest, best ask on #openstack-qa | 09:29 |
| *** gongysh has quit IRC | 09:32 | |
| *** coolsvap has quit IRC | 09:34 | |
| openstackgerrit | Merged openstack-infra/storyboard: Add example commands for the Project api https://review.openstack.org/337730 | 09:35 |
| *** coolsvap has joined #openstack-infra | 09:35 | |
| *** heyongli has quit IRC | 09:36 | |
| *** heyongli has joined #openstack-infra | 09:36 | |
| *** bhavik has joined #openstack-infra | 09:38 | |
| hferenc | AJaeger_: thx | 09:40 |
| *** zeih has joined #openstack-infra | 09:41 | |
| *** zeih has quit IRC | 09:45 | |
| *** heyongli has quit IRC | 09:46 | |
| *** heyongli has joined #openstack-infra | 09:46 | |
| *** Nikolay_St has joined #openstack-infra | 09:53 | |
| *** aurelien__ has joined #openstack-infra | 09:55 | |
| *** heyongli has quit IRC | 09:56 | |
| *** heyongli has joined #openstack-infra | 09:56 | |
| *** Ravikiran_K has quit IRC | 09:57 | |
| *** dizquierdo has joined #openstack-infra | 10:05 | |
| *** vipul_ has quit IRC | 10:05 | |
| *** heyongli has quit IRC | 10:06 | |
| *** heyongli has joined #openstack-infra | 10:07 | |
| *** claudiub has joined #openstack-infra | 10:08 | |
| *** Daisy_ has joined #openstack-infra | 10:09 | |
| *** javeriak has quit IRC | 10:09 | |
| *** Daisy has quit IRC | 10:12 | |
| openstackgerrit | Merged openstack-infra/storyboard: Allow superusers to delete comments https://review.openstack.org/338164 | 10:14 |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Add hyperconverged Ceph to the OVB/HA job https://review.openstack.org/338088 | 10:15 |
| *** heyongli has quit IRC | 10:17 | |
| *** heyongli has joined #openstack-infra | 10:17 | |
| *** zeih has joined #openstack-infra | 10:17 | |
| *** Daisy has joined #openstack-infra | 10:20 | |
| *** rodrigods has quit IRC | 10:21 | |
| *** rodrigods has joined #openstack-infra | 10:21 | |
| *** Daisy_ has quit IRC | 10:23 | |
| *** zhurong has quit IRC | 10:24 | |
| *** heyongli has quit IRC | 10:27 | |
| *** heyongli has joined #openstack-infra | 10:30 | |
| *** javeriak has joined #openstack-infra | 10:33 | |
| *** yanyanhu has quit IRC | 10:33 | |
| *** Daisy has quit IRC | 10:37 | |
| *** isaacb has quit IRC | 10:37 | |
| *** Daisy has joined #openstack-infra | 10:37 | |
| *** heyongli has quit IRC | 10:37 | |
| *** heyongli has joined #openstack-infra | 10:37 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Add ironic-dsvm-multitest experimental job. https://review.openstack.org/340295 | 10:41 |
| *** Daisy_ has joined #openstack-infra | 10:41 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:43 | |
| *** Daisy has quit IRC | 10:44 | |
| *** thorst has joined #openstack-infra | 10:46 | |
| *** thorst has quit IRC | 10:47 | |
| *** thorst has joined #openstack-infra | 10:47 | |
| *** heyongli has quit IRC | 10:47 | |
| *** tqtran has joined #openstack-infra | 10:48 | |
| *** thorst_ has joined #openstack-infra | 10:50 | |
| *** heyongli has joined #openstack-infra | 10:50 | |
| *** Daisy_ has quit IRC | 10:51 | |
| openstackgerrit | Merged openstack-infra/storyboard: Allow editing and deletion of comments to be disabled https://review.openstack.org/338165 | 10:51 |
| *** thorst has quit IRC | 10:52 | |
| *** tqtran has quit IRC | 10:52 | |
| *** isaacb has joined #openstack-infra | 10:53 | |
| *** Na3iL has joined #openstack-infra | 10:53 | |
| *** lucasagomes is now known as lucas-hungry | 10:56 | |
| *** heyongli has quit IRC | 10:58 | |
| *** heyongli has joined #openstack-infra | 10:58 | |
| *** Na3iL has quit IRC | 10:58 | |
| *** isaacb has quit IRC | 10:59 | |
| *** john-dav_ has joined #openstack-infra | 11:01 | |
| *** john-dav_ is now known as john-davidge_ | 11:01 | |
| openstackgerrit | Tomas Turek proposed openstack-infra/jenkins-job-builder: Adds support rerun matrix part to the naginator https://review.openstack.org/330959 | 11:05 |
| *** heyongli has quit IRC | 11:08 | |
| *** heyongli has joined #openstack-infra | 11:08 | |
| openstackgerrit | Dong Ma proposed openstack-infra/project-config: npm-install macro can install nodejs 6.x https://review.openstack.org/337481 | 11:09 |
| *** savihou has quit IRC | 11:10 | |
| *** Daisy has joined #openstack-infra | 11:12 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 11:13 |
| *** sigmavirus_away is now known as sigmavirus | 11:14 | |
| *** Daisy has quit IRC | 11:17 | |
| *** heyongli has quit IRC | 11:18 | |
| *** heyongli has joined #openstack-infra | 11:18 | |
| *** sdake has joined #openstack-infra | 11:19 | |
| *** Qiming_ has joined #openstack-infra | 11:19 | |
| *** savihou has joined #openstack-infra | 11:19 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 11:20 |
| *** Qiming has quit IRC | 11:20 | |
| *** jtomasek_ has joined #openstack-infra | 11:22 | |
| *** TaylorH has quit IRC | 11:22 | |
| *** TaylorH has joined #openstack-infra | 11:22 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 11:24 |
| *** sorantis has quit IRC | 11:24 | |
| *** Jeffrey4l has joined #openstack-infra | 11:27 | |
| *** heyongli has quit IRC | 11:28 | |
| *** heyongli has joined #openstack-infra | 11:29 | |
| *** gordc has joined #openstack-infra | 11:31 | |
| openstackgerrit | Alexander Evseev proposed openstack-infra/puppet-jenkins: Add workaround for Jenkins' SECURITY-170 https://review.openstack.org/334400 | 11:33 |
| *** jed56 has quit IRC | 11:35 | |
| *** heyongli has quit IRC | 11:39 | |
| *** heyongli has joined #openstack-infra | 11:39 | |
| *** ldnunes has joined #openstack-infra | 11:39 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Use venv for all tempest commands https://review.openstack.org/339118 | 11:39 |
| *** baoli has joined #openstack-infra | 11:40 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE TESTING https://review.openstack.org/316436 | 11:40 |
| *** sorantis has joined #openstack-infra | 11:42 | |
| *** jtomasek_ has quit IRC | 11:44 | |
| *** baoli has quit IRC | 11:44 | |
| *** makowals has joined #openstack-infra | 11:44 | |
| *** savihou has quit IRC | 11:47 | |
| *** sdake has quit IRC | 11:48 | |
| *** zul has quit IRC | 11:48 | |
| *** savihou has joined #openstack-infra | 11:48 | |
| *** heyongli has quit IRC | 11:49 | |
| *** heyongli has joined #openstack-infra | 11:49 | |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Add experimental grenade job for designate https://review.openstack.org/339580 | 11:50 |
| *** Guest55540 has quit IRC | 11:51 | |
| *** Hal has joined #openstack-infra | 11:52 | |
| *** Hal is now known as Guest2250 | 11:52 | |
| *** zul has joined #openstack-infra | 11:55 | |
| *** ddieterly has joined #openstack-infra | 11:58 | |
| *** eezhova has quit IRC | 11:59 | |
| *** heyongli has quit IRC | 11:59 | |
| *** raildo-afk is now known as raildo | 11:59 | |
| *** heyongli has joined #openstack-infra | 12:00 | |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Add experimental grenade job for designate https://review.openstack.org/339580 | 12:00 |
| *** makowals_ has joined #openstack-infra | 12:00 | |
| *** markusry has joined #openstack-infra | 12:02 | |
| *** tpsilva has joined #openstack-infra | 12:02 | |
| *** ddieterly has quit IRC | 12:03 | |
| *** saggi1 has joined #openstack-infra | 12:03 | |
| *** makowals has quit IRC | 12:04 | |
| saggi1 | Is there a way to reserve a meeting room for one time only? We usually have the talk tomorrow at 15:00 but we need to have it earlier than that. | 12:05 |
| *** eezhova has joined #openstack-infra | 12:06 | |
| *** ociuhandu has quit IRC | 12:09 | |
| *** heyongli has quit IRC | 12:09 | |
| *** lucas-hungry is now known as lucasagomes | 12:10 | |
| *** heyongli has joined #openstack-infra | 12:10 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 12:12 |
| *** trown|outtypewww is now known as trown | 12:12 | |
| *** weshay has joined #openstack-infra | 12:14 | |
| *** coolsvap has quit IRC | 12:18 | |
| *** cbader has joined #openstack-infra | 12:18 | |
| *** zul has quit IRC | 12:19 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Configure a different port for httpd ipxe https://review.openstack.org/340339 | 12:20 |
| *** heyongli has quit IRC | 12:20 | |
| *** makowals has joined #openstack-infra | 12:21 | |
| *** ccamacho is now known as ccamacho|lunch | 12:21 | |
| *** heyongli has joined #openstack-infra | 12:22 | |
| *** rhallisey has joined #openstack-infra | 12:23 | |
| *** scottda_vacation has joined #openstack-infra | 12:23 | |
| *** zul has joined #openstack-infra | 12:24 | |
| *** makowals_ has quit IRC | 12:25 | |
| *** pradk has joined #openstack-infra | 12:26 | |
| *** sshnaidm is now known as sshnaidm|afk | 12:29 | |
| *** heyongli has quit IRC | 12:30 | |
| *** heyongli has joined #openstack-infra | 12:30 | |
| openstackgerrit | Renat Akhmerov proposed openstack-infra/project-config: Change mistral-extra jobs https://review.openstack.org/340346 | 12:32 |
| *** scottda_vacation is now known as scottda | 12:32 | |
| *** heyongli has quit IRC | 12:40 | |
| *** abregman has joined #openstack-infra | 12:40 | |
| *** heyongli has joined #openstack-infra | 12:40 | |
| *** ddieterly has joined #openstack-infra | 12:41 | |
| *** zhurong has joined #openstack-infra | 12:42 | |
| *** m3m0 has joined #openstack-infra | 12:44 | |
| *** rlandy has joined #openstack-infra | 12:44 | |
| *** notnownikki has joined #openstack-infra | 12:45 | |
| *** hrubi has quit IRC | 12:45 | |
| *** eantyshev has joined #openstack-infra | 12:45 | |
| *** ddieterly has quit IRC | 12:46 | |
| *** pradk has quit IRC | 12:47 | |
| *** tqtran has joined #openstack-infra | 12:50 | |
| *** heyongli has quit IRC | 12:50 | |
| *** heyongli has joined #openstack-infra | 12:51 | |
| openstackgerrit | Merged openstack-infra/storyboard: Allow worklists to be filtered by subscriber_id https://review.openstack.org/335458 | 12:53 |
| *** dprince has joined #openstack-infra | 12:53 | |
| *** tqtran has quit IRC | 12:54 | |
| *** weshay is now known as weshay_mtg | 12:55 | |
| *** eezhova has quit IRC | 12:57 | |
| *** akshai has joined #openstack-infra | 12:57 | |
| asselin__ | anyone seen this error before? http://logs.openstack.org/00/334400/2/check/gate-puppet-jenkins-puppet-lint/57bc945/console.html#_2016-07-11_11_44_22_387563 | 12:57 |
| *** ddieterly has joined #openstack-infra | 12:59 | |
| *** Julien-zte has joined #openstack-infra | 12:59 | |
| *** erlon has joined #openstack-infra | 13:00 | |
| *** heyongli has quit IRC | 13:01 | |
| *** heyongli has joined #openstack-infra | 13:01 | |
| *** makowals has quit IRC | 13:02 | |
| *** itisha has joined #openstack-infra | 13:03 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Bump up the number of OVB env workers available https://review.openstack.org/340359 | 13:03 |
| *** pt_15 has joined #openstack-infra | 13:03 | |
| *** eezhova has joined #openstack-infra | 13:04 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Bump up the number of OVB env workers available https://review.openstack.org/340359 | 13:04 |
| *** mdrabe_ has joined #openstack-infra | 13:05 | |
| *** sshnaidm|afk is now known as sshnaidm | 13:06 | |
| *** javeriak has quit IRC | 13:07 | |
| *** xyang1 has joined #openstack-infra | 13:07 | |
| *** abregman is now known as abregman|mtg | 13:07 | |
| *** markvoelker has joined #openstack-infra | 13:08 | |
| *** bhavik has quit IRC | 13:10 | |
| *** heyongli has quit IRC | 13:11 | |
| *** heyongli has joined #openstack-infra | 13:11 | |
| *** ddieterly is now known as ddieterly[away] | 13:12 | |
| *** ddieterly[away] has quit IRC | 13:12 | |
| *** hrubi has joined #openstack-infra | 13:13 | |
| *** julim has joined #openstack-infra | 13:13 | |
| *** david-lyle has quit IRC | 13:15 | |
| *** Daisy has joined #openstack-infra | 13:15 | |
| *** _ari_ has joined #openstack-infra | 13:16 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Bump up the number of OVB env workers available https://review.openstack.org/340359 | 13:17 |
| *** kgiusti has joined #openstack-infra | 13:17 | |
| *** Daisy has quit IRC | 13:20 | |
| *** pgadiya has quit IRC | 13:21 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/release-tools: Automate retiring old branches https://review.openstack.org/333875 | 13:21 |
| *** heyongli has quit IRC | 13:21 | |
| *** heyongli has joined #openstack-infra | 13:21 | |
| *** berendt has joined #openstack-infra | 13:22 | |
| *** garyk has quit IRC | 13:22 | |
| *** ccamacho|lunch is now known as ccamacho | 13:22 | |
| mugsie | can I get a few reviews on https://review.openstack.org/#/c/339580/ please ? | 13:25 |
| *** markvoelker has quit IRC | 13:27 | |
| openstackgerrit | James Page proposed openstack-infra/project-config: Fix name of layer build target https://review.openstack.org/340366 | 13:29 |
| *** heyongli has quit IRC | 13:31 | |
| *** heyongli has joined #openstack-infra | 13:32 | |
| *** yaume has joined #openstack-infra | 13:34 | |
| *** yaume_ has joined #openstack-infra | 13:35 | |
| *** yaume has quit IRC | 13:38 | |
| *** rfolco has joined #openstack-infra | 13:38 | |
| *** woodster_ has joined #openstack-infra | 13:39 | |
| *** Ravikiran_K has joined #openstack-infra | 13:39 | |
| *** esberglu has joined #openstack-infra | 13:39 | |
| *** caowei has joined #openstack-infra | 13:39 | |
| slagle | pabelanger: clarkb : would it be ok to temporarily do something like "cat /etc/nodepool/id_rsa" during the multinode ci job, and then login and live debug the job? | 13:39 |
| slagle | pabelanger: clarkb : wanted to double check, just in case infra doesnt want folks doing that | 13:40 |
| pabelanger | slagle: you can try doing that | 13:41 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/system-config: Remove cleanup directive https://review.openstack.org/329410 | 13:41 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/system-config: Rename expand-groups to ansible-expand-groups https://review.openstack.org/326465 | 13:41 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/system-config: Tidy up ansible directories https://review.openstack.org/326464 | 13:41 |
| slagle | pabelanger: ok, it will hopefully help things go faster for me to get this passing | 13:41 |
| *** isaacb has joined #openstack-infra | 13:41 | |
| *** makowals has joined #openstack-infra | 13:41 | |
| pabelanger | slagle: we usually will hold the node an add your SSH key to the jenkins user depending on the case | 13:42 |
| *** heyongli has quit IRC | 13:42 | |
| *** heyongli has joined #openstack-infra | 13:42 | |
| *** rdx_matt has quit IRC | 13:44 | |
| *** zumbi has quit IRC | 13:44 | |
| *** rbrndt has joined #openstack-infra | 13:44 | |
| *** nadya has quit IRC | 13:44 | |
| *** makowals has quit IRC | 13:44 | |
| *** _oanson has joined #openstack-infra | 13:46 | |
| *** ddieterly has joined #openstack-infra | 13:47 | |
| *** sdake has joined #openstack-infra | 13:48 | |
| *** sdake_ has joined #openstack-infra | 13:49 | |
| *** r-mibu has quit IRC | 13:49 | |
| *** sarob has joined #openstack-infra | 13:49 | |
| *** sdake has quit IRC | 13:49 | |
| *** ddieterly is now known as ddieterly[away] | 13:50 | |
| *** ddieterly[away] is now known as ddieterly | 13:50 | |
| *** tosky has quit IRC | 13:50 | |
| *** Goneri has joined #openstack-infra | 13:50 | |
| *** e0ne has quit IRC | 13:51 | |
| *** hurgleburgler has joined #openstack-infra | 13:52 | |
| *** hurgleburgler has quit IRC | 13:52 | |
| *** kien-ha has joined #openstack-infra | 13:52 | |
| *** heyongli has quit IRC | 13:52 | |
| *** heyongli has joined #openstack-infra | 13:52 | |
| *** matt-borland has joined #openstack-infra | 13:54 | |
| *** r-mibu has joined #openstack-infra | 13:54 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 13:54 |
| kien-ha | electrofelix: Hello, are you busy? | 13:55 |
| anteaya | saggi1: if you need a space fof a one time meeting I suggest booking the #openstck-sprint channel: https://wiki.openstack.org/wiki/VirtualSprints | 13:56 |
| anteaya | saggi1: ideally sprints are in day units, a full day, a half day, but if the channel isn't alredy booked then you can book it | 13:56 |
| *** eharney has joined #openstack-infra | 13:56 | |
| *** pradk has joined #openstack-infra | 13:57 | |
| anteaya | saggi1: you wouldn't get meeting minutes from it I don't think but the channel is logged | 13:57 |
| kzaitsev_mb | I'm currently thinking about adding a job (non-voting I guess) to test that our master branch is able to work with mitaka upper constraints. Wanted to ask if there are such jobs and/or if it would be accepted at all =) | 13:59 |
| electrofelix | kien-ha: just working on tidying up some rebasing of the 2.0 patches, but fire away even if I'm slow responding | 14:00 |
| *** ddieterly is now known as ddieterly[away] | 14:01 | |
| *** mriedem has joined #openstack-infra | 14:02 | |
| kien-ha | electrofelix: aaah. It's not urgent at all so do this at your convenience but I uploaded a new patch after your feedback for convert xml function. | 14:02 |
| *** heyongli has quit IRC | 14:02 | |
| *** markvoelker has joined #openstack-infra | 14:02 | |
| kien-ha | electrofelix: I hope it is what you were talking about. | 14:02 |
| *** heyongli has joined #openstack-infra | 14:02 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Cleanup after ansible EOLing https://review.openstack.org/340384 | 14:03 |
| kien-ha | electrofelix: Patch is here, https://review.openstack.org/#/c/337381/ | 14:03 |
| *** xarses_ has quit IRC | 14:03 | |
| AJaeger_ | odyssey4me: could you review 340384, please? ^ | 14:03 |
| odyssey4me | AJaeger_ looking | 14:04 |
| *** garyk has joined #openstack-infra | 14:05 | |
| *** notnownikki has quit IRC | 14:05 | |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Add keystone v3 only nv job to designate https://review.openstack.org/340388 | 14:07 |
| *** tonytan4ever has joined #openstack-infra | 14:07 | |
| *** markvoelker has quit IRC | 14:07 | |
| openstackgerrit | Sean Roberts proposed openstack-infra/project-config: add craton project https://review.openstack.org/332470 | 14:07 |
| *** zhurong has quit IRC | 14:08 | |
| openstackgerrit | James Page proposed openstack-infra/project-config: Fix name of layer build target https://review.openstack.org/340366 | 14:09 |
| *** jcoufal has joined #openstack-infra | 14:09 | |
| *** yamamot__ has quit IRC | 14:10 | |
| *** PollyZ has joined #openstack-infra | 14:11 | |
| *** sarob has quit IRC | 14:11 | |
| *** sarob has joined #openstack-infra | 14:12 | |
| *** heyongli has quit IRC | 14:12 | |
| *** heyongli has joined #openstack-infra | 14:13 | |
| *** slaweq has quit IRC | 14:13 | |
| *** ddieterly[away] is now known as ddieterly | 14:14 | |
| *** thiagop has joined #openstack-infra | 14:14 | |
| *** notnownikki has joined #openstack-infra | 14:16 | |
| electrofelix | kien-ha: I did see it, had a quick look, looked fine, wondered if it should be checked earlier rather than after the continue? | 14:17 |
| *** markvoelker has joined #openstack-infra | 14:17 | |
| *** amitgandhinz has quit IRC | 14:17 | |
| *** amitgandhinz has joined #openstack-infra | 14:18 | |
| *** mgould has left #openstack-infra | 14:19 | |
| kien-ha | electrofelix: Is there a particular situation you're thinking of that might be a problem? | 14:20 |
| *** heyongli has quit IRC | 14:23 | |
| *** markvoelker has quit IRC | 14:23 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Add packaging_keytab to release.slave hieradata https://review.openstack.org/340400 | 14:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Add debian-openstack to AFS web mirrors https://review.openstack.org/340401 | 14:23 |
| *** heyongli has joined #openstack-infra | 14:23 | |
| pabelanger | yolanda: around for some quick reviews? ^ | 14:23 |
| *** yaume_ has quit IRC | 14:24 | |
| *** yaume has joined #openstack-infra | 14:25 | |
| *** _oanson has quit IRC | 14:25 | |
| kzaitsev_mb | AJaeger_: sorry for pinging you, but you're usually available at this time of day | 14:25 |
| yolanda | pabelanger, ok, i trade for some i need :) | 14:25 |
| *** kushal has quit IRC | 14:25 | |
| kzaitsev_mb | so I'll repeat myself I'm currently thinking about adding a job (non-voting I guess) to test that our master branch is able to work with mitaka upper constraints. Wanted to ask if there are such jobs and/or | 14:25 |
| pabelanger | yolanda: Yup, I do owe you some reviews today too | 14:25 |
| kzaitsev_mb | if it would be accepted at all =) | 14:25 |
| *** tidwellr has quit IRC | 14:25 | |
| *** mdrabe_ has quit IRC | 14:28 | |
| *** tidwellr has joined #openstack-infra | 14:28 | |
| *** bhavik has joined #openstack-infra | 14:29 | |
| *** timburke has quit IRC | 14:29 | |
| *** charz has quit IRC | 14:29 | |
| openstackgerrit | Alexander Evseev proposed openstack-infra/puppet-jenkins: Add workaround for Jenkins' SECURITY-170 https://review.openstack.org/334400 | 14:29 |
| *** zz_dimtruck is now known as dimtruck | 14:29 | |
| slagle | pabelanger: hmm, i guess this might not work, i just get "Too many authentication failures for jenkins" trying to login with the key | 14:30 |
| *** jamesmcarthur has joined #openstack-infra | 14:30 | |
| openstackgerrit | Alexander Evseev proposed openstack-infra/zuul: Create Merger Git repos using connection names https://review.openstack.org/282660 | 14:30 |
| openstackgerrit | Alexander Evseev proposed openstack-infra/zuul: Report job status 'QUEUED' for queued jobs https://review.openstack.org/272967 | 14:31 |
| *** charz has joined #openstack-infra | 14:31 | |
| electrofelix | kien-ha: not sure, haven't managed to think enough about it, which is why I hadn't +2'ed it yet | 14:32 |
| *** heyongli has quit IRC | 14:33 | |
| *** heyongli has joined #openstack-infra | 14:33 | |
| AJaeger_ | kzaitsev_mb: why would you need such a test at all? I'm not getting it - and against which repo should it run? | 14:34 |
| *** baoli has joined #openstack-infra | 14:34 | |
| pabelanger | slagle: what issue are you trying to solve? | 14:34 |
| *** saggi1 has quit IRC | 14:34 | |
| *** bhavik has quit IRC | 14:35 | |
| *** mdrabe has joined #openstack-infra | 14:36 | |
| slagle | pabelanger: it's an issue when we're configuring the overcloud, i'm still waiting for logs after the job times out | 14:36 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Upgrade Laravel and ORM https://review.openstack.org/322307 | 14:36 |
| slagle | pabelanger: it could be related to the newtork setup | 14:36 |
| slagle | pabelanger: i just thought i'd try to ssh in and interactively figure it out | 14:36 |
| kien-ha | electrofelix: fair enough. Also thanks for pointing out where I could look to learn what you were looking for, it helped a lot. | 14:37 |
| *** sorantis has quit IRC | 14:37 | |
| *** timburke has joined #openstack-infra | 14:38 | |
| *** EricGonczer_ has joined #openstack-infra | 14:38 | |
| *** baoli has quit IRC | 14:38 | |
| *** rossella_s has quit IRC | 14:40 | |
| *** rossella_s has joined #openstack-infra | 14:40 | |
| *** EricGonczer_ has quit IRC | 14:42 | |
| *** PollyZ_ has joined #openstack-infra | 14:43 | |
| *** EricGonczer_ has joined #openstack-infra | 14:43 | |
| *** weshay_mtg is now known as weshay | 14:43 | |
| *** piet has joined #openstack-infra | 14:43 | |
| *** heyongli has quit IRC | 14:43 | |
| *** heyongli has joined #openstack-infra | 14:43 | |
| *** makowals has joined #openstack-infra | 14:44 | |
| *** makowals has quit IRC | 14:44 | |
| *** rdx_matt has joined #openstack-infra | 14:44 | |
| *** sarob has quit IRC | 14:45 | |
| *** dabukalam has quit IRC | 14:45 | |
| AJaeger_ | odyssey4me: is the change fine or do you have concerns? | 14:45 |
| *** PollyZ has quit IRC | 14:46 | |
| *** amitgandhinz has quit IRC | 14:46 | |
| AJaeger_ | odyssey4me: I would appreciate a +1/-1 ;) | 14:46 |
| *** dabukalam has joined #openstack-infra | 14:46 | |
| *** amitgandhinz has joined #openstack-infra | 14:46 | |
| *** makowals has joined #openstack-infra | 14:47 | |
| *** sdake_ has quit IRC | 14:47 | |
| *** makowals has quit IRC | 14:47 | |
| *** PollyZ has joined #openstack-infra | 14:48 | |
| *** PollyZ_ has quit IRC | 14:48 | |
| *** saggi1 has joined #openstack-infra | 14:48 | |
| *** makowals has joined #openstack-infra | 14:48 | |
| *** markvoelker has joined #openstack-infra | 14:48 | |
| *** tosky has joined #openstack-infra | 14:49 | |
| *** ams__ has joined #openstack-infra | 14:50 | |
| *** jlanoux has quit IRC | 14:50 | |
| *** tosky has quit IRC | 14:50 | |
| *** mdrabe_ has joined #openstack-infra | 14:50 | |
| *** mctaylor has joined #openstack-infra | 14:50 | |
| *** tosky has joined #openstack-infra | 14:51 | |
| *** mctaylor has quit IRC | 14:51 | |
| *** mtanino has joined #openstack-infra | 14:52 | |
| *** mdrabe has quit IRC | 14:53 | |
| *** mdrabe_ is now known as mdrabe | 14:53 | |
| *** heyongli has quit IRC | 14:53 | |
| *** heyongli has joined #openstack-infra | 14:54 | |
| *** ociuhandu has joined #openstack-infra | 14:55 | |
| *** cardeois has joined #openstack-infra | 14:57 | |
| *** eezhova has quit IRC | 14:57 | |
| *** piet has quit IRC | 14:58 | |
| *** e0ne has joined #openstack-infra | 14:58 | |
| *** eezhova has joined #openstack-infra | 14:59 | |
| *** savihou has quit IRC | 14:59 | |
| derekh | clarkb: fungi jeblair btw, that PermitRootLogin change worked on friday, I can now boot a infra centos-7 image and ssh in as root | 14:59 |
| *** saggi1 has quit IRC | 15:00 | |
| *** smcginnis has quit IRC | 15:01 | |
| *** piet has joined #openstack-infra | 15:01 | |
| *** arxcruz has quit IRC | 15:01 | |
| *** garyk has quit IRC | 15:01 | |
| *** garyk has joined #openstack-infra | 15:01 | |
| *** lucasagomes has quit IRC | 15:01 | |
| *** isaacb has quit IRC | 15:02 | |
| kzaitsev_mb | AJaeger_: the idea is to allow murano to be installable on -1 release. The assumption we currently have is that most of the features we develop/use wouldn't block us from doing so | 15:03 |
| *** heyongli has quit IRC | 15:04 | |
| AJaeger_ | kzaitsev_mb: so, what test do you want to run when? | 15:04 |
| *** heyongli has joined #openstack-infra | 15:06 | |
| *** lucasagomes has joined #openstack-infra | 15:06 | |
| *** david-lyle has joined #openstack-infra | 15:07 | |
| *** yamamoto has joined #openstack-infra | 15:09 | |
| kzaitsev_mb | AJaeger_: I was thinking py27 jobs | 15:09 |
| *** karthikp_ has joined #openstack-infra | 15:09 | |
| *** saggi1 has joined #openstack-infra | 15:13 | |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Added two new repos for Fuel plugins https://review.openstack.org/340432 | 15:13 |
| zaro | morning | 15:13 |
| *** tidwellr has quit IRC | 15:14 | |
| *** heyongli has quit IRC | 15:14 | |
| kzaitsev_mb | sure that wouldn't catch all the errors, but thats somewhere we can start from. | 15:14 |
| *** nadya has joined #openstack-infra | 15:14 | |
| *** heyongli has joined #openstack-infra | 15:14 | |
| *** yamamoto has quit IRC | 15:14 | |
| *** harlowja_at_home has joined #openstack-infra | 15:14 | |
| *** pcaruana has quit IRC | 15:15 | |
| eantyshev | jeblair: Hello! A few people who run CIs need this change: https://review.openstack.org/238988 | 15:15 |
| *** gouthamr has joined #openstack-infra | 15:15 | |
| kzaitsev_mb | I was wondering if the infra team would be opposed to the idea of such job, as it definitelly looks like no one ever tried to implement smth like that | 15:15 |
| *** gouthamr_ has joined #openstack-infra | 15:16 | |
| *** matt-borland has quit IRC | 15:18 | |
| *** andreas_s has quit IRC | 15:18 | |
| anteaya | morning zaro | 15:18 |
| anteaya | zaro: I hope you had some nice time off | 15:19 |
| anteaya | zaro: let me know when you are back and caught up, I'd like to chat about the storyboard plugin | 15:19 |
| *** rdx_matt has quit IRC | 15:19 | |
| *** pcrews has quit IRC | 15:19 | |
| *** gouthamr has quit IRC | 15:20 | |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Added two new repos for Fuel plugins https://review.openstack.org/340432 | 15:21 |
| *** pcrews has joined #openstack-infra | 15:21 | |
| AJaeger_ | kzaitsev_mb: you can easily run that job on each of your changes *today*, just add an additional tox target that uses constraints... | 15:22 |
| *** roaet has quit IRC | 15:22 | |
| *** mriedem1 has joined #openstack-infra | 15:22 | |
| AJaeger_ | kzaitsev_mb: if you run anything on the requirements repo on the other hand, that's nothing for me to decide - that's for requirements team to do. In that case best talk to dims... | 15:22 |
| *** roaet has joined #openstack-infra | 15:23 | |
| AJaeger_ | kzaitsev_mb: but supporing murano on the previous release is not something our requirements setup is setup for AFAIK - better talk with dhellmann and dims about this. | 15:24 |
| *** mriedem has quit IRC | 15:24 | |
| openstackgerrit | Oleksii Zamiatin proposed openstack-infra/project-config: Turn zmq gates to voting https://review.openstack.org/340439 | 15:24 |
| *** heyongli has quit IRC | 15:24 | |
| *** heyongli has joined #openstack-infra | 15:24 | |
| openstackgerrit | Oleksii Zamiatin proposed openstack-infra/project-config: Use proper driver name to configure devstack https://review.openstack.org/339050 | 15:25 |
| *** mriedem has joined #openstack-infra | 15:26 | |
| kencjohnston | I'm not sure if this is the right place to ask, but who should I contact about a "broken" Etherpad? | 15:26 |
| *** vincentll has quit IRC | 15:26 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update clang scan build https://review.openstack.org/340440 | 15:26 |
| *** mriedem1 has quit IRC | 15:27 | |
| anteaya | kencjohnston: here is the place | 15:27 |
| *** david-lyle has quit IRC | 15:27 | |
| anteaya | kencjohnston: have you a url for the etherpad you feel is behaviing in a sub par fashion? | 15:27 |
| kencjohnston | anteaya: OK, it is this one, no discernable error - https://etherpad.openstack.org/p/OSIC_Ocata_OSIC_Focus_Brainstorm | 15:27 |
| anteaya | infra-root ^^ if someone has time to look at the etherpad db | 15:28 |
| *** eezhova has quit IRC | 15:28 | |
| openstackgerrit | Oleksii Zamiatin proposed openstack-infra/project-config: Use proper driver name to configure devstack https://review.openstack.org/339050 | 15:28 |
| anteaya | kencjohnston: I confirm the etherpad is stuck in "loading..." state | 15:29 |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update clang scan build https://review.openstack.org/340440 | 15:30 |
| kzaitsev_mb | AJaeger_: but I would need to have a separate job entry anyway, I guess. I've looked into how jobs enforce the constraints, yep. And no, I don't want to run anything on the requirements repo | 15:30 |
| *** yamamoto has joined #openstack-infra | 15:30 | |
| *** rajinir has joined #openstack-infra | 15:30 | |
| *** jlanoux has joined #openstack-infra | 15:31 | |
| *** PollyZ has quit IRC | 15:31 | |
| *** tosky has quit IRC | 15:32 | |
| AJaeger_ | kzaitsev_mb: yes, a separate tox based job - that one is easy to do. | 15:32 |
| *** PollyZ has joined #openstack-infra | 15:32 | |
| *** cardeois has quit IRC | 15:33 | |
| *** cardeois has joined #openstack-infra | 15:33 | |
| AJaeger_ | kzaitsev_mb: I suggest you propose a change and add a good commit message - and then let's discuss there. I expect you need two changes, one for murano, one for projec-tconfig. Make the dependent on each other using needed-by and depends-on. | 15:34 |
| *** armax has joined #openstack-infra | 15:34 | |
| *** heyongli has quit IRC | 15:34 | |
| kzaitsev_mb | AJaeger_: ok, sounds like a plan ) | 15:34 |
| *** heyongli has joined #openstack-infra | 15:35 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Add valid set of options parameters to convert_xml https://review.openstack.org/337381 | 15:36 |
| kencjohnston | anteaya: OK, thanks. Any idea how I can retrieve the content? | 15:37 |
| *** adrian_otto has joined #openstack-infra | 15:37 | |
| anteaya | kencjohnston: we wait for an infra-root to be available and look at the etherpad server and db entry for that page | 15:37 |
| anteaya | kencjohnston: I don't know where folks are so far today so I dont' have a time estimate for when someone will be free | 15:38 |
| fungi | i can try to look later (in a vmt meeting right now) but usually the most we can do is extrack an old copy of the content from before whatever happened broke it, and make that available py pasting into a new pad or something | 15:38 |
| fungi | author colors and formatting will generally be lost, and so may very recent changes prior to it breaking | 15:39 |
| kencjohnston | fungi: that sounds perfect | 15:39 |
| *** saggi1 has quit IRC | 15:41 | |
| zaro | anteaya: yeah, time off was great. now ready for storyboard | 15:42 |
| anteaya | awesome thank you | 15:42 |
| anteaya | I'm just finishing up the third party meeting | 15:42 |
| zaro | anteaya: take a look at https://review-dev.openstack.org/#/c/5455/ | 15:42 |
| anteaya | I will in about 15 mintues | 15:42 |
| anteaya | thanks | 15:42 |
| *** sandanar_ has quit IRC | 15:43 | |
| *** sandanar has quit IRC | 15:43 | |
| zaro | fungi: you know status with zuul dev? it doesn't look like it's running jobs for changes on review-dev | 15:43 |
| *** piet has quit IRC | 15:43 | |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: WIP 'All Boards and Worklists' Page https://review.openstack.org/279753 | 15:44 |
| *** heyongli has quit IRC | 15:45 | |
| anteaya | zaro: I think puppet may have overwrote some changes you made manually on dev servers | 15:45 |
| *** heyongli has joined #openstack-infra | 15:45 | |
| anteaya | I think that feature of puppet has been fixed but it happened about a week ago | 15:45 |
| zaro | yup, i've restore, should be working again. | 15:45 |
| fungi | zaro: no clue | 15:45 |
| zaro | change 5455 has a task id. updates to that will update the corresponding task | 15:46 |
| anteaya | yay! | 15:46 |
| anteaya | \o/ | 15:46 |
| fungi | zaro: though i did notice that your git gc change was insufficient to have any actual effect because it (329566) changed a cron job we don't actually use at all. the real cron jobs in production are defined at http://git.openstack.org/cgit/openstack-infra/puppet-gerrit/tree/manifests/cron.pp and so will likely need some parameterized switch to gracefully enable it for us without introducing breaking | 15:47 |
| fungi | changes for downstream consumers of that puppet module | 15:47 |
| zaro | fungi: ahh yeah. i noticed that as well. i pushed a new change that will actually it, https://review.openstack.org/#/c/334714/ | 15:49 |
| fungi | oh, thanks! i'll review and see if that's going to safely no-op for other downstream consumers of our gerrit module | 15:49 |
| *** caowei has quit IRC | 15:50 | |
| *** makowals has quit IRC | 15:50 | |
| *** burgerk has joined #openstack-infra | 15:51 | |
| zaro | anteaya: there's a few more patches to get its-storyboard working. topic is 'its-storyboard' | 15:51 |
| *** dtantsur is now known as dtantsur|bbl | 15:52 | |
| *** tqtran has joined #openstack-infra | 15:52 | |
| EmilienM | pabelanger: hey, good morning - do we still pin ansible in OS infra? | 15:52 |
| anteaya | zaro: thank you! | 15:52 |
| *** rkukura has quit IRC | 15:53 | |
| *** Julien-zte has quit IRC | 15:54 | |
| pabelanger | EmilienM: Yes, to be safe. I need to check when ansible is going to release 2.1 again. Our patches have merged into the stable branch | 15:54 |
| pabelanger | so we need to wait for pip release or switch to stable branch | 15:54 |
| EmilienM | pabelanger: ok. Please ping me when we go back upstream, our ubuntu jobs are still non voting and I don't like that | 15:54 |
| EmilienM | pabelanger: https://review.openstack.org/#/c/334464/ | 15:54 |
| *** lucasagomes is now known as lucas-afk | 15:55 | |
| *** heyongli has quit IRC | 15:55 | |
| *** mikelk has quit IRC | 15:55 | |
| *** Sukhdev_ has joined #openstack-infra | 15:55 | |
| *** heyongli has joined #openstack-infra | 15:55 | |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Add keystone v3 only nv job to designate https://review.openstack.org/340388 | 15:55 |
| pabelanger | EmilienM: I think you could make them voting now. We've confirmed the fix is in ansible, we just need to update zuul-launcher now | 15:55 |
| EmilienM | ok | 15:56 |
| pabelanger | EmilienM: I can +3 if you want | 15:56 |
| EmilienM | pabelanger: let me check again | 15:56 |
| *** tqtran has quit IRC | 15:56 | |
| EmilienM | pabelanger: ok GO | 15:57 |
| pabelanger | EmilienM: done | 15:57 |
| EmilienM | thx | 15:57 |
| zaro | pleia2: if your around, would you mind reviewing this? we really need this one. https://review.openstack.org/#/c/311903/ | 15:57 |
| EmilienM | pabelanger: things are stable for us fyi | 15:57 |
| *** Jeffrey4l has quit IRC | 15:58 | |
| pabelanger | EmilienM: \o/ | 15:58 |
| *** smcginnis has joined #openstack-infra | 15:58 | |
| *** tosky has joined #openstack-infra | 15:59 | |
| *** davideagnello has joined #openstack-infra | 16:00 | |
| *** watanabe_isao has joined #openstack-infra | 16:02 | |
| electrofelix | waynr: I've pushed up to github the changes I was suggesting (also fixed the CI issues introduced with some of the patches rebased on Friday), let me know if this is ok to push to update the existing patches | 16:03 |
| electrofelix | waynr: link https://github.com/electrofelix/jenkins-job-builder/tree/untangle-config | 16:03 |
| *** rcarrillocruz has quit IRC | 16:03 | |
| *** asettle has quit IRC | 16:03 | |
| electrofelix | waynr: oh, and found a very basic naming bug we all missed for the delet-all subcommand, should have been delete-all ;) | 16:04 |
| *** mctaylor has joined #openstack-infra | 16:04 | |
| *** heyongli has quit IRC | 16:05 | |
| *** bryan_att has joined #openstack-infra | 16:05 | |
| *** dizquierdo has quit IRC | 16:05 | |
| *** heyongli has joined #openstack-infra | 16:05 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 16:06 |
| *** garyk has quit IRC | 16:06 | |
| *** rwsu has joined #openstack-infra | 16:06 | |
| anteaya | zaro: nice work: https://storyboard-dev.openstack.org/#!/story/18 | 16:07 |
| *** shashank_hegde has joined #openstack-infra | 16:09 | |
| *** tqtran has joined #openstack-infra | 16:09 | |
| *** garyk has joined #openstack-infra | 16:09 | |
| *** gyee has joined #openstack-infra | 16:09 | |
| *** sdake has joined #openstack-infra | 16:10 | |
| *** jcoufal has quit IRC | 16:11 | |
| *** dprince has quit IRC | 16:11 | |
| *** eliqiao has quit IRC | 16:12 | |
| openstackgerrit | Merged openstack-infra/project-config: Revert "puppet: xenial jobs are now -nv" https://review.openstack.org/334464 | 16:12 |
| *** eharney_ has joined #openstack-infra | 16:12 | |
| sdake | peblanger around | 16:12 |
| *** aurelien__ has quit IRC | 16:12 | |
| *** jcoufal has joined #openstack-infra | 16:13 | |
| *** david-lyle has joined #openstack-infra | 16:13 | |
| *** eharney has quit IRC | 16:13 | |
| *** eliqiao has joined #openstack-infra | 16:13 | |
| sdake | it seems the sources.lisr.acailable.d is not being created | 16:13 |
| sdake | Clarkb said they are synced daily | 16:14 |
| sdake | is something bust with the patxhes | 16:14 |
| zaro | anteaya: you mean, in that it works? | 16:14 |
| anteaya | it works, activity on a gerrit review using task id can set status on a storyboard task | 16:15 |
| anteaya | yay! | 16:15 |
| anteaya | thank you | 16:15 |
| *** rdx_matt has joined #openstack-infra | 16:15 | |
| *** heyongli has quit IRC | 16:15 | |
| anteaya | Zara: SotK ^^ | 16:15 |
| *** heyongli has joined #openstack-infra | 16:16 | |
| sdake | say anyway a I am on a phone can you type pablingers,name with a tab pls | 16:16 |
| sdake | anteaya | 16:17 |
| anteaya | pabelanger: ^^ | 16:17 |
| sdake | I don't know how to spell it | 16:17 |
| sdake | thz | 16:17 |
| sdake | x | 16:17 |
| anteaya | zaro: and you have had a rough life story | 16:17 |
| anteaya | welcome | 16:17 |
| pabelanger | anteaya: thanks | 16:18 |
| pabelanger | sdake: which OS are you using? | 16:18 |
| anteaya | pabelanger: welcome | 16:18 |
| pabelanger | sdake: and region | 16:18 |
| pabelanger | I'll check nodepool | 16:18 |
| sdake | on a plane laptop out of batteries | 16:18 |
| *** eharney_ is now known as eharney | 16:18 | |
| sdake | ubunti | 16:18 |
| pabelanger | also, image build / upload process takes 12 hours or so and starts at 10:30UTC | 16:18 |
| *** david-lyle has quit IRC | 16:19 | |
| *** rkukura has joined #openstack-infra | 16:19 | |
| sdake | I think the change for Cephalon happened several,days ago | 16:19 |
| pabelanger | sdake: pabelanger@ubuntu-trusty-internap-nyj01-2425462:/etc/apt/sources.list.available.d$ | 16:20 |
| *** jlanoux_ has joined #openstack-infra | 16:20 | |
| pabelanger | so patch is live | 16:20 |
| *** jlanoux has quit IRC | 16:20 | |
| pabelanger | likely region is missing the image update | 16:20 |
| sdake | I just wanted to verify the patches are correct | 16:20 |
| sdake | cool | 16:20 |
| sdake | the sorry for noise | 16:20 |
| sdake | Pat I am,adding more mirrors 3 to 5 any objection | 16:21 |
| sdake | pab | 16:21 |
| *** shashank_hegde has quit IRC | 16:22 | |
| sdake | once we have local mirrors we may be able to vote our gates | 16:22 |
| openstackgerrit | Tom Barron proposed openstack-infra/project-config: cinder functional tests unsupported in Liberty. https://review.openstack.org/340462 | 16:22 |
| *** jpich has quit IRC | 16:25 | |
| *** heyongli has quit IRC | 16:26 | |
| *** heyongli has joined #openstack-infra | 16:26 | |
| *** psachin has quit IRC | 16:27 | |
| mugsie | any chance of a review for https://review.openstack.org/#/c/339580/ ? I would like to try testing the current WIP grenade plugin in the gate | 16:27 |
| *** rhallisey has quit IRC | 16:28 | |
| *** dmsimard1 has joined #openstack-infra | 16:28 | |
| *** dmsimard1 is now known as dmsimard|mtl | 16:28 | |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Add keystone v3 only nv job to designate https://review.openstack.org/340388 | 16:30 |
| *** nadya has quit IRC | 16:30 | |
| *** trown is now known as trown|lunch | 16:31 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update clang scan build https://review.openstack.org/340440 | 16:32 |
| *** baoli has joined #openstack-infra | 16:33 | |
| *** xarses_ has joined #openstack-infra | 16:33 | |
| *** e0ne has quit IRC | 16:35 | |
| *** heyongli has quit IRC | 16:36 | |
| *** yamahata has joined #openstack-infra | 16:37 | |
| *** baoli has quit IRC | 16:37 | |
| *** lucas-afk is now known as lucasagomes | 16:37 | |
| openstackgerrit | Tom Barron proposed openstack-infra/project-config: cinder functional tests unsupported in Liberty https://review.openstack.org/340462 | 16:38 |
| *** heyongli has joined #openstack-infra | 16:38 | |
| openstackgerrit | Oleksii Zamiatin proposed openstack-infra/project-config: Turn zmq gates to voting https://review.openstack.org/340439 | 16:41 |
| azvyagintsev | Hi folks, did someone use gerrit-trigger by folder ? could someone point me to example in infra jobs.. | 16:42 |
| *** sree_ has joined #openstack-infra | 16:42 | |
| *** sree_ is now known as Guest66333 | 16:43 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Bump up the number of OVB env workers available https://review.openstack.org/340359 | 16:43 |
| *** jlanoux_ has quit IRC | 16:44 | |
| *** heyongli has quit IRC | 16:46 | |
| *** heyongli has joined #openstack-infra | 16:46 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Experimental reprepro job for deb-openstack-pkg-tools https://review.openstack.org/340469 | 16:46 |
| pabelanger | zigo: 2nd half of the reprepro change | 16:47 |
| pabelanger | ^ | 16:47 |
| openstackgerrit | Sean M. Collins proposed openstack-infra/project-config: Make gate-grenade-dsvm-neutron-dvr-multinode voting https://review.openstack.org/336116 | 16:48 |
| *** kencjohnston has left #openstack-infra | 16:48 | |
| *** tesseract- has quit IRC | 16:49 | |
| *** rdx_matt has quit IRC | 16:49 | |
| AJaeger_ | pabelanger: from earlier today: http://logs.openstack.org/76/339776/2/check/gate-kolla-dsvm-build-ubuntu-source/ba07478/console.html.gz#_2016-07-09_04_33_53_110704 - is that image recent? | 16:50 |
| *** sarob has joined #openstack-infra | 16:50 | |
| AJaeger_ | pabelanger, that was sdake 's test change - in rax-iad. Let's recheck... | 16:50 |
| *** sarob has quit IRC | 16:50 | |
| odyssey4me | AJaeger_ sorry I took so long to complete the review - long conf call | 16:51 |
| *** rcernin has quit IRC | 16:51 | |
| pabelanger | AJaeger_: 00:18:07:23 for rax-iad | 16:51 |
| pabelanger | AJaeger_: should be good | 16:51 |
| pabelanger | rax-ord is 3+ days | 16:52 |
| AJaeger_ | thanks, pabelanger. | 16:52 |
| AJaeger_ | odyssey4me: thanks, I'll update the change... | 16:52 |
| *** watanabe_isao has quit IRC | 16:52 | |
| pabelanger | AJaeger_: once our image uploads are done for day, I'll confirm everything is up to date | 16:52 |
| pabelanger | AJaeger_: when you have time, interested in feedback on 340469. tested it bash stuff locally, waiting for gate to validate it | 16:53 |
| *** sdake has quit IRC | 16:53 | |
| *** phschwartz has quit IRC | 16:54 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Cleanup after ansible EOLing https://review.openstack.org/340384 | 16:54 |
| AJaeger_ | pabelanger: will check now. | 16:54 |
| AJaeger_ | odyssey4me: fixed ^ | 16:54 |
| *** timello has quit IRC | 16:54 | |
| *** dtantsur|bbl is now known as dtantsur | 16:55 | |
| *** sarob has joined #openstack-infra | 16:55 | |
| pabelanger | AJaeger_: I left out the afs-release job for now | 16:55 |
| *** sarob has quit IRC | 16:55 | |
| fungi | kencjohnston seems to have disappeared | 16:55 |
| *** sarob has joined #openstack-infra | 16:55 | |
| *** annegentle has joined #openstack-infra | 16:56 | |
| fungi | i was about to suggest simply retrieving the desired pad contents from the timeslider instead (manually constructing the url to it): https://etherpad.openstack.org/p/OSIC_Ocata_OSIC_Focus_Brainstorm/timeslider#7902 | 16:56 |
| *** sarob has quit IRC | 16:56 | |
| *** heyongli has quit IRC | 16:56 | |
| *** sarob has joined #openstack-infra | 16:56 | |
| *** heyongli has joined #openstack-infra | 16:57 | |
| *** nmagnezi has quit IRC | 16:57 | |
| anteaya | fungi: that works for me, should ken re-appear I will point him to your suggestion | 16:57 |
| anteaya | thank you | 16:57 |
| fungi | interestingly, looks like you can export the chosen timestamp and history as a new etherpad in the version we're running | 16:57 |
| *** kgiusti has left #openstack-infra | 16:57 | |
| AJaeger_ | pabelanger: this will not build - you wrote a template but never instantiate it | 16:57 |
| *** harlowja_at_home has quit IRC | 16:58 | |
| *** kgiusti has joined #openstack-infra | 16:58 | |
| Zara | anteaya, zaro: ooh, nice! | 16:58 |
| anteaya | fungi: how interesting | 16:58 |
| *** timello has joined #openstack-infra | 16:58 | |
| anteaya | Zara: yay! | 16:58 |
| fungi | i'm testing that out now | 16:58 |
| AJaeger_ | pabelanger: otherwise, looks ok - but I don't know much about mirror setup | 16:58 |
| anteaya | fungi: I tried exporting to html and got an error: https://etherpad.openstack.org/p/OSIC_Ocata_OSIC_Focus_Brainstorm/7902/export/html | 16:59 |
| *** phschwartz has joined #openstack-infra | 16:59 | |
| *** garyk has quit IRC | 16:59 | |
| fungi | the export as etherpad i've got running is taking a while since there are ~8k versions and it's a pretty large pad of content | 17:00 |
| anteaya | fungi: I tried html, txt, and pdf and got a 502 proxy error each attempt | 17:00 |
| anteaya | well at least you didn't 502 | 17:00 |
| pabelanger | AJaeger_: Oh, possible :) I never ran tox locally | 17:00 |
| pabelanger | AJaeger_: will fix now | 17:00 |
| *** Swami has joined #openstack-infra | 17:01 | |
| fungi | the export urls may rely on patterns we haven't correctly proxied in our apache config | 17:01 |
| anteaya | sounds like it | 17:01 |
| fungi | or this might be a result of our workaround to prevent people from doing doc exports that spawn abiword | 17:01 |
| anteaya | I hope your export works | 17:01 |
| anteaya | ah, perhaps | 17:01 |
| Zara | anteaya: hm, I noticed it didn't change to 'merged', but then the patch in review-dev isn't marked 'merged', though it has workflow +1... do things merge in there? just a question of waiting? | 17:01 |
| anteaya | Zara: good question | 17:01 |
| fungi | Zara: on review-dev we usually manually "submit" changes to merge them | 17:02 |
| anteaya | zaro: can we merge one of the review-dev patches with a task id to see if it gets marked as merged in storyboard? | 17:02 |
| fungi | that might be why zaro was asking about having zuul-dev run jobs for review-dev changes | 17:02 |
| anteaya | ah | 17:02 |
| fungi | now that you mention it | 17:02 |
| Zara | (it was this change, specifically https://review-dev.openstack.org/#/c/5455/ ) | 17:02 |
| Zara | it looks really exciting, anyway! :D | 17:03 |
| *** sdake has joined #openstack-infra | 17:03 | |
| anteaya | 5454 as well | 17:03 |
| anteaya | I'm excited | 17:03 |
| anteaya | yay! | 17:03 |
| *** gouthamr_ is now known as gouthamr | 17:03 | |
| Zara | well maybe that reveals how dull my life has got, but eh. | 17:03 |
| anteaya | ha ha ha | 17:03 |
| anteaya | but were you born in a shoebox? | 17:03 |
| openstackgerrit | Oleksii Zamiatin proposed openstack-infra/project-config: Turn zmq gates to voting https://review.openstack.org/340439 | 17:04 |
| Zara | true, true, it sounds like zaro got a far worse deal ;_; | 17:04 |
| anteaya | :) | 17:04 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Add support for notifications from subscribed worklists https://review.openstack.org/339557 | 17:04 |
| *** Apoorva has joined #openstack-infra | 17:04 | |
| clarkb | AJaeger_: I am running SUSE properly now >_> | 17:05 |
| *** xenogear has quit IRC | 17:05 | |
| fungi | clarkb: #define "properly" | 17:05 |
| clarkb | fungi: on my desktop which I am using now for work things | 17:06 |
| fungi | ahh | 17:06 |
| fungi | as opposed to "experimentally" | 17:06 |
| clarkb | if this holds up for a week or so I going to do laptop too | 17:06 |
| *** Apoorva has quit IRC | 17:06 | |
| *** heyongli has quit IRC | 17:07 | |
| fungi | still happily running debian/sid on my workstation. just updated the kernel and x.org over the weekend and got to deal with xrandr reordering my displays | 17:07 |
| *** PollyZ has quit IRC | 17:07 | |
| *** heyongli has joined #openstack-infra | 17:07 | |
| fungi | but that was fairly tractable | 17:07 |
| *** PollyZ has joined #openstack-infra | 17:08 | |
| AJaeger_ | cool, clarkb ! | 17:08 |
| *** dprince has joined #openstack-infra | 17:08 | |
| clarkb | AJaeger_: I did have to find, debug, and report a few issues (yay tumbleweed) but they were relatively easy to track down and related to running virtualemachines and not core functionality | 17:08 |
| anteaya | yay better vm support in suse | 17:09 |
| fungi | oh, actually i did run into one pain... the mosh 1.25 release candidate now in sid can't connect to a 1.24 mosh-server by dns name if the server is dual-stack ipv4/ipv6. i had to temporarily update my scripts to connect by explicit ipv4 address for now | 17:10 |
| AJaeger_ | interesting, I thought we testing in virtual machines more ;) | 17:10 |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update clang scan build https://review.openstack.org/340440 | 17:10 |
| zxiiro | electrofelix: So a pattern I noticed. I think cache works alphabetically and there's a bug. If you use --workers 0 to update jobs and it updated say 100 jobs, but there was an intermittent failure at job 21. The next run of the update attempt will restart updating those jobs at job 21 even if there were many successes after that | 17:11 |
| zxiiro | electrofelix: I would have expected it to go back and only update the jobs that had intermittent failures | 17:11 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Experimental reprepro job for deb-openstack-pkg-tools https://review.openstack.org/340469 | 17:12 |
| *** ddieterly is now known as ddieterly[away] | 17:12 | |
| scottda | AJaeger_: or yolanda Would you please re-approve https://review.openstack.org/#/c/330678/ to get it back into the merge queue? something failed the first time. | 17:13 |
| clarkb | jeblair: https://review.openstack.org/#/c/338598/8 has jeheskeths +2 and passes tests now. If you could review as well that would be excellent | 17:13 |
| clarkb | AJaeger_: ya part of the thing that prompted me to do this was I needed a better local VM running option. So now I have tumbleweed deploying VMs straight to my local netowrk and now I can run all the tests on xenial pretty easily | 17:13 |
| *** derekh has quit IRC | 17:13 | |
| clarkb | I am about to start a local iamge build that I can use | 17:14 |
| *** notnownikki has quit IRC | 17:14 | |
| fungi | clarkb: see comments on your xenial spec. i'd love to put it up for a formal council vote this week, so am happy to make those corrections myself if you're busy | 17:15 |
| *** Apoorva has joined #openstack-infra | 17:15 | |
| clarkb | fungi: I will look | 17:15 |
| *** mrmartin has joined #openstack-infra | 17:15 | |
| zaro | anteaya, Zara, fungi : yes, it's not merging because zuul-dev isn't running jobs and marking verfied. | 17:15 |
| AJaeger_ | clarkb: I see. | 17:15 |
| Zara | gotcha | 17:15 |
| AJaeger_ | scottda: Let me check | 17:15 |
| fungi | zaro: i don't recall zuul-dev ever doing that for review-dev, but it's possible it did and i just never knew | 17:16 |
| zaro | I've already tested the merge with my local setup so don't really need to worry about that. | 17:16 |
| Zara | yay! :D I'm very happy about it, thank you! | 17:16 |
| AJaeger_ | scottda: the change has a depends-on - and that dependent change ha snot merged yet. So, let's merge the other first... | 17:16 |
| fungi | in the past when i've proposed changes i needed to test in a merged state on review-dev i've just escalated my privileges in gerrit and hit the submit button | 17:16 |
| AJaeger_ | scottda: your change cannot merge without the other first | 17:16 |
| scottda | AJaeger_: yes, sorry, missed that. Thanks for looking | 17:17 |
| *** heyongli has quit IRC | 17:17 | |
| *** heyongli has joined #openstack-infra | 17:17 | |
| AJaeger_ | scottda: btw reverify is wrong - it's recheck. And if there's a depends-on, a recheck will not help, we need to toggle the +A or add another one. | 17:17 |
| zaro | fungi: it would set jenkins verified+1 which would allow admins to click submit button. | 17:17 |
| *** mrmartin has quit IRC | 17:18 | |
| *** Guest66333 has quit IRC | 17:18 | |
| *** sree_ has joined #openstack-infra | 17:18 | |
| zaro | so it's actually jenkins verified+1 vote that's needed. i guess can probably do that from ssh command | 17:18 |
| *** sree_ is now known as Guest59222 | 17:18 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Upgrade Laravel and ORM https://review.openstack.org/322307 | 17:19 |
| anteaya | Zara: I left a comment on https://review.openstack.org/#/c/339286/3 clarkb's common requirements file for storyboard patch, who else would you like to see review the patch in order for it to merge? | 17:19 |
| anteaya | Zara: and thanks for reviewing | 17:20 |
| zaro | Zara: this is the mapping patchset-upload and restore -> review | 17:20 |
| zaro | abandoned -> todo | 17:20 |
| *** jlanoux has joined #openstack-infra | 17:20 | |
| zaro | gerrit merged -> sb merged | 17:20 |
| clarkb | fungi: in updating that url I have discovered that firefox presents non escaped strings to you /me escapes manually | 17:21 |
| *** degorenko is now known as _degorenko|afk | 17:21 | |
| zaro | Zara: i'm guessing we don't need one for 'progess'? | 17:21 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Experimental reprepro job for deb-openstack-pkg-tools https://review.openstack.org/340469 | 17:21 |
| openstackgerrit | Clark Boylan proposed openstack-infra/infra-specs: Spec for testing Newton on Xenial transition https://review.openstack.org/337905 | 17:22 |
| Zara | zaro: no, I don't think so | 17:22 |
| *** Guest59222 has quit IRC | 17:22 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 17:22 |
| Zara | anteaya: oh, mainly sotk and pedro, but then I noticed sotk was happy with it after. | 17:22 |
| jeblair | clarkb: lgtm thx | 17:23 |
| openstackgerrit | Oleksii Zamiatin proposed openstack-infra/project-config: Turn zmq gates to voting https://review.openstack.org/340439 | 17:23 |
| SotK | zaro: that mapping seems sensible to me | 17:24 |
| zaro | it's not hard coded so we can adjust as needed. | 17:25 |
| SotK | Zara, anteaya: I think we should just merge that patch, all of the python changes are perfectly sensible | 17:26 |
| *** javeriak has joined #openstack-infra | 17:26 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/puppet-hound: Fix example config.json puppet path https://review.openstack.org/339265 | 17:26 |
| *** heyongli has quit IRC | 17:27 | |
| *** heyongli has joined #openstack-infra | 17:27 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/puppet-hound: Add ServerAlias support to the vhost config https://review.openstack.org/339274 | 17:28 |
| * clarkb makes an infra xenial iamge for all the testing | 17:29 | |
| anteaya | Zara: ah okay | 17:29 |
| anteaya | SotK: I agree | 17:29 |
| anteaya | the job is currently non-voting | 17:30 |
| *** yamahata has quit IRC | 17:30 | |
| electrofelix | zxiiro: it's not so much that the cache works alphabetically, but the jobs are sorted alphabetically before being processed. I suspect that when the exception occurs, that the main thread shuts down, saving the cache at that point and preventing any further updates to it from being registered. | 17:30 |
| openstackgerrit | Merged openstack-infra/nodepool: Infer node demand from workers listing https://review.openstack.org/338598 | 17:30 |
| zxiiro | electrofelix: ah yeah, I figured it was probably something similar to that. just wasn't sure how to word it | 17:30 |
| *** akshai has quit IRC | 17:31 | |
| electrofelix | Though I thought it would save the exception and wait for the remainder to stop before writting out the cache | 17:31 |
| fungi | anteaya: confirmed, the export as etherpad option downloaded a 2.6mb OSIC_Ocata_OSIC_Focus_Brainstorm.etherpad file, however subsequent attempts to import that into a new pad are silently failing and giving me what looks like an empty pad instead... and then attempts to reload that page result in the never-ending "loading" screen | 17:31 |
| *** coreycb has quit IRC | 17:31 | |
| *** coreycb has joined #openstack-infra | 17:31 | |
| *** akshai has joined #openstack-infra | 17:31 | |
| anteaya | fungi: yay for at least one successful export | 17:32 |
| *** shashank_hegde has joined #openstack-infra | 17:32 | |
| electrofelix | I recall I had a different approach that use the threadpool mechanism originally, which never appeared to suffer the same issue, since it would shutdown the pool on exception from the main thread, via the manager thread and then wait for the existing thread to terminate | 17:32 |
| *** asettle has joined #openstack-infra | 17:32 | |
| *** fawadkhaliq has joined #openstack-infra | 17:32 | |
| Shrews | jeblair: mordred: notmorgan: Should we have a new branch in nodepool for the new ZK stuff? Or are we just going to commit that to master going forward since it's tagged now? | 17:32 |
| fungi | anteaya: they'll likely need to just manually copy/paste the content from that last revision on the timeslider into a new pad | 17:32 |
| anteaya | fungi: but it sounds like if you can't reload the successful export, it isn't terribly useful to others | 17:32 |
| electrofelix | then it would shut down the main process, which would likely mean that the cache retains all successful entries instead of discarding a whole lot of them | 17:33 |
| anteaya | fungi: yep, that sounds like the best route forward based on your investigation | 17:33 |
| electrofelix | zxiiro: guess we might have a reason to resurrect that approac | 17:33 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Experimental reprepro job for deb-openstack-pkg-tools https://review.openstack.org/340469 | 17:33 |
| *** infra-red has joined #openstack-infra | 17:33 | |
| zxiiro | electrofelix: yeah, it's not a huge issue but a slight inconvenience when it does happen. | 17:34 |
| notmorgan | Shrews: i hope we don't need to | 17:34 |
| notmorgan | Shrews: i would really prefer to not need a special branch for nodepool | 17:34 |
| zxiiro | electrofelix: i see this happen once every few weeks | 17:35 |
| pleia2 | google-fu and doc reading failing me this morning, I don't like using puppet apply -l because then it doesn't give me stdout, is there a way to do both? (I've just been skipping -l altogether and have been piping to tee for a log) | 17:35 |
| pleia2 | (-l is for logging to a file) | 17:35 |
| *** sshnaidm is now known as sshnaidm|afk | 17:36 | |
| anteaya | pleia2: I'm no help I just use -l myself | 17:36 |
| anteaya | I haven't seen crinkle in channel lately but if there is a way, I bet she'd know | 17:37 |
| *** heyongli has quit IRC | 17:37 | |
| *** javeriak_ has joined #openstack-infra | 17:38 | |
| *** deadnull has joined #openstack-infra | 17:38 | |
| *** amotoki has quit IRC | 17:38 | |
| jeblair | Shrews, notmorgan, mordred: yeah, i believe what we want to do is to do the nodepool zk stuff in a way that we can CD into it with openstack, and third parties can avoid the risk by staying pinned to the tag | 17:38 |
| *** deadnull has quit IRC | 17:38 | |
| *** javeriak has quit IRC | 17:38 | |
| clarkb | pleia2: I use --debug and redirect if necessary | 17:39 |
| *** deadnull has joined #openstack-infra | 17:39 | |
| jeblair | Shrews, notmorgan, mordred: the zk stuff does not have to coexist with the existing builders -- we can make it a flag day transition if we want. | 17:39 |
| Shrews | jeblair: notmorgan: ack | 17:39 |
| *** pcaruana has joined #openstack-infra | 17:39 | |
| pleia2 | clarkb: nods | 17:39 |
| *** tphummel has joined #openstack-infra | 17:40 | |
| *** heyongli has joined #openstack-infra | 17:40 | |
| *** infra-red has quit IRC | 17:41 | |
| jeblair | Shrews, notmorgan, mordred: (there are lots of options for how we might do that depending on circumstances) | 17:41 |
| notmorgan | jeblair: do you mind if I propose a patch to move tests [zuulV3 branch] into the project tree? | 17:42 |
| pabelanger | speaking of zookeeper, I have 324037 up adding it to nodepool.o.o, should I expand that into a zookeeper cluster change from the start? | 17:42 |
| notmorgan | jeblair: not sure why that is external in zuul vs in nodepool internal (zuul/tests vs ./tests and ./zuul) | 17:42 |
| notmorgan | jeblair: if there is a reason, i'm happy to keep it as is, just looking for reasoning if there is any | 17:43 |
| jeblair | notmorgan: we had a discussion about that a while ago -- zuul's tests are not part of the product (inasmuch as zuul is not a library for people to use, and so it does not make sense for the tests to be installed) | 17:43 |
| notmorgan | jeblair: wfm. I personally prefer all of it to be included since it's easier for me (workflow wise) to work with. but *shrug* it's a minor thing. | 17:43 |
| jeblair | notmorgan: i think we can revesit this down the road a bit, as i would eventually like zuul to have a stable api for some things. that's probably after zuul 3.5 though. | 17:45 |
| *** blueboxjesse has joined #openstack-infra | 17:45 | |
| notmorgan | yeah sounds good. | 17:45 |
| notmorgan | like i said, it's minor | 17:45 |
| blueboxjesse | Hi Friends. Monty directed me here to help fix my Gerrit screw up. I managed to create two Gerrit accounts and it probably makes sense to fix that. | 17:45 |
| jeblair | notmorgan: in the mean time, i think zuul's tests are about to get quite large (with lots of fixture files) -- so it might be nice to have them out of tree for a bit longer till we see where they get | 17:45 |
| notmorgan | hehe fair enough | 17:45 |
| * notmorgan is about to dive into the py3-ifying zuulV3 | 17:45 | |
| *** rdx_matt has joined #openstack-infra | 17:46 | |
| notmorgan | since the nodepool stuff is in order and gear changes are *almost* done. | 17:46 |
| jeblair | woo! | 17:46 |
| notmorgan | figured if i was doing other cleanup might as well offer to shuffle tests too | 17:46 |
| jeblair | i'm really hoping to have my configuration related changes up for soon -- they are mostly working, but uncovered a bug in some related v3 code that i'm tracking down now. | 17:47 |
| notmorgan | nice. | 17:47 |
| *** trown|lunch is now known as trown | 17:47 | |
| notmorgan | fwiw, i'm expecting the py3 stuff for zuulv3 branch to be horrible rebase hell, so don't worry about landing it in small bursts. | 17:47 |
| jesusaur | clarkb: thanks for pointing out the curator pin | 17:47 |
| *** heyongli has quit IRC | 17:48 | |
| notmorgan | i'm going to try and make it a nice consumable chain we can review/land mostly in one swoop | 17:48 |
| notmorgan | since the plan is to drop all the py2 compat hackery | 17:48 |
| *** heyongli has joined #openstack-infra | 17:48 | |
| notmorgan | too | 17:48 |
| jesusaur | clarkb: and the logstash-filter tests are 320728 and 320729 | 17:48 |
| notmorgan | fwiw, I'm so excited to get to work on a project that doesn't have to import six | 17:48 |
| jeblair | :) | 17:48 |
| blueboxjesse | notmorgan: Is that something you can help me with? :) | 17:49 |
| notmorgan | blueboxjesse: lol, only if you're planning on using Zuul :P | 17:49 |
| pabelanger | AJaeger_: 340469 ready now | 17:49 |
| blueboxjesse | jeblair: What about you? :) | 17:50 |
| AJaeger_ | pabelanger: will recheck... | 17:50 |
| pabelanger | clarkb: mind helping review 340469 adding reprepro into our zuul pipeline | 17:50 |
| notmorgan | blueboxjesse: oh wait, sorry just saw your other thing | 17:50 |
| pabelanger | testing best I could locally | 17:50 |
| blueboxjesse | haha no worries :) | 17:50 |
| notmorgan | blueboxjesse: i thought you were being snarky about my other comment | 17:50 |
| *** rbrndt has quit IRC | 17:50 | |
| blueboxjesse | oh. no. never snarky on Mondays. | 17:50 |
| notmorgan | blueboxjesse: i cannot fix that, i am not a gerrit admin. | 17:50 |
| *** garyk has joined #openstack-infra | 17:51 | |
| notmorgan | blueboxjesse: but i would if i could. | 17:51 |
| blueboxjesse | Any idea who is? | 17:51 |
| jeblair | blueboxjesse: yeah, do you have the numeric account ids of both accounts? | 17:51 |
| blueboxjesse | Ah | 17:51 |
| blueboxjesse | bingo | 17:51 |
| blueboxjesse | yes - standby | 17:51 |
| notmorgan | blueboxjesse: jeblair is awesome and can help ya. | 17:51 |
| *** pvaneck has joined #openstack-infra | 17:51 | |
| *** yamahata has joined #openstack-infra | 17:51 | |
| AJaeger_ | pabelanger, sdake in rax-ord no ceph mirror - so, outdated image? http://logs.openstack.org/76/339776/3/check/gate-kolla-dsvm-deploy-ubuntu-source/2f05db1/console.html#_2016-07-11_16_59_11_615811 | 17:51 |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Add keystone v3 only nv job to designate https://review.openstack.org/340388 | 17:52 |
| pabelanger | AJaeger_: Yup, uploads starting shortly | 17:53 |
| *** garyk has quit IRC | 17:53 | |
| pabelanger | only xenial left to build | 17:53 |
| notmorgan | pabelanger: w00t | 17:53 |
| * notmorgan facepalms. | 17:53 | |
| *** tosky has quit IRC | 17:53 | |
| *** e0ne has joined #openstack-infra | 17:54 | |
| notmorgan | you know... searching for spinning rust named "Velociraptor" just doesn't work well if you don't specify "western digital" or "hard drive", but I have some EPIC products like velociraptor head in my search results. | 17:54 |
| *** asettle has quit IRC | 17:54 | |
| clarkb | notmorgan: is it one of those wearable mask things? | 17:55 |
| *** asettle has joined #openstack-infra | 17:55 | |
| pleia2 | pabelanger: if I recall correctly, any of us can edit the summit talk submission through the web UI until the due date, right? | 17:55 |
| clarkb | pabelanger: ya I will work on reviews while I wait for dib to build its cache | 17:55 |
| notmorgan | clarkb: not sure. it either is that or a high-quality plaster-y shelf thing | 17:55 |
| blueboxjesse | jeblair: Newest account is 22655. Old account is 12996. | 17:55 |
| *** garyk has joined #openstack-infra | 17:55 | |
| notmorgan | maybe a bookend? | 17:55 |
| *** fawadkhaliq has quit IRC | 17:55 | |
| notmorgan | it is pretty epic. | 17:55 |
| *** kzaitsev_mb has quit IRC | 17:55 | |
| clarkb | notmorgan: I just swapped out my old spinning WD with a samsung ssd, much vroom vroom | 17:55 |
| pabelanger | pleia2: Ya, infact you can do some editing after the date too. We just need to make sure something is submitted | 17:55 |
| anteaya | pleia2: if you can't, I would consider it a bug | 17:55 |
| jeblair | blueboxjesse: i can't combine the accounts, but assuming one of them is the one you want to keep using, and the other one you just want disabled in a way that people don't mistakenly add it to reviews, i can do that. do you want me to disable 12996? | 17:56 |
| jeblair | blueboxjesse: for more explanation: http://docs.openstack.org/infra/system-config/gerrit.html#duplicate-accounts-in-gerrit | 17:56 |
| pleia2 | pabelanger: OK, I'm going to submit what we have today, and you and jhesketh can poke at it as needed | 17:56 |
| notmorgan | clarkb: i have 4 machines with the samsung SSDs, 2 with NVMe. yes vrooooom | 17:56 |
| *** jamesmcarthur has quit IRC | 17:56 | |
| pabelanger | pleia2: I was going to do infracloud now, with ricky and crinkle. With bindep for lightning talk | 17:56 |
| *** karthikp_ has quit IRC | 17:56 | |
| pleia2 | pabelanger: just don't want to get distracted and miss it | 17:56 |
| pabelanger | pleia2: also considering adding diskimage-builder for lightning talk too | 17:56 |
| pabelanger | pleia2: ++ | 17:56 |
| notmorgan | clarkb: but i stick my swap space on my workstation on spinning rust, not that i use swap much (64GB of ram) | 17:56 |
| *** Sukhdev_ has quit IRC | 17:56 | |
| pleia2 | pabelanger: still want to help with this one? | 17:57 |
| notmorgan | clarkb: related i want http://store-xkcd-com.myshopify.com/products/no-raptors but as a sticker... well for all the reasons | 17:57 |
| pabelanger | pleia2: Yup, if you want to add me to it | 17:57 |
| pleia2 | pabelanger: good :) | 17:57 |
| blueboxjesse | jeblair: Got it. Let's disable the old one then. Should I just then null out its details in the Stackalytics code? | 17:57 |
| jeblair | notmorgan: btw, my /tmp is on an ssd, so i mount a tmpfs at /tmpfs and then do: export ZUUL_TEST_ROOT=/tmpfs | 17:57 |
| jeblair | notmorgan: that way the crazy busy git operations zuul tests do are all on tmpfs | 17:57 |
| *** garyk has quit IRC | 17:57 | |
| pleia2 | thingee: do we need to give you our lightning talk submission ideas before the other submission deadline, or is it more casual since you're holding the slot? | 17:57 |
| notmorgan | jeblair: i... i made a ramdisk for /tmp :P | 17:57 |
| jeblair | notmorgan: cool, then you're all set :) | 17:58 |
| notmorgan | jeblair: yesh :) | 17:58 |
| *** heyongli has quit IRC | 17:58 | |
| notmorgan | i honestly should just use the SSD for that stuff. | 17:58 |
| jeblair | notmorgan: (i end up using /tmp for "unpack this 12G image" a lot | 17:58 |
| *** heyongli has joined #openstack-infra | 17:58 | |
| jeblair | (so i like to keep it on a real disk of some kind, but don't want to wear out an ssd with unit tests) | 17:59 |
| notmorgan | jeblair: yah. i wish my motherboard supported 2x m.2 slots | 17:59 |
| notmorgan | i am also looking at putting a 2.5" SSD in for just more fast storage. | 17:59 |
| notmorgan | since 512GB gets eaten fast. | 17:59 |
| notmorgan | clarkb: also.. https://xkcd.com/292/ since we're on the topic of raptors | 18:00 |
| mordred | blueboxjesse: you can list multiple email addresses with stackalytics which is how they look at things - look in http://git.openstack.org/cgit/openstack/stackalytics/tree/etc/default_data.json | 18:00 |
| fungi | a while back i picked up a few 1tb external usb3 ssd drives (transcend). fast and useful for projects requiring lots of scratch space | 18:00 |
| mordred | also ... I'd like to announce that jetlag is evil | 18:00 |
| *** dtantsur is now known as dtantsur|afk | 18:01 | |
| *** ifarkas has quit IRC | 18:01 | |
| *** xarses_ is now known as xarses | 18:01 | |
| jeblair | i'm flushing gerrit's caches. that apparently makes it very slow. | 18:02 |
| fungi | jeblair: yes, _very_ | 18:02 |
| *** Apoorva_ has joined #openstack-infra | 18:02 | |
| mriedem | i'm glad someone knew what was slowing things down | 18:02 |
| jeblair | it did not used to do that :( | 18:02 |
| *** rcarrillocruz has joined #openstack-infra | 18:02 | |
| fungi | i think that "feature" showed up when we upgraded to 2.11 | 18:03 |
| *** PollyZ has quit IRC | 18:03 | |
| clarkb | jeblair: anymore I think reports of wearing out SSD are fairly overblown. At least I don't tend to use the same device for 10 years | 18:03 |
| clarkb | jeblair: so will be hard for me to thrash them hard enough in the ~4 years I do use them to get to that point | 18:03 |
| *** yamamoto has quit IRC | 18:03 | |
| jeblair | blueboxjesse: since i nulled out the email address of the old account, you should now be able to add it to the new account. | 18:03 |
| notmorgan | holy crap. they make 4TB 2.5" SSDs now? | 18:03 |
| *** yamamoto has joined #openstack-infra | 18:04 | |
| jeblair | clarkb: i think my ssd may be 6+ years old now? my rust array is 10 years old. | 18:05 |
| *** Apoorva has quit IRC | 18:05 | |
| jeblair | clarkb: can you send me your 4 year old stuff? :) | 18:05 |
| zaro | fungi: i noticed the acl on review-dev to allow registered users to submit changes was missing, just added it back and now users can submit changes again. | 18:06 |
| clarkb | jeblair: my 4 year old stuff goes on the shelf for cold storage >_> | 18:06 |
| fungi | zaro: cool. someone may have been testing something there at some point wrt that acl config | 18:06 |
| jeblair | clarkb: and you have so much more storage space now :) | 18:06 |
| *** garyk has joined #openstack-infra | 18:06 | |
| jesusaur | I'm having trouble understanding http://logs.openstack.org/65/339265/3/check/gate-puppet-hound-puppet-lint/ce1e250/console.html#_2016-07-11_17_32_52_090788 is that the puppet gem failing hard? | 18:07 |
| jeblair | the gerrit cache flush is complete | 18:07 |
| fungi | clarkb: on these 1tb drives, since they give me plenty of space, i just set the root reserved % a little higher than usual so that wear levelling has more breathing room to operate | 18:07 |
| jesusaur | nibalizer: why did we pin the puppet gem in openstack_infra_spec_helper? | 18:08 |
| *** heyongli has quit IRC | 18:08 | |
| * clarkb waits for next diff in pabelanger's change to open | 18:08 | |
| *** heyongli has joined #openstack-infra | 18:09 | |
| *** sputnik13 has joined #openstack-infra | 18:09 | |
| zaro | Zara, anteaya: here's a test for automatic task merge https://review-dev.openstack.org/#/c/5454/ | 18:09 |
| *** yamamoto has quit IRC | 18:09 | |
| anteaya | zaro: thank you | 18:09 |
| *** daemontool has joined #openstack-infra | 18:10 | |
| *** hemna has joined #openstack-infra | 18:10 | |
| *** garyk has quit IRC | 18:11 | |
| *** blueboxjesse has quit IRC | 18:11 | |
| clarkb | pabelanger: I approved the change but left a comment on something we might consider doing | 18:11 |
| *** sputnik13 has quit IRC | 18:12 | |
| armax | AJaeger_: ping | 18:12 |
| *** blueboxjesse has joined #openstack-infra | 18:12 | |
| AJaeger_ | hi armax ! | 18:12 |
| *** david-lyle has joined #openstack-infra | 18:12 | |
| armax | AJaeger_: hi! | 18:13 |
| *** ddieterly[away] has quit IRC | 18:13 | |
| armax | AJaeger_: I was looking at http://developer.openstack.org/api-ref.html | 18:13 |
| armax | and the links to the networking APIs | 18:13 |
| AJaeger_ | armax: annegentle is the expert for that in general ^ | 18:13 |
| armax | still resolve to http://developer.openstack.org/api-ref-networking-v2.html | 18:13 |
| armax | rather than http://developer.openstack.org/api-ref/networking/ | 18:13 |
| armax | AJaeger_: ah, ok | 18:13 |
| armax | I figured it was some sort of infra misconfiguration | 18:13 |
| blueboxjesse | jeblair: Perfect. Thanks so much. | 18:14 |
| *** sdake has quit IRC | 18:14 | |
| *** sputnik13 has joined #openstack-infra | 18:14 | |
| AJaeger_ | No, it isn't - needs changes for api-site. keystone did some recently, have a look at recent merges. annegentle will know whether that's all... | 18:14 |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Install Ceph Hammer and/or Jewel from CentOS Storage SIG repos https://review.openstack.org/340504 | 18:14 |
| *** blueboxjesse has quit IRC | 18:15 | |
| *** lucasagomes is now known as lucas|afk | 18:15 | |
| armax | AJaeger_: ack | 18:16 |
| armax | AJaeger_: thanks for the tip | 18:16 |
| mordred | jeblair: the gerrit slowdowns are cache related? | 18:16 |
| *** sputnik13 has quit IRC | 18:17 | |
| *** david-lyle has quit IRC | 18:17 | |
| armax | AJaeger_: one more thing | 18:17 |
| fungi | clarkb: pabelanger also had a comment on that spec after your new patchset | 18:17 |
| armax | AJaeger_: newbie question | 18:18 |
| *** AJaeger_ is now known as AJaeger | 18:18 | |
| AJaeger | armax: you're not a newbie ;) | 18:18 |
| *** rbrndt has joined #openstack-infra | 18:18 | |
| fungi | mordred: not usually afaik, but gerrit _does_ slow down when we flush its caches | 18:18 |
| armax | AJaeger_: how do one access test results for periodic jobs? | 18:18 |
| mordred | fungi: oh, even better | 18:18 |
| fungi | mordred: we also see gerrit slowdowns for other reasons though | 18:18 |
| *** heyongli has quit IRC | 18:18 | |
| annegentle | armax: I think that's all for redirects. | 18:18 |
| armax | annegentle: thanks! | 18:19 |
| AJaeger | armax: two options: 1) via OpenStack health, like http://status.openstack.org/openstack-health/#/g/build_queue/periodic?groupKey=build_queue&searchJob=translation | 18:19 |
| *** jlanoux has quit IRC | 18:19 | |
| clarkb | fungi: pabelanger ya not sure how exec is going to like that with the virtualenvs | 18:19 |
| armax | AJaeger: ack | 18:19 |
| *** heyongli has joined #openstack-infra | 18:19 | |
| AJaeger | 2) via logs http://logs.openstack.org/periodic/ | 18:19 |
| clarkb | fungi: though its only 6 extra bytes and if we are that close to the limit then maybe we need a different solution regardless | 18:19 |
| clarkb | pabelanger: ^ | 18:19 |
| AJaeger | armax: I prefer OpenStack health if your job is setup for it | 18:19 |
| annegentle | AJaeger: did we get the redirects figured out for keystone? | 18:19 |
| armax | AJaeger: looking | 18:19 |
| AJaeger | annegentle: we merged some at least | 18:20 |
| clarkb | fungi: pabelanger its probably worthwhile to start witht hings matching the labels so the mapping is clear and address any issue we run into with exec path limits when we hit them | 18:20 |
| annegentle | AJaeger: yeah I remember merging, then we weren't sure it was quite working? I'm gonna look again | 18:20 |
| armax | AJaeger: doesn’t look like it is | 18:20 |
| *** rdx_matt has quit IRC | 18:20 | |
| AJaeger | armax: AFAIK all dsvm jobs should be setup for openstack health | 18:21 |
| annegentle | AJaeger: ah they work now, sweet! Might have just been caching. | 18:21 |
| *** electrofelix has quit IRC | 18:21 | |
| AJaeger | armax: ask mtreinish for Health, he's the expert | 18:21 |
| mordred | fungi: in my jetlag brain state, I was inferring that we were flushing caches because the caches were somehow the cause of the slowdowns so flushing the caches would fix it - but that flushing the caches itself made things worse before it made them better | 18:21 |
| armax | AJaeger: I am trying to find the latest periodic-neutron-py34-with-neutron-lib-master in http://status.openstack.org/openstack-health/#/g/build_queue/periodic | 18:22 |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Install Ceph Hammer and/or Jewel from CentOS Storage SIG repos https://review.openstack.org/340504 | 18:22 |
| mordred | fungi: which would have been snarkworthy, but at least a step forward. however, seems that's just a jetlag fantasty | 18:22 |
| fungi | clarkb: yeah, though as a separate exercise we could figure out what the current longest job name is in gearman not ending in a node label suffix already and see how long that would become, then if we don't already have any working jobs with longer names than that test adding one | 18:22 |
| *** ddieterly has joined #openstack-infra | 18:23 | |
| * clarkb grumps that linux fails here | 18:23 | |
| fungi | mordred: actually, i believe the cache flushing was simply a safety precaution after jeblair deactivated blueboxjesse's duplicate account | 18:23 |
| clarkb | we could run all the tests on freebsd | 18:23 |
| AJaeger | armax: that job might not be setup for health since that's a normal python job | 18:23 |
| clarkb | problem solved >_> | 18:23 |
| clarkb | also my dib image build failed on downloading the trove mysql.qcow2 image | 18:23 |
| mordred | clarkb: yeah. I'm sure that we'd have no problems on freebsd :) | 18:23 |
| clarkb | likely hitting the same problem that heat has been hitting when downloading from that host | 18:24 |
| * AJaeger waves good bye | 18:24 | |
| armax | AJaeger: but similar ones *-with-oslo-master do show up | 18:24 |
| AJaeger | armax: please discuss with mtreinish | 18:24 |
| *** ociuhandu has quit IRC | 18:24 | |
| clarkb | mordred: its just amazing that 20 years ago linux changed the exec bye limit in the wrong direction and it has never been changed | 18:24 |
| armax | AJaeger: ack, thanks! | 18:24 |
| clarkb | 128bytes is sufficient for everything? | 18:24 |
| mordred | clarkb: who needs more than 128 bytes? | 18:24 |
| * amrith takes a seat at the back of the room | 18:25 | |
| * mordred hands amrith a box of almost uneaten popcorn | 18:26 | |
| Zara | zaro: thank you! I'm busy with non-work stuff now but I'll take a look tomorrow, so just letting you know I've seen it. :) | 18:26 |
| mwhahaha | hey infra folks, we're running into an issue with one of the puppet-openstack jobs where we appear to be running with a us-ascii only lang or something, http://logs.openstack.org/93/340493/1/check/gate-puppet-openstack-cookiecutter-puppet-3-cookiecutter-check/bc70a5b/console.html#_2016-07-11_17_53_44_292869 | 18:26 |
| * amrith thanks mordred for popcorn ... takes a handful | 18:26 | |
| clarkb | fungi: pabelanger responded on the change | 18:26 |
| *** PollyZ has joined #openstack-infra | 18:27 | |
| mwhahaha | any thoughts on what exactly we should configure as I can't reproduce the error locally since i'm using en_US.UTF-8 or something to that effect | 18:27 |
| clarkb | mwhahaha: it should get en_US.utf8 by default iirc | 18:27 |
| mwhahaha | well our job seems to disagree :D | 18:27 |
| clarkb | ya I am about to check locale output on our centos-7 iamges | 18:28 |
| clarkb | mwhahaha: LANG=en_US.utf8 | 18:28 |
| clarkb | oh but jenkins is different fun | 18:28 |
| mwhahaha | it might just be that job because the other jobs that do the same stuff don't have that problem | 18:29 |
| *** heyongli has quit IRC | 18:29 | |
| clarkb | jenkins has it set to LANG= which will fallback to libc default iirc | 18:29 |
| *** heyongli has joined #openstack-infra | 18:29 | |
| fungi | mwhahaha: clarkb: by default our ubuntu images don't have the package installed to provide en_US.utf8 by default | 18:29 |
| openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Add example commands for the Worklists api https://review.openstack.org/340506 | 18:29 |
| clarkb | fungi: this is centos-7 but maybe same situation? | 18:29 |
| * fungi apparently really wanted to emphasize the "by default" part | 18:29 | |
| fungi | clarkb: quite possible | 18:30 |
| mordred | fungi: by default I think you did a good job by default | 18:30 |
| clarkb | when I login with my user I get en_US.utf8 | 18:30 |
| fungi | i can check | 18:30 |
| clarkb | but sudo su - jenkisn results in LANG= | 18:30 |
| *** asettle has quit IRC | 18:30 | |
| stevemar | armax: AJaeger figure it out? | 18:30 |
| mordred | clarkb: oh - maybe it's not in the env settings for sudo? | 18:30 |
| fungi | clarkb: yeah, ssh forwards some envvars from your calling environment, which does include your locale-related settings | 18:30 |
| armax | stevemar: which issue exactly? | 18:30 |
| stevemar | armax: AJaeger we needed https://review.openstack.org/#/c/337887/ merged before we could see the keystone APIs | 18:31 |
| clarkb | mordred: maybe? | 18:31 |
| clarkb | fungi: ah | 18:31 |
| pabelanger | clarkb: sure, checking your comments | 18:31 |
| armax | stevemar: ack, thanks for the pointer | 18:31 |
| fungi | clarkb: so just because you have LANG=something after ssh'ing in, doesn't mean the remote system actually has the files needed to represent that installed | 18:31 |
| mordred | fungi: oh - good call - since we're ssh-ing in from zuul-launcher -we might be missing the LANG settings there | 18:31 |
| stevemar | armax: your APIs are visible: http://developer.openstack.org/api-ref/networking/ | 18:32 |
| fungi | mordred: i _think_ openssh only does that for interactive sessions though | 18:32 |
| armax | stevemar: yes | 18:32 |
| openstackgerrit | Clark Boylan proposed openstack-infra/infra-specs: Spec for testing Newton on Xenial transition https://review.openstack.org/337905 | 18:32 |
| stevemar | armax: yeah, you need the same change i dropped in, just look at the patch i sent you | 18:32 |
| *** Daisy has joined #openstack-infra | 18:32 | |
| armax | stevemar: yup, tnx | 18:32 |
| stevemar | armax: i also merged this: https://review.openstack.org/#/c/337805/ but not sure if necessary | 18:33 |
| mordred | notmorgan: since you're around today ... | 18:33 |
| armax | stevemar: these are nice to have | 18:33 |
| *** karthikp_ has joined #openstack-infra | 18:33 | |
| fungi | ssh -v will generally mention if it's sending any vars | 18:33 |
| stevemar | armax: glad to help | 18:34 |
| mordred | notmorgan: did you see the note I left a few days ago about shade functional tests and theories that it might be keystone related? (seeing stevemar made me think of it) | 18:34 |
| armax | stevemar: thanks! | 18:34 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 18:35 |
| mordred | armax: btw- that issue I pinged you about last week ^^ current theory is keystone. things run as expected if we use the devstack-admin user, but with the devstack user they run an order of magnitude slower | 18:35 |
| *** ociuhandu has joined #openstack-infra | 18:35 | |
| armax | mordred: but they do pass? | 18:35 |
| clarkb | fungi: I thought we had done work to make sure that we have a utf8 locale by default everywhere | 18:35 |
| fungi | clarkb: mordred: according to my tests, openssh (7.2p2 at least) does actually forward LC_COLLATE, LANG, LC_MEASUREMENT, LC_CTYPE and LC_TIME for me even in a noninteractive session (including one without a terminal as stdin for the local environment) | 18:35 |
| armax | mordred: or the timeout is because of the sluggishness? | 18:36 |
| clarkb | fungi: and we were going to try to set it to C.utf8 but that wasn't available everywhere so would use en_US.utf8 instead | 18:36 |
| mordred | armax: no. they are too slow to pass. timeout is because of sluggishness | 18:36 |
| armax | mordred: that’s strange indded | 18:36 |
| armax | mordred: and the Neutron tests are the only ones being affected? | 18:36 |
| fungi | clarkb: except en_US.utf8 was also not available by default everywhere (ubuntu trusty/xenial i think) so if we're catering to that we're installing the language pack for it either in the image or as a job runtime dep | 18:36 |
| mordred | armax: http://paste.openstack.org/show/528615/ is a test script that is consistent even on devstack's not in the gate | 18:37 |
| *** Daisy has quit IRC | 18:37 | |
| mordred | armax: and yah - it's only the devstack w/neutron config that's failing for us | 18:37 |
| fungi | clarkb: we install it from bindep-fallback.txt | 18:38 |
| clarkb | fungi: considering our images are already 14GB huge we should probably just install the package at build time | 18:38 |
| fungi | language-pack-en [platform:ubuntu] | 18:38 |
| clarkb | because really compared to 14GB its not going to matter | 18:38 |
| mordred | armax: so I'm going to just keep mentioning notmorgan and hope that he magically fixes something | 18:38 |
| mwhahaha | so i don't think it's the image because our normal syntax jobs are centos7 | 18:38 |
| clarkb | mwhahaha: but ^ that probably exaplins it, your job isn't using the fallback dep list and isn't installing the lang package(s) | 18:38 |
| fungi | clarkb: if memory serves, the reasoning is that the ubuntu-minimal element doesn't install that, so making sure it's declared as a runtime dependency if the job needs it is a good idea anyway | 18:39 |
| armax | mordred: could be something we do too | 18:39 |
| clarkb | fungi: ya but it also doesn't install sshd | 18:39 |
| *** heyongli has quit IRC | 18:39 | |
| * mwhahaha scrolls up | 18:39 | |
| notmorgan | mordred: wait what? | 18:39 |
| *** Apoorva_ has quit IRC | 18:39 | |
| *** heyongli has joined #openstack-infra | 18:39 | |
| fungi | clarkb: people running that job locally may not actually need sshd installed, but may need to know that the job requires a specific locale? | 18:39 |
| *** rossella_s has quit IRC | 18:40 | |
| *** Apoorva has joined #openstack-infra | 18:40 | |
| notmorgan | mordred: looooooooking at backscroll now | 18:40 |
| mwhahaha | so we're not sshing, that job just checks stuff out, builds a module and runs the tests | 18:40 |
| clarkb | I suppose. I really dislike the attitude of make thing so minimal it doesn't work in any reasonable situation | 18:40 |
| *** dizquierdo has joined #openstack-infra | 18:40 | |
| mwhahaha | http://logs.openstack.org/71/340371/3/check/gate-puppet-nova-puppet-syntax-3-centos-7/06aada3/console.html (a normal syntax job) | 18:40 |
| notmorgan | mordred: no i didn't see that note | 18:40 |
| *** rossella_s has joined #openstack-infra | 18:40 | |
| clarkb | mwhahaha: yes we know, the problem is we don't install the utf8 languages in that job because you are not using the fallback requirements list | 18:40 |
| clarkb | mwhahaha: so you can add the packages to your other-requirements and I think it may work | 18:40 |
| mwhahaha | oook | 18:41 |
| mwhahaha | i'll give that a shot then | 18:41 |
| armax | mordred: the gap between admin and non-admin is shocking | 18:41 |
| rcarrillocruz | indeed is | 18:41 |
| mwhahaha | got lost in the scrolling | 18:41 |
| clarkb | fungi: like my biggest peeve with ubuntu-minimal is whenever I use it I have to hand roll an install sshd element of my own | 18:41 |
| rcarrillocruz | i assume some keystone logic in between, dunno | 18:41 |
| greghaynes | clarkb: not element | 18:41 |
| greghaynes | clarkb: -p openssh-server | 18:41 |
| rcarrillocruz | the difference is quite big | 18:41 |
| *** asettle has joined #openstack-infra | 18:41 | |
| clarkb | greghaynes: oh neat didn't know about that i have been making an element that deps on apckage installs and has that listed | 18:42 |
| notmorgan | there is a difference in speed between admin and non-admin users in keystone? | 18:42 |
| armax | mordred: most of the policy checks when running as admin are skipped in Neutron, but I don’t think that would induce a order of magnitude performance penalty | 18:42 |
| fungi | mwhahaha: clarkb: which platform was the job in question running/failing on? | 18:42 |
| clarkb | fungi: centos-7 | 18:42 |
| mwhahaha | centos7 | 18:42 |
| greghaynes | clarkb: it is still very silly you have to specify an extra argument, though | 18:42 |
| armax | mordred: besides we would have caught it in other test configurations | 18:42 |
| notmorgan | armax: wait... what is the configuration you're using? | 18:42 |
| notmorgan | armax: i'm missing some context here. | 18:42 |
| fungi | clarkb: mwhahaha: i don't have evidence to suggest that there are additional packages needed for it on centos-7, but i'll see if i can confirm | 18:42 |
| mwhahaha | there shouldn't be | 18:42 |
| *** elo has joined #openstack-infra | 18:42 | |
| mwhahaha | i think it's part of glibc-common or something | 18:43 |
| armax | notmorgan: I am talking in the gate jobs for neutron | 18:43 |
| notmorgan | what is the specifics of the difference you're seeing between admin and non-admin? | 18:43 |
| clarkb | mwhahaha: I don't think it is I recall ianw and I grumping over this in centos/fedora at one time | 18:43 |
| *** sdake has joined #openstack-infra | 18:43 | |
| mordred | notmorgan: heya! | 18:43 |
| clarkb | basically ther is a giant install all the langs package in both iirc and if you don't have that you get the built ins whcih are just C for space concerns | 18:43 |
| fungi | yeah, i vaguely recall that as of centos 7 and f23 or something the non-ascii locales got split off into a separate package | 18:43 |
| greghaynes | clarkb: Yea, IIRC the glibc package kicks off loale generation | 18:43 |
| mordred | notmorgan: the problem is in the shade functional tests - I was originally poking armax for help as it only shows up in the neutron config | 18:43 |
| greghaynes | clarkb: and it only gets re-installed if you remove then reinstall that package | 18:44 |
| * notmorgan got distracted looking at hardward block layouts on motherboards, so context switching to keystone isn't that disruptive | 18:44 | |
| mordred | notmorgan: http://paste.openstack.org/show/528615/ | 18:44 |
| mordred | notmorgan: is the simple reproduction case | 18:44 |
| fungi | which has as a result increased the urgency on the bug report to try and get C.utf8 added to rh distros | 18:44 |
| openstackgerrit | Merged openstack-infra/storyboard: Use a common requirements file https://review.openstack.org/339286 | 18:44 |
| clarkb | f24 makes the switch to doing package per locale/lang | 18:44 |
| mordred | notmorgan: that it's an order of magnitude different between admin and non-admin is why we were thinking maybe it's a keystone something | 18:44 |
| mordred | notmorgan: but basically shade gate is broken currently due to this and we're largely stumped | 18:45 |
| notmorgan | that... makes absolutely no sense. | 18:45 |
| mordred | notmorgan: yah. right? | 18:45 |
| notmorgan | all users in keystone are equal except in policy checks. | 18:45 |
| notmorgan | unless you use the legacy "admin token" thing | 18:45 |
| notmorgan | which does zero user level things. | 18:45 |
| clarkb | mordred: notmorgan is there still an admin vs non admin port/server split? | 18:46 |
| notmorgan | clarkb: in v3, they are the same thing. | 18:46 |
| notmorgan | in v2, it's a pipeline change, so i guess theortically it could be routes+regex matching... but i'd be surprised | 18:46 |
| greghaynes | http://git.openstack.org/cgit/openstack/diskimage-builder/tree/elements/yum-minimal/pre-install.d/03-yum-cleanup | 18:46 |
| notmorgan | but i'd expect the inverse in that case from waht is being seen | 18:46 |
| *** akshai has quit IRC | 18:47 | |
| greghaynes | I believe that is the interesting code for locales on rh images | 18:47 |
| openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Add example commands for the Tags api https://review.openstack.org/338532 | 18:47 |
| fungi | clarkb: mwhahaha: so it looks like they should still be in glibc-common on centos-7 as f24 (and the package split) came later | 18:47 |
| mordred | notmorgan, clarkb: the script shows the problem in local devstacks too, so it's not gate config related | 18:47 |
| clarkb | fungi: mwhahaha greghaynes looks like we should have at least en_US.utf8 | 18:48 |
| *** kencjohnston has joined #openstack-infra | 18:48 | |
| clarkb | and the other things are stripped | 18:48 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 18:48 |
| notmorgan | oh i wonder if this is something insane like "we can't list X in keystone as non-admin and therefore we have to do this the slow way" | 18:49 |
| greghaynes | clarkb: that sounds right | 18:49 |
| fungi | yeah, any locales starting with en_US seem like they _should_ be inlcuded | 18:49 |
| clarkb | fungi: mwhahaha greghaynes so maybe zuul launcher needs to specify when it ssh's? | 18:49 |
| *** Qiming_ has quit IRC | 18:49 | |
| mwhahaha | but why wouldn't it trigger on the puppet-syntax jobs | 18:49 |
| *** heyongli has quit IRC | 18:49 | |
| *** heyongli has joined #openstack-infra | 18:50 | |
| clarkb | mwhahaha: maybe they run on a different image, or something | 18:50 |
| *** akshai has joined #openstack-infra | 18:50 | |
| mwhahaha | which also run on centos7 and basically do the bit that's failing in the cookiecutter | 18:50 |
| mwhahaha | no they don't which is the odd thing | 18:50 |
| clarkb | mwhahaha: is it possible they don't use the same non ascii string? | 18:50 |
| mwhahaha | they do | 18:50 |
| clarkb | I don't know then | 18:50 |
| mwhahaha | yea i know, basically it's failing on the puppet syntax check | 18:50 |
| notmorgan | mordred: let me devstack. | 18:51 |
| notmorgan | mordred: can't guess based upon that script | 18:51 |
| mwhahaha | i'll go look at the project config and the logs to see if i can spot something. just wanted to verify that we at least have en_US.UTF8 | 18:51 |
| fungi | mwhahaha: clarkb: i have the answer | 18:51 |
| *** sdake has quit IRC | 18:51 | |
| fungi | mwhahaha: clarkb: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/macros.yaml#n377 | 18:52 |
| * notmorgan downloads ubuntu cloud image to check into this. | 18:52 | |
| greghaynes | fungi: ahoy! | 18:52 |
| fungi | that gets called by the syntax job | 18:52 |
| * mwhahaha flips tables | 18:52 | |
| clarkb | jeblair: maybe we should have zuul default to utf8? | 18:52 |
| clarkb | I want to say that jenkins did | 18:52 |
| mwhahaha | no that's a different job tho | 18:52 |
| clarkb | (and its a sane value for the future) | 18:52 |
| *** adrian_otto has quit IRC | 18:52 | |
| *** Rockyg has joined #openstack-infra | 18:52 | |
| mwhahaha | (not the puppet-openstack syntax job) | 18:53 |
| fungi | mwhahaha: oh, doesn't use the puppet-syntax builder? | 18:53 |
| mordred | notmorgan: thanks! it's been stumping Shrews and rcarrillocruz and I for days now | 18:53 |
| mwhahaha | hmm maybe it does | 18:53 |
| nibalizer | jesusaur: to avoid getting puppet 4 | 18:53 |
| mwhahaha | trying to track down all these magical things | 18:53 |
| mwhahaha | no we don't use the puppet-syntax builder | 18:54 |
| fungi | mwhahaha: i thought we had standardized some macros between the job for infra's and puppet-openstack's jobs, but maybe the syntax macro wasn't one of them | 18:54 |
| fungi | mwhahaha: have a log link for a passing syntax job i can look at? | 18:55 |
| mwhahaha | http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/puppet-module-jobs.yaml#n145 | 18:55 |
| mwhahaha | http://logs.openstack.org/71/340371/3/check/gate-puppet-nova-puppet-syntax-3-centos-7/06aada3/console.html | 18:55 |
| fungi | we have lots of environment debugging metadata logged which might allow me to spot it | 18:55 |
| mwhahaha | the only difference that i think i spot is that the failing one is running in a python virtualenv | 18:56 |
| jeblair | clarkb: we spent like a week or two being very deliberate about encoding. the gist is that zuul is attempting to stay out of the way and do what the default on the os does. so if the wrong thing is happening, then: a) if it's not the OS default, then zuul has a bug and b) if it is the OS default then the job needs to be adjusted (maybe to be more explicit; maybe to install something missing....) | 18:57 |
| openstackgerrit | Merged openstack-infra/project-config: Experimental reprepro job for deb-openstack-pkg-tools https://review.openstack.org/340469 | 18:57 |
| jeblair | clarkb: (jenkins is not a model here -- jenkins behavior was "leak parts of the locale configuration from the master to the slaves") | 18:57 |
| mwhahaha | http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/puppet-module-jobs.yaml#n342 is the job template for the failing job | 18:57 |
| clarkb | jeblair: I am not asserting jenkins as model... | 18:58 |
| clarkb | jeblair: I am asserting that there is no reason to not use utf8 | 18:58 |
| jeblair | clarkb: didn't say you were | 18:58 |
| clarkb | because its 2016 | 18:58 |
| jeblair | clarkb: i agree. but that's not something the test runner should be dealing with | 18:58 |
| clarkb | jeblair: the implication is that ssh carries that stuff over though | 18:59 |
| jesusaur | nibalizer: maybe we should pin to something newer than 3.0.0 | 18:59 |
| jeblair | clarkb: the code we added to zuul ensures that it does not | 18:59 |
| clarkb | jeblair: or are you just asying its completely unset by zuul and there isn't anything to inherit | 18:59 |
| *** heyongli has quit IRC | 18:59 | |
| fungi | mwhahaha: and what's the name of the failing job? | 18:59 |
| clarkb | jeblair: I see | 19:00 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Configure its-storyboard plugin https://review.openstack.org/330925 | 19:00 |
| mwhahaha | gate-puppet-openstack-cookiecutter-puppet-3-cookiecutter-check | 19:00 |
| *** heyongli has joined #openstack-infra | 19:00 | |
| mwhahaha | and -4- | 19:00 |
| *** yaume_ has joined #openstack-infra | 19:01 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update TestFairy plugin https://review.openstack.org/337945 | 19:02 |
| fungi | mwhahaha: so one possibly relevant difference between those is that the syntax job payload doesn't rely on privilege escalation since we revoke-sudo before running it | 19:02 |
| *** karthikp_ has quit IRC | 19:02 | |
| *** yamamoto has joined #openstack-infra | 19:02 | |
| mwhahaha | we could try adding it to that job | 19:02 |
| mwhahaha | since we don't need it either for that job | 19:02 |
| fungi | oh, in that case it's probably irrelevant | 19:02 |
| mwhahaha | yea | 19:02 |
| fungi | i was assuming something in there was changing users | 19:03 |
| mwhahaha | no | 19:03 |
| *** jamesmcarthur has joined #openstack-infra | 19:03 | |
| fungi | in which case it could have been something like a behavior difference for the jenkins user but not the root user | 19:03 |
| fungi | anyway, if there's no sudo or su happening in the failing job then that's not going to be the cause | 19:03 |
| jeblair | clarkb: here is the code: http://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/ansible/library/zuul_runner.py#n43 | 19:04 |
| nibalizer | jesusaur: if we pinned to 3.0.0 thats a bug | 19:04 |
| nibalizer | 3.x maybe is what we want | 19:04 |
| jeblair | clarkb: zuul runs scripts in a login shell with the environment set to those values | 19:04 |
| *** yaume has quit IRC | 19:04 | |
| nibalizer | or whatever the syntax is in gemspec | 19:04 |
| jeblair | clarkb: as close as is practical to what you get by logging in on the console and running a command | 19:04 |
| jesusaur | nibalizer: I'm not entirely sure that's what happened, but that's what http://logs.openstack.org/65/339265/3/check/gate-puppet-hound-puppet-lint/ce1e250/console.html#_2016-07-11_17_32_52_090788 looks like | 19:04 |
| nibalizer | maybe just < 4.0.0 | 19:05 |
| nibalizer | would be the right way to do that | 19:05 |
| clarkb | jeblair: I was just looking at /etc/default/lcoale and it is C.utf8 on our xenial iamges | 19:05 |
| clarkb | jesusaur: but there is no /etc/default/locale on centos | 19:05 |
| fungi | i would expect that on xenial | 19:05 |
| *** asettle has quit IRC | 19:05 | |
| clarkb | er jeblair ^ | 19:05 |
| clarkb | and /etc/environment is empty on centos | 19:06 |
| jesusaur | nibalizer: or maybe set the dependency to '3' instead of '3.0'? | 19:06 |
| jeblair | clarkb: then we may need to update that for centos (option "a" above :) | 19:06 |
| clarkb | is /etc/default/locale a debuntuism? | 19:06 |
| fungi | /etc/locale.conf may have defaults | 19:07 |
| clarkb | fungi: https://access.redhat.com/solutions/974273 says ya there | 19:07 |
| * clarkb looks | 19:07 | |
| *** sarob has quit IRC | 19:07 | |
| fungi | git01.0.0 has this one line in /etc/locale.conf: LANG=en_US.UTF-8 | 19:08 |
| nibalizer | jesusaur: maybe! | 19:08 |
| clarkb | fungi: our dib images do not have an /etc/locale.conf | 19:08 |
| *** nmagnezi has joined #openstack-infra | 19:08 | |
| clarkb | so I think we want zuul to add support for ^ | 19:08 |
| clarkb | then we need to fix our image builds | 19:08 |
| *** sarob has joined #openstack-infra | 19:08 | |
| jeblair | before we do that, we need to verify that's what pam does on centos | 19:08 |
| clarkb | jeblair: grep locale /etc/pam.d returns nothing | 19:09 |
| clarkb | er pam.d/* | 19:09 |
| jeblair | yeah, and pam_env is not run with any extra files, so i think it should only be reading /etc/environment | 19:09 |
| *** garyk has joined #openstack-infra | 19:10 | |
| *** heyongli has quit IRC | 19:10 | |
| *** _sarob has joined #openstack-infra | 19:10 | |
| *** fawadkhaliq has joined #openstack-infra | 19:10 | |
| *** heyongli has joined #openstack-infra | 19:10 | |
| *** tonytan4ever has quit IRC | 19:10 | |
| clarkb | and /etc/profile(.d)? is run by logins | 19:11 |
| *** karthikp_ has joined #openstack-infra | 19:11 | |
| pabelanger | clarkb: fungi: mind helping 340400 land? Adds our AFS packaging keytab to release.slave.o.o | 19:12 |
| pabelanger | hieradata already setup | 19:12 |
| clarkb | jeblair: that is where locale.conf seems to be read | 19:12 |
| clarkb | jeblair: there is a lang.sh and lang.csh that deal with it | 19:12 |
| fungi | yep... http://paste.openstack.org/show/529784/ | 19:13 |
| fungi | that's from /etc/profile.d/lang.sh on one of our git servers | 19:14 |
| *** sarob has quit IRC | 19:14 | |
| jeblair | so withou $HOME/.i18n that does nothing | 19:14 |
| *** ddieterly is now known as ddieterly[away] | 19:15 | |
| clarkb | jeblair: looks like it does both? | 19:15 |
| *** PollyZ has quit IRC | 19:15 | |
| clarkb | for langfile in /etc/locale.conf "$HOME/.i18n" ; do | 19:15 |
| fungi | check the conditional though | 19:15 |
| fungi | since $LANG is empty, it falls through to the else | 19:16 |
| openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Add example commands for the Worklists api https://review.openstack.org/340506 | 19:16 |
| *** deadnull is now known as _deadnull | 19:16 | |
| jeblair | i logged into a centos7 node and we have no /etc/locale.conf | 19:16 |
| fungi | which then iterates through /etc/locale.conf _and_ $HOME/.i18n and sources them all | 19:16 |
| *** rdx_matt has joined #openstack-infra | 19:16 | |
| fungi | jeblair: yep, i suspect that it's not getting added by the dib element | 19:17 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/puppet-openstack_infra_spec_helper: Change puppet gem dependency to any 3.x version https://review.openstack.org/340529 | 19:17 |
| jeblair | so i'm guessing we fix that, that script runs, and things should work | 19:17 |
| fungi | i'm trying to determine whether that file is normally added by anaconda or if it's owned by a package | 19:17 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/puppet-hound: Add ServerAlias support to the vhost config https://review.openstack.org/339274 | 19:18 |
| fungi | looks like the systemd package claims ownership of it | 19:18 |
| *** garyk has quit IRC | 19:18 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update check for valid attributes for SonaType CLM https://review.openstack.org/340530 | 19:18 |
| jeblair | fungi: so we can *actually blame systemd*?! | 19:18 |
| clarkb | jeblair: would it work though if zuul lauincher isn't setting that var? | 19:18 |
| * fungi prepares open letter to lennart | 19:18 | |
| clarkb | jeblair: I suppose ssh would find it not defined then set it | 19:18 |
| clarkb | which is that whole -n check early on | 19:18 |
| jeblair | clarkb: yeah, the unset var case will cause it to source /etc/locale.conf | 19:18 |
| * clarkb wonders why we bother with /etc/default/locale | 19:19 | |
| jeblair | clarkb: can you clarify "* clarkb wonders why we bother with /etc/default/locale" ? | 19:19 |
| clarkb | jeblair: in the zuul code you linked earlier you explicitly handle ubuntu specific things | 19:20 |
| jeblair | clarkb: ah yeah, that's because: | 19:20 |
| jeblair | sshd:session required pam_env.so user_readenv=1 envfile=/etc/default/locale | 19:20 |
| jeblair | in debuntu, pam is configured to also read that file | 19:20 |
| *** heyongli has quit IRC | 19:20 | |
| clarkb | jeblair: right so if it reads that file why do we need to also set the env var in teh env for it | 19:20 |
| fungi | greghaynes: any clue why the centos-minimal element would result in an image lacking a /etc/locale.conf if the systemd package installs that file? i don't see anything that would delete it in the element set | 19:20 |
| *** heyongli has joined #openstack-infra | 19:20 | |
| clarkb | shouldn't it also just work as in the centos case where profile is executrd and the env read automatically? | 19:20 |
| jeblair | clarkb: because zuul-launcher is not able to invoke the process with pam | 19:21 |
| fungi | zuul-launcher is attempting to emulate pam | 19:21 |
| jeblair | yep | 19:21 |
| clarkb | ah pam isn't part of our ssh login process | 19:21 |
| clarkb | ? I feel liek I am still msising something | 19:22 |
| jeblair | clarkb: because we're going through ansible, we are unable to have a perfectly clean ssh session on the host -- ansible has its own ideas about locale, etc | 19:22 |
| greghaynes | fungi: hrm, no idea | 19:23 |
| clarkb | ok so ansible invokes the normal login process and gets it wrong for our needs then we go back and redo it | 19:23 |
| jeblair | clarkb: yep | 19:23 |
| clarkb | so shouldn't we be doing the asme deal for centos-7 in that case? | 19:23 |
| greghaynes | fungi: I wonder if that localedef --delete-from-archive wipes it out? | 19:23 |
| jeblair | clarkb: we can't change how ansible is doing that, so we have to get a new environment. ideally we would link against pam and invoke the process that way. | 19:23 |
| clarkb | jeblair: right so don't we need to update zuul to do /etc/locale.conf too? | 19:23 |
| jeblair | clarkb: but it turns out that we can emulate everything we need about it in about 20 lines... so... that's easier than linking to pam :) | 19:24 |
| clarkb | jeblair: otherwise ansible could dirty the env on centos7? | 19:24 |
| jeblair | clarkb: i don't think so, because we also run "bash -l" which will invoke that lang.sh script, which will source locale.conf | 19:24 |
| clarkb | ok | 19:24 |
| mwhahaha | so not to go back to the original issue but i think it is package related | 19:24 |
| mwhahaha | the passing job runs the puppet-prepare-node builder | 19:24 |
| mwhahaha | while the failing one does not | 19:25 |
| mwhahaha | the puppet-prepare-node includes yum -y groupinstall "Development Tools" | 19:25 |
| jeblair | clarkb: so the guiding principle is "try to do exactly what pam_env does on every system" and i think we've got that on centos7, just missing the locale.conf file | 19:25 |
| jeblair | clarkb: (i mean, the system itself is missing the file) | 19:25 |
| *** dizquierdo has quit IRC | 19:25 | |
| clarkb | jeblair: right, the dib built image lacks the info | 19:26 |
| *** Sukhdev_ has joined #openstack-infra | 19:26 | |
| fungi | mwhahaha: i see puppet-prepare-node in the list of builders for the gate-{name}-puppet-{puppet_version}-cookiecutter-check{job-suffix} template too | 19:26 |
| *** sdake has joined #openstack-infra | 19:26 | |
| greghaynes | this is a centos7 image or ? | 19:26 |
| *** sdake has quit IRC | 19:26 | |
| fungi | greghaynes: yes | 19:26 |
| mwhahaha | argh you're right wrong tab | 19:26 |
| * mwhahaha cries | 19:26 | |
| clarkb | greghaynes: yes centos-7 with centos-minimal element | 19:27 |
| jeblair | clarkb: and, to put this another way, put another way -- the 2 files on http://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/ansible/library/zuul_runner.py#n43 are the pam_env default, and the extra file that debuntu adds in their pam config. if centos also added an "envfile=" argument to pam_env, we would add it there, but they don't | 19:27 |
| fungi | mwhahaha: yeah, so far no idea why those two jobs don't both fail the same way | 19:27 |
| jeblair | er, sorry for the repetitious repitition | 19:27 |
| fungi | could you repeat that? ;) | 19:27 |
| jeblair | yes, yes, and yes! | 19:28 |
| * clarkb discvoers that tools/build-image.sh does not build a working infra iamge anymore | 19:28 | |
| clarkb | will update | 19:28 |
| jeblair | and i will lunch | 19:28 |
| clarkb | I am trying to make this an exercise of how can people work with this stuff locally | 19:28 |
| clarkb | and found a bug so win | 19:28 |
| zaro | would someone be able to help figure out why gate-infra-puppet-apply-ubuntu-trusty job is failing? https://review.openstack.org/#/c/330925/ | 19:29 |
| jeblair | clarkb: i think derekh was asking/maybe volunteering about publishing nodepool images last week | 19:29 |
| jeblair | the sshd config change was in service of that | 19:29 |
| fungi | greghaynes: it's unfortunate the localedef manpage doesn't mention --delete-from-archive | 19:30 |
| *** heyongli has quit IRC | 19:30 | |
| pabelanger | crinkle: rcarrillocruz: I've created https://www.openstack.org/summit/barcelona-2016/call-for-presentations/manage/15433 for infracloud talk. Right now it has some place holder values, if you'd like to review please | 19:30 |
| greghaynes | fungi: ya, just noticed that :/ | 19:30 |
| zaro | jeblair: zuul-dev doesn't seem to be running jobs from review-dev. was going to look into fixing that. | 19:31 |
| pabelanger | crinkle: rcarrillocruz: Please make changes as you feel | 19:31 |
| *** heyongli has joined #openstack-infra | 19:31 | |
| fungi | or --list-archive for that matter | 19:31 |
| zaro | jeblair: do you have any ideas what's wrong there? | 19:31 |
| *** rcernin has joined #openstack-infra | 19:31 | |
| clarkb | jeblair: the sshd config change was even in service of building your own image | 19:31 |
| fungi | greghaynes: fwiw, the manpage i have for localedef on a debian/sid machine does mention those | 19:31 |
| clarkb | jeblair: since you couldn't login via root which glean configures | 19:31 |
| *** sdake has joined #openstack-infra | 19:32 | |
| *** sdake has quit IRC | 19:32 | |
| fungi | greghaynes: i'm guessing the one on centos just needs some updating | 19:32 |
| greghaynes | fungi: clarkb just confired that after the yum install for the rootfs when using centos-minimal there is no /etc/locale.conf | 19:32 |
| *** PollyZ has joined #openstack-infra | 19:32 | |
| greghaynes | so we don't remove it, it just never gets written | 19:32 |
| anteaya | zaro: I believe the puppet-apply job is failing due to a gem release breaking other gems, EmilienM nibalizer is that failure still affecting puppet-apply? | 19:32 |
| fungi | greghaynes: any chance you could test again with the locale cleanup bits removed/disabled? | 19:32 |
| *** akshai has quit IRC | 19:32 | |
| EmilienM | anteaya: what failure? I don't follow puppet-infra things much | 19:32 |
| anteaya | EmilienM: this failure: http://logs.openstack.org/25/330925/9/check/gate-infra-puppet-apply-ubuntu-trusty/46f654a/console.html | 19:32 |
| greghaynes | fungi: I set a breakpoint before those run which is where i'm inspecting | 19:33 |
| fungi | even better | 19:33 |
| anteaya | EmilienM: Could not find init script or upstart conf file for 'apache2' | 19:33 |
| anteaya | EmilienM: am I mis-remembering that as the failure you and nibalizer were working on updateing all our gems to fix | 19:33 |
| *** karthikp_ has quit IRC | 19:34 | |
| *** karthikp_ has joined #openstack-infra | 19:34 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Update build-image.sh to reflect nodepool config https://review.openstack.org/340539 | 19:34 |
| greghaynes | fungi: hah, the systemd package is not installed | 19:35 |
| fungi | greghaynes: yep, that would do it | 19:35 |
| fungi | greghaynes: since it at least claims to be the package which provides that file | 19:35 |
| greghaynes | I dont understand what that means, we do have a systemd when the image boots... | 19:36 |
| *** akshai has joined #openstack-infra | 19:36 | |
| *** adrian_otto has joined #openstack-infra | 19:36 | |
| *** ddieterly[away] is now known as ddieterly | 19:37 | |
| jesusaur | anteaya: the "could not find init script" message is a red herring, the actual error is http://logs.openstack.org/25/330925/9/check/gate-infra-puppet-apply-ubuntu-trusty/46f654a/console.html#_2016-07-11_19_02_21_951253 | 19:37 |
| *** dtardivel has quit IRC | 19:37 | |
| clarkb | greghaynes: systemd works even when not installed its magic | 19:37 |
| anteaya | jesusaur: thank you | 19:37 |
| anteaya | EmilienM: sorry to bother you | 19:37 |
| greghaynes | oh, theres is a systemd-libs installed, but not systemd? | 19:38 |
| anteaya | zaro: jesusaur found the correct error message | 19:39 |
| *** jamesmcarthur has quit IRC | 19:39 | |
| EmilienM | anteaya: i'm not familiar with infra puppet modules, I looked at the logs and there are so much failures (you can grep them with "Error:") so i'm not sure I can provide immediate help. | 19:39 |
| anteaya | EmilienM: it is okay, I was looking at the wrong thing, sorry to bother you | 19:39 |
| fungi | greghaynes: i grabbed one running a random job and do see systemd-219-19.el7_2.11.x86_64 installed | 19:40 |
| greghaynes | fungi: clarkb ok, later on in the build systemd gets installed. There is still no /etc/locale.conf though | 19:40 |
| *** heyongli has quit IRC | 19:40 | |
| greghaynes | fungi: Yea, my breakpoint was before that, apparently | 19:40 |
| *** jcoufal_ has joined #openstack-infra | 19:40 | |
| *** jamesmcarthur has joined #openstack-infra | 19:41 | |
| *** heyongli has joined #openstack-infra | 19:41 | |
| *** dizquierdo has joined #openstack-infra | 19:41 | |
| *** ajmiller has joined #openstack-infra | 19:41 | |
| *** asettle has joined #openstack-infra | 19:41 | |
| greghaynes | and localectl cant do anything useful because it cant make a bus connection | 19:41 |
| *** dizquierdo has quit IRC | 19:41 | |
| greghaynes | I wonder if thats related | 19:41 |
| fungi | greghaynes: bizarre. it seems to be in the files list for https://www.rpmfind.net/linux/RPM/centos/7.2.1511/x86_64/Packages/systemd-219-19.el7.x86_64.html | 19:42 |
| *** dizquierdo has joined #openstack-infra | 19:42 | |
| mordred | greghaynes: oh. yeah. because chroot perhaps? | 19:42 |
| greghaynes | mordred: Yea | 19:42 |
| EmilienM | anteaya: no worries :) | 19:42 |
| anteaya | :) | 19:42 |
| greghaynes | I'm wondering if the package just fails to write that file out if its installed in a chroot/non-systemd host | 19:42 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Update PACKAGE_DIR for reprepro-import builder https://review.openstack.org/340543 | 19:42 |
| *** jcoufal has quit IRC | 19:43 | |
| *** ajmiller_ has quit IRC | 19:44 | |
| *** _deadnull is now known as deadnull | 19:45 | |
| *** javeriak_ has quit IRC | 19:47 | |
| greghaynes | fungi: I lack the fu needed to debug this, I wonder if we could just write out a locale.conf though? We know we strip everything but en_us.UTF-8 so we know what to write... | 19:49 |
| greghaynes | or, if someone who groks rpm wants to pick apart the systemd rpm thatd be awesome :) | 19:50 |
| *** deadnull has quit IRC | 19:50 | |
| *** rdx_matt has quit IRC | 19:51 | |
| *** heyongli has quit IRC | 19:51 | |
| *** heyongli has joined #openstack-infra | 19:51 | |
| fungi | greghaynes: yeah, a bit out of my depth as well. i don't know what conditions might cause systemd not to create that file, or if it only claims to provide it and under normal circumstances anaconda or something creates it instead | 19:53 |
| pabelanger | mordred: do you mind? https://review.openstack.org/#/c/340401/ in the process of testing reprepro for zigo | 19:53 |
| *** aviau has quit IRC | 19:54 | |
| pabelanger | mordred: and https://review.openstack.org/#/c/340400/ too | 19:54 |
| *** aviau has joined #openstack-infra | 19:54 | |
| *** adrian_otto has quit IRC | 19:54 | |
| *** ajmiller has quit IRC | 19:54 | |
| *** ajmiller has joined #openstack-infra | 19:55 | |
| *** yamamoto has quit IRC | 19:55 | |
| *** nadya has joined #openstack-infra | 19:55 | |
| *** yamamoto has joined #openstack-infra | 19:55 | |
| *** yamamoto has quit IRC | 19:57 | |
| *** yamamoto has joined #openstack-infra | 19:57 | |
| *** Nikolay_St has quit IRC | 19:58 | |
| *** asettle has quit IRC | 19:59 | |
| *** ajmiller has quit IRC | 19:59 | |
| *** elo has quit IRC | 20:00 | |
| *** yamamoto has quit IRC | 20:00 | |
| *** ajmiller has joined #openstack-infra | 20:00 | |
| mordred | pabelanger: done | 20:00 |
| *** yamamoto has joined #openstack-infra | 20:00 | |
| slagle | pabelanger: :), http://logs.openstack.org/77/324777/67/experimental/gate-tripleo-ci-centos-7-nonha-multinode/704439f/ | 20:00 |
| pabelanger | mordred: danke | 20:00 |
| pabelanger | slagle: nice job | 20:01 |
| *** heyongli has quit IRC | 20:01 | |
| greghaynes | fungi: do you know if this is an issue on fedora as well? | 20:02 |
| fungi | greghaynes: good idea--i'll check | 20:02 |
| *** kzaitsev_mb has joined #openstack-infra | 20:02 | |
| *** heyongli has joined #openstack-infra | 20:04 | |
| *** markusry has quit IRC | 20:04 | |
| *** yamamoto has quit IRC | 20:05 | |
| timothyb89 | hey all, it looks like stackviz isn't building on xenial right now, does nodepool need a restart after https://review.openstack.org/#/c/338276/ went through? | 20:05 |
| *** akshai has quit IRC | 20:05 | |
| pabelanger | we likely didn't restart nodepool-builder | 20:05 |
| pabelanger | I can do that once images have been uploaded for the day | 20:06 |
| *** yaume_ has quit IRC | 20:06 | |
| timothyb89 | cool, thank you! | 20:06 |
| fungi | greghaynes: consistent... http://paste.openstack.org/show/529791/ | 20:06 |
| pabelanger | timothyb89: currently upload 48 images, but should be enabled for tomorrows builds | 20:06 |
| *** yaume has joined #openstack-infra | 20:06 | |
| greghaynes | fungi: awesome | 20:07 |
| timothyb89 | pabelanger: perfect, thanks! | 20:07 |
| greghaynes | fungi: Seems like the sane thing to do for now is just write out a /etc/locale.conf for en_us.UTF-8 in an element | 20:07 |
| greghaynes | and hopefully ianw or someone can shed some light on whats up with the rpm | 20:08 |
| fungi | greghaynes: i'm trying to dig into the specfile for the systemd package to see if i can figure this out | 20:08 |
| greghaynes | ah, ok | 20:08 |
| *** akshai has joined #openstack-infra | 20:08 | |
| *** sdake has joined #openstack-infra | 20:08 | |
| fungi | touch %{buildroot}%{_sysconfdir}/locale.conf | 20:09 |
| *** zul_ has joined #openstack-infra | 20:10 | |
| fungi | there's a conditional later on | 20:10 |
| fungi | if [ -e /etc/sysconfig/i18n -a ! -e /etc/locale.conf ]; then | 20:10 |
| fungi | which eventually contains | 20:10 |
| fungi | [ -n "$LANG" ] && echo LANG=$LANG > /etc/locale.conf 2>&1 || : | 20:10 |
| greghaynes | those /etc/locale.conf's I think may be the issue | 20:10 |
| greghaynes | I think this doesn't run inside the chroot, we use yum --installroot | 20:11 |
| *** e0ne has quit IRC | 20:11 | |
| greghaynes | so it may be checking that there is a /etc/locale.conf on the build host | 20:11 |
| *** john-davidge_ has quit IRC | 20:11 | |
| mordred | yup | 20:11 |
| mordred | I believe that is the case | 20:11 |
| *** heyongli has quit IRC | 20:11 | |
| * clarkb is failing at local iamge builds, hopeflly this time I get somehting that works | 20:11 | |
| mordred | which I think gets me back to greghaynes suggestion that we just do that ^^ in the element | 20:11 |
| fungi | greghaynes: well, this is i _think_ running in the context of the package build, not package installation | 20:11 |
| fungi | i'm still trying to confirm that | 20:11 |
| mordred | fungi: you don't have a link to that spec file do you? | 20:12 |
| fungi | someone with deeper grokkage of rpms could probably set me straight | 20:12 |
| fungi | mordred: lemme see if they have a browsable version of this | 20:12 |
| fungi | i had to git clone https://git.centos.org/git/rpms/systemd.git and git checkout c7 | 20:13 |
| mwhahaha | i'd assume the echo LANG thing would have been in a post install | 20:13 |
| fungi | then look at SPECS/systemd.spec | 20:13 |
| *** PollyZ has quit IRC | 20:13 | |
| *** heyongli has joined #openstack-infra | 20:14 | |
| mwhahaha | yea that's in %post | 20:14 |
| fungi | mwhahaha: good call. that's in the %post part of the file | 20:14 |
| fungi | so i guess it is in the context of the chroot | 20:14 |
| *** PollyZ has joined #openstack-infra | 20:14 | |
| greghaynes | annoyingly, yum reinstall systemd doesn't plop the file down either | 20:15 |
| greghaynes | from within the chroot where no /etc/locale.conf exists | 20:15 |
| *** nadya has quit IRC | 20:15 | |
| mwhahaha | is $LANG defined when you build in the chroot? | 20:16 |
| greghaynes | ah, good point | 20:16 |
| * greghaynes checks | 20:16 | |
| fungi | also, is rpm running in the context of teh chroot, or merely being told to write files prefixed with the chroot path? | 20:16 |
| *** _sarob has quit IRC | 20:16 | |
| crinkle | pleia2: for puppet apply i would just use tee | 20:16 |
| *** pcaruana has quit IRC | 20:17 | |
| crinkle | anteaya: i've been traveling, back on friday | 20:17 |
| mwhahaha | and actually in post that block is just converting /etc/sysconfig/i18n to /etc/locale.conf | 20:17 |
| crinkle | pabelanger: cool thank you | 20:17 |
| greghaynes | fungi: right now it isn't running within the chroot for installing this package which is I think the root cause. I was playing with adding a reinstall later on though from within the chroot | 20:17 |
| *** sambetts is now known as sambetts|afk | 20:17 | |
| pleia2 | crinkle: thank you, just wanted to make sure I wasn't missing some built in puppet thing that does the same :) | 20:18 |
| fungi | mwhahaha: agreed, but point is it should be writing /etc/locale.conf if it doesn't exist | 20:18 |
| pleia2 | pipes it is | 20:18 |
| mwhahaha | no it won't | 20:18 |
| *** yaume has quit IRC | 20:18 | |
| crinkle | pleia2: there might be but only the man page would know for sure :) | 20:18 |
| jeblair | clarkb: if you download a nodepool image and boot it with a configdrive attached, you will be able to log in (now that the sshd config change has merged) | 20:18 |
| mwhahaha | it's a %ghost file | 20:18 |
| mwhahaha | meaning it doesn't have to exist | 20:18 |
| *** yaume has joined #openstack-infra | 20:19 | |
| clarkb | jeblair: yup, just pointing out it affected both local and remote builds | 20:19 |
| pleia2 | crinkle: yeah, I didn't find anything useful there | 20:19 |
| jeblair | clarkb: ++ | 20:19 |
| fungi | mwhahaha: if [ -e /etc/sysconfig/i18n -a ! -e /etc/locale.conf ] should be true if /etc/sysconfig/i18n and /etc/locale.conf does not, and then within that conditional if /etc/sysconfig/i18n sets LANG or LANG was previously set in the calling environmenr, it explicitly writes it into /etc/locale.conf | 20:19 |
| fungi | er, if /etc/sysconfig/i18n exists and /etc/locale.conf does not | 20:20 |
| mwhahaha | but neither exist | 20:20 |
| mwhahaha | so it doesn't execute | 20:20 |
| mwhahaha | :D | 20:20 |
| greghaynes | oh, I think whats going on is that /etc/locale.conf does exist - on the build host | 20:20 |
| mordred | yah | 20:20 |
| fungi | mwhahaha: oh, yep ;) | 20:20 |
| *** heyongli has quit IRC | 20:21 | |
| fungi | greghaynes: except it doesn't seem to | 20:21 |
| greghaynes | for the reinstall when within the chroot case neither file exists | 20:21 |
| greghaynes | fungi: on the nodepool builder? | 20:22 |
| *** heyongli has joined #openstack-infra | 20:22 | |
| *** sarob has joined #openstack-infra | 20:22 | |
| fungi | are we using a different server from nodepool.o.o for the builder these days? | 20:22 |
| * greghaynes has no idea | 20:22 | |
| *** sputnik13 has joined #openstack-infra | 20:22 | |
| mordred | don't think so | 20:23 |
| fungi | the only server in our inventory with "nodepool" in its name is nodepool.o.o anyway | 20:23 |
| clarkb | we are not | 20:23 |
| fungi | and it has the image logs | 20:23 |
| fungi | and no /etc/locale.conf on it (since it's ubuntu not centos) | 20:23 |
| mordred | mordred@nodepool:~$ ls /etc/locale.conf | 20:23 |
| mordred | ls: cannot access /etc/locale.conf: No such file or directory | 20:23 |
| *** _ari_ has quit IRC | 20:24 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 20:24 |
| *** annegentle has quit IRC | 20:24 | |
| openstackgerrit | Merged openstack-infra/system-config: Add packaging_keytab to release.slave hieradata https://review.openstack.org/340400 | 20:24 |
| greghaynes | huh. | 20:25 |
| fungi | so there goes that theory | 20:25 |
| openstackgerrit | Merged openstack-infra/system-config: Add debian-openstack to AFS web mirrors https://review.openstack.org/340401 | 20:26 |
| *** dmsimard|mtl has quit IRC | 20:26 | |
| fungi | mwhahaha: tell me more about "ghost files" | 20:26 |
| *** nmagnezi has quit IRC | 20:26 | |
| fungi | mwhahaha: if it doesn't exist but it's in the rpm's file list, it still won't necessarily create it? | 20:26 |
| greghaynes | Yea, I am thoroughly confused now | 20:26 |
| *** cody-somerville has joined #openstack-infra | 20:26 | |
| *** julim has quit IRC | 20:27 | |
| *** yaume has quit IRC | 20:30 | |
| *** yaume has joined #openstack-infra | 20:31 | |
| openstackgerrit | Christopher Aedo proposed openstack-infra/infra-specs: Add spec for hosted IRC client https://review.openstack.org/319506 | 20:32 |
| *** heyongli has quit IRC | 20:32 | |
| *** julim has joined #openstack-infra | 20:32 | |
| pabelanger | I am trying to figure out why release.slave.o.o is not launching jobs. Even thought jobs are queued. Looking at zuul debug.log I see the following: | 20:32 |
| pabelanger | 2016-07-11 20:28:44,358 DEBUG zuul.IndependentPipelineManager: Adding build <Build 3b0e67fcb6554640a51265d3283ad2aa of reprepro-import-debian-openstack-jessie on <Worker Unknown>> of job reprepro-import-debian-openstack-jessie to item <QueueItem 0x7f57c7cb7e90 for <Change 0x7f56ea5547d0 340520,3> in experimental> | 20:32 |
| *** sarob has quit IRC | 20:32 | |
| *** heyongli has joined #openstack-infra | 20:32 | |
| pabelanger | I am not sure if <Worker Unknown>> is expected | 20:32 |
| pabelanger | okay, I think I see the issue | 20:35 |
| *** sarob has joined #openstack-infra | 20:36 | |
| *** sputnik13 has quit IRC | 20:36 | |
| *** fawadkhaliq has quit IRC | 20:36 | |
| *** pt_15 has quit IRC | 20:36 | |
| *** julim has quit IRC | 20:37 | |
| pabelanger | the wheel-release-* jobs share the mutex on release.slave.o.o | 20:38 |
| pabelanger | that | 20:38 |
| pabelanger | err | 20:38 |
| pabelanger | that's surprising, figured we did that one the wheel-mirror servers | 20:39 |
| pabelanger | wheel-build* | 20:39 |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update RunDeck plugin to use convert xml https://review.openstack.org/340565 | 20:39 |
| openstackgerrit | Sam Betts proposed openstack-infra/project-config: Refactor Ironic job macro https://review.openstack.org/340567 | 20:40 |
| *** yaume has quit IRC | 20:41 | |
| *** heyongli has quit IRC | 20:42 | |
| *** yaume has joined #openstack-infra | 20:42 | |
| *** heyongli has joined #openstack-infra | 20:42 | |
| *** chem has quit IRC | 20:42 | |
| *** ddieterly is now known as ddieterly[away] | 20:43 | |
| *** hichihara has joined #openstack-infra | 20:44 | |
| mwhahaha | fungi: see http://www.rpm.org/max-rpm-snapshot/s1-rpm-inside-files-list-directives.html | 20:44 |
| *** ajmiller has quit IRC | 20:44 | |
| *** ajmiller has joined #openstack-infra | 20:44 | |
| jeblair | pabelanger: there's a mutex for each arch, so that we don't release a wheel arch while a build of the same arch is in progress | 20:44 |
| abregman|mtg | is there a way to accelerate the review process of a patch?: https://review.openstack.org/#/c/338216/ | 20:44 |
| mwhahaha | fungi: %ghost %config(noreplace) %{_sysconfdir}/locale.conf | 20:45 |
| fungi | mwhahaha: awesome--thanks. so does that mean that rh-derived distros expect anaconda or a similar installer to explicitly create that file, then? | 20:45 |
| pabelanger | jeblair: right, in my case, I don't have a mutex, so need to wait for the current builds to finished, before my job is processed | 20:45 |
| mwhahaha | not sure who is ultimately expected to create it, but yea something like that | 20:46 |
| fungi | greghaynes: mordred: clarkb: jeblair: ^ given that, i think dib should probably be creating that file | 20:47 |
| *** rdx_matt has joined #openstack-infra | 20:47 | |
| mwhahaha | Note: localectl cannot be used to set the system locale in the installation chroot environment. /etc/locale.conf must be edited manually as follows. | 20:47 |
| mwhahaha | from the arch docs https://wiki.archlinux.org/index.php/Locale | 20:47 |
| mwhahaha | sooo yea it probably needs to manually be created | 20:48 |
| fungi | to clarify, i think dib should probably be changed to _explicitly_ create that file | 20:48 |
| greghaynes | mwhahaha: fungi ah, ok | 20:49 |
| fungi | though a bit of research may be warranted to determine what default content anaconda would put in it | 20:49 |
| *** sarob has quit IRC | 20:49 | |
| * fungi needs to go start dinner... bbiaw | 20:50 | |
| *** sarob has joined #openstack-infra | 20:50 | |
| *** mctaylor has quit IRC | 20:50 | |
| mordred | fungi: yes. I agree that dib should be changed to explicitly create that file | 20:51 |
| pabelanger | jeblair: we may need to revisit our afsadmin credentials moving forward. Our release queue takes upwards of 6+ hours to process afs vos releases (mirror.wheel.foo). With adding reprepro into our post pipeline, maybe we need a 2nd host processing afs vos release requests for mirror.foo(mirror.deb-openstack in this example)? | 20:51 |
| pabelanger | if that makes sense | 20:51 |
| *** dprince has quit IRC | 20:51 | |
| *** heyongli has quit IRC | 20:52 | |
| jeblair | pabelanger: i think the root of the problem lies in the assumption that we need to do a full wheel mirror rebuild specifically tied to every release | 20:52 |
| *** heyongli has joined #openstack-infra | 20:52 | |
| pabelanger | jeblair: right, that's what we do today. Which is expensive | 20:53 |
| jeblair | pabelanger: it also doesn't make sense | 20:53 |
| pabelanger | jeblair: what would be your suggestion for the interval? | 20:54 |
| jeblair | pabelanger: the release pipeline is for building and publishing release artifacts; i don't think we need a mirror build for every artifact we release. | 20:54 |
| mwhahaha | fungi: the only thing i've got from a basic install is just LANG="en_US.UTF-8" | 20:54 |
| *** sarob has quit IRC | 20:54 | |
| pabelanger | jeblair: I would be fine having the periodic job handle most of the workload | 20:55 |
| crinkle | pabelanger: may i suggest https://etherpad.openstack.org/p/infra-cloud-talk-barcelona as an alternative for the abstract and "what should attendees learn" parts of the talk proposal? | 20:55 |
| pabelanger | crinkle: sure, I can update the talk | 20:55 |
| jeblair | pabelanger: i think what it really needs is something like the 'at-most-one-item-in-queue' pipeline manager i'm going to write for the post pipeline, but triggered by releases. i'm not going to do that before zuulv3 though. | 20:56 |
| *** thorst_ has quit IRC | 20:56 | |
| *** trown is now known as trown|outtypewww | 20:57 | |
| *** thorst_ has joined #openstack-infra | 20:57 | |
| pabelanger | jeblair: ya, that would be neat | 20:57 |
| *** Goneri has quit IRC | 20:57 | |
| *** mctaylor has joined #openstack-infra | 20:58 | |
| *** mctaylor has quit IRC | 20:59 | |
| *** itisha has quit IRC | 21:00 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Remove neutron full job from neutron-vpnaas queues https://review.openstack.org/340571 | 21:00 |
| jeblair | pabelanger: why is only one build job running? | 21:00 |
| zaro | jesusaur, anteaya : thanks, | 21:01 |
| jeblair | pabelanger: shouldn't there be one build for each arch running now? | 21:01 |
| *** thorst_ has quit IRC | 21:02 | |
| *** raildo is now known as raildo-afk | 21:02 | |
| jesusaur | zaro: no problem. my trick for finding the error in those tests is to search the whole log for the string "exit 1" | 21:02 |
| *** yamamoto has joined #openstack-infra | 21:02 | |
| *** heyongli has quit IRC | 21:02 | |
| zaro | jesusaur: that helps, a lot! | 21:02 |
| *** sarob has joined #openstack-infra | 21:03 | |
| *** heyongli has joined #openstack-infra | 21:03 | |
| *** thorst_ has joined #openstack-infra | 21:03 | |
| zaro | jesusaur: you happen to know why it fails for only one of the jobs? it seems to work for jessie, precise, and xenial | 21:03 |
| *** cardeois_ has joined #openstack-infra | 21:03 | |
| *** cardeois_ has quit IRC | 21:04 | |
| *** shamail has joined #openstack-infra | 21:04 | |
| *** cardeois_ has joined #openstack-infra | 21:04 | |
| jesusaur | zaro: each job has a different set of nodes it tests, its likely that the node that is failing only has the one matching Node-OS line in manifests/site.pp | 21:05 |
| jesusaur | zaro: which would cause that node to only get tested in the one job | 21:05 |
| *** cardeois has quit IRC | 21:06 | |
| *** thorst_ has quit IRC | 21:07 | |
| *** sarob has quit IRC | 21:07 | |
| *** kgiusti has left #openstack-infra | 21:07 | |
| *** cardeois_ has quit IRC | 21:07 | |
| *** cardeois_ has joined #openstack-infra | 21:08 | |
| *** cardeois has joined #openstack-infra | 21:08 | |
| *** cardeois has quit IRC | 21:08 | |
| *** cardeois has joined #openstack-infra | 21:09 | |
| *** adrian_otto has joined #openstack-infra | 21:11 | |
| *** cardeois_ has quit IRC | 21:12 | |
| *** heyongli has quit IRC | 21:13 | |
| *** heyongli has joined #openstack-infra | 21:13 | |
| *** yaume has quit IRC | 21:13 | |
| *** yaume has joined #openstack-infra | 21:14 | |
| * clarkb finally has tox running against nova on xenial \o/ will have to see if things break | 21:14 | |
| notmorgan | Shrews, armax: how do i get a working devstack with neutron? | 21:14 |
| Shrews | notmorgan: umm... pay me? | 21:15 |
| Shrews | :-P | 21:15 |
| clarkb | notmorgan: you copy pasta the localrc from the gate | 21:15 |
| clarkb | notmorgan: thsi is how you get a working devstack in just about any situation. Juist remove the error on clone stuff and I think you should be good | 21:15 |
| notmorgan | clarkb: i want to point out how horrible there is no "good" way to just enable neutron. | 21:15 |
| armax | notmorgan: sorry running neutron team meeting, but basically what clarkb said :) | 21:15 |
| notmorgan | in devstack. | 21:15 |
| clarkb | notmorgan: they are working on it aiui | 21:15 |
| Shrews | notmorgan: disable_service n-net | 21:16 |
| notmorgan | yeah. | 21:16 |
| Shrews | enable_service q-svc q-agt q-dhcp q-l3 neutron | 21:16 |
| armax | notmorgan: sc68cal is working relenetlessly to fix this | 21:16 |
| clarkb | notmorgan: it turns out that yes the old devstack stuff for neutron was super complicated and needed a bunch of things flipped | 21:16 |
| clarkb | and the nwe thing will be super simpler | 21:16 |
| notmorgan | Shrews: yeah and it is just failing all over on install. | 21:16 |
| *** TaylorHuang has joined #openstack-infra | 21:16 | |
| Shrews | notmorgan: eh? on what? | 21:16 |
| sc68cal | notmorgan: http://docs.openstack.org/developer/devstack/guides/neutron.html | 21:16 |
| notmorgan | clarkb: yay, i am just frustrated cause this has been now 3hrs of time trying to get a basic vm [not frustrated at you, jkust you were talking] | 21:17 |
| notmorgan | sc68cal: yeah was using that. it is pretty poor documentation to make it work | 21:17 |
| sc68cal | .. ok well I wrote most of it. | 21:17 |
| sc68cal | so thanks | 21:17 |
| Shrews | notmorgan: would my entire local.conf help? | 21:18 |
| *** yamamoto has quit IRC | 21:18 | |
| notmorgan | sc68cal: yeah it's not horrible, it's just extremely complex to stand up a basic "neutron enabled" vm without changing a bunch of values in the examples. | 21:18 |
| *** jamesmcarthur has quit IRC | 21:18 | |
| notmorgan | sc68cal: i mean i'm just extremely frustrating burning 3hrs trying to duplicate a basic example of "why is this slow using non-admin user but only with neutron" | 21:18 |
| *** TaylorH has quit IRC | 21:19 | |
| *** jamesmcarthur has joined #openstack-infra | 21:19 | |
| *** jamesmcarthur has quit IRC | 21:19 | |
| *** ddieterly[away] is now known as ddieterly | 21:19 | |
| notmorgan | sc68cal: so, sorry, don't mean to be blasting you or your docs. | 21:19 |
| clarkb | also default security group blocks all traffic by default iirc. So many times I have run into "why isn't it working" only to remember an hours later I have to edit security groups | 21:19 |
| Shrews | notmorgan: i use this with a ubuntu trusty vm on my laptop: http://paste.openstack.org/show/530068/ | 21:19 |
| notmorgan | Shrews: thnx. | 21:20 |
| Shrews | notmorgan: i think using trusty is key as that's been most stable for me | 21:20 |
| notmorgan | Shrews: this is on trusty | 21:20 |
| Shrews | cool | 21:20 |
| *** rdx_matt has quit IRC | 21:21 | |
| *** akshai has quit IRC | 21:21 | |
| notmorgan | Shrews: i would kill if that had been in the docs as a "this is a very basic neutron devstack that doesn't do a lot interesting" | 21:21 |
| Shrews | notmorgan: i understand the frustration. i cherish that config like gold as it took me forever to get it just so | 21:21 |
| notmorgan | Shrews: it prrobably would have saved me an hour. | 21:21 |
| notmorgan | if it works | 21:21 |
| * notmorgan tries again | 21:22 | |
| *** david-lyle has joined #openstack-infra | 21:22 | |
| *** ldnunes has quit IRC | 21:22 | |
| *** pt_15 has joined #openstack-infra | 21:22 | |
| *** heyongli has quit IRC | 21:23 | |
| *** garyk has joined #openstack-infra | 21:23 | |
| *** heyongli has joined #openstack-infra | 21:23 | |
| clarkb | also it turns out running nova unittests on one cpu is slow | 21:23 |
| * clarkb should've made a bigger vm | 21:24 | |
| notmorgan | clarkb: ouch. | 21:24 |
| *** karthikp_ has quit IRC | 21:24 | |
| notmorgan | clarkb: been there, done that. | 21:24 |
| *** jistr has quit IRC | 21:24 | |
| * notmorgan drinks a beer and gets a sammich now that [ok this has been 4 hours on trying to get a devstack up now] | 21:24 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update scoverage to use convert xml https://review.openstack.org/340576 | 21:25 |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update scoverage to use convert xml https://review.openstack.org/340576 | 21:26 |
| clarkb | I am going to get things worked out where I can queue up a whole ton of these tox runs locally then let this burn all week and keep an eye on any issues. Should give us a really good idea for what things break on xenial if anything | 21:27 |
| clarkb | pabelanger: ^ also I just rekicked off some d-g expiermental jobs to make sure that those haven't regressed | 21:28 |
| *** jcoufal_ has quit IRC | 21:29 | |
| *** david-lyle has quit IRC | 21:30 | |
| *** eharney has quit IRC | 21:30 | |
| *** karthikp_ has joined #openstack-infra | 21:32 | |
| *** cody-somerville has quit IRC | 21:32 | |
| *** jcoufal has joined #openstack-infra | 21:33 | |
| *** heyongli has quit IRC | 21:33 | |
| *** heyongli has joined #openstack-infra | 21:34 | |
| pabelanger | clarkb: ack, looking now | 21:36 |
| pabelanger | jeblair: for the package import? I'm only testing with jessie at the moment | 21:36 |
| *** karthikp_ has quit IRC | 21:39 | |
| *** jcoufal has quit IRC | 21:39 | |
| *** claudiub has quit IRC | 21:42 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update clang scan build https://review.openstack.org/340440 | 21:42 |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Refactor to accept java_home from parent modules https://review.openstack.org/331523 | 21:43 |
| *** heyongli has quit IRC | 21:43 | |
| *** heyongli has joined #openstack-infra | 21:44 | |
| *** shardy has quit IRC | 21:44 | |
| *** ccamacho has quit IRC | 21:45 | |
| notmorgan | Shrews: this has gotten further than the last... 5 attempts | 21:45 |
| notmorgan | Shrews: thanks - | 21:45 |
| notmorgan | no failure yet | 21:45 |
| Shrews | notmorgan: w00t! i helped! | 21:45 |
| *** yamamoto has joined #openstack-infra | 21:45 | |
| *** ddieterly is now known as ddieterly[away] | 21:45 | |
| *** tpsilva has quit IRC | 21:48 | |
| *** akshai has joined #openstack-infra | 21:48 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update clang scan build https://review.openstack.org/340440 | 21:50 |
| *** hashar has quit IRC | 21:50 | |
| *** dizquierdo has quit IRC | 21:51 | |
| *** akshai_ has joined #openstack-infra | 21:51 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update clang scan build https://review.openstack.org/340440 | 21:51 |
| *** david-lyle has joined #openstack-infra | 21:52 | |
| *** thorst_ has joined #openstack-infra | 21:52 | |
| openstackgerrit | Anand Desai proposed openstack-infra/glean: Sometimes interfaces take long to change their status to 'UP'. There is a 5 second wait for these interfaces to come up but that is not always enough. This could cause the /etc/network/interfaces.d/ files not to get created and hence network to not come https://review.openstack.org/340585 | 21:52 |
| pabelanger | that's some commit message header | 21:53 |
| *** jamesmcarthur has joined #openstack-infra | 21:53 | |
| *** heyongli has quit IRC | 21:54 | |
| *** ddieterly[away] is now known as ddieterly | 21:54 | |
| *** akshai has quit IRC | 21:54 | |
| *** garyk has quit IRC | 21:55 | |
| *** esberglu has quit IRC | 21:55 | |
| *** gouthamr has quit IRC | 21:56 | |
| notmorgan | Shrews: your config worked perfectly | 21:56 |
| notmorgan | Shrews: i have a working devstack | 21:56 |
| Shrews | ossum | 21:56 |
| notmorgan | Shrews: thank you. you've made my day a lot less frustrating | 21:56 |
| notmorgan | now ... let me duplicate this slow thing | 21:56 |
| *** heyongli has joined #openstack-infra | 21:56 | |
| * Shrews does dinner things now | 21:57 | |
| *** thorst_ has quit IRC | 21:57 | |
| openstackgerrit | Matt Mulsow proposed openstack-infra/glean: Sometimes interfaces take long to change their status to 'UP'. There is a 5 second wait for these interfaces to come up but that is not always enough. This could cause the /etc/network/interfaces.d/ files not to get created and hence network to not come https://review.openstack.org/340585 | 21:57 |
| *** jamesmcarthur has quit IRC | 21:57 | |
| *** TaylorH has joined #openstack-infra | 21:59 | |
| *** shamail has quit IRC | 21:59 | |
| *** garyk has joined #openstack-infra | 21:59 | |
| *** aeng has joined #openstack-infra | 22:00 | |
| *** TaylorHuang has quit IRC | 22:01 | |
| *** david-lyle has quit IRC | 22:02 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Move reprepro bits from release to propose slave https://review.openstack.org/340589 | 22:02 |
| openstackgerrit | Aaron Rosen proposed openstack-infra/project-config: make gate-vmware-nsx-python34 voting https://review.openstack.org/339724 | 22:02 |
| jeblair | pabelanger: er, i was asking why only one build job was running at the time | 22:02 |
| jeblair | pabelanger: only one *wheel* build job | 22:03 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Switch name: reprepro-import-{reprepro}-{codename} to proposal https://review.openstack.org/340590 | 22:04 |
| *** heyongli has quit IRC | 22:04 | |
| *** garyk has quit IRC | 22:04 | |
| *** heyongli has joined #openstack-infra | 22:04 | |
| pabelanger | jeblair: I am not sure honestly. In fact, they all appear to be stopped atm | 22:05 |
| ianw | greghaynes / fungi: let me check into it ... yeah there is a lot of undocumented magic in the locales with centos7 | 22:05 |
| pabelanger | jeblair: confirmed, zlstatic01.o.o is not running anything | 22:05 |
| ianw | greghaynes / fungi : but i tried to be pretty forthcoming with comments in yum-minimal about what's going on | 22:05 |
| *** piet has joined #openstack-infra | 22:06 | |
| *** cbader has quit IRC | 22:07 | |
| pabelanger | 2016-07-11 21:24:09,245 ERROR zuul.MutexHandler: Mutex can not be released for <QueueItem 0x7f57090d10d0 for <Ref 0x7f57ad91a510 creates refs/tags/2.0.0 on fa4c057a09a81b2db9d2a746bcaf7dc6a70bc16a> in release> which does not hold it | 22:08 |
| pabelanger | jeblair: that looks interesting ^ | 22:08 |
| *** mdrabe has quit IRC | 22:08 | |
| pabelanger | I also see the following exception a few times: http://paste.openstack.org/show/530727/ | 22:09 |
| pabelanger | likely unrelated | 22:09 |
| jeblair | pabelanger: yeah, the exception is harmless i think | 22:11 |
| jeblair | pabelanger: the error is probably worth looking into | 22:11 |
| *** hichihara has quit IRC | 22:13 | |
| *** mriedem is now known as mriedem_away | 22:13 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Refactor to accept java_home from parent modules https://review.openstack.org/331523 | 22:13 |
| *** heyongli has quit IRC | 22:14 | |
| *** heyongli has joined #openstack-infra | 22:15 | |
| *** PollyZ has quit IRC | 22:15 | |
| *** burgerk has quit IRC | 22:16 | |
| notmorgan | mordred, Shrews, armax: i'm seeing 52s and 60s boot times on a fresh devstack | 22:17 |
| notmorgan | respectively | 22:17 |
| *** rdx_matt has joined #openstack-infra | 22:17 | |
| notmorgan | trying it again | 22:17 |
| armax | notmorgan: that doesn’t look good | 22:18 |
| notmorgan | well no, but it is equally slow | 22:18 |
| armax | notmorgan: btw, did you manage to spin up a devstack instance with Neutron? | 22:18 |
| notmorgan | not MASSIVELY slow. | 22:18 |
| notmorgan | armax: yes using Shrews's config | 22:18 |
| notmorgan | i mean it is horribly slow | 22:18 |
| notmorgan | but equal slow vs. one being trainwreck slow and one being "ok" | 22:18 |
| armax | notmorgan: 52 is with admin vs 60s is with non admin? | 22:18 |
| notmorgan | yep. | 22:18 |
| notmorgan | erm | 22:18 |
| notmorgan | no | 22:19 |
| notmorgan | vice-versa | 22:19 |
| armax | notmorgan: sorry yes | 22:19 |
| armax | I meant that way | 22:19 |
| notmorgan | non-admin first | 22:19 |
| *** gordc has quit IRC | 22:19 | |
| Shrews | notmorgan: are you going thru shade API? | 22:19 |
| notmorgan | Shrews: using http://paste.openstack.org/show/528615/ | 22:19 |
| notmorgan | second pass was 67s for non-admin, 58 for admin | 22:20 |
| mordred | I wonder if it has magically fixed over the weekend | 22:20 |
| notmorgan | thats within normal differences that i don't worry on a devstack | 22:20 |
| notmorgan | now... that is horribly slow | 22:20 |
| clarkb | I am very close to having a script that will loop over all python-jobs and python-db-jobs users running tox | 22:20 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Configure its-storyboard plugin https://review.openstack.org/330925 | 22:20 |
| clarkb | this should give us a really good sample of what does and doesn't work on xenial | 22:20 |
| mordred | notmorgan: yah - but also nested-virt | 22:20 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Add dynamic reconfiguration https://review.openstack.org/340597 | 22:20 |
| notmorgan | mordred: yah | 22:20 |
| mordred | notmorgan: so it might not be _terrible_ given the sitch | 22:21 |
| notmorgan | mordred: actually i don't think i have KVM enabled atm either | 22:21 |
| notmorgan | just straght qemu | 22:21 |
| notmorgan | so even worse | 22:21 |
| mordred | yah. that's gonna be slow | 22:21 |
| notmorgan | oh no -enable-kvm | 22:21 |
| notmorgan | it's there | 22:21 |
| notmorgan | oh wonder if it's virtio related, anyway w/o | 22:22 |
| notmorgan | w/e* | 22:22 |
| notmorgan | it's equally slow | 22:22 |
| mordred | stab | 22:22 |
| jeblair | mordred, notmorgan, Shrews, pabelanger, jhesketh: ^ the dynamic reconfiguration change (340597) is unfortunately large. i'm sorry about that -- it's taken me a while to understand all the things that would need to change; it might be possible to break that up into smaller changes now that i know what's entailed -- but maybe we can try to make sense of it in review comments and see how things go before doing that... | 22:23 |
| notmorgan | jeblair: sometimes it's not worth breaking up | 22:23 |
| jeblair | mordred, notmorgan, Shrews, pabelanger, jhesketh: (i will be reviewing it as i would any other change as well, since i haven't seen the whole thing yet :) | 22:23 |
| notmorgan | mordred: LOL | 22:23 |
| *** abregman|mtg has quit IRC | 22:23 | |
| notmorgan | mordred: http://paste.openstack.org/show/530728/ amazing | 22:24 |
| *** heyongli has quit IRC | 22:24 | |
| *** heyongli has joined #openstack-infra | 22:25 | |
| jeblair | mordred, notmorgan, Shrews, pabelanger, jhesketh: BUT! OMG proposing a change to zuul's config and having zuul run that change *with* the proposed altered configuration is mind-blowing and cool! :) | 22:25 |
| pabelanger | wow, that is awesome | 22:26 |
| jhesketh | Morning | 22:26 |
| pleia2 | :) | 22:26 |
| anteaya | crinkle: safe travels | 22:26 |
| notmorgan | mordred: wow - so virtmanager faiiiiiled it statically is setting broadwell processor but "replicating" skylake host cpu data. yeah not surprised it's all sorts of broken. | 22:26 |
| anteaya | morning jhesketh | 22:26 |
| zaro | jesusaur: can i get your eyes on this one? http://logs.openstack.org/23/331523/4/check/gate-puppet-gerrit-puppet-lint/86a65ec/console.html | 22:26 |
| *** jamesmcarthur has joined #openstack-infra | 22:27 | |
| notmorgan | anyway | 22:27 |
| jesusaur | zaro: that's the same error I got this morning, but I have no idea what's causing it | 22:27 |
| jesusaur | zaro: I suspect that https://review.openstack.org/340529 might fix that, but haven't been able to test it | 22:28 |
| *** rkukura has quit IRC | 22:28 | |
| pabelanger | jeblair: clarkb: pleia2: mordred: I've proposed https://review.openstack.org/#/c/340589/ to move the reprepro import from release.slave.o.o to proposal.slave.o.o (see backscroll about mutexes) issue. Since the change in https://review.openstack.org/#/c/340590/ doesn't actually use vos release, it never should have been added to release.slave.o.o to start (which is where the afsadmin.keytab) lives | 22:29 |
| zaro | jesusaur: thanks. | 22:30 |
| clarkb | pabelanger: doesn't it need to vos release to publsih the things? | 22:30 |
| clarkb | also http://paste.openstack.org/show/530729/ is my test the world on xenail script | 22:30 |
| clarkb | oh it has a bug | 22:30 |
| pabelanger | clarkb: right, it does, but that is a separate job ATM (like wheel-builds) and I'm not at the point of releasing packages just yet | 22:31 |
| pabelanger | so, I want to actually avoid vos release for the moment | 22:31 |
| *** thorst has joined #openstack-infra | 22:31 | |
| clarkb | I see | 22:33 |
| *** aeng has quit IRC | 22:33 | |
| *** EricGonczer_ has quit IRC | 22:33 | |
| pabelanger | need some zuul help with gearman, if people have a moment | 22:33 |
| pabelanger | http://paste.openstack.org/show/530730/ | 22:33 |
| jeblair | (but even so, reprepro can run on a separate host) | 22:33 |
| pabelanger | does does the 3 fields after each job represent? | 22:34 |
| clarkb | http://paste.openstack.org/show/530731/ is a better version of the script now with more error checking | 22:34 |
| *** thorst has quit IRC | 22:34 | |
| clarkb | pabelanger: first is queued second is running and last is number of workers that have regisered the job | 22:34 |
| pabelanger | jeblair: meaning adding a new reprepro specific worker? | 22:34 |
| jeblair | pabelanger: http://gearman.org/protocol/ | 22:34 |
| jeblair | pabelanger: FUNCTION\tTOTAL\tRUNNING\tAVAILABLE_WORKERS | 22:35 |
| *** heyongli has quit IRC | 22:35 | |
| *** thorst has joined #openstack-infra | 22:35 | |
| pabelanger | clarkb: thanks | 22:35 |
| pabelanger | jeblair: perfect | 22:35 |
| *** heyongli has joined #openstack-infra | 22:35 | |
| jeblair | clarkb: close -- s/queued/queued+running/ | 22:35 |
| *** PollyZ has joined #openstack-infra | 22:35 | |
| clarkb | ah | 22:36 |
| *** hurgleburgler has joined #openstack-infra | 22:36 | |
| jeblair | clarkb: or, you could be right, depending on your definition of 'queued' | 22:36 |
| *** jamesmcarthur has quit IRC | 22:36 | |
| openstackgerrit | Scott DAngelo proposed openstack-infra/project-config: Don't run gate-cinder-tox-db-functional on stable/liberty https://review.openstack.org/340604 | 22:37 |
| jeblair | (depending on whether you define "queued" to mean "in the queue regardless of whether it's running" or "waiting to be run") | 22:37 |
| *** jamesmcarthur has joined #openstack-infra | 22:38 | |
| jeblair | pabelanger: i don't think proposal.slave has afs installed? | 22:38 |
| pabelanger | jeblair: right, my patch toggles afs => true | 22:38 |
| pabelanger | or should | 22:39 |
| jeblair | oh ok | 22:39 |
| *** thorst has quit IRC | 22:39 | |
| kzaitsev_mb | jamespage: zul: coreyob: is anyone of you guys the correct person to ask about ubuntu packages? | 22:39 |
| pabelanger | so, back to zuul and wheel-build | 22:40 |
| *** rossella_s has quit IRC | 22:40 | |
| *** rkukura has joined #openstack-infra | 22:40 | |
| pabelanger | doesn't the following mean, there is not workers available: | 22:40 |
| pabelanger | build:wheel-release-xenialx64 1 0 0 | 22:40 |
| *** pradk has quit IRC | 22:40 | |
| *** rossella_s has joined #openstack-infra | 22:40 | |
| jeblair | pabelanger: yes | 22:41 |
| *** krtaylor has quit IRC | 22:41 | |
| pabelanger | okay, so that would explain why wheel-build seem to be blocked | 22:41 |
| jeblair | pabelanger: wheel-builds don't run on the release worker | 22:42 |
| pabelanger | jeblair: right, but I think there is an issue with the mutexes. No other wheel-build can continue because a wheel-release has not happened | 22:43 |
| *** cody-somerville has joined #openstack-infra | 22:43 | |
| *** cody-somerville has joined #openstack-infra | 22:43 | |
| pabelanger | if I am understanding this properly | 22:43 |
| jhesketh | pleia2: Hey. You added me to the beginners talk? I thought docaedo was going to do it? | 22:43 |
| pabelanger | and for some reason, all the wheel-release-* jobs are 1 0 0 | 22:43 |
| pabelanger | I am currently looking at zuul-launcher to see if a graceful restart will register the functions properly | 22:44 |
| pleia2 | jhesketh: oh! right, ok | 22:44 |
| pleia2 | I'll fix :) | 22:44 |
| jeblair | pabelanger: the wheel-release jobs have no workers registered which is very likely the reason they are not running. i think that's completely separate from my question earlier as to why we were not running a centos build while also running a xenial build. | 22:44 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Install the Gerrit its-storyboard plugin https://review.openstack.org/340605 | 22:44 |
| *** adrian_otto has quit IRC | 22:44 | |
| *** jamesmcarthur has quit IRC | 22:45 | |
| jhesketh | pleia2: :-) (I'm happy to if needed, but that's what we discussed) | 22:45 |
| pabelanger | jeblair: okay | 22:45 |
| thingee | pleia2: casual | 22:45 |
| *** heyongli has quit IRC | 22:45 | |
| *** yamahata has quit IRC | 22:45 | |
| pleia2 | jhesketh: yeah, I just forgot, last week was the longest short week ever for me | 22:45 |
| *** heyongli has joined #openstack-infra | 22:45 | |
| pleia2 | fixed! | 22:45 |
| jhesketh | no worries :-) | 22:45 |
| jhesketh | jeblair: speaking of talks though.. did you want help with a zuul one in the end? | 22:46 |
| jeblair | pabelanger: don't do any restarts yet | 22:46 |
| pabelanger | jeblair: Yup, no restarts | 22:46 |
| pabelanger | jeblair: looking at pause / unpause now | 22:46 |
| jeblair | pabelanger: er, don't do anything that changes state, please | 22:47 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 22:47 |
| *** jamesmcarthur has joined #openstack-infra | 22:47 | |
| pabelanger | jeblair: appologies, I had just run it prior to you asking | 22:47 |
| pabelanger | jeblair: however, I believe something interested has happened. I am seeing none static jobs running on zlstatic01.o.o | 22:48 |
| pabelanger | confirmed by http://grafana.openstack.org/dashboard/db/nodepool | 22:50 |
| *** hurgleburgler has quit IRC | 22:50 | |
| jeblair | pabelanger: the reason nothing is running on release is because the reprepro-import-debian-openstack-jessie set OFFLINE_NODE_WHEN_COMPLETE to 1, so zuul-launcher stopped the worker | 22:50 |
| *** ddieterly has quit IRC | 22:51 | |
| *** adrian_otto has joined #openstack-infra | 22:51 | |
| *** rdx_matt has quit IRC | 22:51 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Configure its-storyboard plugin https://review.openstack.org/330925 | 22:52 |
| pabelanger | jeblair: thank you for the cause | 22:53 |
| pabelanger | I forgot about that | 22:53 |
| *** Jeffrey4l has joined #openstack-infra | 22:53 | |
| *** Jeffrey4l has quit IRC | 22:53 | |
| jeblair | pabelanger: the reason zlstatic01 is running non-static jobs is because there is a bug in the pause/unpause code. if you pause zlstatic01 and unpause it, it will start to accept nodes from nodepool. i will fix that. | 22:53 |
| *** jamesmcarthur has quit IRC | 22:55 | |
| *** heyongli has quit IRC | 22:55 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: fix pause/unpause accept nodes https://review.openstack.org/340608 | 22:55 |
| *** heyongli has joined #openstack-infra | 22:56 | |
| jeblair | pabelanger: ^ | 22:56 |
| pabelanger | jeblair: thanks | 22:56 |
| *** dimtruck is now known as zz_dimtruck | 22:57 | |
| *** jamesmcarthur has joined #openstack-infra | 22:57 | |
| jeblair | jhesketh: i am leaning toward a solo presentation, ideally with much heckling^Winvolvement from audience members contributing to v3... | 22:57 |
| *** kien-ha has quit IRC | 22:57 | |
| jhesketh | jeblair: cool, sounds good :-) | 22:57 |
| jeblair | jhesketh: btw, if you have time for a v3 task -- i think forward porting some of the stuff from the v2.5 ansible launcher to v3 would be helpful... | 22:58 |
| jeblair | jhesketh: (obv not the jenkins-related stuff, but quite a few bits around "how to actually invoke ansible", etc, should probably come over) | 22:59 |
| jhesketh | jeblair: yeah I was thinking that was probably my next step... not sure the best way to go about it but will have a think | 23:00 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Set reusable_node for reprepro-(import|release) jobs https://review.openstack.org/340609 | 23:00 |
| pabelanger | jeblair: ^ sorry to bend your ear on that | 23:00 |
| jhesketh | jeblair: do we want to return to/consider any other changes for v2 (ie the discussion we started here https://etherpad.openstack.org/p/zuul_changes_to_consider) | 23:00 |
| jhesketh | (that list would be outdated by now) | 23:00 |
| *** jamesmcarthur has quit IRC | 23:01 | |
| *** rbrndt has quit IRC | 23:01 | |
| jeblair | jhesketh: oh, thanks. yes, i would like to return to that. i do consider v2 basically frozen for new features, but some of those bug fixes would be good to get in. | 23:01 |
| pabelanger | 16 million dollar zuulv2.5 question now, how does one bring an offlined node back online? | 23:02 |
| jeblair | pabelanger: restart | 23:02 |
| pabelanger | that's what I figured | 23:02 |
| jhesketh | the reason I mention it is that we'll want any fixes into v3 too.. it'd be good to merge v2 into v3 but it's not going to be very clean | 23:03 |
| *** daemontool has quit IRC | 23:04 | |
| *** sputnik13 has joined #openstack-infra | 23:04 | |
| *** cardeois has quit IRC | 23:05 | |
| *** jamesmcarthur has joined #openstack-infra | 23:05 | |
| *** heyongli has quit IRC | 23:05 | |
| craige | o/ | 23:05 |
| *** heyongli has joined #openstack-infra | 23:06 | |
| clarkb | does anyone know if the releasenotes tox target is pretty standard for projects using reno? | 23:06 |
| pabelanger | crinkle: talk updated | 23:06 |
| clarkb | fungi: looks like git-review may break on xenial due to ecdsa keys? | 23:07 |
| clarkb | mordred: pbr fails on its wsgi test start server | 23:07 |
| *** shashank_hegde has quit IRC | 23:07 | |
| *** sputnik13 has quit IRC | 23:09 | |
| clarkb | fungi: http://paste.openstack.org/show/530749/ lots of that spewing out in the logs | 23:09 |
| pabelanger | jhesketh: if you want to help land 340608, and if jeblair is good, we can graceful restart zlstatic01 once it lands | 23:09 |
| *** jamesmcarthur has quit IRC | 23:10 | |
| anteaya | clarkb: here is the tox ini for a project that then set up releasenotes jobs in a dependant patch, I'm going with yes pretty standard | 23:10 |
| anteaya | https://review.openstack.org/#/c/318695/1/tox.ini | 23:10 |
| *** shashank_hegde has joined #openstack-infra | 23:11 | |
| clarkb | anteaya: ya I am just noticing it isn't everywhere yet. I think I will conditionally run that if grep shows it in the tox.ini | 23:11 |
| *** yamahata has joined #openstack-infra | 23:11 | |
| anteaya | here is the project-config patch: https://review.openstack.org/#/c/319259/ | 23:11 |
| anteaya | ah | 23:11 |
| anteaya | well dims to review the olso messaging patch | 23:12 |
| anteaya | so in the workflow of cargo culting I would assume he knows the best practices for using reno | 23:12 |
| anteaya | dims did review | 23:12 |
| jhesketh | pabelanger, jeblair: 340608 lgtm +w | 23:13 |
| *** PollyZ has quit IRC | 23:13 | |
| *** itisha has joined #openstack-infra | 23:13 | |
| jhesketh | btw, there's also https://review.openstack.org/#/c/331123/4 which has been up for a while | 23:13 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Override install_command in neutron unit tests for periodic queue https://review.openstack.org/340612 | 23:13 |
| clarkb | dhellmann: I should have a decent idea of the tox on xenial situation sometime tomorrow after my giant loop is done running | 23:14 |
| *** dingyichen has joined #openstack-infra | 23:14 | |
| pabelanger | jhesketh: added to my list of reviews | 23:14 |
| jhesketh | ta | 23:14 |
| *** jamesmcarthur has joined #openstack-infra | 23:15 | |
| dhellmann | clarkb : cool, I look forward to hearing how that goes | 23:15 |
| pabelanger | pleia2: I made a minor change to the talk, one formatting, other What should attendees expect to learn | 23:15 |
| pabelanger | pleia2: included Ansible in your list of software | 23:15 |
| pleia2 | pabelanger: thanks! | 23:15 |
| clarkb | pleia2: are you using git review on xenial? | 23:15 |
| clarkb | (is anyone else?) | 23:15 |
| pabelanger | fedora-24 here | 23:16 |
| *** heyongli has quit IRC | 23:16 | |
| clarkb | oh! we use an old gerrit war in the git review tests | 23:16 |
| pleia2 | clarkb: no, been slow about upgrading my work systems | 23:16 |
| clarkb | I bet the current version understands what git review is sending it on xenial | 23:16 |
| *** heyongli has joined #openstack-infra | 23:16 | |
| clarkb | fungi: ^ I think tahts the fix for on xenial | 23:16 |
| zaro | clarkb: i think i fixed that | 23:16 |
| clarkb | zaro: grep says its using 2.9.2-something | 23:17 |
| zaro | clarkb: i guess it hasn't merged yet, https://review.openstack.org/#/c/282018/ | 23:17 |
| clarkb | zaro: +2, maybe fungi wants to approve it really quick | 23:18 |
| clarkb | I think that should get us working with testing on xenial | 23:18 |
| clarkb | also thats a fun thing to keep in mind when we upgrade Gerrit | 23:19 |
| clarkb | its possible we would leave people on older ssh's behind | 23:19 |
| *** zul_ has quit IRC | 23:21 | |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: fix pause/unpause accept nodes https://review.openstack.org/340608 | 23:22 |
| pabelanger | jeblair: are you okay with restarting zlstatic01? | 23:22 |
| pabelanger | once puppet runs | 23:22 |
| jeblair | pabelanger: yep | 23:23 |
| *** jamesmcarthur has quit IRC | 23:25 | |
| *** jamesmcarthur has joined #openstack-infra | 23:25 | |
| openstackgerrit | Merged openstack-infra/project-config: Set reusable_node for reprepro-(import|release) jobs https://review.openstack.org/340609 | 23:25 |
| *** yaume has quit IRC | 23:26 | |
| *** heyongli has quit IRC | 23:26 | |
| *** heyongli has joined #openstack-infra | 23:26 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/puppet-openstack_infra_spec_helper: Change puppet gem dependency to any 3.x version https://review.openstack.org/340529 | 23:26 |
| *** jamesmcarthur has quit IRC | 23:27 | |
| clarkb | IOError: [Errno 28] No space left on device sadness | 23:30 |
| *** gfreeman has joined #openstack-infra | 23:31 | |
| *** vasanthi has joined #openstack-infra | 23:31 | |
| *** _oanson has joined #openstack-infra | 23:32 | |
| gfreeman | Hi all - it looks like my zuul is not queuing jobs right now. I'm seeing errors for "Received unrecognized event type" for both ref-replicated and ref-replication-done, and i'm wondering if this is the issue..? | 23:33 |
| jeblair | clarkb: pull some hard drives off the shelf? | 23:33 |
| jeblair | gfreeman: those are harmless | 23:33 |
| *** shashank_hegde has quit IRC | 23:33 | |
| gfreeman | jeblair: oh, that is good, but now how do i debug why zuul isn't queueing jobs? it looks like both zuul and zuul-merger are running, and the /var/run pid files are accurate | 23:34 |
| jeblair | gfreeman: what are the log entries near an event where it should be queueing jobs? | 23:35 |
| jeblair | gfreeman: you can use http://paste.openstack.org/ to copy a bunch of entries then copy the url in here | 23:36 |
| clarkb | jeblair: :) it was actually a bug in my script, I thought it was hardlinking the cloned repos out of /opt/git but it isn't so I was using all the disk | 23:36 |
| *** heyongli has quit IRC | 23:36 | |
| clarkb | sorted out where it went wrong and have restarted | 23:36 |
| *** heyongli has joined #openstack-infra | 23:37 | |
| gfreeman | jeblair: ....huh.. apparently now it is deciding to work..? i got one job queued up now | 23:39 |
| gfreeman | >_> | 23:39 |
| gfreeman | jeblair: i'll paste the log still just in case, 1 sec | 23:40 |
| mordred | gfreeman: best way to debug zuul ... ask jeblair a question, wait for zuul to magically fix itself | 23:40 |
| *** adrian_otto has quit IRC | 23:41 | |
| clarkb | mordred: did you see that pbr tests don't run on xenial successfully? I am trying to debug but am context switching ebtween that and keeping an eye on my test loop | 23:41 |
| gfreeman | mordred: seems to be the case :P | 23:42 |
| gfreeman | jeblair: http://paste.openstack.org/show/530752/ | 23:42 |
| gfreeman | jeblair: yeah, 2nd job in the zuul queue now. i swear i had a problem before i hopped in irc and asked for help~ | 23:43 |
| *** rcernin has quit IRC | 23:43 | |
| *** heyongli has quit IRC | 23:46 | |
| *** heyongli has joined #openstack-infra | 23:47 | |
| *** rdx_matt has joined #openstack-infra | 23:47 | |
| *** markvoelker has quit IRC | 23:49 | |
| *** woodster_ has quit IRC | 23:49 | |
| clarkb | mordred: I have rechekd 330814 to get it to run py35 tests and see if results are duplicated tehre | 23:50 |
| *** akshai_ has quit IRC | 23:50 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Add test of post cloner with cached repo https://review.openstack.org/319347 | 23:50 |
| *** lvdongbing has joined #openstack-infra | 23:50 | |
| *** akshai has joined #openstack-infra | 23:50 | |
| clarkb | anyone know what that large green portion on then odepool graph is there for? | 23:51 |
| pabelanger | #status log zlstatic01 in graceful mode | 23:51 |
| openstackstatus | pabelanger: finished logging | 23:51 |
| clarkb | they all belong to zlstatic01, I guess if things were queueing up tehre but runnign serially we would see that? | 23:51 |
| *** rdx_matt has quit IRC | 23:52 | |
| clarkb | jeblair: ^ may want to try and have it only requset nodes when it is ready to run the jobs? maybe ti alrady does this just going off what I see nodepool side | 23:52 |
| *** caowei has joined #openstack-infra | 23:52 | |
| pabelanger | clarkb: likely related to my pause/unpause task on zlstatic01.o.o | 23:52 |
| pabelanger | clarkb: working on restarting it now | 23:53 |
| *** garyk has joined #openstack-infra | 23:53 | |
| fungi | clarkb: approved the git-review testing gerrit version update. also your xenial testing spec lgtm. mind if i add it to the proposed list for tomorrow's meeting? | 23:53 |
| *** adrian_otto has joined #openstack-infra | 23:54 | |
| pabelanger | clarkb: 340608 is the fix, and nodepool will likely need some cleanup after I restart zlstatic01 | 23:54 |
| pabelanger | I'll be on the hook for that | 23:54 |
| clarkb | fungi: that would be great | 23:54 |
| jeblair | Nakato: https://review.openstack.org/293194 lgtm, but i left a couple of notes which we could get in a followup change if you want. I also update the child test change. | 23:54 |
| *** julim has joined #openstack-infra | 23:55 | |
| jeblair | gfreeman: this is why we stay in irc all the time ;) | 23:55 |
| gfreeman | jeblair: i'm learning~ | 23:55 |
| jeblair | clarkb, pabelanger: you can issue a 'zuul-launcher release' and those nodes will be returned to nodepool | 23:56 |
| *** heyongli has quit IRC | 23:57 | |
| jeblair | clarkb, pabelanger: that should be safe to issue now -- zuul will not release static nodes | 23:57 |
| *** heyongli has joined #openstack-infra | 23:57 | |
| pabelanger | good to know | 23:58 |
| *** kzaitsev_mb has quit IRC | 23:58 | |
| jeblair | (nor will it release nodes that are running jobs) | 23:58 |
| pabelanger | I've ran zuul graceful already | 23:58 |
| jeblair | whoops | 23:58 |
| pabelanger | zuul-launcher* | 23:58 |
| Nakato | jeblair: Thanks, looking. | 23:58 |
| jeblair | pabelanger: it should have released them as part of the graceful | 23:58 |
| pabelanger | jeblair: ack | 23:58 |
| pabelanger | 2016-07-11 23:48:08,558 DEBUG zuul.LaunchServer: Releasing idle nodes | 23:59 |
| pabelanger | yup | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!