| *** gordc has joined #openstack-infra | 00:00 | |
| *** lnr has joined #openstack-infra | 00:01 | |
| *** lnr has quit IRC | 00:01 | |
| *** lnr has joined #openstack-infra | 00:02 | |
| *** lnr has quit IRC | 00:02 | |
| *** Sukhdev has quit IRC | 00:04 | |
| *** lnr has joined #openstack-infra | 00:05 | |
| *** lnr has quit IRC | 00:05 | |
| *** lnr has joined #openstack-infra | 00:05 | |
| *** lnr has quit IRC | 00:05 | |
| *** lnr has joined #openstack-infra | 00:06 | |
| *** lnr has quit IRC | 00:06 | |
| *** lnr has joined #openstack-infra | 00:06 | |
| *** lnr has quit IRC | 00:06 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Initial manual for infra-cloud https://review.openstack.org/180796 | 00:06 |
|---|---|---|
| *** lnr has joined #openstack-infra | 00:06 | |
| *** lnr has quit IRC | 00:06 | |
| *** tiswanso has joined #openstack-infra | 00:06 | |
| *** lnr has joined #openstack-infra | 00:07 | |
| *** lnr has quit IRC | 00:07 | |
| *** lnr has joined #openstack-infra | 00:07 | |
| *** lnr has quit IRC | 00:07 | |
| *** lnr has joined #openstack-infra | 00:07 | |
| *** lnr has quit IRC | 00:07 | |
| tchaypo | jogo: jeblair: http://jamezpolley.github.io//gate/index.html <<- periodic-*-python27 - 10 day graph, moving average over 72 hours | 00:08 |
| *** lnr has joined #openstack-infra | 00:08 | |
| *** lnr has quit IRC | 00:08 | |
| *** lnr has joined #openstack-infra | 00:08 | |
| *** lnr has quit IRC | 00:08 | |
| *** lnr has joined #openstack-infra | 00:08 | |
| *** lnr has quit IRC | 00:08 | |
| *** lnr has joined #openstack-infra | 00:09 | |
| *** lnr has quit IRC | 00:09 | |
| *** lnr has joined #openstack-infra | 00:09 | |
| *** lnr has quit IRC | 00:09 | |
| *** lnr has joined #openstack-infra | 00:09 | |
| *** lnr has quit IRC | 00:09 | |
| *** lnr has joined #openstack-infra | 00:09 | |
| *** lnr has quit IRC | 00:09 | |
| *** lnr has joined #openstack-infra | 00:10 | |
| *** lnr has quit IRC | 00:10 | |
| *** lnr has joined #openstack-infra | 00:10 | |
| *** lnr has quit IRC | 00:10 | |
| *** lnr has joined #openstack-infra | 00:10 | |
| *** lnr has quit IRC | 00:10 | |
| *** lnr has joined #openstack-infra | 00:11 | |
| *** lnr has quit IRC | 00:11 | |
| *** lnr has joined #openstack-infra | 00:11 | |
| *** lnr has quit IRC | 00:11 | |
| clarkb | tchaypo: might be better as several graphs? hard to tell which ones are currently broken (but its a start) | 00:13 |
| *** lnr has joined #openstack-infra | 00:14 | |
| *** lnr has quit IRC | 00:14 | |
| *** lnr has joined #openstack-infra | 00:14 | |
| *** lnr has quit IRC | 00:14 | |
| *** lnr has joined #openstack-infra | 00:15 | |
| *** lnr has quit IRC | 00:15 | |
| *** tiswanso has quit IRC | 00:15 | |
| *** lnr has joined #openstack-infra | 00:15 | |
| *** lnr has quit IRC | 00:15 | |
| *** lnr has joined #openstack-infra | 00:15 | |
| *** lnr has quit IRC | 00:15 | |
| *** lnr has joined #openstack-infra | 00:16 | |
| *** lnr has quit IRC | 00:16 | |
| *** lnr has joined #openstack-infra | 00:16 | |
| *** lnr has quit IRC | 00:16 | |
| *** Nolafleur has quit IRC | 00:16 | |
| *** lnr has joined #openstack-infra | 00:16 | |
| *** lnr has quit IRC | 00:16 | |
| *** david-lyle has quit IRC | 00:16 | |
| *** lnr has joined #openstack-infra | 00:17 | |
| *** lnr has quit IRC | 00:17 | |
| *** lnr has joined #openstack-infra | 00:17 | |
| *** lnr has quit IRC | 00:17 | |
| *** lnr has joined #openstack-infra | 00:17 | |
| *** lnr has quit IRC | 00:17 | |
| *** lnr has joined #openstack-infra | 00:18 | |
| *** lnr has quit IRC | 00:18 | |
| *** lnr has joined #openstack-infra | 00:18 | |
| *** lnr has quit IRC | 00:18 | |
| *** lnr has joined #openstack-infra | 00:18 | |
| *** lnr has quit IRC | 00:18 | |
| *** lnr has joined #openstack-infra | 00:19 | |
| *** lnr has quit IRC | 00:19 | |
| tchaypo | clarkb: yeah, definitely. That graph is getting close to using all of graphite’s colors | 00:19 |
| jogo | tchaypo: you should track the amount of data the graph is built on | 00:19 |
| *** lnr has joined #openstack-infra | 00:19 | |
| *** lnr has quit IRC | 00:19 | |
| jogo | as 1/2 = 50% but not useful | 00:19 |
| *** unicell has joined #openstack-infra | 00:19 | |
| *** unicell has quit IRC | 00:19 | |
| *** lnr has joined #openstack-infra | 00:19 | |
| *** lnr has quit IRC | 00:19 | |
| *** lnr has joined #openstack-infra | 00:20 | |
| *** lnr has quit IRC | 00:20 | |
| *** hdd has quit IRC | 00:20 | |
| *** lnr has joined #openstack-infra | 00:20 | |
| *** lnr has quit IRC | 00:20 | |
| *** unicell has joined #openstack-infra | 00:20 | |
| *** sputnik13 has quit IRC | 00:20 | |
| *** lnr has joined #openstack-infra | 00:20 | |
| *** lnr has quit IRC | 00:20 | |
| tchaypo | how often do the periodic jobs fire? | 00:21 |
| *** lnr has joined #openstack-infra | 00:21 | |
| *** lnr has quit IRC | 00:21 | |
| clarkb | daily | 00:21 |
| tchaypo | I tried this as a 36-hour moving average but there were no visible blips | 00:21 |
| *** lnr has joined #openstack-infra | 00:21 | |
| *** lnr has quit IRC | 00:21 | |
| *** lnr has joined #openstack-infra | 00:21 | |
| *** lnr has quit IRC | 00:21 | |
| greghaynes | Its cron-style definitions in zuul layout.yaml right? | 00:21 |
| openstackgerrit | Stephanie Miller proposed openstack-infra/system-config: Miscellaneous linter cleanups https://review.openstack.org/169085 | 00:21 |
| *** lnr has joined #openstack-infra | 00:22 | |
| *** lnr has quit IRC | 00:22 | |
| greghaynes | so youbshould be able to look in there | 00:22 |
| clarkb | greghaynes: up | 00:22 |
| *** lnr has joined #openstack-infra | 00:22 | |
| *** lnr has quit IRC | 00:22 | |
| *** lnr has joined #openstack-infra | 00:22 | |
| *** lnr has quit IRC | 00:22 | |
| *** dmorita has quit IRC | 00:22 | |
| *** lnr has joined #openstack-infra | 00:23 | |
| *** lnr has quit IRC | 00:23 | |
| *** lnr has joined #openstack-infra | 00:23 | |
| *** lnr has quit IRC | 00:23 | |
| *** lnr has joined #openstack-infra | 00:23 | |
| *** lnr has quit IRC | 00:23 | |
| *** lnr has joined #openstack-infra | 00:24 | |
| *** lnr has quit IRC | 00:24 | |
| *** amotoki has quit IRC | 00:24 | |
| *** rainya has quit IRC | 00:24 | |
| *** dmorita has joined #openstack-infra | 00:24 | |
| *** lnr has joined #openstack-infra | 00:24 | |
| *** lnr has quit IRC | 00:24 | |
| *** lnr has joined #openstack-infra | 00:24 | |
| *** lnr has quit IRC | 00:24 | |
| *** Kennan2 is now known as Kennan | 00:24 | |
| *** lnr has joined #openstack-infra | 00:25 | |
| *** lnr has quit IRC | 00:25 | |
| *** nikhil-bbiab is now known as nikhil_k | 00:25 | |
| *** lnr has joined #openstack-infra | 00:25 | |
| *** lnr has quit IRC | 00:25 | |
| *** salv-orlando has joined #openstack-infra | 00:25 | |
| *** lnr has joined #openstack-infra | 00:25 | |
| *** lnr has quit IRC | 00:25 | |
| *** yamamoto has quit IRC | 00:25 | |
| *** lnr has joined #openstack-infra | 00:26 | |
| *** lnr has quit IRC | 00:26 | |
| *** lnr has joined #openstack-infra | 00:26 | |
| *** lnr has quit IRC | 00:26 | |
| *** zul has quit IRC | 00:26 | |
| *** lnr has joined #openstack-infra | 00:26 | |
| *** lnr has quit IRC | 00:26 | |
| tchaypo | I question whether there's much point fiddling with this | 00:27 |
| *** lnr has joined #openstack-infra | 00:27 | |
| *** lnr has quit IRC | 00:27 | |
| tchaypo | The job only runs daily | 00:27 |
| *** lnr has joined #openstack-infra | 00:27 | |
| *** lnr has quit IRC | 00:27 | |
| *** lnr has joined #openstack-infra | 00:27 | |
| *** lnr has quit IRC | 00:27 | |
| tchaypo | By the time I can see "hey, that broke twice, I wonder if it was the same break" it's been broken for ~48 hours | 00:27 |
| *** lnr has joined #openstack-infra | 00:28 | |
| *** lnr has quit IRC | 00:28 | |
| *** lnr has joined #openstack-infra | 00:28 | |
| *** lnr has quit IRC | 00:28 | |
| *** lnr has joined #openstack-infra | 00:28 | |
| *** lnr has quit IRC | 00:28 | |
| *** Nolafleur has joined #openstack-infra | 00:28 | |
| *** lnr has joined #openstack-infra | 00:29 | |
| *** lnr has quit IRC | 00:29 | |
| *** lnr has joined #openstack-infra | 00:29 | |
| *** lnr has quit IRC | 00:29 | |
| *** lnr has joined #openstack-infra | 00:29 | |
| *** lnr has quit IRC | 00:29 | |
| *** lnr has joined #openstack-infra | 00:30 | |
| *** lnr has quit IRC | 00:30 | |
| *** lnr has joined #openstack-infra | 00:30 | |
| *** lnr has quit IRC | 00:30 | |
| *** hdd has joined #openstack-infra | 00:30 | |
| *** lnr has joined #openstack-infra | 00:30 | |
| *** lnr has quit IRC | 00:30 | |
| *** lnr has joined #openstack-infra | 00:31 | |
| *** lnr has quit IRC | 00:31 | |
| *** lnr has joined #openstack-infra | 00:31 | |
| *** yamamoto has joined #openstack-infra | 00:31 | |
| *** lnr has quit IRC | 00:31 | |
| *** lnr has joined #openstack-infra | 00:31 | |
| *** lnr has quit IRC | 00:31 | |
| *** amotoki has joined #openstack-infra | 00:31 | |
| *** lnr has joined #openstack-infra | 00:31 | |
| *** lnr has quit IRC | 00:31 | |
| *** lnr has joined #openstack-infra | 00:32 | |
| *** lnr has quit IRC | 00:32 | |
| *** Nolafleur has quit IRC | 00:32 | |
| *** lnr has joined #openstack-infra | 00:32 | |
| *** lnr has quit IRC | 00:32 | |
| *** dmorita has quit IRC | 00:32 | |
| *** lnr has joined #openstack-infra | 00:32 | |
| *** enikanorov2 has quit IRC | 00:32 | |
| *** lnr has quit IRC | 00:32 | |
| *** lnr has joined #openstack-infra | 00:33 | |
| *** nikhil_k is now known as nikhil | 00:33 | |
| *** lnr has quit IRC | 00:33 | |
| *** lnr has joined #openstack-infra | 00:33 | |
| *** lnr has quit IRC | 00:33 | |
| *** lnr has joined #openstack-infra | 00:33 | |
| *** lnr has quit IRC | 00:33 | |
| *** lnr has joined #openstack-infra | 00:33 | |
| *** Nolafleur has joined #openstack-infra | 00:34 | |
| *** rossella_s has joined #openstack-infra | 00:35 | |
| *** dboik has joined #openstack-infra | 00:36 | |
| *** zul has joined #openstack-infra | 00:37 | |
| *** lnr has quit IRC | 00:38 | |
| *** tiswanso has joined #openstack-infra | 00:38 | |
| *** lnr has joined #openstack-infra | 00:38 | |
| *** asettle has joined #openstack-infra | 00:38 | |
| *** salv-orlando has quit IRC | 00:40 | |
| *** julim has joined #openstack-infra | 00:40 | |
| *** zz_dimtruck is now known as dimtruck | 00:41 | |
| *** salv-orlando has joined #openstack-infra | 00:42 | |
| *** bswartz has quit IRC | 00:44 | |
| *** dmorita has joined #openstack-infra | 00:45 | |
| *** gordc has quit IRC | 00:45 | |
| *** enikanorov2 has joined #openstack-infra | 00:47 | |
| *** zul has quit IRC | 00:48 | |
| *** jerryz has joined #openstack-infra | 00:52 | |
| *** yolanda has quit IRC | 00:53 | |
| pabelanger | fungi, just a heads up, if I run into at the HP party, I'll be talking to you about packaging in -infra :) | 00:54 |
| pabelanger | well, looking to do some quick hashing on it | 00:54 |
| *** julim has quit IRC | 00:56 | |
| *** ZZelle has quit IRC | 01:02 | |
| *** hdd has quit IRC | 01:06 | |
| *** asselin__ has quit IRC | 01:08 | |
| *** bhunter71 has joined #openstack-infra | 01:08 | |
| *** salv-orlando has quit IRC | 01:11 | |
| *** amotoki has quit IRC | 01:11 | |
| *** julim has joined #openstack-infra | 01:12 | |
| *** asselin_ has joined #openstack-infra | 01:14 | |
| *** yamamoto has quit IRC | 01:14 | |
| fungi | pabelanger: i look forward to it! | 01:14 |
| *** Nolafleur has quit IRC | 01:15 | |
| *** tiswanso has quit IRC | 01:15 | |
| *** rossella_s has quit IRC | 01:16 | |
| *** bswartz has joined #openstack-infra | 01:23 | |
| *** ivar-lazzaro has quit IRC | 01:25 | |
| *** bhunter71 has quit IRC | 01:26 | |
| *** unicell has quit IRC | 01:27 | |
| *** hdd has joined #openstack-infra | 01:27 | |
| *** hdd has quit IRC | 01:28 | |
| *** zhiwei has joined #openstack-infra | 01:30 | |
| *** armax has joined #openstack-infra | 01:34 | |
| *** jamespage_ has quit IRC | 01:34 | |
| *** otter768 has joined #openstack-infra | 01:36 | |
| *** otter768 has quit IRC | 01:41 | |
| *** mmedvede has quit IRC | 01:42 | |
| *** gokrokve_ has joined #openstack-infra | 01:43 | |
| *** gokrokve has quit IRC | 01:44 | |
| *** jamespage_ has joined #openstack-infra | 01:51 | |
| *** jamespage_ has quit IRC | 01:51 | |
| *** Kennan2 has joined #openstack-infra | 01:52 | |
| *** Kennan has quit IRC | 01:52 | |
| *** gokrokve_ has quit IRC | 01:56 | |
| *** armax has quit IRC | 01:56 | |
| *** gokrokve has joined #openstack-infra | 01:56 | |
| *** rainya has joined #openstack-infra | 02:06 | |
| *** jerryz has quit IRC | 02:06 | |
| *** rainya has quit IRC | 02:06 | |
| *** mmedvede has joined #openstack-infra | 02:14 | |
| *** dalgaaf has quit IRC | 02:17 | |
| *** gokrokve has quit IRC | 02:18 | |
| *** gokrokve has joined #openstack-infra | 02:18 | |
| *** gokrokve has quit IRC | 02:23 | |
| *** ivar-lazzaro has joined #openstack-infra | 02:23 | |
| *** gokrokve has joined #openstack-infra | 02:27 | |
| *** changbl has joined #openstack-infra | 02:41 | |
| *** asettle has quit IRC | 02:42 | |
| *** enikanorov2 has quit IRC | 02:43 | |
| *** puranamr has quit IRC | 02:44 | |
| *** asettle has joined #openstack-infra | 02:59 | |
| *** puranamr has joined #openstack-infra | 03:04 | |
| *** ddieterly has joined #openstack-infra | 03:05 | |
| *** puranamr has quit IRC | 03:09 | |
| *** jerryz has joined #openstack-infra | 03:11 | |
| *** soren_ has joined #openstack-infra | 03:35 | |
| *** otter768 has joined #openstack-infra | 03:37 | |
| *** nelsnelson has joined #openstack-infra | 03:37 | |
| *** asselin_ has quit IRC | 03:39 | |
| *** asselin_ has joined #openstack-infra | 03:40 | |
| *** puranamr has joined #openstack-infra | 03:41 | |
| *** otter768 has quit IRC | 03:42 | |
| *** yfried|afk is now known as yfried_ | 03:44 | |
| *** jerryz has quit IRC | 03:45 | |
| *** asselin_ has quit IRC | 03:45 | |
| *** puranamr has quit IRC | 03:45 | |
| *** asselin_ has joined #openstack-infra | 03:48 | |
| *** nelsnelson has quit IRC | 03:52 | |
| *** asselin_ has quit IRC | 03:57 | |
| *** nelsnelson has joined #openstack-infra | 04:02 | |
| *** gokrokve_ has joined #openstack-infra | 04:08 | |
| *** gokrokve has quit IRC | 04:11 | |
| *** gokrokve_ has quit IRC | 04:13 | |
| *** soren_ has quit IRC | 04:13 | |
| *** BharatK has joined #openstack-infra | 04:16 | |
| *** sks has joined #openstack-infra | 04:19 | |
| *** coolsvap|afk is now known as coolsvap | 04:20 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 04:22 | |
| *** jamespage_ has joined #openstack-infra | 04:24 | |
| *** dimtruck is now known as zz_dimtruck | 04:30 | |
| *** jamespage_ has quit IRC | 04:33 | |
| *** coolsvap is now known as coolsvap|afk | 04:35 | |
| *** baoli has joined #openstack-infra | 04:39 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 04:41 | |
| *** abregman has joined #openstack-infra | 04:43 | |
| *** afazekas is now known as __afazekas | 04:43 | |
| *** Sukhdev has joined #openstack-infra | 04:54 | |
| *** Zhongjun has joined #openstack-infra | 04:56 | |
| *** Kennan2 is now known as Kennan_ | 04:58 | |
| *** markvoelker has joined #openstack-infra | 04:58 | |
| *** yfried_ has quit IRC | 05:00 | |
| *** chlong_ has quit IRC | 05:03 | |
| *** soren has joined #openstack-infra | 05:07 | |
| *** asselin_ has joined #openstack-infra | 05:08 | |
| *** ParsectiX has quit IRC | 05:09 | |
| *** coolsvap|afk is now known as coolsvap | 05:11 | |
| *** sputnik13 has joined #openstack-infra | 05:12 | |
| *** markvoelker has quit IRC | 05:13 | |
| *** markvoelker has joined #openstack-infra | 05:13 | |
| *** luqas has joined #openstack-infra | 05:13 | |
| clarkb | fungi apparently futex_wait() is/was buggy on centos6 and that may explain why git breaks there | 05:15 |
| clarkb | apprently bug was backported into centos6 last octoberish | 05:15 |
| clarkb | so hopefully we pull fix in newer builds and everything gets happy | 05:16 |
| *** chlong_ has joined #openstack-infra | 05:17 | |
| *** markvoelker has quit IRC | 05:18 | |
| *** luqas has quit IRC | 05:18 | |
| *** sputnik13 has quit IRC | 05:23 | |
| *** sputnik13 has joined #openstack-infra | 05:23 | |
| *** harlowja has joined #openstack-infra | 05:25 | |
| *** soren has quit IRC | 05:26 | |
| *** afazekas has joined #openstack-infra | 05:29 | |
| *** sputnik13 has quit IRC | 05:34 | |
| *** harlowja has quit IRC | 05:37 | |
| *** otter768 has joined #openstack-infra | 05:38 | |
| *** yfried_ has joined #openstack-infra | 05:38 | |
| *** sputnik13 has joined #openstack-infra | 05:41 | |
| *** mtanino has joined #openstack-infra | 05:41 | |
| *** harlowja has joined #openstack-infra | 05:42 | |
| *** otter768 has quit IRC | 05:43 | |
| *** nelsnelson has quit IRC | 05:43 | |
| *** rlandy has joined #openstack-infra | 05:47 | |
| *** BharatK has quit IRC | 05:47 | |
| *** harlowja has quit IRC | 05:56 | |
| *** asettle has quit IRC | 05:57 | |
| *** BharatK has joined #openstack-infra | 06:00 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/184413 | 06:02 |
| *** k4n0 has joined #openstack-infra | 06:04 | |
| *** mtanino has quit IRC | 06:08 | |
| *** chlong_ has quit IRC | 06:09 | |
| *** scheuran has joined #openstack-infra | 06:11 | |
| *** markvoelker has joined #openstack-infra | 06:14 | |
| *** zul has joined #openstack-infra | 06:16 | |
| *** markvoelker has quit IRC | 06:19 | |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/184413 | 06:20 |
| *** vaidy_ has joined #openstack-infra | 06:21 | |
| *** Sukhdev has quit IRC | 06:23 | |
| *** mpaolino has joined #openstack-infra | 06:25 | |
| *** yolanda has joined #openstack-infra | 06:27 | |
| *** rcarrillocruz has quit IRC | 06:29 | |
| *** chlong has joined #openstack-infra | 06:31 | |
| *** baoli has quit IRC | 06:33 | |
| *** rcarrillocruz has joined #openstack-infra | 06:33 | |
| *** dboik has quit IRC | 06:34 | |
| *** asettle has joined #openstack-infra | 06:34 | |
| jogo | jeblair mordred: ping apps.openstack.org and see what the address turns into | 06:35 |
| jogo | I'll give you a hint, it ends in linode.com :) | 06:36 |
| *** trey has quit IRC | 06:37 | |
| *** hdd has joined #openstack-infra | 06:38 | |
| *** trey has joined #openstack-infra | 06:39 | |
| AJaeger | reazem: you can ask here now since your patch merged - but since everybody is on the summit, not sure whether we can help this week | 06:41 |
| *** asselin_ has quit IRC | 06:44 | |
| *** armax has joined #openstack-infra | 06:44 | |
| *** hdd has quit IRC | 06:45 | |
| fungi | clarkb: which newer centos6 carries the fix? | 06:47 |
| fungi | grue_pm: timrc: great to finally officially meet you both in person! | 06:47 |
| *** mestery has joined #openstack-infra | 06:48 | |
| *** hdd has joined #openstack-infra | 06:50 | |
| *** vaidy_ has quit IRC | 06:52 | |
| *** vaidy_ has joined #openstack-infra | 06:52 | |
| *** jlanoux has joined #openstack-infra | 06:52 | |
| *** salv-orlando has joined #openstack-infra | 06:54 | |
| *** yfried_ is now known as yfried|afk | 06:57 | |
| *** shardy_ has joined #openstack-infra | 06:57 | |
| *** sputnik13 has quit IRC | 06:58 | |
| *** sputnik1_ has joined #openstack-infra | 06:58 | |
| *** shardy has quit IRC | 06:59 | |
| *** shardy_ has quit IRC | 07:02 | |
| *** shardy has joined #openstack-infra | 07:03 | |
| *** asettle has quit IRC | 07:07 | |
| *** dannywilson has joined #openstack-infra | 07:08 | |
| *** ZZelle_ has quit IRC | 07:09 | |
| *** ZZelle_ has joined #openstack-infra | 07:09 | |
| *** hdd has quit IRC | 07:12 | |
| *** panda has quit IRC | 07:13 | |
| *** panda has joined #openstack-infra | 07:15 | |
| *** yfried|afk is now known as yfried_ | 07:17 | |
| *** jistr has joined #openstack-infra | 07:18 | |
| *** mestery has quit IRC | 07:19 | |
| *** panda has quit IRC | 07:21 | |
| *** panda has joined #openstack-infra | 07:23 | |
| *** sshnaidm has joined #openstack-infra | 07:27 | |
| *** csaba has joined #openstack-infra | 07:30 | |
| *** _nadya_ has joined #openstack-infra | 07:35 | |
| *** sputnik1_ has quit IRC | 07:36 | |
| *** _nadya_ has quit IRC | 07:36 | |
| *** chlong has quit IRC | 07:37 | |
| *** armax has quit IRC | 07:39 | |
| *** otter768 has joined #openstack-infra | 07:39 | |
| *** jlanoux has quit IRC | 07:40 | |
| *** yamamoto has joined #openstack-infra | 07:41 | |
| *** otter768 has quit IRC | 07:44 | |
| openstackgerrit | Merged openstack-infra/project-config: surveil-specs: use surveil acl https://review.openstack.org/183172 | 07:50 |
| *** mpaolino has quit IRC | 07:53 | |
| *** arxcruz has joined #openstack-infra | 07:53 | |
| *** dannywilson has quit IRC | 07:53 | |
| *** reazem has quit IRC | 07:53 | |
| *** mpaolino has joined #openstack-infra | 07:54 | |
| *** mpaolino has quit IRC | 07:54 | |
| *** markvoelker has joined #openstack-infra | 07:58 | |
| panda | where's the configuration to trigger jenkins/zuul jobs on 2 +2CR ? seems standard trigger plugins do not correlate stream-events | 07:59 |
| *** dizquierdo has joined #openstack-infra | 08:01 | |
| *** markvoelker has quit IRC | 08:04 | |
| *** isviridov_away is now known as isviridov | 08:08 | |
| *** Hal has joined #openstack-infra | 08:18 | |
| *** Hal is now known as Guest20650 | 08:19 | |
| *** reazem has joined #openstack-infra | 08:19 | |
| *** asselin has joined #openstack-infra | 08:23 | |
| *** abregman has quit IRC | 08:35 | |
| *** abregman has joined #openstack-infra | 08:37 | |
| *** ivar-lazzaro has quit IRC | 08:38 | |
| *** salv-orlando has quit IRC | 08:41 | |
| *** baoli has joined #openstack-infra | 08:49 | |
| *** ParsectiX has joined #openstack-infra | 08:50 | |
| *** ParsectiX has left #openstack-infra | 08:51 | |
| *** ParsectiX has joined #openstack-infra | 08:51 | |
| *** baoli has quit IRC | 08:54 | |
| *** e0ne has joined #openstack-infra | 08:54 | |
| *** e0ne is now known as e0ne_ | 08:54 | |
| *** e0ne_ is now known as e0ne | 08:54 | |
| *** e0ne is now known as e0ne_ | 08:55 | |
| *** julim has quit IRC | 08:55 | |
| ekarlso | heya guys | 08:57 |
| ekarlso | is there a problem with tox and ubuntu 15.04 or os's with py3.4, running tox -epep8 and expecting it to use py27? | 08:58 |
| *** e0ne_ is now known as e0ne | 08:59 | |
| *** markvoelker has joined #openstack-infra | 08:59 | |
| *** asselin has quit IRC | 08:59 | |
| *** teran has quit IRC | 09:00 | |
| *** salv-orlando has joined #openstack-infra | 09:00 | |
| mgedmin | ekarlso, if you require py27 for [testenv:pep8], specify that explicitly: https://testrun.org/tox/latest/config.html#confval-basepython=NAME-OR-PATH | 09:02 |
| * mgedmin notices the "guys" greeting and frowns | 09:03 | |
| *** markvoelker has quit IRC | 09:03 | |
| *** salv-orlando has quit IRC | 09:05 | |
| ekarlso | mgedmin: I set it in the base :P | 09:13 |
| mgedmin | then I guess I didn't understand your question | 09:13 |
| ekarlso | mgedmin: just wondered if it was a "known" thing :) | 09:14 |
| ekarlso | mgedmin: https://review.openstack.org/#/c/184049/ < for designate | 09:14 |
| *** jtomasek has joined #openstack-infra | 09:16 | |
| mgedmin | hm, basepython in [testenv]? that's interesting and possibly wrong | 09:16 |
| mgedmin | horribly incorrect in fact: it makes tox -epy34 use python2.7! | 09:17 |
| mgedmin | ah, but this project supports only one python version | 09:18 |
| mgedmin | personally, I'd rather make everything work with python 2.7 *or* 3.4 and not worry about basepython in tox.ini ;-) | 09:18 |
| *** dizquierdo has quit IRC | 09:20 | |
| *** vaidy_ has quit IRC | 09:20 | |
| *** vaidy_ has joined #openstack-infra | 09:20 | |
| *** ildikov_afk has quit IRC | 09:26 | |
| *** e0ne has quit IRC | 09:28 | |
| *** _nadya_ has joined #openstack-infra | 09:33 | |
| *** ivar-lazzaro has joined #openstack-infra | 09:38 | |
| *** otter768 has joined #openstack-infra | 09:40 | |
| *** ildikov_afk has joined #openstack-infra | 09:40 | |
| *** ivar-lazzaro has quit IRC | 09:43 | |
| *** otter768 has quit IRC | 09:45 | |
| *** sslypushenko has quit IRC | 09:50 | |
| *** markvoelker has joined #openstack-infra | 10:00 | |
| *** yamamoto has quit IRC | 10:03 | |
| *** markvoelker has quit IRC | 10:05 | |
| *** BobBall has quit IRC | 10:07 | |
| *** puranamr has joined #openstack-infra | 10:08 | |
| *** ivar-lazzaro has joined #openstack-infra | 10:10 | |
| *** Guest20650 has quit IRC | 10:11 | |
| *** puranamr has quit IRC | 10:13 | |
| *** ivar-lazzaro has quit IRC | 10:14 | |
| *** zhiwei has quit IRC | 10:14 | |
| *** BobBall has joined #openstack-infra | 10:15 | |
| *** BobBall is now known as Guest59430 | 10:15 | |
| *** Zhongjun has quit IRC | 10:19 | |
| *** teran has joined #openstack-infra | 10:25 | |
| *** vaidy_ has quit IRC | 10:28 | |
| *** vaidy_ has joined #openstack-infra | 10:29 | |
| clarkb | basepython should be /usr/bin/python | 10:34 |
| clarkb | so install python2? | 10:34 |
| clarkb | is that somehow being changed by default on vivid? | 10:34 |
| clarkb | fungi 6.6.z I think, its not entirely clear to me and will need more research when yum is handy | 10:35 |
| clarkb | panda we dont trigger on two +2CR, thats enforced by convention | 10:41 |
| clarkb | zuul does trigger the gate after +1V, +2CR, and +1W | 10:42 |
| clarkb | (and no negative votes that prevent merging like -2CR) | 10:42 |
| panda | clarkb: so only zuul is capable of checking conditions on votes after receiving an event, gerrit trigger plugin for jenkins doesn't offer this feature | 10:44 |
| clarkb | I'm not sure, its been years since I used that plugin. At the very least I would expect the job itself to be able to check though | 10:49 |
| *** fhubik has joined #openstack-infra | 10:50 | |
| pelix | panda: you can configure gerrit to only allow +1W if +1V & +2CR and no negative votes via prologue rules. I expect that's why the jenkins plugin doesn't bother since Gerrit already has the required functionality built in | 10:56 |
| clarkb | pelix but you still need to know when you should bother doing work | 10:57 |
| clarkb | gerrit wont let you merge without meeting the conditions though | 10:57 |
| pelix | clarkb: if you use the prologue rules you can block setting of the approval vote directly in gerrit based on conditions, the job will never run since the approval cannot be set | 11:00 |
| *** markvoelker has joined #openstack-infra | 11:01 | |
| pelix | clarkb: maybe I wasn't clear in my first comment, gerrit can prevent the +1W from being set in the first place by configuring prologue rules to check the values of votes on the CR and V labels. | 11:03 |
| clarkb | that seems like a very suboptimal way to do it but sure (custom prolog just for that is :/) | 11:05 |
| *** markvoelker has quit IRC | 11:05 | |
| panda | and prolog rules can be changed per project ? | 11:07 |
| pelix | it uses prologue internally to control when conditions apply, and exposes it so you can customize the conditions. Stuff like being able to ignore -1 votes from other CI runs but still have them show up, while blocking on other registered users -1 CR | 11:07 |
| clarkb | yes iirc you make an entrypoint function then set that in project config as the rule checker | 11:07 |
| pelix | panda: follows the inheritance rules, so you can configure on parent projects, and override on child projects | 11:07 |
| electrical | Morning all | 11:08 |
| clarkb | where function is likely really a predicate but its too early to remember prolog | 11:08 |
| electrical | or afternoon | 11:08 |
| pelix | panda: https://gerrit-review.googlesource.com/Documentation/prolog-cookbook.html good place to start and probably worth asking on the Repo and Gerrit google group for more details as more likely to have people there that understand the in's and out's of them | 11:09 |
| *** ivar-lazzaro has joined #openstack-infra | 11:10 | |
| panda | pelix: clarkb: interesting points, thanks | 11:12 |
| pelix | clarkb: btw, not saying it's the easiest way, just that it's probably why checking other vote values wasn't added to the Gerrit Trigger plugin | 11:12 |
| *** dguerri is now known as dguerri`away | 11:13 | |
| *** ivar-lazzaro has quit IRC | 11:16 | |
| openstackgerrit | Richard Pijnenburg proposed openstack-infra/jenkins-job-builder: Add logstash publisher https://review.openstack.org/183048 | 11:20 |
| *** panda has quit IRC | 11:20 | |
| *** panda has joined #openstack-infra | 11:21 | |
| *** ivar-lazzaro has joined #openstack-infra | 11:26 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Replace open() with codecs.open() https://review.openstack.org/183488 | 11:30 |
| *** ivar-lazzaro has quit IRC | 11:30 | |
| *** ldnunes has joined #openstack-infra | 11:31 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Fix Builder.update_job() on Python 3 https://review.openstack.org/172238 | 11:32 |
| *** vaidy_ has quit IRC | 11:32 | |
| *** vaidy_ has joined #openstack-infra | 11:32 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Wrap file objects with codecs to handle unicode https://review.openstack.org/183939 | 11:33 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Reformat xUnit publisher help https://review.openstack.org/183585 | 11:34 |
| *** otter768 has joined #openstack-infra | 11:41 | |
| *** otter768 has quit IRC | 11:46 | |
| *** Etienne2 has joined #openstack-infra | 11:46 | |
| *** Etienne2 has left #openstack-infra | 11:46 | |
| *** yamamoto has joined #openstack-infra | 11:52 | |
| *** vaidy__ has joined #openstack-infra | 11:54 | |
| *** vaidy_ has quit IRC | 11:55 | |
| *** vaidy__ has quit IRC | 11:56 | |
| *** aswadr has joined #openstack-infra | 11:56 | |
| *** vaidy__ has joined #openstack-infra | 11:56 | |
| *** vaidy__ has quit IRC | 11:56 | |
| *** vaidy__ has joined #openstack-infra | 11:56 | |
| *** yamamoto has quit IRC | 11:56 | |
| *** vaidy__ has quit IRC | 11:56 | |
| *** isviridov is now known as isviridov_away | 11:58 | |
| *** dguerri`away is now known as dguerri | 12:01 | |
| *** markvoelker has joined #openstack-infra | 12:01 | |
| *** Etienne_ has joined #openstack-infra | 12:03 | |
| *** vaidy_ has joined #openstack-infra | 12:03 | |
| Etienne_ | Hello, the changes for the creation of the watcher project have been merged (https://review.openstack.org/#/c/184149/). Could you please add me to both groups (watcher-core, watcher-release) in gerrit ? | 12:04 |
| *** yfried_ is now known as yfried|afk | 12:04 | |
| *** markvoelker has quit IRC | 12:06 | |
| clarkb | jeblair different gerrit ml thread may have root caused our issue | 12:07 |
| *** Etienne2 has joined #openstack-infra | 12:13 | |
| *** k4n0 has quit IRC | 12:14 | |
| *** mnaser has quit IRC | 12:15 | |
| *** Etienne2 has quit IRC | 12:16 | |
| openstackgerrit | Richard Pijnenburg proposed openstack-infra/jenkins-job-builder: Add logstash publisher https://review.openstack.org/183048 | 12:16 |
| *** dizquierdo has joined #openstack-infra | 12:18 | |
| *** aysyanne has joined #openstack-infra | 12:19 | |
| *** yfried|afk is now known as yfried_ | 12:21 | |
| *** enikanorov2 has joined #openstack-infra | 12:22 | |
| *** ivar-lazzaro has joined #openstack-infra | 12:27 | |
| *** vaidy_ has quit IRC | 12:27 | |
| *** afazekas has quit IRC | 12:27 | |
| openstackgerrit | Richard Pijnenburg proposed openstack-infra/jenkins-job-builder: Add logstash publisher https://review.openstack.org/183048 | 12:28 |
| electrical | clarkb: pelix sorry for the many pushes to gerrit for my logstash publisher. still trying to get my test env working correctly with pyenv :-( | 12:28 |
| electrical | tox doesn't seem to like it to much :-( | 12:28 |
| *** yfried_ has quit IRC | 12:29 | |
| *** ivar-lazzaro has quit IRC | 12:31 | |
| pelix | electrical: I recall needing to do something in order to have pyenv install python with the necessary support for testrepository | 12:33 |
| pelix | can't recall exactly what it was | 12:34 |
| electrical | if i run python setup.py testr it works fine by hand. but tox wants to run against multiple python versions at the same time | 12:34 |
| pelix | electrical: you can either run tox against a specific version 'tox -epy27' or tell pyenv to enable multiple python versions for the project | 12:35 |
| *** fhubik is now known as fhubik_afk | 12:36 | |
| reazem | AJaeger: Thanks. | 12:36 |
| electrical | ah okay. thanks! | 12:36 |
| reazem | Anyone from the infra team here? I would like to be added to surveil-release (see Ifa6a0989406fb78ae0edb133a00cab926a2ae30d) | 12:36 |
| electrical | btw pelix managed to fix everything py 3.4 still fails, but now on other parts of the project again.some ascii stuff that's failing | 12:36 |
| pelix | electrical: for me I would run 'pyenv local 2.6.9 system 3.3.5' to enable python 2.6, 2.7, 3.3 and 3.4 since 2.7 and 3.4 where part of my system. | 12:37 |
| electrical | has to do with the Chinese things i think | 12:37 |
| electrical | pelix: ahh okay, will have a look at that. | 12:38 |
| pelix | electrical: it's definitely not obvious from pyenv help that you can do that... | 12:38 |
| electrical | my problem is that i use purely pyenv to manage every python version. so that might be an issue.. | 12:39 |
| *** fhubik_afk is now known as fhubik | 12:39 | |
| electrical | I'll use tox -e for now to test against specific version | 12:40 |
| *** mnaser has joined #openstack-infra | 12:40 | |
| pelix | electrical: forgot to mention, I would just run it under the project directory, the 'local' option would be applied onto to those projects I wished to manage with pyenv | 12:41 |
| electrical | ah i see, okay | 12:41 |
| *** Hal has joined #openstack-infra | 12:42 | |
| *** Hal is now known as Guest94220 | 12:43 | |
| *** freerunner has joined #openstack-infra | 12:43 | |
| *** nelsnelson has joined #openstack-infra | 12:45 | |
| *** bswartz has quit IRC | 12:51 | |
| *** chlong has joined #openstack-infra | 12:59 | |
| *** markvoelker has joined #openstack-infra | 12:59 | |
| *** markvoelker has quit IRC | 12:59 | |
| *** markvoelker has joined #openstack-infra | 12:59 | |
| *** sks has quit IRC | 13:01 | |
| *** dguerri is now known as dguerri`away | 13:03 | |
| *** markvoelker has quit IRC | 13:03 | |
| AJaeger | clarkb: the proposal node has a full disk - see https://jenkins.openstack.org/job/horizon-upstream-translation-update/45/console . Is there anything that you can do, please? | 13:05 |
| Etienne_ | AJaeger : The changes for the creation of the watcher project have been merged. Could you please add me to both groups (watcher-core, watcher-release) in gerrit , please ? | 13:07 |
| *** dguerri`away is now known as dguerri | 13:08 | |
| AJaeger | Etienne_: I'm not an infra root. Let's ask clarkb if he can. You might need to wait until the summit is over... | 13:08 |
| *** mattfarina has joined #openstack-infra | 13:10 | |
| *** fhubik is now known as fhubik_afk | 13:10 | |
| *** ddieterly has joined #openstack-infra | 13:10 | |
| Etienne_ | AJaeger : thanks | 13:12 |
| *** armax has joined #openstack-infra | 13:13 | |
| *** chlong has quit IRC | 13:14 | |
| *** sks has joined #openstack-infra | 13:15 | |
| *** ddieterly has quit IRC | 13:16 | |
| *** baoli has joined #openstack-infra | 13:17 | |
| *** nelsnelson has quit IRC | 13:20 | |
| *** baoli has quit IRC | 13:21 | |
| *** peristeri has joined #openstack-infra | 13:22 | |
| *** puranamr has joined #openstack-infra | 13:23 | |
| *** ivar-lazzaro has joined #openstack-infra | 13:27 | |
| *** puranamr has quit IRC | 13:27 | |
| *** chlong has joined #openstack-infra | 13:31 | |
| *** ivar-lazzaro has quit IRC | 13:32 | |
| *** dustins has joined #openstack-infra | 13:33 | |
| *** fhubik_afk is now known as fhubik | 13:33 | |
| *** abregman has quit IRC | 13:34 | |
| *** hdd has joined #openstack-infra | 13:35 | |
| mordred | AJaeger: looking | 13:36 |
| AJaeger | thanks mordred ! | 13:36 |
| *** ddieterly has joined #openstack-infra | 13:36 | |
| *** jlanoux has joined #openstack-infra | 13:37 | |
| AJaeger | Btw. mordred looking forward to see you in Berlin in June! | 13:37 |
| mordred | AJaeger: same here! | 13:37 |
| mordred | AJaeger: I'm sad you're not here in vancouver | 13:37 |
| AJaeger | mordred: I'm sad as well, just could get it working with private plans ;( | 13:37 |
| AJaeger | (I meant: could *not* get...) | 13:38 |
| mordred | yah | 13:38 |
| *** puranamr has joined #openstack-infra | 13:40 | |
| *** yamamoto has joined #openstack-infra | 13:41 | |
| mordred | ok. the propsal slave was at 99% disk full. most of the disk is spent in the jenkins workspace, but it's the git repos used, so it's legit disk usage | 13:41 |
| *** otter768 has joined #openstack-infra | 13:42 | |
| mordred | the only other place I could find deletable data was that we had 16 sets of old kernel headers | 13:42 |
| mordred | so I ran apt-get autoremove and removed teh old one - there is now 2.2G free | 13:42 |
| *** salv-orlando has joined #openstack-infra | 13:43 | |
| AJaeger | thanks, mordred | 13:43 |
| AJaeger | is there a way to enlarge the disk? Is that something that should be done after the summit? | 13:43 |
| mordred | it also removed a few python packages ... they looked like things that we do not use - however, it's possible somethign might fail. if it does, I think we'll want to update the puppet for the machine | 13:43 |
| mordred | AJaeger: yes- we can put more disk on the machine for sure | 13:43 |
| *** obulpathi has joined #openstack-infra | 13:44 | |
| AJaeger | mordred: I'll keep my eyes open and will speak up if I notice failures | 13:44 |
| *** yfried_ has joined #openstack-infra | 13:44 | |
| *** puranamr has quit IRC | 13:45 | |
| *** yamamoto has quit IRC | 13:45 | |
| *** otter768 has quit IRC | 13:46 | |
| *** hdd has quit IRC | 13:47 | |
| *** Zhongjun has joined #openstack-infra | 13:47 | |
| *** koolhead17 has joined #openstack-infra | 13:49 | |
| *** koolhead17 has quit IRC | 13:49 | |
| *** koolhead17 has joined #openstack-infra | 13:49 | |
| *** abregman has joined #openstack-infra | 13:49 | |
| *** freerunner has quit IRC | 13:49 | |
| *** annegentle has joined #openstack-infra | 13:49 | |
| *** freerunner has joined #openstack-infra | 13:50 | |
| *** shardy_ has joined #openstack-infra | 13:51 | |
| clarkb | mordred: thanks for looking at it (I am up early to drop people off at airport) also it is far too early in the morning | 13:51 |
| *** shardy has quit IRC | 13:52 | |
| clarkb | mordred: AJaeger one thing we could do is move the workspace on those nodes to /opt | 13:52 |
| clarkb | mordred: AJaeger since they are manually managed jenkins slaves we can just hit that setting in the jenkins master | 13:53 |
| clarkb | there is 68GB of free disk there | 13:53 |
| *** freerunner has quit IRC | 13:54 | |
| mordred | clarkb: ++ to up to early and ++ to /opt | 13:54 |
| *** zhiwei has joined #openstack-infra | 13:55 | |
| AJaeger | clarkb: I know to little about the setup to give a double + - looks fine to me! | 13:55 |
| clarkb | ya we should make sure others are onboard once they wake but I can likely make that change this morning | 13:56 |
| *** Sukhdev has joined #openstack-infra | 13:56 | |
| AJaeger | thanks, clarkb | 13:56 |
| *** shardy_ has quit IRC | 13:56 | |
| AJaeger | clarkb: drink a coffee first ;) | 13:56 |
| *** shardy has joined #openstack-infra | 13:57 | |
| *** ParsectiX has quit IRC | 13:58 | |
| *** coolsvap is now known as coolsvap|afk | 13:59 | |
| fungi | clarkb: sounds good to me | 14:00 |
| clarkb | fungi: mordred: those of you at the summit should pass along to jeblair that gerrit seems to have a very plausible root cause on the jgit issues we saw | 14:01 |
| clarkb | tl;dr is diff timeout occurs raising exception in thread doing pack operations, jgit treats this as an invalid pack and everything breaks from there | 14:02 |
| openstackgerrit | George Peristerakis proposed openstack-infra/system-config: Moved out the server class from the etherpad and etherpad-dev classes https://review.openstack.org/184499 | 14:03 |
| electrical | clarkb: fungi http://logs.openstack.org/48/183048/6/check/gate-jenkins-job-builder-python34/3d50ce4/console.html anything i missed in my stuff or is it something unrelated to my stuff? | 14:05 |
| *** armax has quit IRC | 14:06 | |
| *** shardy_ has joined #openstack-infra | 14:06 | |
| clarkb | electrical: looks like you are doing an ascii decode of files with unicode in them, so thats a valid failure | 14:06 |
| AJaeger | electrical: Duplicate entry found in '/home/jenkins/workspace/gate-jenkins-job-builder-python34/tests/duplicates/fixtures/exception_templates001.yaml: '{name}-001' | 14:06 |
| clarkb | those tests intentionally check with unicode | 14:07 |
| electrical | AJaeger: ah. funny i never tested it :-) | 14:07 |
| electrical | but by the looks of it, it should alert for it since its testing exceptions ? | 14:07 |
| electrical | *tested = modified it | 14:08 |
| *** shardy has quit IRC | 14:08 | |
| electrical | Its alerting about all kinds of stuff i never touched | 14:08 |
| *** samuelBartel has joined #openstack-infra | 14:09 | |
| clarkb | electrical: its very possibly broken elsewhere and you are just fallout | 14:09 |
| AJaeger | electrical: yeah, I'm confused now - but know too little about this | 14:09 |
| electrical | AJaeger: np ;-) | 14:10 |
| clarkb | I know pelix was looking at fixing something related to py34 and I had questions about why it was starting to fail now | 14:10 |
| clarkb | but don't think they were answered (if they were I am sorry I missed them) | 14:10 |
| *** dguerri is now known as dguerri`away | 14:10 | |
| *** dguerri`away is now known as dguerri | 14:10 | |
| electrical | clarkb: funny thing is, if i run tox -e py34 it fails.. if i run python setup.py testr --slowest directly it passes :-) | 14:10 |
| clarkb | electrical: that uses python2 | 14:10 |
| clarkb | `python` is supposed to be python2 | 14:10 |
| mordred | clarkb: oh- that does seem to be a plausible cause | 14:11 |
| electrical | not if i'm testing under python 3.4 right? | 14:11 |
| *** shardy_ has quit IRC | 14:11 | |
| clarkb | electrical: depends on how you set up your python env, but according to Python `python` is supposed to be python2 | 14:12 |
| clarkb | arch linux didn't do it this way so there are exceptions | 14:12 |
| electrical | clarkb ah okay. I'm using pyenv to manage my python versions | 14:12 |
| electrical | And i'm purely testing under python 3.4.3 now | 14:12 |
| *** shardy has joined #openstack-infra | 14:12 | |
| *** coolsvap has joined #openstack-infra | 14:13 | |
| clarkb | why not just run `tox`? | 14:13 |
| clarkb | pyenv doesn't really seem to do anything that tox isn't already doing for you | 14:13 |
| electrical | clarkb: before jjb i never heard of tox :-) | 14:14 |
| clarkb | in any case I would not be surprised if you don't actually get python3.4 there | 14:14 |
| electrical | and it seems to fail when i let it try to run all python versions since it doesn't want to switch or something | 14:14 |
| clarkb | try run just `python` and see what version is returned | 14:14 |
| electrical | Python 3.4.3 | 14:15 |
| clarkb | basically if `tox -e py34` fails due to python 3 issues and `python setup.py testr --slowest` doesn't that is suspiciously like broken env | 14:15 |
| clarkb | also .testr.conf may not know how to run your python3.4 properly in that case | 14:15 |
| *** coolsvap has quit IRC | 14:16 | |
| electrical | its very confusing indeed | 14:17 |
| clarkb | I would personally not use pyenv, just reading how it works its not really friendly to python tools | 14:17 |
| *** ddieterly has quit IRC | 14:17 | |
| clarkb | since it expects to intercept things with shims rather than setting the path to a correct python install that just works (tm) | 14:17 |
| clarkb | virtualenv should be much more robust at ensuring all the things run with the correct python | 14:17 |
| electrical | ah okay | 14:18 |
| *** baoli has joined #openstack-infra | 14:18 | |
| electrical | so best to drop pyenv and purely use virtualenv ? | 14:18 |
| clarkb | or at least drop pyenv for jjb | 14:18 |
| electrical | okay | 14:19 |
| clarkb | if other projects are setup to work with the shims it should be fine, but in the general "Using python" case virtualenv should work most of the time | 14:19 |
| openstackgerrit | Luis Cañas-Díaz proposed openstack-infra/activity-board: Update JS library and company panel to add top people by company. https://review.openstack.org/182995 | 14:19 |
| *** __afazekas is now known as afazekas | 14:20 | |
| *** jamespage_ has joined #openstack-infra | 14:20 | |
| electrical | clarkb: will switch to normal python and use tox. see what happens | 14:20 |
| clarkb | electrical: I think the problem here is that unlike virtualenv which replaces actual python install with a new one that you can install arbitrary things into and have them work as if you installed them globally pyenv needs to understand how to shim for you in all cases | 14:20 |
| *** krtaylor has joined #openstack-infra | 14:20 | |
| *** julim has joined #openstack-infra | 14:20 | |
| clarkb | electrical: and "how to shim for you in all cases" is likely breaking here | 14:20 |
| electrical | clarkb: i see. okay | 14:22 |
| mordred | electrical: if you like the UI of pyenv - you might want to investigate https://virtualenvwrapper.readthedocs.org/en/latest/ which people seem to like | 14:22 |
| *** baoli has quit IRC | 14:23 | |
| mordred | but uses virtualenv to manage the python envs (Also, obviously, using tox for openstack related things is the easiest way to go - but for your other hacking...) | 14:23 |
| openstackgerrit | Merged openstack-infra/activity-board: Update JS library and company panel to add top people by company. https://review.openstack.org/182995 | 14:23 |
| *** tonytan4ever has joined #openstack-infra | 14:23 | |
| *** hdd has joined #openstack-infra | 14:24 | |
| AJaeger | mordred, clarkb : Another job just finished on the proposal slave and is GREEN! Thanks | 14:26 |
| *** jtomasek has quit IRC | 14:26 | |
| electrical | clarkb: okay, now i'm atleast able to reproduce it all the time. | 14:28 |
| *** ivar-lazzaro has joined #openstack-infra | 14:28 | |
| annegentle | anyone know how many projects use tox -e gendocs vs. tox -e docs to run Sphinx builds? gendocs was new to me | 14:30 |
| mordred | annegentle: I've never heard of gendocs | 14:31 |
| annegentle | mordred: me neither, someone put it in our etherpad at yesterday's crossproject session. I'll try to figure out who so I can correct | 14:31 |
| *** sshnaidm has quit IRC | 14:31 | |
| *** gokrokve has joined #openstack-infra | 14:31 | |
| mordred | annegentle: if projects have one at all, it's usually 'docs' - although the gate does not use 'docs' and uses 'tox -evenv -- python setup.py build_sphinx' | 14:31 |
| mordred | annegentle: cool | 14:31 |
| *** wenlock has joined #openstack-infra | 14:32 | |
| annegentle | mordred: oh that's a good tidbit, thanks | 14:32 |
| *** zhiwei has quit IRC | 14:32 | |
| *** salv-orlando has quit IRC | 14:32 | |
| *** ivar-lazzaro has quit IRC | 14:33 | |
| AJaeger | annegentle: in openstack namespace: ironic and ironic-python-agent are the only one that have gendocs | 14:33 |
| AJaeger | annegentle: but 107 repositories have a docs environment | 14:33 |
| annegentle | AJaeger: ha ha ha ha oh ha ha oh LOL | 14:33 |
| annegentle | AJaeger: I'll let devananda know :) | 14:34 |
| annegentle | AJaeger: how's your vacation? | 14:34 |
| AJaeger | annegentle: starts Friday, I'm sure it will be great ;) | 14:34 |
| annegentle | AJaeger: hurrah! | 14:34 |
| AJaeger | Yeah! | 14:34 |
| *** jamespage_ has quit IRC | 14:35 | |
| *** zz_dimtruck is now known as dimtruck | 14:35 | |
| AJaeger | annegentle: shall I send a patch to rename gendocs? ;) | 14:35 |
| annegentle | AJaeger: heh. perhaps! | 14:37 |
| AJaeger | annegentle: tell devananda: https://review.openstack.org/184511 and https://review.openstack.org/184512 | 14:38 |
| annegentle | AJaeger: great, thanks! | 14:38 |
| *** freerunner has joined #openstack-infra | 14:42 | |
| *** zul has quit IRC | 14:42 | |
| *** freerunner has quit IRC | 14:43 | |
| *** tiswanso has joined #openstack-infra | 14:45 | |
| flip214 | anteaya: fungi: I'm now in the convention centre, in case you're here too I'd appreciate a bit of help. | 14:46 |
| *** tiswanso has quit IRC | 14:49 | |
| *** tiswanso has joined #openstack-infra | 14:50 | |
| *** freerunner has joined #openstack-infra | 14:53 | |
| electrical | clarkb: fungi No idea how to solve the unicode issue. ascii encoding fails, most likely because its unicode? | 14:53 |
| clarkb | electrical: yes I think pelix has a change up let me dig through scrollback | 14:54 |
| *** obulpathi has left #openstack-infra | 14:54 | |
| electrical | clarkb: ah cool. thanks. | 14:54 |
| clarkb | electrical: my concern is the job was working just fine in the past so would like to know what changed | 14:54 |
| electrical | clarkb: same here. | 14:55 |
| clarkb | electrical: https://review.openstack.org/#/c/183488/ | 14:55 |
| *** asselin has joined #openstack-infra | 14:55 | |
| clarkb | electrical: but I would try rebasing your change on that one to see if it cleans it up | 14:55 |
| electrical | clarkb: will try it out | 14:56 |
| *** bswartz has joined #openstack-infra | 14:56 | |
| *** ihrachyshka has joined #openstack-infra | 14:57 | |
| *** _nadya_ has quit IRC | 14:57 | |
| clarkb | electrical: I am running tox -r against master now too to see if master is affected | 14:58 |
| electrical | clarkb: works like a charm. Merge it ;-) | 14:58 |
| clarkb | well I want to know why we broken when it worked before... | 14:58 |
| clarkb | in theory we gate on this and we cna't merge code to break this | 14:58 |
| clarkb | and this doesn't cover how something external has changed | 14:58 |
| *** arxcruz has quit IRC | 14:59 | |
| electrical | Its weird yeah since it should have broke testing at some point. unless something changed on the testing infra at some point? | 14:59 |
| clarkb | I think its likely a dep change somewhere (maybe pyyaml?) | 14:59 |
| *** asselin has quit IRC | 15:00 | |
| electrical | could be. | 15:00 |
| clarkb | except py34 works fine against master for me | 15:00 |
| *** annegentle has quit IRC | 15:00 | |
| clarkb | hrm, maybe the comment of regardless of terminal encoding is important? | 15:00 |
| *** igorbelikov has quit IRC | 15:01 | |
| clarkb | I am all utf8'd | 15:01 |
| electrical | hmm PyYAML-3.11 is out of 2014. so that's not it | 15:01 |
| electrical | with the patch from pelix 34 works fine for me | 15:01 |
| electrical | i did read something that if LANG env isn't set it can mess up | 15:02 |
| clarkb | electrical: what does `locale` say for you? | 15:02 |
| electrical | its all set to en_US.UTF-8 | 15:02 |
| clarkb | ya same here so thats likely not it | 15:02 |
| clarkb | let me try your patch | 15:03 |
| clarkb | it works for me locally | 15:03 |
| electrical | Ah i think i found it. ( maybe ) with tox -evenv locale its all set to POSIX so it seems tox removes some stuff. | 15:04 |
| *** dims has joined #openstack-infra | 15:04 | |
| electrical | that's why my direct 'python' call works because it still had the lang set | 15:04 |
| clarkb | OH! tox2.0 maybe | 15:04 |
| clarkb | let me upgrade and try again | 15:04 |
| *** igorbelikov has joined #openstack-infra | 15:04 | |
| electrical | tox (2.0.1) | 15:05 |
| *** dboik has joined #openstack-infra | 15:05 | |
| electrical | that's what i got installed | 15:05 |
| flip214 | can somebody tell me why my devstack installation crashes during django, "ImportError: cannot import name Compiler" | 15:05 |
| clarkb | flip214: django is trying to compile the css for horizon and failing (I think). Is this on a fresh stack.sh on a ubuntu trusty node? | 15:06 |
| *** abregman has quit IRC | 15:06 | |
| electrical | clarkb: https://testrun.org/tox/latest/example/basic.html#passing-down-environment-variables <--- culprit !! | 15:06 |
| flip214 | clarkb: trusty or vivid. | 15:07 |
| flip214 | both fail. | 15:07 |
| electrical | By default tox will only pass the PATH environment variable | 15:07 |
| clarkb | electrical: ya I think thats the problem | 15:07 |
| clarkb | electrical: I am testing with an explicit LANG setting now | 15:07 |
| electrical | okay | 15:07 |
| flip214 | clarkb: what do I do about that? | 15:07 |
| clarkb | electrical: that works, so I think we want LANG=en_US.UTF-8 in the testenv setenv so that we are sure we actually test utf8 | 15:08 |
| clarkb | electrical: but otherwise pelix's change is probably a sane thing to do as well | 15:08 |
| clarkb | flip214: you could disable horizon as the cheap workaround | 15:08 |
| electrical | clarkb: yeah. we should not depend on the users locale imho. it could be set to all kinds of weirness | 15:08 |
| electrical | *weirdness | 15:08 |
| clarkb | flip214: but I would open a bug with them/devstack and get someone that understands their css compilationto look into it | 15:09 |
| clarkb | flip214: I am pretty sure we spin up horizon a few thousand times a day on trusty though so not sure why it would break for you | 15:09 |
| *** dboik has quit IRC | 15:09 | |
| flip214 | clarkb: that's what I'm wondering about, too. | 15:09 |
| electrical | clarkb: i think if we merge pelix's patch it should be all good. | 15:09 |
| electrical | until we find something else that breaks :p | 15:09 |
| *** e0ne has joined #openstack-infra | 15:10 | |
| clarkb | electrical: well I think we need to merge the LANG change, pushing it up in just a moment | 15:10 |
| electrical | clarkb: okay | 15:10 |
| clarkb | electrical: ^ is the actual fix, pelix's change is just belt and suspenders | 15:10 |
| *** ParsectiX has joined #openstack-infra | 15:10 | |
| electrical | hehe | 15:10 |
| electrical | or you can pass on the users LANG variable instead of forcing it? | 15:11 |
| *** ParsectiX has quit IRC | 15:11 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/jenkins-job-builder: Test with LANG set to UTF-8 https://review.openstack.org/184519 | 15:12 |
| clarkb | electrical: no I want to force it | 15:12 |
| electrical | ah okay | 15:12 |
| clarkb | electrical: because I don't want users to test with ascii or latin1 or some utf16 thing | 15:12 |
| electrical | hehe okay :-) | 15:13 |
| *** markus_z has joined #openstack-infra | 15:13 | |
| *** ParsectiX has joined #openstack-infra | 15:13 | |
| *** yamamoto has joined #openstack-infra | 15:13 | |
| clarkb | though apparnetly yaml is happy with utf16 too | 15:14 |
| *** aswadr has quit IRC | 15:14 | |
| *** ihrachyshka has quit IRC | 15:14 | |
| *** rlandy has quit IRC | 15:14 | |
| *** fhubik has quit IRC | 15:14 | |
| *** notnownikki has joined #openstack-infra | 15:14 | |
| *** armax has joined #openstack-infra | 15:15 | |
| *** e0ne has quit IRC | 15:16 | |
| electrical | patch works like a charm for me. | 15:17 |
| *** ddieterly has joined #openstack-infra | 15:18 | |
| *** juggler_ has joined #openstack-infra | 15:18 | |
| *** panda has quit IRC | 15:20 | |
| *** tiswanso has quit IRC | 15:21 | |
| *** fhubik has joined #openstack-infra | 15:21 | |
| *** tiswanso has joined #openstack-infra | 15:21 | |
| *** panda has joined #openstack-infra | 15:21 | |
| *** juggler has quit IRC | 15:22 | |
| *** ddieterly has quit IRC | 15:22 | |
| *** BharatK has quit IRC | 15:23 | |
| *** sks has quit IRC | 15:23 | |
| *** dims has quit IRC | 15:24 | |
| *** gokrokve_ has joined #openstack-infra | 15:26 | |
| *** tiswanso has quit IRC | 15:26 | |
| *** baoli has joined #openstack-infra | 15:26 | |
| *** fhubik has quit IRC | 15:27 | |
| *** gokrokve_ has quit IRC | 15:27 | |
| *** gokrokve_ has joined #openstack-infra | 15:27 | |
| *** jamespage_ has joined #openstack-infra | 15:28 | |
| *** gokrokve has quit IRC | 15:29 | |
| *** ivar-lazzaro has joined #openstack-infra | 15:29 | |
| *** jamespage_ has quit IRC | 15:29 | |
| elarson | hi all, we have a review that hasn't been merged https://review.openstack.org/#/c/181697/ and we were wondering why? is it b/c of a lack of a second +2? | 15:29 |
| *** blahdeblah has quit IRC | 15:31 | |
| *** freerunner has quit IRC | 15:31 | |
| *** freerunner has joined #openstack-infra | 15:32 | |
| *** puranamr has joined #openstack-infra | 15:33 | |
| clarkb | elarson: it needs to go into the gate but gerrit doesn't emit the vote data if it doesn't change so the +1 verified comes back each time and doesn't transition to gate (zaro is working upstream to fix in gerrit). To get around this you can reapprove or I can remove the +1 jenkins vote and recheck then | 15:33 |
| fungi | elarson: no, it's because dims added his code review +2 separately after his workflow +1, so when zuul got the original workflow +1 event the conditions needed to enqueue in the gate pipeline (in this case at least one code review +2) weren't met. someone needs to add another approval vote (dims could also do it by removing and adding his again) | 15:33 |
| *** salv-orlando has joined #openstack-infra | 15:33 | |
| fungi | and the reason why recheck isn't helping is as clarkb mentions above | 15:34 |
| *** ivar-lazzaro has quit IRC | 15:34 | |
| elarson | ah ok | 15:34 |
| *** ParsectiX is now known as ParsectiX[away] | 15:34 | |
| *** krtaylor has quit IRC | 15:36 | |
| * elarson will reapprove | 15:36 | |
| clarkb | https://git.eclipse.org/r/#/c/48288/ | 15:36 |
| clarkb | that is the supposed fix for our jgit problems | 15:36 |
| *** BharatK has joined #openstack-infra | 15:37 | |
| fungi | that looks remarkably promising | 15:37 |
| *** freerunner has quit IRC | 15:37 | |
| *** nelsnelson has joined #openstack-infra | 15:38 | |
| *** amitgandhinz has joined #openstack-infra | 15:38 | |
| *** yamamoto has quit IRC | 15:39 | |
| dstanek | i heard that we will(have?) remove pypy jobs from the gate since there were no volunteers to help. is that true? and if it is, is it too late to volunteer? | 15:39 |
| clarkb | dstanek: I thought we did get a volunteer and the jobs were sorted before that | 15:40 |
| clarkb | dstanek: but you should definitely volunteer too :) | 15:40 |
| *** Sukhdev has quit IRC | 15:40 | |
| dstanek | clarkb: nice. who should i talk to about it? i have no idea what is needed :-) | 15:41 |
| *** salv-orlando has quit IRC | 15:41 | |
| clarkb | I am trying to dig up the mail thread but for some reason searching for pypy returns results for pypi :/ | 15:41 |
| clarkb | dstanek: I think the general idea is that if/when things break you could be the person working to get them fixed (that may be coordination, patches, etc) | 15:42 |
| *** baoli has quit IRC | 15:42 | |
| clarkb | "disabling pypy unit test jobs for oslo' is the subject of the thread, right now they are all non voting iirc | 15:42 |
| *** otter768 has joined #openstack-infra | 15:42 | |
| clarkb | but doesn't look like anyone has responded with updates since then | 15:43 |
| clarkb | dstanek: lifeless and sdague should know what is going on then someone should update the list | 15:43 |
| *** amitgandhinz has quit IRC | 15:43 | |
| *** tiswanso has joined #openstack-infra | 15:43 | |
| *** samuelBartel has quit IRC | 15:44 | |
| *** hdd has quit IRC | 15:44 | |
| *** freerunner has joined #openstack-infra | 15:46 | |
| dstanek | clarkb: great, thanks. i'll see if i can find one of them here today to see if there's anything i can help out with. long term is there a need to people to watch for pypy issues? | 15:47 |
| *** otter768 has quit IRC | 15:48 | |
| *** dims has joined #openstack-infra | 15:48 | |
| *** kgiusti has joined #openstack-infra | 15:49 | |
| *** enikanorov2 has quit IRC | 15:49 | |
| clarkb | dstanek: I think the need is less to watch for issues and more to be around to fix them when they happen | 15:50 |
| clarkb | zuul/jenkins is pretty good at doing the watching | 15:50 |
| *** hdd has joined #openstack-infra | 15:50 | |
| dstanek | clarkb: that's what i meant :-) i don't think i'd be very popular if i stopped reviewing Keystone code to watch progress bars | 15:51 |
| *** julim has quit IRC | 15:51 | |
| *** markus_z has quit IRC | 15:52 | |
| *** kgiusti has quit IRC | 15:52 | |
| *** patrickeast has joined #openstack-infra | 15:53 | |
| *** baoli has joined #openstack-infra | 15:53 | |
| *** baoli has quit IRC | 15:54 | |
| *** david-lyle has joined #openstack-infra | 15:54 | |
| *** dmorita has quit IRC | 15:54 | |
| *** mestery has joined #openstack-infra | 15:55 | |
| *** doude has joined #openstack-infra | 15:55 | |
| *** armax has quit IRC | 15:56 | |
| *** tiswanso has quit IRC | 15:56 | |
| *** annegentle has joined #openstack-infra | 15:56 | |
| *** mriedem has joined #openstack-infra | 15:56 | |
| *** mestery has quit IRC | 15:57 | |
| *** mestery has joined #openstack-infra | 15:57 | |
| *** kgiusti has joined #openstack-infra | 15:58 | |
| *** mestery has quit IRC | 15:59 | |
| *** yamamoto has joined #openstack-infra | 15:59 | |
| *** dannywilson has joined #openstack-infra | 15:59 | |
| *** baoli has joined #openstack-infra | 15:59 | |
| *** mestery has joined #openstack-infra | 15:59 | |
| jeblair | clarkb, nibz: i've dialed into the pbx room 6000 | 16:00 |
| *** kerpan has quit IRC | 16:00 | |
| clarkb | :) and fwiw the last one was a small problem with old setuptools and whatever pypy ubuntu trusty gave us. I think what was happening is that setuptools was getting upgraded but since pip has already imported it you are stuck on the old version until you make a new process and re import things. Fix was to upgrade virtualenv which upgraded setuptools | 16:00 |
| *** salv-orlando has joined #openstack-infra | 16:00 | |
| clarkb | jeblair: thanks, will pop in a few | 16:00 |
| jeblair | sorry i haven't had time to update the ep; this is the yaml2ical work session | 16:00 |
| *** _nadya_ has joined #openstack-infra | 16:01 | |
| *** yolanda has quit IRC | 16:01 | |
| *** tiswanso has joined #openstack-infra | 16:02 | |
| *** smyers has quit IRC | 16:02 | |
| *** ociuhandu has joined #openstack-infra | 16:02 | |
| *** rbradfor has joined #openstack-infra | 16:02 | |
| jeblair | https://etherpad.openstack.org/p/YVR-infra-irc-meetings | 16:03 |
| *** isviridov_away is now known as isviridov | 16:03 | |
| *** dmorita has joined #openstack-infra | 16:03 | |
| *** kerpan has joined #openstack-infra | 16:04 | |
| *** asselin has joined #openstack-infra | 16:04 | |
| *** Etienne_ has quit IRC | 16:04 | |
| *** annegentle has quit IRC | 16:04 | |
| *** _nadya_ has quit IRC | 16:04 | |
| *** baoli has quit IRC | 16:05 | |
| *** hdd has quit IRC | 16:06 | |
| *** dkranz has joined #openstack-infra | 16:06 | |
| *** ivar-lazzaro has joined #openstack-infra | 16:07 | |
| *** annegentle has joined #openstack-infra | 16:08 | |
| clarkb | jeblair: should I use etherpad chat or speak for the work sessions? | 16:11 |
| *** jcoufal has joined #openstack-infra | 16:12 | |
| *** dboik has joined #openstack-infra | 16:12 | |
| openstackgerrit | Aaron Rosen proposed openstack/requirements: Add ovn-networking to tracked projects list https://review.openstack.org/184528 | 16:12 |
| *** koolhead17 has quit IRC | 16:13 | |
| *** e0ne has joined #openstack-infra | 16:13 | |
| fungi | clarkb: you can speak, though when jeblair's laptop starts making noise people may jump | 16:13 |
| *** doude has quit IRC | 16:16 | |
| *** amotoki has joined #openstack-infra | 16:17 | |
| *** jlanoux has quit IRC | 16:17 | |
| nibz | :) | 16:18 |
| *** dboik_ has joined #openstack-infra | 16:19 | |
| *** BharatK has quit IRC | 16:19 | |
| *** dannywilson has quit IRC | 16:20 | |
| crinkle | etherpad seems sad again :( | 16:20 |
| *** jistr has quit IRC | 16:20 | |
| *** ZZelle has joined #openstack-infra | 16:20 | |
| *** dannywilson has joined #openstack-infra | 16:20 | |
| jeblair | crinkle: i agree with you | 16:20 |
| *** dboik has quit IRC | 16:22 | |
| *** scheuran has quit IRC | 16:22 | |
| jeblair | seems to have restarted but is better now | 16:22 |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Remove UTF-8 Characters. https://review.openstack.org/184531 | 16:22 |
| *** asselin has quit IRC | 16:22 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Add jenkins user to eavesdrop.openstack.org https://review.openstack.org/184532 | 16:23 |
| *** BharatK has joined #openstack-infra | 16:23 | |
| *** BharatK has quit IRC | 16:24 | |
| *** salv-orlando has quit IRC | 16:24 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/irc-meetings: Basic template for meeting index https://review.openstack.org/184533 | 16:26 |
| clarkb | crinkle: jeblair fungi et al http://paste.openstack.org/show/229549/ is the error | 16:26 |
| clarkb | it basically seems that on any error etherpad-lite restarts | 16:27 |
| *** Sukhdev has joined #openstack-infra | 16:27 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Remove UTF-8 Characters. https://review.openstack.org/184531 | 16:28 |
| *** jcoufal has quit IRC | 16:29 | |
| *** jaypipes has joined #openstack-infra | 16:29 | |
| fungi | clarkb: yeah, mclear basically said as much in that other bug yesterday | 16:30 |
| *** e0ne has quit IRC | 16:30 | |
| fungi | "node runs in a single thread so when it hits an exception the stack bubbles up all the way to the top" | 16:30 |
| fungi | seems like a poor design choice to me | 16:30 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/irc-meetings: Basic template for meeting index https://review.openstack.org/184533 | 16:30 |
| clarkb | fungi: ya you can catch them withut letting them explode your process | 16:31 |
| clarkb | fungi: its just harder so I think they don't do it | 16:31 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/irc-meetings: Basic template for meeting index https://review.openstack.org/184533 | 16:32 |
| *** samuelBartel has joined #openstack-infra | 16:33 | |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-meetbot: Make index management optional https://review.openstack.org/184538 | 16:33 |
| *** dannywilson has quit IRC | 16:36 | |
| *** dkranz has quit IRC | 16:37 | |
| *** e0ne has joined #openstack-infra | 16:37 | |
| openstackgerrit | Merged openstack-infra/yaml2ical: Add ability to generate a meeting index https://review.openstack.org/159879 | 16:37 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Disable management of eavesdrop index.html https://review.openstack.org/184539 | 16:37 |
| zaro | pelix: ping | 16:38 |
| electrical | zaro: hiya :-) | 16:38 |
| pabelanger | 980855 | 16:38 |
| pabelanger | 820783 | 16:38 |
| pabelanger | oops | 16:39 |
| pabelanger | my bad | 16:39 |
| clarkb | http://paste.openstack.org/show/229557/ seems to be the current issue | 16:39 |
| clarkb | (I really wonder how this error handling method is supposed to scale) | 16:39 |
| openstackgerrit | Merged openstack-infra/yaml2ical: Replace ci.o.o links with docs.o.o/infra https://review.openstack.org/183307 | 16:40 |
| greghaynes | clarkb: its webscale | 16:40 |
| *** patrickeast_ has joined #openstack-infra | 16:40 | |
| electrical | zaro: i updated the logstash publisher with your comments. Just waiting for a fix of jjb to land so python 3.4 is green as well | 16:41 |
| *** jcoufal has joined #openstack-infra | 16:41 | |
| *** yamamoto has quit IRC | 16:41 | |
| *** amotoki has quit IRC | 16:41 | |
| *** unicell has joined #openstack-infra | 16:41 | |
| *** baoli has joined #openstack-infra | 16:41 | |
| *** armax has joined #openstack-infra | 16:41 | |
| *** e0ne has quit IRC | 16:41 | |
| clarkb | I am running `tail -f /var/log/eplite/access.log | grep -A 10 -B 30 'graceful shutdown'` now to catch the restarts | 16:42 |
| *** patrickeast has quit IRC | 16:42 | |
| clarkb | so basically these are all clients returning unsafe data errors and etherpad does not protect itself | 16:42 |
| clarkb | not only does it not protect itself but its behavior in response is to corrupt its DB then die | 16:42 |
| *** baoli has quit IRC | 16:42 | |
| anteaya | clarkb: how many errors have we acknowledged since yesterday? two? | 16:42 |
| *** armax has quit IRC | 16:43 | |
| clarkb | anteaya: there was the ony DB issue, then there have been a handful of unrelated restarts, the last two pastes of mine cover the two cases | 16:43 |
| *** annegentle has quit IRC | 16:43 | |
| pelix | zaro: ong | 16:43 |
| anteaya | okay thanks | 16:43 |
| clarkb | anteaya: these restarts don't end up in a loop like the DB one so they are less bad, but still annoying | 16:43 |
| *** ParsectiX[away] is now known as ParsectiX | 16:44 | |
| anteaya | yay less bad? | 16:44 |
| *** tiswanso has quit IRC | 16:44 | |
| *** patrickeast_ has quit IRC | 16:45 | |
| *** dboik_ has quit IRC | 16:45 | |
| *** rbradfor has quit IRC | 16:45 | |
| *** ociuhandu has quit IRC | 16:46 | |
| *** amotoki has joined #openstack-infra | 16:46 | |
| *** kgiusti has quit IRC | 16:47 | |
| *** mestery has quit IRC | 16:47 | |
| *** abregman has joined #openstack-infra | 16:48 | |
| *** mriedem has quit IRC | 16:48 | |
| *** liam__ has joined #openstack-infra | 16:48 | |
| clarkb | I think next step if it keeps up is the tcpdump -A on the traffic that is in the clear and see if we can narrow it down to interactions on a single etherpad | 16:49 |
| *** doude has joined #openstack-infra | 16:50 | |
| clarkb | then go in that room and tell everyone to fix their etherpad clients | 16:50 |
| *** tiswanso has joined #openstack-infra | 16:50 | |
| *** salv-orlando has joined #openstack-infra | 16:50 | |
| *** asselin has joined #openstack-infra | 16:51 | |
| clarkb | https://github.com/ether/etherpad-lite/issues/2669 suggests that node 12 may help (but I have no idea why) | 16:51 |
| greghaynes | clarkb: we can hold open a computer with you on video chat so you can yell at people to fix their etherpad | 16:52 |
| anteaya | there is a roaming bot here so you can move around while you do that | 16:53 |
| anteaya | I'm a fan of having a roomba trailer on that roaming bot | 16:53 |
| *** annegentle has joined #openstack-infra | 16:54 | |
| *** freerunner has quit IRC | 16:54 | |
| Clint | anteaya: what was the wiki page you mentioned? | 16:55 |
| anteaya | Clint: https://wiki.openstack.org/wiki/Design_Summit/Liberty/Etherpads | 16:56 |
| *** baoli has joined #openstack-infra | 16:56 | |
| Clint | anteaya: thanks! | 16:57 |
| anteaya | Clint: welcome | 16:57 |
| *** asahlin has quit IRC | 16:57 | |
| *** ivar-lazzaro has quit IRC | 16:58 | |
| *** asahlin has joined #openstack-infra | 16:58 | |
| *** doude has quit IRC | 17:00 | |
| clarkb | also https://github.com/ether/etherpad-lite/issues/2454 but that was supposedly fixed so likely same symptom but different underlying issue | 17:01 |
| *** jamielennox|away is now known as jamielennox | 17:01 | |
| *** liam__ has quit IRC | 17:02 | |
| *** freerunner has joined #openstack-infra | 17:04 | |
| lifeless | clarkb: dstanek hi wassup ? | 17:05 |
| *** annegentle has quit IRC | 17:05 | |
| clarkb | lifeless: dstanek was looking to catch up on where pypy testing ended up and iirc you were doing some organizing around that but not volunteering yourself | 17:05 |
| lifeless | clarkb: dstanek: we have two volunteers, I need to put it up on a wiki page | 17:05 |
| lifeless | AIUI the jobs are passing again now and we should be able to put them into voting mode | 17:05 |
| clarkb | lifeless: maybe also respond to the mail thread | 17:05 |
| lifeless | but should discussin the list first | 17:05 |
| lifeless | clarkb: yes | 17:05 |
| lifeless | ETIME | 17:05 |
| clarkb | thanks | 17:06 |
| *** Guest94220 has quit IRC | 17:07 | |
| *** dboik has joined #openstack-infra | 17:09 | |
| *** baoli has quit IRC | 17:09 | |
| lifeless | fijall is one | 17:09 |
| anteaya | clarkb: we seem to be in an etherpad restart loop, can you confirm? | 17:09 |
| clarkb | anteaya: I do not see it shutting down | 17:09 |
| lifeless | sdague: is there an existing page about pypy ? | 17:09 |
| clarkb | looks like its off though | 17:09 |
| anteaya | I am consistently reconnecting to https://etherpad.openstack.org/p/YVR-infra-activity-tracking | 17:09 |
| Clint | same | 17:10 |
| clarkb | anteaya: its not in a loop | 17:10 |
| anteaya | okay | 17:10 |
| clarkb | anteaya: was the author undefined error again | 17:10 |
| anteaya | :( | 17:10 |
| *** dtroyer has quit IRC | 17:11 | |
| lifeless | can't see one, making one. | 17:11 |
| * anteaya tries a refresh of the browser page | 17:11 | |
| anteaya | 503 | 17:11 |
| *** dtroyer has joined #openstack-infra | 17:11 | |
| clarkb | anteaya: hard refresh | 17:11 |
| clarkb | I think it caches that | 17:11 |
| *** rbradfor has joined #openstack-infra | 17:11 | |
| clarkb | probably to keep you from hammering the server while it fails and restarts | 17:11 |
| cinerama | etherpad is having a sad | 17:12 |
| *** salv-orlando has quit IRC | 17:13 | |
| fungi | yeah, i seem to not be able to load the page, even on a force refresh | 17:13 |
| *** zaneb has joined #openstack-infra | 17:13 | |
| fungi | ahh, it finally worked | 17:14 |
| anteaya | my results after an f5: http://imgur.com/2ANF0Tf | 17:14 |
| *** ParsectiX has quit IRC | 17:14 | |
| anteaya | and I have the etherpad again | 17:14 |
| clarkb | it was a single restart | 17:14 |
| *** bhunter71 has joined #openstack-infra | 17:14 | |
| cinerama | yeah we're good here now | 17:15 |
| *** _nadya_ has joined #openstack-infra | 17:16 | |
| Clint | it's doing it again | 17:16 |
| *** _nadya_ has quit IRC | 17:16 | |
| TheJulia | :( | 17:17 |
| lifeless | and rguillebert | 17:17 |
| clarkb | it restarted again | 17:17 |
| clarkb | I really don't want to tcpdump as a method to debug etherpad but... | 17:18 |
| *** _nadya_ has joined #openstack-infra | 17:18 | |
| cinerama | ick | 17:18 |
| anteaya | yeah, it is restarting fairly consistently :( | 17:18 |
| sdague | etherpad seems to be looping | 17:19 |
| fungi | clarkb: would you do offline decrypt of the https connections after you capture them? | 17:19 |
| sdague | oh, reads scrollback... | 17:20 |
| clarkb | [2015-05-20 17:16:25.279] [ERROR] console - TypeError: Cannot set property 'colorId' of null | 17:20 |
| clarkb | again | 17:20 |
| fungi | oh, wait, it's http on the loopback | 17:20 |
| clarkb | It is not looping | 17:20 |
| clarkb | fungi: and yes would look at port 9001 | 17:20 |
| fungi | yeah, i just spaced for a moment | 17:20 |
| clarkb | I think that there is a bad client or two out there and etherpad-lite's method of handling invalid input is to explode | 17:20 |
| anteaya | clarkb: what characterizes a bad client? | 17:21 |
| anteaya | a certain browser? | 17:21 |
| *** mtanino_away has joined #openstack-infra | 17:22 | |
| clarkb | anteaya: I have no idea | 17:22 |
| anteaya | okay | 17:22 |
| *** salv-orlando has joined #openstack-infra | 17:22 | |
| *** mtanino_away is now known as mtanino | 17:23 | |
| clarkb | anteaya: I say that because http://paste.openstack.org/show/229549/ reads as client gave invalid author data causing etherpad-lite to explode | 17:24 |
| clarkb | but there is zerp information about that at all, don't know what browser, what etherpad, etc | 17:24 |
| *** amotoki has quit IRC | 17:24 | |
| *** teran has quit IRC | 17:24 | |
| *** teran has joined #openstack-infra | 17:25 | |
| lifeless | clarkb: wiki page made, email sent to list | 17:25 |
| clarkb | but I think I have captured it with tcpdump so will dig through that shortly | 17:25 |
| clarkb | if anyone else has a better idea for figuring out why this happens I am all ears | 17:25 |
| anteaya | clarkb: I have no better ideas | 17:26 |
| *** mriedem has joined #openstack-infra | 17:26 | |
| openstackgerrit | Khai Do proposed stackforge/python-jenkins: Ensure request data is in the correct format https://review.openstack.org/184119 | 17:26 |
| * anteaya offers clarkb digging gloves | 17:26 | |
| *** teran has quit IRC | 17:26 | |
| clarkb | ~clarkb/etherpad-explodes.pcap is the capture file | 17:26 |
| *** samuelBartel has quit IRC | 17:29 | |
| *** ivar-lazzaro has joined #openstack-infra | 17:29 | |
| *** ashleighfarnham has joined #openstack-infra | 17:29 | |
| *** david-lyle has quit IRC | 17:29 | |
| *** ashleighfarnham has quit IRC | 17:30 | |
| *** dizquierdo has quit IRC | 17:31 | |
| *** yolanda has joined #openstack-infra | 17:32 | |
| clarkb | I was hoping there would be an http 500 around that time that I could work backward from to see what request resulted in it | 17:33 |
| clarkb | but not having any luck with that | 17:33 |
| *** dims has quit IRC | 17:33 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for bug 1456771 https://review.openstack.org/184313 | 17:33 |
| *** amotoki has joined #openstack-infra | 17:33 | |
| openstack | bug 1456771 in OpenStack Compute (nova) "Failure prepping block device in the gate" [High,In progress] https://launchpad.net/bugs/1456771 - Assigned to Hans Lindgren (hanlind) | 17:33 |
| *** dannywilson has joined #openstack-infra | 17:33 | |
| *** weshay has joined #openstack-infra | 17:33 | |
| *** amotoki has quit IRC | 17:33 | |
| clarkb | so I think that not only does etherpad-lite fail at failing it fails to tell its client that it is failing | 17:33 |
| *** nikeshm has joined #openstack-infra | 17:34 | |
| *** achanda has joined #openstack-infra | 17:34 | |
| *** yamamoto has joined #openstack-infra | 17:34 | |
| anteaya | awesome | 17:34 |
| *** yamamoto has quit IRC | 17:34 | |
| *** ZZelle has quit IRC | 17:34 | |
| *** Sukhdev has quit IRC | 17:34 | |
| *** baoli has joined #openstack-infra | 17:35 | |
| *** soren has joined #openstack-infra | 17:35 | |
| *** asselin has quit IRC | 17:35 | |
| nikeshm | anteaya : hi good morning yesterday eve we met,i installled xchat,what network to select in xchat | 17:37 |
| *** achanda has quit IRC | 17:37 | |
| *** yolanda has quit IRC | 17:38 | |
| *** tiswanso has quit IRC | 17:38 | |
| *** asselin has joined #openstack-infra | 17:38 | |
| *** unicell has quit IRC | 17:39 | |
| *** baoli has quit IRC | 17:39 | |
| *** achanda has joined #openstack-infra | 17:39 | |
| nikeshm | anteya :there are bunch of networks,i selected default one,and connected but i was not able to see any people,so login through web IRC | 17:39 |
| *** bhunter71 has quit IRC | 17:40 | |
| openstackgerrit | George Peristerakis proposed openstack-infra/system-config: Moved out the server class from the nodepool_prod class https://review.openstack.org/184557 | 17:40 |
| openstackgerrit | garyk proposed openstack-infra/project-config: vmware-nsx: move from stackforge/ to openstack/ https://review.openstack.org/184558 | 17:41 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for bug 1456771 https://review.openstack.org/184313 | 17:41 |
| openstack | bug 1456771 in OpenStack Compute (nova) "Failure prepping block device in the gate" [High,In progress] https://launchpad.net/bugs/1456771 - Assigned to Matt Riedemann (mriedem) | 17:41 |
| *** salv-orlando has quit IRC | 17:42 | |
| reazem | clarkb: Would you be available to add me to the surveil-release group on gerrit? (see Ifa6a0989406fb78ae0edb133a00cab926a2ae30d) | 17:42 |
| openstackgerrit | Lukasz Jernas proposed openstack-infra/infra-specs: Translation check site spec https://review.openstack.org/184559 | 17:42 |
| *** yolanda has joined #openstack-infra | 17:42 | |
| clarkb | reazem: what is the gerrit user? | 17:43 |
| reazem | clarkb: reazem | 17:43 |
| reazem | The group does not exist yet. | 17:43 |
| *** otter768 has joined #openstack-infra | 17:43 | |
| *** salv-orlando has joined #openstack-infra | 17:44 | |
| *** dboik has quit IRC | 17:44 | |
| clarkb | the group exists | 17:44 |
| *** amotoki has joined #openstack-infra | 17:44 | |
| clarkb | there is no reazem user though | 17:44 |
| *** mnaser has quit IRC | 17:44 | |
| reazem | clarkb: ReAzem | 17:44 |
| *** ashleighfarnham has joined #openstack-infra | 17:44 | |
| reazem | Caps matter. my bad | 17:45 |
| clarkb | done | 17:45 |
| reazem | clarkb: Thanks! | 17:45 |
| reazem | clarkb: Are you also able to reset my username? I would like to change it to 'aviau'. There seems to be a procedure here: http://docs.openstack.org/infra/system-config/gerrit.html#resetting-a-username-in-gerrit | 17:48 |
| *** otter768 has quit IRC | 17:49 | |
| clarkb | https://etherpad.openstack.org/p/heat-reviews https://etherpad.openstack.org/p/YVR-neutron-use-case-discussion are in use right before the error according to timestamps | 17:49 |
| clarkb | reazem: we don't change them unless something is broken | 17:50 |
| *** unicell has joined #openstack-infra | 17:50 | |
| reazem | clarkb: oh, thanks anyways | 17:50 |
| *** ZZelle has joined #openstack-infra | 17:51 | |
| clarkb | reazem: typically oyu are the onl person that has to know your username (account ids work for group membership instead) so unless there is a conflict preventing you from using gerrit we just leave it as is | 17:51 |
| reazem | clarkb: Oh that's true. I didn't realise it was hidden. | 17:52 |
| *** kgiusti has joined #openstack-infra | 17:52 | |
| *** mnaser has joined #openstack-infra | 17:53 | |
| *** nzeer has quit IRC | 17:53 | |
| *** nzeer has joined #openstack-infra | 17:53 | |
| *** dannywilson has quit IRC | 17:53 | |
| clarkb | for the colorid issue I wonder if that is set as null in the db | 17:54 |
| *** julim has joined #openstack-infra | 17:54 | |
| *** e0ne has joined #openstack-infra | 17:57 | |
| *** asselin has quit IRC | 17:57 | |
| *** asselin has joined #openstack-infra | 17:57 | |
| *** soren has quit IRC | 17:58 | |
| *** Zhongjun has quit IRC | 17:59 | |
| *** unicell1 has joined #openstack-infra | 17:59 | |
| *** unicell has quit IRC | 18:00 | |
| *** yamamoto has joined #openstack-infra | 18:01 | |
| greghaynes | jeblair: https://github.com/gobby/gobby/wiki/Dedicated-Server | 18:02 |
| greghaynes | jeblair: should be the good starting point for infinote infos | 18:02 |
| clarkb | https://github.com/Pita/ueberDB/blob/master/CacheAndBufferLayer.js#L317 is where we break on the colorID thing | 18:02 |
| clarkb | so its setting a value not reading a value | 18:03 |
| *** salv-orlando has quit IRC | 18:03 | |
| clarkb | so fairly certain that is a "bad" client issue too | 18:03 |
| *** dboik has joined #openstack-infra | 18:03 | |
| *** cody-somerville has joined #openstack-infra | 18:03 | |
| *** cody-somerville has quit IRC | 18:03 | |
| *** cody-somerville has joined #openstack-infra | 18:03 | |
| *** nikeshm_ has joined #openstack-infra | 18:03 | |
| *** mriedem has quit IRC | 18:04 | |
| *** weshay has quit IRC | 18:04 | |
| *** sputnik13 has joined #openstack-infra | 18:04 | |
| *** zaneb has quit IRC | 18:05 | |
| anteaya | nikeshm: hi connect to freendoe network on x-chat | 18:05 |
| nikeshm_ | thanks | 18:06 |
| nikeshm_ | just now onnected | 18:06 |
| *** tiswanso has joined #openstack-infra | 18:06 | |
| anteaya | nikeshm_: congratulations | 18:06 |
| clarkb | ok the plot thickens, the code that does setSub on color id does seem to verify that colorId is not null | 18:07 |
| clarkb | so I can only guess that this is super racey and what happens is it async passes in the data then sometime later but efore the db gets to it that data is null ified | 18:08 |
| clarkb | but I know almost nothing about js so thats just me waving my hands | 18:08 |
| nikeshm_ | anteaya:where can i found list of elements out of https://github.com/openstack-infra/project-config/tree/master/nodepool/elements for creating a nodepool image for running tempest for cider drivers | 18:08 |
| *** sputnik13 has quit IRC | 18:09 | |
| *** dkranz has joined #openstack-infra | 18:09 | |
| clarkb | but it does pass message.data.userInfo.colorId which if not passed by value is going to make it a sad time | 18:09 |
| purp | Hi, smart infra folks. Seems like I can't change the topic in #openstack-defcore ... how do I fix that? | 18:09 |
| clarkb | krotscheck: greghaynes https://github.com/ether/etherpad-lite/blob/develop/src/node/handler/PadMessageHandler.js#L551-L552 those appear to be the offending lines. Could that be a race against message.data changing? | 18:10 |
| nikeshm_ | anteaya : like asselin said i am debugging scripts which are not useful,but if there any lists then it will be useful | 18:10 |
| nikeshm_ | :) | 18:10 |
| Clint | purp: you need to be opped or remove the 't' from the channel mode | 18:10 |
| asselin | nikeshm_, why do you need a list? ls -R ? | 18:11 |
| *** nikeshm has quit IRC | 18:11 | |
| clarkb | krotscheck: greghaynes and if that is the problem is there a simple way to pass a copy of the values? | 18:11 |
| purp | And I have no power to do either for myself. Halp? | 18:11 |
| krotscheck | Eh? Wha? | 18:11 |
| greghaynes | clarkb: hrm? im no nodejs guru but I thought its single thread | 18:12 |
| purp | I'd recommend that someone who set up chanserv grant op to at least eglute: and zehicle: | 18:12 |
| nikeshm_ | asselin: list in the sense,which scripts are not required for cinder | 18:12 |
| clarkb | greghaynes: its single thread but that doesn't mean X runs before Y | 18:12 |
| asselin | nikeshm_, the elements have nothing to do with cinder | 18:12 |
| krotscheck | greghaynes: It's "magic" threaded. | 18:12 |
| clarkb | greghaynes: so you submit async job to update DB, then message.data is cleared, then DB handles async == explode | 18:12 |
| Clint | purp: eglute has chanserv access | 18:12 |
| greghaynes | clarkb: you have a backtrace? | 18:13 |
| purp | Clint: thanks. I'll poke her, then. She's right here. But eglute doesn't think she does, so she's looking. | 18:13 |
| *** jerryz has joined #openstack-infra | 18:13 | |
| asselin | nikeshm_, they are (amoung other things) to pre-cache data so that your jobs don't download hundreds of MB unnecessarily | 18:13 |
| clarkb | greghaynes: krotscheck http://paste.openstack.org/show/229557/ and http://paste.openstack.org/show/229549/ | 18:13 |
| eglute | Clint purp i think i lost it | 18:14 |
| asselin | nikeshm_, and allow jenkins master to talk to the jenkins slave (based on that image) | 18:14 |
| StevenK | purp: /msg ChanServ access #openstack-defcore list shows the list for that channel, and eglute is number 1 on the lsit | 18:14 |
| eglute | ah ok, thanks | 18:14 |
| asselin | nikeshm_, as I said yesterday, there are some elements that may not work in your environment. Just take them out from your env. | 18:15 |
| krotscheck | clarkb: Looks like the offending method is wrapped in a closure, so there's no good way to access it to fix it via a monkeypatch. | 18:15 |
| krotscheck | I'd have to build a debug environment to figure out if there's another workaround. | 18:15 |
| clarkb | greghaynes: krotscheck the first paste is the thing I am tracking down and the first one seems to break a little earlier in the same function for similar reasons | 18:16 |
| lifeless | oh yay. https://weakdh.org/ | 18:16 |
| clarkb | but tl;dr is that user data validation seems completely broken because racey | 18:16 |
| *** _nadya_ has quit IRC | 18:16 | |
| clarkb | and I don't know enough js to be useful beyond that | 18:17 |
| anteaya | clarkb: :( I'm in a reconnection loop again | 18:17 |
| clarkb | anteaya: it should not loop | 18:18 |
| *** ashleighfarnham has quit IRC | 18:18 | |
| clarkb | (lets stop using that word, the looping was a specific failure case yesterday that is not happening anymore best I can tell) | 18:18 |
| pleia2 | eglute: if you're still looking for how to alter the topic, since you have access you can just /msg chanserv topic #openstack-defcore channel topic goes here | 18:18 |
| anteaya | Reconnecting to your pad..., connected. Reconnecting to your pad..., connected. over and over | 18:18 |
| *** julim has quit IRC | 18:19 | |
| clarkb | this was the colorId explosion again | 18:19 |
| *** ddieterly has joined #openstack-infra | 18:19 | |
| greghaynes | clarkb: yeaaa, the async business makes debugging the db failure :( | 18:21 |
| greghaynes | clarkb: I wonder if the db is corrupt though | 18:22 |
| clarkb | greghaynes: I don't think so, thats reading a value from a client, then trying to set it in the db | 18:22 |
| *** teran has joined #openstack-infra | 18:22 | |
| clarkb | greghaynes: doesn't appear to read any data from the db | 18:22 |
| greghaynes | clarkb: well, thats based on the assumption that the second trace is the cause of the first right? | 18:23 |
| *** nikeshm_ has quit IRC | 18:23 | |
| clarkb | greghaynes: no they are unrelated | 18:23 |
| greghaynes | clarkb: the second trace is just an async setting 'something' | 18:23 |
| greghaynes | er, the first trace | 18:24 |
| clarkb | greghaynes: sorry the second trace is the other issue we see | 18:24 |
| clarkb | but they don't happen together | 18:24 |
| greghaynes | ok | 18:24 |
| tchaypo | jeblair: off the top of your head, do you know where I should look if I want to tweak the way a stack of changes is displayed? | 18:24 |
| clarkb | greghaynes: but the failures are very similar, in the first case you get "bad" data from the client and it fails to check if the data is good (which is an amazing fail btw) | 18:24 |
| clarkb | er sorry thats teh second traceback | 18:24 |
| eglute | thanks pleia2! | 18:25 |
| jeblair | clarkb, nibz: i have added some sessions to the yvr-infra etherpad; let me know if you want audio for any of them | 18:25 |
| clarkb | in the first traceback the data is validated as good then becomes ungood when trying to DB it | 18:25 |
| nibz | jeblair: looking | 18:25 |
| jeblair | infra is done for today; those are just the other sessions i'm pretty sure i'll be in | 18:25 |
| *** gokrokve has joined #openstack-infra | 18:26 | |
| nibz | jeblair: yea they look cool but I think i'm fine without | 18:26 |
| *** mjturek1 has quit IRC | 18:26 | |
| jeblair | nibz: k | 18:26 |
| clarkb | jeblair: all look good, I have to head to doctor visit at 2:30 though so unsure if I will catch the later 2 | 18:26 |
| *** e0ne has quit IRC | 18:26 | |
| clarkb | greghaynes: krotscheck so my theory is that when sessions start up and people pop open laptops then maybe flap on wifi or whatever they end up disconnecting and there are enough other sessions happening at the same time that the async task doesn't get processed until after their connection is invalidated | 18:27 |
| clarkb | at that point things are null and explode | 18:27 |
| *** ajmiller has joined #openstack-infra | 18:28 | |
| jeblair | clarkb: okay, if i were in your shoes, i don't think i would make a special effort for those two. but let me know if you are around and i'll patch in. | 18:28 |
| clarkb | jeblair: will do | 18:28 |
| lifeless | eglute: why does #openstack-defcore have mode t ? | 18:28 |
| clarkb | lifeless: if its statusbotted thats normal (see this channel) | 18:29 |
| purp | pleia2 eglute clark: all started because *I* wanted to be able to change topic. I think the answer you've given me is go beg one of the people on that list. I'll do that. | 18:29 |
| eglute | lifeless i have no idea. what does that mean? | 18:29 |
| lifeless | eglute: clark answerwed | 18:29 |
| purp | lifeless: I suspect it's a default setup. | 18:29 |
| lifeless | clarkb: will statusbot preserve the topic once purp edits it ? | 18:29 |
| lifeless | clarkb: or are we approaching this the wrong way? | 18:29 |
| *** mrmartin has joined #openstack-infra | 18:29 | |
| clarkb | lifeless: ya if it changes it the #status ok command is meant to set it back to the original | 18:30 |
| lifeless | ack | 18:30 |
| clarkb | lifeless: so you can manage your topic as wanted then any project wide statuses will be pushed and popped off the topic stack | 18:30 |
| *** gokrokve_ has quit IRC | 18:30 | |
| greghaynes | clarkb: have you found where they setup sessioninfos[client.id[? | 18:31 |
| *** ivar-lazzaro has quit IRC | 18:31 | |
| clarkb | greghaynes: for message.data.userInfo.colorId ? | 18:31 |
| *** ddieterly has quit IRC | 18:32 | |
| *** baoli has joined #openstack-infra | 18:32 | |
| greghaynes | clarkb: oh, interestingly, I see some if session.author guards in other methods | 18:32 |
| greghaynes | which supports your theory | 18:32 |
| *** julim has joined #openstack-infra | 18:32 | |
| greghaynes | clarkb: well, the issue is that session.author isnt set AIUI | 18:32 |
| clarkb | greghaynes: in the second traceback, that is correct | 18:33 |
| greghaynes | no, in the first trace | 18:33 |
| greghaynes | in http://paste.openstack.org/show/229557/ | 18:33 |
| greghaynes | its setting colorid of null, the only thing which has colorid set on it is an author | 18:34 |
| *** baoli has quit IRC | 18:34 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 18:34 | |
| *** hdd has joined #openstack-infra | 18:34 | |
| clarkb | greghaynes: right but we are failing to set it on author because the value from message.data.userInfo is null | 18:34 |
| clarkb | at least that was how I parsed it, since we get far enough along in that function to call setAuthorColorId | 18:35 |
| greghaynes | clarkb: oh? I read it as author is null, colorid may or may not be | 18:36 |
| clarkb | greghaynes: you may be write, the message says null has no colorId property we can set? | 18:36 |
| clarkb | er right :) | 18:37 |
| greghaynes | clarkb: yes | 18:37 |
| *** achanda has quit IRC | 18:37 | |
| *** yfried_ has quit IRC | 18:37 | |
| greghaynes | clarkb: and its pulling author out of sessioninfos | 18:37 |
| *** mrmartin has quit IRC | 18:37 | |
| greghaynes | clarkb: which I think might be server side state | 18:37 |
| *** yfried_ has joined #openstack-infra | 18:37 | |
| clarkb | ya it looks like a global var in that file | 18:37 |
| clarkb | and I see the guards you are talking about | 18:38 |
| greghaynes | clarkb: reguardless, we can put an if session.author around that method | 18:38 |
| *** amotoki has quit IRC | 18:38 | |
| greghaynes | clarkb: and should fix | 18:38 |
| clarkb | ya | 18:38 |
| *** mrmartin has joined #openstack-infra | 18:38 | |
| clarkb | I will prep patch that I can apply and others that know js can tell me if its wrong | 18:38 |
| greghaynes | clarkb: https://github.com/ether/etherpad-lite/blob/3944a0e79b21802aecf10457d9e44f1fc644a278/src/node/handler/PadMessageHandler.js#L127 | 18:38 |
| greghaynes | clarkb: notice that method has simlar guarding... | 18:38 |
| *** hdd has quit IRC | 18:39 | |
| *** Sukhdev has joined #openstack-infra | 18:39 | |
| clarkb | ya | 18:40 |
| *** dguerri is now known as dguerri`away | 18:42 | |
| clarkb | http://paste.openstack.org/show/229637/ if there are no glaring issues I will apply to the dev server and restart it | 18:42 |
| greghaynes | clarkb: LGTM, might be nice to put some extra debug, like print the message.data | 18:43 |
| clarkb | hrm probably need to check padId too? | 18:43 |
| greghaynes | clarkb: so we can try and really debug | 18:43 |
| clarkb | ya let me update | 18:43 |
| *** weshay has joined #openstack-infra | 18:43 | |
| *** jcoufal has quit IRC | 18:44 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 18:44 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: puppet: use a single image for CI https://review.openstack.org/177060 | 18:44 |
| Clint | clarkb: could you do the next one with git diff -w ? | 18:44 |
| *** soren has joined #openstack-infra | 18:45 | |
| Clint | nm | 18:45 |
| *** dims has joined #openstack-infra | 18:45 | |
| *** kgiusti has quit IRC | 18:45 | |
| clarkb | greghaynes: can you just + message.data and that will coerce the userInfo and other attributes into a string? | 18:46 |
| *** _nadya_ has joined #openstack-infra | 18:47 | |
| clarkb | meh start with userinfo go from there | 18:47 |
| clarkb | http://paste.openstack.org/show/229646/ | 18:48 |
| *** amotoki has joined #openstack-infra | 18:48 | |
| jeblair | clarkb: audio bridged | 18:48 |
| *** salv-orlando has joined #openstack-infra | 18:49 | |
| greghaynes | clarkb: yea | 18:50 |
| *** dmorita has quit IRC | 18:50 | |
| *** yolanda has quit IRC | 18:50 | |
| *** freerunner has quit IRC | 18:51 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 18:51 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 18:52 | |
| clarkb | puppet is disabled on etherpad-dev | 18:52 |
| asselin | anteaya, like to liberty etherpads for the summit working session? | 18:53 |
| *** mrmartin has quit IRC | 18:53 | |
| anteaya | asselin: https://wiki.openstack.org/wiki/Design_Summit/Liberty/Etherpads | 18:54 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 18:54 | |
| anteaya | thanks for the reminder, sorry I forgot | 18:55 |
| *** sputnik13 has joined #openstack-infra | 18:55 | |
| asselin | thanks | 18:55 |
| *** _nadya_ has quit IRC | 18:56 | |
| *** bknudson has joined #openstack-infra | 18:56 | |
| clarkb | greghaynes: Clint http://paste.openstack.org/show/229648/ that should be a much nicer diff | 18:57 |
| *** Nolafleur has joined #openstack-infra | 18:59 | |
| *** gokrokve_ has joined #openstack-infra | 18:59 | |
| *** tonytan4ever has quit IRC | 19:00 | |
| fungi | etherpad also looks like it might benefit from a bigger instance (lots of cpu time spent in system, cache memory pretty quickly consumes all available ram) | 19:01 |
| clarkb | https://etherpad-dev.openstack.org/p/clarkb-test | 19:01 |
| clarkb | -dev is running the latest diff above | 19:01 |
| clarkb | whether or not we want to apply clarkb hacky js to prod server during summit is another question :) | 19:01 |
| greghaynes | clarkb: well, its falling over already | 19:02 |
| clarkb | (I totally do not understand if there are other sideeffects here that we should be worried about making the restart safest) | 19:02 |
| greghaynes | actually | 19:02 |
| greghaynes | clarkb: do it during lunch | 19:02 |
| greghaynes | clarkb: lunch starts in about an hour | 19:02 |
| clarkb | well I won't be here after lunch so I am a bad one to do it | 19:02 |
| greghaynes | hah | 19:02 |
| clarkb | (also my diff is missing a trailing newline at EOF so you need to add that in order to make it work >_>) | 19:02 |
| *** gokrokve has quit IRC | 19:03 | |
| *** gokrokve_ has quit IRC | 19:04 | |
| *** dboik has quit IRC | 19:04 | |
| *** unicell1 has quit IRC | 19:04 | |
| *** dmorita has joined #openstack-infra | 19:05 | |
| *** ZZelle has quit IRC | 19:06 | |
| *** ayoung has joined #openstack-infra | 19:06 | |
| *** amotoki has quit IRC | 19:06 | |
| clarkb | we should also file upstream bug | 19:07 |
| clarkb | maybe with my patch along with it | 19:07 |
| *** ddieterly has joined #openstack-infra | 19:07 | |
| greghaynes | yea, if it works ;) | 19:07 |
| clarkb | it hasn't broken the dev server :) | 19:08 |
| greghaynes | oh, nice | 19:08 |
| clarkb | greghaynes: https://etherpad-dev.openstack.org/p/clarkb-test | 19:08 |
| *** mjturek1 has joined #openstack-infra | 19:08 | |
| greghaynes | clarkb: I think this is a race with creating and disconnecting quickly | 19:09 |
| greghaynes | clarkb: FWIW | 19:09 |
| cinerama | clarkb: i like your diff smiley but i prefer unified diffs so mine is +_+ | 19:09 |
| greghaynes | clarkb: if someone connects and disconnects before the event to set some state is fired the two events could get interweaved, for example | 19:10 |
| clarkb | greghaynes: ya I agree | 19:10 |
| clarkb | greghaynes: and the window where you get caught is wider when lots of connection are processed | 19:10 |
| greghaynes | ah, right | 19:10 |
| clarkb | so maybe we can just throw load generator at it then manually disconnect connect in a loop with some changes | 19:11 |
| *** gokrokve has joined #openstack-infra | 19:11 | |
| clarkb | cinerama: :) | 19:11 |
| *** jsavak has joined #openstack-infra | 19:11 | |
| *** ddieterly has quit IRC | 19:12 | |
| *** salv-orlando has quit IRC | 19:13 | |
| *** nolafleur_ has joined #openstack-infra | 19:13 | |
| *** unicell has joined #openstack-infra | 19:14 | |
| *** tonytan4ever has joined #openstack-infra | 19:14 | |
| asselin | anteaya, here's a start https://etherpad.openstack.org/p/YVR-infra-puppet-openstackci | 19:15 |
| *** _nadya_ has joined #openstack-infra | 19:15 | |
| *** dguerri`away is now known as dguerri | 19:15 | |
| *** gokrokve has quit IRC | 19:16 | |
| asselin | greghaynes, if not too busy could you fix minor issue here? I can also push the update if you like: https://review.openstack.org/#/c/177045/1 | 19:16 |
| *** soren has quit IRC | 19:18 | |
| anteaya | asselin: awesome beginning! | 19:18 |
| *** david-lyle has joined #openstack-infra | 19:18 | |
| *** salv-orlando has joined #openstack-infra | 19:18 | |
| anteaya | asselin: we need to load test this patched etherpad, can you join us on https://etherpad-dev.openstack.org/p/clarkb-test as ballast? | 19:18 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Stop setting compat=0.10 for qemu-img https://review.openstack.org/177045 | 19:19 |
| clarkb | anteaya: there is a tool we can use so don't need to recruit a bunch of people | 19:19 |
| clarkb | anteaya: but need to go find the tool and compile it and I won't have time before lunch and doctor visit | 19:19 |
| anteaya | clarkb: ah okay | 19:19 |
| anteaya | I hope the doctor visit goes well | 19:20 |
| greghaynes | well, load shouldnt be a factor here, the branch is just whether youre updating your color or name, etc | 19:20 |
| greghaynes | and we dont know how to replicate so *shrug* | 19:21 |
| *** panda has quit IRC | 19:21 | |
| clarkb | greghaynes: but I think load is how you make the window where disconnection affects that matter | 19:21 |
| clarkb | greghaynes: because otherwise its < HTTP RTT | 19:21 |
| greghaynes | yea, what im getting at is that the fix certainly wont make that case worse | 19:21 |
| greghaynes | since the unknown quantity is total explosion | 19:21 |
| *** panda has joined #openstack-infra | 19:21 | |
| clarkb | unless we break clients in a really subtle way where updating that info or dying is important | 19:22 |
| clarkb | its a very slim chance at being a problem though | 19:22 |
| clarkb | though it has other guards that it bails on so I am likely just over paranoid | 19:23 |
| greghaynes | Yea, I am having a hard time envisioning how we could make it worse with this | 19:23 |
| greghaynes | since this seems to be a deal where once a client gets in this state it keeps exploding | 19:24 |
| *** Nolafleur is now known as nolafleurita | 19:24 | |
| *** nolafleur_ is now known as nolafleur | 19:24 | |
| *** julim has quit IRC | 19:25 | |
| *** dims has quit IRC | 19:26 | |
| *** notnownikki has quit IRC | 19:26 | |
| *** nikeshm has joined #openstack-infra | 19:26 | |
| *** sputnik13 has quit IRC | 19:26 | |
| *** jraim has quit IRC | 19:26 | |
| jogo | clarkb: any ideas what this is from http://logs.openstack.org/periodic-qa/periodic-tempest-dsvm-full-non-isolated-master/dcdc24f/logs/devstack-gate-setup-workspace-new.txt.gz#_2015-05-20_06_06_57_100 | 19:26 |
| *** ajmiller has quit IRC | 19:26 | |
| *** jraim has joined #openstack-infra | 19:26 | |
| jogo | started a week or two ago causing all nightly jobs to fail | 19:26 |
| *** david-lyle has quit IRC | 19:27 | |
| openstackgerrit | Obulpathi proposed openstack-dev/openstack-nose: Fixes unicode formatting bug https://review.openstack.org/184594 | 19:27 |
| *** jaypipes has quit IRC | 19:27 | |
| fungi | clarkb: i think we can likely limp through today. it seems to have calmed down | 19:28 |
| clarkb | jogo: I think we may need to set the branch override as master in that job | 19:28 |
| *** ociuhandu has joined #openstack-infra | 19:28 | |
| clarkb | jogo: it likely started failing because ianw wrote a change for the tsfilter function to fial on script fails | 19:29 |
| clarkb | jogo: so we were failing before but getting by, now we are enforcing and failing properly | 19:29 |
| jogo | I think we call export BRANCH_OVERRIDE={branch-override} | 19:29 |
| clarkb | jogo: then likely just need to set the branch-override in JJB, if we do do that then I am completely wrng about why it fails | 19:30 |
| jogo | clarkb: hmm will pick up after lunch, at least a few jobs were passing 2 weeks ago as well | 19:30 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 19:31 | |
| clarkb | jogo: ya I think ianw's recent change is what made it fail | 19:31 |
| *** unicell has quit IRC | 19:31 | |
| clarkb | fungi: ok, well the code is there if needed and running on -dev so should be mostly safe | 19:32 |
| clarkb | I need to pop out now, but if someone can file a bug upstream its https://github.com/ether/etherpad-lite iirc that would be good | 19:32 |
| clarkb | (and can include my patch as a possible fix) | 19:32 |
| *** hdd has joined #openstack-infra | 19:33 | |
| *** rbradfor has quit IRC | 19:33 | |
| *** blahdeblah has joined #openstack-infra | 19:33 | |
| *** yamamoto has quit IRC | 19:33 | |
| *** jsavak has quit IRC | 19:34 | |
| *** salv-orlando has quit IRC | 19:34 | |
| *** weshay has quit IRC | 19:35 | |
| *** dkranz has quit IRC | 19:35 | |
| *** hdd has quit IRC | 19:35 | |
| *** ociuhandu has quit IRC | 19:35 | |
| openstackgerrit | Lukasz Jernas proposed openstack-infra/infra-specs: Translation check site spec https://review.openstack.org/184559 | 19:36 |
| *** tiswanso has quit IRC | 19:37 | |
| *** blahdeblah has quit IRC | 19:39 | |
| *** _nadya_ has quit IRC | 19:39 | |
| *** Sukhdev has quit IRC | 19:39 | |
| *** bknudson has quit IRC | 19:41 | |
| *** otter768 has joined #openstack-infra | 19:44 | |
| *** cody-somerville has quit IRC | 19:45 | |
| *** blahdeblah has joined #openstack-infra | 19:47 | |
| *** dims has joined #openstack-infra | 19:48 | |
| *** freerunner has joined #openstack-infra | 19:48 | |
| *** otter768 has quit IRC | 19:49 | |
| *** ayoung has quit IRC | 19:51 | |
| *** amotoki has joined #openstack-infra | 19:52 | |
| *** ZZelle has joined #openstack-infra | 19:54 | |
| *** jamielennox is now known as jamielennox|away | 19:56 | |
| *** nolafleurita has quit IRC | 19:57 | |
| *** mrunge has joined #openstack-infra | 19:58 | |
| nikeshm | asselin:thanks,i am using ubuntu 14.04 server virtual machine for jenkins master | 19:59 |
| nikeshm | Linux jenkins-master3 3.13.0-52-generic #86-Ubuntu SMP Mon May 4 04:32:59 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux | 19:59 |
| *** dims has quit IRC | 19:59 | |
| asselin | nikeshm, you got the image built? | 19:59 |
| nikeshm | asselin:no | 19:59 |
| nikeshm | asselin:DISTRIB_ID=Ubuntu | 20:00 |
| nikeshm | DISTRIB_RELEASE=14.04 | 20:00 |
| nikeshm | DISTRIB_CODENAME=trusty | 20:00 |
| nikeshm | DISTRIB_DESCRIPTION="Ubuntu 14.04.2 LTS" | 20:00 |
| nikeshm | these configuration should be fine | 20:00 |
| asselin | yes... | 20:00 |
| *** dmorita has quit IRC | 20:01 | |
| *** gokrokve has joined #openstack-infra | 20:02 | |
| nikeshm | asselin: after running this script i am getting error -----> cache-devstack/install.d/50-download-pkgs so like you said just commented out every thing and is waiting for result | 20:02 |
| *** amotoki has quit IRC | 20:04 | |
| *** asselin has quit IRC | 20:06 | |
| *** tiswanso has joined #openstack-infra | 20:13 | |
| *** amotoki has joined #openstack-infra | 20:14 | |
| *** amotoki has quit IRC | 20:14 | |
| *** nikeshm has quit IRC | 20:15 | |
| *** dannywilson has joined #openstack-infra | 20:17 | |
| *** ZZelle has quit IRC | 20:19 | |
| openstackgerrit | Terry Howe proposed openstack-infra/project-config: Enable Heat and Neutron for Python SDK gate https://review.openstack.org/184611 | 20:19 |
| *** dannywilson has quit IRC | 20:20 | |
| *** tim_o has quit IRC | 20:20 | |
| *** patrickeast has joined #openstack-infra | 20:23 | |
| *** tiswanso has quit IRC | 20:24 | |
| *** patrickeast has quit IRC | 20:24 | |
| *** amotoki has joined #openstack-infra | 20:24 | |
| *** yolanda has joined #openstack-infra | 20:25 | |
| *** _nadya_ has joined #openstack-infra | 20:27 | |
| *** dustins has quit IRC | 20:30 | |
| *** Longgeek has quit IRC | 20:30 | |
| *** koolhead17 has joined #openstack-infra | 20:30 | |
| *** gokrokve has quit IRC | 20:31 | |
| jeblair | clarkb, fungi, mordred: i am going to deploy the ep change into prod now | 20:31 |
| *** hdd has joined #openstack-infra | 20:32 | |
| jeblair | clarkb, fungi, mordred: done and restarted | 20:35 |
| *** ZZelle has joined #openstack-infra | 20:36 | |
| *** asselin_ has joined #openstack-infra | 20:36 | |
| *** rlandy has joined #openstack-infra | 20:38 | |
| *** dims has joined #openstack-infra | 20:38 | |
| *** dims has quit IRC | 20:38 | |
| *** dims has joined #openstack-infra | 20:39 | |
| *** dims has quit IRC | 20:39 | |
| *** dims has joined #openstack-infra | 20:39 | |
| *** harlowja has joined #openstack-infra | 20:39 | |
| *** mriedem has joined #openstack-infra | 20:40 | |
| jeblair | wow i can see the traffic picking up :) | 20:41 |
| *** bswartz has quit IRC | 20:41 | |
| *** ZZelle has quit IRC | 20:41 | |
| openstackgerrit | Merged openstack-dev/openstack-nose: Fixes unicode formatting bug https://review.openstack.org/184594 | 20:42 |
| *** david-lyle has joined #openstack-infra | 20:44 | |
| *** ZZelle has joined #openstack-infra | 20:45 | |
| *** asselin_ has quit IRC | 20:46 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 20:47 | |
| *** tbarron has joined #openstack-infra | 20:47 | |
| pabelanger | timrc, are you around the summit today? Wouldn't mind syncing up to take grafana | 20:47 |
| pabelanger | talk* | 20:47 |
| *** dmorita has joined #openstack-infra | 20:48 | |
| *** amotoki has quit IRC | 20:49 | |
| *** unicell has joined #openstack-infra | 20:49 | |
| *** ajmiller has joined #openstack-infra | 20:49 | |
| *** patrickeast has joined #openstack-infra | 20:50 | |
| *** jamielennox|away is now known as jamielennox | 20:50 | |
| nibz | i have some example graph queries to give yall some data points pabelanger timrc | 20:51 |
| *** asselin has joined #openstack-infra | 20:51 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for (fixed) pbr bug 1456663 https://review.openstack.org/184618 | 20:51 |
| openstack | bug 1456663 in PBR "AttributeError: pre_run in py26, py27 and py34 jobs " [Critical,Fix released] https://launchpad.net/bugs/1456663 - Assigned to Ilya Shakhat (shakhat) | 20:51 |
| pabelanger | nibz, Ya, I think there are a fair bit of people interested, would be keen to get ppl together to see what that looks like | 20:52 |
| *** tiswanso has joined #openstack-infra | 20:52 | |
| *** _nadya_ has quit IRC | 20:52 | |
| *** salv-orlando has joined #openstack-infra | 20:53 | |
| *** patrickeast has quit IRC | 20:53 | |
| *** ddieterly has joined #openstack-infra | 20:54 | |
| *** amotoki has joined #openstack-infra | 20:54 | |
| *** ddieterly has quit IRC | 20:55 | |
| *** yolanda has quit IRC | 20:56 | |
| jogo | clarkb: link to patch, or idea on how to fix? | 20:57 |
| clarkb | idea to fix is to set the branch override | 20:58 |
| openstackgerrit | Terry Howe proposed openstack-infra/project-config: Python SDK make functional tests a non voting gate https://review.openstack.org/184621 | 20:58 |
| *** sputnik13 has joined #openstack-infra | 20:58 | |
| *** weshay has joined #openstack-infra | 21:00 | |
| clarkb | I dont have ianw's change handy right now on a phone | 21:01 |
| *** nikeshm has joined #openstack-infra | 21:01 | |
| *** salv-orlando has quit IRC | 21:01 | |
| anteaya | nikeshm: please use paste.openstack.org for pasting code rather than pasting into the channel | 21:02 |
| *** mattfarina has quit IRC | 21:02 | |
| nikeshm | anteaya : sure | 21:02 |
| anteaya | nikeshm: thank you | 21:02 |
| *** bswartz has joined #openstack-infra | 21:02 | |
| *** ihrachyshka has joined #openstack-infra | 21:04 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for (fixed) pbr bug 1456663 https://review.openstack.org/184618 | 21:04 |
| openstack | bug 1456663 in PBR "AttributeError: pre_run in py26, py27 and py34 jobs " [Critical,Fix released] https://launchpad.net/bugs/1456663 - Assigned to Ilya Shakhat (shakhat) | 21:04 |
| *** freerunner has quit IRC | 21:06 | |
| *** ddieterly has joined #openstack-infra | 21:09 | |
| *** yolanda has joined #openstack-infra | 21:11 | |
| *** jkt has quit IRC | 21:13 | |
| *** ddieterly has quit IRC | 21:13 | |
| *** ldnunes has quit IRC | 21:14 | |
| *** jkt has joined #openstack-infra | 21:15 | |
| nikeshm | asselin: this is currently breaking nodepool image-build dpc command http://paste.openstack.org/show/229744/ | 21:15 |
| jeblair | tchaypo: sorry, missed yoru q before -- view/change_list.py | 21:15 |
| *** abregman has quit IRC | 21:15 | |
| nikeshm | did any one else this type of issue | 21:15 |
| jeblair | tchaypo: what do you want to change? | 21:15 |
| *** rlandy has quit IRC | 21:16 | |
| *** boris-42 has joined #openstack-infra | 21:16 | |
| asselin | nikeshm, in a xen ci meeting now....you're not here? | 21:17 |
| nikeshm | no | 21:17 |
| jeblair | we've matched our previous max established tcp sessions on etherpad | 21:17 |
| *** dboik has joined #openstack-infra | 21:18 | |
| nikeshm | asselin: i am in market-place,i am trying to debug as much as possible,whenevr yu have some time,please meet in market place | 21:18 |
| asselin | nikeshm, you should come and learn about other peoples experience | 21:19 |
| openstackgerrit | Steve Kowalik proposed openstack-infra/project-config: Move git config to a common function/file https://review.openstack.org/184623 | 21:20 |
| anteaya | nikeshm: please listen to asselin | 21:20 |
| *** ParsectiX has joined #openstack-infra | 21:20 | |
| *** mrunge has quit IRC | 21:20 | |
| nikeshm | asselin: sure where is this meeting | 21:23 |
| *** jkt has quit IRC | 21:23 | |
| asselin | nikeshm, https://libertydesignsummit.sched.org/event/454bd293910d345dc9fe6f3b438f2bbc#.VVz7ePlVhBc | 21:24 |
| *** unicell has quit IRC | 21:24 | |
| *** weshay has quit IRC | 21:24 | |
| *** harlowja has quit IRC | 21:24 | |
| *** dims has quit IRC | 21:24 | |
| *** dmorita has quit IRC | 21:24 | |
| *** hdd has quit IRC | 21:24 | |
| *** david-lyle has quit IRC | 21:24 | |
| *** nikeshm has quit IRC | 21:24 | |
| *** asselin has quit IRC | 21:24 | |
| *** amotoki has quit IRC | 21:24 | |
| *** mriedem has quit IRC | 21:24 | |
| openstackgerrit | Steve Kowalik proposed openstack-infra/project-config: Don't use set +e to check the return value https://review.openstack.org/184627 | 21:24 |
| *** puranamr has quit IRC | 21:25 | |
| anteaya | jeblair: why were nikeshm and asselin k-lined? | 21:26 |
| anteaya | why is sharing a link grounds for k-lining? | 21:26 |
| StevenK | anteaya: They're the same IP, for one. | 21:26 |
| anteaya | StevenK: wow, that is odd | 21:27 |
| *** hodos has joined #openstack-infra | 21:27 | |
| timrc | pabelanger, Hi hi. I am around. | 21:27 |
| timrc | pabelanger, Well I came back to my hotel quickly since I missed the session I was wanting to go to, but I'll be heading back shortly. | 21:27 |
| *** dboik has quit IRC | 21:29 | |
| *** ddieterly has joined #openstack-infra | 21:30 | |
| *** unicell has joined #openstack-infra | 21:30 | |
| pabelanger | timrc, okay. pabelanger@gmail.com is sync'd to phone for google talk | 21:30 |
| *** puranamr has joined #openstack-infra | 21:30 | |
| *** ajmiller has quit IRC | 21:31 | |
| *** harlowja has joined #openstack-infra | 21:32 | |
| timrc | pabelanger, Okay. timrchavez@gmail.com here. I'll shall be back in about a half hour. There is nothing I'm super excited about that I have to be at, so did you want to meet at say 3:15 near the bloomerg lounge or we can go somewhere more quiet in East Convention center if you'd prefer. | 21:34 |
| *** puranamr_ has joined #openstack-infra | 21:34 | |
| timrc | I shall* | 21:34 |
| *** sputnik13 has quit IRC | 21:34 | |
| *** salv-orlando has joined #openstack-infra | 21:34 | |
| *** tiswanso has quit IRC | 21:35 | |
| openstackgerrit | James Polley proposed stackforge/gertty: Tell flake8 to ignore bin/ and lib/ https://review.openstack.org/184630 | 21:37 |
| *** tiswanso has joined #openstack-infra | 21:37 | |
| *** ihrachyshka has quit IRC | 21:38 | |
| *** dkranz has joined #openstack-infra | 21:38 | |
| *** puranamr has quit IRC | 21:38 | |
| *** cody-somerville has joined #openstack-infra | 21:39 | |
| *** sputnik13 has joined #openstack-infra | 21:40 | |
| *** ashleighfarnham has joined #openstack-infra | 21:42 | |
| *** unicell has quit IRC | 21:42 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 21:43 | |
| *** dkranz has quit IRC | 21:43 | |
| *** jamielennox is now known as jamielennox|away | 21:43 | |
| *** dkranz has joined #openstack-infra | 21:44 | |
| *** salv-orlando has quit IRC | 21:44 | |
| *** otter768 has joined #openstack-infra | 21:45 | |
| *** otter768 has quit IRC | 21:50 | |
| anteaya | so far I haven't seen etherpad reconnect | 21:50 |
| anteaya | since clarkb's fix went into production | 21:51 |
| *** dkehn_ has joined #openstack-infra | 21:51 | |
| cinerama | same, much appreciated clarkb | 21:51 |
| flip214 | anyone in YVR with some time to answer CI questions, please? | 21:52 |
| *** dkehn_ is now known as dkehnx | 21:53 | |
| *** amotoki has joined #openstack-infra | 21:55 | |
| *** yamamoto has joined #openstack-infra | 21:55 | |
| *** nikeshm has joined #openstack-infra | 21:55 | |
| *** weshay has joined #openstack-infra | 21:55 | |
| *** sarob has joined #openstack-infra | 21:55 | |
| *** ivar-lazzaro has joined #openstack-infra | 21:55 | |
| *** stevemar has joined #openstack-infra | 21:55 | |
| *** baoli has joined #openstack-infra | 21:55 | |
| *** jsavak has joined #openstack-infra | 21:55 | |
| *** dims has joined #openstack-infra | 21:55 | |
| *** Sukhdev has joined #openstack-infra | 21:56 | |
| *** dboik has joined #openstack-infra | 21:56 | |
| *** Sree_ has joined #openstack-infra | 21:56 | |
| jeblair | anteaya: yep, server has not reported restarting, we've passed peak load for the most recent session | 21:56 |
| *** Sree_ is now known as Guest46471 | 21:57 | |
| *** stevemar has quit IRC | 21:57 | |
| anteaya | jeblair: yay! | 21:57 |
| anteaya | flip214: summit for us is a time to be in sessions planning the next 6 months of work | 21:58 |
| anteaya | flip214: infra is particualrly busy during summit as we all have to be in different rooms to provide guidance and support to other projects | 21:58 |
| *** jamielennox|away is now known as jamielennox | 21:59 | |
| anteaya | flip214: we don't have time for answering questions of the nature you are asking about, posting questions to channel is the recommended way forward, we will do our best | 21:59 |
| *** rbradfor has joined #openstack-infra | 22:00 | |
| *** nikeshm has quit IRC | 22:00 | |
| *** unicell has joined #openstack-infra | 22:02 | |
| fungi | 1.5 hours since the last etherpad restart, so looking good | 22:02 |
| anteaya | fungi: \o/ | 22:03 |
| *** Kennan_2 has joined #openstack-infra | 22:03 | |
| *** Kennan_ has quit IRC | 22:03 | |
| *** freerunner has joined #openstack-infra | 22:04 | |
| anteaya | reconnecting | 22:05 |
| anteaya | and again | 22:05 |
| anteaya | 503 | 22:06 |
| cinerama | :( | 22:06 |
| anteaya | back up | 22:06 |
| jeblair | ep itself did not restart | 22:08 |
| jeblair | anteaya: if you have an error code, paste it please | 22:08 |
| anteaya | I had a 503 service unavailable, that was all I got for an error | 22:09 |
| jeblair | ok | 22:09 |
| *** unicell has quit IRC | 22:09 | |
| anteaya | refresh got the etherpad back which is up and working now | 22:09 |
| *** yamamoto has quit IRC | 22:09 | |
| *** salv-orlando has joined #openstack-infra | 22:09 | |
| *** ivar-lazzaro has quit IRC | 22:10 | |
| *** nikeshm has joined #openstack-infra | 22:10 | |
| *** Guest46471 has quit IRC | 22:11 | |
| *** nelsnelson has quit IRC | 22:11 | |
| *** baoli has quit IRC | 22:12 | |
| *** chlong has quit IRC | 22:12 | |
| *** baoli has joined #openstack-infra | 22:12 | |
| anteaya | this is my etherpad of the moment if that is helpful: https://etherpad.openstack.org/p/YVR-QA-Tempest-service-clients | 22:13 |
| *** Sukhdev has quit IRC | 22:14 | |
| *** jsavak has quit IRC | 22:14 | |
| *** rbradfor has quit IRC | 22:14 | |
| *** dims has quit IRC | 22:14 | |
| *** amotoki has quit IRC | 22:14 | |
| *** weshay has quit IRC | 22:14 | |
| *** nikeshm has quit IRC | 22:14 | |
| *** sarob has quit IRC | 22:14 | |
| *** salv-orlando has quit IRC | 22:14 | |
| *** salv-orlando has joined #openstack-infra | 22:17 | |
| *** salv-orlando has quit IRC | 22:17 | |
| fungi | for those not following the i18n ml, the start of a horizon demo spec has been proposed at https://review.openstack.org/184559 | 22:18 |
| tchaypo | jeblair: You know the big stack of dependent things that ends in 183887? I have 180546 marked as reviewed - which means that (unless i manually turn on viewing of reviewed reviews) 183887 wanders off and sits down the bottom of the list and doesn’t appear related | 22:19 |
| *** freerunner has quit IRC | 22:19 | |
| tchaypo | I’d like to not break those links, I’d like 183887 to still show with its friends | 22:19 |
| *** ayoung has joined #openstack-infra | 22:19 | |
| *** asselin_ has joined #openstack-infra | 22:20 | |
| *** sputnik13 has quit IRC | 22:20 | |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Update delorean URL https://review.openstack.org/184640 | 22:21 |
| jeblair | tchaypo: oh yeah, i'd love that too, but when i last looked it was really hard for some reason i can't think of right now -- i think the problem is that there isn't a way to make the transitive connection from change C-A if B isn't in the search result list that gertty is working with | 22:21 |
| tchaypo | Yep. I was guessing that the filtering is done first and then the links are found | 22:23 |
| *** dkranz has quit IRC | 22:24 | |
| *** baoli has quit IRC | 22:24 | |
| *** salv-orl_ has joined #openstack-infra | 22:24 | |
| *** dboik has quit IRC | 22:24 | |
| *** baoli has joined #openstack-infra | 22:25 | |
| *** unicell has joined #openstack-infra | 22:25 | |
| *** samuelBartel has joined #openstack-infra | 22:25 | |
| *** dboik has joined #openstack-infra | 22:25 | |
| *** ayoung has quit IRC | 22:27 | |
| *** dimtruck is now known as zz_dimtruck | 22:28 | |
| *** mjturek1 has quit IRC | 22:29 | |
| *** dboik has quit IRC | 22:29 | |
| *** rossella_s has joined #openstack-infra | 22:29 | |
| *** dboik has joined #openstack-infra | 22:29 | |
| *** harlowja has quit IRC | 22:29 | |
| *** harlowja has joined #openstack-infra | 22:30 | |
| *** jamielennox is now known as jamielennox|away | 22:31 | |
| *** tiswanso has quit IRC | 22:32 | |
| *** cody-somerville has quit IRC | 22:32 | |
| *** aysyanne has quit IRC | 22:32 | |
| openstackgerrit | Steve Kowalik proposed openstack-infra/project-config: Don't repeat the commit message https://review.openstack.org/184641 | 22:32 |
| *** peristeri has quit IRC | 22:34 | |
| *** ihrachyshka has joined #openstack-infra | 22:34 | |
| *** ivar-lazzaro has joined #openstack-infra | 22:35 | |
| *** ddieterly has quit IRC | 22:36 | |
| anteaya | jeblair: what room are you in right now? | 22:37 |
| *** ddieterly has joined #openstack-infra | 22:37 | |
| jeblair | anteaya: 2nd floor deck | 22:40 |
| anteaya | I am coming to you | 22:40 |
| *** ddieterly has quit IRC | 22:42 | |
| *** ashleighfarnham has quit IRC | 22:43 | |
| *** weshay has joined #openstack-infra | 22:44 | |
| *** jsavak has joined #openstack-infra | 22:44 | |
| *** asselin has joined #openstack-infra | 22:45 | |
| *** yamamoto has joined #openstack-infra | 22:45 | |
| *** amotoki has joined #openstack-infra | 22:45 | |
| *** david-lyle has joined #openstack-infra | 22:45 | |
| *** nikeshm has joined #openstack-infra | 22:45 | |
| *** Sukhdev has joined #openstack-infra | 22:45 | |
| *** sarob has joined #openstack-infra | 22:45 | |
| *** ZZelle has quit IRC | 22:46 | |
| *** pelix has quit IRC | 22:49 | |
| *** tiswanso has joined #openstack-infra | 22:49 | |
| *** baoli has quit IRC | 22:50 | |
| *** Sree_ has joined #openstack-infra | 22:51 | |
| *** Sree_ is now known as Guest3721 | 22:52 | |
| *** sarob has quit IRC | 22:53 | |
| *** yamamoto has quit IRC | 22:53 | |
| *** simonmcc has quit IRC | 22:53 | |
| *** smccully has quit IRC | 22:53 | |
| *** rossella_s has quit IRC | 22:54 | |
| *** simonmcc has joined #openstack-infra | 22:54 | |
| *** ayoung has joined #openstack-infra | 22:54 | |
| *** ParsectiX has quit IRC | 22:54 | |
| *** ParsectiX has joined #openstack-infra | 22:55 | |
| *** salv-orl_ has quit IRC | 22:56 | |
| *** ihrachyshka has quit IRC | 22:58 | |
| *** Sukhdev has quit IRC | 22:59 | |
| *** baoli has joined #openstack-infra | 23:01 | |
| *** koolhead17 has quit IRC | 23:01 | |
| *** e0ne has joined #openstack-infra | 23:04 | |
| *** dboik has quit IRC | 23:05 | |
| *** yamamoto has joined #openstack-infra | 23:07 | |
| *** smccully has joined #openstack-infra | 23:09 | |
| *** hdd has joined #openstack-infra | 23:09 | |
| *** unicell has quit IRC | 23:10 | |
| *** jsavak has quit IRC | 23:10 | |
| openstackgerrit | Akihiro Motoki proposed openstack-dev/pbr: Make setup.py --help-commands work without testrepository https://review.openstack.org/124652 | 23:10 |
| *** hdd has quit IRC | 23:11 | |
| *** dboik has joined #openstack-infra | 23:11 | |
| *** david-lyle has quit IRC | 23:13 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Migration of resource server https://review.openstack.org/178854 | 23:14 |
| *** tiswanso has quit IRC | 23:14 | |
| *** e0ne has quit IRC | 23:15 | |
| *** jaypipes has joined #openstack-infra | 23:15 | |
| *** Sukhdev has joined #openstack-infra | 23:15 | |
| *** Guest3721 has quit IRC | 23:16 | |
| *** jaypipes has quit IRC | 23:16 | |
| *** ayoung has quit IRC | 23:16 | |
| *** unicell has joined #openstack-infra | 23:16 | |
| *** juggler has joined #openstack-infra | 23:17 | |
| *** samuelBartel has quit IRC | 23:17 | |
| *** harlowja has quit IRC | 23:18 | |
| *** dboik has quit IRC | 23:18 | |
| *** yamamoto has quit IRC | 23:18 | |
| *** juggler_ has quit IRC | 23:18 | |
| clarkb | jeblair: I am back in time for 1630 session if you are still going | 23:18 |
| *** asselin has quit IRC | 23:18 | |
| *** hdd has joined #openstack-infra | 23:19 | |
| *** ddieterly has joined #openstack-infra | 23:20 | |
| *** panda has quit IRC | 23:21 | |
| *** panda has joined #openstack-infra | 23:22 | |
| *** yamamoto has joined #openstack-infra | 23:23 | |
| jeblair | clarkb: connected | 23:23 |
| *** kgiusti has joined #openstack-infra | 23:23 | |
| *** bhunter71 has joined #openstack-infra | 23:23 | |
| *** Kennan_2 is now known as Kennan | 23:24 | |
| clarkb | jeblair: I am on thanks | 23:25 |
| *** dboik has joined #openstack-infra | 23:25 | |
| *** ddieterly has quit IRC | 23:25 | |
| *** patrickeast has joined #openstack-infra | 23:25 | |
| *** patrickeast has quit IRC | 23:26 | |
| *** patrickeast has joined #openstack-infra | 23:26 | |
| *** blahdeblah has left #openstack-infra | 23:26 | |
| *** unicell1 has joined #openstack-infra | 23:26 | |
| *** Sree_ has joined #openstack-infra | 23:27 | |
| *** Sree_ is now known as Guest64315 | 23:27 | |
| *** unicell has quit IRC | 23:28 | |
| *** ParsectiX has quit IRC | 23:28 | |
| *** asselin_ has quit IRC | 23:29 | |
| *** nibz is now known as nibalizer | 23:29 | |
| *** sarob has joined #openstack-infra | 23:30 | |
| *** unicell has joined #openstack-infra | 23:30 | |
| *** jkt has joined #openstack-infra | 23:31 | |
| *** unicell1 has quit IRC | 23:31 | |
| *** ashleighfarnham has joined #openstack-infra | 23:31 | |
| *** dmorita has joined #openstack-infra | 23:32 | |
| *** samuelBartel has joined #openstack-infra | 23:33 | |
| *** freerunner has joined #openstack-infra | 23:33 | |
| nikeshm | patrickeast:hi | 23:34 |
| *** chlong has joined #openstack-infra | 23:34 | |
| *** dboik has quit IRC | 23:34 | |
| patrickeast | nikeshm: hey | 23:34 |
| *** jsavak has joined #openstack-infra | 23:34 | |
| nikeshm | i want to add 'export NODEPOOL_STATIC_NAMESERVER' in my ost-ext-testing-data | 23:35 |
| *** sarob has quit IRC | 23:35 | |
| nikeshm | where can i add | 23:35 |
| nikeshm | also DIB_OFFLINE=True | 23:35 |
| *** ayoung has joined #openstack-infra | 23:36 | |
| clarkb | you can set env vars inside the nodepool.yaml on a per image basis, or you can set those up with a nodepool defaults env file soured by your init script | 23:36 |
| *** jsavak has quit IRC | 23:36 | |
| *** jsavak has joined #openstack-infra | 23:37 | |
| nikeshm | patrickeast: i think i can add here os-ext-testing-data/etc/nodepool/nodepool.yaml.erb but not clear about syntax | 23:38 |
| *** dannywilson has joined #openstack-infra | 23:39 | |
| *** Guest64315 has quit IRC | 23:40 | |
| patrickeast | nikeshm: it looks like there are examples for env vars syntax for DIB here http://docs.openstack.org/infra/nodepool/configuration.html#diskimages | 23:41 |
| patrickeast | i haven’t tried it yet, so i probably wont be much help on the syntax | 23:41 |
| *** sarob has joined #openstack-infra | 23:42 | |
| nikeshm | patrickeast: how you generally setup environment varaible for nodepool | 23:43 |
| nikeshm | manually? | 23:43 |
| *** wenlock has quit IRC | 23:44 | |
| *** e0ne has joined #openstack-infra | 23:44 | |
| nikeshm | patrickeast : thanks | 23:45 |
| *** ctracey has quit IRC | 23:45 | |
| nikeshm | i will try and let yu know | 23:45 |
| *** ctracey has joined #openstack-infra | 23:45 | |
| *** otter768 has joined #openstack-infra | 23:46 | |
| *** freerunner has quit IRC | 23:48 | |
| *** asselin has joined #openstack-infra | 23:48 | |
| *** hodos has quit IRC | 23:48 | |
| patrickeast | nikeshm: we only use the ‘default’ ones that are coded into ramy’s scripts, they come from here: https://github.com/rasselin/os-ext-testing/blob/master/puppet/modules/os_ext_testing/templates/nodepool/set_nodepool_env.sh.erb which get automatically set in the environment when installed into profile.d https://github.com/rasselin/os-ext-testing/blob/master/puppet/modules/os_ext_testing/manifests/master.pp#L31 | 23:49 |
| patrickeast | nikeshm: so far I haven’t needed to add any additional ones | 23:49 |
| *** patrickeast has quit IRC | 23:51 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/puppet-elasticsearch: Add a cluster name option https://review.openstack.org/184649 | 23:51 |
| *** otter768 has quit IRC | 23:51 | |
| *** rbradfor has joined #openstack-infra | 23:54 | |
| *** asselin has quit IRC | 23:55 | |
| *** asselin_ has joined #openstack-infra | 23:57 | |
| *** samuelBartel has quit IRC | 23:57 | |
| *** jamespage_ has joined #openstack-infra | 23:57 | |
| anteaya | mordred: are you planning on attending the neutron 'get me a network' session in rm 221 at 5:20pm? | 23:58 |
| *** nikeshm has quit IRC | 23:58 | |
| *** ramyasselin has joined #openstack-infra | 23:58 | |
| *** Kennan has quit IRC | 23:59 | |
| ramyasselin | jeblair, having issues connecting on free node w/ name 'asselin | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!