*** andreww has joined #openstack-infra | 00:00 | |
*** xarses_ has quit IRC | 00:03 | |
*** lukebrowning has joined #openstack-infra | 00:19 | |
*** lukebrowning has quit IRC | 00:23 | |
*** lukebrowning has joined #openstack-infra | 00:26 | |
*** markvoelker has joined #openstack-infra | 00:27 | |
openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Slack driver https://review.openstack.org/530521 | 00:29 |
---|---|---|
*** lukebrowning has quit IRC | 00:31 | |
*** markvoelker has quit IRC | 00:31 | |
*** lukebrowning has joined #openstack-infra | 00:33 | |
openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Slack driver https://review.openstack.org/530521 | 00:36 |
*** lukebrowning has quit IRC | 00:38 | |
*** lukebrowning has joined #openstack-infra | 00:39 | |
*** zhurong has joined #openstack-infra | 00:43 | |
*** lukebrowning has quit IRC | 00:44 | |
*** lukebrowning has joined #openstack-infra | 00:45 | |
*** lukebrowning has quit IRC | 00:50 | |
*** lukebrowning has joined #openstack-infra | 00:52 | |
*** lukebrowning has quit IRC | 00:57 | |
*** lukebrowning has joined #openstack-infra | 00:58 | |
*** namnh has joined #openstack-infra | 01:03 | |
*** lukebrowning has quit IRC | 01:03 | |
*** kiennt26 has joined #openstack-infra | 01:08 | |
*** lukebrowning has joined #openstack-infra | 01:09 | |
*** lukebrowning_ has joined #openstack-infra | 01:13 | |
*** daidv has joined #openstack-infra | 01:13 | |
*** lukebrowning has quit IRC | 01:13 | |
*** cuongnv has joined #openstack-infra | 01:15 | |
*** heyongli has joined #openstack-infra | 01:17 | |
*** lukebrowning_ has quit IRC | 01:20 | |
*** ijw has quit IRC | 01:21 | |
*** kiennt26 has quit IRC | 01:21 | |
*** lukebrowning has joined #openstack-infra | 01:22 | |
*** cshastri has joined #openstack-infra | 01:23 | |
*** lukebrowning has quit IRC | 01:26 | |
*** heyongli has quit IRC | 01:27 | |
*** heyongli has joined #openstack-infra | 01:27 | |
*** markvoelker has joined #openstack-infra | 01:28 | |
*** xinliang has joined #openstack-infra | 01:29 | |
*** markvoelker has quit IRC | 01:32 | |
*** lukebrowning has joined #openstack-infra | 01:33 | |
*** numans has quit IRC | 01:35 | |
*** heyongli has quit IRC | 01:37 | |
*** numans has joined #openstack-infra | 01:37 | |
*** heyongli has joined #openstack-infra | 01:37 | |
*** lukebrowning has quit IRC | 01:37 | |
*** lukebrowning has joined #openstack-infra | 01:39 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: negative test https://review.openstack.org/522438 | 01:43 |
*** lukebrowning has quit IRC | 01:44 | |
*** niska has quit IRC | 01:45 | |
*** heyongli has quit IRC | 01:47 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: negative test https://review.openstack.org/522438 | 01:47 |
*** heyongli has joined #openstack-infra | 01:47 | |
*** niska has joined #openstack-infra | 01:50 | |
*** lukebrowning has joined #openstack-infra | 01:52 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: unittests: make bindep role optional https://review.openstack.org/522255 | 01:54 |
*** lukebrowning has quit IRC | 01:57 | |
*** heyongli has quit IRC | 01:57 | |
*** heyongli has joined #openstack-infra | 01:58 | |
*** chrisyang_0660 has joined #openstack-infra | 02:06 | |
*** gcb has joined #openstack-infra | 02:06 | |
*** heyongli has quit IRC | 02:08 | |
*** heyongli has joined #openstack-infra | 02:08 | |
*** zhenguo has joined #openstack-infra | 02:14 | |
*** heyongli has quit IRC | 02:18 | |
*** heyongli has joined #openstack-infra | 02:18 | |
*** ijw has joined #openstack-infra | 02:21 | |
*** pbourke_ has quit IRC | 02:22 | |
*** lukebrowning has joined #openstack-infra | 02:22 | |
*** pbourke_ has joined #openstack-infra | 02:24 | |
*** ijw has quit IRC | 02:27 | |
*** lukebrowning has quit IRC | 02:27 | |
*** heyongli has quit IRC | 02:28 | |
*** heyongli has joined #openstack-infra | 02:28 | |
*** lukebrowning has joined #openstack-infra | 02:34 | |
*** liujiong has joined #openstack-infra | 02:38 | |
*** heyongli has quit IRC | 02:38 | |
*** heyongli has joined #openstack-infra | 02:39 | |
*** lukebrowning has quit IRC | 02:42 | |
*** lukebrowning has joined #openstack-infra | 02:43 | |
*** edmondsw has joined #openstack-infra | 02:45 | |
*** lukebrowning has quit IRC | 02:48 | |
*** heyongli has quit IRC | 02:49 | |
*** heyongli has joined #openstack-infra | 02:49 | |
*** lukebrowning has joined #openstack-infra | 02:50 | |
*** kiennt26 has joined #openstack-infra | 02:51 | |
*** lukebrowning has quit IRC | 02:54 | |
*** ijw has joined #openstack-infra | 02:59 | |
*** heyongli has quit IRC | 02:59 | |
*** heyongli has joined #openstack-infra | 02:59 | |
*** lukebrowning has joined #openstack-infra | 03:00 | |
*** liujiong has quit IRC | 03:00 | |
*** liujiong has joined #openstack-infra | 03:01 | |
*** edmondsw has quit IRC | 03:03 | |
*** lukebrowning has quit IRC | 03:05 | |
*** bobh has joined #openstack-infra | 03:05 | |
*** edmondsw has joined #openstack-infra | 03:05 | |
*** edmondsw has quit IRC | 03:06 | |
*** bobh has quit IRC | 03:06 | |
*** heyongli has quit IRC | 03:09 | |
*** heyongli has joined #openstack-infra | 03:09 | |
*** annp has joined #openstack-infra | 03:14 | |
*** liujiong has quit IRC | 03:17 | |
*** liujiong has joined #openstack-infra | 03:18 | |
*** heyongli has quit IRC | 03:19 | |
*** heyongli has joined #openstack-infra | 03:20 | |
*** yamamoto has quit IRC | 03:27 | |
*** markvoelker has joined #openstack-infra | 03:29 | |
*** heyongli has quit IRC | 03:30 | |
*** heyongli has joined #openstack-infra | 03:30 | |
*** xarses has joined #openstack-infra | 03:32 | |
*** andreww has quit IRC | 03:33 | |
*** links has joined #openstack-infra | 03:34 | |
*** markvoelker has quit IRC | 03:34 | |
*** ijw has quit IRC | 03:38 | |
*** lukebrowning has joined #openstack-infra | 03:39 | |
*** heyongli has quit IRC | 03:40 | |
*** heyongli has joined #openstack-infra | 03:40 | |
*** lukebrowning has quit IRC | 03:44 | |
jbryce | frickler, clarkb We've sent it to our trademark lawyer to advise if it's a real thing or not. Thanks for the heads up! | 03:44 |
*** lukebrowning has joined #openstack-infra | 03:45 | |
*** lukebrowning has quit IRC | 03:50 | |
*** heyongli has quit IRC | 03:50 | |
*** heyongli has joined #openstack-infra | 03:50 | |
*** dave-mccowan has quit IRC | 03:51 | |
*** lukebrowning has joined #openstack-infra | 03:52 | |
*** coolsvap has joined #openstack-infra | 03:53 | |
*** lukebrowning has quit IRC | 03:56 | |
*** lukebrowning has joined #openstack-infra | 03:58 | |
*** heyongli has quit IRC | 04:00 | |
*** heyongli has joined #openstack-infra | 04:01 | |
*** yamamoto has joined #openstack-infra | 04:01 | |
*** lukebrowning has quit IRC | 04:03 | |
*** lukebrowning has joined #openstack-infra | 04:04 | |
*** ramishra has joined #openstack-infra | 04:08 | |
*** lukebrowning has quit IRC | 04:09 | |
*** heyongli has quit IRC | 04:11 | |
*** lukebrowning has joined #openstack-infra | 04:11 | |
*** heyongli has joined #openstack-infra | 04:11 | |
*** vivsoni has quit IRC | 04:11 | |
*** lukebrowning has quit IRC | 04:16 | |
*** lukebrowning has joined #openstack-infra | 04:17 | |
*** yamamoto has quit IRC | 04:17 | |
*** heyongli has quit IRC | 04:21 | |
*** heyongli has joined #openstack-infra | 04:21 | |
*** lukebrowning has quit IRC | 04:22 | |
*** vivsoni has joined #openstack-infra | 04:23 | |
*** markvoelker has joined #openstack-infra | 04:30 | |
*** heyongli has quit IRC | 04:31 | |
*** heyongli has joined #openstack-infra | 04:31 | |
*** markvoelker has quit IRC | 04:35 | |
*** edmondsw has joined #openstack-infra | 04:35 | |
*** yamamoto has joined #openstack-infra | 04:36 | |
*** nicolasbock has quit IRC | 04:38 | |
*** ijw has joined #openstack-infra | 04:39 | |
*** edmondsw has quit IRC | 04:40 | |
*** yamamoto has quit IRC | 04:41 | |
*** heyongli has quit IRC | 04:41 | |
*** heyongli has joined #openstack-infra | 04:42 | |
*** ykarel has joined #openstack-infra | 04:42 | |
*** udesale has joined #openstack-infra | 04:43 | |
*** lukebrowning has joined #openstack-infra | 04:49 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: Add buildset-artifacts-location role https://review.openstack.org/530679 | 04:49 |
*** heyongli has quit IRC | 04:52 | |
*** heyongli has joined #openstack-infra | 04:52 | |
*** ijw has quit IRC | 04:55 | |
*** lukebrowning has quit IRC | 04:55 | |
*** lukebrowning has joined #openstack-infra | 04:57 | |
*** lukebrowning has quit IRC | 05:02 | |
*** heyongli has quit IRC | 05:02 | |
*** heyongli has joined #openstack-infra | 05:02 | |
*** lukebrowning has joined #openstack-infra | 05:03 | |
*** lukebrowning has quit IRC | 05:08 | |
*** heyongli has quit IRC | 05:12 | |
*** heyongli has joined #openstack-infra | 05:12 | |
*** lukebrowning has joined #openstack-infra | 05:20 | |
*** heyongli has quit IRC | 05:22 | |
*** heyongli has joined #openstack-infra | 05:23 | |
*** zhurong has quit IRC | 05:23 | |
*** andrewbogott has quit IRC | 05:24 | |
*** andrewbogott has joined #openstack-infra | 05:24 | |
*** lukebrowning has quit IRC | 05:25 | |
*** bhavik1 has joined #openstack-infra | 05:31 | |
*** psachin has joined #openstack-infra | 05:31 | |
*** heyongli has quit IRC | 05:33 | |
*** heyongli has joined #openstack-infra | 05:33 | |
*** bhavik1 has quit IRC | 05:34 | |
*** heyongli has quit IRC | 05:43 | |
*** heyongli has joined #openstack-infra | 05:43 | |
*** yamamoto has joined #openstack-infra | 05:44 | |
*** lukebrowning has joined #openstack-infra | 05:47 | |
*** yamamoto has quit IRC | 05:50 | |
*** hongbin has joined #openstack-infra | 05:52 | |
*** lukebrowning has quit IRC | 05:52 | |
*** heyongli has quit IRC | 05:53 | |
*** heyongli has joined #openstack-infra | 05:53 | |
*** lukebrowning has joined #openstack-infra | 05:54 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: Add linter job and roles https://review.openstack.org/530682 | 05:55 |
*** ijw has joined #openstack-infra | 05:55 | |
*** pgadiya has joined #openstack-infra | 05:56 | |
*** lukebrowning has quit IRC | 05:59 | |
*** lukebrowning has joined #openstack-infra | 06:01 | |
*** heyongli has quit IRC | 06:03 | |
*** heyongli has joined #openstack-infra | 06:04 | |
*** lukebrowning_ has joined #openstack-infra | 06:04 | |
*** lukebrowning has quit IRC | 06:06 | |
*** jbadiapa has joined #openstack-infra | 06:07 | |
*** lukebrowning_ has quit IRC | 06:09 | |
*** lukebrowning has joined #openstack-infra | 06:10 | |
*** heyongli has quit IRC | 06:14 | |
*** heyongli has joined #openstack-infra | 06:14 | |
*** lukebrowning has quit IRC | 06:15 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: Add buildset-artifacts-location role https://review.openstack.org/530679 | 06:20 |
openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Slack driver https://review.openstack.org/530521 | 06:21 |
*** liujiong has quit IRC | 06:22 | |
*** edmondsw has joined #openstack-infra | 06:23 | |
*** heyongli has quit IRC | 06:24 | |
*** heyongli has joined #openstack-infra | 06:24 | |
*** jbadiapa has quit IRC | 06:26 | |
openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Slack driver https://review.openstack.org/530521 | 06:27 |
*** edmondsw has quit IRC | 06:28 | |
*** armaan has quit IRC | 06:31 | |
*** armaan has joined #openstack-infra | 06:31 | |
*** jbadiapa has joined #openstack-infra | 06:31 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: Add buildset-artifacts-location role https://review.openstack.org/530679 | 06:32 |
*** heyongli has quit IRC | 06:34 | |
*** lukebrowning has joined #openstack-infra | 06:34 | |
*** heyongli has joined #openstack-infra | 06:34 | |
*** e0ne has joined #openstack-infra | 06:36 | |
*** e0ne has quit IRC | 06:36 | |
*** lukebrowning has quit IRC | 06:38 | |
*** lukebrowning has joined #openstack-infra | 06:40 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: Add linter job and role https://review.openstack.org/530682 | 06:41 |
*** ijw has quit IRC | 06:41 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: Fix pep8/yamllint errors https://review.openstack.org/530685 | 06:43 |
*** dhajare has joined #openstack-infra | 06:43 | |
*** heyongli has quit IRC | 06:44 | |
*** heyongli has joined #openstack-infra | 06:45 | |
*** lukebrowning has quit IRC | 06:45 | |
*** lukebrowning has joined #openstack-infra | 06:47 | |
*** lukebrowning has quit IRC | 06:51 | |
*** lukebrowning has joined #openstack-infra | 06:53 | |
*** heyongli has quit IRC | 06:55 | |
*** heyongli has joined #openstack-infra | 06:55 | |
*** lukebrowning has quit IRC | 06:58 | |
*** lukebrowning has joined #openstack-infra | 06:59 | |
*** gmann__ has joined #openstack-infra | 07:00 | |
*** lukebrowning has quit IRC | 07:04 | |
*** dsariel has quit IRC | 07:05 | |
*** heyongli has quit IRC | 07:05 | |
*** heyongli has joined #openstack-infra | 07:05 | |
*** jaosorior has joined #openstack-infra | 07:07 | |
*** lukebrowning has joined #openstack-infra | 07:07 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove legacy jobs in Cyborg https://review.openstack.org/511087 | 07:09 |
openstackgerrit | Merged openstack-infra/project-config master: Remove legacy jobs in Cyborg https://review.openstack.org/511088 | 07:10 |
*** lukebrowning has quit IRC | 07:13 | |
*** lukebrowning has joined #openstack-infra | 07:14 | |
*** heyongli has quit IRC | 07:15 | |
*** heyongli has joined #openstack-infra | 07:15 | |
*** lukebrowning has quit IRC | 07:19 | |
*** lukebrowning has joined #openstack-infra | 07:20 | |
*** gmann__ is now known as gmann | 07:23 | |
*** pcaruana has joined #openstack-infra | 07:24 | |
*** lukebrowning has quit IRC | 07:25 | |
*** pcaruana has quit IRC | 07:25 | |
*** heyongli has quit IRC | 07:25 | |
*** pcaruana has joined #openstack-infra | 07:26 | |
*** heyongli has joined #openstack-infra | 07:26 | |
*** lukebrowning has joined #openstack-infra | 07:26 | |
*** pcaruana has quit IRC | 07:29 | |
*** pcaruana has joined #openstack-infra | 07:29 | |
*** lukebrowning has quit IRC | 07:31 | |
*** markvoelker has joined #openstack-infra | 07:32 | |
*** heyongli has quit IRC | 07:36 | |
*** heyongli has joined #openstack-infra | 07:36 | |
*** slaweq has joined #openstack-infra | 07:38 | |
*** ijw has joined #openstack-infra | 07:42 | |
*** pgadiya has quit IRC | 07:44 | |
*** lukebrowning has joined #openstack-infra | 07:44 | |
*** heyongli has quit IRC | 07:46 | |
*** heyongli has joined #openstack-infra | 07:46 | |
*** tosky has joined #openstack-infra | 07:48 | |
*** lukebrowning has quit IRC | 07:49 | |
*** lukebrowning has joined #openstack-infra | 07:51 | |
*** e0ne has joined #openstack-infra | 07:51 | |
*** larainema has quit IRC | 07:53 | |
*** hongbin has quit IRC | 07:54 | |
*** lukebrowning has quit IRC | 07:56 | |
*** heyongli has quit IRC | 07:56 | |
*** heyongli has joined #openstack-infra | 07:56 | |
*** lukebrowning has joined #openstack-infra | 07:57 | |
*** jaosorior has quit IRC | 07:58 | |
*** jaosorior has joined #openstack-infra | 08:00 | |
*** lukebrowning has quit IRC | 08:02 | |
*** lukebrowning has joined #openstack-infra | 08:03 | |
*** dhajare has quit IRC | 08:05 | |
*** heyongli has quit IRC | 08:06 | |
*** heyongli has joined #openstack-infra | 08:07 | |
*** lukebrowning has quit IRC | 08:08 | |
*** lukebrowning has joined #openstack-infra | 08:10 | |
*** jtomasek has joined #openstack-infra | 08:10 | |
*** edmondsw has joined #openstack-infra | 08:12 | |
*** jtomasek has quit IRC | 08:12 | |
*** jtomasek has joined #openstack-infra | 08:12 | |
*** edmondsw has quit IRC | 08:16 | |
*** heyongli has quit IRC | 08:17 | |
*** heyongli has joined #openstack-infra | 08:17 | |
*** lukebrowning has quit IRC | 08:19 | |
*** tesseract has joined #openstack-infra | 08:20 | |
*** armaan has quit IRC | 08:20 | |
*** lukebrowning has joined #openstack-infra | 08:21 | |
*** lukebrowning has quit IRC | 08:25 | |
*** armaan has joined #openstack-infra | 08:26 | |
*** heyongli has quit IRC | 08:27 | |
*** heyongli has joined #openstack-infra | 08:27 | |
*** hashar has joined #openstack-infra | 08:29 | |
*** ijw has quit IRC | 08:29 | |
*** ijw has joined #openstack-infra | 08:30 | |
*** ijw has quit IRC | 08:31 | |
*** ijw has joined #openstack-infra | 08:31 | |
*** ykarel has quit IRC | 08:31 | |
*** ykarel has joined #openstack-infra | 08:32 | |
*** heyongli has quit IRC | 08:37 | |
*** heyongli has joined #openstack-infra | 08:37 | |
*** danpawlik has joined #openstack-infra | 08:39 | |
*** heyongli has quit IRC | 08:47 | |
*** heyongli has joined #openstack-infra | 08:48 | |
*** lukebrowning has joined #openstack-infra | 08:49 | |
*** lukebrowning has quit IRC | 08:53 | |
*** lukebrowning has joined #openstack-infra | 08:57 | |
*** heyongli has quit IRC | 08:58 | |
*** heyongli has joined #openstack-infra | 08:58 | |
*** jpich has joined #openstack-infra | 08:58 | |
*** lukebrowning has quit IRC | 09:02 | |
*** AJaeger_ has quit IRC | 09:05 | |
*** heyongli has quit IRC | 09:08 | |
*** heyongli has joined #openstack-infra | 09:08 | |
*** lukebrowning has joined #openstack-infra | 09:09 | |
*** yolanda has quit IRC | 09:13 | |
*** yolanda has joined #openstack-infra | 09:16 | |
*** lukebrowning has quit IRC | 09:18 | |
*** heyongli has quit IRC | 09:18 | |
*** heyongli has joined #openstack-infra | 09:18 | |
*** lukebrowning has joined #openstack-infra | 09:19 | |
*** lukebrowning has quit IRC | 09:24 | |
*** e0ne has quit IRC | 09:27 | |
*** e0ne has joined #openstack-infra | 09:28 | |
*** heyongli has quit IRC | 09:28 | |
*** heyongli has joined #openstack-infra | 09:29 | |
*** shardy has joined #openstack-infra | 09:32 | |
*** lucas-afk is now known as lucasagomes | 09:33 | |
*** dbecker has joined #openstack-infra | 09:34 | |
*** heyongli has quit IRC | 09:39 | |
*** heyongli has joined #openstack-infra | 09:39 | |
*** heyongli has quit IRC | 09:49 | |
*** heyongli has joined #openstack-infra | 09:49 | |
*** lukebrowning has joined #openstack-infra | 09:55 | |
*** derekh has joined #openstack-infra | 09:55 | |
*** armaan has quit IRC | 09:56 | |
*** heyongli has quit IRC | 09:59 | |
*** lukebrowning has quit IRC | 09:59 | |
*** heyongli has joined #openstack-infra | 09:59 | |
*** edmondsw has joined #openstack-infra | 10:00 | |
*** dsariel has joined #openstack-infra | 10:00 | |
*** pbourke_ has quit IRC | 10:02 | |
*** edmondsw has quit IRC | 10:04 | |
*** sambetts_ is now known as sambetts | 10:07 | |
*** heyongli has quit IRC | 10:09 | |
*** heyongli has joined #openstack-infra | 10:10 | |
*** pbourke has joined #openstack-infra | 10:10 | |
*** ianychoi_ is now known as ianychoi | 10:11 | |
*** cuongnv has quit IRC | 10:13 | |
*** namnh has quit IRC | 10:14 | |
*** gmann has quit IRC | 10:19 | |
*** heyongli has quit IRC | 10:20 | |
*** heyongli has joined #openstack-infra | 10:20 | |
*** kiennt26 has quit IRC | 10:21 | |
*** liusheng has quit IRC | 10:23 | |
*** liusheng has joined #openstack-infra | 10:23 | |
*** pgadiya has joined #openstack-infra | 10:26 | |
sambetts | Hey infra, there seems to have been *a lot* of spam occuring in openstack- channels over the christmas break and its even still happening at the moment in meeting-3 can we add a rule that auto-kick/bans anyone starting a message with â–„â–„â–„â–„â–„â–„â–„â–„â–„ ?? | 10:27 |
jpich | shinji257904 is spamming #openstack-mistral, if someone here has the power to do something about it (?) | 10:27 |
tosky | jpich, sambetts : ping people on #freenode, they can add global k-line for those users | 10:27 |
jpich | tosky: Thanks! | 10:27 |
*** heyongli has quit IRC | 10:30 | |
*** heyongli has joined #openstack-infra | 10:30 | |
*** markvoelker has quit IRC | 10:32 | |
*** slaweq has quit IRC | 10:32 | |
*** lukebrowning has joined #openstack-infra | 10:32 | |
*** ramishra has quit IRC | 10:35 | |
*** lukebrowning has quit IRC | 10:37 | |
*** armaan has joined #openstack-infra | 10:38 | |
*** lukebrowning has joined #openstack-infra | 10:39 | |
*** armaan_ has joined #openstack-infra | 10:40 | |
*** armaan has quit IRC | 10:40 | |
*** heyongli has quit IRC | 10:40 | |
*** heyongli has joined #openstack-infra | 10:40 | |
*** lukebrowning has quit IRC | 10:44 | |
*** lukebrowning has joined #openstack-infra | 10:45 | |
*** ramishra has joined #openstack-infra | 10:48 | |
*** lukebrowning has quit IRC | 10:50 | |
tosky | sambetts, jpich: was the issue solved? | 10:50 |
jpich | yep, cheers tosky! | 10:50 |
*** heyongli has quit IRC | 10:50 | |
*** heyongli has joined #openstack-infra | 10:51 | |
*** slaweq has joined #openstack-infra | 10:51 | |
*** lukebrowning has joined #openstack-infra | 10:51 | |
sambetts | tosky: seems to have been, however blocking by name doesn't seem to work, they just generate a new one and then pop up again, it would be much better if the openstack IRC channel manager blocked any message starting with â–„â–„â–„â–„â–„â–„ | 10:51 |
*** lukebrowning has quit IRC | 10:56 | |
*** udesale has quit IRC | 10:56 | |
*** heyongli has quit IRC | 11:01 | |
*** heyongli has joined #openstack-infra | 11:01 | |
*** pgadiya has quit IRC | 11:01 | |
*** lukebrowning has joined #openstack-infra | 11:04 | |
*** numans has quit IRC | 11:06 | |
*** lukebrowning has quit IRC | 11:08 | |
*** numans has joined #openstack-infra | 11:09 | |
*** heyongli has quit IRC | 11:11 | |
*** heyongli has joined #openstack-infra | 11:11 | |
*** pgadiya has joined #openstack-infra | 11:15 | |
*** armaan_ has quit IRC | 11:19 | |
*** rfolco has joined #openstack-infra | 11:19 | |
*** heyongli has quit IRC | 11:21 | |
*** heyongli has joined #openstack-infra | 11:21 | |
openstackgerrit | Fabien Boucher proposed openstack-infra/zuul feature/zuulv3: Make Zuul able to start with a broken config https://review.openstack.org/529060 | 11:29 |
*** heyongli has quit IRC | 11:31 | |
*** heyongli has joined #openstack-infra | 11:32 | |
*** markvoelker has joined #openstack-infra | 11:32 | |
*** wolverineav has joined #openstack-infra | 11:36 | |
*** markvoelker has quit IRC | 11:37 | |
*** heyongli has quit IRC | 11:42 | |
*** heyongli has joined #openstack-infra | 11:42 | |
*** lukebrowning has joined #openstack-infra | 11:42 | |
*** lukebrowning has quit IRC | 11:47 | |
*** e0ne has quit IRC | 11:48 | |
*** lukebrowning has joined #openstack-infra | 11:48 | |
*** e0ne has joined #openstack-infra | 11:49 | |
*** heyongli has quit IRC | 11:52 | |
*** heyongli has joined #openstack-infra | 11:52 | |
*** lukebrowning has quit IRC | 11:53 | |
*** lukebrowning has joined #openstack-infra | 11:55 | |
*** nicolasbock has joined #openstack-infra | 11:58 | |
*** lukebrowning_ has joined #openstack-infra | 11:59 | |
*** lukebrowning has quit IRC | 12:00 | |
*** ykarel has quit IRC | 12:00 | |
*** annp has quit IRC | 12:01 | |
*** heyongli has quit IRC | 12:02 | |
*** heyongli has joined #openstack-infra | 12:02 | |
*** lukebrowning_ has quit IRC | 12:03 | |
*** lukebrowning has joined #openstack-infra | 12:05 | |
*** jkilpatr has joined #openstack-infra | 12:07 | |
tosky | sambetts: it's not just the nickname; freenode admins have a bot with rules for k-lining based on various parameters | 12:08 |
sambetts | tosky: ah thats good then | 12:09 |
*** ijw has quit IRC | 12:09 | |
*** lukebrowning has quit IRC | 12:10 | |
*** heyongli has quit IRC | 12:12 | |
*** cshastri has quit IRC | 12:12 | |
*** heyongli has joined #openstack-infra | 12:13 | |
*** links has quit IRC | 12:13 | |
*** lukebrowning has joined #openstack-infra | 12:15 | |
openstackgerrit | Sam Betts proposed openstack-infra/devstack-gate master: Move location of devstack-gate unstack to post-tempest https://review.openstack.org/530726 | 12:17 |
*** lukebrowning has quit IRC | 12:19 | |
*** edmondsw has joined #openstack-infra | 12:19 | |
*** edmondsw has quit IRC | 12:20 | |
*** ijw has joined #openstack-infra | 12:22 | |
*** heyongli has quit IRC | 12:23 | |
*** heyongli has joined #openstack-infra | 12:23 | |
*** lukebrowning has joined #openstack-infra | 12:24 | |
*** lukebrowning has quit IRC | 12:29 | |
*** lucasagomes is now known as lucas-hugry | 12:30 | |
*** ykarel has joined #openstack-infra | 12:30 | |
*** lukebrowning has joined #openstack-infra | 12:31 | |
*** heyongli has quit IRC | 12:33 | |
*** heyongli has joined #openstack-infra | 12:33 | |
*** markvoelker has joined #openstack-infra | 12:34 | |
*** dave-mccowan has joined #openstack-infra | 12:35 | |
*** lukebrowning has quit IRC | 12:35 | |
*** jaypipes has joined #openstack-infra | 12:37 | |
*** markvoelker has quit IRC | 12:38 | |
*** lukebrowning has joined #openstack-infra | 12:38 | |
*** smatzek has joined #openstack-infra | 12:41 | |
*** lukebrowning has quit IRC | 12:43 | |
*** heyongli has quit IRC | 12:43 | |
*** heyongli has joined #openstack-infra | 12:43 | |
*** lukebrowning has joined #openstack-infra | 12:45 | |
*** lukebrowning_ has joined #openstack-infra | 12:49 | |
*** lukebrowning has quit IRC | 12:50 | |
*** heyongli has quit IRC | 12:53 | |
*** lukebrowning_ has quit IRC | 12:53 | |
*** heyongli has joined #openstack-infra | 12:54 | |
*** lukebrowning has joined #openstack-infra | 12:55 | |
*** larainema has joined #openstack-infra | 12:57 | |
*** jcoufal has joined #openstack-infra | 12:59 | |
*** lukebrowning has quit IRC | 13:00 | |
*** lukebrowning has joined #openstack-infra | 13:02 | |
*** heyongli has quit IRC | 13:04 | |
*** heyongli has joined #openstack-infra | 13:04 | |
*** lukebrowning has quit IRC | 13:07 | |
*** rlandy has joined #openstack-infra | 13:07 | |
*** lukebrowning has joined #openstack-infra | 13:12 | |
*** heyongli has quit IRC | 13:14 | |
*** rlandy is now known as rlandy|ruck | 13:14 | |
*** heyongli has joined #openstack-infra | 13:14 | |
*** pblaho has joined #openstack-infra | 13:14 | |
*** coolsvap has quit IRC | 13:15 | |
*** gmann has joined #openstack-infra | 13:18 | |
*** dave-mccowan has quit IRC | 13:21 | |
*** lukebrowning has quit IRC | 13:21 | |
*** pblaho has quit IRC | 13:22 | |
*** pgadiya has quit IRC | 13:23 | |
*** heyongli has quit IRC | 13:24 | |
*** heyongli has joined #openstack-infra | 13:24 | |
fungi | clarkb: i don't expect to be around for the infra meeting later today. some last-minute travel came up with has me booked through tomorrow now | 13:25 |
fungi | s/with.which/ | 13:25 |
* fungi is teh typo king | 13:25 | |
*** ramishra has quit IRC | 13:26 | |
*** erlon has joined #openstack-infra | 13:26 | |
*** annp has joined #openstack-infra | 13:28 | |
*** markvoelker has joined #openstack-infra | 13:28 | |
erlon | @all, guys, anyone else experiencing the glance error on devstack? http://logs.openstack.netapp.com/logs/periodic-internal/periodic-cinder-SVM-cDOT-NFS/20ff876/logs/devstack-early.txt | 13:34 |
*** heyongli has quit IRC | 13:34 | |
*** heyongli has joined #openstack-infra | 13:35 | |
*** pblaho has joined #openstack-infra | 13:36 | |
*** udesale has joined #openstack-infra | 13:36 | |
stephenfin | clarkb: When you're about, fancy taking a look at this? https://review.openstack.org/#/c/450918/5 | 13:36 |
frickler | infra-root: neutron proposes a test that will check connectivity from an instance to the outside world, in that case 8.8.8.8. I think it is a very bad idea to assume third-party hosts to be reachable, but would like your feedback on that. see https://review.openstack.org/530036 | 13:37 |
*** lucas-hugry is now known as lucasagomes | 13:38 | |
*** edmondsw has joined #openstack-infra | 13:39 | |
*** annp has quit IRC | 13:43 | |
*** edmondsw has quit IRC | 13:44 | |
*** heyongli has quit IRC | 13:45 | |
*** heyongli has joined #openstack-infra | 13:45 | |
*** eharney has joined #openstack-infra | 13:47 | |
*** pgadiya has joined #openstack-infra | 13:47 | |
*** pcichy_ has quit IRC | 13:48 | |
*** rhallisey has joined #openstack-infra | 13:49 | |
*** trown|outtypewww is now known as trown|rover | 13:51 | |
*** annp has joined #openstack-infra | 13:53 | |
*** heyongli has quit IRC | 13:55 | |
*** heyongli has joined #openstack-infra | 13:55 | |
frickler | erlon: without access to the logs from glance, that will be impossible to debug. | 13:55 |
*** kgiusti has joined #openstack-infra | 13:56 | |
*** mriedem has joined #openstack-infra | 13:56 | |
*** bh526r has joined #openstack-infra | 13:56 | |
erlon | frickler, yeap, but at this stage glance is not up yet, so the only logs we have are the devstack ones | 13:57 |
*** mihalis68 has joined #openstack-infra | 13:59 | |
*** kgiusti has quit IRC | 14:00 | |
*** kgiusti has joined #openstack-infra | 14:02 | |
frickler | erlon: glance api is installed and started before you get that error, so there would be a log from that, possibly in systemd journal | 14:03 |
erlon | frickler, hmm, well that wasnt saved in the job, Ill start on manually and hold the node for checking, just wanted to know if that was a problem that affected uptream CIs | 14:04 |
*** heyongli has quit IRC | 14:05 | |
*** heyongli has joined #openstack-infra | 14:05 | |
cloudnull | mornings all, happy new year! | 14:09 |
*** Goneri has joined #openstack-infra | 14:10 | |
*** pblaho has quit IRC | 14:11 | |
*** pblaho has joined #openstack-infra | 14:11 | |
*** edmondsw has joined #openstack-infra | 14:14 | |
*** heyongli has quit IRC | 14:15 | |
*** heyongli has joined #openstack-infra | 14:16 | |
*** lukebrowning has joined #openstack-infra | 14:17 | |
*** kgiusti has quit IRC | 14:20 | |
*** numans has quit IRC | 14:22 | |
*** lukebrowning has quit IRC | 14:22 | |
*** numans has joined #openstack-infra | 14:23 | |
*** pgadiya has quit IRC | 14:24 | |
*** heyongli has quit IRC | 14:26 | |
*** heyongli has joined #openstack-infra | 14:26 | |
*** lukebrowning has joined #openstack-infra | 14:28 | |
*** lukebrowning has quit IRC | 14:32 | |
*** heyongli has quit IRC | 14:36 | |
*** heyongli has joined #openstack-infra | 14:36 | |
*** psachin has quit IRC | 14:37 | |
*** esberglu has joined #openstack-infra | 14:37 | |
*** mdrabe_ is now known as mdrabe | 14:38 | |
*** kgiusti has joined #openstack-infra | 14:38 | |
*** bobh has joined #openstack-infra | 14:39 | |
*** hongbin has joined #openstack-infra | 14:41 | |
*** lukebrowning has joined #openstack-infra | 14:42 | |
openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Reject mail to openstack-infra-owner https://review.openstack.org/530749 | 14:44 |
*** pall is now known as pabelanger | 14:45 | |
pabelanger | morning | 14:45 |
*** heyongli has quit IRC | 14:46 | |
*** heyongli has joined #openstack-infra | 14:46 | |
*** lukebrowning has quit IRC | 14:47 | |
pabelanger | frickler: Yah, not sure I would depend on 8.8.8.8 for a test, but that is just me | 14:48 |
*** lukebrowning has joined #openstack-infra | 14:49 | |
*** lyarwood has joined #openstack-infra | 14:52 | |
corvus | infra-root: if you would please approve 530749 that would give my spam filter a respite. | 14:53 |
*** annp has quit IRC | 14:53 | |
*** lukebrowning has quit IRC | 14:53 | |
*** heyongli has quit IRC | 14:56 | |
*** heyongli has joined #openstack-infra | 14:57 | |
*** dsariel has quit IRC | 14:57 | |
shardy | Hi all, happy new year! | 14:58 |
shardy | Can anyone please help my troubleshoot http://logs.openstack.org/83/530483/1/check/requirements-tox-py27-check-uc/7bc8388/tox/py27-check-uc-1.log | 14:58 |
shardy | it looks like the pypi mirror is out of date, because it can't find this: | 14:58 |
shardy | https://pypi.python.org/pypi/tripleo-common/8.3.0 | 14:59 |
shardy | is some sync job failing for the mirror perhaps? | 14:59 |
shardy | pabelanger: ^^ perhaps you can help when you get some time? | 14:59 |
*** rlandy|ruck is now known as rlandy|ruck|mtg | 15:00 | |
*** dave-mccowan has joined #openstack-infra | 15:01 | |
pabelanger | http://mirror.dfw.rax.openstack.org/pypi/last-modified | 15:02 |
pabelanger | seems to be a little old | 15:02 |
pabelanger | so it is possible pypi is out of sync | 15:02 |
pabelanger | let me get some coffee and have a look | 15:02 |
shardy | pabelanger: ack thanks! | 15:02 |
*** heyongli has quit IRC | 15:07 | |
*** heyongli has joined #openstack-infra | 15:07 | |
pabelanger | mirror.pypi 1200000000 1199997050 100%<< 17% <<WARNING | 15:07 |
pabelanger | guess we are out of space | 15:07 |
lyarwood | Are there any docs covering how to run Zuulv3 jobs locally against a VM? I'm trying and failing to reproduce https://bugs.launchpad.net/tempest/+bug/1739829 that's currently blocking stable/pike for Nova | 15:09 |
openstack | Launchpad bug 1739829 in tempest "tempest-full job failing in stable/pike with 404 from keystone during tempest verify-config" [Undecided,Confirmed] | 15:09 |
*** Apoorva has joined #openstack-infra | 15:11 | |
*** lukebrowning has joined #openstack-infra | 15:11 | |
*** pcichy_ has joined #openstack-infra | 15:12 | |
pabelanger | okay, bumped quota on mirror.pypi | 15:15 |
pabelanger | checking logs now | 15:15 |
*** lukebrowning has quit IRC | 15:16 | |
*** heyongli has quit IRC | 15:17 | |
*** heyongli has joined #openstack-infra | 15:17 | |
*** cshastri has joined #openstack-infra | 15:20 | |
pabelanger | okay, bandersnatch running again | 15:21 |
pabelanger | hopefully it will complete properly with enough space | 15:22 |
*** dsariel has joined #openstack-infra | 15:23 | |
*** cshastri has quit IRC | 15:26 | |
*** heyongli has quit IRC | 15:27 | |
pabelanger | Hmm, I think we might need to re-initialize bandersnatch, I only see a single package that was mirrored | 15:27 |
*** heyongli has joined #openstack-infra | 15:27 | |
corvus | pabelanger: let it run again | 15:28 |
corvus | pabelanger: that may have been it finishing up the previous run (it saves state); it may pick up the new changes on the next run | 15:28 |
pabelanger | corvus: okay | 15:28 |
pabelanger | crontab running now | 15:30 |
*** lukebrowning has joined #openstack-infra | 15:32 | |
*** sobersabre has joined #openstack-infra | 15:37 | |
*** lukebrowning has quit IRC | 15:37 | |
sobersabre | hi, any jenkins job builder devels around ? | 15:37 |
*** heyongli has quit IRC | 15:37 | |
*** gmann has quit IRC | 15:37 | |
*** heyongli has joined #openstack-infra | 15:38 | |
*** eharney has quit IRC | 15:38 | |
*** lukebrowning has joined #openstack-infra | 15:39 | |
corvus | sobersabre: there's an #openstack-jjb channel which may be the best place to find them | 15:41 |
sobersabre | corvus: oh, ok. I looked on https://wiki.openstack.org/wiki/IRC | 15:42 |
sobersabre | thanks, corvus | 15:42 |
sobersabre | :) | 15:42 |
*** sobersabre has left #openstack-infra | 15:42 | |
corvus | i'll add it | 15:43 |
*** bnemec-xmas is now known as bnemec | 15:46 | |
*** lukebrowning has quit IRC | 15:46 | |
*** david-lyle has joined #openstack-infra | 15:47 | |
*** lukebrowning has joined #openstack-infra | 15:47 | |
*** heyongli has quit IRC | 15:48 | |
*** heyongli has joined #openstack-infra | 15:48 | |
*** mlavalle has joined #openstack-infra | 15:49 | |
*** baoli has joined #openstack-infra | 15:49 | |
frickler | lyarwood: IMHO the tempest-full job isn't ready to be voting yet, because it is lacking lots of important log collection, making debugging like this difficult. your best bet for reproducing locally would be manually tracing the ansible job definitions which you can see in the inheritance_path here http://logs.openstack.org/84/529384/1/check/tempest-full/fbefda8/zuul-info/inventory.yaml | 15:49 |
frickler | lyarwood: also this is more an issue for #openstack-qa I'd say | 15:50 |
*** eharney has joined #openstack-infra | 15:51 | |
*** baoli has quit IRC | 15:51 | |
*** lukebrowning has quit IRC | 15:52 | |
*** lukebrowning has joined #openstack-infra | 15:54 | |
*** heyongli has quit IRC | 15:58 | |
*** heyongli has joined #openstack-infra | 15:58 | |
*** lukebrowning has quit IRC | 15:59 | |
*** gouthamr has joined #openstack-infra | 16:00 | |
*** lukebrowning has joined #openstack-infra | 16:00 | |
*** armax has joined #openstack-infra | 16:00 | |
*** rlandy|ruck|mtg is now known as rlandy|ruck | 16:01 | |
lyarwood | frickler: ack thanks | 16:04 |
*** xarses_ has joined #openstack-infra | 16:04 | |
*** lukebrowning has quit IRC | 16:05 | |
*** lukebrowning has joined #openstack-infra | 16:06 | |
*** heyongli has quit IRC | 16:08 | |
*** heyongli has joined #openstack-infra | 16:08 | |
*** kmalloc has joined #openstack-infra | 16:09 | |
*** lukebrowning has quit IRC | 16:11 | |
*** lukebrowning has joined #openstack-infra | 16:13 | |
smcginnis | pabelanger: Do we regularly clean out the bandersnatch mirror? I seem to remember needing to do that once or twice when I ran a local one. | 16:16 |
frickler | pabelanger: multiple jobs failures due to issues with mirror.lon1.citycloud.o.o, do you think that could be related to your mirror actions? http://logs.openstack.org/27/527027/3/check/legacy-tempest-dsvm-py35/ff2107e/job-output.txt.gz#_2018-01-02_14_30_11_063608 http://logs.openstack.org/27/527027/3/check/legacy-grenade-dsvm-neutron-multinode/dece1c5/logs/devstack-gate-setup-host.txt | 16:16 |
*** pcichy_ has quit IRC | 16:17 | |
*** slaweq has quit IRC | 16:17 | |
*** lukebrowning has quit IRC | 16:18 | |
pabelanger | smcginnis: I don't believe so, IIRC we keep a full mirror at all times | 16:18 |
*** heyongli has quit IRC | 16:18 | |
*** heyongli has joined #openstack-infra | 16:19 | |
*** lukebrowning has joined #openstack-infra | 16:19 | |
pabelanger | frickler: looks like possible networking issue, we'd have to check and see how often it has been happening | 16:19 |
openstackgerrit | David Moreau Simard proposed openstack-infra/system-config master: Setup bash history to contain standard timestamps (RFC3339) https://review.openstack.org/529428 | 16:19 |
clarkb | pabelanger: frickler I think we have an elastic recheck query for that issue already | 16:20 |
pabelanger | however, bandersnatch is still running, hopefully once we do a full mirror / release we can confirm logs again | 16:20 |
clarkb | it doesn't always result in a failure though as pip will retry up to 5 times by default now iirc | 16:20 |
*** iyamahat has joined #openstack-infra | 16:20 | |
*** rlandy|ruck is now known as rlandy|ruck|mtg | 16:21 | |
dmsimard | mnaser, clarkb: I'll add a freenode spam (continued) topic to the agenda | 16:21 |
dmsimard | I was 99% disconnected throughout the holiday period but there was several waves | 16:21 |
clarkb | ya though there isn't much we can do I expect | 16:21 |
clarkb | freenode staff seems to have been trying to kline things as they notice it | 16:22 |
dmsimard | clarkb: what I did on the original spam wave was to +r all channels which enforces the requirement for users to be authenticated against nickserv before joining the channel | 16:23 |
*** lukebrowning has quit IRC | 16:24 | |
dmsimard | however, there needs to be a better way than http://paste.openstack.org/raw/629176/ (which takes ~3 minutes to run) :D | 16:24 |
clarkb | pabelanger: frickler http://status.openstack.org/elastic-recheck/#1449136 is the bug tracking it and it does hvae a large spike currently | 16:24 |
mnaser | i added myself to operators and i would ban things when i get notifications (i have irccloud so it would hit my phone) | 16:24 |
*** iyamahat has quit IRC | 16:24 | |
*** lukebrowning has joined #openstack-infra | 16:25 | |
clarkb | it is happening in more than one cloud as well | 16:26 |
dmsimard | just pyyaml &? | 16:26 |
pabelanger | clarkb: frickler: okay, I can dig more shortly, bandersnatch is still running but need to relocate to coffee shop | 16:26 |
clarkb | dmsimard: pyyaml tripleo-common pycrypto devstack-tools I see after a quick skim | 16:27 |
clarkb | likely just instals that happen early in jobs are common | 16:27 |
corvus | i just got a random ssh connectivity failure on a job in rax-ord | 16:27 |
*** heyongli has quit IRC | 16:29 | |
frickler | pabelanger: clarkb: o.k., looks like I just had bad luck with my patch, then. waiting for the next recheck results now | 16:29 |
*** heyongli has joined #openstack-infra | 16:29 | |
corvus | clarkb, pabelanger, Shrews: https://review.openstack.org/529705 and child will help us get the zuul finger gateway running | 16:30 |
clarkb | frickler: well it does look like somethin is going on, possibly related to the bandersnatch update but lso possibly something else | 16:30 |
*** lukebrowning has quit IRC | 16:30 | |
*** ijw has quit IRC | 16:30 | |
pabelanger | yah, we have about ~10days worth of data to mirror from pypi | 16:31 |
pabelanger | okay, relocating now | 16:31 |
Shrews | corvus: oh neat! i forgot that was a thing | 16:31 |
*** iyamahat has joined #openstack-infra | 16:31 | |
*** lukebrowning has joined #openstack-infra | 16:32 | |
corvus | Shrews: yeah... i can't remember who wrote that.... ;) | 16:32 |
*** dsariel has quit IRC | 16:32 | |
Shrews | i was lucky to remember my laptop password this morning | 16:32 |
mordred | Shrews: what's a laptop? | 16:33 |
*** ijw has joined #openstack-infra | 16:33 | |
Shrews | mordred: that thing i stole from you that one time | 16:33 |
Shrews | (oops) | 16:33 |
mordred | Shrews: oh sweet. so I don't have one and can just go back to bed? | 16:33 |
*** dsariel has joined #openstack-infra | 16:34 | |
dmsimard | corvus: new handle for the new year ? | 16:34 |
corvus | mordred: you're not in bed? | 16:34 |
mordred | corvus: I'm not? | 16:34 |
clarkb | corvus: question on https://review.openstack.org/#/c/529704/2 but not worthy of a -1 | 16:34 |
corvus | dmsimard: i heard not everyone was familiar with it :) | 16:34 |
dmsimard | bah | 16:35 |
dmsimard | so it's my fault then | 16:35 |
corvus | clarkb: 529874 and 529875 lgtm | 16:35 |
dmsimard | :D | 16:35 |
clarkb | corvus: thanks, I figure if I can get those changes in today I will get the existing host updated then deploy new host with less of the old config ever touching it | 16:35 |
*** lukebrowning has quit IRC | 16:36 | |
frickler | clarkb: pabelanger: all the recent matches on http://status.openstack.org/elastic-recheck/#1449136 seem to be located in ovh-* now, saying "No matching distribution found for PyYAML" as opposed to the triple-o thing earlier | 16:37 |
corvus | clarkb: i think the logging stuff is all copy pasta from the other zuul services. however, does the python time logger compress? | 16:37 |
* frickler moves home now, not sure yet whether I'll make it to the meeting time later | 16:37 | |
clarkb | corvus: looks like no compression, so probably worth using logrotate | 16:38 |
*** dsariel has quit IRC | 16:38 | |
*** heyongli has quit IRC | 16:39 | |
*** heyongli has joined #openstack-infra | 16:39 | |
*** lukebrowning has joined #openstack-infra | 16:40 | |
*** pcaruana has quit IRC | 16:41 | |
*** ijw has quit IRC | 16:44 | |
*** lukebrowning has quit IRC | 16:44 | |
*** Apoorva has quit IRC | 16:44 | |
*** lukebrowning has joined #openstack-infra | 16:46 | |
*** bh526r has quit IRC | 16:46 | |
*** heyongli has quit IRC | 16:49 | |
*** heyongli has joined #openstack-infra | 16:49 | |
*** lukebrowning has quit IRC | 16:50 | |
*** lukebrowning has joined #openstack-infra | 16:52 | |
*** mgoddard has joined #openstack-infra | 16:52 | |
mgoddard | Hello infra team, I would like to create an IRC channel for the kayobe project (https://github.com/stackhpc/kayobe) | 16:54 |
corvus | mgoddard: see info here: https://docs.openstack.org/infra/system-config/irc.html#channel-requirements | 16:54 |
*** udesale has quit IRC | 16:55 | |
corvus | mgoddard: also https://docs.openstack.org/infra/manual/creators.html#configure-gerritbot-to-announce-changes | 16:55 |
corvus | mgoddard: also https://docs.openstack.org/infra/system-config/irc.html#accessbot | 16:56 |
corvus | sorry that's not all together :| | 16:56 |
mgoddard | corvus: great, thanks | 16:56 |
*** lukebrowning has quit IRC | 16:57 | |
*** lukebrowning has joined #openstack-infra | 16:58 | |
*** heyongli has quit IRC | 16:59 | |
*** heyongli has joined #openstack-infra | 17:00 | |
*** armaan has joined #openstack-infra | 17:00 | |
*** gyee has joined #openstack-infra | 17:01 | |
*** lukebrowning has quit IRC | 17:03 | |
*** lukebrowning has joined #openstack-infra | 17:05 | |
*** rlandy|ruck|mtg is now known as rlandy|ruck | 17:07 | |
*** mihalis68 has quit IRC | 17:08 | |
*** heyongli has quit IRC | 17:10 | |
*** heyongli has joined #openstack-infra | 17:10 | |
*** lukebrowning has quit IRC | 17:14 | |
*** lukebrowning has joined #openstack-infra | 17:16 | |
*** d0ugal has quit IRC | 17:19 | |
*** d0ugal has joined #openstack-infra | 17:20 | |
*** heyongli has quit IRC | 17:20 | |
*** heyongli has joined #openstack-infra | 17:20 | |
*** lukebrowning has quit IRC | 17:20 | |
openstackgerrit | Mark Goddard proposed openstack-infra/project-config master: Add #openstack-kayobe to accessbot channel list https://review.openstack.org/530778 | 17:21 |
*** lukebrowning has joined #openstack-infra | 17:22 | |
*** jpich has quit IRC | 17:23 | |
*** lucasagomes is now known as lucas-afk | 17:25 | |
*** ijw has joined #openstack-infra | 17:26 | |
*** lukebrowning has quit IRC | 17:27 | |
*** lukebrowning has joined #openstack-infra | 17:28 | |
*** heyongli has quit IRC | 17:30 | |
*** heyongli has joined #openstack-infra | 17:30 | |
*** iyamahat has quit IRC | 17:32 | |
*** iyamahat has joined #openstack-infra | 17:33 | |
*** ykarel has quit IRC | 17:33 | |
*** iyamahat has quit IRC | 17:33 | |
*** lukebrowning has quit IRC | 17:34 | |
*** e0ne has quit IRC | 17:35 | |
*** iyamahat has joined #openstack-infra | 17:35 | |
*** iyamahat has quit IRC | 17:35 | |
*** iyamahat has joined #openstack-infra | 17:36 | |
*** jascott1 has joined #openstack-infra | 17:38 | |
*** Apoorva has joined #openstack-infra | 17:39 | |
*** caphrim007 has joined #openstack-infra | 17:39 | |
*** heyongli has quit IRC | 17:40 | |
*** heyongli has joined #openstack-infra | 17:41 | |
*** armaan has quit IRC | 17:41 | |
*** armaan has joined #openstack-infra | 17:43 | |
*** AJaeger has joined #openstack-infra | 17:43 | |
*** armaan has quit IRC | 17:43 | |
AJaeger | Happy new year! | 17:43 |
clarkb | AJaeger: to you as well | 17:44 |
AJaeger | thanks, clarkb ! | 17:44 |
*** lukebrowning has joined #openstack-infra | 17:45 | |
*** armaan has joined #openstack-infra | 17:45 | |
AJaeger | config-core, https://etherpad.openstack.org/p/Nvt3ovbn5x contains a list of reviews ready to merge - nothing critical, just a larger backlog. Reviews are welcome. | 17:46 |
*** trown|rover is now known as trown|lunch | 17:48 | |
*** caphrim007 has quit IRC | 17:49 | |
*** caphrim007 has joined #openstack-infra | 17:49 | |
*** caphrim007 has quit IRC | 17:50 | |
*** armaan has quit IRC | 17:51 | |
*** heyongli has quit IRC | 17:51 | |
*** heyongli has joined #openstack-infra | 17:51 | |
*** armaan has joined #openstack-infra | 17:51 | |
*** caphrim007 has joined #openstack-infra | 17:51 | |
*** catintheroof has joined #openstack-infra | 17:51 | |
clarkb | AJaeger: thank you for putting that together, gives me an easy thing t ostart the year on now that I have caffeine :) | 17:51 |
smcginnis | There was a problem with the tempest-full job on stable branches that I think someone was working on. Anyone know if that is fixed? | 17:52 |
clarkb | andreaf: know the answer to ^ | 17:52 |
smcginnis | I guess I can just try a recheck and find out. | 17:53 |
openstackgerrit | Merged openstack-infra/puppet-zuul master: Add support for zuul-fingergw https://review.openstack.org/529704 | 17:53 |
openstackgerrit | Merged openstack-infra/system-config master: Add finger gateway to zuulv3 https://review.openstack.org/529705 | 17:53 |
openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove ensure-reno role https://review.openstack.org/521143 | 17:54 |
*** lukebrowning has quit IRC | 17:54 | |
*** armaan has quit IRC | 17:55 | |
AJaeger | clarkb: thanks for reviewing! | 17:56 |
openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove legacy jobs in storlets https://review.openstack.org/512958 | 17:56 |
openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove legacy jobs in Murano https://review.openstack.org/511438 | 17:59 |
openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove legacy novaclient jobs https://review.openstack.org/522102 | 17:59 |
*** derekh has quit IRC | 17:59 | |
*** armaan has joined #openstack-infra | 17:59 | |
*** heyongli has quit IRC | 18:01 | |
*** heyongli has joined #openstack-infra | 18:01 | |
*** lukebrowning has joined #openstack-infra | 18:03 | |
*** lamt` has joined #openstack-infra | 18:04 | |
openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Treat mail sent to superuser-owner as spam https://review.openstack.org/530785 | 18:04 |
clarkb | infra-root corvus ^ similar to an earlier change today to black hole list owner spam | 18:05 |
lamt` | o/ I have a question regarding the doc publication. It looks like the latest update for some of the doc was Dec 21, even though newer doc changes were merged in after (and are not reflected): e.g. https://docs.openstack.org/openstack-helm/latest/ | 18:07 |
*** armaan has quit IRC | 18:07 | |
clarkb | lamt`: have an example change that merged more recently that should've updated the docs? we should be able to work back from that to find logs and figure out what is going on | 18:08 |
lamt` | clarkb, thanks lemme find a patch set | 18:08 |
*** lukebrowning has quit IRC | 18:09 | |
lamt` | clarkb, https://review.openstack.org/#/c/530468/ - merged on Dec 30. | 18:09 |
*** lukebrowning has joined #openstack-infra | 18:10 | |
*** heyongli has quit IRC | 18:11 | |
*** heyongli has joined #openstack-infra | 18:11 | |
*** harlowja has joined #openstack-infra | 18:12 | |
clarkb | lamt`: ok logs show the job ran in what it thinks was a successful manner | 18:12 |
*** mgoddard has quit IRC | 18:12 | |
clarkb | lamt`: http://logs.openstack.org/6c/6c27dd852cb92a4d8a67b9b8d2f356f72dbcdd9a/post/publish-openstack-sphinx-docs/5c5437e/ ( found that via the zuul status page's builds list and added openstack/openstack-helm as the project and post as the pipeline filter) | 18:13 |
lamt` | the page linked from gerrit looks updated, but docs.o.o is not | 18:14 |
AJaeger | clarkb: seems we have a general problem with docs.o.o - look at http://files.openstack.org/docs/?C=M;O=D | 18:14 |
AJaeger | last updated 23rd of December ;( | 18:15 |
*** lukebrowning has quit IRC | 18:15 | |
clarkb | lamt`: the page linked from gerrit is generated by check and gate builds and is only published to the ci logs server not the actual afs production server | 18:15 |
AJaeger | mordred: is there a problem with the pti-updated changes? We merged some around that time ^ | 18:15 |
AJaeger | interesting, this is wrong: http://files.openstack.org/docs/python-tripleoclient/html/ | 18:17 |
openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Treat mail sent to foundation-board-owner as spam https://review.openstack.org/530788 | 18:17 |
clarkb | another list owner spam blackhole request ^ | 18:17 |
clarkb | AJaeger: supposed to be just latest/ not html/latest? | 18:18 |
AJaeger | clarkb: indeed, should not be http://files.openstack.org/docs/tempest/html/latest/ but http://files.openstack.org/docs/tempest/latest/ | 18:18 |
clarkb | helm at least does not have an html/latest | 18:18 |
AJaeger | but no publishing *after* the 23rd anywhere that I checked | 18:18 |
*** sambetts is now known as sambetts|afk | 18:19 | |
AJaeger | clarkb: any zuul log files for that helm change? | 18:20 |
AJaeger | I mean: Debug log from zuul? | 18:20 |
clarkb | AJaeger: I can check in a sec | 18:21 |
*** heyongli has quit IRC | 18:21 | |
*** heyongli has joined #openstack-infra | 18:22 | |
*** lukebrowning has joined #openstack-infra | 18:22 | |
AJaeger | https://review.openstack.org/#/c/525734/ was the change that merged last on this. | 18:23 |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool feature/zuulv3: WIP: Convert from legacy to native devstack job https://review.openstack.org/520664 | 18:25 |
*** lukebrowning has quit IRC | 18:27 | |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool feature/zuulv3: WIP: Convert from legacy to native devstack job https://review.openstack.org/520664 | 18:27 |
lamt` | brb, thanks for looking into it. From spotchecking docs from other projects last week, it looks like nothing got published past 12/22-23. | 18:28 |
clarkb | AJaeger: not seeing anything weird in the executor debug log for that job | 18:28 |
*** lukebrowning has joined #openstack-infra | 18:29 | |
AJaeger | clarkb, mordred, so I think the extra html/ got introduced by 525734 - but I don't know why we stop publishing on the 23rd. 525734 merged on the 21st already | 18:29 |
AJaeger | clarkb: is AFS ok? | 18:29 |
clarkb | AJaeger: that was the next thing I was going t ocheck | 18:29 |
clarkb | pabelanger: was it you that updated files01 to files02? we still have a files01 dns record fwiw | 18:29 |
pabelanger | clarkb: yah, I need to check my notes, I am not sure I deleted files01 yet | 18:30 |
pabelanger | https://review.openstack.org/527519/ and https://review.openstack.org/528135/ are related reviews | 18:31 |
*** heyongli has quit IRC | 18:32 | |
*** heyongli has joined #openstack-infra | 18:32 | |
*** mgoddard has joined #openstack-infra | 18:32 | |
corvus | pabelanger: fwiw, filesNN is intended to support HA -- we can run more than one and load-balance/failover them if we want. | 18:32 |
corvus | (i'm just reacting to the commit message in 527519) | 18:32 |
AJaeger | found out the reason for extra html/ - not sure yet how to fix best ;/ | 18:33 |
AJaeger | as usual a missing "/" (in this case a removed one) | 18:33 |
clarkb | AJaeger: http://paste.openstack.org/show/636430/ | 18:33 |
*** lukebrowning has quit IRC | 18:33 | |
clarkb | AJaeger: so its publishing to html/ for helm too | 18:33 |
clarkb | that makes me think we hvae two problems, the first is writing to html and the second must be related to afs publishing to ro volume | 18:33 |
pabelanger | clarkb: okay, cleaning up files01.o.o DNS now, I'll also remove the server. files.o.o has been pointing to files02.o.o for a few weeks now | 18:34 |
AJaeger | clarkb: agreed with the two unrelated problems. I'm working on html | 18:34 |
clarkb | pabelanger: well | 18:34 |
pabelanger | corvus: ack | 18:34 |
clarkb | pabelanger: docs publishing hasn't worked for a few days | 18:34 |
openstackgerrit | David Shrewsbury proposed openstack-infra/system-config master: Open finger port for zuulv3 https://review.openstack.org/530789 | 18:35 |
*** hemna_ has joined #openstack-infra | 18:35 | |
clarkb | I've got to step out fo ra bit but can poke at the afs side when back if no one beats me to it | 18:35 |
pabelanger | clarkb: okay, I can look. But believe I confirmed doc publishing to be working once we updated files.o.o to files02.o.o | 18:36 |
openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: networking-midonet: Remove some of legacy jobs https://review.openstack.org/522471 | 18:37 |
openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove legacy jobs in Cyborg https://review.openstack.org/511087 | 18:37 |
openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove *-js-release-branch/-master/-draft jobs https://review.openstack.org/529499 | 18:37 |
pabelanger | [Sat Dec 23 08:34:55 2017] afs: Lost contact with volume location server 104.130.136.20 in cell openstack.org (code -1) | 18:41 |
pabelanger | that is on ze01 | 18:41 |
*** heyongli has quit IRC | 18:42 | |
openstackgerrit | Merged openstack-infra/system-config master: Reject mail to openstack-infra-owner https://review.openstack.org/530749 | 18:42 |
*** heyongli has joined #openstack-infra | 18:42 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: Fix sphinx publishing https://review.openstack.org/530790 | 18:44 |
AJaeger | clarkb, mordred, that's the first part of the change, please review and tell me whether that is ok ^ | 18:44 |
pabelanger | clarkb: Yah, I am seeing that message on a most zuul-executors on Dec. 23rd | 18:44 |
* AJaeger works on second part now | 18:44 | |
*** jkilpatr has quit IRC | 18:46 | |
pabelanger | we also getting OOM killer running on executors too, pretty sure we are aware of that | 18:46 |
AJaeger | clarkb, mordred, alternative is revert the removal of sphinx_output_src in 525734 | 18:47 |
*** trown|lunch is now known as trown | 18:49 | |
*** trown is now known as trown|rover | 18:49 | |
*** heyongli has quit IRC | 18:52 | |
*** heyongli has joined #openstack-infra | 18:52 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Use sphinx_output_suffix https://review.openstack.org/530791 | 18:53 |
*** wolverineav has quit IRC | 18:53 | |
AJaeger | clarkb, mordred, second part ^ | 18:53 |
*** lukebrowning has joined #openstack-infra | 18:54 | |
*** wolverineav has joined #openstack-infra | 18:55 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Use sphinx_output_suffix https://review.openstack.org/530791 | 18:55 |
pabelanger | AJaeger: that is starting to look pretty complicated^. Why can't we just default to html/ and not create sphinx_output_suffix | 18:56 |
AJaeger | pabelanger: for check and gate we need "html" to publish to the html subdir ;( | 18:57 |
AJaeger | but for post, we don't want it. | 18:57 |
pabelanger | AJaeger: where is that code again for check / gate? | 18:58 |
AJaeger | pabelanger: have a look at https://review.openstack.org/#/c/525734/ and the removal of sphinx_output_src | 18:58 |
AJaeger | pabelanger: it's the same role in zuul-jobs | 18:58 |
AJaeger | pabelanger: if you or mordred have a better idea - welcome to see that! | 18:59 |
*** tesseract has quit IRC | 18:59 | |
clarkb | ok back | 18:59 |
*** lukebrowning has quit IRC | 18:59 | |
clarkb | pabelanger: while there may have been a blip on the 23rd I don't know that that is the problem since we have writes to the RW volume on the 30th | 18:59 |
clarkb | pabelanger: I'm wondering if we deleted the host that does the cron to publish to RO volume or something like that as part of the trusty to xenial stuff | 19:00 |
* clarkb looks to find where we do that 5 minute cron | 19:00 | |
pabelanger | AJaeger: yah, I'll have to catch up on docs reorg, did know we removed sphinx_output_src | 19:00 |
*** jkilpatr has joined #openstack-infra | 19:00 | |
AJaeger | clarkb: note that http://files.openstack.org/docs/openstack-helm/html does not exist while /afs/.openstack.org/docs/openstack-helm/html exists | 19:01 |
clarkb | AJaeger: ya that is why I think its a vos release problem | 19:01 |
AJaeger | pabelanger: we can revert the part of 525734 and reintroduce sphinx_output_src for the post jobs. | 19:01 |
AJaeger | pabelanger: if you prefer that solution, I can do it... | 19:01 |
*** heyongli has quit IRC | 19:02 | |
*** heyongli has joined #openstack-infra | 19:03 | |
pabelanger | clarkb: Hmm, was it on afsdb01.o.o? If so, I am not able to SSH to that server currently | 19:03 |
openstackgerrit | Merged openstack-infra/project-config master: Add neutron-lib-commit group https://review.openstack.org/529661 | 19:04 |
clarkb | pabelanger: ya site.pp says it is the host with afsrelease included | 19:04 |
Shrews | umm, meeting now?? | 19:04 |
corvus | yeah, the auto-release thing is a cron job that only runs on one host | 19:05 |
*** lukebrowning has joined #openstack-infra | 19:05 | |
pabelanger | wonder if host was live migrated | 19:05 |
clarkb | Shrews: yes sorry I had to akf then distracted by afs things | 19:05 |
*** priteau has joined #openstack-infra | 19:08 | |
*** lukebrowning has quit IRC | 19:10 | |
*** lukebrowning has joined #openstack-infra | 19:11 | |
*** priteau has quit IRC | 19:11 | |
*** priteau has joined #openstack-infra | 19:12 | |
*** heyongli has quit IRC | 19:13 | |
*** heyongli has joined #openstack-infra | 19:13 | |
*** priteau has quit IRC | 19:13 | |
*** priteau has joined #openstack-infra | 19:14 | |
*** lukebrowning has quit IRC | 19:16 | |
*** wolverineav has quit IRC | 19:17 | |
*** lukebrowning has joined #openstack-infra | 19:17 | |
*** wolverineav has joined #openstack-infra | 19:19 | |
NobodyCam | happy New Year To all the awesome Infra folk! | 19:21 |
*** zerick has joined #openstack-infra | 19:22 | |
*** lukebrowning has quit IRC | 19:22 | |
Shrews | NobodyCam: you too! | 19:23 |
NobodyCam | :) | 19:23 |
*** heyongli has quit IRC | 19:23 | |
*** heyongli has joined #openstack-infra | 19:23 | |
mordred | hogepodge: saw a mentoin in the meeting channel - ping me if you have any issues realted to doc PTI things | 19:24 |
*** lukebrowning has joined #openstack-infra | 19:24 | |
AJaeger | mordred: please read backscroll - and see https://review.openstack.org/530790 and https://review.openstack.org/530791 | 19:24 |
mordred | AJaeger: okie - will do - still catching up post-break | 19:25 |
AJaeger | mordred: alternative: revert part of 525734 - reintroduce sphinx_output_src for the post jobs. | 19:25 |
AJaeger | thanks, mordred | 19:25 |
*** dbecker has quit IRC | 19:25 | |
AJaeger | mordred: and feel free to take over the changes if you have better ideas - I won't be around for much longer today... | 19:26 |
mordred | AJaeger: those look good on first glance - out of curiosity, why not just remove the html part always? | 19:26 |
mordred | AJaeger: (I thnk either way is fine, mostly wondering if there is a use-case or aconcern I might be missing) | 19:27 |
AJaeger | mordred: check/gate preview publishing | 19:27 |
AJaeger | mordred: http://logs.openstack.org/90/530790/1/check/build-openstack-sphinx-docs/6d2c3c0/html/ is our location there | 19:27 |
AJaeger | but we could reorganize that and publish the *target* to html perhaps? | 19:28 |
AJaeger | didn't look at that option | 19:28 |
mordred | yah - that's what I was starting to think - but I haven't thought about it for long enough to know whether it's a better or worse idea ... | 19:28 |
AJaeger | neither have I... | 19:29 |
*** lukebrowning has quit IRC | 19:29 | |
*** lukebrowning has joined #openstack-infra | 19:30 | |
*** heyongli has quit IRC | 19:33 | |
*** heyongli has joined #openstack-infra | 19:33 | |
*** lukebrowning has quit IRC | 19:35 | |
ssbarnea | do we have any openstack gerrit projects where gates are triggered only after someone adds a label to gerrit? if so, which ones? i want to know the label name used for this case. note that this is not "Code-Review" one. | 19:37 |
clarkb | dmsimard: talking freenode spam in #openstack-meeting now | 19:38 |
dmsimard | saw the meeting notification but got sidetracked, joining | 19:39 |
clarkb | ssbarnea: gate requires a +1 workflow vote | 19:39 |
ssbarnea | clarkb: ok, i imagined this but failed to find documentation for "Workflow" label. | 19:40 |
*** dimak has joined #openstack-infra | 19:40 | |
clarkb | ssbarnea: its a label we add to Gerrit. Not sure what documentation you are looking for | 19:40 |
ssbarnea | clarkb: so "Workflow" meaning is: "looks safe to be tested by CI". | 19:40 |
clarkb | ssbarnea: no, workflow has three states: 0, default. +1 approved means this should go through gate testing and if that psses merge the change. -1 Work in progress (do not merge) | 19:41 |
ssbarnea | clarkb: is there any relation between Code-Review label in Workflow one? Or they are used parallel? (merge will happen only when Code-Review + Workflow + Verified are present with +2 or +! values) | 19:43 |
openstackgerrit | Merged openstack-infra/system-config master: Treat mail sent to superuser-owner as spam https://review.openstack.org/530785 | 19:43 |
clarkb | ssbarnea: they are used in parallel, correct all of them need to have the positive votes | 19:43 |
*** heyongli has quit IRC | 19:43 | |
*** heyongli has joined #openstack-infra | 19:44 | |
ssbarnea | clarkb: thanks! | 19:44 |
*** heyongli has quit IRC | 19:54 | |
*** heyongli has joined #openstack-infra | 19:54 | |
*** lukebrowning has joined #openstack-infra | 19:56 | |
dmsimard | corvus: so it appears that we indeed removed the mlock settings on channels such as #shade (thus breaking the forward). Do we have a list of those channels somewhere ? | 19:59 |
corvus | dmsimard: not that i'm aware | 19:59 |
*** d0ugal has quit IRC | 20:00 | |
corvus | dmsimard: adding mlock support to accessbot might be a way of keeping such a list for the future, however. | 20:00 |
*** lukebrowning has quit IRC | 20:01 | |
corvus | dmsimard: if we're lucky, there may be mentions in the infrastructure status log | 20:01 |
dmsimard | digging right now | 20:01 |
*** heyongli has quit IRC | 20:04 | |
*** shardy has quit IRC | 20:04 | |
*** heyongli has joined #openstack-infra | 20:04 | |
corvus | dmsimard: i don't see any there other than shade :( | 20:05 |
pabelanger | offline for a bit while I relocate again | 20:06 |
*** lukebrowning has joined #openstack-infra | 20:06 | |
dmsimard | I know that, for example, #kolla was renamed to #openstack-kolla and the redirection is still in place .. but #kolla is also no longer in accessbot's list | 20:07 |
clarkb | I confirm that afsdb01 is not sshable | 20:07 |
frickler | the channel was #openstack-shade and that redirects fine for me | 20:07 |
clarkb | openstack says its active | 20:07 |
dmsimard | #shade is no longer there as well | 20:07 |
clarkb | I'm goingto check its console really quickly but expect that its a victim of the live migration stuff we've seen fial periodically recently | 20:08 |
clarkb | corvus: ^ anything special I should account for if I hard reboot that instnace via the openstack api? | 20:08 |
frickler | note the redirect only works if you are not joined to #openstack-sdks already | 20:08 |
dmsimard | hmmm, yeah #shade seems something entirely different and the registration doesn't show anything openstack related | 20:08 |
corvus | dmsimard, frickler: oh in that case, maybe we're lucky enough that none of those are in the list now. | 20:08 |
corvus | clarkb: no... theoretically it should resync with afsdb02 | 20:09 |
corvus | i have to run grab lunch, biab. | 20:09 |
*** mgoddard has quit IRC | 20:10 | |
mordred | dmsimard, corvus: perhaps the #shade channel pre-dates the registration system and we never fully migrated it over? | 20:10 |
*** larainema has quit IRC | 20:10 | |
dmsimard | mordred: was #shade ever a thing ? It seems to have been registered by "ffmad" more than 3 years ago | 20:11 |
*** lukebrowning has quit IRC | 20:11 | |
clarkb | ya lots of kernel hung task timeouts on afsdb01 which is what we've seen with the failed live migrations | 20:11 |
clarkb | hard rebooting it now | 20:11 |
clarkb | ok reboot is done | 20:13 |
clarkb | it should run the vos release for docs at 2015UTC | 20:13 |
dmsimard | asking #freenode about general advice how to best manage our channels "at scale", they do mention an interesting bit in that you can enable the chanserv verbose mode to have it echo changes to the operators (channel operators? chanserv operators? not sure) | 20:13 |
mordred | dmsimard: oh - maybe not - maybe it was just #openstack-shade | 20:13 |
*** dbecker has joined #openstack-infra | 20:13 | |
*** heyongli has quit IRC | 20:14 | |
dmsimard | ah, but the help message only mentions it echoes access list changes | 20:14 |
*** Goneri has quit IRC | 20:14 | |
*** heyongli has joined #openstack-infra | 20:14 | |
mordred | dmsimard: if you're starting to get sucked in to hacking on irc things - are you aware of the long-standing intent to rework the bots to be a single errbot bot? (and by single bot, I actually mean scale-out-collection of copies of a single bot, because of channel limits) | 20:15 |
dmsimard | I discussed that with harlowja a while back since I've used errbot before (and we use it right now for RDO) but I'm not aware of anyone working on that right now | 20:16 |
*** slaweq has joined #openstack-infra | 20:16 | |
mordred | dmsimard: oh - definitely nobody is working on it | 20:16 |
dmsimard | iirc harlowja ended up writing his own bot framework for his stuff | 20:16 |
harlowja | ya, SpamapS can vouch for it, lol | 20:16 |
harlowja | i'll prob just opensource it :-P | 20:16 |
harlowja | and then people can use it, lol | 20:16 |
mordred | dmsimard: I just figured I'd let you know that it's been on the todo listfor forever in case you get ragey and wind up wanting to hack on that | 20:17 |
harlowja | its better than errbot (though its targeted at slack, not being a driver-based-all-backends crap) | 20:17 |
mordred | harlowja: oh, well, targetted at slack probably won't help us too much :) | 20:17 |
harlowja | down with IRC, lol | 20:17 |
harlowja | lol | 20:17 |
mordred | the driver-based-all-backends was actually one of the reasons we were looking at errbot (so that people running infra clones inside of companies where they used not-irc could re-use stuff we've got) | 20:18 |
dmsimard | mordred: I'd love to tbh, errbot is great to work with -- here, let me put it on my never-ending list of things I'd like to do :p | 20:18 |
harlowja | ya, driver crap is driver crap, imho | 20:18 |
mordred | harlowja: tell me about it | 20:18 |
*** d0ugal has joined #openstack-infra | 20:18 | |
harlowja | u get what u pay for with driver LCD crap | 20:18 |
harlowja | lol | 20:18 |
harlowja | that's in part why i said ummm, ya, no thx to errbot | 20:18 |
harlowja | lol | 20:18 |
mordred | dmsimard: main 'hurdle' with errbot is that in its current form it wants config to be done via IRC commands, which is obviously not how we want to configure it | 20:18 |
dmsimard | mordred: yeah.. it's been that way before but they've moved a lot in recent months, maybe worth looking at it again. They don't even support python2 anymore | 20:19 |
mordred | harlowja: yah - #1 priority on our side is handling IRC *well* - supporting non-IRC is a nice-to-have but certainly not essential or anything | 20:19 |
clarkb | I mean we're talking a bot that has to write 512 byte messages to message busses | 20:19 |
clarkb | its not like the LCD is lacking in features | 20:19 |
harlowja | so that starts to get into how useful u want a bot to be | 20:20 |
mordred | ooh | 20:20 |
mordred | http://errbot.io/en/latest/user_guide/setup.html#id1 | 20:20 |
openstackgerrit | Merged openstack-infra/system-config master: Treat mail sent to foundation-board-owner as spam https://review.openstack.org/530788 | 20:20 |
dmsimard | mordred: that's not new | 20:20 |
mordred | it's not? poo | 20:20 |
dmsimard | mordred: you could always use config.py and then have your plugins pull from that (that's what we do for RDO) | 20:21 |
dmsimard | but there are certain things that don't work that way | 20:21 |
mordred | ah. gotcha | 20:21 |
dmsimard | or at least back when I last tried it | 20:21 |
dmsimard | https://github.com/rdo-infra/ansible-role-rdo-bot/blob/master/tasks/setup.yml#L66-L69 | 20:21 |
clarkb | vos release for docs is still going | 20:21 |
clarkb | (taking more than 5 minutes but we don't have multiple processes) | 20:21 |
*** rfolco has quit IRC | 20:22 | |
pabelanger | http://git.openstack.org/cgit/openstack-infra/err2d2/ :) | 20:22 |
dmsimard | mordred: oh, this is new though and fixes exactly our problem: http://errbot.io/en/latest/user_guide/provisioning.html | 20:22 |
pabelanger | best repo name | 20:22 |
mordred | dmsimard: ++ | 20:23 |
*** dbecker has quit IRC | 20:24 | |
mordred | dmsimard: that seems fairly perfect - we could have our config in yaml and then just write a tiny thing that reads it and pipes it to errbot --storage-set | 20:24 |
dmsimard | something like that | 20:24 |
*** heyongli has quit IRC | 20:24 | |
mordred | dmsimard: I mean, we could just store things in python dict format so it's just 'cat foo.py | errbot --storage-set' ... but the other thing seems pretty trivial | 20:24 |
jaypipes | as long as it doesn't jaypipes it, I'm fine. | 20:25 |
*** heyongli has joined #openstack-infra | 20:25 | |
dmsimard | a wild jaypipes has appeared | 20:25 |
jaypipes | :P | 20:25 |
mordred | jaypipes: nothing is possible without jaypipesing things | 20:25 |
jaypipes | lol | 20:25 |
* jaypipes goes back to reading about UEFI | 20:25 | |
dmsimard | mordred: you could even *gasp* make an idempotent ansible module that does a get on the config before doing a set so you'd know if it changed | 20:26 |
clarkb | AJaeger: http://files.openstack.org/docs/openstack-helm/html/ exists now so I think once we fix the job side of things it will be all happy again | 20:26 |
mordred | dmsimard: ++ | 20:26 |
*** jkilpatr has quit IRC | 20:27 | |
clarkb | and with that I need to figure out lunch plans | 20:27 |
mordred | dmsimard: so - since that exists now - the largest amount of work, iirc, is porting our meetbot code to be an errbot plugin | 20:27 |
dmsimard | meetbot is a debian thing right ? | 20:27 |
dmsimard | there's probably no way it can be ported as-is | 20:28 |
dmsimard | but we can probably write something similar-ish | 20:28 |
mordred | dmsimard: well, it started that way, but we have an openstack fork: http://git.openstack.org/cgit/openstack-infra/meetbot | 20:28 |
mordred | dmsimard: but yah - it'll certainly an amount of porting effort - which may involve just rewriting from scratch based on design, or may be able to use *some* of the code | 20:29 |
clarkb | mordred: pabelanger AJaeger ok I think the last thing to sort out now is the html/ stuff | 20:30 |
*** iyamahat has quit IRC | 20:30 | |
clarkb | then maybe clean out all the unwatned html/ dirs and tell projects they may need to merge new changes to get updates | 20:30 |
mordred | clarkb: cool - I've got AJaeger's changes open, will engage with that in just a sec | 20:31 |
pabelanger | clarkb: yah, I'm going to see if I can get a console on afsdb01.o.o, still not able to SSH to it | 20:32 |
pabelanger | oh | 20:33 |
pabelanger | it just worked | 20:33 |
pabelanger | 2018-01-02 20:35:01,351 release INFO Checking docs | 20:33 |
pabelanger | just started again | 20:33 |
pabelanger | so, somebody restart it? | 20:33 |
clarkb | pabelanger: ya I did | 20:33 |
*** lukebrowning has joined #openstack-infra | 20:33 | |
pabelanger | 2017-12-23 02:50:01,753 release DEBUG afs01.ord.openstack.org /vicepa 2017-12-23 00:25:59 docs.dev.readonly | 20:33 |
pabelanger | was last | 20:33 |
clarkb | I chceked the console first it had the kernel hung task messages | 20:33 |
pabelanger | kk | 20:33 |
pabelanger | cool | 20:33 |
clarkb | which is what we've seen with the failed live migrations | 20:34 |
pabelanger | yah, see backscoll now | 20:34 |
*** dangers_away has quit IRC | 20:34 | |
*** heyongli has quit IRC | 20:35 | |
*** heyongli has joined #openstack-infra | 20:35 | |
*** yamahata has quit IRC | 20:35 | |
*** e0ne has joined #openstack-infra | 20:37 | |
*** dangers_away has joined #openstack-infra | 20:38 | |
*** erlon has quit IRC | 20:38 | |
*** lukebrowning has quit IRC | 20:38 | |
*** lukebrowning has joined #openstack-infra | 20:41 | |
harlowja | mordred dmsimard u guys can steal from https://github.com/harlowja/gerritbot2/blob/master/plugins/gerritbot/gerritbot.py also if u want | 20:41 |
harlowja | https://github.com/harlowja/gerritbot2/blob/master/plugins/gerritbot/gerritbot.py#L203 ya da ya da | 20:41 |
*** jkilpatr has joined #openstack-infra | 20:41 | |
harlowja | i really didn't like the whole configuration method of errbot | 20:41 |
harlowja | it seemed ummmm, sorta ummmm, overdone, lol | 20:42 |
*** kgiusti has quit IRC | 20:42 | |
*** heyongli has quit IRC | 20:45 | |
*** heyongli has joined #openstack-infra | 20:45 | |
*** lukebrowning has quit IRC | 20:45 | |
*** catintheroof has quit IRC | 20:46 | |
*** catintheroof has joined #openstack-infra | 20:46 | |
*** lukebrowning has joined #openstack-infra | 20:47 | |
*** e0ne has quit IRC | 20:47 | |
*** armax has quit IRC | 20:49 | |
*** e0ne has joined #openstack-infra | 20:51 | |
*** catintheroof has quit IRC | 20:51 | |
*** lukebrowning has quit IRC | 20:51 | |
*** lukebrowning has joined #openstack-infra | 20:52 | |
*** smatzek has quit IRC | 20:54 | |
*** smatzek has joined #openstack-infra | 20:55 | |
*** smatzek has quit IRC | 20:55 | |
*** heyongli has quit IRC | 20:55 | |
*** smatzek has joined #openstack-infra | 20:55 | |
*** heyongli has joined #openstack-infra | 20:55 | |
*** lukebrowning has quit IRC | 20:56 | |
dmsimard | harlowja: so it relies on firehose/mqtt then ? is that how the current gerritbot works ? /me has no idea | 20:57 |
harlowja | i think the current one does now use mqtt yes | 20:57 |
dmsimard | I figured the bot connected directly to the gerrit event stream | 20:57 |
harlowja | it used to afaik | 20:57 |
harlowja | don't think it does anymore | 20:57 |
harlowja | ssh keys and blah blah were required | 20:57 |
*** kgiusti has joined #openstack-infra | 21:00 | |
*** smatzek has quit IRC | 21:00 | |
*** jkilpatr has quit IRC | 21:04 | |
*** jlk` has joined #openstack-infra | 21:05 | |
openstackgerrit | Alex Krzos proposed openstack-infra/grafyaml master: Add support to change the default time filter range https://review.openstack.org/530798 | 21:05 |
*** heyongli has quit IRC | 21:05 | |
*** heyongli has joined #openstack-infra | 21:06 | |
*** jlk has quit IRC | 21:06 | |
openstackgerrit | Alex Krzos proposed openstack-infra/grafyaml master: Add legend for graphs https://review.openstack.org/530799 | 21:09 |
*** slaweq_ has joined #openstack-infra | 21:13 | |
*** slaweq_ has quit IRC | 21:14 | |
*** jlk` is now known as jlk | 21:15 | |
*** heyongli has quit IRC | 21:16 | |
*** jlk has quit IRC | 21:16 | |
*** jlk has joined #openstack-infra | 21:16 | |
*** heyongli has joined #openstack-infra | 21:16 | |
*** Swanson has joined #openstack-infra | 21:18 | |
*** armax has joined #openstack-infra | 21:19 | |
*** Goneri has joined #openstack-infra | 21:22 | |
*** markmcclain has quit IRC | 21:25 | |
*** heyongli has quit IRC | 21:26 | |
*** heyongli has joined #openstack-infra | 21:26 | |
*** markmcclain has joined #openstack-infra | 21:28 | |
*** aeng has joined #openstack-infra | 21:30 | |
*** jkilpatr has joined #openstack-infra | 21:33 | |
dmsimard | infra-root: an hopefully simple review to add date/time to our bash history: https://review.openstack.org/#/c/529428/ | 21:33 |
corvus | +2 but leaving for more infra-roots to see | 21:35 |
dmsimard | yeah, that's the intent | 21:35 |
mordred | same here - +2 but leaving for more infra-roots | 21:36 |
*** heyongli has quit IRC | 21:36 | |
*** heyongli has joined #openstack-infra | 21:36 | |
*** kgiusti has left #openstack-infra | 21:37 | |
*** eharney has quit IRC | 21:41 | |
*** jcoufal has quit IRC | 21:42 | |
*** rcernin has joined #openstack-infra | 21:45 | |
*** priteau has quit IRC | 21:45 | |
*** hongbin has quit IRC | 21:45 | |
*** heyongli has quit IRC | 21:46 | |
*** dave-mccowan has quit IRC | 21:47 | |
*** heyongli has joined #openstack-infra | 21:47 | |
*** wolverineav has quit IRC | 21:47 | |
*** jaypipes has quit IRC | 21:51 | |
*** heyongli has quit IRC | 21:57 | |
*** heyongli has joined #openstack-infra | 21:57 | |
*** slaweq has quit IRC | 21:59 | |
*** trown|rover is now known as trown|outtypewww | 21:59 | |
*** heyongli has quit IRC | 22:07 | |
*** heyongli has joined #openstack-infra | 22:07 | |
*** heyongli has quit IRC | 22:17 | |
*** heyongli has joined #openstack-infra | 22:17 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Support cross-source dependencies https://review.openstack.org/530806 | 22:21 |
*** jascott1 has quit IRC | 22:26 | |
*** jascott1 has joined #openstack-infra | 22:26 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: Remove legacy beaker jobs from Puppet OpenStack modules https://review.openstack.org/530807 | 22:26 |
*** heyongli has quit IRC | 22:27 | |
*** jascott1 has quit IRC | 22:28 | |
*** heyongli has joined #openstack-infra | 22:28 | |
*** jascott1 has joined #openstack-infra | 22:28 | |
*** bobh has quit IRC | 22:28 | |
*** jascott1 has quit IRC | 22:30 | |
*** heyongli has quit IRC | 22:38 | |
*** heyongli has joined #openstack-infra | 22:38 | |
*** catintheroof has joined #openstack-infra | 22:46 | |
clarkb | lunch always takes twice as long when having it with family | 22:46 |
* clarkb pulls up docs fixs | 22:46 | |
*** heyongli has quit IRC | 22:48 | |
*** heyongli has joined #openstack-infra | 22:48 | |
openstackgerrit | Clark Boylan proposed openstack-infra/zuul-jobs master: Fix sphinx publishing https://review.openstack.org/530790 | 22:49 |
clarkb | minor fix to the docs really quickly since it didn't have any +2s yet | 22:49 |
clarkb | pabelanger: mordred corvus dmsimard ^ reviews on that and 530791 much appreciated | 22:49 |
clarkb | dmsimard: corvus ara updates on executors is working now right? | 22:57 |
clarkb | looks like ze04 is out to lunch. I will check in on its console and reboot it if it has the hung task messages | 22:58 |
*** heyongli has quit IRC | 22:58 | |
*** heyongli has joined #openstack-infra | 22:58 | |
Swanson | retry_limit is one I've never seen before. | 22:59 |
clarkb | Swanson: means your job failed in the pre/setup phase multiple times (we retry jobs if they fail there until the retry limit) | 23:00 |
clarkb | Swanson: checking ara is typically a good way to see what is failing | 23:00 |
corvus | maybe we should rename that result to 'pre_failure' | 23:00 |
*** iyamahat has joined #openstack-infra | 23:00 | |
Swanson | clarkb, ara? | 23:01 |
Swanson | nevermind | 23:02 |
clarkb | Swanson: it is part of your job logs on failure, its a nice rendering of the ansible run | 23:02 |
clarkb | mtreinish: are the subunit2sql issues at the bottom of https://etherpad.openstack.org/p/zuulv3-issues addressed at this point? the two changes listed there merged | 23:05 |
clarkb | andreaf: ^ you may know | 23:05 |
*** hashar has quit IRC | 23:05 | |
mordred | clarkb: ok. both +A'd - I think we could improve on it, but I think unbreaking is more important and we can swing back by and improve later | 23:05 |
*** heyongli has quit IRC | 23:08 | |
*** heyongli has joined #openstack-infra | 23:09 | |
*** jascott1 has joined #openstack-infra | 23:12 | |
*** jtomasek has quit IRC | 23:17 | |
*** yamahata has joined #openstack-infra | 23:18 | |
clarkb | ya ze04 exhibits the hung task timeout message on its console going to hard reboot it now | 23:18 |
clarkb | the other ze's and zm's seem fine though | 23:18 |
*** heyongli has quit IRC | 23:19 | |
*** edmondsw has quit IRC | 23:19 | |
*** heyongli has joined #openstack-infra | 23:19 | |
*** edmondsw has joined #openstack-infra | 23:19 | |
clarkb | ze04 has a bunch of leaked builds in /var/lib/zuul/builds so going to delete those before starting services | 23:20 |
*** edmondsw has quit IRC | 23:24 | |
corvus | clarkb: what's the gist of 'hung task timeout'? | 23:25 |
clarkb | corvus: when rax does live migrations sometimes they fail and the failures exhibit as the kernel complaining about hung tasks timing out | 23:26 |
corvus | clarkb: gotcha, thx | 23:26 |
*** ijw has quit IRC | 23:26 | |
clarkb | corvus: my hunch is that when the live migration does the suspend of the old host, then copy of memory delta, then start again on the other side sometimes that memory delta copy takes long enough that linux is very unhappy when it "starts" again | 23:26 |
*** ijw_ has joined #openstack-infra | 23:26 | |
clarkb | corvus: any idea why lists.openstack.org is still in the emergency file for ansible puppetry? | 23:27 |
clarkb | also puppet run all log shows we have some keystone failures when building inventory. I am going to look into that next | 23:27 |
corvus | clarkb: oh, i thought i removed it, let me dig | 23:27 |
corvus | clarkb: we need https://review.openstack.org/529893 | 23:28 |
corvus | clarkb: and https://review.openstack.org/529895 | 23:28 |
corvus | infra-root: ^ | 23:28 |
* clarkb looks | 23:29 | |
*** heyongli has quit IRC | 23:29 | |
*** heyongli has joined #openstack-infra | 23:29 | |
clarkb | oh I worte the one change so won't approve it | 23:29 |
*** pahuang has joined #openstack-infra | 23:32 | |
clarkb | infra-root much appreciated if you can review https://review.openstack.org/#/c/529893/ so that puppet can puppet lists.o.o again | 23:35 |
mordred | clarkb: done | 23:38 |
clarkb | mordred: also don't go anywhere I'm about to try and figure out hwich cloud is 401ing keystone | 23:38 |
*** heyongli has quit IRC | 23:39 | |
*** heyongli has joined #openstack-infra | 23:39 | |
*** tosky has quit IRC | 23:39 | |
clarkb | its ovh | 23:40 |
clarkb | and its only to the openstackci-ovh creds not the openstackjenkins-ovh creds | 23:43 |
*** e0ne has quit IRC | 23:45 | |
clarkb | hrm ze04 zuul-executor service doesn't appear to be starting properly | 23:45 |
clarkb | I think we need to disable ovh | 23:48 |
clarkb | the mirror nodes unping and the openstackci-ovh account unpings | 23:48 |
*** e0ne has joined #openstack-infra | 23:49 | |
clarkb | is someone able to do that while I debug ze04? | 23:49 |
*** heyongli has quit IRC | 23:49 | |
*** heyongli has joined #openstack-infra | 23:50 | |
mordred | clarkb: yah - on it - all of ovh? | 23:51 |
clarkb | mordred: I think so. both mirrors are gone (but you should double check that assertion) | 23:51 |
clarkb | systemd says zuul-executor exited with return code 0 | 23:52 |
clarkb | Process: 1507 ExecStart=/etc/init.d/zuul-executor start (code=exited, status=0/SUCCESS) so confused. I guess I try to start it in the foreground? (there are no logs that help) | 23:52 |
openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Disable OVH https://review.openstack.org/530817 | 23:54 |
openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Revert "Disable OVH" https://review.openstack.org/530818 | 23:54 |
mordred | clarkb: ^^ there's the disable and then a patch for later to re-enable | 23:54 |
clarkb | mordred: +2, thanks | 23:55 |
*** olaph has quit IRC | 23:55 | |
clarkb | the executor socket is not being recreated so we aren't making it that far | 23:56 |
mordred | clarkb: and yes, I verify independently that the ovh account is unhappy | 23:57 |
*** olaph has joined #openstack-infra | 23:57 | |
clarkb | mordred: I wonder if that account met the fate of the other account, basically running out of funds or however they comp it | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!