*** wolverineav has joined #openstack-infra | 00:00 | |
*** wolverineav has quit IRC | 00:05 | |
*** gmann has quit IRC | 00:05 | |
*** gmann has joined #openstack-infra | 00:05 | |
*** Guest16483 has quit IRC | 00:06 | |
*** annegentle has joined #openstack-infra | 00:08 | |
*** annegentle is now known as Guest2799 | 00:09 | |
*** wolverineav has joined #openstack-infra | 00:12 | |
*** hongbin_ has joined #openstack-infra | 00:15 | |
*** hongbin has quit IRC | 00:15 | |
*** wolverineav has quit IRC | 00:17 | |
*** wolverineav has joined #openstack-infra | 00:18 | |
*** Guest2799 has quit IRC | 00:22 | |
*** zz_dimtruck is now known as dimtruck | 00:26 | |
*** hongbin has joined #openstack-infra | 00:37 | |
*** hongbin_ has quit IRC | 00:37 | |
*** wolverineav has quit IRC | 00:38 | |
openstackgerrit | Anne Gentle proposed openstack-infra/reviewstats master: Adds api-ref, docs, or installdocs statistics measures https://review.openstack.org/461280 | 00:39 |
---|---|---|
*** baoli has joined #openstack-infra | 00:43 | |
*** baoli has quit IRC | 00:43 | |
*** alex_xu has quit IRC | 00:49 | |
openstackgerrit | Rosario Di Somma proposed openstack-infra/shade master: Don't remove top-container element for user and project REST API calls https://review.openstack.org/475150 | 00:49 |
*** hongbin has quit IRC | 00:52 | |
*** alex_xu has joined #openstack-infra | 00:54 | |
*** lbragstad has joined #openstack-infra | 01:08 | |
*** cshastri has joined #openstack-infra | 01:11 | |
*** ihrachys has joined #openstack-infra | 01:11 | |
*** jamesmcarthur has joined #openstack-infra | 01:12 | |
*** jamesmcarthur has quit IRC | 01:13 | |
*** jamesmcarthur has joined #openstack-infra | 01:13 | |
*** ihrachys has quit IRC | 01:13 | |
*** Julien-zte has quit IRC | 01:16 | |
*** jamesmcarthur has quit IRC | 01:18 | |
*** SumitNaiksatam has quit IRC | 01:18 | |
*** SumitNaiksatam has joined #openstack-infra | 01:19 | |
openstackgerrit | Anne Gentle proposed openstack-infra/reviewstats master: Adds api-ref, docs, or installdocs statistics measures https://review.openstack.org/461280 | 01:23 |
*** baoli has joined #openstack-infra | 01:30 | |
*** wolverineav has joined #openstack-infra | 01:30 | |
*** baoli has quit IRC | 01:34 | |
*** wolverineav has quit IRC | 01:35 | |
*** ykarel_ has joined #openstack-infra | 01:36 | |
*** xinliang has quit IRC | 01:36 | |
*** markvoelker has joined #openstack-infra | 01:45 | |
*** bkero has quit IRC | 01:47 | |
*** xinliang has joined #openstack-infra | 01:48 | |
*** xinliang has quit IRC | 01:48 | |
*** xinliang has joined #openstack-infra | 01:48 | |
*** thorst has joined #openstack-infra | 01:49 | |
*** lbragstad has quit IRC | 01:51 | |
*** thorst has quit IRC | 01:53 | |
*** Julien-zte has joined #openstack-infra | 01:58 | |
*** Julien-zte has quit IRC | 02:06 | |
*** ykarel_ has quit IRC | 02:08 | |
*** gomarivera has joined #openstack-infra | 02:10 | |
*** gomarivera has quit IRC | 02:12 | |
*** gomarivera has joined #openstack-infra | 02:12 | |
*** Goneri has quit IRC | 02:13 | |
*** gomarivera_ has joined #openstack-infra | 02:16 | |
*** gomarivera has quit IRC | 02:16 | |
*** darvon has quit IRC | 02:18 | |
*** markvoelker has quit IRC | 02:18 | |
*** darvon has joined #openstack-infra | 02:20 | |
*** yamahata_ has joined #openstack-infra | 02:44 | |
*** thorst has joined #openstack-infra | 02:44 | |
*** thorst has quit IRC | 02:44 | |
*** Julien-zte has joined #openstack-infra | 02:54 | |
*** bkero has joined #openstack-infra | 03:10 | |
*** bkero has quit IRC | 03:11 | |
*** bkero has joined #openstack-infra | 03:11 | |
*** yamamoto has joined #openstack-infra | 03:11 | |
*** Julien-zte has quit IRC | 03:23 | |
*** yamahata_ has quit IRC | 03:24 | |
*** wolverineav has joined #openstack-infra | 03:30 | |
*** pradk has quit IRC | 03:34 | |
*** wolverineav has quit IRC | 03:35 | |
*** wolverineav has joined #openstack-infra | 03:37 | |
*** wolverineav has quit IRC | 03:39 | |
*** wolverineav has joined #openstack-infra | 03:39 | |
*** Goneri has joined #openstack-infra | 03:41 | |
*** isaacb has joined #openstack-infra | 03:45 | |
*** isaacb has quit IRC | 03:51 | |
*** yamamoto has quit IRC | 03:52 | |
*** pradk has joined #openstack-infra | 03:54 | |
*** peterstac has joined #openstack-infra | 04:00 | |
*** dhinesh has joined #openstack-infra | 04:01 | |
*** vgnbkr has joined #openstack-infra | 04:01 | |
*** ianychoi has quit IRC | 04:02 | |
*** schang has joined #openstack-infra | 04:03 | |
*** dougshelley66 has joined #openstack-infra | 04:03 | |
*** watersoul_ has quit IRC | 04:03 | |
*** watersoul has joined #openstack-infra | 04:04 | |
*** ramishra has joined #openstack-infra | 04:05 | |
*** markvoelker has joined #openstack-infra | 04:15 | |
*** isaacb has joined #openstack-infra | 04:17 | |
*** yamamoto has joined #openstack-infra | 04:19 | |
*** isaacb has quit IRC | 04:21 | |
*** yamamoto has quit IRC | 04:29 | |
*** thorst has joined #openstack-infra | 04:45 | |
*** yamamoto has joined #openstack-infra | 04:46 | |
*** markvoelker has quit IRC | 04:50 | |
*** thorst has quit IRC | 04:50 | |
*** salv-orl_ has quit IRC | 04:50 | |
*** salv-orlando has joined #openstack-infra | 04:51 | |
*** yamamoto has quit IRC | 04:51 | |
*** wolverineav has quit IRC | 05:01 | |
*** isaacb has joined #openstack-infra | 05:02 | |
*** ykarel_ has joined #openstack-infra | 05:03 | |
*** ramishra has quit IRC | 05:11 | |
*** salv-orl_ has joined #openstack-infra | 05:15 | |
*** salv-orlando has quit IRC | 05:18 | |
*** yamamoto has joined #openstack-infra | 05:25 | |
*** Dinesh_Bhor has quit IRC | 05:25 | |
*** Goneri has quit IRC | 05:26 | |
*** yamamoto has quit IRC | 05:26 | |
*** jascott1 has quit IRC | 05:28 | |
*** yamamoto has joined #openstack-infra | 05:28 | |
*** yamamoto has quit IRC | 06:23 | |
*** links has joined #openstack-infra | 06:37 | |
*** hieulq_ has joined #openstack-infra | 06:40 | |
*** dhinesh has quit IRC | 06:43 | |
*** thorst has joined #openstack-infra | 06:46 | |
*** markvoelker has joined #openstack-infra | 06:47 | |
*** rcernin has joined #openstack-infra | 06:49 | |
*** thorst has quit IRC | 06:51 | |
*** hieulq__ has joined #openstack-infra | 06:54 | |
*** hieulq_ has quit IRC | 06:55 | |
*** rcernin has quit IRC | 07:02 | |
*** rcernin has joined #openstack-infra | 07:02 | |
*** aviau has quit IRC | 07:02 | |
*** aviau has joined #openstack-infra | 07:03 | |
*** pradk has quit IRC | 07:10 | |
*** tesseract has joined #openstack-infra | 07:12 | |
*** isaacb has quit IRC | 07:14 | |
*** hieulq__ has quit IRC | 07:15 | |
*** markvoelker has quit IRC | 07:19 | |
*** yamamoto has joined #openstack-infra | 07:24 | |
*** yamamoto has quit IRC | 07:30 | |
*** tosky has joined #openstack-infra | 07:32 | |
*** yamamoto has joined #openstack-infra | 07:32 | |
*** yamamoto has quit IRC | 07:37 | |
*** jascott1 has joined #openstack-infra | 07:44 | |
openstackgerrit | Merged openstack-infra/project-config master: [magnum] Add experimental dcos job https://review.openstack.org/471776 | 07:58 |
*** andreww has joined #openstack-infra | 07:59 | |
*** zzzeek has quit IRC | 08:00 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Re-enable beaker tests for puppet-midonet https://review.openstack.org/470210 | 08:01 |
*** zzzeek has joined #openstack-infra | 08:02 | |
*** xarses has joined #openstack-infra | 08:02 | |
*** xarses has quit IRC | 08:02 | |
*** xarses has joined #openstack-infra | 08:03 | |
*** andreww has quit IRC | 08:04 | |
*** jamesmcarthur has joined #openstack-infra | 08:14 | |
*** markvoelker has joined #openstack-infra | 08:16 | |
openstackgerrit | Merged openstack-infra/project-config master: Re-enable beaker tests for puppet-midonet https://review.openstack.org/470210 | 08:17 |
*** HeOS has joined #openstack-infra | 08:17 | |
*** HeOS has quit IRC | 08:18 | |
*** jamesmcarthur has quit IRC | 08:18 | |
*** HeOS has joined #openstack-infra | 08:18 | |
*** lifeless has quit IRC | 08:20 | |
openstackgerrit | Merged openstack-infra/project-config master: jenkins: scripts: propose_update: Pass project directory as first argument https://review.openstack.org/471785 | 08:20 |
*** lifeless has joined #openstack-infra | 08:20 | |
openstackgerrit | Merged openstack-infra/project-config master: Add etcd3 to networking-generic-switch job https://review.openstack.org/472343 | 08:23 |
*** yamamoto has joined #openstack-infra | 08:24 | |
*** yamamoto has quit IRC | 08:26 | |
*** yolanda has quit IRC | 08:38 | |
*** yolanda has joined #openstack-infra | 08:41 | |
*** thorst has joined #openstack-infra | 08:47 | |
*** yamamoto has joined #openstack-infra | 08:49 | |
mtreinish | fungi: so I can now confirm that mqtt/firehose isn't being blocked in china (at least on my hotel's wifi) we might not need the websockets interface after all | 08:50 |
mtreinish | although it's probably still something useful to have | 08:50 |
*** markvoelker has quit IRC | 08:50 | |
*** yamamoto has quit IRC | 08:51 | |
*** thorst has quit IRC | 08:52 | |
*** links has quit IRC | 08:54 | |
*** yamamoto has joined #openstack-infra | 08:56 | |
*** yamamoto has quit IRC | 09:00 | |
*** yamamoto has joined #openstack-infra | 09:01 | |
*** yamamoto has quit IRC | 09:06 | |
openstackgerrit | Akihiro Motoki proposed openstack-infra/project-config master: Add neutron-fwaas-dashboard project https://review.openstack.org/475163 | 09:07 |
openstackgerrit | Akihiro Motoki proposed openstack-infra/project-config master: Add neutron-vpnaas-dashboard project https://review.openstack.org/475165 | 09:12 |
*** Julien-zte has joined #openstack-infra | 09:21 | |
openstackgerrit | Akihiro Motoki proposed openstack-infra/project-config master: Add neutron-vpnaas-dashboard project https://review.openstack.org/475165 | 09:32 |
openstackgerrit | Akihiro Motoki proposed openstack-infra/project-config master: Add neutron-vpnaas-dashboard project https://review.openstack.org/475165 | 09:34 |
openstackgerrit | Akihiro Motoki proposed openstack-infra/project-config master: Add neutron-fwaas-dashboard project https://review.openstack.org/475163 | 09:36 |
*** yamamoto has joined #openstack-infra | 09:38 | |
*** yamamoto has quit IRC | 09:43 | |
*** ykarel_ has quit IRC | 09:47 | |
*** thorst has joined #openstack-infra | 09:48 | |
*** armax has quit IRC | 09:52 | |
*** hieulq_ has joined #openstack-infra | 09:52 | |
*** thorst has quit IRC | 09:53 | |
*** armax has joined #openstack-infra | 09:53 | |
*** armax has quit IRC | 09:53 | |
*** armax has joined #openstack-infra | 09:53 | |
*** armax has quit IRC | 09:54 | |
*** armax has joined #openstack-infra | 09:54 | |
*** armax has quit IRC | 09:55 | |
*** armax has joined #openstack-infra | 09:55 | |
*** sshnaidm has quit IRC | 09:55 | |
*** armax has quit IRC | 09:55 | |
*** armax has joined #openstack-infra | 09:56 | |
*** armax has quit IRC | 09:56 | |
*** armax has joined #openstack-infra | 09:57 | |
*** armax has quit IRC | 09:57 | |
*** armax has joined #openstack-infra | 09:57 | |
*** armax has quit IRC | 09:58 | |
*** Julien-zte has quit IRC | 10:00 | |
*** cshastri has quit IRC | 10:05 | |
*** gouthamr has quit IRC | 10:05 | |
*** wfoster has quit IRC | 10:07 | |
*** wfoster has joined #openstack-infra | 10:08 | |
*** jamesmcarthur has joined #openstack-infra | 10:15 | |
*** jamesmcarthur has quit IRC | 10:19 | |
*** dhajare has joined #openstack-infra | 10:24 | |
*** HeOS has quit IRC | 10:41 | |
*** yamamoto has joined #openstack-infra | 10:43 | |
*** yamamoto has quit IRC | 10:46 | |
*** yamamoto has joined #openstack-infra | 10:46 | |
*** markvoelker has joined #openstack-infra | 10:48 | |
*** sshnaidm has joined #openstack-infra | 10:48 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config master: migrate periodic jobs on stable branches to oooq https://review.openstack.org/474736 | 10:50 |
*** ykarel_ has joined #openstack-infra | 10:56 | |
*** yamamoto has quit IRC | 11:12 | |
*** gomarivera_ has quit IRC | 11:13 | |
*** dhajare has joined #openstack-infra | 11:14 | |
*** salv-orlando has joined #openstack-infra | 11:15 | |
*** salv-orl_ has quit IRC | 11:18 | |
*** markvoelker has quit IRC | 11:21 | |
*** hieulq_ has quit IRC | 11:21 | |
*** hieulq_ has joined #openstack-infra | 11:22 | |
*** yamamoto has joined #openstack-infra | 11:24 | |
*** hieulq_ has quit IRC | 11:27 | |
*** Julien-zte has joined #openstack-infra | 11:40 | |
*** ykarel_ has quit IRC | 11:40 | |
*** thorst has joined #openstack-infra | 11:49 | |
*** thorst has quit IRC | 11:53 | |
*** jkilpatr has joined #openstack-infra | 12:00 | |
*** thorst has joined #openstack-infra | 12:03 | |
*** thorst has quit IRC | 12:03 | |
*** gomarivera has joined #openstack-infra | 12:10 | |
fungi | mtreinish: i agree with you on both points | 12:13 |
*** yamamoto has quit IRC | 12:14 | |
*** jamesmcarthur has joined #openstack-infra | 12:15 | |
fungi | i'm not so much concerned about the great wall but rather all the lesser walls various corporate overlords impose upon their employees who then need months of negotiating with the security team there to get egress allowed to some new specific port (and often, it only gets allowed by specific destination address, which makes replacing servers that much harder) | 12:15 |
*** gomarivera has quit IRC | 12:16 | |
*** markvoelker has joined #openstack-infra | 12:18 | |
*** jamesmcarthur has quit IRC | 12:19 | |
mordred | fungi: ++ | 12:23 |
*** abramley has joined #openstack-infra | 12:34 | |
*** Julien-zte has quit IRC | 12:43 | |
*** abramley has quit IRC | 12:46 | |
*** Julien-zte has joined #openstack-infra | 12:47 | |
*** e0ne has joined #openstack-infra | 12:48 | |
openstackgerrit | Merged openstack-infra/shade master: Don't remove top-container element for user and project REST API calls https://review.openstack.org/475150 | 12:48 |
openstackgerrit | Merged openstack-infra/shade master: Convert keypairs tests to requests_mock https://review.openstack.org/475090 | 12:48 |
openstackgerrit | Merged openstack-infra/shade master: Add normalization and functional tests for keypairs https://review.openstack.org/475134 | 12:48 |
*** markvoelker has quit IRC | 12:51 | |
openstackgerrit | Merged openstack-infra/shade master: Convert keypairs calls to REST https://review.openstack.org/475091 | 12:52 |
*** e0ne has quit IRC | 12:54 | |
*** gomarivera has joined #openstack-infra | 13:11 | |
*** jamesmcarthur has joined #openstack-infra | 13:14 | |
*** yamamoto has joined #openstack-infra | 13:15 | |
*** gomarivera has quit IRC | 13:16 | |
*** jamesmcarthur has quit IRC | 13:19 | |
*** yamamoto has quit IRC | 13:22 | |
*** dimtruck is now known as zz_dimtruck | 13:27 | |
*** dhajare has quit IRC | 13:38 | |
*** zz_dimtruck is now known as dimtruck | 13:46 | |
*** markvoelker has joined #openstack-infra | 13:49 | |
*** rcernin has quit IRC | 13:53 | |
*** dizquierdo has joined #openstack-infra | 14:02 | |
*** thorst has joined #openstack-infra | 14:04 | |
*** thorst has quit IRC | 14:09 | |
*** gomarivera has joined #openstack-infra | 14:12 | |
*** jascott1 has quit IRC | 14:16 | |
*** gomarivera has quit IRC | 14:17 | |
*** markvoelker has quit IRC | 14:22 | |
*** Julien-zte has quit IRC | 14:27 | |
*** Julien-zte has joined #openstack-infra | 14:29 | |
*** Julien-zte has joined #openstack-infra | 14:30 | |
*** Julien-zte has quit IRC | 14:30 | |
*** Julien-zte has joined #openstack-infra | 14:31 | |
*** Julien-zte has quit IRC | 14:32 | |
*** sshnaidm has quit IRC | 14:33 | |
*** Julien-zte has joined #openstack-infra | 14:33 | |
*** Julien-zte has quit IRC | 14:34 | |
*** lbragstad has joined #openstack-infra | 14:36 | |
*** jascott1 has joined #openstack-infra | 14:45 | |
*** anthonyper has quit IRC | 14:45 | |
*** anthonyper has joined #openstack-infra | 14:45 | |
*** andreww has joined #openstack-infra | 14:46 | |
*** lbragstad has quit IRC | 14:46 | |
*** xarses has quit IRC | 14:49 | |
*** tumbarka has joined #openstack-infra | 14:50 | |
*** andreww has quit IRC | 14:52 | |
*** umbarkar has quit IRC | 14:53 | |
fungi | infra-root: apparently the virtualenv on proposal.slave.o.o was creating python3.4-based environments by default, probably owing to the pip vs pip3 mishap from a few weeks ago | 15:05 |
fungi | i just fixed it by forcibly reinstalling virtualenv, but spot checking i find that release.slave.o.o is similarly affected so this may be more widespread than i expected | 15:05 |
fungi | fixed that one just now as well | 15:06 |
fungi | signing01.ci is also affected | 15:07 |
fungi | fixed too | 15:07 |
fungi | i need to step away to tackle some chores, but if anybody finds more a quick `sudo pip install -U --force virtualenv` seems to take care of it | 15:08 |
*** gomarivera has joined #openstack-infra | 15:13 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Remove use of FakeServer from tests https://review.openstack.org/475177 | 15:17 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert FakeSecGroup to dict https://review.openstack.org/475178 | 15:17 |
*** gomarivera has quit IRC | 15:17 | |
*** markvoelker has joined #openstack-infra | 15:19 | |
openstackgerrit | Hongbin Lu proposed openstack-infra/project-config master: [Zun] Turn dsvm job to voting https://review.openstack.org/471842 | 15:22 |
*** hongbin has joined #openstack-infra | 15:22 | |
*** sshnaidm has joined #openstack-infra | 15:26 | |
*** bobh has joined #openstack-infra | 15:28 | |
*** hongbin_ has joined #openstack-infra | 15:31 | |
odyssey4me | fungi should we still be seeing DNS resolution failures in tests? | 15:33 |
*** e0ne has joined #openstack-infra | 15:33 | |
odyssey4me | I've been having to do a *lot* of rechecks over the last 36 hours. | 15:33 |
*** hongbin has quit IRC | 15:34 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert server group tests to requests_mock https://review.openstack.org/475181 | 15:41 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert Server Groups to REST https://review.openstack.org/475182 | 15:41 |
*** hongbin has joined #openstack-infra | 15:41 | |
*** hongbin_ has quit IRC | 15:43 | |
fungi | odyssey4me: clarkb worked out that one of teh .org tld servers is intermittently returning bad results for lots of names and so recursion ends up negative caching some failures as a result. not sure there's much more we can do to work around that if it's an issue globally | 15:46 |
*** e0ne has quit IRC | 15:49 | |
*** baoli has joined #openstack-infra | 15:50 | |
*** markvoelker has quit IRC | 15:52 | |
fungi | 2001:500:c::1 a.k.a. b0.org.afilias-nst.org is the one he mentioned being an issue | 15:53 |
fungi | odyssey4me: we also merged a change of clarkb's to add error logging for unbound which should have made it into today's images | 15:55 |
fungi | so maybe we can narrow down the issue a little better | 15:55 |
clarkb | ya next step will be grabbing that log file in jobs | 15:55 |
clarkb | or just dumping its contents or something | 15:56 |
clarkb | /var/log/unbound.log | 15:56 |
*** e0ne has joined #openstack-infra | 15:56 | |
clarkb | if we can pin it to that host in our job logs there then next step is file a bug with the nameserver I think | 15:58 |
*** baoli has quit IRC | 15:59 | |
openstackgerrit | Tom Barron proposed openstack-infra/project-config master: Promote manila lvm centos 7 job to voting https://review.openstack.org/472302 | 15:59 |
fungi | nothing of note in recent nanog posts at least | 16:03 |
*** thorst has joined #openstack-infra | 16:05 | |
*** hongbin_ has joined #openstack-infra | 16:10 | |
*** ykarel_ has joined #openstack-infra | 16:11 | |
*** hongbin has quit IRC | 16:11 | |
*** thorst has quit IRC | 16:12 | |
*** gomarivera has joined #openstack-infra | 16:14 | |
*** hongbin_ has quit IRC | 16:15 | |
*** hongbin has joined #openstack-infra | 16:16 | |
*** gomarivera has quit IRC | 16:18 | |
*** e0ne has quit IRC | 16:20 | |
*** e0ne has joined #openstack-infra | 16:21 | |
*** e0ne has quit IRC | 16:21 | |
*** e0ne has joined #openstack-infra | 16:24 | |
*** bobh has quit IRC | 16:27 | |
*** ykarel_ has quit IRC | 16:33 | |
*** gomarivera has joined #openstack-infra | 16:34 | |
*** armax has joined #openstack-infra | 16:36 | |
*** tesseract has quit IRC | 16:38 | |
*** nicolasbock has joined #openstack-infra | 16:41 | |
*** armax has quit IRC | 16:44 | |
*** markvoelker has joined #openstack-infra | 16:50 | |
*** hongbin_ has joined #openstack-infra | 16:58 | |
openstackgerrit | Egor Borisov proposed openstack-infra/jenkins-job-builder master: Adds integration with Allure Report plugin for Jenkins into the `publishers` section. https://review.openstack.org/475185 | 16:59 |
*** hongbin has quit IRC | 17:00 | |
*** hongbin_ has quit IRC | 17:03 | |
*** gomarivera has quit IRC | 17:04 | |
*** gomarivera has joined #openstack-infra | 17:05 | |
*** e0ne has quit IRC | 17:05 | |
*** e0ne has joined #openstack-infra | 17:05 | |
*** hongbin has joined #openstack-infra | 17:06 | |
*** e0ne has quit IRC | 17:06 | |
*** e0ne has joined #openstack-infra | 17:06 | |
*** e0ne has quit IRC | 17:07 | |
*** e0ne has joined #openstack-infra | 17:07 | |
*** e0ne has quit IRC | 17:07 | |
*** e0ne has joined #openstack-infra | 17:08 | |
*** e0ne has quit IRC | 17:08 | |
*** superdan is now known as dansmith | 17:08 | |
*** e0ne has joined #openstack-infra | 17:09 | |
*** e0ne has quit IRC | 17:09 | |
*** gomarivera has quit IRC | 17:09 | |
*** hongbin has quit IRC | 17:10 | |
*** hongbin has joined #openstack-infra | 17:11 | |
*** salv-orl_ has joined #openstack-infra | 17:16 | |
*** gomarivera has joined #openstack-infra | 17:18 | |
*** salv-orlando has quit IRC | 17:18 | |
*** markvoelker has quit IRC | 17:23 | |
*** gomarivera has quit IRC | 17:30 | |
*** gomarivera has joined #openstack-infra | 17:31 | |
*** hongbin has quit IRC | 17:32 | |
*** gomarivera has quit IRC | 17:35 | |
*** bobh has joined #openstack-infra | 17:39 | |
*** bobh has quit IRC | 17:42 | |
*** gomarivera has joined #openstack-infra | 17:43 | |
*** AJaeger has joined #openstack-infra | 17:45 | |
AJaeger | infra-root, I see two project-config changes in the gate queue - waiting for a job since over 30 mins. https://review.openstack.org/#/c/472499/ is the first one - waiting for ubuntu-xenial node. we should have 19 ready nodes... | 17:47 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert hypervisor test to requests_mock https://review.openstack.org/475186 | 18:00 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert hypervisor list to REST https://review.openstack.org/475187 | 18:00 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert host aggregate tests to requests_mock https://review.openstack.org/475188 | 18:00 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert host aggregates calls to REST https://review.openstack.org/475189 | 18:00 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert remaining nova tests to requests_mock https://review.openstack.org/475190 | 18:00 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Translate final nova calls to REST https://review.openstack.org/475191 | 18:00 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Remove novaclient from shade's dependencies https://review.openstack.org/475192 | 18:00 |
*** thorst has joined #openstack-infra | 18:01 | |
*** thorst has quit IRC | 18:02 | |
fungi | AJaeger: i count a total of 6 ubuntu-xenial in a ready state, all for just a few seconds except one which looks like it's been sitting stale for nearly a month | 18:07 |
fungi | i'm going to delete that one just to keep tidy | 18:07 |
*** dkehn has joined #openstack-infra | 18:08 | |
fungi | i wonder if the mergers are having a problem | 18:13 |
*** kzaitsev1pi has joined #openstack-infra | 18:18 | |
*** kzaitsev_pi has quit IRC | 18:18 | |
fungi | 2017-06-18 17:17:39,321 DEBUG zuul.Repo: CreateZuulRef master/Z3f73e4f638184f898b1f08ff55fcf9b1 at 7b6e516128071203bf760314f029614e9622199e on <git.Repo "/var/lib/zuul/git/openstack-infra/project-config/.git"> | 18:19 |
fungi | that looks okay | 18:19 |
*** markvoelker has joined #openstack-infra | 18:20 | |
mordred | fungi: maybe the configure-mirrors nodepool script combined with the ongoing dns issues is just causing nodepool to be slowering getting working nodes out there? | 18:23 |
fungi | well, it seems to be handing nodes out to other (lower priority) jobs | 18:24 |
fungi | 2017-06-18 17:06:34,447 INFO zuul.Gearman: Launch job gate-project-config-layout (uuid: dc445a8f1380470b87aa9daf067e4c9b) for change <Change 0x7fd3fcb22e90 472499,1> with dependent changes [] | 18:29 |
fungi | so the scheduler at least got that far | 18:29 |
fungi | 2017-06-18 17:06:34,449 DEBUG zuul.DependentPipelineManager: Adding build <Build dc445a8f1380470b87aa9daf067e4c9b of gate-project-config-layout on <Worker Unknown>> of job gate-project-config-layout to item <QueueItem 0x7fd37ec23750 for <Change 0x7fd3fcb22e90 472499,1> in gate> | 18:30 |
fungi | i see no further reference to Build dc445a8f1380470b87aa9daf067e4c9b in the scheduler's debug log | 18:31 |
fungi | gearman shows two outstanding jobs for build:gate-project-config-layout which are i think the ones in the gate | 18:35 |
fungi | AJaeger: wild goose chase there... gate-project-config-layout uses ubuntu-trusty nodes, not ubuntu-xenial | 18:37 |
fungi | we have zero ready ubuntu-trusty nodes | 18:38 |
fungi | only building and delete | 18:38 |
fungi | no used either | 18:38 |
fungi | probably we just put new images into rotation and the trusty ones aren't booting to completion | 18:39 |
fungi | yeah, they all got uploaded around 2.5-3 hours ago | 18:40 |
mordred | fungi: ahhh. yah -that would do it | 18:40 |
fungi | i can go ahead and delete these for now so we build from yesterday's images | 18:40 |
fungi | oh, though we need to pause rebuilding for ubuntu-trusty to do that, right? | 18:41 |
*** dhinesh has joined #openstack-infra | 18:42 | |
fungi | i need to go attend to the grill for a few minutes, but can work out how to do that when i get back if nobody else beats me to it | 18:42 |
*** links has joined #openstack-infra | 18:49 | |
*** markvoelker has quit IRC | 18:52 | |
*** eranrom has quit IRC | 19:01 | |
fungi | clarkb: looks from the debug output like we've somehow tanked unbound on ubuntu-trusty. consistent ready node script failures attempting to lookup git.openstack.org: "connection timed out; no servers could be reached" | 19:02 |
*** armax has joined #openstack-infra | 19:03 | |
*** yamahata_ has joined #openstack-infra | 19:05 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config master: Pause rebuilding ubuntu-trusty images https://review.openstack.org/475195 | 19:05 |
fungi | if someone wants to quick-approve that ^ then i'll delete the latest ubuntu-trusty images once it lands | 19:06 |
mordred | fungi: done | 19:10 |
*** eranrom has joined #openstack-infra | 19:10 | |
fungi | much appreciated | 19:11 |
mordred | fungi: yay for sundays! | 19:11 |
*** HeOS has joined #openstack-infra | 19:11 | |
fungi | oh, right, that change is never going to pass testing because it will wait indefinitely for a node | 19:18 |
*** mhickey has joined #openstack-infra | 19:19 | |
*** eranrom has quit IRC | 19:19 | |
fungi | rather than figure out which of the various nodepool servers i need to add to the emergency list and manually apply that change on, i'm just going to bypass gating | 19:19 |
openstackgerrit | Merged openstack-infra/project-config master: Pause rebuilding ubuntu-trusty images https://review.openstack.org/475195 | 19:21 |
*** gomarivera has quit IRC | 19:25 | |
*** gomarivera has joined #openstack-infra | 19:26 | |
*** thorst has joined #openstack-infra | 19:34 | |
*** thorst has quit IRC | 19:34 | |
*** armax has quit IRC | 19:37 | |
*** links has quit IRC | 19:38 | |
*** yamahata_ has quit IRC | 19:44 | |
fungi | voluptuous.error.MultipleInvalid: extra keys not allowed @ data['labels'][1]['pause'] | 19:47 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config master: Move ubuntu-trusty image pause to correct section https://review.openstack.org/475196 | 19:49 |
fungi | self-approving and manually merging that ^ now | 19:49 |
*** markvoelker has joined #openstack-infra | 19:50 | |
openstackgerrit | Merged openstack-infra/project-config master: Move ubuntu-trusty image pause to correct section https://review.openstack.org/475196 | 19:50 |
openstackgerrit | Merged openstack-infra/shade master: Remove use of FakeServer from tests https://review.openstack.org/475177 | 19:51 |
openstackgerrit | Merged openstack-infra/shade master: Convert FakeSecGroup to dict https://review.openstack.org/475178 | 19:51 |
openstackgerrit | Merged openstack-infra/shade master: Convert server group tests to requests_mock https://review.openstack.org/475181 | 19:52 |
openstackgerrit | Merged openstack-infra/shade master: Convert Server Groups to REST https://review.openstack.org/475182 | 19:52 |
openstackgerrit | Merged openstack-infra/shade master: Convert hypervisor test to requests_mock https://review.openstack.org/475186 | 19:52 |
*** nicolasbock has quit IRC | 19:53 | |
openstackgerrit | Merged openstack-infra/shade master: Convert hypervisor list to REST https://review.openstack.org/475187 | 19:53 |
*** gouthamr has joined #openstack-infra | 19:57 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Add script parsing status multinode periodic jobs https://review.openstack.org/475197 | 20:03 |
*** andreww has joined #openstack-infra | 20:20 | |
*** xarses_ has quit IRC | 20:23 | |
*** markvoelker has quit IRC | 20:24 | |
fungi | grr, pausing seems to just prevent building new images, not reuploading already built existing one. i guess i need to delete the built copy too | 20:28 |
fungi | starting to think the increased complexity warrants a `nodepool image-rollback` subcommand or something | 20:28 |
fungi | do i have to dib-image-delete on the builder where it built, or is the scheduler smart enough to negotiate that through zk? | 20:30 |
fungi | i guess i'll find out | 20:30 |
*** markvoelker has joined #openstack-infra | 20:30 | |
fungi | ahh, nice, that seems to work | 20:30 |
fungi | though now i need to wait for these reuploads to complete before i can delete them again | 20:33 |
fungi | Cannot delete because image upload in progress | 20:33 |
openstackgerrit | Merged openstack-infra/project-config master: Add tempest OOOQ job to experimental for tripleo https://review.openstack.org/472499 | 20:34 |
openstackgerrit | Merged openstack-infra/project-config master: Run gate-tempest-dsvm-neutron-multinode-full in devstack check https://review.openstack.org/471016 | 20:35 |
fungi | at least project-config is dislodged again | 20:36 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Add multinode jobs to promotion https://review.openstack.org/475200 | 20:44 |
*** yamamoto has joined #openstack-infra | 20:50 | |
*** yamamoto has quit IRC | 20:54 | |
*** wolverineav has joined #openstack-infra | 20:55 | |
*** xarses_ has joined #openstack-infra | 21:01 | |
*** xarses has joined #openstack-infra | 21:04 | |
*** xarses_ has quit IRC | 21:06 | |
*** jascott1 has quit IRC | 21:07 | |
*** arxcruz|off is now known as arxcruz | 21:09 | |
*** xarses has quit IRC | 21:21 | |
*** askb has joined #openstack-infra | 21:26 | |
fungi | hah, so it uploaded them all but auto-deleted them as soon as each one was uploaded | 21:28 |
fungi | #status log Image builds for ubuntu-trusty are paused and have been rolled back to yesterday until DNS issues can be unraveled | 21:29 |
openstackstatus | fungi: finished logging | 21:29 |
*** aeng has joined #openstack-infra | 21:32 | |
*** thorst has joined #openstack-infra | 21:35 | |
*** wolverineav has quit IRC | 21:39 | |
*** thorst has quit IRC | 21:40 | |
*** funzo has quit IRC | 21:42 | |
openstackgerrit | Merged openstack-infra/shade master: Convert host aggregate tests to requests_mock https://review.openstack.org/475188 | 21:48 |
*** salv-orl_ has quit IRC | 22:01 | |
*** jkilpatr has quit IRC | 22:04 | |
*** dhinesh has quit IRC | 22:07 | |
*** dizquierdo has quit IRC | 22:14 | |
*** Julien-zte has joined #openstack-infra | 22:18 | |
*** Julien-zte has quit IRC | 22:30 | |
*** Julien-zte has joined #openstack-infra | 22:30 | |
*** hongbin has joined #openstack-infra | 22:39 | |
*** mhickey has quit IRC | 22:44 | |
*** tosky has quit IRC | 22:49 | |
*** SamYaple has quit IRC | 23:02 | |
*** SamYaple has joined #openstack-infra | 23:03 | |
openstackgerrit | Merged openstack-infra/shade master: Convert host aggregates calls to REST https://review.openstack.org/475189 | 23:13 |
clarkb | fungi doea trust unbound not like that config? | 23:14 |
fungi | clarkb: that's what i'm expecting based on purely circumstantial evidence right now. i haven't tested it, just saw that our latest trusty images had no working dns resolution | 23:18 |
fungi | figure it's not the end of the world if trusty images are a day or two stale for now, so long as jobs keep flowing | 23:19 |
clarkb | kk | 23:20 |
*** dhinesh has joined #openstack-infra | 23:20 | |
*** jascott1 has joined #openstack-infra | 23:22 | |
*** dimtruck is now known as zz_dimtruck | 23:32 | |
*** thorst has joined #openstack-infra | 23:36 | |
*** armax has joined #openstack-infra | 23:37 | |
*** Julien-zte has quit IRC | 23:39 | |
*** thorst has quit IRC | 23:41 | |
*** hongbin has quit IRC | 23:44 | |
*** hongbin has joined #openstack-infra | 23:45 | |
*** armax has quit IRC | 23:53 | |
*** lbragstad has joined #openstack-infra | 23:53 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!